minus-squareLanguages_Learner@alien.topBtoLocalLLaMA•Any interest in C#/.NET for serving LLMs?linkfedilinkEnglisharrow-up1·1 year agoThis may be useful: saddam213/LLamaSharp: C#/.NET binding of llama.cpp, including LLaMa/GPT model inference and quantization, ASP.NET core integration and UI. (github.com) linkfedilink
minus-squareLanguages_Learner@alien.topBtoLocalLLaMA•Any Open Source Local LLM GUI Built with .NET Framework.linkfedilinkEnglisharrow-up1·1 year agosaddam213/LLamaStack: ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp (github.com) linkfedilink
This may be useful: saddam213/LLamaSharp: C#/.NET binding of llama.cpp, including LLaMa/GPT model inference and quantization, ASP.NET core integration and UI. (github.com)