ExLlamaSharp v1.4.1 is out.
Local LLM server for Windows with NVIDIA GPUs — OpenAI-compatible /v1, Blazor admin, and EXL3 inference.
Release notes
ExLlamaSharp 1.4.1
- Tray + Admin update checks against GitHub Releases (About page download)
- English load-profile labels and installer scripts
- Builds on 1.4.0 Multi-GPU / AdminLTE baseline
Download: ExLlamaSharp-Setup-win-x64.exe
Full notes: https://github.com/Kortexio/ExLlamaSharp/releases/tag/v1.4.1
Top comments (0)