ExLlamaSharp v1.3.2: what shipped

ExLlamaSharp v1.3.2 is out.

Local LLM server for Windows with NVIDIA GPUs — OpenAI-compatible /v1, Blazor admin, and EXL3 inference.

Release notes

Summary

• Fix false installation-failed dialog in desktop mode (Tray started after /health probe).
• Installer no longer aborts the Inno wizard when /health is still warming up.

Install

Download ExLlamaSharp-Setup-win-x64.exe, run as Administrator, choose Desktop mode.

Full notes: https://github.com/Kortexio/ExLlamaSharp/releases/tag/v1.3.2

Repo: https://github.com/Kortexio/ExLlamaSharp