llama.cpp build b10835 resolves a critical divergence bug within f16 FlashAttention on CUDA backends. The update also streamlines execution paths on NVIDIA hardware by preventing redundant metadata pointer assignment.
What changed
Build b10835 addresses issue #27870 in the llama.cpp repository, targeting correctness and efficiency issues specific to the CUDA backend. The primary fix centers on divergent execution paths within the f16 FlashAttention implementation. When processing half-precision floating-point attention mechanisms on NVIDIA GPUs, thread synchronization and branch divergence could previously lead to unstable execution or calculation errors under specific workloads.
In addition to fixing the branch barrier bug, the release removes redundant assignments of metadata pointers within the CUDA execution kernels. By avoiding this overhead, the update streamlines the dispatch path on NVIDIA hardware, ensuring that execution flow proceeds without unnecessary pointer recalculations.
Binaries and source distributions incorporating these changes are available on GitHub for macOS, Linux, and Windows, though the core algorithmic and kernel fixes directly benefit CUDA-enabled configurations.
Who this affects
This release directly affects developers, self-hosters, and local inference practitioners running quantized or unquantized models on NVIDIA consumer and enterprise GPUs using the CUDA backend. Those who have experienced sporadic failures, performance degradation, or numerical instability specifically related to FlashAttention operations under f16 precision will find relevant fixes here.
Users running exclusively on CPU-only setups, Apple Silicon (Metal), or alternative accelerator backends without NVIDIA hardware are unaffected by this specific CUDA kernel patch, as the changes do not alter model files (such as GGUF formatting) or CPU-bound execution graphs.
Verdict
Upgrade immediately if running llama.cpp with the CUDA backend, particularly on setups utilizing f16 FlashAttention. The resolution of issue #27870 provides necessary stability for prolonged inference sessions and eliminates subtle branch divergence bugs on NVIDIA hardware. There are no breaking API changes or configuration shifts required to adopt this tag; standard source compilation or binary replacement is sufficient.
Source: llama.cpp
Also shipping today
- [vLLM] vLLM v0.28.0がリリース (vLLM) (https://github.com/vllm-project/vllm/releases/tag/v0.28.0)
- [Stockfish (chess NNUE)] Stockfish 19がリリース (Stockfish (chess NNUE)) (https://github.com/official-stockfish/Stockfish/releases/tag/sf_19)
- [Claude Code] Claude Code v2.1.260 公式リリース
- [Anthropic SDK (Python)] Anthropic SDK (Python) v1.4.0 公式リリース
- [MCP Python SDK] MCP Python SDK v2.0.1 公式リリース
- [TensorRT-LLM] TensorRT-LLM v1.3.0rc25がリリース (GitHub) (https://github.com/NVIDIA/TensorRT-LLM/releases/tag/v1.3.0rc25)
Tracked daily from official release feeds and vendor changelogs. Full archive: https://media.patentllm.org
Top comments (0)