Skip to content

DEV Community

# quantization

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Alan West

Apr 18

Traditional Quantization vs 1.58-Bit Ternary Models: A Practical Comparison

#machinelearning #llm #quantization #ai

5 min read

Denis Lavrentyev

Apr 13

GIMP's Posterization: Simple Quantization vs. Median Cut for Better Visuals

#gimp #posterization #quantization #mediancut

8 min read

plasmon

Apr 8

Q4 KV Cache Fit 32K Context into 8GB VRAM — Only Math Broke

#llm #quantization #vram #localllm

8 min read

Mar 30

Building a Vector Database That Never Decompresses Your Vectors

#vectordatabase #quantization #turboquant #go

16 min read

TildAlice

Feb 22

TorchAO vs ONNX Runtime: 8-bit Quantization Benchmark

#quantization #llminference #pytorch #onnx

1 min read

Hector Li

Feb 11

Bringing 2-Bit Quantization to ONNX Runtime's WebGPU Backend

#onnxruntime #webgpu #2bit #quantization

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.