DEV Community

# vllm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Compiling the Vision Encoder: Squeezing 3% More Throughput from Qwen3-VL on Hopper GPUs
mketkar profile

Compiling the Vision Encoder: Squeezing 3% More Throughput from Qwen3-VL on Hopper GPUs

#vllm #pytorch #gpu #machinelearning
Comments
11 min read
Running Claude Code with Local LLMs via vLLM and LiteLLM
dcruver profile

Running Claude Code with Local LLMs via vLLM and LiteLLM

#claudecode #vllm #selfhosted #ai
Comments
6 min read
vLLM — Session 2: The Engine Layer — Request Management
c2sea profile
Ben

vLLM — Session 2: The Engine Layer — Request Management

#vllm #llm #python #machinelearning
Comments
13 min read
Session 1: vLLM Overview and the User API
c2sea profile
Ben

Session 1: vLLM Overview and the User API

#vllm #llm #python #machinelearning
Comments
12 min read
Pare de Brincar com LLMs Locais: Leve a IAG Open Source para a Produção na Magalu Cloud
glaucioripol profile

Pare de Brincar com LLMs Locais: Leve a IAG Open Source para a Produção na Magalu Cloud

#ai #llm #vllm #docker
1
Comments 3
22 min read
The Hidden Switchboard Behind vLLM Attention
mahmoudz profile

The Hidden Switchboard Behind vLLM Attention

#vllm #llm #attention #aiinference
Comments
10 min read
The Ultimate LLM Inference Battle: vLLM vs. Ollama vs. ZML
raphiki profile

The Ultimate LLM Inference Battle: vLLM vs. Ollama vs. ZML

#qsos #zml #ollama #vllm
1
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.