Skip to content

DEV Community

# llm

👋 Sign in for the ability to sort posts by relevant, latest, or top.

May 26

Prefix caching in vLLM under multi-tenant agent traffic

#llm #mlops #infrastructure #pytorch

4 min read

May 21

I used LLMs to rewrite meta descriptions for 1,600 articles — honest results

#ai #seo #webdev #llm

5 min read

hummingbirdLabs

May 25

Using Qwen 3.6 Plus: Great but a Bit Expensive

#ai #csharp #llm #programming

2 min read

Karthik S

May 21

Our AI Inference Bill Dropped 65% After We Stopped Treating Every Query the Same

#ai #javascript #llm #backend

5 min read

soy

May 21

Qwen 3.6 & llama.cpp Push Local Inference Limits on Consumer GPUs

#ai #llm #selfhosted

3 min read

May 22

AI Weekly — 2026-05-15 to 2026-05-22 | The Agentic Inflection Is Real, But the Enterprise Gap Is Wider Than Ever

#ai #machinelearning #tech #llm

4 min read

Aimilios Vikatos

May 21

I tested cheap vs expensive LLMs across 3 real agent tasks. The cheap model won every time.

#ai #python #llm #opensource

4 min read

May 21

Routing Event-Camera Pipelines Through an LLM Gateway: A Field Report

#machinelearning #computervision #mlops #llm

4 min read

May 21

Measuring AI Gateway Failover: 30 Days of Production Data

#mlops #llm #infrastructure #devops

3 min read

May 21

Routing diffusion inference traffic across three providers

#machinelearning #llm #mlops #infrastructure

4 min read

May 22

ToolRouter: Switch AI Coding Tools Freely Without Losing Context

#machinelearning #llm #python #opensource

6 min read

Ritu.R

May 21

Beyond the Stateless Prompt: Building an Auditable Product Intelligence Pipeline with Cascadeflow and Hindsight

#ai #architecture #dataengineering #llm

5 min read

May 21

Putting an LLM Gateway in Front of Our Build Agents

#infrastructure #devops #sre #llm

4 min read

May 21

You Probably Don't Need 8-Bit Quantization

#ai #llm #opensource #hardware

2 min read

May 21

The README Was a Protocol. The Entrypoint Was Still Optional.

#llm #contextengineering #architecture #ai

8 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.