DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Admission Control for Self-Hosted LLMs: Rejecting Requests Before the KV Cache OOMs You

Admission Control for Self-Hosted LLMs: Rejecting Requests Before the KV Cache OOMs You

Comments 3
6 min read
Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model

Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model

Comments 2
3 min read
A Letter to the Founder, From the Thing He is Building With

A Letter to the Founder, From the Thing He is Building With

Comments
3 min read
The Age of the One-Minute Expert

The Age of the One-Minute Expert

Comments
4 min read
Your AI Agent Worked in the Demo. Here's Why It's Failing in Production.

Your AI Agent Worked in the Demo. Here's Why It's Failing in Production.

Comments
3 min read
Corrective RAG for billing: the bug is not retrieval, it's the model narrating correct numbers wrong

Corrective RAG for billing: the bug is not retrieval, it's the model narrating correct numbers wrong

1
Comments 2
8 min read
Context Engineering: Why It’s Replacing Prompt Engineering in Modern AI Systems

Context Engineering: Why It’s Replacing Prompt Engineering in Modern AI Systems

1
Comments
9 min read
We Stress-Tested a Live AI Chatbot. It Invented a Fake Identity, Cited Fake Statistics, and Scored 55/100.

We Stress-Tested a Live AI Chatbot. It Invented a Fake Identity, Cited Fake Statistics, and Scored 55/100.

Comments
4 min read
ComfyUI, Lemonade, and LocalAI: Scouting the Next Wave of Homelab AI Tools

ComfyUI, Lemonade, and LocalAI: Scouting the Next Wave of Homelab AI Tools

Comments
7 min read
PIVOT Explained — From Paper to Working Code in 10 Minutes

PIVOT Explained — From Paper to Working Code in 10 Minutes

2
Comments
4 min read
llms.txt: what it is and how to add one

llms.txt: what it is and how to add one

Comments
7 min read
Treat the Context Window Like a Budget, Not a Junk Drawer

Treat the Context Window Like a Budget, Not a Junk Drawer

Comments
4 min read
China's AI Chip Rebellion Has a New Name

China's AI Chip Rebellion Has a New Name

Comments
2 min read
Your PII redactor probably leaks tool-call arguments

Your PII redactor probably leaks tool-call arguments

Comments
3 min read
Budget enforcement for multi-agent LLM systems (without a proxy)

Budget enforcement for multi-agent LLM systems (without a proxy)

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.