DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
7 things I learned trying to stop LLM API bills from silently exploding

7 things I learned trying to stop LLM API bills from silently exploding

4
Comments 13
3 min read
LLM-as-Judge Shouldn't Aggregate Scores: Binary Checks as Evidence, One Holistic Verdict

LLM-as-Judge Shouldn't Aggregate Scores: Binary Checks as Evidence, One Holistic Verdict

Comments
12 min read
Building an MCP Server in Python — Architecture, FastMCP, and Production Code

Building an MCP Server in Python — Architecture, FastMCP, and Production Code

2
Comments
8 min read
The Prefill Wall: Why MTP's 2 Barely Moves Long-Context Latency (Qwen3.6-27B, RTX 3090)

The Prefill Wall: Why MTP's 2 Barely Moves Long-Context Latency (Qwen3.6-27B, RTX 3090)

Comments
4 min read
My Home AI's First Reply Took Four Minutes. Now It Takes Eleven Seconds.

My Home AI's First Reply Took Four Minutes. Now It Takes Eleven Seconds.

2
Comments
4 min read
The OWASP Agentic Top 10, explained for practitioners

The OWASP Agentic Top 10, explained for practitioners

1
Comments
4 min read
I Built an AI Agent That Writes Tests, Finds Bugs, and Opens PRs — Autonomously

I Built an AI Agent That Writes Tests, Finds Bugs, and Opens PRs — Autonomously

Comments 1
5 min read
How to Build AI Agents from Scratch with FastAPI

How to Build AI Agents from Scratch with FastAPI

Comments
8 min read
Kubernetes in LLMOps (Part 2): GPU Efficiency, Cost Engineering, and Real-World Failure Modes

Kubernetes in LLMOps (Part 2): GPU Efficiency, Cost Engineering, and Real-World Failure Modes

1
Comments 1
5 min read
Building a Robust RAG Pipeline Architecture for Production

Building a Robust RAG Pipeline Architecture for Production

Comments
7 min read
I was fine-tuning a language model on a new language. The loss was perfect. It spoke Chinese.

I was fine-tuning a language model on a new language. The loss was perfect. It spoke Chinese.

Comments
3 min read
Model routing by task type: the savings math, the classifier overhead, and the A/B that proves it

Model routing by task type: the savings math, the classifier overhead, and the A/B that proves it

Comments
12 min read
No AI Claim Without a Kill Condition: Falsifier-Driven AI Decisions

No AI Claim Without a Kill Condition: Falsifier-Driven AI Decisions

1
Comments 2
5 min read
Context Compaction Visualizer: See Exactly What Your AI Agent Forgot Before It Costs You

Context Compaction Visualizer: See Exactly What Your AI Agent Forgot Before It Costs You

8
Comments 4
7 min read
The Hidden Economics of AI: What It Actually Costs to Run LLMs in Production (With Real Data)

The Hidden Economics of AI: What It Actually Costs to Run LLMs in Production (With Real Data)

1
Comments 1
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.