DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Claude Code Token Usage: Monitor It with an AI Gateway

Claude Code Token Usage: Monitor It with an AI Gateway

5
Comments 2
13 min read
Gemini's free tier, measured: 20 requests a day, and Google no longer publishes the number

Gemini's free tier, measured: 20 requests a day, and Google no longer publishes the number

Comments
5 min read
llama-server's logprobs are placeholders when speculative decoding is on

llama-server's logprobs are placeholders when speculative decoding is on

1
Comments 2
7 min read
I Compared 5 GPU Clouds for LLM Inference in 2026 — Here's What I Found

I Compared 5 GPU Clouds for LLM Inference in 2026 — Here's What I Found

Comments
2 min read
Sarvam Arya: Production Agent Orchestration Stack Exposes State, Routing, and Recovery Plumbing

Sarvam Arya: Production Agent Orchestration Stack Exposes State, Routing, and Recovery Plumbing

1
Comments 1
6 min read
I built a deterministic LLM evaluation engine without an LLM judge

I built a deterministic LLM evaluation engine without an LLM judge

Comments
3 min read
LLM fine-tuning 101: a practical guide for developers

LLM fine-tuning 101: a practical guide for developers

Comments
5 min read
RAG for Developers: What Actually Happens Between a User Query and an AI Answer

RAG for Developers: What Actually Happens Between a User Query and an AI Answer

Comments
4 min read
LLM VRAM requirements: what fits on 8, 16, 24, 48 and 80GB

LLM VRAM requirements: what fits on 8, 16, 24, 48 and 80GB

Comments 3
5 min read
Best LLM Gateways in 2026: A Production-Ready Comparison

Best LLM Gateways in 2026: A Production-Ready Comparison

5
Comments 5
15 min read
The Production AI Checklist That Nobody Publishes.

The Production AI Checklist That Nobody Publishes.

Comments
4 min read
Built a zero-latency AST bouncer for local agent tool-calling

Built a zero-latency AST bouncer for local agent tool-calling

1
Comments
1 min read
Why averaging LLM benchmarks gives the wrong leaderboard

Why averaging LLM benchmarks gives the wrong leaderboard

5
Comments 4
6 min read
Your Agent's Free-Text Output Is an API You Never Designed

Your Agent's Free-Text Output Is an API You Never Designed

Comments 2
4 min read
The 48-Hour Verdict: Sort Your AI Failures Before You Fix Them

The 48-Hour Verdict: Sort Your AI Failures Before You Fix Them

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.