DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
97% of what my coding agent billed for was re-reading its own context

97% of what my coding agent billed for was re-reading its own context

1
Comments 2
5 min read
Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU

Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU

1
Comments 1
11 min read
Your LLM bill has two levers. Your team only pulls one.

Your LLM bill has two levers. Your team only pulls one.

Comments
3 min read
I Found 35+ Text-Generation LLM Providers That Are Entirely Free And Replenishable

I Found 35+ Text-Generation LLM Providers That Are Entirely Free And Replenishable

Comments
3 min read
The Dedicated OCR Engine Lost to the General-Purpose Model — 300 Slower

The Dedicated OCR Engine Lost to the General-Purpose Model — 300 Slower

1
Comments
4 min read
Consolidation: the half of agent memory nobody builds

Consolidation: the half of agent memory nobody builds

Comments 3
5 min read
Ollama's gemma4 renderer silently drops tool parameters named type or description, and the model invents a value

Ollama's gemma4 renderer silently drops tool parameters named type or description, and the model invents a value

2
Comments 2
7 min read
Why BEAM Is a Good Memory Benchmark for AI Agents

Why BEAM Is a Good Memory Benchmark for AI Agents

Comments
6 min read
Stop Naive Vector Lookup: Boost RAG Recall with Spring AI HyDE Query Rewriting

Stop Naive Vector Lookup: Boost RAG Recall with Spring AI HyDE Query Rewriting

Comments
2 min read
Anthropic's Production Agent Guardrails: Lint Rules, Fuzzers, and Automated Reviews for Claude-Generated Code

Anthropic's Production Agent Guardrails: Lint Rules, Fuzzers, and Automated Reviews for Claude-Generated Code

2
Comments 1
7 min read
Hermes Soul, Copilot Shell: Inline Editing in VS Code with Your Hermes Agent

Hermes Soul, Copilot Shell: Inline Editing in VS Code with Your Hermes Agent

Comments
12 min read
Cheap Model First, Strong Model on Failure: Building an Auditable Two-Tier LLM Pipeline

Cheap Model First, Strong Model on Failure: Building an Auditable Two-Tier LLM Pipeline

Comments
6 min read
Treat Every “Cheap and Great” Model Release as a Hypothesis: A Reproducible LLM Cost-Quality Router

Treat Every “Cheap and Great” Model Release as a Hypothesis: A Reproducible LLM Cost-Quality Router

Comments
4 min read
Security Basics for AI Apps and APIs

Security Basics for AI Apps and APIs

Comments
4 min read
Per-Tenant Media Scheduling Explained: Node.js LLM JSON Schema for Ticket Tags

Per-Tenant Media Scheduling Explained: Node.js LLM JSON Schema for Ticket Tags

Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.