DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
We removed 98.77% of an LLM’s input. Accuracy went up.

We removed 98.77% of an LLM’s input. Accuracy went up.

Comments
3 min read
What Does It Actually Cost to Self-Host an LLM? The Batching Math Nobody Shows You

What Does It Actually Cost to Self-Host an LLM? The Batching Math Nobody Shows You

Comments
6 min read
Giving Your LLM Agent Web Search Without Burning Money: Self-hosted SearXNG, Caching and Citation Checks

Giving Your LLM Agent Web Search Without Burning Money: Self-hosted SearXNG, Caching and Citation Checks

Comments
8 min read
Best practices for implementing LLM access controls and monitoring

Best practices for implementing LLM access controls and monitoring

1
Comments
3 min read
How Much Memory Does Your Agent Actually Need?

How Much Memory Does Your Agent Actually Need?

Comments
7 min read
Your AI Agent Has a Burn Rate: Governing the Cost of Production AI Agents on AWS

Your AI Agent Has a Burn Rate: Governing the Cost of Production AI Agents on AWS

1
Comments
3 min read
Two Protocols, Three Translations: How a Host Bridges MCP and an LLM Provider API

Two Protocols, Three Translations: How a Host Bridges MCP and an LLM Provider API

Comments
14 min read
Show Me the Diagram

Show Me the Diagram

Comments
6 min read
1,107 Tokens Per Second: The LLM That Doesn't Type

1,107 Tokens Per Second: The LLM That Doesn't Type

Comments
5 min read
GEO vs SEO: what actually changes when AI answers the question

GEO vs SEO: what actually changes when AI answers the question

Comments
3 min read
brethof-brain launches today: memory for AI agents that is already there when the session starts

brethof-brain launches today: memory for AI agents that is already there when the session starts

Comments
5 min read
Overcoming LLM Knowledge Gap: Balancing AI Tool Use with Advanced Local Model Understanding

Overcoming LLM Knowledge Gap: Balancing AI Tool Use with Advanced Local Model Understanding

Comments
12 min read
Stop managing six AI vendor accounts: one key for 109 models

Stop managing six AI vendor accounts: one key for 109 models

Comments
3 min read
VIDRAFT Tops 10 Hugging Face Official Leaderboards — A Real-Time Map of All 48 Benchmarks Is Now Public

VIDRAFT Tops 10 Hugging Face Official Leaderboards — A Real-Time Map of All 48 Benchmarks Is Now Public

Comments
4 min read
The Two-Phase Machine: Your LLM Request Is Two Jobs in a Trench Coat

The Two-Phase Machine: Your LLM Request Is Two Jobs in a Trench Coat

Comments 1
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.