DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Caching LLM Responses on Your Side: An Exact-Match Cache in Front of Any OpenAI-Compatible API (Python)

Caching LLM Responses on Your Side: An Exact-Match Cache in Front of Any OpenAI-Compatible API (Python)

Comments
5 min read
[Hermes Agent] Fixing Voice Memo Skill Misidentification via pre_gateway_dispatch

[Hermes Agent] Fixing Voice Memo Skill Misidentification via pre_gateway_dispatch

Comments
3 min read
# I Built a Local AI Pet That Yells at You to Go Outside — No Cloud, No API Keys

# I Built a Local AI Pet That Yells at You to Go Outside — No Cloud, No API Keys

Comments
2 min read
Your Structured Output Passed Once. Build a Tiny Schema Gate in TypeScript.

Your Structured Output Passed Once. Build a Tiny Schema Gate in TypeScript.

1
Comments
9 min read
Choosing a Local LLM Through Fate (2026 Edition)

Choosing a Local LLM Through Fate (2026 Edition)

2
Comments
28 min read
Qwen-Image-2.1-Turbo Isn't 7B: The VRAM You Actually Need to Run It Locally

Qwen-Image-2.1-Turbo Isn't 7B: The VRAM You Actually Need to Run It Locally

Comments
7 min read
What an AI agent actually is

What an AI agent actually is

Comments
3 min read
The Gateway, the Registry and the Executor: Keeping Groq at the Edge of My Backend

The Gateway, the Registry and the Executor: Keeping Groq at the Edge of My Backend

1
Comments
9 min read
Model Fallback Chains on One OpenAI-Compatible Base URL: When to Switch Models and How (Python)

Model Fallback Chains on One OpenAI-Compatible Base URL: When to Switch Models and How (Python)

Comments
5 min read
How I Built an Open-Source LLM Key-Pool Gateway (and Why You Might Want One)

How I Built an Open-Source LLM Key-Pool Gateway (and Why You Might Want One)

Comments 1
6 min read
Can AI Tell When Evidence Is Not Enough?

Can AI Tell When Evidence Is Not Enough?

Comments
4 min read
Stop Restarting Failed Loops: Resumable ReAct Agents with Spring AI State Checkpointing

Stop Restarting Failed Loops: Resumable ReAct Agents with Spring AI State Checkpointing

Comments
2 min read
How a Private RAG Assistant Answers From Your Own Documents

How a Private RAG Assistant Answers From Your Own Documents

Comments
8 min read
From BASALT to CLAUDE, CHATgpt, Gemini

From BASALT to CLAUDE, CHATgpt, Gemini

1
Comments
2 min read
Gemini 4 Argon Costs $2 Per Million Tokens. Your Real Bill Will Disagree.

Gemini 4 Argon Costs $2 Per Million Tokens. Your Real Bill Will Disagree.

1
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.