DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Treat streamed LLM output as an uncommitted draft

Treat streamed LLM output as an uncommitted draft

Comments
4 min read
Where AI agent test cases come from: synthetic vs. production data

Where AI agent test cases come from: synthetic vs. production data

Comments 3
4 min read
GRPO: How Language Models Learn to Reason

GRPO: How Language Models Learn to Reason

Comments
4 min read
Our task categorizer routed 46% of tasks. A $0.04/MTok decision model routes 97%.

Our task categorizer routed 46% of tasks. A $0.04/MTok decision model routes 97%.

Comments
3 min read
Why Is Jev So Fast Compared to Traditional LLMs?

Why Is Jev So Fast Compared to Traditional LLMs?

1
Comments 1
3 min read
94.7% on LoCoMo — and why most of the gap between published memory numbers isn't the memory

94.7% on LoCoMo — and why most of the gap between published memory numbers isn't the memory

Comments
9 min read
I went through 14 reports of AI agents burning money. Every budget that failed, failed one of two ways.

I went through 14 reports of AI agents burning money. Every budget that failed, failed one of two ways.

1
Comments
2 min read
Mnemosyne for Hermes Agent: Local Memory Quickstart

Mnemosyne for Hermes Agent: Local Memory Quickstart

Comments
9 min read
We Thought the LLM Was Wrong. Our Safety Detector Was Wrong.

We Thought the LLM Was Wrong. Our Safety Detector Was Wrong.

Comments
1 min read
5 Guardrails That Keep an LLM Agent Shippable in Production

5 Guardrails That Keep an LLM Agent Shippable in Production

Comments
2 min read
Your AI eval is green because it never called the model

Your AI eval is green because it never called the model

Comments 6
6 min read
THIS AI MODEL DOESN'T WANT TO TALK TO YOU

THIS AI MODEL DOESN'T WANT TO TALK TO YOU

Comments
22 min read
How to reduce LLM costs in production: 07 techniques you need to know

How to reduce LLM costs in production: 07 techniques you need to know

Comments
3 min read
How Do You Know When AI Is Wrong? The Case for Evals.

How Do You Know When AI Is Wrong? The Case for Evals.

Comments 1
6 min read
Beyond Autoregression: Running JEV and Open "System 1" Decision Models on Google Cloud

Beyond Autoregression: Running JEV and Open "System 1" Decision Models on Google Cloud

Comments
10 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.