DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why INT4 Weight-Only Quantization Doesn't Speed Up Prefill

Why INT4 Weight-Only Quantization Doesn't Speed Up Prefill

Comments 1
7 min read
Why I made my eval tool refuse to give a score

Why I made my eval tool refuse to give a score

6
Comments
2 min read
What are the leading dedicated AI agent memory layer platforms?

What are the leading dedicated AI agent memory layer platforms?

3
Comments 4
6 min read
Deploying Inference Using NVIDIA Dynamo and vLLM

Deploying Inference Using NVIDIA Dynamo and vLLM

13
Comments
8 min read
I Built an AI That Rewrites Its Own Prompts — Its Safety Gate Rejected Every Single Edit

I Built an AI That Rewrites Its Own Prompts — Its Safety Gate Rejected Every Single Edit

24
Comments 7
8 min read
Why Most AI Agents Fail in Production: 10 Architecture Mistakes Engineers Make

Why Most AI Agents Fail in Production: 10 Architecture Mistakes Engineers Make

1
Comments
9 min read
Everyone's Trying Vectors and Graphs for AI Memory. We Went Back to SQL.

Everyone's Trying Vectors and Graphs for AI Memory. We Went Back to SQL.

Comments 1
4 min read
CI/CD for Agentic AI: Freezing Production Failures Into Hermetic Regression Tests With Tracely-ai

CI/CD for Agentic AI: Freezing Production Failures Into Hermetic Regression Tests With Tracely-ai

Comments
5 min read
The Two-Hour Gatekeeper for a 'Cheap and Capable' Model Announcement

The Two-Hour Gatekeeper for a 'Cheap and Capable' Model Announcement

1
Comments
4 min read
Tracely: Turning Real Production Agent Failures into Hermetic Regression Tests

Tracely: Turning Real Production Agent Failures into Hermetic Regression Tests

Comments
4 min read
Anthropic's Opus 5 Release Is About Production Engineering, Not Just Performance

Anthropic's Opus 5 Release Is About Production Engineering, Not Just Performance

Comments 1
2 min read
Open LLM Gateway: self-hosted LLM control plane (proxy + analytics + admin UI, no seat cap)

Open LLM Gateway: self-hosted LLM control plane (proxy + analytics + admin UI, no seat cap)

1
Comments 3
2 min read
DiffusionGemma Is Fast Because It Stops Pretending Text Has to Be Written Left to Right

DiffusionGemma Is Fast Because It Stops Pretending Text Has to Be Written Left to Right

3
Comments
3 min read
Your LLM pricing page is probably wrong — here's how I automated mine

Your LLM pricing page is probably wrong — here's how I automated mine

1
Comments
3 min read
Your context window bills you every turn

Your context window bills you every turn

Comments 1
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.