DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Repacked QAT Gemma 4 on One TPU v5e: 12B Serves at 675 Tokens per Second

Repacked QAT Gemma 4 on One TPU v5e: 12B Serves at 675 Tokens per Second

8
Comments 1
9 min read
Run Qwen3.8-Flash-Next Locally with EXL3 and TabbyAPI on 40+ GB of RAM

Run Qwen3.8-Flash-Next Locally with EXL3 and TabbyAPI on 40+ GB of RAM

1
Comments 2
11 min read
How To Implement the AgentgatewayModel Object In Agentgateway

How To Implement the AgentgatewayModel Object In Agentgateway

1
Comments 1
6 min read
Billing LLM usage per token: the pitfalls nobody warns you about

Billing LLM usage per token: the pitfalls nobody warns you about

Comments
2 min read
Top 9 AI Security Tools for Prompt Injection and Data Leakage in 2026

Top 9 AI Security Tools for Prompt Injection and Data Leakage in 2026

Comments 1
16 min read
Is an AI Product Still the Same After Its AI Layer Changes?

Is an AI Product Still the Same After Its AI Layer Changes?

Comments
1 min read
From Software Engineer to AI Engineer - Part 4: RAG-ing the facts

From Software Engineer to AI Engineer - Part 4: RAG-ing the facts

Comments
9 min read
Anthropic + Nvidia: The $35B AI Cloud Shift

Anthropic + Nvidia: The $35B AI Cloud Shift

Comments 1
9 min read
JSFuck in Your Inbox: How an Old JS Obfuscation Trick Beat an AI Agent's Guardrails

JSFuck in Your Inbox: How an Old JS Obfuscation Trick Beat an AI Agent's Guardrails

3
Comments 4
5 min read
Spark X2.5-4B & 1.7B: the only on-device models with native 1M-token context — now open source

Spark X2.5-4B & 1.7B: the only on-device models with native 1M-token context — now open source

Comments
2 min read
I Shipped a Green Test That Lied About My Pipeline

I Shipped a Green Test That Lied About My Pipeline

16
Comments 7
4 min read
Chronos: Building a Governed AI Control Plane Where Production Wipes Are Structurally Impossible

Chronos: Building a Governed AI Control Plane Where Production Wipes Are Structurally Impossible

Comments 1
3 min read
RDAI: A Multi-Brain Python SDK for Self-Healing AI

RDAI: A Multi-Brain Python SDK for Self-Healing AI

3
Comments
7 min read
The Free Model Kept Explaining an Outage That Already Ended: 48 Hours of Context-Budget Field Notes

The Free Model Kept Explaining an Outage That Already Ended: 48 Hours of Context-Budget Field Notes

Comments
4 min read
The agentic RAG pipeline that was faster and cheaper — and no more accurate than no agent at all

The agentic RAG pipeline that was faster and cheaper — and no more accurate than no agent at all

1
Comments 4
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.