DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Stop Parsing LLM Junk: Zero-Latency JSON with Claude Prefill, Spring AI, and Java 26 Records

Stop Parsing LLM Junk: Zero-Latency JSON with Claude Prefill, Spring AI, and Java 26 Records

Comments
2 min read
Run Your Own AI at Home and Access It Anywhere with LM Studio and LM Link

Run Your Own AI at Home and Access It Anywhere with LM Studio and LM Link

Comments
12 min read
Stop Wasting Your LLM Context Window: A Practical Strategy

Stop Wasting Your LLM Context Window: A Practical Strategy

Comments
3 min read
Prompt Injection Is the One AI Security Bug Nobody Can Fix

Prompt Injection Is the One AI Security Bug Nobody Can Fix

Comments
4 min read
Mixture of Experts (MoE): what it actually does under the hood, and when it pays off

Mixture of Experts (MoE): what it actually does under the hood, and when it pays off

1
Comments
8 min read
OpenCode V2 Compaction Internals

OpenCode V2 Compaction Internals

Comments
11 min read
I Did the Math on Kimi K3. The $15 Output Price Isn't the Whole Cost Story.

I Did the Math on Kimi K3. The $15 Output Price Isn't the Whole Cost Story.

6
Comments 1
7 min read
Stop Loading Your Entire Instruction System Into Every Session

Stop Loading Your Entire Instruction System Into Every Session

7
Comments 1
5 min read
I Had a GBNF Grammar File and Nowhere to Point It. So I Added Support for It.

I Had a GBNF Grammar File and Nowhere to Point It. So I Added Support for It.

Comments
4 min read
Claude 3.5 Sonnet Isn't Just an Upgrade. It's a New Baseline.

Claude 3.5 Sonnet Isn't Just an Upgrade. It's a New Baseline.

2
Comments 1
3 min read
The "Demo vs. Production" Trap: Building a Scalable Kafka Pipeline for LLMs

The "Demo vs. Production" Trap: Building a Scalable Kafka Pipeline for LLMs

Comments
2 min read
The Guardrail Has to Be Code: How a Runaway Local LLM Corrupted APFS and Bricked a Mac Mini

The Guardrail Has to Be Code: How a Runaway Local LLM Corrupted APFS and Bricked a Mac Mini

1
Comments 2
8 min read
i built a tool that tracks what AI tasks actually cost. the real number surprised me.

i built a tool that tracks what AI tasks actually cost. the real number surprised me.

Comments 3
6 min read
Why I built StreamCtx: The hidden context problem in every LLM app

Why I built StreamCtx: The hidden context problem in every LLM app

Comments
1 min read
Your RAG Is Underperforming Because Your Embeddings Are Too Simple

Your RAG Is Underperforming Because Your Embeddings Are Too Simple

Comments 2
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.