DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
KV Cache on 16 GB GPUs: Making Long Context Actually Fit

KV Cache on 16 GB GPUs: Making Long Context Actually Fit

Comments 1
22 min read
Best Ollama Models for Coding, Writing and Medicine (September 2026)

Best Ollama Models for Coding, Writing and Medicine (September 2026)

1
Comments 2
7 min read
My agent kept dropping numbers when it copied data into a tool call. A file path fixed it.

My agent kept dropping numbers when it copied data into a tool call. A file path fixed it.

8
Comments 22
3 min read
Selling LLM Inference Per-Call to AI Agents: 99% Margin With x402

Selling LLM Inference Per-Call to AI Agents: 99% Margin With x402

Comments
2 min read
Four versions of one translate() function

Four versions of one translate() function

Comments
3 min read
I ask Claude the same 100 questions every day. One day, Haiku 4.5 stopped wobbling

I ask Claude the same 100 questions every day. One day, Haiku 4.5 stopped wobbling

2
Comments 3
9 min read
Making Qwen Faster on an RTX 3090

Making Qwen Faster on an RTX 3090

1
Comments 3
10 min read
Building The Real Jarvis: Did OpenAI Just Create Iron Man's AI?

Building The Real Jarvis: Did OpenAI Just Create Iron Man's AI?

Comments
8 min read
Stop Your AI Agent From Leaking Tenant Data — Params the Model Never Sees

Stop Your AI Agent From Leaking Tenant Data — Params the Model Never Sees

Comments
3 min read
622 of our 5,087 LLM API calls never returned an answer

622 of our 5,087 LLM API calls never returned an answer

Comments 1
4 min read
We Measured Our LLM's Confidence Scores. They Were Wrong 16% of the Time — Even at Maximum Confidence.

We Measured Our LLM's Confidence Scores. They Were Wrong 16% of the Time — Even at Maximum Confidence.

Comments 1
5 min read
The Embedding Table Was 72% of the Model

The Embedding Table Was 72% of the Model

Comments 1
5 min read
Ollama Model Loads Time Out After the 0.32.10 Upgrade: The Load Mode Change and the Fix

Ollama Model Loads Time Out After the 0.32.10 Upgrade: The Load Mode Change and the Fix

Comments
3 min read
Como testar Sistemas multiagentes com ADK

Como testar Sistemas multiagentes com ADK

Comments 2
26 min read
I built a prompt injection detection API that responds in <1ms — here's how

I built a prompt injection detection API that responds in <1ms — here's how

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.