Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Sonnet hallucinated. My agent stored it as fact.
ישראל חן
ישראל חן
ישראל חן
Follow
May 26
Sonnet hallucinated. My agent stored it as fact.
#
ai
#
security
#
agents
#
llm
3
reactions
Comments
45
comments
3 min read
TurboQuant on a MacBook Pro, part 2: perplexity, KL divergence, and asymmetric K/V on M5 Max
Christopher Maher
Christopher Maher
Christopher Maher
Follow
Apr 29
TurboQuant on a MacBook Pro, part 2: perplexity, KL divergence, and asymmetric K/V on M5 Max
#
ai
#
llm
#
kubernetes
#
opensource
Comments
Add Comment
8 min read
llama.cpp b9455 Finally Caught vLLM: 70t/s on 2x3090 Qwen 27B UQ8
Storm Engine Technology.
Storm Engine Technology.
Storm Engine Technology.
Follow
Jun 3
llama.cpp b9455 Finally Caught vLLM: 70t/s on 2x3090 Qwen 27B UQ8
#
llamacpp
#
llm
#
ai
#
opensource
Comments
1
comment
3 min read
Why I'm Building a Local-First AI Coding Workspace (And How Behavioral Routing Makes It Work)
Eli Hadam Zucker
Eli Hadam Zucker
Eli Hadam Zucker
Follow
Apr 29
Why I'm Building a Local-First AI Coding Workspace (And How Behavioral Routing Makes It Work)
#
ai
#
rust
#
llm
#
webdev
Comments
Add Comment
6 min read
We Had LLMs Hallucinating Legal URLs in Production — Here's What We Tried
Akshat Soni
Akshat Soni
Akshat Soni
Follow
Jun 2
We Had LLMs Hallucinating Legal URLs in Production — Here's What We Tried
#
ai
#
python
#
llm
#
rag
2
reactions
Comments
2
comments
4 min read
hat Makes a Good SFT Sample (And Why Most Synthetic Datasets Get It Wrong)
dang phan
dang phan
dang phan
Follow
Jun 3
hat Makes a Good SFT Sample (And Why Most Synthetic Datasets Get It Wrong)
#
machinelearning
#
llm
#
ai
#
finetuning
Comments
2
comments
4 min read
Prompt Caching Works. Your Prompt Assembly Code Does Not.
Parag Darade
Parag Darade
Parag Darade
Follow
Apr 29
Prompt Caching Works. Your Prompt Assembly Code Does Not.
#
ai
#
llm
#
rag
#
machinelearning
Comments
Add Comment
4 min read
Opus 4.7 vs GLM 5.1: is mixing models worth it?
Edy Silva
Edy Silva
Edy Silva
Follow
Apr 29
Opus 4.7 vs GLM 5.1: is mixing models worth it?
#
llm
#
ai
#
opus
#
glm
Comments
Add Comment
13 min read
How to track LLM costs per customer in production
Credyt.ai
Credyt.ai
Credyt.ai
Follow
Jun 2
How to track LLM costs per customer in production
#
ai
#
tutorial
#
agents
#
llm
17
reactions
Comments
2
comments
8 min read
Upgrading Kiwi-chan’s Brain: Pushing a 30GB "Frankenstein" GPU Rig to the Limit with Qwen 3.6-35B-A3B
kiwi_tech
kiwi_tech
kiwi_tech
Follow
Apr 29
Upgrading Kiwi-chan’s Brain: Pushing a 30GB "Frankenstein" GPU Rig to the Limit with Qwen 3.6-35B-A3B
#
agents
#
ai
#
llm
#
rag
Comments
Add Comment
4 min read
Mistral Medium 3.5 GGUF, FlashQLA Boost for Qwen, & Ollama Playground
soy
soy
soy
Follow
Apr 29
Mistral Medium 3.5 GGUF, FlashQLA Boost for Qwen, & Ollama Playground
#
ai
#
llm
#
selfhosted
Comments
Add Comment
3 min read
When the Reranker Hurts: Recall@5 Cases Where Two-Stage Retrieval Loses to One
Gabriel Anhaia
Gabriel Anhaia
Gabriel Anhaia
Follow
Apr 29
When the Reranker Hurts: Recall@5 Cases Where Two-Stage Retrieval Loses to One
#
ai
#
rag
#
llm
#
benchmark
Comments
Add Comment
7 min read
Why Strict JSON Mode Doesn't Stop Hallucinated Tool Calls
Gabriel Anhaia
Gabriel Anhaia
Gabriel Anhaia
Follow
Apr 29
Why Strict JSON Mode Doesn't Stop Hallucinated Tool Calls
#
ai
#
llm
#
agents
#
python
Comments
Add Comment
7 min read
Every LLM Eval Library Has the Same Bug: Stochastic Judges Used as Deterministic Oracles
Gabriel Anhaia
Gabriel Anhaia
Gabriel Anhaia
Follow
Apr 29
Every LLM Eval Library Has the Same Bug: Stochastic Judges Used as Deterministic Oracles
#
ai
#
testing
#
llm
#
observability
Comments
Add Comment
7 min read
Local AI Accessibility, JetBrains’ 2026 IDE Plans, and Agentic Architecture Pitfalls
Anikalp Jaiswal
Anikalp Jaiswal
Anikalp Jaiswal
Follow
Apr 29
Local AI Accessibility, JetBrains’ 2026 IDE Plans, and Agentic Architecture Pitfalls
#
ai
#
technology
#
machinelearning
#
llm
Comments
Add Comment
2 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account