DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
llama-server's prompt cache reuses KV computed under a different LoRA scale

llama-server's prompt cache reuses KV computed under a different LoRA scale

Comments
6 min read
Designing an AI Concierge That Qualifies Visitors With Facts You Publish

Designing an AI Concierge That Qualifies Visitors With Facts You Publish

Comments
9 min read
Ten proofs, ten 97-99% scores, one rejection: what Verdikta's math bounties reveal about AI proof grading

Ten proofs, ten 97-99% scores, one rejection: what Verdikta's math bounties reveal about AI proof grading

Comments
4 min read
Only 3% of the Brain Wakes Up: The Mixture-of-Experts Playbook Behind September's Biggest Models

Only 3% of the Brain Wakes Up: The Mixture-of-Experts Playbook Behind September's Biggest Models

Comments
6 min read
The Definition Is the Kernel. What Still Runs After the People and the Model Change Is the Asset.

The Definition Is the Kernel. What Still Runs After the People and the Model Change Is the Asset.

2
Comments
9 min read
Build a chatbot that actually remembers context (and win from a 2,500 prize pool!) 🧠🤖

Build a chatbot that actually remembers context (and win from a 2,500 prize pool!) 🧠🤖

Comments
1 min read
The Agent That Trapped Itself: How Context Eviction and Deduplication Broke on a Go Project

The Agent That Trapped Itself: How Context Eviction and Deduplication Broke on a Go Project

Comments 5
7 min read
Azure AI Foundry Cost Optimization: Caching & KV-Cache Reuse

Azure AI Foundry Cost Optimization: Caching & KV-Cache Reuse

Comments
7 min read
Why Most AI Startups Will Fail at the Same Problem Nobody Is Talking About

Why Most AI Startups Will Fail at the Same Problem Nobody Is Talking About

Comments
4 min read
A Field Guide to RAG Failure Modes: Garbled Scans, Duplicate Chunks, and Leaky Indexes

A Field Guide to RAG Failure Modes: Garbled Scans, Duplicate Chunks, and Leaky Indexes

Comments 2
6 min read
Your LiteLLM master key is also your admin UI password: a hardening checklist for self-hosted LiteLLM

Your LiteLLM master key is also your admin UI password: a hardening checklist for self-hosted LiteLLM

Comments 1
4 min read
A Mixed-Language Test Set for WhatsApp Assistants in Gulf Businesses

A Mixed-Language Test Set for WhatsApp Assistants in Gulf Businesses

Comments
2 min read
Vector database showroom. Part 3 Qdrant — The Hot Hatchback That Carries More Than It Looks

Vector database showroom. Part 3 Qdrant — The Hot Hatchback That Carries More Than It Looks

Comments
3 min read
Semantic Caching for LLM Calls in Node.js With pgvector

Semantic Caching for LLM Calls in Node.js With pgvector

Comments
6 min read
Your LLM Types One Token at a Time. It Doesn't Have To.

Your LLM Types One Token at a Time. It Doesn't Have To.

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.