Llm Page 176 - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Jun 7

Prefix caching at scale: when it saves you 80% of prefill cost, and the eviction policies that quietly turn it into 5%

#llm #ai #infrastructure #vllm

9 min read

Kiran Reddy Duvvuru

Jun 11

I Reduced My System Prompt Tokens by 70% Using a Custom Prompt DSL

#ai #architecture #llm #performance

6 min read

Jun 7

MCTS-Reasoning: Tree Search for LLM Reasoning

#mcts #llm #machinelearning #reasoning

3 min read

Prevents autonomous agent retry loops

ยชญ์ศรัณย์ ผิวผ่อง

Jul 8

How I Built a Zero-Copy Rust Proxy to Stop Runaway LLM API Bills (and Survived the Docker Loopback Trap)

#api #llm #opensource #rust

3 min read

plasma

Jul 10

My LLM Bill Kept Growing, but User Traffic Didn’t

#ai #webdev #productivity #llm

6 min read

marsa adam

Jun 6

Why Your AI Agent Hallucinates in Production — And How Context Design Fixes It

#ai #agents #llm #contextengineering

5 min read

Jun 7

How to Measure AI ROI: A 2026 Framework for Proving Return on AI Spend

#ai #analytics #llm #management

6 min read

Jun 7

SLUUG Talk: Demystifying Large Language Models on Linux

#llm #linux #ai #presentation

1 min read

marsa adam

Jun 6

100 System Prompt Patterns Every AI Developer Should Have Saved

#ai #llm #developers #promptengineering

7 min read

soy

Jun 6

Local Models Orchestration, Personal AI Infrastructure & Multimodal Safety

#ai #llm #selfhosted

3 min read

Jun 7

Using SSH Tunnels to Make Up for Lack of HTTPS on LAN

#llm #networking #privacy #security

10 min read

Francesca

Jun 6

Frequency Bias in LLM Coding Assistants: Fairness Risks for Software Development.

#ai #aibias #llm #writing

7 min read

Jun 6

NeuraDebugger-Micro-1.1B: The 1B Parameter Debugging Specialist That Outperforms Generalists

#ai #llm #machinelearning #programming

9 min read

Jun 11

The Retrieval Failure That Looked Like a Model Problem

#ai #llm #rag #brainpackai

3 min read

Arthur

Jul 8

You Probably Don't Need a Vector Database for RAG

#rag #llm #ai #vectorsearch

9 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.