DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Moderation Report Triage: 4-Stage LLM Token Cost and Quality Budget

Moderation Report Triage: 4-Stage LLM Token Cost and Quality Budget

Comments
6 min read
Sorting website form enquiries with an LLM that can only answer from a list

Sorting website form enquiries with an LLM that can only answer from a list

Comments
3 min read
Building ELMDE: Deciding in One Pass

Building ELMDE: Deciding in One Pass

Comments
4 min read
How Indian Startups Can Cut Their OpenAI API Bill — Real Numbers, No Theory

How Indian Startups Can Cut Their OpenAI API Bill — Real Numbers, No Theory

Comments
2 min read
Jev vs. GPT-5.6 Luna: Do We Really Need a General-Purpose LLM for Everything?

Jev vs. GPT-5.6 Luna: Do We Really Need a General-Purpose LLM for Everything?

Comments
2 min read
Which agent tool calls need a human? A simple consequence matrix

Which agent tool calls need a human? A simple consequence matrix

Comments
3 min read
How Much Does It Cost to Build an AI Agent?

How Much Does It Cost to Build an AI Agent?

Comments
7 min read
KV Cache Wars: How Compaction, Quantization, and a Rust Rewrite Are Redefining LLM Serving Economics

KV Cache Wars: How Compaction, Quantization, and a Rust Rewrite Are Redefining LLM Serving Economics

2
Comments 1
10 min read
How we use an LLM to triage SAST findings, and what we never send it

How we use an LLM to triage SAST findings, and what we never send it

Comments
4 min read
leantext's first small win: 49 clones in two days

leantext's first small win: 49 clones in two days

1
Comments
2 min read
Auditing Marketplace LLM Chatbot Actions Under Latency Budgets (and Why Boundaries Matter)

Auditing Marketplace LLM Chatbot Actions Under Latency Budgets (and Why Boundaries Matter)

Comments
5 min read
Your chatbot's average call costs $0.006 — one pasted file can make it $2.03

Your chatbot's average call costs $0.006 — one pasted file can make it $2.03

Comments
5 min read
Correct, Cited, and Two Years Out of Date: Measuring Version Leakage in RAG

Correct, Cited, and Two Years Out of Date: Measuring Version Leakage in RAG

1
Comments
2 min read
Customer Support Evidence: Summarize Large Documents with an LLM API, Batch and Streaming

Customer Support Evidence: Summarize Large Documents with an LLM API, Batch and Streaming

Comments
6 min read
Token-Level Filtering Costs 0.15 to 0.34 ms per Token on CPU

Token-Level Filtering Costs 0.15 to 0.34 ms per Token on CPU

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.