DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Who is nondeterministic, the model or the human?

Who is nondeterministic, the model or the human?

5
Comments
8 min read
Convert Word (DOCX) to Markdown With Python (Standard Library Only) for LLM Prompts and Chatbot Knowledge

Convert Word (DOCX) to Markdown With Python (Standard Library Only) for LLM Prompts and Chatbot Knowledge

Comments
14 min read
vLLM Fast Start Explained: What Preload and Snapshots Save, What They Cannot, and the Fingerprint Gap

vLLM Fast Start Explained: What Preload and Snapshots Save, What They Cannot, and the Fingerprint Gap

Comments
14 min read
What our analytics SDK receives from your server, field by field

What our analytics SDK receives from your server, field by field

Comments
5 min read
Building Production Features with the Claude API in Java

Building Production Features with the Claude API in Java

Comments
6 min read
What counts as feedback in weight-space programming?

What counts as feedback in weight-space programming?

Comments
3 min read
Stop Trusting Vibes: Build a Minimal LLM Eval Harness Before You Claim Your Model Got Better

Stop Trusting Vibes: Build a Minimal LLM Eval Harness Before You Claim Your Model Got Better

Comments
8 min read
json.dumps Writes NaN by Default: 31 LLM Reports JSON.parse Rejected

json.dumps Writes NaN by Default: 31 LLM Reports JSON.parse Rejected

Comments
6 min read
How to Secure a Local LLM Relay Listening on *:4000

How to Secure a Local LLM Relay Listening on *:4000

Comments
5 min read
Enterprise AI spend hits $177B as agents become the biggest consumers of model tokens

Enterprise AI spend hits $177B as agents become the biggest consumers of model tokens

Comments
2 min read
Anthropic cuts agent request payloads from 800 KB to 1.8 KB with Message Threads in public beta

Anthropic cuts agent request payloads from 800 KB to 1.8 KB with Message Threads in public beta

Comments
2 min read
Turn 10 of a 50K-token chat waits 5 seconds, not 49: the prefix cache on RTX Spark, and whether the code compiles

Turn 10 of a 50K-token chat waits 5 seconds, not 49: the prefix cache on RTX Spark, and whether the code compiles

Comments
13 min read
A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

Comments
13 min read
How ChatGPT Actually Finds Your Page: A Developer's Walkthrough of RAG

How ChatGPT Actually Finds Your Page: A Developer's Walkthrough of RAG

Comments
3 min read
Hydrogen-1.0 MIT Open Weights: Gated BF16, NVFP4 262K Context Cliff, and Vendor FSR vs GPT-6 Astra

Hydrogen-1.0 MIT Open Weights: Gated BF16, NVFP4 262K Context Cliff, and Vendor FSR vs GPT-6 Astra

Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.