Llm Page 315 - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

PRANJUL RATHOUR

Sep 5

Fine-tuning a 1.7B model at 3.2 GB VRAM — building FineTune Studio

#finetuning #qlora #llm #opensource

2 min read

Sep 5

Temperature 0 is not reproducible. I measured 30 percent of my output changing between identical runs.

#llm #benchmarks #localllm #reproducibility

3 min read

Brenn Hill

Aug 6

The Circuit Breaker Pattern for AI Agents

#ai #machinelearning #llm #programming

9 min read

Isolates hidden gateway latency sources

Sep 2

My AI Gateway Added 400ms to Every Request. Here's Where It Went

#discuss #ai #llm #devops

29

7 min read

Edward Izgorodin

Sep 5

Interpretability Built an Instrument to Prove a Signal Is Actually Used. Agent Memory Has Nothing Like It.

#ai #machinelearning #llm #agents

5 min read

Shinsuke KAGAWA

Sep 5

Switching from GPT-5.6 Sol to GPT-6 Astra: Start with Medium Effort

#ai #programming #tutorial #llm

6 min read

howcani howcani

Sep 5

Every Greedy Metric Said the Model Was Improving. Then pass@64 Fell From 0.83 to 0.19

#ai #deeplearning #llm #machinelearning

5 min read

Sep 5

Our small model beat Claude Opus on one 440K-token question. Then it came last on the public benchmark.

#llm #benchmarks #localllm #privateai

5 min read

miguel

Aug 6

How I reduced LLM context cost by 35% without changing code (Token Firewall)

#ai #goolang #llm #mcp

2 min read

PRANJUL RATHOUR

Sep 5

Why my RAG platform says "I don't know" — building RAG.NextUpgrad

#rag #retrieval #llm #productionai

3 min read

Sep 5

A small model on a 6GB laptop matched direct reading on aggregation, except when the answer is a number

#llm #benchmarks #localllm #agents

4 min read

Sep 5

Your agent truncates the corpus and answers anyway. Two harnesses, and a router that picks between them.

#llm #agents #localllm #benchmarks

5 min read

Debashish Ghosal

Sep 4

I Compared a Local 4B, a Better Cloud Model, and Role Separation. The Results Were Weird.

#healthydebate #ai #llm #testing

6 min read

Aug 2

Tokenization in AI: What Is It, Why Is It Used, and How Does It Work?

#ai #llm #nlp

6 min read

Weio

Sep 5

How to route LLM requests by task difficulty (a practical guide to cutting API spend without losing quality)

#ai #llm #webdev #programming

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.