DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Getting Agents to Stop Assuming: What a First AWS Agent Workflow Reveals About Constraint Design

Getting Agents to Stop Assuming: What a First AWS Agent Workflow Reveals About Constraint Design

1
Comments
6 min read
I built an epistemic gate to stop LLM data poisoning during fine-tuning. Tested across 5 architectures, orchestrated on a 2006 Toshiba laptop for $0.

I built an epistemic gate to stop LLM data poisoning during fine-tuning. Tested across 5 architectures, orchestrated on a 2006 Toshiba laptop for $0.

1
Comments 3
2 min read
llama-server's sleep mode loses or crashes on a request that arrives just before it sleeps

llama-server's sleep mode loses or crashes on a request that arrives just before it sleeps

1
Comments 2
7 min read
Fine-tuning a 7B model needs 112 GB. The model is only 14 GB of it.

Fine-tuning a 7B model needs 112 GB. The model is only 14 GB of it.

1
Comments 1
3 min read
API deprecation for AI models: what breaks when a model is retired

API deprecation for AI models: what breaks when a model is retired

2
Comments 1
9 min read
I Benchmarked 4 Frontier LLMs on Catching ML's "Silent Killers" — DeepSeek-R1 Missed the Most Basic Bug

Kaggle Benchmarking Challenge Submission

I Benchmarked 4 Frontier LLMs on Catching ML's "Silent Killers" — DeepSeek-R1 Missed the Most Basic Bug

1
Comments 1
3 min read
Inside My llama.cpp Setup: Tuning Qwen 3.8 27B for 512K Context

Inside My llama.cpp Setup: Tuning Qwen 3.8 27B for 512K Context

2
Comments 3
7 min read
System design for physical AI: a fully air-gapped stack for an oil and gas operation in Pakistan

System design for physical AI: a fully air-gapped stack for an oil and gas operation in Pakistan

1
Comments
4 min read
Designing an eval harness for prompt-injection detection: what measuring my defenses actually taught me

Designing an eval harness for prompt-injection detection: what measuring my defenses actually taught me

Comments 1
6 min read
LLM Observability & Evaluation Tools: A Practical Guide for Small Teams

LLM Observability & Evaluation Tools: A Practical Guide for Small Teams

Comments 2
5 min read
LLM Serving on Kubernetes in 2026: What's Solved and What's Still Open

LLM Serving on Kubernetes in 2026: What's Solved and What's Still Open

1
Comments 1
5 min read
Build a Knowledge Layer for SQL Agents with OKF (Part 2)

Build a Knowledge Layer for SQL Agents with OKF (Part 2)

1
Comments
16 min read
Self-hosted Langfuse: tracing 7% of my AI agents, and ClickHouse logging itself

Self-hosted Langfuse: tracing 7% of my AI agents, and ClickHouse logging itself

2
Comments 8
8 min read
What we learned fine-tuning our own coding model on a $100 budget

What we learned fine-tuning our own coding model on a $100 budget

Comments 2
5 min read
I built an hourly crypto "market thermometer" from free data, then refused to let it trade

I built an hourly crypto "market thermometer" from free data, then refused to let it trade

1
Comments 3
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.