DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Pushing the Limits: Extreme Inference Speedup of Qwen 3.8 27B on NVIDIA B300 (100 to 10k+ tok/s)

Pushing the Limits: Extreme Inference Speedup of Qwen 3.8 27B on NVIDIA B300 (100 to 10k+ tok/s)

1
Comments
16 min read
What Happens When an AI Agent Gets Stuck in a Loop?

What Happens When an AI Agent Gets Stuck in a Loop?

5
Comments
7 min read
DeepSeek V4.1 Flash API Cost: Matches V4 Pro at 3-6x Less per Answer

DeepSeek V4.1 Flash API Cost: Matches V4 Pro at 3-6x Less per Answer

Comments
12 min read
Letting an LLM write alerting rules, but never letting it flip the switch

Letting an LLM write alerting rules, but never letting it flip the switch

Comments 3
5 min read
Implementing AI Observability: Tracing LLM Calls End-to-End

Implementing AI Observability: Tracing LLM Calls End-to-End

Comments
4 min read
llama.cpp vs Ollama in 2026: Which Runtime Should You Run?

llama.cpp vs Ollama in 2026: Which Runtime Should You Run?

Comments
18 min read
Your model confabulates

Your model confabulates

Comments
6 min read
How I Fine-Tuned a 7B LLM with LoRA and Unsloth

How I Fine-Tuned a 7B LLM with LoRA and Unsloth

Comments
3 min read
LLM Cascades Violate the Ensemble Theory They're Built On

LLM Cascades Violate the Ensemble Theory They're Built On

1
Comments 1
5 min read
gstack: AI Software Engineering Stack

gstack: AI Software Engineering Stack

1
Comments 2
18 min read
Reading an official Hugging Face leaderboard: protocols, majority vote and reproducibility

Reading an official Hugging Face leaderboard: protocols, majority vote and reproducibility

Comments 1
2 min read
My checklist for reading computer use benchmarks

My checklist for reading computer use benchmarks

2
Comments 3
15 min read
Building AI Observability for the Native Stack: Architecture Design and Engineering Practice from Bonree ONE 4.0

Building AI Observability for the Native Stack: Architecture Design and Engineering Practice from Bonree ONE 4.0

Comments
14 min read
How I Manage API Keys for 4 Providers Behind One Client

How I Manage API Keys for 4 Providers Behind One Client

Comments
6 min read
OpenArch: PyTorch implementations of modern LLM architectures!

OpenArch: PyTorch implementations of modern LLM architectures!

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.