DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to tell if your AI agent actually got better

How to tell if your AI agent actually got better

Comments 2
2 min read
How 8-bit quantization shrinks an LLM to half of its size — and why a single outlier weight can quietly ruin it

How 8-bit quantization shrinks an LLM to half of its size — and why a single outlier weight can quietly ruin it

9
Comments 8
11 min read
Plain Gemma 4 26B vs Jev on One EC2 L4: 2.1 Points Behind Overall, Level on Yes/No, 4.5 Behind on Multiple Choice

Plain Gemma 4 26B vs Jev on One EC2 L4: 2.1 Points Behind Overall, Level on Yes/No, 4.5 Behind on Multiple Choice

1
Comments
23 min read
No, Seriously. Neural Networks Cannot Produce Genuine Intelligence.

No, Seriously. Neural Networks Cannot Produce Genuine Intelligence.

3
Comments 10
37 min read
Deploying LLMs Locally: Ollama, LM Studio, llama.cpp & vLLM Compared

Deploying LLMs Locally: Ollama, LM Studio, llama.cpp & vLLM Compared

Comments
9 min read
Building a Production-Ready RAG System: Architecture, Optimization & Monitoring

Building a Production-Ready RAG System: Architecture, Optimization & Monitoring

Comments
12 min read
Why Make an LLM Do the Grunt Work? After Jev, Who Should Handle an Agent’s Tool Work?

Why Make an LLM Do the Grunt Work? After Jev, Who Should Handle an Agent’s Tool Work?

1
Comments 1
11 min read
5 Best AI Gateways

Focuses on production needs over docs

5 Best AI Gateways

38
Comments 7
14 min read
Project HydraFusion: GitHub Copilot Stops Picking a Model and Starts Building a Workflow

Project HydraFusion: GitHub Copilot Stops Picking a Model and Starts Building a Workflow

2
Comments
22 min read
Advanced Prompt Engineering: Techniques, Patterns & Production Systems

Advanced Prompt Engineering: Techniques, Patterns & Production Systems

Comments
13 min read
How to Evaluate LLMs: A Complete Guide to LLM Evaluation

How to Evaluate LLMs: A Complete Guide to LLM Evaluation

Comments
8 min read
VRAM for local LLMs: why memory bandwidth sets your tokens per second

VRAM for local LLMs: why memory bandwidth sets your tokens per second

2
Comments 2
8 min read
Prompt Engineering Masterclass: From Basics to Advanced Techniques

Prompt Engineering Masterclass: From Basics to Advanced Techniques

Comments
5 min read
Deploying LLMs Locally: Ollama, llama.cpp, and vLLM Comparison

Deploying LLMs Locally: Ollama, llama.cpp, and vLLM Comparison

Comments
5 min read
I built an AI content agent that would rather drop a topic than make things up

I built an AI content agent that would rather drop a topic than make things up

Comments 1
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.