DEV Community

AI, engineering & what survives production Series' Articles

Back to Richard Atkins's Series
Stop shipping AI agents you can't measure: evals + observability from scratch
Cover image for Stop shipping AI agents you can't measure: evals + observability from scratch

Stop shipping AI agents you can't measure: evals + observability from scratch

9
Comments
5 min read
The real economics of a production LLM pipeline: resumability, cost-aware routing, and measuring when local beats the API
Cover image for The real economics of a production LLM pipeline: resumability, cost-aware routing, and measuring when local beats the API

The real economics of a production LLM pipeline: resumability, cost-aware routing, and measuring when local beats the API

8
Comments
7 min read
Measure your own coding habits before you believe anyone else's numbers
Cover image for Measure your own coding habits before you believe anyone else's numbers

Measure your own coding habits before you believe anyone else's numbers

Comments
8 min read
The code that hides the evidence
Cover image for The code that hides the evidence

The code that hides the evidence

5
Comments
7 min read
An MCP server that has to prove itself: citations, abstention and entitlements as CI gates
Cover image for An MCP server that has to prove itself: citations, abstention and entitlements as CI gates

An MCP server that has to prove itself: citations, abstention and entitlements as CI gates

Comments 2
5 min read
The migration the data ordered: moving a production LLM pipeline off the Mac Mini under my desk
Cover image for The migration the data ordered: moving a production LLM pipeline off the Mac Mini under my desk

The migration the data ordered: moving a production LLM pipeline off the Mac Mini under my desk

Comments
5 min read
One LLM judge is an opinion. Two model families agreeing is evidence.
Cover image for One LLM judge is an opinion. Two model families agreeing is evidence.

One LLM judge is an opinion. Two model families agreeing is evidence.

Comments
4 min read
Measurement tools need evals too
Cover image for Measurement tools need evals too

Measurement tools need evals too

Comments
6 min read
Earned Autonomy
Cover image for Earned Autonomy

Earned Autonomy

5
Comments
23 min read