DEV Community

Pragmatic AI Tools Series' Articles

Back to Debashish Ghosal's Series
Your Flaky Tests Aren't Flaky
Cover image for Your Flaky Tests Aren't Flaky

Your Flaky Tests Aren't Flaky

Comments
6 min read
I Planned 10 LLM Evaluation Experiments And Only Ran 1. It Was Enough.
Cover image for I Planned 10 LLM Evaluation Experiments And Only Ran 1. It Was Enough.

I Planned 10 LLM Evaluation Experiments And Only Ran 1. It Was Enough.

5
Comments 2
13 min read
I Thought Building Agent Observability Was a Detector Problem. I Was Wrong.
Cover image for I Thought Building Agent Observability Was a Detector Problem. I Was Wrong.

Real production data broke 35 detectors instantly

I Thought Building Agent Observability Was a Detector Problem. I Was Wrong.

22
Comments 19
8 min read
I Built Scenario Packs for Agent Regression Testing. The Integration, Not the Judge, Broke Me.
Cover image for I Built Scenario Packs for Agent Regression Testing. The Integration, Not the Judge, Broke Me.

Adapters need conformance suites too

I Built Scenario Packs for Agent Regression Testing. The Integration, Not the Judge, Broke Me.

18
Comments 21
15 min read
I Stopped Trusting AI Agents With Tools. So I Built a Gatekeeper.
Cover image for I Stopped Trusting AI Agents With Tools. So I Built a Gatekeeper.

83 real agents tested zero mocks

I Stopped Trusting AI Agents With Tools. So I Built a Gatekeeper.

35
Comments 48
14 min read
I Shipped an Agent Gatekeeper (v0.1). 14 Developers Showed Me What I Missed. Here's v0.2 — a Control Plane.
Cover image for I Shipped an Agent Gatekeeper (v0.1). 14 Developers Showed Me What I Missed. Here's v0.2 — a Control Plane.

I Shipped an Agent Gatekeeper (v0.1). 14 Developers Showed Me What I Missed. Here's v0.2 — a Control Plane.

8
Comments 1
13 min read