DEV Community

suraj kumar profile picture

suraj kumar

Building swarm-test -- chaos engineering for multi - agent AI systems . AI systems Architect. Building the reliability layer for the agent economy.

Joined Joined on 
Your AI agents pass every test you wrote. Your system still fails in production. Here's the gap nobody's testing.

Your AI agents pass every test you wrote. Your system still fails in production. Here's the gap nobody's testing.

Comments
3 min read

Want to connect with suraj kumar?

Create an account to connect with suraj kumar. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Everyone tests their agents. Nobody tests the wiring. That's why your multi-agent system is ~50% reliable.

Everyone tests their agents. Nobody tests the wiring. That's why your multi-agent system is ~50% reliable.

Comments 1
3 min read
I ran my own reliability tool on my production system. 90% of the findings were wrong — and that was the most valuable bug I've fixed.

I ran my own reliability tool on my production system. 90% of the findings were wrong — and that was the most valuable bug I've fixed.

1
Comments 1
6 min read
Your AI agents aren't just unreliable — they're expensive, and you can't see it in the logs

Your AI agents aren't just unreliable — they're expensive, and you can't see it in the logs

Comments
3 min read
The most expensive agent failure is the one that doesn't crash

The most expensive agent failure is the one that doesn't crash

Comments
1 min read
I built an open-source reliability tester for multi-agent AI systems

I built an open-source reliability tester for multi-agent AI systems

1
Comments
2 min read
I Built an Open-Source Reliability Tester for Multi-Agent AI Systems — Here's What It Catches

I Built an Open-Source Reliability Tester for Multi-Agent AI Systems — Here's What It Catches

Comments
2 min read
swarm-test v0.3.4 — Auto-Classifying Agent Roles (and Why Role Changes What a Failure Means)

swarm-test v0.3.4 — Auto-Classifying Agent Roles (and Why Role Changes What a Failure Means)

Comments
2 min read
swarm-test v0.3.3 — I Visualized My 14-Agent System and the Bottleneck Was Obvious

swarm-test v0.3.3 — I Visualized My 14-Agent System and the Bottleneck Was Obvious

Comments
2 min read
swarm-test v0.3.2 — Write Your Own Multi-Agent Reliability Tests

swarm-test v0.3.2 — Write Your Own Multi-Agent Reliability Tests

1
Comments
2 min read
swarm-test v0.3.1 — Interactive HTML Reports and Developer Experience Overhaul

swarm-test v0.3.1 — Interactive HTML Reports and Developer Experience Overhaul

Comments
2 min read
swarm-test is now a GitHub Action — multi-agent reliability testing on every PR

swarm-test is now a GitHub Action — multi-agent reliability testing on every PR

Comments
1 min read
swarm-test v0.2.8 — This Reliability Report Found a Catastrophic Failure Nobody Caught

swarm-test v0.2.8 — This Reliability Report Found a Catastrophic Failure Nobody Caught

1
Comments 10
2 min read
swarm-test now supports AutoGen — 3 frameworks, 1 reliability testing tool

swarm-test now supports AutoGen — 3 frameworks, 1 reliability testing tool

Comments
2 min read
🐝 swarm-test v0.2.4 — Quick Scan CLI

🐝 swarm-test v0.2.4 — Quick Scan CLI

Comments 1
1 min read
I Found 54 Reliability Issues in My 14-Agent AI System — Here's What Broke

I Found 54 Reliability Issues in My 14-Agent AI System — Here's What Broke

1
Comments 21
3 min read
I Ship One AI Testing Feature Every Day — Here's What 6 Days Looks Like

I Ship One AI Testing Feature Every Day — Here's What 6 Days Looks Like

Comments 1
1 min read
🐝 swarm-test v0.1.5— Per-Agent Health Scores

🐝 swarm-test v0.1.5— Per-Agent Health Scores

Comments
1 min read
loading...