I Built an AI Agent Monitoring System as a Non-Dev Side Project. Here's Why.

Sid Thyagarajan — Thu, 26 Feb 2026 18:16:44 +0000

Hey everyone. This is my first ever side project and my first ever
post here. I'm not a developer by profession — I work in consulting
— but I've been obsessing over the AI agent space for the past year
and this thing just kind of happened.

What got me started:

I kept seeing stories about AI agents doing wild things when nobody
was watching. An AI coding assistant on Replit deleted its own database
during testing and then lied about it. Anthropic ran an experiment
where an agent named "Claudius" was put in charge of a vending business
and it repeatedly mismanaged money and behaved unpredictably. A Cursor
coding agent got stuck in an infinite loop burning through tokens
endlessly. And probably the craziest one — an enterprise AI agent
scanned an employee's inbox, found some questionable emails, and
threatened to forward them to the board of directors as blackmail.

Then I saw a survey that said there are over 3 million AI agents
running in corporations right now, and 53% of them aren't monitored
at all. 88% of companies reported having a suspected agent security
incident in the past year.

That's when I thought — somebody should build a security camera for
these things. Not something that controls them or adds guardrails.
Just something that watches what they do and tells you when something
looks wrong.

What I built:

https://agentsentinel.netlify.app/
https://sentineldemo.netlify.app/

Sentinel is a watchdog system for AI agents. It sits alongside your
agents and monitors every tool call, LLM request, and API interaction
in real-time. When it spots something unusual, it alerts you.

The detection works in 3 layers:

Fast rules (~1ms): "Did the agent access something it shouldn't?"
Statistics (~5ms): "Is this behavior abnormal compared to the last 7 days?"
AI analysis (~500ms): "Does this output contain fabricated information?"

It flags 10 types of problems: scope violations, hallucinated content,
prompt injection attempts, cost spikes, infinite loops, unauthorized
access, and more.

To add it to an existing agent, you literally just add two lines:

@sentinel.monitor_tool()   # monitors tool calls
@sentinel.monitor_llm      # monitors LLM calls

Your existing code stays completely untouched.

The honest truth:

I built this entire thing with Claude as my coding partner. I don't
know Python beyond the basics. I can't set up a database from scratch.
But I had a clear vision of what I wanted, and Claude helped me turn
it into actual working code. The irony of using an AI to build an AI
monitoring system is not lost on me.

It's open source (MIT license) and free:
https://gitlab.com/sidhomein-group/sentinel

I have no idea if anyone will find this useful, but building it was
one of the most satisfying things I've done. Would love any feedback
— especially from actual developers who can tell me what I've done
wrong!

DEV Community: Sid Thyagarajan

I Built an AI Agent Monitoring System as a Non-Dev Side Project. Here's Why.