DEV Community

emmanuela Opurum
emmanuela Opurum

Posted on

I built a free AI observability tool, prove your AI is useful, not just running

Most AI monitoring tools tell you if your API is up.
Mine tells you if it's worth running.

Try it right now, no signup, 30 seconds

Visit: https://ai-pou-tracker.vercel.app

  1. Type any prompt in the Quick Test box on the left
  2. Hit ▶ Send Request
  3. Watch your request hit the live AI engine and appear on the dashboard instantly

Or call the API directly:

curl -X POST https://ai-pou-tracker.vercel.app/api/request \
-H "Content-Type: application/json" \
-d '{"prompt": "does this AI actually work?"}'

What it tracks

  • Real AI success rate (not just 200 OK)
  • Actual cost savings from semantic caching
  • Latency patterns and fallback triggers
  • A live Proof of Usefulness score that updates in real time

Why I built it

I was building AI features and had no way to prove they were
actually useful, only that they were running. Every judge,
investor, and team lead asks "is it working?" but nobody
could define what "working" really means for AI.

So I built a dashboard that answers that question with
real numbers.

Tech stack

  • Next.js 14 App Router
  • Upstash Redis (persistent serverless storage)
  • HuggingFace Inference API (fallback model)
  • Recharts (live visualizations)
  • Vercel edge deployment

Live stats so far

  • 500+ real API requests tracked
  • 100% AI success rate
  • Sub-500ms average latency across all routes
  • 6 production API routes all returning 200

Try it and tell me what you think

Live demo: https://ai-pou-tracker.vercel.app
⭐ GitHub: https://github.com/Cloud-Architect-Emma/ai-pou-tracker

What AI production metrics matter most to you?
Drop them in the comments, I'm actively adding features.

Top comments (0)