What if your AI agent could do anything... but only what you actually allow?
That's Aegis: the first agent with biometric-gated trust boundaries.
GeminiLiveAgentChallenge
The Problem Nobody Is Talking About
Everyone is racing to build autonomous agents that read email, manage calendars, push code, send messages.
But nobody is asking: what stops it from doing something you didn't want?
Not hallucinations. Trust.
Aegis solves this with a three-tier security model:
π’ GREEN β Read-only, silent
π‘ YELLOW β Modifies state, verbal confirmation
π΄ RED β Irreversible/sensitive, Face ID/Touch ID required
Every action is classified by intent & consequence β not tool names.
The Biometric Flow (the hardest & most satisfying part)
RED action β Mac agent halts β GCP creates pending request β iPhone companion app receives it β Face ID fires via WebAuthn β success β agent proceeds.
Real-time cross-device flow: Mac β GCP β iPhone Face ID β Mac in seconds.
Your phone becomes the hardware lock on your AI.
The Classifier Insight
Tool names don't matter. Intent & consequence do.
Same click tool: navigating a menu = GREEN. Sending an email = RED. Context decides.
When in doubt: escalate. False RED costs one tap. False GREEN could cost everything.
The Stack
- Gemini Live API β real-time voice
- Gemini 2.5 Flash β classification & planning
- Composio β tool execution
- WebAuthn β biometric auth on iPhone
- FastAPI + GCP Cloud Run β backend & audit
- Firestore β real-time state
- React PWAs β Mac app, mobile, dashboard
Lightweight Auth (deadline pressure)
Full JWT was too risky in 8 days. Used bcrypt-hashed PIN registered to Firestore. Simple, secure, documented.
Aegis proves boundaries are buildable.
Try it now:
π Live: https://aegis.projectalpha.in
π Dashboard: https://aegisdashboard.projectalpha.in
π± Mobile: https://aegismobile.projectalpha.in
π» Code: https://github.com/harshitsinghbhandari/gemini-live-hackathon
Built solo in 15 days for #GeminiLiveAgentChallenge #GoogleAI #GeminiLive #BuildWithGemini
Top comments (0)