<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Abhishek</title>
    <description>The latest articles on DEV Community by Abhishek (@abhishek_44d97e81b5a38faa).</description>
    <link>https://dev.to/abhishek_44d97e81b5a38faa</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3780593%2F29d735aa-4629-41a4-bc28-ca41db483538.png</url>
      <title>DEV Community: Abhishek</title>
      <link>https://dev.to/abhishek_44d97e81b5a38faa</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/abhishek_44d97e81b5a38faa"/>
    <language>en</language>
    <item>
      <title>Jan Sahay — From a Financial Crisis to a Citizen AI Voice Assistant</title>
      <dc:creator>Abhishek</dc:creator>
      <pubDate>Sat, 15 Aug 2026 10:29:08 +0000</pubDate>
      <link>https://dev.to/abhishek_44d97e81b5a38faa/jan-sahay-from-a-financial-crisis-to-a-citizen-ai-voice-assistant-2l8n</link>
      <guid>https://dev.to/abhishek_44d97e81b5a38faa/jan-sahay-from-a-financial-crisis-to-a-citizen-ai-voice-assistant-2l8n</guid>
      <description>&lt;h1&gt;
  
  
  🛡️ Jan Sahay (जन सहाय) — AI-Powered Citizen Assistance Platform
&lt;/h1&gt;

&lt;h3&gt;
  
  
  &lt;em&gt;A 10-Day Journey Building a Real-Time, Multilingual Voice Agent for Financial Safety, Government Welfare &amp;amp; Cyber Fraud Containment&lt;/em&gt;
&lt;/h3&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F91bygk2z8tb4kzmxln7x.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F91bygk2z8tb4kzmxln7x.jpg" alt=" " width="800" height="378"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F9wau50369i8z9h7ifj4z.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F9wau50369i8z9h7ifj4z.jpg" alt="Jan Sahay Banner" width="800" height="378"&gt;&lt;/a&gt;&lt;/p&gt;




&lt;h2&gt;
  
  
  📖 The Story That Started It All
&lt;/h2&gt;

&lt;p&gt;Imagine a small shopkeeper in Delhi named &lt;strong&gt;Ramesh&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;One evening, Ramesh receives a message on his phone:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;em&gt;"Your bank account will be blocked tonight. Verify your KYC immediately by clicking the link below."&lt;/em&gt;&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;Anxious and rushed, he clicks the link. Within a few minutes, he realizes the message was fake and an unauthorized transaction has taken place.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fatc9fzmjjidxi00eud1j.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fatc9fzmjjidxi00eud1j.png" alt=" " width="800" height="450"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Now he is gripped with panic and urgent questions:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;em&gt;What should he do right now?&lt;/em&gt;&lt;/li&gt;
&lt;li&gt;&lt;em&gt;Who should he contact?&lt;/em&gt;&lt;/li&gt;
&lt;li&gt;&lt;em&gt;Can he report the fraud and freeze his account before the money is moved?&lt;/em&gt;&lt;/li&gt;
&lt;li&gt;&lt;em&gt;Are there government schemes or emergency funds that could help his family recover?&lt;/em&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The information exists across various portals and government websites—but finding the right, authoritative guidance during a crisis is overwhelmingly difficult. Most portals are text-heavy, loaded with bureaucratic jargon, or only in English.&lt;/p&gt;

&lt;p&gt;That very question became the inspiration behind &lt;strong&gt;Jan Sahay (जन सहाय)&lt;/strong&gt;: a citizen-focused, voice-first AI platform built to make &lt;strong&gt;financial literacy, fraud prevention, government welfare schemes, and complaint guidance&lt;/strong&gt; accessible to every citizen. Instead of navigating complex portals or waiting in queues, citizens can simply talk naturally in Hindi, English, or Hinglish to an empathetic AI voice assistant.&lt;/p&gt;

&lt;p&gt;This document outlines the complete story, architecture, development log, challenges solved, and setup guide for Jan Sahay over &lt;strong&gt;10 Days of Building Voice Agents&lt;/strong&gt;.&lt;/p&gt;




&lt;h2&gt;
  
  
  🏛️ The 4 Core Functional Pillars
&lt;/h2&gt;

&lt;p&gt;Rather than building a generic open-ended chatbot, Jan Sahay is structured around four foundational pillars designed specifically for citizen welfare and digital safety:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;                  ┌──────────────────────────────┐
                  │          JAN SAHAY           │
                  │   Citizen Voice Assistant    │
                  └──────────────┬───────────────┘
                                 │
     ┌──────────────────┬────────┴─────────┬──────────────────┐
     ▼                  ▼                  ▼                  ▼
┌──────────────┐ ┌──────────────┐ ┌──────────────┐ ┌──────────────┐
│  Financial   │ │    Fraud     │ │  Government  │ │  Complaint   │
│   Literacy   │ │  Prevention  │ │   Schemes    │ │  Assistance  │
└──────────────┘ └──────────────┘ └──────────────┘ └──────────────┘
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;💰 Financial Literacy:&lt;/strong&gt; Jargon-free guidance on savings accounts, budgeting fundamentals, formal credit, interest rates, and long-term financial planning.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;🛡️ Fraud Prevention:&lt;/strong&gt; Real-time coaching on OTP/PIN safety, identifying phishing messages, fake caller identification, and avoiding malicious screen-sharing APKs.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;🏛️ Government Welfare Schemes:&lt;/strong&gt; Deterministic eligibility calculations and checklists for &lt;strong&gt;PMJDY&lt;/strong&gt;, &lt;strong&gt;PMSBY&lt;/strong&gt;, &lt;strong&gt;PMJJBY&lt;/strong&gt;, &lt;strong&gt;Atal Pension Yojana (APY)&lt;/strong&gt;, &lt;strong&gt;Sukanya Samriddhi (SSY)&lt;/strong&gt;, &lt;strong&gt;PM Mudra Yojana&lt;/strong&gt;, and &lt;strong&gt;PM-KISAN&lt;/strong&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;📞 Complaint &amp;amp; Emergency Triage:&lt;/strong&gt; Structured step-by-step incident response for cybercrime reporting (&lt;strong&gt;1930 / cybercrime.gov.in&lt;/strong&gt;), bank dispute filing for RBI Zero-Liability protection, and consumer forum escalations.&lt;/li&gt;
&lt;/ol&gt;




&lt;h2&gt;
  
  
  🏗️ System Architecture &amp;amp; Real-Time Voice Flow
&lt;/h2&gt;

&lt;p&gt;Jan Sahay achieves sub-500ms voice turnaround times using real-time WebRTC audio streaming, streaming transcription, low-latency LLM reasoning, and natural Indian voice synthesis.&lt;/p&gt;

&lt;h3&gt;
  
  
  1. Real-Time Audio Pipeline Flow
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;flowchart LR
    A["🎙️ Citizen Speaks Audio"] --&amp;gt; B["⚡ LiveKit WebRTC&amp;lt;br/&amp;gt;Real-Time Transport"]
    B --&amp;gt; C["🗣️ Deepgram Nova-2&amp;lt;br/&amp;gt;Streaming Speech-to-Text"]
    C --&amp;gt; D["🧠 Google Gemini AI&amp;lt;br/&amp;gt;Reasoning &amp;amp; Intent"]
    D --&amp;gt; E["💰 Financial Rules Engine&amp;lt;br/&amp;gt;+ Caller Memory DB"]
    E --&amp;gt; F["🔊 Murf Falcon TTS&amp;lt;br/&amp;gt;Ultra-Fast Indian Voices"]
    F --&amp;gt; G["🗣️ Natural Voice&amp;lt;br/&amp;gt;Playback to Citizen"]

    G -.-&amp;gt; A

    style A fill:#1E293B,stroke:#38BDF8,color:#fff
    style B fill:#0284C7,stroke:#38BDF8,color:#fff
    style C fill:#0D9488,stroke:#2DD4BF,color:#fff
    style D fill:#6366F1,stroke:#A5B4FC,color:#fff
    style E fill:#D97706,stroke:#FDE68A,color:#fff
    style F fill:#EA580C,stroke:#FDBA74,color:#fff
    style G fill:#10B981,stroke:#6EE7B7,color:#fff
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  2. Complete Multi-Tier Architecture
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;                        ┌──────────────────────┐
                        │        CITIZEN       │
                        └──────────┬───────────┘
                                   │ (Speaks / Listens)
                                   ▼
                        ┌──────────────────────┐
                        │ Jan Sahay Web Portal │
                        │   (Next.js Client)   │
                        └──────────┬───────────┘
                                   │ WebRTC Audio Stream (LiveKit)
                                   ▼
                        ┌──────────────────────┐
                        │ LiveKit Voice Agent  │
                        └─────┬──────────┬─────┘
                              │          │
        ┌─────────────────────┘          └─────────────────────┐
        ▼                                                      ▼
┌───────────────┐                                      ┌───────────────┐
│   Deepgram    │ (Audio to Text)                      │  Murf Falcon  │ (Text to Audio)
│  Nova-2 STT   │                                      │   (TTS API)   │
└───────┬───────┘                                      └───────▲───────┘
        │                                                      │
        ▼                                                      │
┌──────────────────────────────────────────────────────────────┴───────┐
│                     Google Gemini Orchestrator                       │
└───────┬───────────────────────────────┬──────────────────────────────┘
        │                               │
        ▼                               ▼
┌───────────────┐               ┌───────────────┐
│ Caller Memory │               │ Rules Engine  │
│ (SQLite DB)   │               │ (Deterministic│
│               │               │ Scheme Logic) │
└───────────────┘               └───────────────┘
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h2&gt;
  
  
  🎙️ Meet the Team of AI Specialists
&lt;/h2&gt;

&lt;p&gt;Jan Sahay uses a multi-agent federation where a main intake guide dynamically hands off the conversation to dedicated domain specialists, matching their persona with the optimal &lt;strong&gt;Murf Falcon voice profile&lt;/strong&gt;:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Specialist Avatar&lt;/th&gt;
&lt;th&gt;Agent Role &amp;amp; Domain&lt;/th&gt;
&lt;th&gt;Voice Profile&lt;/th&gt;
&lt;th&gt;Supported Locales&lt;/th&gt;
&lt;th&gt;Key Capabilities&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Anisha&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;strong&gt;Main Intake &amp;amp; General Guide&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;Anisha&lt;/code&gt; (Murf Falcon)&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;en-IN&lt;/code&gt; / &lt;code&gt;hi-IN&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Warm intake, 2-turn scoping, personalized greetings, banking basics.&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Samar&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;strong&gt;Cyber Safety &amp;amp; Emergency Containment&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;Samar&lt;/code&gt; (Murf Falcon)&lt;/td&gt;
&lt;td&gt;&lt;code&gt;en-IN&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Golden hour containment, 1930 reporting, bank helpline lookup.&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Pooja&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;strong&gt;Government Schemes &amp;amp; Pension Guide&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;Pooja&lt;/code&gt; (Murf Falcon)&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;en-IN&lt;/code&gt; / &lt;code&gt;hi-IN&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;APY pension calculators, Sukanya Samriddhi (8.2%), PMJDY/PMSBY/PMJJBY.&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Samar&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;strong&gt;Micro-Credit &amp;amp; Business Loans&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;Samar&lt;/code&gt; (Murf Falcon)&lt;/td&gt;
&lt;td&gt;&lt;code&gt;en-IN&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;PMMY Mudra loans (Shishu, Kishore, Tarun), PM SVANidhi vendor loans.&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Palak&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;strong&gt;Agri-Financial &amp;amp; Crop Insurance&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;Palak&lt;/code&gt; (Murf Falcon)&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;en-IN&lt;/code&gt; / &lt;code&gt;hi-IN&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;PMFBY 72-hr crop loss reporting, PM-KISAN e-KYC status, Kisan Credit Cards.&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;




&lt;h2&gt;
  
  
  📅 10-Day Development Journey &amp;amp; Log
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fefwcphxmh1l7r2dzf2pz.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fefwcphxmh1l7r2dzf2pz.jpg" alt="Development Highlights" width="800" height="342"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h3&gt;
  
  
  🟢 Day 1 — The Problem: Financial Confusion Is Everywhere
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Key Realization&lt;/strong&gt;: Financial information is available, but accessibility is broken. Ordinary citizens struggle with banking, digital safety (UPI fraud/phishing), welfare schemes, and dispute recourse.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Objective&lt;/strong&gt;: Build an AI assistant that feels less like a search engine and more like a patient, empathetic citizen-support counselor.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Core Pillars Defined&lt;/strong&gt;: Simple, Conversational, Multilingual, Trustworthy, and Voice-first.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 2 — Designing the Citizen Experience
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Structured the core 4-pillar interaction model (Financial Literacy, Fraud Prevention, Government Schemes, Complaint Assistance).&lt;/li&gt;
&lt;li&gt;Defined prompt rules prohibiting hallucinations and outlining empathetic responses for users facing financial distress.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 3 — Giving the AI a Memory
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Problem&lt;/strong&gt;: Stateless chatbots suffer from amnesia. If Ramesh calls today about his daughter's education fund and calls back tomorrow, repeating context causes friction.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Solution&lt;/strong&gt;: Built the &lt;strong&gt;Caller Memory Database&lt;/strong&gt; (&lt;code&gt;backend/caller_data.db&lt;/code&gt; using SQLite) with schema for &lt;code&gt;user_id&lt;/code&gt;, &lt;code&gt;name&lt;/code&gt;, &lt;code&gt;language_pref&lt;/code&gt;, &lt;code&gt;demographic_facts&lt;/code&gt;, and &lt;code&gt;discussed_schemes&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Privacy First&lt;/strong&gt;: Integrated explicit verbal consent checks (&lt;em&gt;"May I remember this for your next call?"&lt;/em&gt;) before storing non-PII demographic facts.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 4 — Building the Government Scheme Knowledge Layer
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Architecture Rule&lt;/strong&gt;: &lt;em&gt;LLM handles dialogue $\rightarrow$ Deterministic Rules Engine guarantees official policy truth.&lt;/em&gt;
&lt;/li&gt;
&lt;li&gt;Implemented exact formula calculators for:

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;PMJDY&lt;/strong&gt;: Zero balance, RuPay debit card, ₹2L accident insurance cover.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;PMSBY&lt;/strong&gt;: Accidental death/disability cover (Age 18–70, ₹20/year premium, ₹2 Lakh cover).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;PMJJBY&lt;/strong&gt;: Life insurance cover (Age 18–50, ₹436/year premium, ₹2 Lakh cover).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;APY&lt;/strong&gt;: Atal Pension Yojana pension slabs (₹1,000–₹5,000/mo at age 60 based on entry age).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;SSY&lt;/strong&gt;: Sukanya Samriddhi Yojana (Girl child &amp;lt; 10 yrs, current 8.2% interest, tax exemptions).&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 5 — Turning Text Into a Real-Time Voice Conversation
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Integrated &lt;strong&gt;LiveKit WebRTC Agents&lt;/strong&gt; with &lt;strong&gt;Deepgram Nova-2 STT&lt;/strong&gt; and &lt;strong&gt;Murf Falcon TTS&lt;/strong&gt;.&lt;/li&gt;
&lt;li&gt;Enabled streaming bidirectional audio with Silero VAD (Voice Activity Detection) for seamless turn detection and low-latency interruptions.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 6 — Making Jan Sahay Multilingual &amp;amp; Code-Mixed
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Configured STT and TTS mappings for English (&lt;code&gt;en-IN&lt;/code&gt;), Hindi (&lt;code&gt;hi-IN&lt;/code&gt;), and conversational Hinglish.&lt;/li&gt;
&lt;li&gt;Enforced single-language response purity per turn to eliminate double-audio slash artifacts (&lt;code&gt;"Hello / नमस्ते"&lt;/code&gt;).&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 7 — Fraud Prevention as a First-Class Feature
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Implemented &lt;strong&gt;Immediate Action Matrix&lt;/strong&gt; for cyber safety:

&lt;ul&gt;
&lt;li&gt;Strict alerts on OTP/PIN confidentiality.&lt;/li&gt;
&lt;li&gt;Screen-sharing warning triggers (AnyDesk, TeamViewer).&lt;/li&gt;
&lt;li&gt;Unverified QR code and UPI PIN receiving scam alerts.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Golden Hour Protocols&lt;/strong&gt; to halt fund movement.&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 8 — Action-Oriented Complaint Assistance
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Developed structured escalation protocols:

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Banking Disputes&lt;/strong&gt;: Card freeze, dispute filing within 3 days for RBI Zero-Liability.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cybercrime Reporting&lt;/strong&gt;: Guided walkthrough for &lt;code&gt;cybercrime.gov.in&lt;/code&gt; and National Helpline &lt;strong&gt;1930&lt;/strong&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Human Escalation&lt;/strong&gt;: Generates unique escalation reference IDs (e.g., &lt;code&gt;ESC-XXXXX&lt;/code&gt;) logged to SQLite for officer review.&lt;/li&gt;
&lt;/ol&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 9 — Building the Web Portal &amp;amp; Telemetry Dashboard
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Developed a high-performance &lt;strong&gt;Next.js&lt;/strong&gt; web application with a single-click 🎙️ &lt;strong&gt;"Start Talking"&lt;/strong&gt; interface.&lt;/li&gt;
&lt;li&gt;Built real-time telemetry tracking turn latency, outcome classifications (resolved/escalated), and active escalation queues at &lt;code&gt;/api/dashboard&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;Added telephony SIP outbound calling capability (&lt;code&gt;backend/src/outbound_call.py&lt;/code&gt;).&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  🟢 Day 10 — Open-Source Release &amp;amp; Architecture Documentation
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Packaged repository with automated startup scripts (&lt;code&gt;start_app.ps1&lt;/code&gt; / &lt;code&gt;start_app.sh&lt;/code&gt;), comprehensive API documentation, and architecture diagrams.&lt;/li&gt;
&lt;/ul&gt;




&lt;h2&gt;
  
  
  🚧 Challenges Faced &amp;amp; How We Solved Them
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. 🌐 Multilingual &amp;amp; Language Switching Inconsistencies
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;The Problem&lt;/strong&gt;: In bilingual English/Hindi environments, the agent sometimes randomly replied in Hindi to an English prompt or switched languages mid-conversation without user intent.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;How We Solved It&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;Implemented session-level language tracking in SQLite memory.&lt;/li&gt;
&lt;li&gt;Enforced strict prompt guidelines: detect user language preference, maintain it consistently across turns, and switch languages only when explicitly requested by the citizen.&lt;/li&gt;
&lt;li&gt;Required native Devanagari script output for Hindi responses to ensure Murf Falcon TTS synthesizes authentic intonation.&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  2. 🧠 Hallucination-Free Financial Reasoning
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;The Problem&lt;/strong&gt;: Financial queries involving age limits, cutoff dates, premium tiers, and pension returns must be 100% accurate. LLMs can hallucinate calculation schedules.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;How We Solved It&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;Decoupled conversational empathy from calculations.&lt;/li&gt;
&lt;li&gt;Gemini extracts parameters (age, target pension, child age) and calls deterministic Python functions (&lt;code&gt;calculate_apy_contribution&lt;/code&gt;, &lt;code&gt;get_scheme_details&lt;/code&gt;).&lt;/li&gt;
&lt;li&gt;Verified math is returned to Gemini to format as a spoken response.
&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Citizen Question ──&amp;gt; Gemini AI (Intent Extraction) ──&amp;gt; Python Rules Engine ──&amp;gt; Verified Result ──&amp;gt; Murf Voice
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  3. 🔄 Dynamic Voice Profile Switching in WebRTC
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;The Problem&lt;/strong&gt;: Tearing down WebRTC rooms when switching from Anisha to Samar or Pooja caused noticeable audio stutters and 2–3s delays.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;How We Solved It&lt;/strong&gt;: Kept the WebRTC audio transport live while dynamically swapping the Murf Falcon voice profile parameters in-flight during tool execution.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  4. 🛡️ Accidental PII Memorization
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;The Problem&lt;/strong&gt;: Panicked callers reporting fraud frequently blurt out card numbers or PINs.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;How We Solved It&lt;/strong&gt;: Built an automated sanitization regex layer in &lt;code&gt;save_caller_facts&lt;/code&gt; and &lt;code&gt;create_escalation&lt;/code&gt; that automatically scrubs card numbers, OTPs, PINs, and passwords before database commits.&lt;/li&gt;
&lt;/ul&gt;




&lt;h2&gt;
  
  
  🔮 What's Next on the Roadmap
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;📞 Telephony &amp;amp; IVR Toll-Free Access&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;SIP Trunking integration with Exotel / Twilio so citizens without smartphones can dial a toll-free number from any basic feature phone.&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;🗣️ Hyper-Local Regional Dialects&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;Expand beyond Hindi/English to regional languages (Bhojpuri, Maithili, Bengali, Marathi, Tamil, Telugu).&lt;/li&gt;
&lt;li&gt;Acoustic noise suppression tuned for busy Indian environments (markets, bus stops, railway stations).&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;📄 DigiLocker &amp;amp; Voice-Guided Application&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;Voice OTP authorization for instant eligibility verification via DigiLocker.&lt;/li&gt;
&lt;li&gt;Voice-guided form pre-filling for PM-KISAN and Sukanya Samriddhi portals.&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;📲 Multi-Channel Follow-ups (WhatsApp / SMS)&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;Automated post-call summary SMS with verified helpline links, scheme forms, and grievance reference IDs.&lt;/li&gt;
&lt;li&gt;Instant downloadable PDF checklist generated at the end of the voice call.&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;🚨 Proactive Outbound Alerts&lt;/strong&gt;:

&lt;ul&gt;
&lt;li&gt;Automated voice alerts when subsidy installments (PM-KISAN, APY pensions) are credited.&lt;/li&gt;
&lt;li&gt;Geo-targeted voice broadcasts warning citizens about emerging phishing scams in their district.&lt;/li&gt;
&lt;/ul&gt;
&lt;/li&gt;
&lt;/ol&gt;




&lt;h2&gt;
  
  
  🛠️ Step-by-Step Quickstart Guide
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Prerequisites
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Python&lt;/strong&gt; 3.10+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;&lt;a href="https://docs.astral.sh/uv/" rel="noopener noreferrer"&gt;uv&lt;/a&gt;&lt;/strong&gt; (Fast Python package manager)
&lt;/li&gt;
&lt;/ul&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight powershell"&gt;&lt;code&gt;&lt;span class="w"&gt;  &lt;/span&gt;&lt;span class="c"&gt;# Windows (PowerShell)&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="n"&gt;powershell&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nt"&gt;-ExecutionPolicy&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nx"&gt;ByPass&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nt"&gt;-c&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"irm https://astral.sh/uv/install.ps1 | iex"&lt;/span&gt;&lt;span class="w"&gt;

  &lt;/span&gt;&lt;span class="c"&gt;# macOS/Linux&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="n"&gt;curl&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nt"&gt;-LsSf&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nx"&gt;https://astral.sh/uv/install.sh&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="o"&gt;|&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="n"&gt;sh&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Node.js&lt;/strong&gt; 18+ and &lt;strong&gt;pnpm&lt;/strong&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;  npm &lt;span class="nb"&gt;install&lt;/span&gt; &lt;span class="nt"&gt;-g&lt;/span&gt; pnpm
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;LiveKit Cloud Account&lt;/strong&gt;: &lt;a href="https://cloud.livekit.io/" rel="noopener noreferrer"&gt;cloud.livekit.io&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Murf AI API Key&lt;/strong&gt;: &lt;a href="https://murf.ai/api/dashboard" rel="noopener noreferrer"&gt;murf.ai/api/dashboard&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google AI Studio API Key&lt;/strong&gt;: &lt;a href="https://aistudio.google.com/" rel="noopener noreferrer"&gt;aistudio.google.com&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Deepgram API Key&lt;/strong&gt;: &lt;a href="https://deepgram.com/" rel="noopener noreferrer"&gt;deepgram.com&lt;/a&gt;
&lt;/li&gt;
&lt;/ul&gt;




&lt;h3&gt;
  
  
  Step 1: Clone the Repository &amp;amp; Configure Secrets
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;git clone https://github.com/your-username/jan-sahay-voice-agent.git
&lt;span class="nb"&gt;cd &lt;/span&gt;jan-sahay-voice-agent/murf-livekit-starter
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Create &lt;code&gt;.env.local&lt;/code&gt; files in both &lt;code&gt;backend/&lt;/code&gt; and &lt;code&gt;frontend/&lt;/code&gt;:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;&lt;code&gt;backend/.env.local&lt;/code&gt;&lt;/strong&gt;:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;LIVEKIT_URL=wss://your-project.livekit.cloud
LIVEKIT_API_KEY=your_livekit_key
LIVEKIT_API_SECRET=your_livekit_secret
MURF_API_KEY=your_murf_falcon_api_key
DEEPGRAM_API_KEY=your_deepgram_api_key
GOOGLE_API_KEY=your_gemini_api_key
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;&lt;code&gt;frontend/.env.local&lt;/code&gt;&lt;/strong&gt;:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;LIVEKIT_URL=wss://your-project.livekit.cloud
LIVEKIT_API_KEY=your_livekit_key
LIVEKIT_API_SECRET=your_livekit_secret
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h3&gt;
  
  
  Step 2: Install Backend Dependencies
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nb"&gt;cd &lt;/span&gt;backend
uv &lt;span class="nb"&gt;sync
&lt;/span&gt;uv run python src/agent.py download-files
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h3&gt;
  
  
  Step 3: Install Frontend Dependencies
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nb"&gt;cd&lt;/span&gt; ../frontend
pnpm &lt;span class="nb"&gt;install&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h3&gt;
  
  
  Step 4: Run the Application
&lt;/h3&gt;

&lt;h4&gt;
  
  
  Option A: One-Click Startup Script (Recommended)
&lt;/h4&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;# Windows (PowerShell):&lt;/span&gt;
.&lt;span class="se"&gt;\s&lt;/span&gt;tart_app.ps1

&lt;span class="c"&gt;# Linux / macOS:&lt;/span&gt;
&lt;span class="nb"&gt;chmod&lt;/span&gt; +x start_app.sh
./start_app.sh
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h4&gt;
  
  
  Option B: Separate Terminals
&lt;/h4&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;# Terminal 1: Backend Voice Worker&lt;/span&gt;
&lt;span class="nb"&gt;cd &lt;/span&gt;backend
uv run python src/agent.py dev

&lt;span class="c"&gt;# Terminal 2: Frontend Web UI &amp;amp; Dashboard&lt;/span&gt;
&lt;span class="nb"&gt;cd &lt;/span&gt;frontend
pnpm dev
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Open &lt;strong&gt;&lt;code&gt;http://localhost:3000&lt;/code&gt;&lt;/strong&gt; in your browser, click &lt;strong&gt;"Start talking"&lt;/strong&gt;, grant microphone access, and begin speaking with &lt;strong&gt;Anisha&lt;/strong&gt;!&lt;/p&gt;




&lt;h2&gt;
  
  
  📁 Repository Structure
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;jan-sahay/
├── README.md                           # Main documentation &amp;amp; 10-day build story
└── murf-livekit-starter/
    ├── start_app.ps1                   # Windows 1-click startup script
    ├── start_app.sh                    # Linux/macOS 1-click startup script
    ├── backend/
    │   ├── caller_data.db              # SQLite Caller Memory &amp;amp; Escalations DB
    │   ├── src/
    │   │   ├── agent.py                # Main LiveKit Agent &amp;amp; Multi-Specialist logic
    │   │   ├── db.py                   # SQLite memory CRUD, calculators &amp;amp; PII sanitizer
    │   │   ├── prompt.py               # Anisha persona &amp;amp; system guardrails
    │   │   ├── specialist_prompts.py   # Prompts for Samar, Pooja, and Palak
    │   │   └── outbound_call.py        # Telephony SIP outbound dialer
    │   └── pyproject.toml              # uv Python dependencies
    └── frontend/
        ├── app/
        │   ├── page.tsx                # Next.js Voice Assistant Web Interface
        │   └── api/dashboard/route.ts  # Observability &amp;amp; Escalations API
        └── package.json                # Frontend dependencies (pnpm)
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






</description>
      <category>voiceagent</category>
      <category>10daysofaivoiceagents</category>
      <category>murffalcon</category>
      <category>voiceforbharat</category>
    </item>
    <item>
      <title>my post mera post</title>
      <dc:creator>Abhishek</dc:creator>
      <pubDate>Sat, 15 Aug 2026 05:58:28 +0000</pubDate>
      <link>https://dev.to/abhishek_44d97e81b5a38faa/my-post-mera-post-38j4</link>
      <guid>https://dev.to/abhishek_44d97e81b5a38faa/my-post-mera-post-38j4</guid>
      <description>&lt;p&gt;happy guys&lt;/p&gt;

</description>
      <category>ai</category>
    </item>
    <item>
      <title>Navigatop</title>
      <dc:creator>Abhishek</dc:creator>
      <pubDate>Sat, 11 Apr 2026 13:58:12 +0000</pubDate>
      <link>https://dev.to/abhishek_44d97e81b5a38faa/navigatop-2lm2</link>
      <guid>https://dev.to/abhishek_44d97e81b5a38faa/navigatop-2lm2</guid>
      <description>&lt;h2&gt;
  
  
  📖 Overview
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Navigato Platinum&lt;/strong&gt; is a premium...&lt;/p&gt;

&lt;p&gt;In a venue hosting &lt;strong&gt;132,000 attendees&lt;/strong&gt;, congestion and emergency response are critical life-safety challenges. Navigato solves this by aggregating real-time occupancy data and delivering strategic insights via an &lt;strong&gt;AI-Grounded Spatial Hub&lt;/strong&gt;.&lt;/p&gt;




&lt;h2&gt;
  
  
  🧠 Approach and Logic
&lt;/h2&gt;

&lt;p&gt;Large venues suffer from "Information Blackouts" during peak events. Navigato creates a &lt;strong&gt;Single Source of Truth&lt;/strong&gt; across defined zones (Gates, Food Courts, Pavilions).&lt;/p&gt;

&lt;h3&gt;
  
  
  1. Strategic Decision Making
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Status Derivation&lt;/strong&gt;: Zone health (Clear, Moderate, Crowded, Critical) is dynamically calculated using a weighted threshold algorithm based on live capacity-to-density ratios.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Pathfinding (Dijkstra's Algorithm)&lt;/strong&gt;: Navigation routes are not just the shortest path; they are the &lt;strong&gt;fastest&lt;/strong&gt; path. The edge weights in our Dijkstra implementation are adjusted in real-time based on the congestion ratio of each zone.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;AI Context Grounding&lt;/strong&gt;: The Gemini assistant is "Stitched" into the stadium's live telemetry. Every prompt is injected with the current JSON state of the venue, enabling hyper-accurate, real-time advice.&lt;/li&gt;
&lt;/ul&gt;




&lt;h2&gt;
  
  
  ⚡ The Twin-Engine™ Architecture
&lt;/h2&gt;

&lt;p&gt;To achieve 100% startup stability on Google Cloud Run, Navigato utilizes a proprietary &lt;strong&gt;Twin-Engine&lt;/strong&gt; boot sequence.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;sequenceDiagram
    participant GCR as Google Cloud Run
    participant E1 as Engine 1 (Safe-Start)
    participant E2 as Engine 2 (Platinum Core)

    GCR-&amp;gt;&amp;gt;E1: SIGINIT Launch
    E1-&amp;gt;&amp;gt;E1: Bind Port 8080 (Instantly)
    Note over E1: Health Check Passed (2ms)
    E1-&amp;gt;&amp;gt;E2: Modular Dynamic Import
    E2-&amp;gt;&amp;gt;E2: Warm up AI Clusters &amp;amp; GCS Streams
    E2--&amp;gt;&amp;gt;E1: Core Synchronized
    Note over E1,E2: Platform 100% Operational
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Engine 1 (The Shield)&lt;/strong&gt;: A lightweight Node.js entrypoint that binds to the assigned PORT immediately to prevent timeout errors.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Engine 2 (The Intelligence)&lt;/strong&gt;: The modular Express 5.0 application logic, loaded after the port is stable.&lt;/li&gt;
&lt;/ul&gt;




&lt;h2&gt;
  
  
  📂 Full Project Structure
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;├── server/                 # PLATINUM BACKEND ENGINE
│   ├── boot.ts             # Engine 1: Instant-bind bootstrapper
│   ├── index.ts            # Engine 2: Modular app logic (Express 5)
│   ├── routes/             # API Endpoints
│   │   ├── ai.ts           # Gemini 1.5 Flash Chat &amp;amp; Triage
│   │   └── incidents.ts    # GCS Visual Telemetry Pipeline
│   ├── services/           # External Service Layer
│   │   ├── gemini.ts       # Google Gen AI SDK Integration
│   │   ├── storage.ts      # Cloud Storage Stream Engine
│   │   └── analytics.ts    # BigQuery &amp;amp; Event Logging
│   └── middleware/         # Security &amp;amp; Auth
│       └── auth.ts         # Firebase Admin Token Verification
├── src/                    # ELITE FRONTEND HUB (React 19)
│   ├── components/         # Premium Component Library
│   │   ├── attendee/       # ZoneMap, LiveHub, Dispatch
│   │   └── layout/         # Glassmorphism Framework
│   ├── context/            # Global State (ZoneContext)
│   ├── hooks/              # Custom Logic (useAuth)
│   └── App.tsx             # Main System Entrypoint
├── Dockerfile              # Multi-Stage Production Shield
├── vite.config.js          # Advanced Rollup Code-Splitting
└── deploy.ps1              # One-Click Cloud Run Deployer
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h2&gt;
  
  
  🛠️ Google Services Integration
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Service&lt;/th&gt;
&lt;th&gt;Integration Detail&lt;/th&gt;
&lt;th&gt;Location&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Google Cloud Run&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Multi-stage container runtime with Twin-Engine boot.&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;Dockerfile&lt;/code&gt;, &lt;code&gt;boot.ts&lt;/code&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Google Maps JS API&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Satellite imagery + Advanced Markers + Directions.&lt;/td&gt;
&lt;td&gt;&lt;code&gt;ZoneMap.tsx&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Gemini 1.5 Flash&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;AI Chat Assistant &amp;amp; Visual Incident Triage.&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;gemini.ts&lt;/code&gt;, &lt;code&gt;ai.ts&lt;/code&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Cloud Storage&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Visual telemetry streams for emergency dispatch.&lt;/td&gt;
&lt;td&gt;&lt;code&gt;storage.ts&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Firebase Admin&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Role-based custom claims &amp;amp; Token security.&lt;/td&gt;
&lt;td&gt;&lt;code&gt;auth.ts&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Google Cloud Logging&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;Structured JSON logging for 100% observability.&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;index.ts&lt;/code&gt;, &lt;code&gt;boot.ts&lt;/code&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;




&lt;h2&gt;
  
  
  🏗️ System Visualizations
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. The Intelligence Pipeline (AI Triage)
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;graph TD
    A[Attendee Report] --&amp;gt;|Satellite Telemetry| B(Google Cloud Storage)
    A --&amp;gt;|Contextual Description| C(Navigato AI)
    B --&amp;gt; C
    C --&amp;gt;|Gemini 1.5 Flash| D{Strategic Severity}
    D --&amp;gt;|HIGH| E[Emergency Staff Dispatch]
    D --&amp;gt;|LOW/MED| F[Operational Logging]
    E --&amp;gt; G(Cloud Pub/Sub Alert)
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  2. The Platinum Cloud Stack
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;graph LR
    User[Attendee] --&amp;gt;|React 19| FE(Frontend Hub)
    FE --&amp;gt;|Vite 8 / ESM| BE(Platinum Core)
    BE --&amp;gt;|Twin-Engine™ Boot| CR(Cloud Run)
    CR --&amp;gt;|Security| FA(Firebase Admin)
    CR --&amp;gt;|Spatial| GM(Google Maps)
    CR --&amp;gt;|Gen AI| AI(Gemini 1.5)
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h2&gt;
  
  
  🚀 Setup &amp;amp; Running locally
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt; &lt;strong&gt;Environment Setup&lt;/strong&gt;: Add your &lt;code&gt;VITE_GOOGLE_MAPS_API_KEY&lt;/code&gt; to the &lt;code&gt;.env&lt;/code&gt; file.&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Install &amp;amp; Build&lt;/strong&gt;:&lt;br&gt;
&lt;/p&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;npm &lt;span class="nb"&gt;install
&lt;/span&gt;npm run build
&lt;/code&gt;&lt;/pre&gt;

&lt;/li&gt;
&lt;li&gt;
&lt;p&gt;&lt;strong&gt;Ignite the Platform&lt;/strong&gt;:&lt;br&gt;
&lt;/p&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;npm start
&lt;/code&gt;&lt;/pre&gt;

&lt;/li&gt;
&lt;/ol&gt;




&lt;blockquote&gt;
&lt;p&gt;[!IMPORTANT]&lt;br&gt;
&lt;strong&gt;Production Note&lt;/strong&gt;: Navigato Platinum is optimized for the &lt;strong&gt;Narendra Modi Stadium&lt;/strong&gt; geolocation. For local testing, use the "Force Sync" demo mode to bypass live GPS requirements.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;&lt;strong&gt;Navigato Platinum • Strategic Crowd Intelligence&lt;/strong&gt;&lt;br&gt;&lt;br&gt;
Built by &lt;strong&gt;Abhishek&lt;/strong&gt; for &lt;strong&gt;Promptwars&lt;/strong&gt;.&lt;/p&gt;

</description>
      <category>webdev</category>
      <category>ai</category>
    </item>
    <item>
      <title>Building MovieSync in Public: A Real-Time Dashboard for Smarter Movie Intermissions</title>
      <dc:creator>Abhishek</dc:creator>
      <pubDate>Fri, 10 Apr 2026 05:23:53 +0000</pubDate>
      <link>https://dev.to/abhishek_44d97e81b5a38faa/building-moviesync-in-public-a-real-time-dashboard-for-smarter-movie-intermissions-4h6n</link>
      <guid>https://dev.to/abhishek_44d97e81b5a38faa/building-moviesync-in-public-a-real-time-dashboard-for-smarter-movie-intermissions-4h6n</guid>
      <description>&lt;p&gt;Building MovieSync in Public (with Antigravity) 🎬🚀&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fb4td59m6v75x59vfptbm.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fb4td59m6v75x59vfptbm.png" alt=" " width="800" height="378"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Building in public means sharing not just the outcome, but the tools and decisions behind it. While creating MovieSync, I also leveraged Antigravity to accelerate development and deployment, making the project faster to ship and easier to scale.&lt;/p&gt;

&lt;p&gt;*&lt;em&gt;The Problem&lt;br&gt;
*&lt;/em&gt;&lt;br&gt;
Movie intermissions are short, but queues are long. Whether it’s the washroom or food counter, people waste valuable break time waiting. There’s no visibility into crowd density, and decisions are made blindly.&lt;/p&gt;

&lt;p&gt;*&lt;em&gt;The Idea&lt;br&gt;
*&lt;/em&gt;&lt;br&gt;
MovieSync is a real-time venue dashboard that shows crowd levels across different areas using simple color indicators. Users can instantly decide where to go and avoid congestion.&lt;/p&gt;

&lt;p&gt;Tech Stack&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;1. React + Vite (Frontend)&lt;/li&gt;
&lt;li&gt;2. Vanilla CSS (Glassmorphism UI)&lt;/li&gt;
&lt;li&gt;3. Docker (Multi-stage build)&lt;/li&gt;
&lt;li&gt;4. Nginx (Static hosting)&lt;/li&gt;
&lt;li&gt;5. Google Cloud Run (Serverless deployment)&lt;/li&gt;
&lt;li&gt;6. Antigravity (Rapid development &amp;amp; cloud workflow acceleration)&lt;/li&gt;
&lt;li&gt;7. Frontend Architecture&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;I built the UI with React and Vite to keep it lightweight and fast. Instead of using heavy UI frameworks, I hand-coded the layout with Vanilla CSS. The interface uses glassmorphism effects, smooth transitions, and micro-animations to create a premium experience.&lt;/p&gt;

&lt;p&gt;Real-Time Simulation&lt;/p&gt;

&lt;p&gt;Since real sensors were unavailable, I implemented dynamic simulators that mimic WebSocket-based IoT data. The dashboard updates crowd density in real time using:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Green → Low traffic&lt;br&gt;
Orange → Moderate traffic&lt;br&gt;
Red → High congestion&lt;br&gt;
Docker Multi-Stage Build&lt;br&gt;
The project uses a two-stage Docker setup:&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;Node stage builds optimized assets&lt;br&gt;
Nginx stage serves the static SPA on port 8080&lt;/p&gt;

&lt;p&gt;This keeps the container small and production-ready.&lt;/p&gt;

&lt;p&gt;Cloud Deployment with Google Cloud Run&lt;/p&gt;

&lt;p&gt;The container is deployed serverlessly using Google Cloud Run. It automatically scales based on traffic and integrates with Cloud Build for CI/CD.&lt;/p&gt;

&lt;p&gt;Deployment command:&lt;/p&gt;

&lt;p&gt;gcloud run deploy moviesync --source . --port 8080&lt;br&gt;
Where Antigravity Helped&lt;/p&gt;

&lt;p&gt;Antigravity helped streamline:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Rapid scaffolding of the project structure&lt;/li&gt;
&lt;li&gt;Faster iteration during UI development&lt;/li&gt;
&lt;li&gt;Simplified deployment workflow&lt;/li&gt;
&lt;li&gt;Reduced setup complexity for cloud deployment&lt;/li&gt;
&lt;li&gt;Improved developer productivity&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Using Antigravity alongside Cloud Run made the entire process smoother and quicker.&lt;/p&gt;

&lt;p&gt;Key Features&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Real-time queue dashboard&lt;/li&gt;
&lt;li&gt;Serverless scalable deployment&lt;/li&gt;
&lt;li&gt;Lightweight UI&lt;/li&gt;
&lt;li&gt;Dockerized production build&lt;/li&gt;
&lt;li&gt;Antigravity-powered workflow&lt;/li&gt;
&lt;li&gt;Open-source repository&lt;/li&gt;
&lt;li&gt;What's Next&lt;/li&gt;
&lt;li&gt;Real IoT sensor integration&lt;/li&gt;
&lt;li&gt;WebSocket backend&lt;/li&gt;
&lt;li&gt;Predictive analytics&lt;/li&gt;
&lt;li&gt;Mobile PWA version&lt;/li&gt;
&lt;li&gt;Multi-venue support&lt;/li&gt;
&lt;li&gt;Final Thoughts&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;MovieSync demonstrates how modern tools like React, Docker, Google Cloud Run, and Antigravity can be combined to build scalable real-time applications quickly. Building in public made the journey more transparent and collaborative.&lt;/p&gt;

&lt;p&gt;What are you building right now? 🚀&lt;/p&gt;

</description>
      <category>ai</category>
      <category>antigravity</category>
      <category>programming</category>
      <category>webdev</category>
    </item>
  </channel>
</rss>
