Dr. T
What I Built
What does it do:
Dr. T is an autonomous clinical intelligence, multilingual healthcare companion, and decentralized AI ecosystem. It bridges human-centric patient care, advanced clinical informatics, and machine-to-machine AI economies.
Here is what Dr. T does across its core pillars:
- Multilingual Clinical Triage & Empathetic Companion Real-Time Voice & Language Care: Delivers real-time medical guidance, empathetic mental wellness support, and triage in multiple languages.
Personalized Health Soulmate: Adapts tone, cultural context, and medical communication styles to patients, caregivers, and clinicians.
- Clinical Automation & Diagnostic Intelligence Pharmacogenomics & Precision Medicine: Predicts adverse drug interactions and metabolic dosing (e.g., CYP2D6, CYP2C19) based on patient genotypes.
FHIR Longitudinal Summarizer: Ingests multi-hospital Electronic Health Record (EHR) bundles and compresses complex patient histories into prioritized clinical risk alerts.
SmArtist Spectroscopic Dermoscopy (AR): Performs multi-dimensional computer-vision analysis on skin lesions to estimate malignancy risks and guide clinical next steps.
- Dr. T Cinema (Evidence-to-Screen Production Studio) Medical Script-to-Screen Automation: Translates peer-reviewed medical papers, diagnoses, and discharge plans into cinematic 2D/3D educational videos and patient explainers.
Parallel Search & Multimodal Synthesis: Combines Gemini multimodal reasoning with verified PubMed/clinical citations to generate broadcast-ready health media.
Trib-House Living Library Commons
Ethnobotanical & Biodiversity Preservation: An open, sovereign knowledge repository preserving indigenous botanical medicine and biodiversity wisdom from 16+ countries with cryptographic provenance.x402 Sovereign Micro-Transaction Engine (Algorand MainNet)
Pay-Per-Request AI Services: Protects high-value medical APIs and AI models behind HTTP 402 paywalls, allowing autonomous agents and researchers to query endpoints on-demand without monthly SaaS subscriptions.
Instant L1 Settlement: Settles microtransactions in USDC on Algorand MainNet (2.7s finality, <$0.001 fee) via the GoPlausible facilitator and indexed on the Bazaar Discovery Catalog.
- Zero-Knowledge Privacy & Sovereign Security HIPAA & Local-First Governance: Protects sensitive health data using zero-knowledge proofs and differential privacy, ensuring patients maintain full custody of their biometric and genetic data. The platform keeps expanding till infinity.
Inspiration:
Health issues in 2026 have given experiences of blessings of a real life figure with heart and mind - Dr. T. Her legacy would go towards infinity.
What I have learned along the way:
Dr. T is social based with humans as center, building it from a clinical companion into a decentralized, full-stack intelligence platform yielded several fundamental lessons across healthcare, distributed systems, and the emerging agentic economy:
- Traditional SaaS Fails Autonomous AI Agents The Friction of Subscriptions: Autonomous AI agents cannot fill out billing forms, maintain monthly credit card retainers, or manage API keys across dozens of vendors.
HTTP 402 as the Native Protocol: Reviving the native HTTP 402 status code combined with microtransactions turns any API into a trustless vending machine. An agent pays fractions of a cent (
0.02 USDC), receives the computed output instantly, and moves on without ongoing financial liability.
- Microtransactions Require Layer-1 Determinism Finality Over TPS Hype: In payment-gated computation, latency determines user experience. Algorand’s ~2.7-second deterministic finality and negligible (~0.001 ALGO) network fees proved critical. Any network where settlement takes minutes or fees exceed the cost of the API call itself makes micro-APIs unviable.
Machine Discovery is Key: Having a paywall is useless if agents cannot find it. Implementing self-describing schemas via /.well-known/x402.json and catalogs like GoPlausible Bazaar showed that machine-readable discovery is as vital as search engines were for the web.
- Empathy and Evidence Must Coexist Accuracy Without Empathy Alienates Patients: Raw clinical statistics (e.g., genetic risk scores or cancer probabilities) cause anxiety if presented cold. Empathetic, culturally aware communication in a patient’s native language bridges the gap between diagnosis and comprehension.
Empathy Without Evidence is Dangerous: Conversely, a compassionate bedside manner is meaningless without strict grounding in verified standards (such as CPIC pharmacogenomic rules, FHIR data structures, and PubMed literature).
- Cinematic Visualization Bridges the Health Literacy Gap Text Alone Is Insufficient: Most patients struggle to understand dense lab reports or discharge instructions.
Evidence-to-Screen Impact: Automating the conversion of clinical findings into short, cinematic 2D/3D explainers (Dr. T Cinema) dramatically boosts patient retention and compliance compared to traditional pamphlets or portal text.
Privacy Cannot Be an Afterthought in Health Tech
Local-First & Zero-Knowledge: Sensitive health data—especially genomic markers and biometric scans—should never be centralized unnecessarily. Employing local processing, differential privacy, and zero-knowledge proofs demonstrated that diagnostic utility does not require compromising patient sovereignty.Preserving Traditional Wisdom Ethically
Bridging Ancient Knowledge and Modern Science: Developing the Trib-House Commons revealed that indigenous botanical knowledge is disappearing rapidly. Preserving it through cryptographic provenance ensures cultural attribution, fair benefit-sharing, and ethical study alongside modern pharmacogenomics.
Demo
https://youtu.be/JnH1HZPd9Ds?si=CVz08o2cVmMXCRXi
Technologies Stack
- Frontend & User Interface Framework: React 18 (Functional components, custom hooks, context state)
Language: TypeScript 5.7 (Strict static typing across client & server)
Build & Bundling: Vite 6 with @vitejs/plugin-react
Styling: Tailwind CSS v4 (@tailwindcss/vite) with custom responsive themes and typography
Iconography: Lucide React
Micro-Interactions & FX: canvas-confetti, custom CSS keyframes, and canvas-based spectroscopic visualizers
Typography: Google Fonts (Plus Jakarta Sans, Playfair Display, JetBrains Mono)
- Backend & Runtime Infrastructure Runtime Environment: Node.js (LTS) with native TypeScript execution via tsx
Production Bundler: esbuild compiling into a standalone CJS server (dist/server.cjs)
Web Framework: Express 5 (RESTful endpoints, middleware, static SPA serving)
Deployment Platform: Google Cloud Platform (Cloud Run & Containerized Containers)
- Artificial Intelligence & Multimodal Reasoning AI Core SDK: @google/genai (Google Gemini models)
Multimodal Capabilities:
Evidence-to-screen scriptwriting and visual storyboarding (Dr. T Cinema)
Multilingual natural language translation and empathetic conversational tone
Google Parallel Search & medical literature grounding (PubMed / clinical citations)
Spectroscopic computer vision for lesion classification (SmArtist)
- Blockchain, x402 & Agent Economy Decentralized Network: Algorand MainNet (CAIP-2: algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=)
Settlement Asset: USDC ASA (Asset ID: 31566704) with sub-3s deterministic finality
Payment Protocol: RFC HTTP 402 Payment Required with standard WWW-Authenticate: x402 headers
Facilitator Gateway: GoPlausible Facilitator (https://facilitator.goplausible.xyz)
Autonomous Agent Discovery: Bazaar Discovery Specification published via /.well-known/x402.json and /api/x402/bazaar/discovery
On-Chain Explorers: Lora Algokit & Pera Explorer integration
- Persistence & Cloud Infrastructure Cloud Database: Google Cloud Firestore (NoSQL real-time document storage for user preferences, session logs, and knowledge commons)
Authentication & Security: Firebase Auth & local-first zero-knowledge proof primitives
CORS & Middleware: Express cors and custom security headers
- Clinical & Biomedical Standards Interoperability: HL7 FHIR bundle parser and longitudinal clinical risk engine
Pharmacogenomics: CPIC Guidelines (Clinical Pharmacogenetics Implementation Consortium) for gene-drug metabolism inference (CYP2D6, CYP2C19)
Biodiversity Commons: Cryptographic provenance hashes for ethnobotanical records across 16 countries
- Native Browser APIs Web Speech API: Real-time multi-dialect Speech Recognition and Speech Synthesis
MediaStream & Canvas API: Camera and video capture for dermatological AR diagnostics and live interaction
Web Audio API: Real-time voice and sound processing
Top comments (0)