HeirloomAI — Grandpa's Voice Memo Recipe & Storybook Engine 📖🎙️
This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend
What I Built
HeirloomAI is a private, open-source AI application built specifically for a loved grandpa (Grandpa Joe) and a roommate with severe dietary restrictions (Roommate Alex).
The Problem It Solves:
- Preserving Grandpa's Voice & Family Recipes: Older family members often hold decades of culinary wisdom and family stories in spoken word and vintage voice memos. Uploading grandpa's personal recordings to proprietary cloud AI servers risks losing ownership, privacy leaks, and service deprecation.
- Protecting Roommates from Allergens: Roommates with severe allergies (Gluten, Dairy, Nuts) face daily safety concerns when sharing recipes.
- Helping Friends Learn Languages: Friends learning new languages need a low-pressure, patient practice partner to rehearse cooking vocabulary and oral storytelling.
Core Features:
- 🎙️ Spoken Audio & Voice Memo Transcriber: Live mic recording with real-time frequency visualizer canvas + file drag-and-drop for Grandpa's vintage MP3/WAV/M4A voice notes.
- 🧠 Open-Source AI Recipe & Story Structurer: Automatically parses raw transcripts into beautifully formatted recipe cards, extracting secret ingredients, step-by-step instructions, nostalgia backstory quotes, prep times, and serving sizes.
- 🛡️ Roommate Allergy Safety Shield: Auto-scans recipes against custom roommate allergy profiles (Gluten-Free, Dairy-Free, Nut-Free, Vegan) and generates safe AI ingredient substitutions (e.g., replacing wheat flour with oat flour, or butter with extra virgin olive oil).
- 🗣️ Patient Practice Partner (Multilingual Voice Chat): Interactive practice partner with Web Speech API audio synthesis for learning cooking terminology and storytelling in English, Spanish, Italian, French, and German.
- 🖨️ Printable Family Cookbook & JSON Export: Instant physical cookbook layout generator for
window.print()and private JSON data backups.
Demo
https://shagunmohan.github.io/HeirloomAI/
Code
HeirloomAI — Grandpa's Voice Memo Recipe & Storybook Engine 📖🎙️
Build for a Friend Hackathon Edition — Powered by Private, Local Open-Source AI.
HeirloomAI turns your loved one's spoken stories and voice notes into a beautifully formatted family recipe vault and storybook — completely offline, with 100% data privacy and zero cloud server dependency.
🌟 Key Features
- 🎙️ Voice Memo Transcriber & Visualizer: Live microphone audio recording with dynamic frequency canvas visualizer + MP3/WAV file drag-and-drop.
- 🧠 Private Open-Source AI Parser: Extract recipe ingredients, secret family tips, nostalgia stories, prep times, and serving sizes using local open-weight models (Ollama, LM Studio, Qwen 2.5, Llama 3.2) or the built-in 100% offline browser engine.
- 🛡️ Roommate Allergy Safety Shield: Auto-check recipe ingredients against custom roommate dietary restrictions (Gluten, Dairy, Peanuts, Shellfish) with smart safe AI substitution recommendations.
- 🗣️ Multilingual Voice Practice Partner: Practice cooking vocabulary and story listening in English, Spanish, Italian…
https://github.com/ShagunMohan/HeirloomAI
How I Built It
HeirloomAI is engineered around Open-Source AI at its core, featuring a flexible multi-engine architecture:
-
Local Open-Weight Inference Engines:
-
🦙 Ollama Local Integration: Connects to
http://localhost:11434supporting open-weight models like Qwen 2.5, Llama 3.2, Mistral, and TinyLlama. -
🧪 LM Studio API Bridge: OpenAI-compatible REST endpoint on
http://localhost:1234/v1. - ⚡ Browser Local Embedded Engine (Offline Fallback): Zero-server, zero-dependency embedded NLP engine running inside browser memory so the application functions 100% offline out of the box without any mandatory external setup.
-
🦙 Ollama Local Integration: Connects to
-
Audio & Voice Processing:
-
HTML5 Web Audio API:
AudioContextandAnalyserNodefrequency spectrum canvas renderer. - Web Speech API: SpeechRecognition for live voice notes & SpeechSynthesisUtterance for read-aloud hands-free kitchen narration.
-
HTML5 Web Audio API:
Why Does Open Innovation Matter?
Open innovation and open-weight AI models are the exact pillars that make HeirloomAI superior to cloud-based proprietary services:
- 🔒 100% Privacy & Zero Data Leakage: Grandpa's voice memos, personal family memories, and personal health/allergy profiles remain exclusively on the user's laptop. No big-tech corporation gets to train on sensitive family stories.
- ✈️ Off-Grid Offline Independence: The entire app runs without an internet connection. Grandpa can record voice notes at a remote cabin in Vermont or on a long flight.
- 💰 $0 Operational Cost: Zero per-token cloud API bills. You can transcribe and structure thousands of family voice memos for life at $0 recurring cost.
- 🎛️ Model Customization & Swappability: Users can freely swap between Qwen 2.5 (for logic & formatting), Llama 3.2 (for warm storytelling), or specialized fine-tuned weights without being locked into a single closed vendor.
My Agent Session
Built with pair programming assistance from Google DeepMind's Antigravity Agentic IDE.
Prize Categories
- Build for a Friend Hackathon Main Category (Solving real problems for Grandpa Joe & Roommate Alex)
- Open-Source AI & Local Inference Category (Open-weight models, Ollama/LM Studio, zero cloud dependency)
Top comments (0)