This is a submission for the MLH x DEV Writing Challenge
What I Built
TrailBird AI is a zero-latency, 100% offline open-source bird call identification system engineered specifically for deep wilderness trails where cellular service drops to zero.
When hiking in dense forests, river canyons, or mountain passes, cloud-based AI APIs fail instantly due to zero network availability. Furthermore, conventional nature apps keep users glued to screen interfaces while scrolling through lists—defeating the core experience of being outdoors.
TrailBird AI flips this paradigm with two core innovations:
Zero-Signal Edge Inference: Operates 100% client-side inside any smartphone browser or terminal CLI using Fast Fourier Transform (FFT) acoustic feature extraction. No cloud requests, no backend servers, zero bandwidth required.
"Touch Grass" Screen Minimizer: Processes audio in <15ms, identifies the species with confidence metrics, provides a physical sighting action tip ("Look 15 feet up in the fork of that birch tree!"), and immediately prompts the hiker to pocket their device and listen to nature.
Whether you are a trail runner, backpacker, birdwatcher, or casual hiker, TrailBird AI lets you identify bird calls on the trail while keeping your eyes on the forest canopy rather than a phone screen.
Demo
Here is TrailBird AI running offline in browser and terminal environments:
================================================================
🌲 TRAILBIRD AI 🌲 — Offline Bird Call Identifier (Touch Grass)
📁 Audio File: audio_samples/american_robin.wav
⏱️ Duration: 3.0s
⚡ Dominant Pitch: 3600 Hz
🔊 RMS Energy: 0.2426
📊 ACOUSTIC SPECTROGRAM PREVIEW (Local Inference):
┌──────────────────────────────────────────┐
7kHz│ │
5kHz│ │
3kHz│ ██████ ██████ ██████ ██████ │
1kHz│ │
0kHz└──────────────────────────────────────────┘
0.0s 1.0s 2.0s 3.0s
🎯 TOP IDENTIFICATION: 🐤 Black-capped Chickadee (Poecile atricapillus)
Confidence: 93.7%
Family: Paridae
Typical Call: "chick-a-dee-dee-dee"
Habitat: Deciduous and mixed forests, trail edges, willow thickets
Status: Least Concern (LC)
💡 Fun Fact: The number of 'dee' notes at the end of their alarm call indicates predator threat level!
🌿 TOUCH GRASS ACTION TIP:
👉 Pause silently under birch or pine trees; chickadees are curious and will hop close to inspect you.
📢 Put your phone in your pocket and look up now!
Key UI Features:
Real-Time Web Audio Spectrogram: Live FFT frequency spectrum visualizer rendered via HTML5 Canvas.
Sub-15ms Local Matching: Instant acoustic feature extraction and similarity ranking.
"Pocket Your Phone" Overlay: One-tap full-screen dark overlay that turns off visual distraction and switches to ambient acoustic monitoring.
Local Sighting Log: Persists trail sightings locally with localStorage so naturalists can review their trail log when back at camp.
Partner Technologies
TrailBird AI leverages open-source & web-native technologies designed for edge audio processing and zero-dependency execution:
Web Audio API & WebAssembly: Microphone audio stream processing and 512-bin Fast Fourier Transform (FFT) extraction executed directly in the browser's JavaScript V8/Wasm runtime.
Open-Weight Acoustic Profile Engine: Evaluates spectral centroids, pitch frequencies, zero-crossing rates, and RMS energy against structured open acoustic profiles (models/species_db.json).
Python Standard Library CLI (trailbird.py): A standalone terminal tool using native Python wave and math modules for offline field data processing without external library installation overhead.
Tailwind CSS & PWA Cache: Lightweight responsive UI with zero runtime framework weight, optimized for mobile outdoors display and offline web app manifests.
Hackathon Experience
Participating in MLH hackathons and building open-source projects is immensely satisfying. The process of taking an idea—like identifying bird calls offline while hiking—and turning it into a working prototype in a high-energy challenge window is what hacking is all about.
Key Learnings:
Designing for No Signal: Building an app under the constraint of zero network connectivity forces cleaner architecture: everything must run locally on device, from asset rendering to inference calculation.
Human-Centric UX ("Touch Grass"): Technology works best when it enhances physical experiences rather than consuming attention. Designing the app to proactively encourage users to put their phones away after giving them the information was a rewarding design exercise.
Open-Source Accessibility: Keeping tools open-weight and open-source means naturalists, students, and outdoor enthusiasts anywhere in the world can modify, expand, and fine-tune species datasets for their own local ecosystems.
Happy hacking! 🌲✨
Top comments (0)