EchoQuest: Turn the Real World into Your RPG 🗺️🌿 #hf26challenge #devchallenge #openweights #touchgrass

#ai #opensource #devchallenge #webdev

EchoQuest is an outdoor adventure web app that gamifies real-world exploration to get people off their screens and into nature. Players customize their field ranger avatar, activate GPS tracking, and receive procedural quests like the Canopy Crafting Quest. With "Pocket Mode" enabled, users explore completely eyes-up: spatial audio and voice prompts guide them to physical landmarks. When an item is found, integrated camera vision leverages open-weight multimodal models to identify and validate specimens, granting XP and journal stickers—all running efficiently with complete data privacy.

🎵 I love assigning a theme song to my builds, just because it's fun. This one is "The Distance" by Cake, because it's all about going the extra mile outdoors!

Links & Demo
Live Demo: https://eco-quest1-dpor.vercel.app
GitHub Repository: https://github.com/ziyadparkar01/EcoQuest

What I Built
The idea for EchoQuest came from wanting an outdoor experience that doesn't feel like staring at a mobile game map while walking into a tree.

EchoQuest turns any park, hiking trail, or neighborhood walk into an interactive role-playing scavenger hunt.

Avatar Customization & Quest Generation: Players set up their ranger profile and receive context-aware, procedural outdoor missions based on their real-world surroundings.

Pocket Mode (Eyes-Up Exploration): Instead of staring down at a screen, players lock their device into Pocket Mode. Conversational voice prompts and spatial audio from our AI companion, Aura, guide them toward physical waypoints.

Specimen Validation: When players find a target object (like a specific leaf texture or rock formation), the built-in camera uses open-weight vision pipelines to identify and validate the discovery. Successful finds unlock 3D bio-cards and journal stickers.

Why Open Innovation Matters for This Project?
Building an app meant for the deep outdoors meant designing for environments with zero cloud connectivity and strict privacy needs:

True Offline & Edge Capabilities: By leveraging open-weight models and local execution pipelines, EchoQuest processes telemetry and voice cues even when deep on a remote hiking trail with zero cellular signal.

Complete Data Sovereignty: Users' exact GPS routes, favorite hiking spots, and personal nature photos stay private on their own devices—never streamed or stored on centralized commercial servers.

Fine-Tuning & Customization: Running open-source frameworks allowed us to customize Aura's voice companion behavior specifically for ambient outdoor interaction rather than generic assistant tasks.

Zero Cost at Scale: No per-token API bottlenecks or runaway cloud costs while players spend hours exploring.

Architecture & Tech Stack
AI & Vision: Open-weight audio/vision pipelines and multimodal open models for local telemetry and plant/wildlife validation.

Core Framework: Full-stack mobile-responsive architecture with real-time GPS telemetry and spatial audio support.

Agent Harness: Custom open-source agent loop powering Aura and procedural quest logic.

Here is a peek at how the procedural outdoor mission engine structures real-world coordinates:

Python
class EchoQuestEngine:
def init(self, ranger_profile):
self.ranger = ranger_profile
self.active_quest = None

def generate_outdoor_mission(self, user_location, terrain_type="forest"):
    print(f"🌲 Scanning local terrain near {user_location}...")
    self.active_quest = {
        "title": "The Canopy Crafting Quest",
        "objective": "Locate a unique leaf or bark texture and verify via camera.",
        "reward_xp": 150
    }
    return self.active_quest

Field Test & Results
We tested EchoQuest on local wooded park loops and open trails. By toggling Pocket Mode, players kept their eyes on the trees, birds, and paths rather than staring downward. The transition from digital audio clue to physical discovery was seamless, proving that AI can successfully bridge the gap between digital engagement and real-world touch-grass moments!

Tags
devchallenge hf26challenge openweights touchgrass