FloraTrace: Offline Trail Botanist & Plant Identifier for Offline Hikes

Sanjay Choudhary — Mon, 12 Oct 2026 06:24:13 +0000

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass

What I Built

I built FloraTrace to solve a problem my friends and I face every time we go hiking on trails around the Western Ghats: we see incredible wild flora, native trees, and medicinal plants, but we have zero cellular network signal to search for what they are.

FloraTrace is a lightweight, offline-first mobile web app designed to get people exploring outdoors without staring at screens:

Snap & Go: You take a photo of a leaf, bark, or wildflower while on a trail.
On-Device Offline Plant Identification: It runs a lightweight open-weight vision model directly in the browser/locally to identify native flora species, edible plants, and ecological facts—without needing cellular connectivity or Wi-Fi.
Screen-Time Minimizer: Instead of endless scrolling or long textual paragraphs, it delivers a 2-sentence audio summary about the plant and logs your location badge so you can lock your phone and get right back to enjoying nature.

I took it on a 6 km weekend trail hike to a testing spot near Savandurga. I snapped 8 native plant species deep in the forest zone with my phone on Airplane Mode. FloraTrace parsed every sample offline in under 2 seconds and read out the species name via voice, letting me keep moving without eyes glued to a screen.

How I Built It

The core philosophy behind FloraTrace was making the tech entirely self-contained so it works deep in the woods without paid APIs or cloud dependencies.

   +-------------------------------------------------------+
   |             Hiker / User on Outdoor Trail             |
   |                (Captures Plant Snapshot)              |
   +---------------------------+---------------------------+
                               |
                               v
   +-------------------------------------------------------+
   |               FastAPI + Web Application               |
   |                (Hosted on Render / Local)             |
   +-------+-------------------+-------------------+-------+
           |                   |                   |
           v                   v                   v
  +-----------------+  +---------------+  +-------------------+
  | Gemma 2 /       |  | Web Speech /  |  |  SQLite /         |
  | PaliGemma Nano  |  | Edge TTS      |  | Local Trail       |
  | Vision Parser   |  | Audio Engine  |  | Field Database    |
  +-----------------+  +---------------+  +-------------------+

Technical Stack:

Vision Intelligence (PaliGemma / Gemma 2 Vision via Ollama): Analyzes botanical photos to extract species names, native status, and safety notes.
Audio Output Engine (edge-tts / Web Speech API): Converts plant facts into spoken audio clips so hikers can listen while walking without looking at their phones.
Local Storage & Database (SQLite / Browser Cache): Caches offline field guides, regional flora maps, and trail logbooks directly on device.
Hosting & Telemetry (Render & Sentry): Serves the web interface and handles background sync when back in network coverage.

Why Does Open Innovation Matter?

True Offline Independence: Cloud-based proprietary APIs fail the moment you step onto a mountain trail without cell towers. Open-weight vision models allow real AI reasoning on local hardware deep in nature.
Zero Operating Expense: Running open-weight models locally or self-hosting on lightweight servers means zero per-query cost, keeping the app completely free for outdoor communities.
Privacy First in the Wild: Location tags and personal outdoor activity logs stay strictly on your local device rather than being sold or harvested by central ad networks.

Prize Categories

Best Use of Gemma: Uses Gemma 2 / PaliGemma open vision models for offline plant identification and instant field guide summaries.
Best Use of Render: Hosts the web frontend application, service workers, and backend sync pipelines on Render.
Best Use of Sentry Agent Tracing: Tracks local model inference latency and offline tool invocation performance.

FlameDesk: Local-First Telegram Voice & Order Desk for Artisanal Businesses

Sanjay Choudhary — Mon, 05 Oct 2026 09:26:54 +0000

This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend

What I Built

I built Kritika for my friend Ananya, who launched a handcrafted candle studio in Bengaluru ahead of the Diwali festive rush.

As order volume grew across social channels, manual order handling became a bottleneck:

Customers routinely sent 30-to-60-second voice notes on Telegram in mixed English and Hindi requesting custom candle gift sets and local delivery timelines.
Ananya spent upwards of 4 hours each evening listening to audio clips, checking inventory levels, calculating shipping fees, and manually recording customer addresses into spreadsheets.

Kritika is a lightweight, open-source order desk integrated directly into Telegram. It automates customer communication and back-office order logging by:

Ingesting incoming Telegram audio voice notes and text messages.
Transcribing regional speech into clean text.
Extracting structured order metadata (items, quantities, delivery address, preferred dates).
Calculating totals, verifying stock availability, and sending instant confirmation summaries back to the user.

How I Built It

The architecture relies entirely on open-weight models, open-source audio tooling, and free-tier infrastructure. The system is designed to run efficiently inside a single Docker container deployed on Render.

       +-------------------------------------------------------+
       |                  Customer on Telegram                 |
       |             (Sends Voice Message or Text)             |
       +---------------------------+---------------------------+
                                   |
                                   v
       +-------------------------------------------------------+
       |             Python FastAPI Engine (Render)            |
       +-------+-------------------+-------------------+-------+
               |                   |                   |
               v                   v                   v
      +-----------------+  +---------------+  +-------------------+
      | Speech Parser   |  | Open LLM      |  | Catalog & Order   |
      | Faster-Whisper  |  | Gemma 2       |  | Database          |
      | & Edge-TTS      |  | (Ollama/Groq) |  | MongoDB Atlas     |
      +-----------------+  +---------------+  +-------------------+

Technical Implementation Details:

Telegram Webhook Layer (python-telegram-bot): Captures incoming audio files (.ogg) and text payloads, routing them through asynchronous processing queues.
Open Audio Pipeline (Faster-Whisper & Edge-TTS):
- Transcribes incoming customer voice messages locally without relying on paid speech-to-text APIs.
- Synthesizes audio responses when customers request spoken status updates.
Language Intelligence (Google Gemma 2):
- Parses unstructured customer conversations into strict JSON schemas.
- Handles multi-turn inquiries, stock validation, and shipping address verification.
Data Persistence (MongoDB Atlas):
- Maintains product catalog records, stock counts, customer conversation histories, and structured order entries.
Observability & Hosting (Render & Sentry):
- Deployed on Render's web service architecture.
- Monitored via Sentry Agent Tracing to measure end-to-end voice processing latency and function execution stability.

Why Does Open Innovation Matter?

Zero Marginal Operational Cost: Small independent creators operate on thin margins. Using open-weight language models and open speech engines eliminates per-token and per-minute transcription costs, allowing automated order desks to run affordably at scale.
Accurate Context & Local Speech Adaptation: Proprietary global APIs often fail when transcribing regional accents, local neighborhood landmarks, or mixed-language queries. Open models allow tailored system prompts and localized fine-tuning.
Data Control & Independence: All customer information, contact details, and order transactions remain strictly within open-source databases under the owner's direct control, preventing unauthorized data processing by commercial API vendors.

Prize Categories

Best Use of Gemma: Uses Google Gemma 2 as the primary intelligence engine for intent classification, JSON extraction, and conversational responses.
Best Use of Render: Hosts the complete FastAPI engine, Telegram webhook worker, and order pipeline on Render.
Best Use of MongoDB Atlas: Manages inventory catalogs, vector-based product queries, and structured customer order states.
Best Use of Sentry Agent Tracing: Tracks voice transcription latency, tool execution pipelines, and error rates across processing workflows.

DEV Community: Sanjay Choudhary

FloraTrace: Offline Trail Botanist & Plant Identifier for Offline Hikes

What I Built

How I Built It

Technical Stack:

Why Does Open Innovation Matter?

Prize Categories

FlameDesk: Local-First Telegram Voice & Order Desk for Artisanal Businesses

What I Built

How I Built It

Technical Implementation Details:

Why Does Open Innovation Matter?

Prize Categories