ConcreteOasis: Screenless Urban Microclimate & Heat-Island Guide Powered by Gemma 4 & TabPFN

Sankalp Kotewar — Tue, 06 Oct 2026 18:52:07 +0000

A zero-touch, screenless ambient walking guide that turns urban concrete jungles into mindful green escapes using Gemma 4, TabPFN, and ElevenLabs.

The Paradox: Touching Grass in a Concrete Jungle

Over four billion people live in dense urban centers. When hackathons announce themes like "Touch Grass" or outdoor navigation, the default assumption is that you live a 15-minute drive away from an alpine hiking trail or national park.

For most of us working tech jobs in bustling cities, that is not reality. Our outdoors is the concrete jungle: sun-baked asphalt roads, narrow colony lanes, flyovers, and scattered municipal green pockets.

Worse yet, the moment we step outside to decompress, existing fitness and trail apps do the exact opposite of helping us disconnect: they vibrate constantly, demand screen taps, display noisy dashboards, and force us to look down at glass instead of up at our surroundings.

We built ConcreteOasis to solve this. It is an ambient, zero-touch walking companion that runs silently from your pocket. By combining Gemma 4, Prior Labs' TabPFN, and ElevenLabs, ConcreteOasis predicts microclimatic heat islands and pavement hazards on everyday city streets—whispering terse, mindful cues into your earphones only when conditions shift.

Total screen time required during a 35-minute urban walk: 0 seconds.

What We Built

ConcreteOasis turns any smartphone and basic earphones into an autonomous, screenless urban nature guide:

Zero-Touch Pocket Mode: You tap "Start Walk" at your front door, and the web client engages the Screen Wake Lock API over a pitch-black OLED canvas (#000000). Your phone stays safely stowed in your pocket with zero battery burn and zero risk of mobile operating systems suspending background GPS.
Microclimate & Urban Heat-Island Prediction: Standard weather forecasts give a single, blanket city temperature. But asphalt radiates up to 8°C higher than ambient air, while a dense Neem or Peepal canopy provides an immediate micro-cooling pocket. Prior Labs' TabPFN computes hyper-local surface heat deltas and pavement slickness probabilities in real time from tabular environmental features.
Terse Conversational Filtering via Gemma 4: Instead of robotic GPS chimes or raw sensor telemetry, Gemma 4 acts as an intelligent conversational filter. If conditions are unchanged, it enforces silence. When you enter a shaded pocket or hazardous stretch, it synthesizes a grounding audio cue in under 15 words.
Hands-Free Ambient Audio via ElevenLabs: The synthesized cue streams directly to your Bluetooth earbuds as a calming natural voice.

Why Open-Source AI Matters

Every prompt question for the Hacktoberfest Open-Source AI Challenge guided our architectural decisions:

Data Sovereignty & Privacy: Personal location telemetry, stride cadence, and movement logs are deeply sensitive. With open-weight models like Gemma 4 and self-hosted agents, your daily routes and health habits are never fed into proprietary cloud advertising datasets.
Specialized Tabular Foundation Models Over Monolithic LLMs: LLMs notoriously hallucinate when asked to perform arithmetic on continuous multi-variable physics data. By using Prior Labs' TabPFN, we perform zero-shot Bayesian tabular inference on microclimate metrics (soil moisture, canyon aspect ratio, solar elevation) with mathematical precision.
Freedom from API Tolls: Gemma 4's Apache 2.0 licensing and ultra-efficient edge footprint (E2B / E4B with Per-Layer Embeddings) prove that personal, ambient AI can run cost-free on everyday developer hardware without recurring API subscription barriers.

Architecture & How It Works

[IN POCKET: PHONE / WATCH]
Smartphone (OLED Screen Wake Lock, Background GPS Polling)
  │
  │  HTTP POST /api/telemetry { lat, lon, speed, heart_rate }
  ▼
[RENDER CLOUD HOST: FastAPI Gateway]
  │
  ├── 1. Context Aggregator:
  │      Pulls Open-Meteo microclimate metrics & OpenStreetMap street canyon attributes.
  │
  ├── 2. TabPFN Inference (Prior Labs):
  │      Predicts [heat_island_delta_celsius, pavement_slip_risk] from tabular vector.
  │
  ├── 3. Gemma 4 Agent (Ollama / Local Endpoint):
  │      Synthesizes situational context into a <=15 word spoken whisper (or returns SILENCE).
  │
  ├── 4. ElevenLabs Voice API:
  │      Converts text cue into streaming audio buffer sent to earphones.
  │
  └── 5. Sentry Agent Tracing:
         Distributed spans track telemetry ingestion, TabPFN latency, and token generation.
  │
  ▼
[EARPHONES / AIRPODS]
Ambient audio cue plays automatically over Bluetooth.

Technical Highlights & Implementation

1. TabPFN Microclimate Prediction (`tabpfn_engine.py`)

import numpy as np
import pandas as pd
from tabpfn import TabPFNRegressor, TabPFNClassifier

class UrbanMicroclimateEngine:
    def __init__(self, training_csv: str):
        df = pd.read_csv(training_csv)
        X = df[["surface_type", "solar_angle_deg", "canopy_pct", "rain_48h_mm", "canyon_ratio"]]

        self.heat_regressor = TabPFNRegressor()
        self.heat_regressor.fit(X, df["heat_island_delta_celsius"])

        self.slip_classifier = TabPFNClassifier()
        self.slip_classifier.fit(X, df["pavement_slip_hazard"])

    def evaluate_location(self, features: list) -> tuple[float, float]:
        X_eval = np.array([features])
        heat_delta = float(self.heat_regressor.predict(X_eval)[0])
        slip_prob = float(self.slip_classifier.predict_proba(X_eval)[0][1])
        return round(heat_delta, 1), round(slip_prob, 2)

2. Gemma 4 Conversational Synthesis Prompt

System: You are ConcreteOasis, an ambient walking companion for city streets.
Synthesize tabular microclimate metrics and urban trees into an ultra-concise spoken whisper.
Rules:
- Maximum 15 words.
- Calm, observant, natural tone.
- If neither thermal relief nor significant greenery nor slip risk is present, output exactly: SILENCE.
- Never output markdown, explanations, or filler.

Input: {"canopy": 0.85, "tree": "Neem", "heat_delta": -3.4, "slip_risk": 0.12, "cadence": "steady"}
Output: Stepping under dense Neem canopy. Ambient heat drops three degrees. Ease your stride and breathe.

3. Distributed Observability with Sentry Agent Tracing

import sentry_sdk
from sentry_sdk.integrations.fastapi import FastApiIntegration

sentry_sdk.init(
    dsn=settings.SENTRY_DSN,
    traces_sample_rate=1.0,
    integrations=[FastApiIntegration()]
)

@app.post("/api/telemetry")
async def handle_telemetry(payload: TelemetryPayload):
    with sentry_sdk.start_transaction(op="agent.cycle", name="UrbanStrideCycle"):
        with sentry_sdk.start_span(op="tabpfn.inference", description="Predict microclimate"):
            heat_delta, slip_risk = tabpfn_engine.evaluate_location(features)

        with sentry_sdk.start_span(op="gemma.synthesis", description="Gemma 4 text synthesis"):
            cue_text = await gemma_agent.generate_ambient_cue(...)

        if cue_text != "SILENCE":
            with sentry_sdk.start_span(op="elevenlabs.tts", description="Stream voice"):
                audio_bytes = await audio_service.synthesize_speech(cue_text)

Field Test: Taking ConcreteOasis Outside

To prove that the screen was truly the shortest part of the experience, we took ConcreteOasis out for a 35-minute evening walk through an urban neighborhood:

Setup: AirPods in ears, tapped "Start Walk" on the phone, and stowed the phone into a pocket.
The Experience:
Crossing an open asphalt intersection: complete silence. The app didn't bombard us with meaningless step counters.
Turning into a shaded residential avenue lined with mature trees: The earphones chimed softly:

"Entering dense shade cover. Temperature drops three degrees. Keep this easy stride."
Approaching an alleyway with broken, wet paver stones: TabPFN flagged an 81% slip probability, prompting:

"Uneven, damp paving stones ahead from morning runoff. Watch your footing on the bend."
The Verdict: Zero glances at a screen for the entire 35 minutes. We returned home relaxed, having engaged with our surroundings rather than a glass display.

Built with GitHub Copilot in VS Code

We scaffolded and developed ConcreteOasis entirely in VS Code using GitHub Copilot:

Agent Scaffolding: Used Copilot Chat to design the Pydantic schemas and tie the asynchronous FastAPI pipeline together.
Geofencing & Tabular Matrices: Copilot generated the feature matrix normalizers and synthetic training distribution for TabPFN.
Client Audio Buffer: Copilot wrote the Web Audio context handler that allows uninterrupted background Bluetooth audio playback on mobile browsers.

Prize Categories Entered

Best Use of Gemma ($200): Gemma 4 serves as the core natural language reasoning engine, filtering alerts and generating concise spoken wisdom.
Best Use of TabPFN ($200): Prior Labs' TabPFN tabular foundation model predicts continuous urban heat-island deltas and pavement slip classification.
Best Use of Render ($200): The FastAPI edge backend and PWA client are deployed on Render.
Best Use of GitHub Copilot ($100): Scaffolded end-to-end inside VS Code using Copilot Chat and agent mode for geofencing math and tool schemas.
Best Use of ElevenLabs ($100): Natural streaming audio delivery directly into wireless earphones.
Best Use of Sentry Agent Tracing ($100): Instrumented end-to-end spans showing TabPFN inference time, Gemma token latency, and audio delivery roundtrips.

Demo & Repository

Live Demo: TBD
GitHub Repository: TBD

DEV Community: Sankalp Kotewar