DEV Community: Rohith Pavithran

Free Voice Music Curator: Ditch Premium Music Fees with ElevenLabs & Google AI

Rohith Pavithran — Sun, 12 Jul 2026 15:18:44 +0000

This is a submission for Weekend Challenge: Passion Edition

What I Built

I built the Free Voice Music Curator, an intelligent full-stack audio player powered entirely by public APIs, legal Creative Commons music, and zero paid subscription walls.

Inspired by the challenge prompt of passion, I wanted to capture the absolute devotion fans and hobbyists pour into their musical worlds. However, classic web-streaming apps are trapped behind heavy OAuth logic or aggressive paid premium tiers. The Free Voice Music Curator solves this by allowing users to command a local audio player using natural voice strings (via ElevenLabs), which are dynamically parsed by Google AI to pull over 500,000 legal, free-streaming tracks from Jamendo.

🟢 The Free-Tier Architecture

[ ElevenLabs Agent ] ➔ Webhook ➔ [ Backend Server ] ➔ Jamendo REST API
                                        │
                                        ▼
                        [ HTML5 Audio Player Engine ] ➔ (Plays raw .mp3 stream)

Demo

The application is fully configured and ready!

Live Development Webhook: https://ais-dev-vtsuihfhfsyunprfhoszsh-559194232025.asia-east1.run.app/api/webhook/elevenlabs
Production Webhook Simulator: Included directly inside the UI console so you can fire direct preset configurations (e.g., 💤 Lofi Study, 🏎️ Synthwave, 🎸 Acoustic) to watch the system respond in real time.

Code

The interface features a gorgeous deep interstellar slate and emerald canvas (bg-slate-900 / text-emerald-400) alongside modern typography pairings (Space Grotesk and Inter).

Here is the clean Python Core Engine snippet used to process the incoming webhook metadata securely:

import random
import requests
import vlc  # Install via: pip install python-vlc

class FreeVoiceMusicCurator:
    def __init__(self, client_id):
        self.client_id = client_id
        self.base_url = "https://api.jamendo.com/v3.0/tracks/"

    def get_curated_stream_urls(self, target_genre=None, target_artist=None, limit=10):
        print(f"Querying free cloud library for: Genre={target_genre}, Artist={target_artist}...")

        params = {
            "client_id": self.client_id,
            "format": "json",
            "limit": 50,
            "audioformat": "mp32",
            "order": "popularity_total"
        }

        if target_genre:
            params["tags"] = target_genre.lower()
        if target_artist:
            params["artist_name"] = target_artist.lower()

        try:
            response = requests.get(self.base_url, params=params)
            data = response.json()
            tracks = data.get("results", [])

            stream_targets = []
            for track in tracks:
                stream_url = track.get("audio")
                if stream_url:
                    stream_targets.append({
                        "title": track.get("name"),
                        "artist": track.get("artist_name"),
                        "url": stream_url
                    })

            random.shuffle(stream_targets)
            return stream_targets[:limit]
        except Exception as e:
            print(f"API Fetch Error: {e}")
            return []

How I Built It

The execution pipeline flows fluidly across three modern technical frameworks:

Intelligent Conversational Agent (ElevenLabs): I built a blank agent powered by a custom webhook tool named play_free_genre_music. It listens for spoken triggers like "Play some high-energy synthwave beats" and extracts clean textual params (prompt, genre, artist).
Contextual AI Translation Engine (Google AI Studio): The backend leverages the gemini-3.5-flash model to analyze the full natural-language transcripts, scrubbing out specific moods, obscure tags, or strict artist names, complete with a local rule-based keyword fallback parser to guarantee zero downtime.
Responsive Web Player Platform: Built an HTML5 audio context interface complete with a live API resource monitor (tracking Jamendo's 35,000 free monthly request tier cap) and real-time scrolling telemetry log panels recording every single serverless event transcript.

Prize Categories

This application is being submitted to the following prize categories:

Best Use of ElevenLabs: For mapping custom voice conversational tools to a local audio state architecture seamlessly.
Best Use of Google AI: Using Gemini to turn messy, natural speech commands into highly structured metadata payloads.

Terminal Web 2.0: AI Preflight, Healing, and Safety

Rohith Pavithran — Sun, 07 Jun 2026 11:45:57 +0000

This is a submission for the GitHub Finish-Up-A-Thon Challenge

What I Built

Terminal Web (py_terminal) is a powerful terminal-based UI web project utilizing Python and the Rich library for beautiful terminal output combined with advanced command execution capabilities.

As part of the Finish-Up-A-Thon, I transformed this tool by integrating an AI Safety Net—a proactive layer designed to protect users from executing destructive shell commands (e.g., rm -rf, git push --force) while maintaining a fluid and rapid developer experience. The safety net employs:

Tier-1 Heuristics: Instant, offline protection against common dangerous commands.
Tier-2 AI Preflight: LLM-powered risk analysis that summarizes potential consequences and affected resources for MUTATING+ risk levels.
Intelligent Self-Healing: A workflow that diagnoses failed commands (e.g., permission errors, missing paths) and suggests safe alternatives to get you back on track.

Demo

Project Repository: https://github.com/rohithtp/py_terminal

The Comeback Story

Previously, py_terminal was an effective CLI wrapper with dual execution modes (interactive and capture) and beautifully formatted outputs. However, it had one critical flaw: it blindly executed whatever bash command was provided, offering no protection against accidental system damage. In a modern development environment where LLMs are sometimes used to generate complex, unverified commands, ensuring those commands are safe to run locally became a high priority.

To "finish it up" for this hackathon, I drastically leveled up the tool's intelligence and safety by adding:

An AI Preflight Loop: Intercepts risky commands, uses LLMs to generate reversibility notes, and blocks execution until explicit user confirmation is given.
A Self-Healing Workflow: Catches non-zero exit codes, diagnoses the error (e.g., "No such file or directory"), and proposes an LLM-generated fix that gets re-routed through the safety preflight loop.
SQLite Caching: Caches preflight AI evaluations to avoid duplicate API calls and guarantees zero latency for repeated commands.
Offline Graceful Degradation: The UI falls back beautifully to local heuristic warnings when the LLM API is unavailable, ensuring the tool is always usable.
A Status Capture Utility: A built-in telemetry tool to rapidly verify repository and dependency health.

My Experience with GitHub Copilot

GitHub Copilot acted as an exceptionally fast pair programmer throughout this challenge. It was instrumental in scaffolding the pexpect-based automated test suite for validating the AI Safety Net, mocking out LLM network responses, and quickly laying out the boilerplate for the Rich UI panels.

When constructing the SQLite caching mechanism, Copilot seamlessly anticipated the database schema I needed and handled boilerplate queries, allowing me to focus entirely on the core business logic of the safety heuristics and healing loop. It transformed complex refactoring and UI layout tasks into smooth, effortless completions.

Team Members: @rohithtp

mnemo — A local-first learning agent that remembers, without leaking

Rohith Pavithran — Sun, 31 May 2026 09:20:10 +0000

This is a submission for the Hermes Agent Challenge: Build With Hermes Agent

What I Built

mnemo is a learning-management agent for kids and self-directed learners. It tracks topics, sequences them by prerequisites, schedules spaced-repetition reviews (SM-2), generates quizzes, and adapts the plan over time through a Hermes-driven feedback loop.

The problem: hosted AI tutors send a child's mistakes, struggles, and reading level to someone else's servers. Browser-only chat loops forget everything the moment the tab closes — no cross-session adaptation, no long-term plan. And LLMs happily hallucinate URLs and quiz answers, so nothing stops an unreviewed link from reaching a 6th-grader.

mnemo's answer is a three-part stance baked into the schema, not bolted on:

Local-first by default. SQLite (WAL) on-device, 7 tables, 3 migrations. Hermes-3 runs locally via Ollama. A HuggingFace API path exists for constrained hardware but requires explicit opt-in and is clearly labelled in the UI — every hosted call is logged to the events table.
Two gates before any content reaches the learner. Every external resource starts approved = 0 in the schema. A second gate joins a source_allowlist table at the SQL layer — even an approved resource is suppressed if its origin isn't a trusted source (khan-academy, ck12, internal-curriculum). Both gates have dedicated scenario tests.
The agent proposes; a human approves. Pace changes, resource-type shifts, and any preference write goes through a confirmation gate. The agent literally cannot mutate learner preferences without a human checkbox — enforced via an MCP deny-list, not just UI.

Demo

Pitch deck (single-file Reveal.js, no build step):
pitch.html — 6 slides covering the problem, the Hermes differentiator, architecture, the two-gate safety model, and a realistic dashboard mockup of the shipped UI.

Quick local run:

python3 -m venv .venv && source .venv/bin/activate
pip install -r requirements.txt
sqlite3 learning.db < migrations/001_init.sql
sqlite3 learning.db < migrations/002_quiz_bank.sql
sqlite3 learning.db < migrations/003_source_allowlist.sql
python -m uvicorn webapp.app:app --reload --port 8000

Open http://localhost:8000 for the dashboard, or run a Hermes session end-to-end:

ollama pull hermes3
curl -X POST http://localhost:8000/api/agent/session \
  -H "Content-Type: application/json" \
  -d '{"learner_id": 1, "backend": "ollama"}'

The dashboard streams each tool call the agent makes, then refreshes progress and the review queue automatically.

Code

Repository: gitea.com/rohithtp/mnemo

Key directories:

webapp/ — FastAPI REST + SSE + static dashboard (25+ endpoints)
mcp_server/ — stdio MCP server exposing 7 tools to Hermes
src/agent/ — Hermes session orchestrator, allowlist, memory, insights
src/learning/ — SM-2 algorithm, sequencing logic, safety/privacy gates
migrations/ — 3 SQL files, schema-version tracked
tests/ — 69 passing tests (SM-2 unit + integration + API + scenario)
docs/ — full build plan, decisions log, 25-risk register, two-profile docs

My Tech Stack

Layer	Choice
Database	SQLite (WAL mode) on-device · libSQL/Turso documented as forward path
Backend	FastAPI + uvicorn + SSE streaming
Agent runtime	Hermes-3 via Ollama (local) · HuggingFace Inference API fallback
Tool surface	stdio MCP (Hermes) + WebMCP progressive enhancement (Chrome 146+)
Frontend	Vanilla JS + plain CSS — no framework, no build step
Spaced repetition	SM-2 algorithm, implemented as pure functions
Tests	pytest — 15 SM-2 unit + 18 integration + 31 API + 5 scenario = 69 passing
Deployment	Dockerfile + systemd unit
Language	Python 3.11+ (3.14 tested)

All Python deps are pinned in requirements.txt. The Hermes-3 model digest is pinned by SHA256 and asserted at startup so a silent upstream change can't drift the agent's behaviour mid-session (R02 mitigation).

How I Used Hermes Agent

Hermes-3 is the orchestration brain for the whole adaptive loop. The reason it had to be Hermes specifically, not a stateless prompt loop, comes down to four capabilities:

1. Tool-calling over a real schema. src/agent/session.py runs a tool-calling loop where Hermes drives a study session by calling the 7 MCP tools (get_progress_summary, get_ready_topics, start_topic, get_next_review_items, record_review_result, recommend_resources, generate_quiz). Each call is logged to the events table with arguments and result. The agent isn't generating advice in prose — it's writing to SQLite through audited tools.

2. Cross-session memory. Every session writes a memory_note event summarising patterns the agent noticed. The next session's system prompt is injected with the most recent notes for that learner, so Hermes "remembers" that this kid struggles with unlike denominators across sessions, not just within one tab. Memory notes are per-learner and stay on-device.

3. Pattern analysis + human-approvable proposals. Phase 6 added POST /api/agent/insights/{learner_id}. Hermes reads the event trail across a configurable window, computes avg_quality, days_active, resource-type variety, and emits structured proposals like {"type": "pace", "direction": "increase", "reason": "avg quality above 4.0"}. Each proposal is stored with resolved_at = NULL and surfaces in the dashboard with Approve / Dismiss buttons. The agent never silently applies pace changes — a human resolves each proposal.

4. Allowlist-enforced tool boundary. src/agent/allowlist.py defines AGENT_ALLOWLIST and AGENT_DENY_LIST as constants. set_learner_preferences is on the deny-list, so even if the model is jailbroken into trying to mutate preferences directly, the session orchestrator raises PermissionError before the tool runs. This is the difference between "the UI hides it" and "the agent cannot do it."

The combination — local model + persistent memory + audited tool calls + human-in-the-loop on every state-mutating proposal — is what makes mnemo trustable as a coach for a child, not just for an adult tinkerer. That posture is what the Hermes agent makes practical; a hosted stateless chatbot can't enforce any of it.

StudyTrak // Astra Core – Gemma 4 Challenge Submission

Rohith Pavithran — Sat, 23 May 2026 17:42:27 +0000

StudyTrak // Astra Core – Gemma 4 Challenge Submission

This is a submission for the Gemma 4 Challenge: Build with Gemma 4

What I Built

StudyTrak (Astra Core) is an immersive, high-fidelity student spaced repetition planner and neural coaching console. Designed to work completely local-first or proxy securely via remote endpoints, StudyTrak solves the "academic attention fragmentation" problem. It merges class schedules, homework tracker boards, spaced-repetition card decks (SM-2 scheduler), and deep neural academic helpers into a single HUD-inspired dashboard.

Core Features

🗓️ Astra Chrono Scheduler: Interactive class blocks and room assignments synced with responsive real-time layout structures.
🎯 Spaced Repetition Flashcards: Localized FSRS/SM-2 simulator (with grades: Forgot, Hard Link, Good Match, Perfect Spot) scheduling item intervals adaptively.
🎙️ Multi-Modal Capture Panel: Scan worksheets (Camera/Photo uploads) or type natural language inputs to automatically parse schedule drafts and pending homework proposals.
💬 Subject Advisory Chat Tutor: Academic conversational helper grounded directly in defined high-school/college subjects.
🧘‍♀️ Empathetic Reflection Journal: Conversational weekly debriefs tracking achievements, struggles, and proposed behavioral corrections.
🔊 Voice Speech Synthesis: Listen to high-fidelity audio versions of daily briefings with an interactive audio player.

App In Google AI

AiStudio: https://ai.studio/apps/97a83485-4fc2-43ae-8eb7-b82d63cdb1e9

Code

The complete, pristine full-stack source code is published on Gitea at https://gitea.com/rohithtp/studytrak. You can clone, audit, or deploy the application directly from this repository.

How I Used Gemma 4

StudyTrak leverages the lightweight yet highly competent capabilities of the Gemma 4 model lineup to deliver a privacy-preserving co-pilot:

Model Choices and Fit:
- Gemma 4 Tiny (E2B - 1.5GB): Configured as the optimal on-device WebLLM/MediaPipe companion. We chose the E2B formulation because it easily fits within the standard modern browser sandbox, enabling sub-150ms real-time token generation for micro-scans and speech transcription parsing without any outbound network latency.
- Gemma 4 Standard (E4B - 3GB): Selected for core desktop semantic analysis, empathetic reflection summaries, and structuring homework proposals from handwritten worksheet snapshots. It balances rapid execution speeds with reasoning traits needed to provide high-quality structural mentorship.
Context Grounding:
Every prompt generated goes through a deep localized context packaging layer, supplying active subject indices, schedule constraints, and historic reflection streaks to completely ground prompt results with zero external leak risk.