I Built an AI Voice-to-Database Assistant to Save My Friend 2 Hours a Day 🎙️

nickmed — Fri, 02 Oct 2026 16:53:43 +0000

The Problem: My Friend's Nightly Struggle

My friend Carlos is a field supervisor in the construction industry. He spends his entire day walking around sites, inspecting materials, and dealing with contractors. But his real nightmare began at 6:00 PM: he had to sit down for two hours to manually transcribe all his messy WhatsApp voice notes into his company's structured Google Sheets and PowerBI dashboards.

He was exhausted, and his family missed him in the evenings. I knew I had to build something for him.

What I Built

I built a WhatsApp-based AI assistant that completely automates his data entry. Now, Carlos just sends a WhatsApp voice note like: "Today we received 50 bags of cement from supplier X, but 3 were damaged. Total cost \$250."

The system automatically:

Receives the audio via Webhook.
Downloads the .ogg file using the WhatsApp Business API.
Transcribes the audio using Whisper (Open-Source AI).
Extracts the exact entities (Material, Quantity, Status, Cost) using an LLM.
Pushes the clean, structured JSON directly into his Google Sheets.

Demo & Architecture

Here is a look under the hood using Make (formerly Integromat) to orchestrate the workflow:

(If you want to see the exact step-by-step technical guide on how I solved the tricky WhatsApp Media ID download, check out my deep-dive technical post here.)

Why Open Innovation Matters for This Project

Open-source AI is the absolute core of this solution, specifically OpenAI's Whisper model.

For Carlos, open innovation matters for two critical reasons:

Language & Slang: Carlos speaks Spanish with heavy local construction slang. Proprietary, rigid voice-to-text models fail miserably at this. Whisper's open-source architecture allows for incredibly robust multilingual transcription that actually understands him.
Future Data Privacy: Because Whisper is open-source, if Carlos's company ever demands strict data privacy (keeping audio files off third-party servers), we have the freedom to take this exact workflow and run Whisper locally on a private server or even a laptop on the construction site with no internet. Open innovation gives us the flexibility to scale without vendor lock-in.

I handed the bot over to Carlos yesterday. His response? "You just gave me my evenings back." That's the power of building for a friend. 🚀

How to turn WhatsApp Voice Notes into Structured Data (Google Sheets) using Whisper & ChatGPT

nickmed — Thu, 01 Oct 2026 17:45:59 +0000

Hey everyone! 👋

I recently worked on a real-world problem: field workers and operators hate typing long reports on their phones, but sending random voice notes creates a massive mess for the data analysis team.

I designed a no-code/low-code architecture to solve this. The goal? Let users send a simple WhatsApp audio, and automatically transform that unstructured voice into a clean, structured JSON format ready for Google Sheets or PowerBI.

Here is the high-level architecture of the workflow I built:

🛠️ How the workflow actually works:

🟢 WhatsApp Cloud API Webhook: It listens for incoming messages. If it's a text, a Router sends it straight to the LLM. If it's an audio file, it moves to the next step.
⚠️ The Tricky Part (Media ID): WhatsApp webhooks don't send the actual audio file, just a Media ID. You need an HTTP module to download the .ogg file using the WhatsApp Business API.
🎙️ OpenAI Whisper: We pass the downloaded .ogg file to Whisper to get a highly accurate text transcription.
🧠 Chat Completion (JSON Extraction): We send the transcribed text to ChatGPT with a strict system prompt to extract specific entities (like quantities, product names, dates, or client IDs) and output them in a valid JSON format.
📊 Parse JSON & Export: Once parsed, the data is perfectly mapped to columns in Google Sheets or sent to a PowerBI dataset.

🚀 Why this matters?

This completely removes the friction of manual data entry. Operators just talk to WhatsApp, and the database updates in seconds with zero human typos.

💡 If you are building something similar and get stuck on the WhatsApp Media download step or the JSON parsing, let me know in the comments. I'd be happy to discuss the logic!

Have you implemented LLMs for structuring field data? How did you handle it?

🔗 Let's connect on https://www.linkedin.com/in/nickmed/ if you want to talk about process automation!

DEV Community: nickmed