DEV Community

Vozzo AI
Vozzo AI

Posted on

How to Build an AI Voice Agent in Under 15 Minutes (No-Code, Step-by-Step)

How to Build an AI Voice Agent in Under 15 Minutes (No-Code, Step-by-Step)

Building a voice AI agent from scratch usually means stitching together a speech-to-text engine, an LLM, a text-to-speech engine, a prompt that survives real conversations, and some way to feed it your own data so it doesn't hallucinate. That's a multi-week project before you've even had a real test call.

I wanted to see how fast that whole pipeline could be replaced with a UI-driven workflow, so I built a working voice agent end-to-end on Vozzo AI Labs — no infrastructure, no glue code, just configuration. Here's the exact process, step by step, plus where to plug in code if you want to go past the dashboard.

This works whether you're building a customer support bot, an enrollment assistant, an order-tracking line, or something else entirely — the pipeline is the same regardless of industry. I'll point out where your choices will differ depending on your specific use case.

What you'll need

A Vozzo AI Labs account (sign up here)

Some reference material for your agent — a website URL, an FAQ doc, or a spreadsheet

~15 minutes

Step 1: Sign in

Go to platform.vozzo.ai and sign in with email/password or Google SSO. You land on the main dashboard — the left sidebar has everything you'll need: Create New, My Agents, Agent Templates, Actions, Telephony, Voices, and further down, API Docs (useful once you're past manual testing and want to trigger calls or pull data programmatically).

Step 2: Start from a template, not a blank page


This is the step that saves the most time, regardless of what you're building. Go to Agent Templates. Vozzo ships with pre-built templates spanning multiple industries — Edtech (Academic Advising, AI Tutoring & Support, Campus Information, Student Enrollment Support), Ecommerce (Order Tracking, Service Professional Tracking), Government (Candidate Screening, Grievance Help Desk), and more, with a search bar and an industry filter to narrow things down.

Each card gives you a one-line summary of the agent's persona and purpose. Whatever your use case, look for the closest match first — even an 80%-fit template is faster to edit than a prompt written from a blank page, because the hardest parts of a voice-agent prompt (pacing, tone, edge-case handling) are already worked out.

If nothing matches, Create New starts you from scratch — the configuration steps below are identical either way.

Step 3: Configure the model stack (Persona tab)

Click Create Agent and you land on the Persona tab, where you set the actual pipeline behind the agent. Two architecture options:

Orbit — speech-to-speech only, a single unified model handling the whole pipeline

Quantum — separate STT → LLM → TTS stages, each independently configurable

Quantum is the better default if you want control over each stage — different providers genuinely perform differently depending on your language, accent, and domain vocabulary. A typical config:

Stage Provider Model Speech-to-Text Sarvam AI Saaras:v3 LLM OpenAI GPT-4.1-mini Text-to-Speech Google Gemini-2.5-flash-preview-tts

Each stage has Advanced Settings and a Fallback Configuration. Set a fallback on at least the LLM stage — voice agents fail loudly (dead air, dropped calls) when a provider hiccups mid-call, and a fallback swaps providers quietly instead.

Step 4: Write the conversation logic (Prompts tab)

This tab decides your agent's personality and reliability more than anything else:

Agent Greetings — the literal first line spoken.

Agent Greets First — whether the agent opens the call or waits.

Agent Prompt — the full system prompt.

A few rules worth adding to any voice-agent prompt, regardless of industry:

Language and tone — specify explicitly (formal vs. casual, single language vs. code-mixed) rather than leaving it to the model's default.

Number handling — voice agents mis-speak numbers constantly. Force digit-wise reading for phone numbers, IDs, order numbers, and codes, or your TTS will read a 6-digit ID as one large number.

Punctuation handling — an easy miss that breaks agents in production: TTS engines will sometimes literally say "hyphen" or "dash" out loud if a prompt or knowledge source contains one. Add a rule to treat punctuation as silent spacing, never verbalized.

Pacing — for anything procedural (steps, instructions, options), tell the model to chunk information rather than dumping a paragraph — a caller can't re-read the way a chat user can.

There's an Edit with AI button next to the prompt box to revise it via plain-English instructions, and Prompt History to roll back a change that made things worse.

Step 5: Give it real knowledge (Wisdom tab)

A strong prompt with no real data will just make things up when asked something specific. The Wisdom tab fixes that:

Website URLs to reference — paste your site/docs URL and hit Add; the agent pulls from it live.

Custom Knowledge — free text for anything not already published on a page.

Upload File — for structured detail (catalogs, pricing sheets, policy documents, FAQs), upload directly rather than pasting as text.

General rule regardless of use case: URLs and free text work well for broad context, but anything tabular or fact-heavy (prices, deadlines, codes) is far more reliable as an uploaded file than as pasted text.

Step 6: Save, test, iterate

Hit Save & Next, then start the agent and talk to it directly. This is the step to spend real time on: ask off-scope questions, say numbers the way a real caller would, interrupt it mid-sentence. Every failure here is a one-line prompt fix now instead of a bad call in production.

What I'd do differently next time

Start from a template no matter what you're building — editing beats writing from scratch almost every time.

Write the punctuation/number-handling rules into the prompt on day one, not after a test call embarrasses the agent.

Upload structured data as a file, not pasted text — the model handles tabular facts more reliably that way.

Set an LLM fallback before calling it "done" — a two-minute setting that prevents dead air during a real call.

Wrapping up

Going from an empty dashboard to a working, testable voice agent took about 15 minutes, and none of that time was spent on infrastructure. Whatever the use case, the pipeline is the same: pick a starting template, configure the model stack, write the prompt with voice-specific rules, feed it real knowledge, and test it like a real caller would. Start from the closest match in Agent Templates, and once you're ready to go beyond manual testing, the API docs cover triggering calls and pulling data programmatically.

Top comments (0)