<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Autor Technologies Inc.</title>
    <description>The latest articles on DEV Community by Autor Technologies Inc. (@autor_tech).</description>
    <link>https://dev.to/autor_tech</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3842303%2Fbf0b0e32-20ca-43ae-b5aa-7032797fc21e.png</url>
      <title>DEV Community: Autor Technologies Inc.</title>
      <link>https://dev.to/autor_tech</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/autor_tech"/>
    <language>en</language>
    <item>
      <title>The AI receptionist market is solving the wrong problem</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Tue, 08 Sep 2026 03:13:58 +0000</pubDate>
      <link>https://dev.to/autor_tech/the-ai-receptionist-market-is-solving-the-wrong-problem-3f4a</link>
      <guid>https://dev.to/autor_tech/the-ai-receptionist-market-is-solving-the-wrong-problem-3f4a</guid>
      <description>&lt;p&gt;Every AI voice startup in healthcare is demoing the same thing: "Listen to how natural it sounds!" Meanwhile, the clinic office manager who actually has to use the product is asking a completely different question — and nobody's answering it.&lt;/p&gt;

&lt;p&gt;We've been running Loquent, our production voice AI platform, across dental and healthcare clinics for over a year now. Thousands of automated calls every month, 24/7, handling everything from appointment scheduling to insurance verification. And the single biggest lesson we've learned has nothing to do with how the AI sounds.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Demo That Wins Deals vs. The Product That Keeps Them
&lt;/h2&gt;

&lt;p&gt;Here's a pattern we see constantly in the healthcare AI voice space: a startup builds an impressive demo. The AI sounds warm, conversational, almost indistinguishable from a real person. The founder posts a clip on LinkedIn, it goes viral, inbound explodes.&lt;/p&gt;

&lt;p&gt;Then the product lands in an actual dental practice.&lt;/p&gt;

&lt;p&gt;Within the first week, the office manager discovers that the AI can't check whether a patient's insurance is active in their practice management system. It can book an appointment, sure — but it creates a separate record that someone has to manually reconcile with Curve Dental or Dentrix or Open Dental at the end of the day. The AI sounds great on the phone, but it's creating more work, not less.&lt;/p&gt;

&lt;p&gt;We know this because we built the wrong version of Loquent first. Our initial prototype had impressive voice quality. We spent weeks fine-tuning prosody, adding natural pauses, getting the pacing right. Our first pilot clinic was genuinely impressed — for about three days. Then the office manager called and said, "This thing is booking patients into slots that are already taken in our system."&lt;/p&gt;

&lt;p&gt;That was the moment we realized we were solving the wrong problem.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Clinics Actually Buy
&lt;/h2&gt;

&lt;p&gt;After running Loquent across multiple practices and analyzing the patterns in thousands of calls, here's what we've found: clinics don't buy voice quality. They buy workflow integration.&lt;/p&gt;

&lt;p&gt;The actual purchase decision comes down to three questions, and none of them are about how human the AI sounds:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;"Does it talk to my PMS?"&lt;/strong&gt; Every dental practice runs on a practice management system — Curve Dental, Dentrix, Open Dental, Eaglesoft, and a dozen others. If the AI can't read real-time availability from that system and write bookings back into it, the product is a toy. Not a "good start." Not an "MVP." A toy. Because someone still has to sit there and manually enter every appointment the AI books.&lt;/p&gt;

&lt;p&gt;We spent more engineering time building PMS integrations than we spent on any other part of Loquent. Curve Dental alone took us three weeks of back-and-forth on API access, data mapping, and edge cases like provider schedules that change mid-week. It's unglamorous work. Nobody posts a video of "look at our Dentrix integration" on LinkedIn. But it's the thing that makes the product actually usable.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;"Does it handle our compliance requirements?"&lt;/strong&gt; In Canada, healthcare data falls under PHIPA — the Personal Health Information Protection Act. This isn't just "use encryption and you're fine." It governs where data is stored, who can access it, how consent is obtained, and what happens when a patient asks for their records. Most AI voice startups we see are building with US infrastructure, US-hosted models, and US-centric compliance (HIPAA). Then they try to sell into Canadian clinics and discover that PHIPA has requirements HIPAA doesn't — like the requirement that personal health information stays within Canada unless the patient explicitly consents to cross-border transfer.&lt;/p&gt;

&lt;p&gt;We built Loquent from day one for PHIPA compliance. Canadian-hosted infrastructure. Canadian data residency. Consent workflows built into the call flow, not bolted on after. This wasn't a feature. It was a prerequisite. And it's the single most common gap we see when Canadian clinics evaluate competitors.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;"What happens when it can't handle a call?"&lt;/strong&gt; This is the question that separates production voice AI from demos. Every AI receptionist will encounter calls it can't handle — a patient who's upset, a complex insurance question, a medical emergency. What matters is how gracefully it fails.&lt;/p&gt;

&lt;p&gt;In our data, about 15-20% of calls need human escalation. That number hasn't budged much regardless of how sophisticated the AI gets. The important thing isn't reducing that number to zero — it's making sure those transfers happen seamlessly. The patient shouldn't have to repeat themselves. The human who picks up should have full context. The handoff should feel like one continuous conversation, not a cold transfer to a confused receptionist.&lt;/p&gt;

&lt;p&gt;We built Loquent's escalation system before we built its conversational AI. That's not a typo. We designed the failure mode first, then built the happy path around it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why "Human-Sounding" Is a Distraction
&lt;/h2&gt;

&lt;p&gt;I'm not saying voice quality doesn't matter at all. Obviously, a robotic monotone isn't going to work. But there's a threshold of "good enough" that modern TTS models crossed about two years ago. ElevenLabs, Deepgram, Play.ht — they all produce perfectly adequate voice quality for a professional phone interaction. Spending engineering cycles on making the voice 5% more natural is optimizing the wrong variable.&lt;/p&gt;

&lt;p&gt;Here's what we've actually observed: patients don't care whether the AI sounds human. They care whether it solves their problem. A patient calling to reschedule an appointment at 9pm on a Sunday doesn't need the AI to crack a joke or use conversational fillers. They need it to find an open slot that works, confirm it, and send a reminder. If it does that in a slightly robotic voice, they're fine. If it sounds perfectly human but can't actually see the dentist's schedule, they're furious.&lt;/p&gt;

&lt;p&gt;The startup landscape right now is full of companies raising millions on voice demos. Their pitch decks are full of "indistinguishable from human" claims and TTS benchmarks. Their integration page says "coming soon" next to every PMS system. They have beautiful landing pages and zero production deployments handling real patient data under real compliance requirements.&lt;/p&gt;

&lt;p&gt;Meanwhile, the companies that will actually survive in this space are the ones doing the boring work: building PMS connectors, navigating provincial privacy regulations, designing escalation workflows, and handling the thousand edge cases that only show up in production.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Market Is About to Correct
&lt;/h2&gt;

&lt;p&gt;There are now dozens of AI receptionist startups targeting dental and healthcare in Canada alone. New ones pop up every month. Most of them will be gone within 18 months, and it won't be because their AI wasn't good enough. It'll be because they couldn't answer the three questions above.&lt;/p&gt;

&lt;p&gt;The clinics that adopted early are already starting to churn from the "sounds great, integrates with nothing" products. They're moving to solutions that actually connect to their existing systems and handle their actual compliance requirements. This is the correction that's coming, and it's going to be brutal for startups that spent their runway on voice quality instead of plumbing.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Takeaways
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Integration beats voice quality every time.&lt;/strong&gt; The single highest-value engineering investment is PMS integration. If your AI can't read and write to the clinic's existing system, you don't have a product — you have a demo.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Compliance is a prerequisite, not a feature.&lt;/strong&gt; In Canada, PHIPA compliance means Canadian data residency, explicit consent workflows, and provincial-level privacy controls. "We're HIPAA compliant" doesn't cut it north of the border.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Design the failure mode first.&lt;/strong&gt; 15-20% of calls will need human escalation regardless of AI quality. Build seamless handoffs before you optimize the happy path.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;"Good enough" voice quality already exists.&lt;/strong&gt; Modern TTS crossed the usability threshold years ago. Stop optimizing the 95th percentile of naturalness and start optimizing the 0th percentile of integration coverage.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;The market correction is coming.&lt;/strong&gt; The startups that survive will be the ones that did the boring work — PMS connectors, compliance infrastructure, escalation design. The ones with the best demos will be the ones that shut down.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;




&lt;p&gt;If you're building something similar — or evaluating AI voice solutions for your practice — we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit autor.ca.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>product</category>
      <category>startup</category>
    </item>
    <item>
      <title>I Built 50+ AI Products in 4 Years — Here's What I Wish I Knew at the Start</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Tue, 01 Sep 2026 03:30:16 +0000</pubDate>
      <link>https://dev.to/autor_tech/i-built-50-ai-products-in-4-years-ai-webdev-mahinelearning-typescriptheres-what-i-wish-i-1pio</link>
      <guid>https://dev.to/autor_tech/i-built-50-ai-products-in-4-years-ai-webdev-mahinelearning-typescriptheres-what-i-wish-i-1pio</guid>
      <description>&lt;p&gt;Since 2021, our team at Autor has shipped over 50 AI products across healthcare, fintech, logistics, and SaaS. Some of them are running in production right now, handling thousands of automated calls per month. Others failed spectacularly — and those are the ones that taught us the most.&lt;/p&gt;

&lt;h2&gt;
  
  
  Where This Comes From
&lt;/h2&gt;

&lt;p&gt;I started Autor in Toronto as a one-person AI development shop. The original thesis was simple: companies needed custom AI but couldn't hire fast enough to build it themselves. Four years and 50+ products later, we're a senior-only studio with a production voice AI platform (Loquent) serving healthcare and dental clients 24/7. Along the way, we've impacted over 5 million users, helped clients raise more than $10 million in funding, and shipped across 10+ countries.&lt;/p&gt;

&lt;p&gt;This isn't a highlight reel. This is the unvarnished list of things I got wrong, figured out the hard way, or wish someone had told me before I wrote my first line of production AI code.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Your First AI Product Should Be Boring
&lt;/h2&gt;

&lt;p&gt;Our first few products were ambitious. Multi-modal pipelines, complex reasoning chains, novel architectures. Most of them took twice as long as estimated and required constant babysitting in production.&lt;/p&gt;

&lt;p&gt;The products that actually made money and kept clients happy? A straightforward document classifier. A simple intent router. A basic FAQ bot with good fallback logic.&lt;/p&gt;

&lt;p&gt;I used to think "boring" meant "not innovative." Now I know boring means "reliable enough that I don't get paged at 3am." Our most successful product, Loquent, handles healthcare scheduling calls. It's not doing anything architecturally exotic. It picks up the phone, understands what the caller needs, books or reschedules an appointment, and hangs up. The magic isn't in the model — it's in the 200+ edge cases we've handled around it.&lt;/p&gt;

&lt;p&gt;If you're building your first AI product, pick the most boring version of your idea and ship that. You can add complexity later. You cannot add reliability later.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Prompt Engineering Is Real Engineering
&lt;/h2&gt;

&lt;p&gt;Early on, I treated prompts like configuration — something you'd tweak until it worked, then move on. That was a $40,000 mistake across three client projects.&lt;/p&gt;

&lt;p&gt;Prompts in production need version control, testing, rollback plans, and monitoring. We learned this when a Claude model update changed how our voice AI interpreted scheduling instructions. Calls that used to resolve correctly started booking appointments on wrong days. The model hadn't broken — our prompts were too tightly coupled to specific model behaviors instead of being robust against model variations.&lt;/p&gt;

&lt;p&gt;Today, every prompt at Autor goes through the same review process as application code. We maintain prompt test suites with 50+ test cases per critical path. When we onboard a new healthcare client, we run their specific terminology through our prompt regression suite before going live.&lt;/p&gt;

&lt;p&gt;The companies that treat prompt engineering as "just writing" are the ones calling us at midnight asking why their AI started hallucinating appointment times.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. The Model Is 20% of Your Production System
&lt;/h2&gt;

&lt;p&gt;This is the hardest lesson for technical founders to internalize. When I started, I spent 80% of my time on model selection, fine-tuning, and evaluation. That ratio was exactly backwards.&lt;/p&gt;

&lt;p&gt;In a production AI system, the model is a component. The other 80% is:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Monitoring and observability&lt;/strong&gt; — knowing when something goes wrong before your users tell you. We log every Loquent call: latency per turn, confidence scores, fallback triggers, transfer reasons. That's how we discovered that 18% of calls were being transferred to humans and could systematically fix the common failure patterns.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Integration plumbing&lt;/strong&gt; — connecting to Twilio for telephony, to clinic management systems for real-time appointment data, to HubSpot and Salesforce for CRM updates. Each integration has its own failure modes, retry logic, and authentication quirks.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Edge case handling&lt;/strong&gt; — what happens when the caller speaks a language the system wasn't configured for? When the clinic's API is down? When someone calls to report a medical emergency? These aren't model problems. They're systems engineering problems.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Deployment infrastructure&lt;/strong&gt; — zero-downtime deployments, canary releases, A/B testing different prompt versions. We use Docker on AWS, and the CI/CD pipeline for Loquent is more complex than the AI logic itself.&lt;/p&gt;

&lt;p&gt;If you're spending more than 20% of your time on the model, you're probably not ready for production.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Ship Weekly or You'll Ship Never
&lt;/h2&gt;

&lt;p&gt;At product number 15 or so, I noticed a pattern. Projects with two-week sprint cycles shipped. Projects with "we'll ship when it's ready" timelines didn't.&lt;/p&gt;

&lt;p&gt;The reason is subtle. AI systems have a special failure mode where you can always make them "a little better." Run one more evaluation. Try one more prompt variant. Fine-tune on one more dataset. Each improvement is real but marginal, and the compound effect is that you never ship.&lt;/p&gt;

&lt;p&gt;We now enforce a hard rule at Autor: something goes to a real user every week. Not a demo. Not a staging environment. A real user, using it for a real task. Loquent was built in 8 weeks, and it was talking to real callers by week 3. Those early calls were rough — the AI mispronounced the clinic name, got confused by call-waiting beeps, and once tried to book an appointment at 2am. But each of those failures generated specific, actionable fixes that no amount of internal testing would have caught.&lt;/p&gt;

&lt;p&gt;The team that ships a mediocre v1 in week 3 will have a solid v4 by week 12. The team perfecting their v1 will still be in staging.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Charge What Production AI Actually Costs
&lt;/h2&gt;

&lt;p&gt;Our first three clients got significant discounts because I was terrified of sticker shock. The result: we couldn't afford to invest in proper monitoring, the systems degraded, and two of those three clients churned anyway.&lt;/p&gt;

&lt;p&gt;Production AI isn't a commodity. The model API costs are the smallest line item. The real costs are: senior engineers maintaining the system (we're a senior-only team for a reason), infrastructure running 24/7, ongoing prompt optimization as models update, and being available when something breaks at 3am on a Saturday.&lt;/p&gt;

&lt;p&gt;We charge $150/hour and we're transparent about why. A junior team charging $60/hour will cost you more in the long run because they'll build something that works in the demo and breaks in production. We know because we've been hired to replace those systems more than once.&lt;/p&gt;

&lt;p&gt;The clients who balk at $150/hour aren't our clients. The ones who've had a production AI fail on them understand exactly why it costs what it does.&lt;/p&gt;

&lt;h2&gt;
  
  
  6. Pick Your Stack and Commit
&lt;/h2&gt;

&lt;p&gt;Over 50 products, we've tried almost everything. LangChain, LlamaIndex, raw API calls, various vector databases, different embedding models, multiple TTS and STT providers. Here's what we actually use in production today:&lt;/p&gt;

&lt;p&gt;OpenAI and Anthropic Claude for language models — we run both because each has strengths for different use cases. Deepgram for speech-to-text because their latency is unmatched for real-time voice. ElevenLabs for text-to-speech. Twilio for telephony. Pinecone for vector search when we need it (which is less often than you'd think — RAG is genuinely overkill for most voice AI). PostgreSQL with Prisma, not some exotic vector-native database. Next.js and NestJS for the application layers. AWS and Docker for infrastructure.&lt;/p&gt;

&lt;p&gt;We stopped experimenting with our production stack around product number 30. Every new tool has a learning curve, integration cost, and risk of undiscovered failure modes. The marginal improvement from switching to the latest vector database isn't worth the three weeks of integration work and six months of discovering its production quirks.&lt;/p&gt;

&lt;p&gt;Pick tools that are boring, well-documented, and have active communities. Your future self will thank you.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Takeaways
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Start boring, add complexity later.&lt;/strong&gt; The most successful AI products solve mundane problems reliably. Pick the simplest version of your idea and ship it.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Treat prompts as production code.&lt;/strong&gt; Version control, test suites, regression testing, and monitoring. Prompts are not configuration — they're the core logic of your system.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Spend 80% of your time on everything except the model.&lt;/strong&gt; Monitoring, integrations, edge cases, and deployment infrastructure are where production AI lives or dies.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Enforce weekly shipping to real users.&lt;/strong&gt; AI projects have a unique "just a little better" trap. The antidote is putting imperfect work in front of real users every week.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Charge what production AI costs, and be transparent about it.&lt;/strong&gt; Underpricing leads to underinvestment, degradation, and churn. The clients who understand this are the ones worth keeping.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit autor.ca.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>We Tested 4 Text-to-Speech Engines on 12,000 Live Healthcare Calls — Here's Which One Patients Actually Trust</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Tue, 18 Aug 2026 03:14:32 +0000</pubDate>
      <link>https://dev.to/autor_tech/we-tested-4-text-to-speech-engines-on-12000-live-healthcare-calls-heres-which-one-patients-5b88</link>
      <guid>https://dev.to/autor_tech/we-tested-4-text-to-speech-engines-on-12000-live-healthcare-calls-heres-which-one-patients-5b88</guid>
      <description>&lt;p&gt;Last quarter, we ran our production voice AI receptionist — Loquent — across four different TTS engines simultaneously, split-testing real patient calls at dental and healthcare clinics. The results surprised us: the most "natural sounding" engine in demos performed the worst with actual patients.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why We Ran This Test
&lt;/h2&gt;

&lt;p&gt;At Autor, we've been running Loquent in production for over a year now. It handles thousands of automated calls per month for healthcare and dental clinics across Canada — booking appointments, answering insurance questions, handling after-hours triage. The voice is the product. If patients don't trust the voice, they hang up, and the clinic loses a booking.&lt;/p&gt;

&lt;p&gt;When we first built Loquent, we picked our TTS engine the way most teams do: we generated a few sample clips, played them for ourselves, and went with the one that sounded best in a quiet office. That worked fine until we started digging into our call analytics and noticed something weird. Our completion rate — the percentage of calls where patients actually finished the full interaction instead of hanging up or asking for a human — was hovering around 74%. Good, but not great. We suspected the voice itself was part of the problem.&lt;/p&gt;

&lt;p&gt;So we designed a proper A/B test. Not a demo comparison. A production comparison on live calls.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Setup
&lt;/h2&gt;

&lt;p&gt;We tested four TTS engines across 12,247 calls over 8 weeks. Each engine handled roughly equal volume, randomly assigned at call start. All other variables stayed constant: same prompts, same Anthropic Claude backbone for conversation, same Twilio infrastructure, same clinics.&lt;/p&gt;

&lt;p&gt;The four engines:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Engine A&lt;/strong&gt;: ElevenLabs (Turbo v2.5) — our existing production engine&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Engine B&lt;/strong&gt;: OpenAI TTS (tts-1-hd) — the model most teams default to&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Engine C&lt;/strong&gt;: Deepgram Aura — optimized for real-time, low-latency use cases&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Engine D&lt;/strong&gt;: A newer entrant we'd been evaluating (under NDA, so I can't name it)&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;We measured five things:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Completion rate&lt;/strong&gt; — did the patient finish the full call flow?&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Time-to-first-hang-up&lt;/strong&gt; — how far into the call patients dropped if they did hang up&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Human transfer requests&lt;/strong&gt; — how often patients explicitly asked for a real person&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Repeat-caller behavior&lt;/strong&gt; — did patients who called back engage or immediately ask for a human?&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Post-call survey scores&lt;/strong&gt; — a subset of clinics ran a 1-question SMS survey: "How was your experience? Reply 1-5"&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;We did not measure "naturalness" or "voice quality" in isolation. We measured whether patients trusted the voice enough to complete their task.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Results
&lt;/h2&gt;

&lt;p&gt;Here's what we found, and it's not what the marketing pages of any of these vendors would predict.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Completion rates:&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Engine C (Deepgram Aura): 81.2%&lt;/li&gt;
&lt;li&gt;Engine A (ElevenLabs): 78.4%&lt;/li&gt;
&lt;li&gt;Engine D (unnamed): 76.1%&lt;/li&gt;
&lt;li&gt;Engine B (OpenAI TTS): 71.8%&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Deepgram won on completion rate by a meaningful margin. But the interesting part is &lt;em&gt;why&lt;/em&gt;.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Latency was the dominant factor, not voice quality.&lt;/strong&gt; When we dug into the data, the correlation between response latency and hang-up rate was stronger than any voice quality metric. Engine C had a median time-to-first-byte of 180ms. Engine A was at 320ms. Engine B sat around 480ms. Engine D was 410ms.&lt;/p&gt;

&lt;p&gt;In a voice call, latency feels like hesitation. And when you're a patient calling a clinic, hesitation from an AI voice triggers the uncanny valley harder than a slightly robotic tone ever will. Patients interpreted fast responses as confidence and slow responses as something being wrong.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The "best sounding" engine had the worst outcomes.&lt;/strong&gt; OpenAI's tts-1-hd produces objectively beautiful speech. In blind audio comparisons, our team ranked it first every time. But in production, it had the lowest completion rate. The higher latency meant longer pauses in conversation, and patients read those pauses as the system struggling to understand them. Several patients in the survey comments said things like "it seemed confused" — when the AI wasn't confused at all, it was just waiting for audio to generate.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Human transfer requests told a different story:&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Engine A (ElevenLabs): 14.2%&lt;/li&gt;
&lt;li&gt;Engine B (OpenAI TTS): 19.7%&lt;/li&gt;
&lt;li&gt;Engine C (Deepgram Aura): 12.8%&lt;/li&gt;
&lt;li&gt;Engine D (unnamed): 16.3%&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Engine C again. But the gap between A and C was smaller here. Patients who stayed on the call long enough to interact mostly stuck with it regardless of engine. The damage was being done in the first 3-5 seconds.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The first response is everything.&lt;/strong&gt; We isolated the first-turn drop-off rate — patients who hung up after hearing just the greeting and one response. The spread was dramatic:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Engine C: 4.1% first-turn drop-off&lt;/li&gt;
&lt;li&gt;Engine A: 6.8%&lt;/li&gt;
&lt;li&gt;Engine D: 8.9%&lt;/li&gt;
&lt;li&gt;Engine B: 11.3%&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Nearly 1 in 9 patients hung up after the first exchange with Engine B. With Engine C, it was 1 in 24. Same greeting, same words, same AI — different voice engine, different outcome.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Repeat callers validated the pattern.&lt;/strong&gt; Patients who had previously interacted with Engine C were 2.3x more likely to engage with the AI on their next call versus asking for a human immediately. Engine B repeat callers asked for a human 34% of the time on their second call. First impressions stuck.&lt;/p&gt;

&lt;h2&gt;
  
  
  What We Changed
&lt;/h2&gt;

&lt;p&gt;We moved Loquent's primary TTS to Deepgram Aura for all production healthcare clients. But we didn't just swap engines and call it done. The test taught us three architectural things:&lt;/p&gt;

&lt;p&gt;First, we implemented &lt;strong&gt;adaptive engine selection&lt;/strong&gt;. For complex responses where voice quality matters more — reading back appointment details, explaining insurance coverage — we route to ElevenLabs. For fast conversational turns — confirmations, short answers, greetings — we use Deepgram. This hybrid approach got us to 83.6% completion rate, higher than any single engine alone.&lt;/p&gt;

&lt;p&gt;Second, we added &lt;strong&gt;latency budgeting&lt;/strong&gt; to our voice pipeline. Every component now has a time budget: LLM inference gets 800ms, TTS gets 250ms, network overhead gets 150ms. If any component is trending over budget, we fall back to a faster path. We pre-generate common responses (greetings, "one moment please" fillers, confirmations) so the first turn is always instant.&lt;/p&gt;

&lt;p&gt;Third, we started &lt;strong&gt;measuring voice trust, not voice quality&lt;/strong&gt;. We retired our internal "does this sound good?" reviews and replaced them with production metrics: completion rate, first-turn drop-off, and repeat-caller engagement. The voice that sounds best in a meeting room is not the voice that performs best on a phone call from a noisy waiting room.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Findings
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Latency beats quality in production voice AI.&lt;/strong&gt; A 300ms difference in time-to-first-byte correlated with a 10-percentage-point swing in call completion. Patients interpret speed as competence and delays as confusion.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;The first 3 seconds determine the entire call.&lt;/strong&gt; First-turn drop-off varied by nearly 3x across engines. If you're optimizing your voice AI, start with the greeting response time, not the voice timbre.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Demo performance inversely correlated with production performance.&lt;/strong&gt; The engine our team unanimously preferred in blind tests had the worst patient outcomes. Always test in production, not in a conference room.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Hybrid TTS routing outperforms any single engine.&lt;/strong&gt; Using fast engines for conversational turns and higher-quality engines for complex information delivery gave us better results than committing to one engine for everything.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Trust is measurable, and it compounds.&lt;/strong&gt; Repeat-caller behavior is the most honest signal. Patients who had a good first experience came back willing to engage. Patients who didn't came back demanding a human. Your TTS choice has a retention effect.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  What This Means for Builders
&lt;/h2&gt;

&lt;p&gt;If you're building voice AI for healthcare or any high-trust domain, stop optimizing for how the voice sounds in your headphones. Optimize for how fast it responds when a nervous patient calls at 7am about a toothache. That's the test that matters.&lt;/p&gt;

&lt;p&gt;We're considering publishing our full latency benchmarking methodology as an open-source tool (we teased this in a previous post). If there's interest, we'll prioritize it.&lt;/p&gt;

&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://www.autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>What Autor Will Build in the Next 12 Months — And Why We're Telling You Before We Build It</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Wed, 22 Jul 2026 18:08:49 +0000</pubDate>
      <link>https://dev.to/autor_tech/what-autor-will-build-in-the-next-12-months-and-why-were-telling-you-before-we-build-it-3ebi</link>
      <guid>https://dev.to/autor_tech/what-autor-will-build-in-the-next-12-months-and-why-were-telling-you-before-we-build-it-3ebi</guid>
      <description>&lt;p&gt;We've shipped 50+ AI products for clients over the past four years. Starting now, we're going to build three of our own — and we're publishing our roadmap because we think the AI development studio model is about to change in ways most studios aren't prepared for.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why We're Doing This Publicly
&lt;/h2&gt;

&lt;p&gt;Most agencies guard their roadmaps. We get it — you don't want competitors copying your moves. But after four years of building custom AI for everyone from healthcare networks to fintech startups, we've realized something: the studios that will survive the next two years aren't the ones with secret plans. They're the ones with public conviction.&lt;/p&gt;

&lt;p&gt;Here's the honest context. Autor is an eight-person AI development studio in Toronto. We charge $150/hr, we only hire senior engineers, and we've never taken outside funding. Our biggest product, Loquent, handles thousands of automated voice calls per month for healthcare and dental clinics across Canada. We built it in eight weeks.&lt;/p&gt;

&lt;p&gt;That last part matters. Eight weeks from first commit to production calls. Not because we cut corners — because our team has done this enough times that we know exactly where the time sinks are, and we've built internal tooling to skip them. That internal tooling is what this roadmap is really about.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Three Things We're Building
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. Loquent Multi-Vertical (Q3 2026 – Q1 2027)
&lt;/h3&gt;

&lt;p&gt;Loquent today handles inbound calls for dental clinics and healthcare offices. It books appointments, answers insurance questions, handles cancellations, and transfers to a human when it hits something it can't resolve. About 82% of calls are fully automated end-to-end.&lt;/p&gt;

&lt;p&gt;Here's what we've learned from analyzing tens of thousands of those calls: the hard problems in voice AI aren't industry-specific. The hard problems are latency management, interrupt handling, context switching mid-sentence, and knowing when to shut up and transfer. We solved those problems for healthcare. The actual healthcare knowledge — the appointment types, the insurance logic, the PHIPA compliance — that's configuration, not architecture.&lt;/p&gt;

&lt;p&gt;So starting in Q3, we're expanding Loquent to property management, legal intake, and auto service. Three verticals, chosen for specific reasons:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Property management&lt;/strong&gt; because tenant call patterns are remarkably similar to patient call patterns — high volume, mostly routine, time-sensitive, and currently handled by overworked humans or terrible IVR trees.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Legal intake&lt;/strong&gt; because law firms already understand hourly billing and the ROI calculation is dead simple: if your intake coordinator costs $55k/year and handles 40 calls a day, and Loquent handles 33 of those, the math does itself.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Auto service&lt;/strong&gt; because one of our existing clients asked us to, and they're willing to be the beta. Never underestimate "a client asked for it" as a product strategy.&lt;/p&gt;

&lt;p&gt;We're not building three separate products. Loquent stays one platform with vertical-specific configuration layers. The voice pipeline, the Twilio integration, the Claude-powered reasoning engine, the fallback logic — all shared. What changes per vertical is the knowledge base, the integration targets (Jane App for healthcare, Clio for legal, Shop-Ware for auto), and the compliance requirements.&lt;/p&gt;

&lt;p&gt;Target: three verticals live by February 2027. We'll publish the results — conversion rates, automation percentages, latency numbers — as we go.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. Autor Deploy Kit — Our Internal Stack, Open Sourced (Q4 2026)
&lt;/h3&gt;

&lt;p&gt;Every AI product we build at Autor starts the same way. We spin up a Next.js frontend, a NestJS API layer, a PostgreSQL database with Prisma, wire up authentication, set up deployment on AWS or Vercel, configure monitoring, and integrate whatever LLM provider the project needs. That process used to take two weeks. We've gotten it down to about four hours.&lt;/p&gt;

&lt;p&gt;The tooling that makes that possible — our starter templates, our LLM abstraction layer, our prompt management system, our evaluation harness — has been internal-only for three years. We're open-sourcing it in Q4 2026.&lt;/p&gt;

&lt;p&gt;Why now? Two reasons.&lt;/p&gt;

&lt;p&gt;First, the AI development market is getting flooded with studios that can't actually ship production systems. They can build demos. They can build prototypes. But they don't know how to handle rate limiting at scale, or how to structure prompts so they don't drift over time, or how to set up evaluation pipelines that catch regressions before users do. Publishing our tooling is a forcing function — it makes us document our opinions about how production AI should work, and it lets potential clients evaluate our thinking before they hire us.&lt;/p&gt;

&lt;p&gt;Second, we've watched enough open-source AI tooling projects to know what's missing. LangChain is a framework for building chains. LlamaIndex is a framework for building RAG. But nobody's published a good opinionated starter for "I need to ship an AI-powered SaaS product that handles real users, real errors, and real scale." That's what Autor Deploy Kit is.&lt;/p&gt;

&lt;p&gt;It'll include our LLM provider abstraction (swap between OpenAI, Anthropic, and local models with a config change), our prompt versioning system (every prompt is a tracked artifact with evaluation history), our evaluation framework (automatic regression testing against golden datasets), and our deployment templates for AWS and Vercel.&lt;/p&gt;

&lt;p&gt;We're not pretending this will be the next big open-source project. But if even 50 teams use it to ship production AI products faster, that's a win for the ecosystem — and frankly, it's good marketing. Every team that uses our deployment kit and likes it is a team that might hire us when they need custom work.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Agentic Workflow Platform — Internal First, Then Product (Q1 – Q3 2027)
&lt;/h3&gt;

&lt;p&gt;This is the ambitious one. Over the past year, we've built custom AI agent systems for nine different clients. Document processing pipelines for insurance companies. Research assistants for consulting firms. Automated QA systems for SaaS products. Every one of those projects involved building the same orchestration layer from scratch — the part that manages multiple AI agents working together, handles failures gracefully, maintains state across long-running workflows, and provides observability into what the agents are actually doing.&lt;/p&gt;

&lt;p&gt;We're building a general-purpose version of that orchestration layer. Not a framework — a platform. The difference: a framework gives you primitives and says "figure it out." A platform gives you a running system with a UI, logging, deployment, and monitoring built in.&lt;/p&gt;

&lt;p&gt;We're building it internal-first. Meaning we'll use it on our own client projects for at least two quarters before we offer it as a standalone product. Every client project in 2027 will run on this platform, which means it'll get battle-tested across different industries, different scale requirements, and different failure modes before anyone else touches it.&lt;/p&gt;

&lt;p&gt;The technical bet we're making: the next wave of AI products won't be single-model applications. They'll be systems of specialized agents coordinated by an orchestration layer. The orchestration problem — routing, state management, error recovery, human-in-the-loop handoffs — is where the real engineering challenge is. And it's where most teams are currently duct-taping things together with ad-hoc code.&lt;/p&gt;

&lt;p&gt;We don't have a launch date for the external product yet. We'll share progress quarterly.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why We're Telling You This
&lt;/h2&gt;

&lt;p&gt;Four reasons, and I'll be direct about all of them.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;1. Accountability.&lt;/strong&gt; Publishing a roadmap means we can't quietly pivot when things get hard. If Loquent multi-vertical doesn't ship by February 2027, you'll know. That pressure is useful.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Recruiting.&lt;/strong&gt; We're hiring two senior engineers this year. The kind of engineers we want — the ones who've shipped production AI and are tired of working at companies that demo well but can't operate — those people want to know what they'd be building. Now they know.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Client signaling.&lt;/strong&gt; If you're evaluating AI development studios in Toronto right now, you should know which ones are investing in their own IP versus which ones are just billing hours. We're doing both, and we think that makes us better at client work, not worse. Every product we build internally sharpens the tools we use on client projects.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4. Industry transparency.&lt;/strong&gt; The AI development studio market is opaque. Clients can't tell who's good until they've already spent $50k finding out. Publishing our roadmap, our technical opinions, and eventually our tooling is our way of making that evaluation easier.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Takeaways
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;Loquent is expanding from healthcare-only to property management, legal intake, and auto service — same voice AI engine, different configuration layers. Three verticals live by February 2027.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Autor Deploy Kit ships in Q4 2026 as open source — our opinionated production AI starter that cuts new project setup from two weeks to four hours.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;We're building an agentic workflow platform starting Q1 2027, internal-first for at least two quarters before external launch. The bet: multi-agent orchestration is the next critical infrastructure layer.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;We're publishing this roadmap because accountability, recruiting, client signaling, and industry transparency all benefit from openness. Secret roadmaps are a liability when trust is your differentiator.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;Everything we build gets published results — conversion rates, automation percentages, real latency numbers. No vague claims.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://www.autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>We Turned Down a $200k Project Last Month — Here's Why</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 20 Jul 2026 16:06:27 +0000</pubDate>
      <link>https://dev.to/autor_tech/we-turned-down-a-200k-project-last-month-heres-why-243</link>
      <guid>https://dev.to/autor_tech/we-turned-down-a-200k-project-last-month-heres-why-243</guid>
      <description>&lt;p&gt;Last month a Series B fintech company offered us $200k to build their entire customer support automation platform. We said no. It was the hardest business decision I've made this year, and I'm still not 100% sure it was right.&lt;/p&gt;

&lt;h2&gt;
  
  
  The call that started it
&lt;/h2&gt;

&lt;p&gt;Their VP of Engineering found us through a referral. They'd seen what we built with Loquent — our production voice AI platform handling thousands of automated calls per month for healthcare and dental clients — and wanted something similar for their support operation. The scope was clear: voice AI for inbound support, chatbot for their web app, automated ticket routing, and integration with their existing Zendesk and Salesforce stack.&lt;/p&gt;

&lt;p&gt;On paper, this was a dream project. $200k budget. Reasonable 16-week timeline. A technical team on their side that actually understood AI limitations. They weren't asking us to "add AI" to a product that didn't need it — they had a real problem with support costs eating 40% of their gross margin, and they'd done the math on what automation could save them.&lt;/p&gt;

&lt;p&gt;I spent three days putting together a technical proposal. We mapped out the architecture: Twilio for voice, Anthropic Claude for conversation handling, Pinecone for their knowledge base retrieval, NestJS for the backend services. I knew exactly how we'd build it because we'd already solved most of these problems with Loquent.&lt;/p&gt;

&lt;p&gt;Then I killed the deal.&lt;/p&gt;

&lt;h2&gt;
  
  
  What changed my mind
&lt;/h2&gt;

&lt;p&gt;It wasn't one thing. It was a pattern I'd been watching for six months across our client engagements.&lt;/p&gt;

&lt;p&gt;The first red flag was scope. This wasn't a voice AI project with some chat bolted on. This was three distinct products: a voice agent, a chatbot, and a ticket routing system. Each one of those is a 6-8 week build if you're doing it right. At $150/hr with our team of four senior engineers, $200k buys you roughly 1,333 hours. Split across three products over 16 weeks, that's about 83 hours per person per product. That's tight. Not impossible, but tight enough that quality would suffer.&lt;/p&gt;

&lt;p&gt;The second flag was maintenance. We've been running Loquent in production for over a year now. I've written about the 3am calls, the edge cases that break your confidence in AI, the 18% of calls that still need human transfer. What I haven't written about much is the ongoing engineering cost of keeping a production voice AI system reliable. Every month we spend 60-80 hours on Loquent maintenance: prompt tuning, handling new edge cases, updating integrations when Twilio or our LLM providers ship breaking changes, monitoring call quality metrics.&lt;/p&gt;

&lt;p&gt;If we built three products for this client, we'd be signing up for 150-200 hours of monthly maintenance work. That's essentially one full-time senior engineer dedicated to a single client. At our size — four senior engineers, no offshore, no handoffs — that's 25% of our entire capacity locked up indefinitely.&lt;/p&gt;

&lt;p&gt;The third flag was the one that actually made the decision. This project would pull us away from healthcare.&lt;/p&gt;

&lt;h2&gt;
  
  
  The positioning problem
&lt;/h2&gt;

&lt;p&gt;When I started Autor in 2021, we were a generalist AI development studio. We'd build anything: recommendation engines, NLP pipelines, computer vision systems, chatbots. We were good at all of it. We shipped 50+ products across 10+ countries. But "good at everything" is a terrible positioning for a six-person studio competing against agencies with 200 engineers and enterprise consultancies with thousands.&lt;/p&gt;

&lt;p&gt;The shift happened when we built Loquent. For the first time, we weren't just building AI — we were operating it. We understood the difference between a demo that handles 10 calls and a system that handles 10,000. We learned things about healthcare voice AI that nobody else had learned because nobody else was running it at our scale in Canada with PHIPA compliance baked in from day one.&lt;/p&gt;

&lt;p&gt;That knowledge is our moat. Not our code. Not our tech stack. The operational knowledge of what breaks at 2am when a patient calls about a prescription refill and your AI confidently gives the wrong pharmacy number.&lt;/p&gt;

&lt;p&gt;Taking the fintech project would have meant three things for our positioning:&lt;/p&gt;

&lt;p&gt;First, it would dilute our healthcare expertise. Four months of building fintech support tools means four months not deepening our understanding of healthcare voice AI. In a market moving this fast, four months of distraction is significant.&lt;/p&gt;

&lt;p&gt;Second, it would muddy our story. Right now when someone asks "who builds voice AI for healthcare in Canada?" there's a short list, and we're on it. If we start building fintech support platforms, we become "the AI agency that does everything" again. We already learned that lesson once.&lt;/p&gt;

&lt;p&gt;Third — and this is the part that surprised me — it would actually hurt our revenue long-term. We ran the numbers. The $200k project would generate roughly $200k over 16 weeks, then maybe $30-40k/year in maintenance revenue. But our healthcare pipeline had two deals in it totaling $280k, both specifically seeking a team with production healthcare voice AI experience. If we took the fintech work, we'd likely lose both of those deals because we wouldn't have the capacity to start them on time.&lt;/p&gt;

&lt;p&gt;So the math was: $200k now + $30-40k/year recurring, versus $280k in 8 weeks + the compounding value of deeper healthcare positioning.&lt;/p&gt;

&lt;h2&gt;
  
  
  The conversation I didn't want to have
&lt;/h2&gt;

&lt;p&gt;Telling the fintech VP was uncomfortable. They'd spent time with us, shared their architecture docs, introduced us to their CTO. I didn't want to waste their time or damage the relationship.&lt;/p&gt;

&lt;p&gt;I was honest about it. I told them exactly what I'm telling you: we're a healthcare voice AI company now, and taking their project would make us worse at the thing we're best at. I offered to introduce them to two other studios I trust — one in Toronto, one in Vancouver — who could handle their scope without the positioning conflict.&lt;/p&gt;

&lt;p&gt;Their response surprised me. The VP said something like: "That's actually why I wanted to hire you. Most agencies would have said yes to $200k without thinking twice." He asked if we'd consider a smaller advisory engagement — 20 hours to help their internal team with the voice AI architecture, since that was where our expertise was most relevant. We said yes to that.&lt;/p&gt;

&lt;p&gt;That advisory engagement turned into a $15k engagement, which isn't $200k, but it's $15k of pure expertise delivery with zero maintenance tail. And the referral relationship is intact — they've already sent one healthcare company our way.&lt;/p&gt;

&lt;h2&gt;
  
  
  The part I'm still not sure about
&lt;/h2&gt;

&lt;p&gt;I'd be lying if I said this was an easy call. $200k is a lot of money for a studio our size. There are months where payroll feels tight, where a big contract would solve problems I think about at 3am.&lt;/p&gt;

&lt;p&gt;And there's a real risk in over-indexing on positioning. If healthcare voice AI hits a regulatory wall, or if a bigger player commoditizes what we do, we'll wish we had diversified. I think about that. I don't have a clean answer for it.&lt;/p&gt;

&lt;p&gt;What I do know is that in the 18 months since we started focusing on healthcare, our close rate went from 15% to 40%, our average project value went up 60%, and we stopped competing on price. When a dental clinic in Ontario needs a voice AI system that handles patient calls 24/7 and complies with PHIPA, they don't get five proposals. They get maybe two. We want to be one of those two.&lt;/p&gt;

&lt;h2&gt;
  
  
  5 things I learned from saying no to $200k
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Scope math doesn't lie.&lt;/strong&gt; Before you say yes to any project, divide the budget by your hourly rate, then by the number of distinct products. If each product gets less than 400 engineering hours, you're going to cut corners. You might not notice on delivery day, but you'll notice in month three of maintenance.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Maintenance is the real cost.&lt;/strong&gt; Every product you ship is a recurring obligation. At a small studio, three or four maintenance-heavy products will consume your entire capacity for new work. Calculate the maintenance tail before you sign.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;"Good at everything" is positioning for nobody.&lt;/strong&gt; This is especially true for studios under 20 people. You can't outbuild a 200-person agency on breadth. You can absolutely outbuild them on depth in one domain.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Be honest when you say no.&lt;/strong&gt; Don't make up excuses. Tell the client exactly why you're declining. The best referral sources are people who respect your honesty, even when it costs them time.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Run the 12-month math, not the 12-week math.&lt;/strong&gt; The $200k looked better than our pipeline on a 16-week horizon. On a 12-month horizon, staying focused was worth roughly 40% more in revenue — and that's before you factor in the positioning value.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;




&lt;p&gt;&lt;em&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>We Turned Down a $200k Project Last Month - Here's Why</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 13 Jul 2026 16:42:54 +0000</pubDate>
      <link>https://dev.to/autor_tech/we-turned-down-a-200k-project-last-month-heres-why-b4</link>
      <guid>https://dev.to/autor_tech/we-turned-down-a-200k-project-last-month-heres-why-b4</guid>
      <description>&lt;p&gt;Last month, a Series B fintech company offered us $200k to build their platform. We said no, and it was one of the hardest business decisions I've made at Autor. Here's the full story — the call, the spreadsheet I built at 11pm to justify it, and what it taught us about running a boutique AI development studio.&lt;/p&gt;

&lt;h2&gt;
  
  
  The pitch sounded perfect
&lt;/h2&gt;

&lt;p&gt;The founder reached out through a warm intro. Smart guy, well-funded, clear vision. His company had raised $14M and needed a platform rebuilt from scratch — a customer-facing fintech tool with AI-powered risk assessment, automated document processing, and a dashboard for their ops team.&lt;/p&gt;

&lt;p&gt;Timeline: 6 months. Budget: $200k. Our rate, our stack, our call on architecture.&lt;/p&gt;

&lt;p&gt;For a studio our size — senior engineers only, typically running 2-3 concurrent projects — $200k over 6 months is a significant chunk of annual revenue. My co-founder and I spent a week scoping it. We had three calls with their team. We started sketching the architecture.&lt;/p&gt;

&lt;p&gt;Then I built the spreadsheet that killed the deal.&lt;/p&gt;

&lt;h2&gt;
  
  
  The 85/15 problem
&lt;/h2&gt;

&lt;p&gt;When I broke down the actual work, the numbers told a different story. Out of an estimated 2,400 engineering hours:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;~360 hours (15%) was genuine AI work — the risk models, document processing pipeline, and the inference layer&lt;/li&gt;
&lt;li&gt;~2,040 hours (85%) was standard web development — auth flows, admin panels, CRUD operations, payment integrations, responsive frontend, notification system, user management&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;We're an AI development studio. We charge $150/hr because our engineers have built production AI systems — voice agents handling thousands of calls, RAG pipelines processing medical documents, real-time inference serving healthcare providers 24/7. That's what clients pay a premium for.&lt;/p&gt;

&lt;p&gt;Spending 85% of a 6-month engagement on work that any competent web dev shop could handle at $80-100/hr? That's not what we built Autor to do.&lt;/p&gt;

&lt;p&gt;But it gets worse.&lt;/p&gt;

&lt;h2&gt;
  
  
  The opportunity cost spreadsheet
&lt;/h2&gt;

&lt;p&gt;I opened a new tab in the spreadsheet and modeled what saying yes would actually cost us. Here's what I found:&lt;/p&gt;

&lt;p&gt;With our current team size, taking this project meant turning away roughly 3-4 focused AI engagements over the same period. Based on our pipeline at the time, those projects looked like:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;A dental group wanting voice AI for 12 clinics (similar to our Loquent platform — we could deliver in 8 weeks, not 6 months)&lt;/li&gt;
&lt;li&gt;A healthtech startup needing a clinical document processing pipeline&lt;/li&gt;
&lt;li&gt;Two smaller AI agent builds, each in the $40-60k range&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Total revenue from those projects: approximately $180-220k. So financially, it was roughly a wash. The $200k project wasn't even a revenue premium — it was just one big number that felt safer than four smaller ones.&lt;/p&gt;

&lt;p&gt;But the real cost wasn't financial. It was positioning.&lt;/p&gt;

&lt;h2&gt;
  
  
  What happened last time
&lt;/h2&gt;

&lt;p&gt;I've been here before. In 2024, we took a large project that was maybe 30% AI and 70% general platform work. The client was great, the money was good, and we told ourselves the AI component justified it.&lt;/p&gt;

&lt;p&gt;Six months later, here's what actually happened:&lt;/p&gt;

&lt;p&gt;Our dev.to posts dried up because nobody had time to write about AI work — we were debugging CSS grid issues and Stripe webhook edge cases. Our case studies from that period were weak because the AI component shipped in month 5 and we couldn't talk about the other client's business.&lt;/p&gt;

&lt;p&gt;Three prospects during that period asked what we'd been working on. "A fintech platform" doesn't land the same as "We built a voice AI system that handles 3,000 automated calls per month for healthcare providers." Two of those prospects went with other studios.&lt;/p&gt;

&lt;p&gt;The worst part: when the project ended, our inbound pipeline had cooled. It took us almost two months to rebuild momentum. The total cost of that positioning drift was probably $150k in delayed or lost deals. I can't prove that number exactly, but I can tell you our Q1 2025 was our weakest quarter since founding, and it traced directly back to that decision.&lt;/p&gt;

&lt;h2&gt;
  
  
  The conversation with the founder
&lt;/h2&gt;

&lt;p&gt;Telling the founder was uncomfortable. He'd invested time with us. The warm intro was a friend I respect. And his reaction was exactly what I expected: "Can't you just staff up for this?"&lt;/p&gt;

&lt;p&gt;I explained our model. We don't subcontract. We don't hire junior devs and mark them up. Every engineer at Autor has built production AI systems. That's not a recruiting pitch — it's a structural decision that limits our capacity on purpose.&lt;/p&gt;

&lt;p&gt;He pushed back: "So hire another senior engineer."&lt;/p&gt;

&lt;p&gt;Here's the thing about hiring senior AI engineers in Toronto in 2026: it takes 3-4 months to find someone good, another month to onboard them into our systems and standards, and the project needed to start in 3 weeks. Even if I found someone tomorrow, they wouldn't be productive on this codebase for 6 weeks. The math doesn't work.&lt;/p&gt;

&lt;p&gt;We offered an alternative: we'd build the AI components — the risk models, the document processing pipeline, the inference infrastructure — as a standalone engagement. Eight weeks, $65k. They could hire a separate web dev team for the platform work at a lower rate, and we'd architect the integration points.&lt;/p&gt;

&lt;p&gt;He thought about it for a week and went with a full-service agency instead. No hard feelings. It was the right call for his timeline.&lt;/p&gt;

&lt;h2&gt;
  
  
  What we did with those 6 months instead
&lt;/h2&gt;

&lt;p&gt;Since turning down that project in June, here's what shipped:&lt;/p&gt;

&lt;p&gt;We onboarded two new Loquent clients — a multi-location dental group in Ontario and a physiotherapy chain in BC. Combined, they're running about 1,800 automated calls per month through our platform. The dental group went live in 6 weeks.&lt;/p&gt;

&lt;p&gt;We built a clinical intake AI agent for a healthtech company that processes patient forms in three languages. That project was 10 weeks and every hour was genuine AI engineering — multilingual NLP, structured data extraction from messy PDFs, PHIPA-compliant data handling.&lt;/p&gt;

&lt;p&gt;We published four technical articles (including this one) that generated inbound leads. Our dev.to posts collectively pulled 8,000+ views. One of them — the healthcare voice AI analysis piece — got picked up by two AI newsletters.&lt;/p&gt;

&lt;p&gt;Total revenue from these projects is tracking ahead of the $200k we turned down. More importantly, every project reinforced our positioning. Every case study we can write from this period is an AI story, not a "we also do general web dev" story.&lt;/p&gt;

&lt;h2&gt;
  
  
  The 5 things I'd tell any boutique AI studio about saying no
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Model the real work breakdown before you say yes.&lt;/strong&gt; If more than 40% of the hours are outside your core expertise, you're not being hired for what makes you valuable. You're being hired because you're available. That's a commodity position, and it will price you like one eventually.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Calculate opportunity cost in positioning, not just revenue.&lt;/strong&gt; Lost positioning compounds. A quarter spent on off-brand work doesn't just cost you that quarter — it weakens your pipeline for the next two. I've lived this twice now and the pattern is clear.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;"Just hire more people" is not a strategy for boutique studios.&lt;/strong&gt; Our value proposition is that every engineer is senior and has shipped production AI. The moment we dilute that to service a larger project, we become a body shop with a nicer website. Clients who want 15 developers can find them. Clients who want 4 engineers who've each built voice AI systems handling thousands of calls? That's a shorter list.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Offer the scoped alternative.&lt;/strong&gt; Don't just say no — propose the engagement that fits your strengths. We lost this particular deal, but the "we'll build the AI layer, you hire a web team" pitch has landed with other clients. It respects their needs while protecting your positioning.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Track what you ship instead.&lt;/strong&gt; After saying no to a big project, I now keep a running doc of what we delivered in that same window. It's the best antidote to the "what if we'd taken it" doubt. Six months later, the evidence is always overwhelming.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  The uncomfortable truth
&lt;/h2&gt;

&lt;p&gt;Turning down $200k when you're a small studio with real payroll is genuinely scary. There's no venture fund backstopping us. Every dollar matters. And I won't pretend the decision was easy or that I didn't second-guess it for weeks.&lt;/p&gt;

&lt;p&gt;But every time we've said yes to a large project that diluted our focus, we've paid for it in ways that don't show up on the invoice. Weaker case studies, slower content output, cooled inbound pipeline, and that creeping feeling that we're becoming generalists who happen to know some AI — instead of AI specialists who happen to be excellent engineers.&lt;/p&gt;

&lt;p&gt;Boutique doesn't mean small. It means focused. And focus requires saying no to good money when it pulls you off course.&lt;/p&gt;

&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://www.autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>The 3 Canadian Companies I'd Call If I Needed to Automate My Clinic's Front Desk</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 06 Jul 2026 13:15:36 +0000</pubDate>
      <link>https://dev.to/autor_tech/the-3-canadian-companies-id-call-if-i-needed-to-automate-my-clinics-front-desk-430e</link>
      <guid>https://dev.to/autor_tech/the-3-canadian-companies-id-call-if-i-needed-to-automate-my-clinics-front-desk-430e</guid>
      <description>&lt;p&gt;Last month, a clinic owner in Mississauga asked me which AI platform she should use to handle her 140 daily phone calls. She'd already demoed three US-based solutions. All three looked great in the sales pitch. None of them could tell her where her patient data would be stored.&lt;/p&gt;

&lt;p&gt;This is the fundamental problem with clinic front desk automation in Canada right now. The market is flooded with slick voice AI demos and "all-in-one" platforms, mostly built for the American healthcare system. They'll show you a beautiful dashboard, play you a recording of their AI booking an appointment, and quote you in USD. What they won't tell you is whether they're PHIPA-compliant, where their servers are, or what happens when a patient calls in French.&lt;/p&gt;

&lt;p&gt;I run Autor, an AI development studio in Toronto. We built Loquent, a production voice AI platform that handles thousands of automated healthcare calls every month. So yes, I have skin in this game. But I've also spent the last two years evaluating every company in this space — because our clients ask us to, and because we need to know who else is actually shipping.&lt;/p&gt;

&lt;p&gt;Here are the three Canadian companies I'd call if I needed to automate my clinic's front desk today. Not the three with the best marketing. The three I'd actually trust with my patients.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Loquent by Autor — For Answering the Phone
&lt;/h2&gt;

&lt;p&gt;Full disclosure: this is us. I'm listing us first because I'd be lying if I said I'd call someone else for voice AI, and this article isn't about pretending to be objective.&lt;/p&gt;

&lt;p&gt;Loquent handles the phone — the part of front desk automation that most clinics need fixed first. When a patient calls, Loquent answers, understands what they need, books or reschedules appointments, answers common questions, and transfers to a human when the situation requires it.&lt;/p&gt;

&lt;p&gt;Here's what actually matters about our setup:&lt;/p&gt;

&lt;p&gt;All data stays in Canada. Our infrastructure runs on AWS ca-central-1 (Montreal). No patient data crosses the border. We built PHIPA compliance in from day one, not as an afterthought — patient consent flows, data retention policies, audit logging, all baked into the platform.&lt;/p&gt;

&lt;p&gt;We handle thousands of calls per month across healthcare and dental clients. This isn't a demo. It's production. Our transfer rate to humans sits at about 18%. We've analyzed what those 18% of calls have in common and we've written about it. The short version: edge cases involving insurance disputes, emotional distress, and multi-party scheduling. AI shouldn't handle those. We designed the system so it doesn't try.&lt;/p&gt;

&lt;p&gt;The stack is Twilio for telephony, Anthropic Claude and OpenAI for language understanding, Deepgram for speech-to-text, and ElevenLabs for natural-sounding responses. We built the whole thing in 8 weeks and wrote about every decision we made.&lt;/p&gt;

&lt;p&gt;Loquent isn't for everyone. If your clinic gets fewer than 30 calls a day, you probably don't need us. If you just need a chatbot on your website, look elsewhere. But if your phone is ringing constantly and your receptionist is drowning, this is what we built.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Ocean by CognisantMD — For Patient Intake and Forms
&lt;/h2&gt;

&lt;p&gt;Loquent answers the phone. Ocean handles what happens after the patient walks through the door.&lt;/p&gt;

&lt;p&gt;Ocean is a Toronto-based platform that does digital patient intake, online booking, secure messaging, and electronic forms — all integrated directly into Canadian EMRs. If you're running Oscar, PS Suite, Med Access, or TELUS Health, Ocean probably already plugs in.&lt;/p&gt;

&lt;p&gt;They solved the EMR integration problem. This is the single hardest part of healthcare automation in Canada, and most voice AI companies (including us) have to work around it. Ocean went straight at it. Their tablet-based check-in and online forms feed directly into the patient's chart. No double-entry. No faxing. No transcription errors.&lt;/p&gt;

&lt;p&gt;They've been running in Canadian clinics for years. Ontario Health endorsed Ocean for COVID screening workflows. They have real deployment scale across thousands of Canadian providers. And they're not trying to do everything — Ocean doesn't answer your phone, doesn't do voice AI. What they do is replace the clipboard-and-pen intake process with something that actually works. Because they don't try to do everything, what they do is solid.&lt;/p&gt;

&lt;p&gt;If I were automating a clinic, I'd use Loquent for the phone and Ocean for intake. There's almost zero overlap.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. DentalAssist.ai — For Dental-Specific Voice AI
&lt;/h2&gt;

&lt;p&gt;DentalAssist is based in Burlington, Ontario, and they've built their entire product around dental clinics specifically. Where Loquent is a general healthcare voice AI platform that serves dental as one vertical, DentalAssist went deep on dentistry from the start.&lt;/p&gt;

&lt;p&gt;They understand the dental workflow. Dental scheduling is weirdly specific — hygiene vs. operative vs. emergency slots, insurance pre-authorization calls, recall reminders for cleanings every 6 months. DentalAssist built their AI around these dental-specific patterns.&lt;/p&gt;

&lt;p&gt;They're Canadian-built and marketing PHIPA compliance, bilingual capabilities, and CAD pricing. In a market where most competitors are US-based, this matters.&lt;/p&gt;

&lt;p&gt;Am I recommending a direct competitor? Yes. Because the honest answer is that if you're a dental clinic and you want something purpose-built for your workflow from the ground up, DentalAssist is doing interesting work. If you want a platform that handles dental AND medical AND can scale across multiple clinic types, that's where Loquent fits better.&lt;/p&gt;

&lt;p&gt;Competition makes everyone better. We've gotten sharper because companies like DentalAssist showed up.&lt;/p&gt;

&lt;h2&gt;
  
  
  What About Everyone Else?
&lt;/h2&gt;

&lt;p&gt;The Canadian healthcare AI front desk space has exploded in the last six months. I'm tracking at least half a dozen new entrants — SmileDial, JimmyAI, MedReception, JustReva, Mihron, and more. Some will ship good products. Some won't survive 2026.&lt;/p&gt;

&lt;p&gt;Here's my filter for evaluating any of them:&lt;/p&gt;

&lt;p&gt;Ask where the servers are. If they can't tell you immediately that patient data stays in Canada, walk away. Ask for a PHIPA compliance attestation — marketing copy that says "PHIPA-compliant" isn't the same as having actual policies, consent flows, and audit trails. Ask how many production calls they handle per month. A demo is not production. A pilot is not production. If they can't give you a number, they're not ready. Ask what happens when the AI can't handle a call — the transfer logic is the most important part of any voice AI system. And ask to talk to a clinic that's been using it for more than 3 months. Anything less and the honeymoon period is doing the heavy lifting.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why I Didn't Recommend Any US Companies
&lt;/h2&gt;

&lt;p&gt;This is the contrarian part. The American healthcare AI market is 10x the size of Canada's. Companies like Hyro, Parlance, and dozens of well-funded Bay Area startups are building impressive products.&lt;/p&gt;

&lt;p&gt;But for a Canadian clinic, they're the wrong choice. PHIPA is not HIPAA. Canadian patient expectations around bilingual service are different. The EMR landscape is different — Oscar and PS Suite don't exist in the US. Even the scheduling conventions are different: Ontario billing codes, provincial insurance, the way Canadian dental offices handle benefits verification.&lt;/p&gt;

&lt;p&gt;Building for Canadian healthcare is a specialization, not a localization. You can't take a US product, host it on a Canadian server, and call it PHIPA-compliant. The companies I listed above were built for Canadian clinics from scratch. That matters.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Takeaways
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;Don't buy an "all-in-one" platform. Phone answering, patient intake, and scheduling are three different problems. Use the best tool for each.&lt;/li&gt;
&lt;li&gt;Canadian data residency is non-negotiable. If your vendor can't confirm your patient data stays in Canada, keep looking.&lt;/li&gt;
&lt;li&gt;Production track record beats demo quality every time. Ask for real numbers — call volumes, transfer rates, uptime.&lt;/li&gt;
&lt;li&gt;The market is early and moving fast. The companies I listed today might not be the same ones I'd list in 12 months. Re-evaluate regularly.&lt;/li&gt;
&lt;li&gt;Direct competitors can coexist. I just recommended a competitor, and our business won't suffer for it. The market is big enough, and different clinics need different things.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit autor.ca.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>How to Evaluate an AI Development Studio in 2026 (The 8 Questions We'd Ask)</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 29 Jun 2026 13:13:53 +0000</pubDate>
      <link>https://dev.to/autor_tech/how-to-evaluate-an-ai-development-studio-in-2026-the-8-questions-wed-ask-1cbg</link>
      <guid>https://dev.to/autor_tech/how-to-evaluate-an-ai-development-studio-in-2026-the-8-questions-wed-ask-1cbg</guid>
      <description>&lt;p&gt;We've built over 50 AI products in four years. We've also watched companies waste six figures hiring the wrong development partner — teams that demo well, talk a great game about "leveraging AI," and then deliver a chatbot wrapper around GPT-3.5 with a React frontend. We've been brought in to rescue three of those projects in the last year alone.&lt;/p&gt;

&lt;p&gt;So we sat down and asked ourselves: if we were a company looking to hire an AI development studio in 2026 — even if it wasn't us — what would we actually ask? Not the softball stuff on their website. The questions that separate studios that ship production AI from those that ship demos.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why This Matters More Now Than a Year Ago
&lt;/h2&gt;

&lt;p&gt;The AI development landscape in Canada and globally has exploded. A quick search turns up hundreds of studios claiming to build "custom AI solutions." Most of them stood up a website in 2023, built a few proof-of-concepts, and started charging enterprise rates. The barrier to calling yourself an AI development studio is essentially zero.&lt;/p&gt;

&lt;p&gt;Meanwhile, the technical bar for production AI has gotten significantly higher. Customers expect sub-second response times. Healthcare and dental clients expect PHIPA and PIPEDA compliance out of the box. Everyone expects their AI to actually work at 2am on a Sunday, not just during a polished demo.&lt;/p&gt;

&lt;p&gt;This gap — between how easy it is to claim expertise and how hard it is to deliver — is the reason you need better questions.&lt;/p&gt;

&lt;h2&gt;
  
  
  The 8 Questions
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. "What's running in production right now, and can I see the metrics?"
&lt;/h3&gt;

&lt;p&gt;This is the single most important question. Not "what have you built" — what's running &lt;em&gt;right now&lt;/em&gt;, handling real users, real data, real edge cases?&lt;/p&gt;

&lt;p&gt;When we answer this, we show Loquent: thousands of automated calls per month, 89% automation rate, 4.3/5 patient satisfaction, sub-second first-response latency. These aren't pitch deck numbers. They're from our live Grafana dashboards.&lt;/p&gt;

&lt;p&gt;A studio that can only point to completed projects but nothing currently in production is telling you they build things and hand them off. That's fine for a marketing website. It's not fine for AI that needs to handle real-world chaos at 3am.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Red flag:&lt;/strong&gt; "We built an AI solution for [big company name] but can't share details due to NDA." Everyone has NDAs. Studios that actually ship production AI can at least describe the architecture, the scale, and the outcomes without naming the client.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. "Walk me through a production incident you had and how you handled it."
&lt;/h3&gt;

&lt;p&gt;We wrote an entire article about a 3am production failure during our healthcare AI launch. The short version: a Deepgram model update silently changed our transcription accuracy, we didn't have model version pinning, and patients in Montreal started getting transferred to humans at double our normal rate.&lt;/p&gt;

&lt;p&gt;Any studio with real production experience has war stories. If they don't, they either haven't run anything in production long enough to hit problems, or they're not being honest about what happened. Both are bad signs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What you want to hear:&lt;/strong&gt; specific technical details about what broke, how they detected it, how long it took to fix, and what they changed to prevent it from happening again. Not "we had a minor issue and resolved it quickly."&lt;/p&gt;

&lt;h3&gt;
  
  
  3. "What's your team structure, and who exactly will work on my project?"
&lt;/h3&gt;

&lt;p&gt;At Autor, we're senior engineers only. No offshore. No handoffs. The person you talk to in the sales call is the person writing your code. That's a deliberate choice — we charge $150/hr and keep the team small enough that quality never becomes someone else's problem.&lt;/p&gt;

&lt;p&gt;Many studios operate differently: a senior architect scopes the work, mid-level developers build it, and offshore contractors handle the grunt work. Sometimes that model works. But for AI specifically, the gap between "it works in the demo" and "it works in production" is almost always a senior engineering problem. Junior developers can wire up an OpenAI API call. Handling the edge cases, building the monitoring, tuning the prompts — that takes experience.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Red flag:&lt;/strong&gt; vague answers about team size, phrases like "we scale the team based on project needs," or an inability to name the specific engineers who'll work on your project.&lt;/p&gt;

&lt;h3&gt;
  
  
  4. "How do you handle data privacy and compliance?"
&lt;/h3&gt;

&lt;p&gt;If you're in healthcare, dental, legal, or financial services in Canada, this question eliminates about 70% of studios immediately.&lt;/p&gt;

&lt;p&gt;We built Loquent from day one with PHIPA and PIPEDA compliance as architectural constraints, not afterthoughts. Patient call data is encrypted at rest and in transit, stored on Canadian servers, access-logged with retention policies, and we can produce a complete audit trail for any patient interaction. We went through this with our healthcare clients' legal teams before writing a line of code.&lt;/p&gt;

&lt;p&gt;A studio that says "we can add compliance later" or "we use [US cloud provider] but it's probably fine" doesn't understand how healthcare data works in Canada. Compliance isn't a feature you bolt on. It's a design constraint that affects your database schema, your deployment architecture, your logging strategy, and your vendor selection.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What you want to hear:&lt;/strong&gt; specific compliance frameworks they've implemented, where data is stored, how access is controlled, and whether they've survived a client's legal or compliance review.&lt;/p&gt;

&lt;h3&gt;
  
  
  5. "What happens after you deliver? Who's on call?"
&lt;/h3&gt;

&lt;p&gt;We've inherited projects from three different studios in the past year. In every case, the original studio delivered a working product, the client signed off, and then things started breaking. The original team had moved on to the next project. Support was an email address that got checked "within 48 hours."&lt;/p&gt;

&lt;p&gt;Production AI isn't a build-and-forget deliverable. Models drift. Vendors push updates. User behavior changes. Call volumes spike. You need someone who monitors the system, responds to incidents, and proactively identifies degradation before users notice.&lt;/p&gt;

&lt;p&gt;Ask for their SLA terms. Ask what monitoring they run. Ask what happens at 3am on a Saturday when something breaks. At Autor, we run our own AI products in production — Loquent is ours, not a client handoff. So we're already monitoring and maintaining production AI systems around the clock because our own reputation depends on it.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Red flag:&lt;/strong&gt; "We offer a maintenance package" with no details on response times, monitoring, or what's actually included.&lt;/p&gt;

&lt;h3&gt;
  
  
  6. "Can you show me your testing process for AI-specific failures?"
&lt;/h3&gt;

&lt;p&gt;Traditional software testing — unit tests, integration tests, end-to-end tests — is necessary but not sufficient for AI systems. AI has failure modes that conventional tests don't catch: prompt regressions, model drift, transcription accuracy changes, hallucination under edge-case inputs.&lt;/p&gt;

&lt;p&gt;We built a test harness that replays 200 real call transcripts against every prompt change and flags regressions in intent detection, entity extraction, and task completion rate. We pin vendor model versions and test new versions against a saved corpus before promoting to production. We learned to do this the hard way, after a surprise model update dropped our Montreal automation rate by 9 points overnight.&lt;/p&gt;

&lt;p&gt;A studio that tests AI products the same way they test a CRUD app will ship you a product that works great on demo day and degrades unpredictably in production.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What you want to hear:&lt;/strong&gt; specific testing strategies for prompt regression, model version management, and real-world conversation replay testing. Not just "we have CI/CD."&lt;/p&gt;

&lt;h3&gt;
  
  
  7. "What AI infrastructure decisions would you make differently if you started over?"
&lt;/h3&gt;

&lt;p&gt;This is a trap question, in the best way. A studio with real production experience has a long list of things they'd do differently. We certainly do: we'd build a graph-based conversation state machine instead of a linear flow, invest in observability from day one instead of bolting on Grafana at month three, and build our regression test corpus from the first call instead of waiting until month four.&lt;/p&gt;

&lt;p&gt;A studio that says "we'd do everything the same" either hasn't run anything long enough to learn, or isn't self-aware enough to be trusted with your project. The best engineers are the ones who can articulate their own past mistakes clearly.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Red flag:&lt;/strong&gt; confident assertions that their architecture and process are already optimal. Nobody's are.&lt;/p&gt;

&lt;h3&gt;
  
  
  8. "What would you tell us NOT to build?"
&lt;/h3&gt;

&lt;p&gt;The most valuable thing an AI development partner can do is talk you out of building the wrong thing. We turned down a $200k project last month because the client's requirements would have produced a product their users didn't actually need. That's $200k we could have taken, but shipping something doomed to fail is worse for everyone.&lt;/p&gt;

&lt;p&gt;Ask the studio what kinds of projects they've declined. Ask them to look at your requirements and tell you what's unnecessary, what's premature, and what would be a waste of money. A studio that says yes to everything is optimizing for their revenue, not your outcome.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What you want to hear:&lt;/strong&gt; honest pushback on your own assumptions, specific examples of projects they've declined or descoped, and a willingness to tell you things you don't want to hear.&lt;/p&gt;

&lt;h2&gt;
  
  
  How to Weight These Answers
&lt;/h2&gt;

&lt;p&gt;Not all eight questions carry equal weight. Here's how I'd prioritize:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Production systems with live metrics&lt;/strong&gt; (Question 1) — this is pass/fail. No current production system, no consideration.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Compliance and data privacy&lt;/strong&gt; (Question 4) — if you're in a regulated industry in Canada, this is also pass/fail.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Post-delivery support and monitoring&lt;/strong&gt; (Question 5) — this is where most projects actually fail, six months after "delivery."&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;War stories and honest retrospectives&lt;/strong&gt; (Questions 2 and 7) — these reveal real experience vs. marketing polish.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Everything else&lt;/strong&gt; (Questions 3, 6, 8) — important differentiators once you've passed the first four filters.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;If a studio passes the first two questions clearly, you're probably in good hands. The remaining six help you choose between the studios that make it through that filter.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Uncomfortable Truth
&lt;/h2&gt;

&lt;p&gt;Most companies hiring an AI development studio in 2026 will make their decision based on the proposal deck, the quoted price, and whether the sales call "felt good." They'll end up with a product that works in the demo and breaks in production, built by a team they never met, running on infrastructure nobody monitors.&lt;/p&gt;

&lt;p&gt;The eight questions above aren't complicated. They just require the studio to be honest about what they've actually built, what went wrong, and what happens after they get paid. The studios that can answer them confidently are the ones worth hiring. The ones that can't will tell you they can't in how they dodge the questions.&lt;/p&gt;

&lt;p&gt;We've been on both sides of this — as the studio being evaluated and as the team brought in to fix what another studio delivered. The difference between a good outcome and a bad one almost always comes down to whether someone asked the hard questions before signing the contract.&lt;/p&gt;

&lt;p&gt;If you're evaluating studios right now — including us — we'd love to hear what questions you're asking. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit autor.ca.&lt;/p&gt;

</description>
      <category>typescript</category>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>6 Months of Running a Production Voice AI — What Changed, What Broke, What We'd Rebuild</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 22 Jun 2026 13:14:00 +0000</pubDate>
      <link>https://dev.to/autor_tech/6-months-of-running-a-production-voice-ai-what-changed-what-broke-what-wed-rebuild-5621</link>
      <guid>https://dev.to/autor_tech/6-months-of-running-a-production-voice-ai-what-changed-what-broke-what-wed-rebuild-5621</guid>
      <description>&lt;p&gt;Six months ago we pushed Loquent — our voice AI receptionist for healthcare and dental clinics — into production. It now handles thousands of automated calls per month across multiple clinics, 24/7, in both English and French. Here's everything that actually happened once real patients started talking to it.&lt;/p&gt;

&lt;p&gt;This isn't a launch post. We wrote that already. This is the unglamorous sequel: the parts where our assumptions were wrong, where vendors changed things under us, and where we looked at our own architecture and thought "why did we do it that way?"&lt;/p&gt;

&lt;h2&gt;
  
  
  The System at Month Zero
&lt;/h2&gt;

&lt;p&gt;Quick context on the stack we shipped. Loquent runs on Twilio for telephony, Deepgram for speech-to-text, Anthropic Claude for conversation logic, and ElevenLabs for text-to-speech. The backend is NestJS with PostgreSQL and Prisma, deployed on AWS with Docker. We built the whole thing in 8 weeks.&lt;/p&gt;

&lt;p&gt;At launch we had a single healthcare client running about 400 calls per week. The system handled appointment booking, cancellations, insurance verification routing, and basic triage — determining whether a patient needed to speak with a human or could be handled automatically.&lt;/p&gt;

&lt;p&gt;Our target was 85% full automation rate. We hit 82% in week one, which felt close enough to ship.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Changed
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;The prompt architecture got rewritten twice.&lt;/strong&gt; Our initial approach was a single massive system prompt — roughly 4,000 tokens — that covered every scenario. It worked for one clinic with one specialty. By month two we had three clinics with different booking rules, insurance requirements, and operating hours. The monolithic prompt became unmaintainable.&lt;/p&gt;

&lt;p&gt;We moved to a modular prompt system where each clinic gets a base conversation scaffold, and clinic-specific rules (hours, procedures, insurance logic) are injected as structured data rather than prose. The prompts dropped to about 1,200 tokens of core logic plus 300-800 tokens of clinic config. Latency improved by roughly 200ms on first response because Claude was processing less context.&lt;/p&gt;

&lt;p&gt;The second rewrite happened at month four when we added French language support for Quebec clinics. Instead of duplicating prompts, we built a language-agnostic intent layer and pushed all patient-facing text into a template system. This made adding new languages a config change instead of a prompt engineering project.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Deepgram's model updates changed our accuracy numbers overnight.&lt;/strong&gt; Twice in six months, Deepgram pushed model updates that shifted our transcription accuracy. The first time it improved — dental terminology recognition jumped from about 71% to 83%. The second time, three weeks later, a different update introduced regressions on Quebec French accents. Our automation rate in Montreal dropped 9 points in a single day.&lt;/p&gt;

&lt;p&gt;We now pin specific Deepgram model versions in production and test new versions against a saved corpus of 500 real call recordings before promoting. This added a week to our vendor update cycle but eliminated surprise regressions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Call volumes tripled, but not where we expected.&lt;/strong&gt; We planned for steady growth across all clinics. Instead, one dental group ran a local ad campaign that tripled their call volume in a week without telling us. Our Twilio concurrent call limit was 15. They hit 23 simultaneous calls on a Tuesday morning.&lt;/p&gt;

&lt;p&gt;The overflow calls got busy signals. We didn't even know it was happening until the clinic called us directly. Now we have alerting on concurrent call counts, queue depth, and Twilio capacity headroom. We also built an auto-scaling config that bumps concurrent limits when utilization crosses 70%.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Broke
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;The "I'll hold" problem.&lt;/strong&gt; We didn't anticipate how many patients would say "I'll hold" or "I'll wait" when told a human wasn't available. Our conversation logic treated silence as a disconnect signal after 8 seconds. Patients waiting for a human would go quiet, get disconnected, call back, get the AI again, and get increasingly frustrated.&lt;/p&gt;

&lt;p&gt;We found this pattern in 6% of all calls — roughly 40 calls per week across our clinics. The fix was a dedicated hold state with periodic check-ins ("I'm still here, a team member will be with you shortly") and extended silence tolerance of 45 seconds. Transfer-to-human success rate went from 74% to 91%.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;ElevenLabs latency spikes during peak hours.&lt;/strong&gt; Between 9am and 11am Eastern — prime appointment-booking time — ElevenLabs response times would occasionally spike from our baseline 180ms to 600-900ms. Patients experienced this as the AI "pausing" mid-conversation, which eroded trust.&lt;/p&gt;

&lt;p&gt;We built a TTS response cache for common phrases (greetings, confirmations, hold messages) that eliminated latency for about 35% of all spoken responses. For the remaining dynamic responses, we added a streaming playback pipeline that starts speaking before the full audio is generated. Combined, these brought worst-case perceived latency down to about 300ms.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The insurance verification rabbit hole.&lt;/strong&gt; Our original insurance check was simple: ask the patient for their insurance provider and policy number, confirm it's in the clinic's accepted list. Then clinics started asking us to do real-time eligibility checks. We built an integration with a clearinghouse API, and it worked — until it didn't.&lt;/p&gt;

&lt;p&gt;The clearinghouse had a 4-second average response time. Four seconds of silence on a phone call feels like an eternity. We tried filling the gap with "Let me check that for you" and hold music snippets, but the UX was terrible. We ended up moving insurance verification to an async flow: the AI collects the information, confirms it'll be verified before the appointment, and the actual check happens after the call. Patient satisfaction scores went up. Clinic staff workload went down.&lt;/p&gt;

&lt;h2&gt;
  
  
  What We'd Rebuild
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;The conversation state machine.&lt;/strong&gt; We built state management as a simple linear flow: greeting → intent detection → information collection → action → confirmation → goodbye. Real conversations aren't linear. Patients interrupt, backtrack, ask unrelated questions mid-booking, and change their minds.&lt;/p&gt;

&lt;p&gt;We patched this with increasingly complex branching logic, and it works, but it's brittle. If we rebuilt from scratch, we'd use a graph-based conversation model where each node is an intent with defined entry/exit conditions and any node can transition to any other node based on what the patient says. We're about 60% through this rebuild now.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The monitoring stack.&lt;/strong&gt; We started with basic CloudWatch logging and a Slack alert channel. That was fine for 400 calls a week. At our current volume, we need real-time dashboards showing automation rate by clinic, average call duration, transfer reasons, transcription confidence scores, and TTS latency — all broken down by time of day and language.&lt;/p&gt;

&lt;p&gt;We bolted on a custom analytics pipeline at month three, but it's a collection of Lambda functions and a Grafana dashboard that took more effort to maintain than to build. We'd invest in a proper observability layer from day one if we did it again. Probably Datadog with custom metrics, though the cost at our call volume would need careful management.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The testing infrastructure.&lt;/strong&gt; We ship prompt changes the way most teams ship code — PR, review, merge, deploy. But we didn't have automated regression testing for conversation quality until month four. Before that, someone on the team would manually call the system and run through scenarios.&lt;/p&gt;

&lt;p&gt;We now have a test harness that replays 200 real call transcripts against any prompt change and flags regressions in intent detection, entity extraction, and task completion rate. Building this earlier would have prevented at least three production incidents that each affected several hundred calls.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Numbers at Month Six
&lt;/h2&gt;

&lt;p&gt;Here's where we stand today compared to launch:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Automation rate:&lt;/strong&gt; 82% → 89% (target was 85%)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Average call duration:&lt;/strong&gt; 3m 42s → 2m 51s&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Patient satisfaction (post-call survey):&lt;/strong&gt; 3.8/5 → 4.3/5&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Transfer-to-human rate:&lt;/strong&gt; 18% → 11%&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;First-response latency (p95):&lt;/strong&gt; 1.4s → 0.8s&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Monthly call volume:&lt;/strong&gt; ~1,600 → ~5,200&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The single biggest driver of improvement wasn't any technical change. It was the modular prompt system that let us tune each clinic's AI behavior without risk of breaking other clinics. Configuration over code.&lt;/p&gt;

&lt;h2&gt;
  
  
  Five Things I'd Tell Someone Building This Today
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Pin your vendor model versions.&lt;/strong&gt; Every speech-to-text and LLM provider ships updates that can change your product's behavior without warning. Control when you adopt changes.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Build your test corpus from real calls immediately.&lt;/strong&gt; From day one, save anonymized call recordings. You'll need them for regression testing within weeks, not months.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Design for the unhappy path first.&lt;/strong&gt; The 11% of calls that need a human are more important than the 89% that don't. A bad transfer experience destroys all the goodwill the AI built.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Async everything that takes more than 2 seconds.&lt;/strong&gt; Silence on a phone call is death. If a backend operation takes time, collect the info and process it after the call.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Invest in per-client configuration early.&lt;/strong&gt; Your second client will have different rules than your first. Build the config system before you need it, because you'll need it sooner than you think.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;




&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit autor.ca&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>Why Canada Is the Best Place to Build Healthcare AI Right Now</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 15 Jun 2026 13:13:18 +0000</pubDate>
      <link>https://dev.to/autor_tech/why-canada-is-the-best-place-to-build-healthcare-ai-right-now-5dj0</link>
      <guid>https://dev.to/autor_tech/why-canada-is-the-best-place-to-build-healthcare-ai-right-now-5dj0</guid>
      <description>&lt;p&gt;Every week I talk to a founder who's building healthcare AI in San Francisco and spending 40% of their engineering time on HIPAA compliance across fifty different state-level interpretations. Meanwhile, we shipped Loquent — a production voice AI handling thousands of automated calls per month for healthcare and dental clinics — from Toronto, in eight weeks. The regulatory environment wasn't something we fought against. It was one of the reasons we moved fast.&lt;/p&gt;

&lt;p&gt;Most of the AI discourse assumes you need to be in the Bay Area to build anything real. For healthcare AI specifically, I think that's wrong. Canada has a set of structural advantages right now that most people aren't paying attention to, and by the time they do, the window will be smaller.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Regulatory Stack Is Actually an Advantage
&lt;/h2&gt;

&lt;p&gt;Here's what most people get wrong about Canadian privacy law: they assume PIPEDA is just "HIPAA but Canadian." It's not. It's actually more coherent.&lt;/p&gt;

&lt;p&gt;In the US, you have HIPAA at the federal level, but then you're dealing with a patchwork of state-level regulations. California has CCPA/CPRA. New York has SHIELD. Texas has its own thing. If you're building AI that processes health data, you're essentially maintaining compliance against a dozen different interpretations of what "adequate protection" means.&lt;/p&gt;

&lt;p&gt;In Canada, PIPEDA gives you a federal baseline built on 10 Fair Information Principles — purpose limitation, consent, accountability, the fundamentals. Then you layer on provincial health-specific legislation like Ontario's PHIPA (Personal Health Information Protection Act), which was actually designed with digital health workflows in mind. PHIPA explicitly addresses how health information custodians and their agents handle PHI across clinical and administrative workflows, including AI systems.&lt;/p&gt;

&lt;p&gt;The Ontario Information and Privacy Commissioner released guidance specifically about AI transcription tools in healthcare — requiring privacy impact assessments, data minimization throughout the AI lifecycle, and limiting PHI disclosure to vendors. These aren't vague handwaves. They're specific, implementable requirements.&lt;/p&gt;

&lt;p&gt;When we built Loquent, this clarity was a competitive advantage. Instead of hiring a team of lawyers to interpret ambiguous regulations, we could read the guidance, build to spec, and ship. PIPEDA's emphasis on meaningful consent — where individuals must be fully informed about how their data will be used — forced us to build better product, not slower product.&lt;/p&gt;

&lt;p&gt;And here's the kicker: Bill C-27's 2026 amendments are tightening consent requirements further, with penalties up to C$25 million or 5% of gross global revenue. That sounds scary, but it actually favors builders who are already compliant. It raises the floor for everyone else trying to compete in the Canadian market.&lt;/p&gt;

&lt;h2&gt;
  
  
  AIDA Is Dead. That's Actually Good for Builders.
&lt;/h2&gt;

&lt;p&gt;Canada's Artificial Intelligence and Data Act (AIDA) died in parliament. A lot of people read that as "Canada has no AI regulation" and panicked. I read it differently.&lt;/p&gt;

&lt;p&gt;What it means in practice is that healthcare AI in Canada operates under existing, well-understood privacy frameworks rather than a brand-new, untested AI-specific law. You're building against PIPEDA and PHIPA — legislation that's been interpreted by courts and privacy commissioners for years. Compare that to the EU's AI Act, where nobody actually knows yet how enforcement will work in practice for health applications.&lt;/p&gt;

&lt;p&gt;For a small studio like ours, regulatory predictability is worth more than regulatory completeness. We can build with confidence because the rules are clear. The AIDA vacuum will get filled eventually, but right now it means Canadian builders have a window where they can iterate without worrying that new legislation will retroactively invalidate their architecture decisions.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Talent Pool Is Deeper Than You Think
&lt;/h2&gt;

&lt;p&gt;Toronto has the fourth-largest AI talent pool in North America — 23,936 workers — and hit number three in CBRE's 2026 tech talent ranking. The city has over 285,000 tech workers across roughly 24,000 companies and was named Canada's fastest-growing AI hub in March 2026.&lt;/p&gt;

&lt;p&gt;But the real story is Waterloo. Waterloo Region jumped 11 spots to enter the top 10 for the first time, driven by computer and information systems manager growth. The University of Waterloo co-op pipeline is producing engineers who understand both ML fundamentals and production systems. And critically, more of them are staying local instead of immediately migrating to Silicon Valley.&lt;/p&gt;

&lt;p&gt;Canada now has three of the top 10 largest AI talent pools in North America: Toronto, Vancouver, and Montreal. The talent density isn't Bay Area level, but the cost difference is dramatic. We hire senior engineers in Toronto at rates that would get us mid-levels in SF. For a bootstrapped studio building production AI, that math matters.&lt;/p&gt;

&lt;h2&gt;
  
  
  41 Million Patients, One System
&lt;/h2&gt;

&lt;p&gt;This is the structural advantage nobody talks about. Canada's universal single-payer healthcare system generates clinical data at a scale most countries can't match. 41 million people across diverse demographics, all flowing through a single system architecture.&lt;/p&gt;

&lt;p&gt;The federal government is betting on this. In June 2025, Canada Health Infoway gave 10,000 primary care clinicians across Canada AI Scribe licenses through a federally funded program. In September 2025, they announced a task force on AI to recommend policies for research, talent, and commercialization. The VITAL health data initiative is explicitly about turning Canada's structural data advantage into Canadian AI products.&lt;/p&gt;

&lt;p&gt;For us at Autor, this means our clients are part of a system that's actively moving toward AI adoption, not resisting it. When a dental clinic in Ontario asks us about Loquent, they're asking in the context of a healthcare system that's already distributing AI tools to physicians. We're pushing on an open door.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Dental Market Is Wide Open
&lt;/h2&gt;

&lt;p&gt;Speaking of dental: Canada's dental AI market is still nascent. When surveyed, 60% of Canadian dentists said they hadn't implemented AI-assisted technologies in the past five years. The companies in this space — DentalRx, MaxAssist, ClearDent — are primarily focused on practice management and imaging. Almost nobody is building voice AI for dental front desks.&lt;/p&gt;

&lt;p&gt;That's exactly where Loquent lives. And Canada's dental market has a specific advantage: it's large enough to build a real business (over 27,000 dentists across the country) but small enough that you can reach meaningful market penetration from a single city. We're not competing against Epic or Cerner here. We're building for clinic owners who are running reception with two people and a phone that won't stop ringing.&lt;/p&gt;

&lt;h2&gt;
  
  
  Data Sovereignty Is a Selling Point
&lt;/h2&gt;

&lt;p&gt;One advantage I didn't anticipate: Canadian healthcare organizations are increasingly concerned about the US CLOUD Act. US-based platforms are subject to government data access requests, which creates a compliance risk for Canadian organizations handling personal health information. Canadian-operated platforms eliminate that exposure entirely.&lt;/p&gt;

&lt;p&gt;This isn't theoretical. We've had multiple conversations with clinic owners who specifically asked whether patient call data stays in Canada. For Loquent, it does. That's not just a compliance checkbox — it's becoming a real differentiator against US-based competitors trying to sell into the Canadian market.&lt;/p&gt;

&lt;p&gt;Canada's digital health market generated US$13.49 billion in 2024 and is projected to reach US$53.92 billion by 2030 — a 26% CAGR. Last year, 54% of digital health investment went to AI-enabled companies, up from 37% the year before. The money is following the opportunity.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Takeaways
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;PIPEDA + PHIPA give you clear, implementable compliance requirements.&lt;/strong&gt; The US patchwork of state privacy laws is actually harder to build against than Canada's layered federal-provincial model. Clarity beats complexity.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;The AIDA vacuum is a feature, not a bug.&lt;/strong&gt; Canadian healthcare AI operates under established privacy law with years of interpretation behind it. That's more predictable than brand-new AI-specific legislation that hasn't been tested.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Toronto-Waterloo talent density is real and growing.&lt;/strong&gt; Three of North America's top 10 AI talent pools are in Canada, and the cost advantage over US cities is significant for bootstrapped companies.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Single-payer data at scale is a structural moat.&lt;/strong&gt; 41 million patients in one system, with a federal government actively funding AI adoption. This dataset advantage compounds over time.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;The dental/clinic market is wide open.&lt;/strong&gt; 60% of Canadian dentists haven't adopted AI yet. If you're building healthcare AI tools for frontline clinics, Canada is an ideal starting market.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;




&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://www.autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>Why Canada Is the Best Place to Build Healthcare AI Right Now</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Mon, 08 Jun 2026 13:12:55 +0000</pubDate>
      <link>https://dev.to/autor_tech/why-canada-is-the-best-place-to-build-healthcare-ai-right-now-4pk</link>
      <guid>https://dev.to/autor_tech/why-canada-is-the-best-place-to-build-healthcare-ai-right-now-4pk</guid>
      <description>&lt;p&gt;Last month, a US-based healthtech founder asked me where he should incorporate his AI company. He was deciding between Delaware and Ontario. I told him Ontario — and he looked at me like I'd suggested he build a spaceship out of duct tape. Six weeks later, he moved his entire dev team to Toronto. Here's why.&lt;/p&gt;

&lt;p&gt;At Autor, we've spent the last two years building Loquent — a production voice AI platform that handles thousands of automated calls per month for healthcare and dental clients across Canada. We've shipped AI into regulated healthcare environments, navigated PIPEDA and PHIPA compliance from day one, and watched the US regulatory landscape turn into a minefield while Canada quietly built something better. I'm not saying Canada is perfect. I'm saying that right now, in June 2026, if you're starting a healthcare AI company, you're making a mistake by defaulting to the US.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Regulatory Argument Everyone Gets Wrong
&lt;/h2&gt;

&lt;p&gt;The common take is that the US is more "innovation-friendly" because HIPAA is well-understood and the FDA has been approving AI/ML medical devices since 2017. That's true — if you're building a diagnostic imaging tool that fits neatly into the existing SaMD framework. For everything else, especially conversational AI, voice agents, ambient scribes, and patient-facing automation, the US is a regulatory grey zone that's getting greyer.&lt;/p&gt;

&lt;p&gt;Canada's AIDA (Artificial Intelligence and Data Act) died in Parliament when it was prorogued in January 2025. Most people read that as "Canada has no AI regulation." I read it differently: Canada has no &lt;em&gt;bad&lt;/em&gt; AI regulation. What we do have is PIPEDA — a principles-based privacy framework that actually works for AI development.&lt;/p&gt;

&lt;p&gt;Here's the practical difference. HIPAA is entity-specific. It only covers "covered entities" — healthcare providers, insurers, and clearinghouses. Your AI startup processing voice calls for a dental clinic? You might not be a covered entity, but you're still handling PHI, and the legal exposure is enormous and unclear. PIPEDA covers all commercial activity involving personal information. There's no ambiguity about whether you're in scope. You are. And because PIPEDA's 10 Fair Information Principles are consent-based rather than entity-based, you can actually build a compliance architecture that makes sense for an AI product.&lt;/p&gt;

&lt;p&gt;Ontario's PHIPA adds a healthcare-specific layer on top. Section 29 requires Canadian data residency. That sounds like a restriction, but it's actually a competitive moat. If your data stays in Canada, you're compliant by default with the data sovereignty requirements that are now hitting US companies as a surprise. The EU's adequacy decisions, cross-border transfer restrictions, and provincial approval requirements all become simpler problems when your infrastructure is already Canadian.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Talent Math
&lt;/h2&gt;

&lt;p&gt;Toronto is now the third-largest tech talent pool in North America — over 285,000 technology workers in software, systems, and engineering roles. Only the Bay Area and New York Metro are bigger. Toronto's tech talent grew 44% over five years. The Vector Institute, University of Toronto, and the broader Waterloo-Toronto corridor produce more ML engineers per capita than anywhere except maybe London.&lt;/p&gt;

&lt;p&gt;But here's the number that actually matters: 30-40% cost savings compared to equivalent US hires. A senior ML engineer in San Francisco costs $250-350K fully loaded. In Toronto, that same engineer — often trained at the same institutions, publishing in the same conferences — costs $160-220K CAD, which is roughly $115-160K USD.&lt;/p&gt;

&lt;p&gt;And Canada's Global Talent Stream visa processes international hires in two weeks. Not two months. Two weeks. We've used this at Autor to bring in specialized talent from India and Eastern Europe without the H-1B lottery or the 8-month USCIS processing times that US startups just accept as normal.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Healthcare AI Market Nobody's Watching
&lt;/h2&gt;

&lt;p&gt;The dental AI market alone is projected to grow from $516M (2025) to $3.9B by 2035 — a 22.5% CAGR. The Canadian Dental Association made AI its central theme at CDA Presents 2026 in April. This isn't fringe adoption. The professional governing bodies are actively pushing clinics to modernize.&lt;/p&gt;

&lt;p&gt;We see this firsthand with Loquent. When we started building voice AI for dental clinics, the conventional wisdom was that Canadian healthcare was too conservative, too slow-moving, too resistant to automation. That turned out to be completely wrong. What Canadian clinics are is &lt;em&gt;compliance-conscious&lt;/em&gt;. They don't want to be first, but they absolutely want to adopt technology that's already proven AND compliant. Once we showed that Loquent handled PHIPA-compliant call handling with Canadian data residency, the objection wasn't "we don't want AI" — it was "how fast can you deploy."&lt;/p&gt;

&lt;p&gt;The competitive landscape is still early. DentalAssist.ai out of Burlington is doing interesting work. A few US-based companies are trying to enter the Canadian market but stumbling on compliance. The window for building a dominant Canadian healthcare AI company is open right now, and it won't stay open forever.&lt;/p&gt;

&lt;h2&gt;
  
  
  The SR&amp;amp;ED Advantage Nobody Talks About
&lt;/h2&gt;

&lt;p&gt;Canada's Scientific Research and Experimental Development (SR&amp;amp;ED) tax credit covers up to 35% of eligible R&amp;amp;D spend for Canadian-controlled private corporations. If you're building an AI product, most of your engineering work qualifies. We've used SR&amp;amp;ED at Autor every year, and the refund effectively subsidizes our entire research pipeline.&lt;/p&gt;

&lt;p&gt;The US has R&amp;amp;D tax credits too, but they're far less generous and the 2022 amortization rules made them worse. For early-stage healthcare AI companies burning cash on model development, prompt engineering, and integration work, the SR&amp;amp;ED refund is often the difference between having 12 months of runway and having 16 months.&lt;/p&gt;

&lt;p&gt;Combine SR&amp;amp;ED with lower salaries, Canadian data residency compliance, and the fact that $1 USD buys you roughly $1.38 CAD of engineering output, and the unit economics of building in Canada are hard to argue against.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Contrarian Bet
&lt;/h2&gt;

&lt;p&gt;I know what the counterarguments are. The US healthcare market is 10x larger. US VCs have deeper pockets. The FDA approval pathway, despite its flaws, is a known quantity.&lt;/p&gt;

&lt;p&gt;All true. And all beside the point if you're building voice AI, conversational agents, patient-facing automation, or ambient clinical intelligence — the categories that are actually growing fastest. For these products, the regulatory clarity, talent economics, and compliance infrastructure in Canada aren't just "comparable" to the US. They're better.&lt;/p&gt;

&lt;p&gt;The US is heading toward a patchwork of state-level AI regulations. California, Colorado, and Illinois already have divergent frameworks. HIPAA wasn't designed for AI and hasn't been meaningfully updated. The FDA is doing innovative work with agentic AI reviews, but that's for medical devices — not for the voice agent that answers your clinic's phones.&lt;/p&gt;

&lt;p&gt;Canada has a single federal privacy framework, provincial health information acts that are consistent in their principles, a regulatory gap that gives startups room to build without premature compliance burden, and a talent pool that keeps getting deeper.&lt;/p&gt;

&lt;p&gt;We're not the only ones who've noticed. The healthtech founder I mentioned at the top? He told me his Toronto team shipped their MVP three months faster than his US team had projected, at 40% of the budget. That's not a fluke. That's the structural advantage of building where the fundamentals align.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key Takeaways
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;PIPEDA's principles-based approach works better for AI than HIPAA's entity-based model.&lt;/strong&gt; If you're building any healthcare AI product that isn't a traditional medical device, Canada's regulatory framework gives you clearer guardrails with less ambiguity.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;The talent economics are unbeatable.&lt;/strong&gt; Toronto's 285,000+ tech workers, 30-40% cost savings, and two-week visa processing make it the most capital-efficient place in North America to build an AI team.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Canadian data residency is a moat, not a limitation.&lt;/strong&gt; As cross-border data transfer requirements tighten globally, being Canadian-first means you're already compliant where others are scrambling.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;SR&amp;amp;ED extends your runway by 20-30%.&lt;/strong&gt; No other G7 country offers R&amp;amp;D tax credits this generous for early-stage AI companies.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;The dental and healthcare AI market is moving now.&lt;/strong&gt; The CDA made AI its 2026 theme. Clinics are buying. The competitive window is open but closing.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;




&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://www.autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
    <item>
      <title>We're Open Sourcing Our Voice AI Latency Benchmarking Tool</title>
      <dc:creator>Autor Technologies Inc.</dc:creator>
      <pubDate>Wed, 03 Jun 2026 21:56:41 +0000</pubDate>
      <link>https://dev.to/autor_tech/were-open-sourcing-our-voice-ai-latency-benchmarking-tool-3oa8</link>
      <guid>https://dev.to/autor_tech/were-open-sourcing-our-voice-ai-latency-benchmarking-tool-3oa8</guid>
      <description>&lt;p&gt;Last month, a 340ms spike in our TTS pipeline caused 12% of Loquent callers to talk over the AI mid-response. We didn't catch it for six hours because we were measuring the wrong thing — average latency instead of tail latency at each pipeline stage. That incident is why we built &lt;code&gt;vox-bench&lt;/code&gt;, and why we're releasing it today.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why we needed this
&lt;/h2&gt;

&lt;p&gt;When you're building a voice AI agent that handles thousands of live phone calls per month — dental appointment bookings, patient intake, after-hours triage — latency isn't a nice-to-have metric. It's the difference between a conversation that feels human and one that feels like talking to a broken IVR.&lt;/p&gt;

&lt;p&gt;Our Loquent pipeline has five stages: Twilio media stream ingestion, speech-to-text via Deepgram, LLM inference via Anthropic Claude (with OpenAI as fallback), text-to-speech via ElevenLabs, and audio streaming back through Twilio. Each stage adds time. The total round-trip — from the moment a caller stops speaking to the moment they hear the AI respond — needs to stay under 800ms to feel natural. Go above 1.2 seconds and callers start repeating themselves. Go above 1.8 seconds and they hang up.&lt;/p&gt;

&lt;p&gt;We know these numbers because we tracked them across 10,000+ calls over six months of running Loquent in production. But for the first four months, we were tracking them wrong.&lt;/p&gt;

&lt;h2&gt;
  
  
  What we were doing wrong
&lt;/h2&gt;

&lt;p&gt;Our original monitoring was simple: we logged a timestamp when audio came in from Twilio and another when we sent audio back. Total round-trip time. One number. And for a while, it looked great — averaging around 650ms.&lt;/p&gt;

&lt;p&gt;The problem was that average told us almost nothing. When our ElevenLabs latency spiked from 120ms p50 to 340ms p95 during a provider-side deployment, our total average barely moved — from 650ms to 710ms. Still "fine" by our alerting thresholds. But 12% of calls were hitting 1.4+ second response times, and those callers were already talking again before the AI responded. The result was conversational chaos — interrupted responses, repeated questions, callers saying "hello? are you there?"&lt;/p&gt;

&lt;p&gt;We needed per-stage, per-percentile latency tracking. Nothing we found did exactly what we needed.&lt;/p&gt;

&lt;h2&gt;
  
  
  What exists today (and why it wasn't enough)
&lt;/h2&gt;

&lt;p&gt;We evaluated several options before building our own:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Generic APM tools&lt;/strong&gt; (Datadog, New Relic) — great for HTTP request latency, but they don't understand voice AI pipeline stages. You can instrument custom spans, but you're building the domain model yourself. We tried this with Datadog for two months. The dashboard became a wall of custom metrics that nobody on the team could parse quickly.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Provider-specific dashboards&lt;/strong&gt; — Deepgram and ElevenLabs both have latency metrics in their dashboards, but they only show their own stage. You can't correlate a Deepgram STT spike with downstream effects on total response time. And they measure from their side — not from your server's perspective, which includes network transit.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Load testing tools&lt;/strong&gt; (k6, Locust) — designed for HTTP endpoints, not real-time WebSocket audio streams. You can hack them into shape, but simulating realistic voice conversation patterns (variable utterance lengths, interruptions, silence gaps) is a project in itself.&lt;/p&gt;

&lt;p&gt;We needed something purpose-built for voice AI pipelines. So we built it.&lt;/p&gt;

&lt;h2&gt;
  
  
  How vox-bench works
&lt;/h2&gt;

&lt;p&gt;&lt;code&gt;vox-bench&lt;/code&gt; is a TypeScript CLI tool that benchmarks each stage of a voice AI pipeline independently and in combination. Here's what it does:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Per-stage benchmarking.&lt;/strong&gt; Point it at your STT provider, your LLM, and your TTS provider. It sends realistic audio samples (we include a corpus of 200 healthcare-domain utterances of varying lengths) and measures latency at each stage independently. You get p50, p95, p99, and max for each provider.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Pipeline simulation.&lt;/strong&gt; Chain your stages together and &lt;code&gt;vox-bench&lt;/code&gt; simulates full conversational round-trips. It measures total time-to-first-byte (TTFB) and time-to-complete, broken down by stage. This is where you catch the compounding effects — a 50ms STT increase plus a 80ms LLM increase that pushes your total over the threshold.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Provider comparison.&lt;/strong&gt; Run the same benchmark against multiple providers simultaneously. We built this because we needed to evaluate whether switching from Deepgram Nova-2 to Nova-3 would actually reduce our p95 STT latency in practice (it did — by 35ms on average for our healthcare utterances, but increased p99 by 12ms on longer sentences). You configure providers in a YAML file and &lt;code&gt;vox-bench&lt;/code&gt; runs them head-to-head.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Regression detection.&lt;/strong&gt; Run &lt;code&gt;vox-bench&lt;/code&gt; on a schedule (we use a GitHub Action that runs every 6 hours) and it compares results against your baseline. If any stage's p95 moves more than your configured threshold, it fires an alert. This is what would have caught the ElevenLabs spike that burned us.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Conversation pattern simulation.&lt;/strong&gt; Real calls aren't "send audio, get response, repeat." Callers interrupt. They pause mid-sentence. They say "um" for three seconds. &lt;code&gt;vox-bench&lt;/code&gt; includes conversation profiles — &lt;code&gt;healthcare-intake&lt;/code&gt;, &lt;code&gt;appointment-booking&lt;/code&gt;, &lt;code&gt;general-inquiry&lt;/code&gt; — that model realistic interaction patterns we extracted from our Loquent call data.&lt;/p&gt;

&lt;h2&gt;
  
  
  What our benchmarks actually show
&lt;/h2&gt;

&lt;p&gt;We've been running &lt;code&gt;vox-bench&lt;/code&gt; internally for two months. Here's what the data looks like across our current production stack:&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Deepgram Nova-3 STT:&lt;/strong&gt; p50 = 180ms, p95 = 245ms, p99 = 310ms. The variance is almost entirely driven by utterance length. Anything under 3 seconds of audio processes fast. Once you cross 6-7 seconds (a full sentence describing symptoms, for example), latency jumps. Our takeaway: design your prompts to encourage shorter caller responses when possible.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Anthropic Claude (Haiku) LLM:&lt;/strong&gt; p50 = 210ms TTFB, p95 = 340ms, p99 = 480ms. This is streaming — we start sending to TTS as soon as the first tokens arrive. We tested Claude Sonnet too: p50 = 380ms TTFB, p95 = 620ms. For voice, Haiku wins. The quality difference between Haiku and Sonnet for our use cases (appointment scheduling, FAQ answers, intake questions) is negligible, but the latency difference is enormous.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;ElevenLabs TTS:&lt;/strong&gt; p50 = 130ms, p95 = 220ms, p99 = 350ms. The most variable stage in our pipeline. We've seen p99 hit 600ms during what we assume are provider-side capacity issues, always between 2-4pm ET. &lt;code&gt;vox-bench&lt;/code&gt; caught this pattern within a week of deployment.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Total pipeline (end-to-end):&lt;/strong&gt; p50 = 620ms, p95 = 890ms, p99 = 1,150ms. Our p99 is above the 800ms "feels natural" threshold, but below the 1.2 second "callers repeat themselves" line. We're okay with that tradeoff — optimizing p99 below 800ms would require either pre-generating responses (quality hit) or switching to a faster but lower-quality TTS (quality hit). For now, 5-6% of responses feeling slightly delayed is acceptable.&lt;/p&gt;

&lt;h2&gt;
  
  
  The architecture
&lt;/h2&gt;

&lt;p&gt;&lt;code&gt;vox-bench&lt;/code&gt; is built with TypeScript (Node.js 20+). We chose TypeScript because our entire Loquent backend is TypeScript/NestJS, and we wanted the team to be able to extend the tool without context-switching languages.&lt;/p&gt;

&lt;p&gt;Key components: a provider adapter layer (currently supports Deepgram, OpenAI Whisper, Anthropic Claude, OpenAI GPT, ElevenLabs, and Google Cloud TTS), a pipeline orchestrator that chains stages with proper streaming, a statistics engine that computes percentiles using the t-digest algorithm (accurate percentiles without storing every measurement), and a reporter that outputs results as JSON, Markdown tables, or sends them to your monitoring system via webhooks.&lt;/p&gt;

&lt;p&gt;The whole thing is about 3,200 lines of TypeScript. No magic.&lt;/p&gt;

&lt;h2&gt;
  
  
  Key findings
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;TTS is your most variable stage.&lt;/strong&gt; STT and LLM latency are relatively predictable. TTS providers show the most variance, and the variance is time-of-day dependent. Benchmark at different times or you'll get misleading numbers.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Average latency is a useless metric for voice AI.&lt;/strong&gt; Your p95 and p99 determine caller experience. A 650ms average can hide a 1.4 second p99 that makes 5% of your conversations feel broken.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Streaming changes everything.&lt;/strong&gt; Without streaming (waiting for complete LLM response before sending to TTS), our p50 total would be 1,100ms+. With streaming, it's 620ms. If your voice AI pipeline isn't streaming at every stage, fix that before optimizing anything else.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Provider latency varies by content domain.&lt;/strong&gt; Our healthcare utterances benchmark 15-20% slower on STT than general conversation because of medical terminology. Always benchmark with domain-representative audio, not generic test phrases.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Schedule your benchmarks.&lt;/strong&gt; Provider performance isn't static. Run benchmarks on a cadence and track trends. The regression detection in &lt;code&gt;vox-bench&lt;/code&gt; has caught three provider-side degradations that our application monitoring missed.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Where to find it
&lt;/h2&gt;

&lt;p&gt;The repo is at &lt;a href="https://github.com/Autor-Technologies/vox-bench" rel="noopener noreferrer"&gt;github.com/Autor-Technologies/vox-bench&lt;/a&gt;. MIT licensed. The README has quickstart instructions — you can be running benchmarks against your own providers in under five minutes if you have API keys ready.&lt;/p&gt;

&lt;p&gt;We included our healthcare conversation profiles and audio corpus. If you're building voice AI for a different domain, you can create your own profiles — the format is documented and there's a generator script that builds profiles from your own call recordings.&lt;/p&gt;

&lt;p&gt;We're actively using this internally. If you find bugs or want to add a provider adapter, PRs are welcome. If you're building voice AI and want to talk latency optimization, we've probably hit the same walls you're hitting.&lt;/p&gt;

&lt;p&gt;If you're building something similar, we'd love to hear about it. Reach out at &lt;a href="mailto:hello@autor.ca"&gt;hello@autor.ca&lt;/a&gt; or visit &lt;a href="https://www.autor.ca" rel="noopener noreferrer"&gt;autor.ca&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>machinelearning</category>
      <category>typescript</category>
    </item>
  </channel>
</rss>
