Building an AI Phone Answering System for Accounting Firms

I've been working on the problem of automated phone answering for professional services, and accounting firms turned out to be a fascinating use case.

The Problem

During tax season (Jan–April), accounting firms get slammed with calls. Staff are buried in returns. Calls go to voicemail. 67% of new clients choose whichever firm answers first. That's a massive revenue leak.

The Technical Approach

A modern AI receptionist needs to handle:

1. Speech-to-text with domain-specific vocabulary (PAYE, VAT returns, self-assessment, etc.)
2. Intent classification — is this a new enquiry, an existing client follow-up, or a "what documents do I need?" FAQ?
3. Calendar integration — real-time slot availability for booking consultations
4. Call routing logic — urgent items go to a human, everything else is handled autonomously
5. Multilingual support — relevant for firms serving immigrant communities

What Surprised Me

The hardest part wasn't the AI — it was the call flow design. Accountants have very specific intake processes. The AI needs to gather:

• Business type (sole trader, Ltd, partnership)
• Revenue bracket (affects service tier)
• Filing urgency (deadline in 2 days vs. next quarter)
• Existing accountant situation (switching or first-time)

Getting this wrong means wasted time for the accountant on the follow-up call. Getting it right means they sit down with a qualified, pre-screened lead.

Results

Firms using AI phone answering during tax season typically see:

• 100% answer rate (vs. ~60% with human-only reception)
• 40-50% reduction in time spent on initial client screening
• 3-5x ROI within the first busy season

Stack

If you're building something similar: the key is combining a solid telephony layer (SIP/WebRTC) with an LLM that has strong function-calling capabilities for the calendar/CRM integrations.

VoiceFleet is one platform tackling this — full disclosure, I work on it. But the pattern applies regardless of provider.

What's your experience with AI in professional services? Would love to hear other approaches.