DEV Community

Cover image for Simplify Phone Screening with Twilio and AI Automation
Bibek
Bibek

Posted on

Simplify Phone Screening with Twilio and AI Automation

This is a submission for the Twilio Challenge

What I Built

I explored several ideas for this challenge and did some research. Then, I found a LinkedIn post about how recruiters handle phone interviews for screening and the problems they face, like coordinating schedules between recruiters and candidates. Often, these calls are unplanned for the candidates, causing nervousness and a poor first impression. This inspired me to create a product that automates the process using IVR to conduct phone interviews for screening. The product would evaluate the call recordings and provide a summary of the entire conversation to the recruiter.

Flow of the system:

  • The recruiter will enter the candidate's details into the system through a form.
  • The candidate will receive an SMS notification with a link included in the message.
  • When the candidate clicks the link, the system will automatically dial their phone number.
  • An IVR call will guide the candidate through the interview and ask the necessary questions.
  • The candidate's responses will be recorded and transcribed by the system. AI will then use the transcription to provide context for the call recording.

Future Scopes/Improvements:

  • Develop a comprehensive multi-tenant dashboard for recruiters to manage records efficiently.
  • Integrate the system with job boards for seamless operation.
  • Implement an AI model to evaluate candidates' responses and rank them based on job requirements.

Demo

Walkthrough video

Demo application link

Github link
https://github.com/bibekkakati/ai-interview-call

Twilio and AI

Let's discuss how I used Twilio and AI in the project.

  • Twilio Verify is used to validate the candidate's phone number and provide an internationally formatted result.
  • Twilio Programmable Messaging is used to send an SMS to the candidate with the interview call link.
  • Twilio Voice is used to make a call to the candidate, gather information, and record the candidate's responses.
  • Twilio Voice Intelligence is used to transcribe the call recordings.
  • Gemini AI is used to extract key points from the candidate's responses (transcriptions).
  • Twilio Serverless functions are used to deploy the functions and assets (a form to capture candidate details).

Additional Prize Categories

My submission qualifies for the following additional prize categories:

  • Twilio Times Two: Multiple Twilio features are used in the project.

  • Impactful Innovators: This product will greatly help recruiters and companies manage their time and resources better.

Top comments (4)

Collapse
 
bablishil profile image
Babli Shil

This is great Bibek, this is an essential part of our recruitment journey and this can save tons of money and time for HR firms, I used to do all this process manually as a fresher in my career. This process was time-consuming and tiresome, sometimes the candidates were not even available at the given time. This can automate this process easily. Keep up the good work.

Collapse
 
bibekkakati profile image
Bibek

Glad you liked it.

Collapse
 
nkuku99 profile image
Rowan

The given try out url isn't working, and why does the demo video looks like it's manipulated one (using a ai generated voice)>

Collapse
 
bibekkakati profile image
Bibek

Hey, you will not get a call because I am on test account, only manually added verified numbers works in test account.

And, recording is not AI generated. I wrote the content and converted the text to speech.