DEV Community

Cover image for Speech to text
Mateus Sobral
Mateus Sobral

Posted on

Speech to text

This is a submission for the AssemblyAI Challenge : Sophisticated Speech-to-Text.

What I Built

I built a web app to streamline audio-to-text transcription. Users can submit audio URLs, which the app then transcribes into text. The transcribed text is displayed alongside the original audio, allowing users to follow along word-by-word as the audio plays. Users can also click on any word in the transcription, and it will sync with the corresponding part of the audio. In addition, the app includes sentiment analysis, content safety labels to identify potentially sensitive or inappropriate material, and the confidence level of each transcribed word.

Demo

App Demo

Source Code

Image description

Image description

Journey

The web app uses AssemblyAI’s Universal-2 Speech-to-Text Model to transcribe audio into text. When a user submits an audio URL, the app sends it to AssemblyAI via their API. Once the transcription is complete, the web app utilizes all the data returned by AssemblyAI, including the transcribed text, confidence levels for each word, sentiment analysis, content moderation labels, summarization, speaker diarization, and word timestamps, to synchronize with the audio file and provide users with an accurate and insightful transcription experience.

Image of Timescale

🚀 pgai Vectorizer: SQLAlchemy and LiteLLM Make Vector Search Simple

We built pgai Vectorizer to simplify embedding management for AI applications—without needing a separate database or complex infrastructure. Since launch, developers have created over 3,000 vectorizers on Timescale Cloud, with many more self-hosted.

Read more

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay