DEV Community

Cover image for Fluid, natural voice translation with Gemini 3.5 Live Translate
Gemini Team for Google AI

Posted on • Originally published at blog.google

Fluid, natural voice translation with Gemini 3.5 Live Translate

Twenty years ago, translation at Google began as one of our pioneering machine learning experiments to turn the science of language into the magic of human connection. That experiment has come a long way with over a trillion words being translated for billions of users across our products every month.

We’re taking our next step with the release of Gemini 3.5 Live Translate, our latest audio model for live speech-to-speech translation.

The model automatically detects 70+ languages and generates smooth, natural-sounding translated speech that preserves the speakers' intonation, pacing and pitch. Unlike turn by turn systems that wait for the speaker to finish speaking before responding, 3.5 Live Translate generates speech continuously, balancing the trade-off between waiting for context to improve quality and translating immediately to stay in sync with the speaker. It delivers fluid audio without awkward pauses and stays just a few seconds behind the speaker throughout the session.

Gemini 3.5 Live Translate is rolling out across Google products:

Build with 3.5 Live Translate

Gemini 3.5 Live Translate processes speech as it’s streamed, enabling a more seamless connection across languages. The model handles multilingual inputs without the need to manually configure settings. At the same time, its noise robustness ensures applications can handle loud, unpredictable environments. You can use its capabilities to help facilitate live interpretation for multilingual calls, meetings, lessons, broadcasts and more.

Watch the Gemini Live API in action, enabling dubbing and simultaneous multi-language translation. Dive into the demo or more example code in the Gemini Cookbook.

By utilizing the Gemini Live API, developer platforms like Agora, Fishjam, LiveKit, Pipecat, and Vision Agents enable developers to build and deploy voice translation apps with ease. These integrations handle the complex real-time media streaming infrastructure, so developers can focus on the user experience.

Our partners at Grab are testing the model to enable multilingual communication in near real-time between drivers and travelers at pickups. These users make over 10 million voice calls per month through Grab.
 

See how Grab has been testing 3.5 Live Translate to transform communication between users.

 

Read the early reviews

In addition to Grab, companies like CJ ENM, LiveKit and others have shared positive feedback on 3.5 Live Translate highlighting its impressive translation quality, accuracy and low latency:


"While testing Gemini 3.5 Live Translate, we’ve valued its ability to auto-detect multiple languages and translate speech accurately with low latency."
Philipp Kandal
Chief Product Office at Grab

"CJ ENM is excited to partner with Google DeepMind on 3.5 Live Translate. Early tests show promising quality for a more authentic experience for global & Korean viewers."
Bella Baek
Chief AI Officer at CJ ENM

"Gemini 3.5 Live Translate makes multilingual voice effortless. I built a demo on LiveKit Agents where everyone speaks their own language and understands each other live."
Jesse Hall
Staff Developer Advocate at LiveKit

"During our time with the 3.5 Live Translate model, we tested across several languages, and our team was blown away by the speed, accuracy, and liveliness of the model."
Nash Ramdial
Director at Vision Agents

"Gemini 3.5 Live Translate paired with Fishjam’s MoQ protocol sets a new frontier for real-time multimedia streaming, allowing speech-to-speech translation into over 70 languages."
Maciej Rys
VP of Engineering at Software Mansion

"We tested the Gemini 3.5 Live Translate model at Agora and in our opinion it provided SOTA results, with low latency and high accuracy that set a new bar for real-time translation."
Mason Adams
Developer Evangelist at Agora

Experience 3.5 Live Translate in your video meetings

Speech translation in Google Meet will soon use 3.5 Live Translate, improving the experience by:

  • Offering 70+ languages, an improvement from the previous limit of just five languages,
  • Enabling conversations across over 2000+ language combinations in one meeting, expanding from the previous state of only translating to and from English,
  • Updating the interface to provide instant access to speech translation.

We’re launching this update in private preview for select business Google Workspace customers starting this month, followed by a broader rollout later this year.
 

Google Meet participants use speech translation to communicate across English, Mandarin, and Swedish.

 

Get 3.5 Live Translate in the Google Translate app on Android or iOS

The model is also rolling out on the Google Translate app globally, on both Android and iOS. When using the Live translate feature, simply connect any pair of headphones to experience a more seamless translation that mirrors the speaker’s tone across 70+ languages.

For Android users, we’re also starting to roll out a new ‘listening mode’ with 3.5 Live Translate that lets you hear translations directly through your phone’s earpiece. Simply hold your phone to your ear just like a regular call, and the translated audio streams straight to you. This new experience can be helpful in situations where you want to quickly hear translations without others hearing, and you don’t have your headphones handy.
 

Using the new listening mode, users can hear a near real-time English translation of a guided tour in Spanish directly through their phone's earpiece.

 

Watermarked with SynthID

All audio generated by our models is watermarked with SynthID. This imperceptible watermark is woven directly into the audio output, ensuring AI-generated content remains detectable to help prevent misinformation. For details on our approach to safety and responsibility, review the model card.

Top comments (0)