AI Translation Gets Visual

#webdev #ai #react #coding

We've all been there: your AI translator suggests "Delete File" when your users expect "Remove File."

Why does it happen? Lack of context!

Tolgee found a way to improve this!

Translation tools process strings in isolation, missing crucial visual and situational cues that make translations feel natural.

The Context Problem

AI translation has gained popularity because it sounds more natural than traditional tools like DeepL, but it is still bad without proper context.

Visual Context

Tolgee's new AI Playground introduces screenshot-based translation. We think that it is gonna be a crucial tool. Here is why we added it and how it is better than regular translation engines:

Here's how it works:

No-Prompt Solution

Simply click "Customize" in the Machine translation menu. The AI playground lets you toggle context elements:

Project descriptions
Key descriptions
Language notes
Screenshots for visual context

Screenshots provide AI with crucial information about user interfaces, ensuring translations fit the actual context where they'll appear.

You can even assign specific prompts to different languages - perfect for handling regional dialects like Latin American Spanish vs. Iberian Spanish.

Testing Your Setup

Before committing to full translation runs, you can:

Batch preview: Test on filtered keys
Dataset preview: Tag specific keys with ai-playground for targeted testing

Conclusion

Visual context through screenshots transforms AI translation into a precise localization tool. While screenshots increase processing time and costs, the accuracy gains make it worthwhile for critical translations.