Asked to write Bulgarian names in Latin letters, Claude blended several spelling systems. We checked every answer letter by letter against the official table.
Because more than one Latin system for Bulgarian is in use, and a model blends them unless it is told which one counts. Bulgaria's Transliteration Act of 2009 fixes a single table, yet older habits keep showing up in model answers: Mariya where the law writes Maria, the accented letters of the scholarly system, the Russian shch. We gave Claude 24 short Bulgarian texts and compared each answer, letter by letter, with the official Latin spelling. Claude Sonnet got 15 right on its own and all 24 once the rules were written out for it; Claude Haiku went from 11 to 18.
Read the full report on AISkills402: https://aiskills402.com/blog/llm-bulgarian-transliteration-mixes-systems
Top comments (0)