We asked Claude Sonnet and Haiku to humanize one text in five languages. Without rules, all ten answers lost the word usually, and some invented facts.
Not reliably, if all you send is the request. Claude Sonnet and Claude Haiku each received one short piece of AI-sounding text in five languages, with nothing more than the line "Humanize this text." In all ten of them the word "usually" was gone, so a meeting the company usually holds once a year turned into one it always holds. Sonnet's answers stated facts the input never gave, and Haiku's added motives nobody had claimed and came back in English for three of the four non-English texts. Once the same models had our rules for this task loaded as a skill, all ten answers kept that qualifier, stayed in the original language and returned nothing but the rewrite, though both models still cut…
Read the full report on AISkills402: https://aiskills402.com/blog/llm-humanize-drops-usually
Top comments (0)