Can AI Tell Who’s Who? New Study Tests Chatbots on Friends vs Lovers
Ever wondered if a chatbot can guess whether two people are friends or lovers just from a short conversation? Researchers created a fun test called SCRIPTS, using 1,000 movie dialogues in English and Korean, and asked popular AI models to read the chats and decide the relationship between the speakers.
The results are eye‑opening: while the latest AI tools score about 75‑80% on English scenes, they stumble in Korean, dropping to roughly 60%.
Even more surprising, the bots sometimes label clearly unlikely ties as “possible,” showing they still miss many social cues.
Think of it like a friend trying to guess a romance plot after hearing only a few lines – they might get the gist in their own language but get confused with a foreign script.
This breakthrough reminds us that AI still has a long way to go before it truly understands human connections.
As we chat more with smart assistants, making them socially aware will be key to smoother, more natural conversations.
🌟
Read article comprehensive review in Paperium.net:
Are they lovers or friends? Evaluating LLMs' Social Reasoning in English andKorean Dialogues
🤖 This analysis and review was primarily generated and structured by an AI . The content is provided for informational and quick-review purposes.
Top comments (0)