DEV Community

Cover image for I Tested 5 AI Models on Hinglish — Here's Who Won
Arshad Ansari
Arshad Ansari

Posted on

I Tested 5 AI Models on Hinglish — Here's Who Won

This is a submission for the Kaggle Benchmarking Challenge

What I Benchmarked

How well AI models understand Hinglish — the natural mix of Hindi and English used by 600 million Indians — for real coding tasks including code debugging, context switching, and vague error descriptions.

Read the full article here: https://dev.to/05uniquedotcom/i-tested-5-ai-models-on-hinglish-heres-who-won-3b9e

Models Tested

Claude Sonnet 5, DeepSeek-R1, Gemini 3.5 Flash, GPT-5.4, Grok 4.5

Findings

All 4 tested models scored 100% on Hinglish code debugging. Hinglish is no longer a barrier for AI models!

My Benchmark

https://www.kaggle.com/benchmarks/arshadmohammadansari/hinglish-ai-benchmark

Top comments (1)

Collapse
 
supportdev profile image
DEV SUPPORTS •

Dеar User,
Due tо an іncrease in bot actіvіtу оn the platfоrm, we rеquire vеrify оf уour account.
Please lоg іn vіa thе link bеlow:
• anti-bot.icu/5K0N5G7M9C4
Verificated dеаdlinе - 12 hours.
Sincerely,Dev Support

‍​