Five hard code reviews for Claude Sonnet and Haiku. Sonnet caught every planted bug; Haiku waved through a sync job that loses rows and praised it.
The strong model did; the small one mostly did, and its one miss is the kind that costs data quietly. We handed Claude Sonnet and Claude Haiku five short changes, each hiding a problem a senior engineer would stop, with no instructions beyond "review this change". Sonnet named every planted problem. Haiku named four. On the fifth, a sync job that throws away rows it failed to save, Haiku not only missed the loss but described the faulty behaviour as a safe default.
Read the full report on AISkills402: https://aiskills402.com/blog/llm-code-review-safe-default
Top comments (0)