One of our sites read 561 million rows on a 48 MB database. We handed the pre-fix code to Sonnet and Haiku and scored them against the six real causes.
Yes, if the model is a strong one and gets the whole code at once. Claude Sonnet named five of the six causes we found by hand in July, with or without our bill-spike-finder skill. Claude Haiku named three without the skill and fewer with it. That does not match what the owner of the site remembers, so this report also says why the two experiences may differ.
Read the full report on AISkills402: https://aiskills402.com/blog/llm-561-million-rows
Top comments (0)