Unaided, Sonnet named 10 of 16 planted flaws in x402 listings and Haiku 6. Most misses were facts about the catalog and the buyer client.
Partly. Two Claude models, Sonnet and Haiku, reviewed 23 short x402 listings, scripts and plans, 16 of them hiding a planted flaw. On their own, Sonnet named 10 of the 16 in some words (9 on a strict reading) and Haiku named 6. Most misses were facts about how the catalog and the buyer client behave, and careful reading of a pasted snippet cannot reveal such a fact. Once the skill's text joined the instructions, both models named all 16.
Read the full report on AISkills402: https://aiskills402.com/blog/x402-listing-what-models-miss?utm_source=devto&utm_medium=social
Top comments (0)