DEV Community

Cover image for What a model gets wrong writing a job post from notes
Georgi Kalchev
Georgi Kalchev

Posted on Originally published at aiskills402.com

What a model gets wrong writing a job post from notes

Sonnet wrote 16 of 23 job posts right alone, Haiku 15. With a skill, 21 and 20, though two Sonnet posts that passed alone then failed.

Not reliably. We ran Claude Sonnet and Claude Haiku over 23 sets of scrappy hiring notes, asking each for a job post with seven fixed sections. Left alone, Sonnet produced 16 posts that passed our checks and Haiku 15. The misses were rarely bad prose. A model obeyed an order hidden in the notes, kept age-flavoured wording, or answered in a language nobody asked for. With the skill's text added, the counts rose to 21 and 20, yet two of Sonnet's passes turned into fails.

Read the full report on AISkills402: https://aiskills402.com/blog/ai-job-post-from-hiring-notes?utm_source=devto&utm_medium=social

Top comments (0)