We had Claude cut texts to a limit and turn spec sheets into shop copy. Bare, it overran limits and added praise; with rules, it lost facts or broke a count.
It gives up one of them, and nothing in the answer tells you which. We asked Claude Sonnet to cut 23 short texts down to a stated number of words or characters, and to turn 24 product spec sheets into shop copy with fixed counts: a title, a short text, three to five bullets. Given only the request, Sonnet kept the facts and broke the length limit: nine of its shortened texts ran past it. With a written set of rules loaded, it never ran over, but five shortened texts lost a date or a figure, and two product answers ran to six bullets where five was the cap. The invented praise you might expect from a model writing shop copy did disappear: on the bare request, 19 of its 24 product texts…
Read the full report on AISkills402: https://aiskills402.com/blog/llm-length-limit-or-facts
Top comments (0)