DEV Community

Cover image for LLM config repair: the syntax holds, the values move
Georgi Kalchev
Georgi Kalchev

Posted on Originally published at aiskills402.com

LLM config repair: the syntax holds, the values move

Claude Sonnet fixed every broken quote, tab and bracket in our .env, TOML and YAML files. Its misses were files that load and say something else.

The syntax, yes. The values, not reliably. We had two Claude models, Sonnet and Haiku, repair three sets of small config files: 24 in .env or INI form, 22 in TOML and 22 in YAML. Given only the request, Sonnet closed every quote left open, replaced every tab and added every missing bracket, yet just 19, 17 and 16 of its files came back right, and nearly every wrong one loaded without an error. The harm was to meaning: a value given a new type, a prefix or a key name lost, two conflicting values cut down to one in silence. With written rules for each format added to the request, Sonnet got all of them right.

Read the full report on AISkills402: https://aiskills402.com/blog/llm-config-repair-env-toml-yaml

Top comments (0)