DEV Community

Nathan C.
Nathan C.

Posted on

Two hotfixes in one day

This morning I shipped Flash 0.5.6. A hotfix.

By the evening I shipped 0.5.7. Also a hotfix.

What broke

Flash kept forgetting what it said two messages ago.

The model was fine. The math wasn't. Flash reserved room for the model's reply, and on my setup that reservation was the entire context window. The conversation got whatever was left: about two messages.

The fix

  • The reply gets a quarter of the window, max.
  • Your last three exchanges always stay word for word.
  • Old tool output shrinks before anything else is dropped.
  • Summarizing is now off by default.

The history budget on my machine went from 1,024 tokens to about 114,000. One line of math.

While I was in there

  • A rewritten system prompt: reread the conversation, check before guessing, verify before saying done.
  • Update Flash from the browser, with a restart that keeps you signed in.
  • Flash can send HTML pages now, sandboxed in the web UI.

The lesson

Ship small. When it breaks, ship again. Same day is fine.

curl -fsSL https://raw.githubusercontent.com/Natuworkguy/Flash/main/install.sh | bash
Enter fullscreen mode Exit fullscreen mode

Release notes: https://github.com/Natuworkguy/Flash/releases/tag/v0.5.7

Top comments (0)