The first step was simple: a local model, a gateway in front of it, a web UI on top. It worked within an evening.
Then I looked at it soberly and found four things, each of which made "it works" untrue:
— the gateway answered 200 to a request with no key at all;
— I was starting the runtime by hand, and after a reboot it did not come back;
— the images sat on floating tags, so the next pull could break everything silently;
— none of this lived in Git.
The conclusion became a rule for me: whatever is started by hand and not written down as a script or config is considered non-existent. Not "should be tidied up someday", non-existent. Otherwise moving to another machine turns into archaeology from memory.
Fixed: autostart through launchd, keys on every entrance, image versions pinned, everything under Git.
Top comments (0)