Sometimes, to move forward, you’ve got to throw everything out and rebuild from scratch. So that’s exactly what I did.
Tore the old qAPIx infrastructure apart, dumped the junk (frontend_old, you won't be missed), and carefully moved the living pieces — main.py, routers.py — into a clean new backend.
Found a couple of monsters: double app = FastAPI, redundant APIRouter()s — tamed and refactored them.
Launched docker-compose from scratch — no hacks, no ghost volumes. Got Mistral running locally, tunneled through ngrok, and finally — POST /chat worked across the entire stack.
Tested everything: Swagger → FastAPI → local Mistral → response. It flies (well... 3 minutes per reply isn’t exactly lightning, but it works).
Result:
qAPIx is alive.
The full chain GCP → ngrok → laptop → FastAPI → model is running like clockwork.
The project is ready to move forward. So am I.
Top comments (0)