DEV Community

LaoWuuu
LaoWuuu

Posted on

One week of running my own AI gateway

There's a thread on HN today asking whether the stockmarket can swallow Anthropic, SpaceX, and OpenAI. Big money circling big names. Meanwhile I hit one week running a side-project AI gateway, and the contrast is something.

The first 48 hours were silent. I kept refreshing the dashboard. Nobody. Around 3am on day two a user registered and immediately tested Claude. Complained about latency. I switched upstreams and it worked. That was when it started to feel real.

My monitoring setup was the biggest headache. Fired 17 times in one night. Every alert was a Cloudflare hiccup, not an actual outage. Took a few rounds of retries and a cooldown before I could trust it.

Seven days in, twelve users. DeepSeek is the most requested model by miles. Nobody asked for GPT-4. Enough to rethink the whole model lineup.

Zero revenue. Working software that people chose. I'll take that for week one.

https://aiopencloud.xyz?utm_source=devto

Top comments (0)