Why I Stopped Overpaying for AI APIs (And Built a Gateway to Chinese Models Instead)

#webdev

Last month, a friend showed me his AI API bill. It was shocking.

He was paying hundreds of dollars every month just to access GPT-4, Claude, and other Western AI models for his startup. As a solo developer, that was eating up most of his budget.

"There's got to be a better way," he said.

There wasn't. So we built one.

The Problem Nobody Talks About

Western AI APIs are expensive. And if you're building in Asia or serving Asian markets, you're paying premium prices for models that weren't even optimized for your use case.

Meanwhile, Chinese AI companies like DeepSeek, Zhipu AI, and Moonshot AI were building incredibly capable models at a fraction of the cost. The problem? No easy way to access them.

Documentation in Chinese
Payment methods that don't work internationally
No standardized API format
Complex authentication flows

What We Built

NovAI is an open-source API gateway that solves this:

One API format - Use the familiar OpenAI-compatible interface
Access to Chinese models - DeepSeek, GLM-4, Moonshot, and more
Significant cost savings - Often 60-80% cheaper than Western alternatives
Simple authentication - Just an API key, no complex setup

Here's how simple it is:

import openai

client = openai.OpenAI(
    api_key="your-novai-key",
    base_url="https://aiapi-pro.com/v1"
)

response = client.chat.completions.create(
    model="deepseek-chat",
    messages=[{"role": "user", "content": "Hello!"}]
)

That's it. No new SDK to learn. Just change the base URL and start saving.

Real Results

My friend? His monthly AI costs dropped by over 80%. He's now running his entire AI infrastructure on Chinese models through our gateway, and his users can't tell the difference.

The models are that good.