DEV Community

bolddeck
bolddeck

Posted on

I Tested Chinese AI Models Against GPT-4o and Got Shocked

Check this out: i Tested Chinese AI Models Against GPT-4o and Got Shocked

I'm three months out of coding bootcamp, and until last week I genuinely thought GPT-4o was the only game in town for serious AI work. My instructors mentioned "there are other models" exactly once, in a slide they spent maybe ten seconds on. So when a friend on Discord told me I was burning money on API calls, I figured I'd just check it out for an afternoon. That afternoon turned into three days of rabbit holes, and I'm writing this because I wish someone had shown me this stuff months ago.

Let me walk you through what I found, because honestly some of these numbers made me put my laptop down and stare at the wall for a minute.

The First Time I Heard About DeepSeek

I was debugging a Python script that summarized customer support tickets. My OpenAI bill was creeping toward $80 for the month, and I was only halfway through my project. A guy in a Discord channel I lurk in asked if I'd tried DeepSeek. I said "who?" — and he linked me to a pricing page that I genuinely thought was broken at first.

DeepSeek V4 Flash charges $0.18 per million input tokens and $0.25 per million output tokens. I had to read it three times. My GPT-4o charges? $2.50 input and $10.00 output. I pulled out my phone calculator and did the math on the spot. DeepSeek is literally 40 times cheaper for output. I had no idea. Forty. Times. Cheaper.

That single number is what kicked off my deep dive, and I want to share everything I learned because I think a lot of other bootcamp grads and self-taught devs are in the same boat I was.

The Pricing Chart That Ruined My Week

Once I went down the rabbit hole, I made a spreadsheet. I'm going to lay it all out here because I think seeing the numbers side by side is the only way this stuff really lands.

Model Where It's From Input $/M Output $/M
GPT-4o United States $2.50 $10.00
Claude 3.5 Sonnet United States $3.00 $15.00
Gemini 1.5 Pro United States $1.25 $5.00
GPT-4o-mini United States $0.15 $0.60
DeepSeek V4 Flash China $0.18 $0.25
Qwen3-32B China $0.18 $0.28
GLM-5 China $0.73 $1.92
Kimi K2.5 China $0.59 $3.00

Look at the bottom four rows. Look at them. Kimi K2.5 is the most expensive of the Chinese bunch and it still costs $3.00 per million output tokens — that's one-fifth of what Claude 3.5 Sonnet charges. And GLM-5 at $1.92 per million output? That's still less than half of what Gemini 1.5 Pro wants.

I sat there for a good five minutes just staring at my screen. My entire bootcamp budget for the month was less than what I'd been spending on a single weekend's worth of API experiments.

"But Are They Any Good?" — My Quality Investigation

OK so the obvious next question I had was: cheap is great, but is the output garbage? I spent a couple days running benchmarks and looking at community-aggregated scores. Here's what I found.

For general reasoning tasks (the kind of MMLU-style tests that measure how well a model handles a broad range of knowledge questions), the gap between top US and Chinese models is shockingly small:

Model Reasoning Score Output Price
GPT-4o 88.7 $10.00
Claude 3.5 Sonnet 89.0 $15.00
Kimi K2.5 87.0 $3.00
Qwen3.5-397B 87.5 $2.34
GLM-5 86.0 $1.92
DeepSeek V4 Flash 85.5 $0.25

Claude 3.5 Sonnet is the king at 89.0, but look at Kimi K2.5 at 87.0. You're giving up 2 points of reasoning for a fifth of the price. I was shocked. Like, genuinely taken aback. In bootcamp we were taught that GPT and Claude were these untouchable titans and everything else was "interesting but not production-ready." That framing felt outdated by the time I finished reading the benchmarks.

For code generation (HumanEval-style tests), the results actually flipped — Chinese models won or tied:

Model Code Score Output Price
Claude 3.5 Sonnet 93.0 $15.00
GPT-4o 92.5 $10.00
DeepSeek V4 Flash 92.0 $0.25
Qwen3-Coder-30B 91.5 $0.35
DeepSeek Coder 91.0 $0.25

I had no idea DeepSeek was this good at code. The fact that DeepSeek V4 Flash scored 92.0 on code generation while charging $0.25 per million output tokens — that's not even a fair fight. GPT-4o beats it by 0.5 points at 40 times the cost. That's like paying 40x more for half a point on a test.

Chinese Language Performance Blew My Mind

Here's something I didn't expect at all. Chinese models are obviously trained with way more Chinese-language data, so they should do well on Chinese benchmarks. But the gap is way bigger than I assumed:

Model C-Eval Score Output Price
GLM-5 91.0 $1.92
Kimi K2.5 90.5 $3.00
Qwen3-32B 89.0 $0.28
GPT-4o 88.5 $10.00
DeepSeek V4 Flash 88.0 $0.25

GPT-4o actually does respectably here at 88.5 — but Qwen3-32B beats it at 89.0 and costs $0.28 per million output. GLM-5 at 91.0 is genuinely impressive. If you ever build anything for Chinese-speaking users (or need to translate Chinese content), this is a massive deal.

Then I Hit the Wall — The Access Problem

OK so I'm sitting there with all this data thinking "great, I'll just switch to DeepSeek!" and then I went to actually sign up. That's when I found out the real catch.

To use DeepSeek, Qwen, GLM, or Kimi directly, you typically need:

  • A Chinese phone number for verification
  • WeChat Pay or Alipay for payment
  • Sometimes a Chinese ID

I have a US phone number, a Visa card, and a PayPal account. None of those help when the sign-up page literally asks for a Chinese mobile carrier code.

This is the dirty secret nobody talks about in those "China is winning the AI race" YouTube videos. The models are incredible and dirt cheap, but actually accessing them from outside China is a whole project. The pricing is the easy part. Getting through the door is the hard part.

I almost gave up here. I'm a junior dev, I don't have a Chinese bank account, I can't read the documentation that's mostly in Mandarin, and I'm not about to start setting up a VPN just to pay for an API.

The Thing That Saved Me: Global API

A more senior dev in the same Discord channel saw me complaining and sent me a link to global-apis.com. I had never heard of it before. Apparently it's a service that acts as a proxy layer — you get access to all these Chinese models through a normal OpenAI-compatible API endpoint, with regular PayPal/Visa payment and English docs.

The setup took me maybe fifteen minutes. Here's the Python code I ended up using for my summarization project:

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_GLOBAL_API_KEY",
    base_url="https://global-apis.com/v1"
)

response = client.chat.completions.create(
    model="deepseek-v4-flash",
    messages=[
        {"role": "system", "content": "You summarize customer support tickets."},
        {"role": "user", "content": "Customer says their order #4821 arrived damaged and they want a refund."}
    ],
    max_tokens=200
)

print(response.choices[0].message.content)
Enter fullscreen mode Exit fullscreen mode

That's it. That's literally the whole change. The base URL is https://global-apis.com/v1 and you use your existing OpenAI Python client. I almost couldn't believe it would work, but I ran a test prompt and got back a clean summary in about 800 milliseconds.

I also tested Qwen for a translation job I was doing on the side:

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_GLOBAL_API_KEY",
    base_url="https://global-apis.com/v1"
)

translation = client.chat.completions.create(
    model="qwen3-32b",
    messages=[
        {"role": "user", "content": "Translate this product description to Simplified Chinese, keep the marketing tone: 'Our new running shoes feature breathable mesh and responsive foam for all-day comfort.'" }
    ]
)

print(translation.choices[0].message.content)
print(f"Tokens used: {translation.usage.total_tokens}")
Enter fullscreen mode Exit fullscreen mode

Both worked on the first try. The Qwen translation was honestly better than what I'd gotten from GPT-4o the week before, and it cost me literal fractions of a cent.

Head-to-Head: How I'd Actually Choose Models Now

After a few days of testing, here's my honest take on picking between the major options. This is basically my personal cheat sheet that I keep open in a browser tab.

DeepSeek V4 Flash vs GPT-4o

For pure value, DeepSeek V4 Flash wins. It's $0.25 vs $10.00 per million output — that's 40x cheaper, no typo. Speed-wise V4 Flash actually clocks around 60 tokens per second compared to GPT-4o's 50, which surprised me. Both have 128K context windows. The catch? V4 Flash doesn't do image/vision inputs. If you're building something that needs to look at pictures, GPT-4o still has the edge. If it's text-only, I'm switching to DeepSeek and not looking back.

Qwen3-32B vs GPT-4o-mini

This one isn't even close in my opinion. Qwen3-32B costs $0.28 per million output vs GPT-4o-mini at $0.60 — about 2.1x cheaper. Qwen is better at general reasoning, better at code, better at Chinese, just better all around. I genuinely can't find a reason to use GPT-4o-mini anymore. My bootcamp instructors probably wouldn't love me saying that, but the numbers are the numbers.

Kimi K2.5 vs Claude 3.5 Sonnet

Kimi K2.5 costs $3.00 per million output vs Claude 3.5 Sonnet's $15.00 — five times cheaper. On pure reasoning tasks they're roughly tied. Where Kimi pulls way ahead is Chinese language work, where it crushes Claude. If you're doing anything multilingual, Kimi is the move. If you're a Claude stan for writing quality (I get it, the prose is nice), the five-times price difference might still be worth it to you. For me, I'm using Kimi.

What I Actually Pay Now vs Before

Let me put this in concrete numbers because I think abstract pricing comparisons don't hit the same.

My old monthly bill (GPT-4o for my summarization project, plus a few side experiments): around $80.

My new monthly bill after switching the summarization to DeepSeek V4 Flash through Global API, plus using Qwen for translation work: around $2.

That's not a typo. I went from $80 to $2. The quality of my outputs went up in some places (especially anything involving Chinese text) and stayed basically the same in others.

If you're a bootcamp grad like me or a hobbyist dev, this is genuinely life-changing money. That $78 difference is rent money, grocery money, "I can keep building my portfolio instead of pausing because I can't afford the API" money.

The Stuff I Didn't Expect to Learn

A few things I picked up along the way that I didn't expect:

  1. The benchmarks are way closer than the marketing suggests. US providers still lead in some categories, but the gap is in the low single digits on most tests. For a lot of real-world tasks, you genuinely cannot tell the difference.

  2. "Made in China" doesn't mean low quality. I had this implicit bias from years of tech news telling me US AI was untouchable. The data doesn't

Top comments (0)