DEV Community

bolddeck
bolddeck

Posted on

I Tested Every Multimodal AI API So You Don't Have To

I Tested Every Multimodal AI API So You Don't Have To

Okay so I just finished a coding bootcamp a few months ago and I've been trying to build little side projects to keep my skills sharp. Last week I had this idea: what if I built an app that could look at a photo of a receipt and automatically log it as an expense? Seemed simple enough. Then I discovered multimodal AI APIs and honestly, it kind of blew my mind what's possible now.

I had no idea you could just send an image to an AI and have it describe everything in it, read text out of it, or even answer questions about charts. I figured I'd share what I learned because honestly, picking between these models was way harder than I expected.

First, What Even Is Multimodal AI?

So before I went down this rabbit hole, I thought "multimodal" was some fancy term I'd never need. Turns out it just means an AI that can handle more than one type of input. Most AI APIs deal with text, but these multimodal ones can look at images, listen to audio, and in one case even watch video.

I was shocked to learn that I could literally send a picture of a menu in Chinese and have the AI translate it and tell me what's vegetarian. Like, what timeline are we living in?

The Models I Tested

I went through Global API to test a bunch of different models. Here's the lineup I looked at:

Model Provider What It Handles Output Price per Million Tokens Context Window
Qwen3-VL-32B Qwen Image + Text $0.52 32K
Qwen3-VL-30B-A3B Qwen Image + Text $0.52 32K
Qwen3-VL-8B Qwen Image + Text $0.50 32K
Qwen3-Omni-30B Qwen Image + Audio + Video + Text $0.52 32K
GLM-4.6V Zhipu Image + Text $0.80 32K
GLM-4.5V Zhipu Image + Text $0.01 32K
Hunyuan-Vision Tencent Image + Text $1.20 32K
Hunyuan-Turbo-Vision Tencent Image + Text $1.20 32K
Doubao-Seed-2.0-Pro ByteDance Image + Text $3.00 128K

Just glancing at that table, I noticed a few things right away. The Qwen models are suspiciously cheap. The Doubao one costs almost 6x more than the Qwen models. And Qwen3-Omni-30B is the only one that does audio and video. That last one made me do a double-take because video is insane.

My Receipt Reader Experiment

So back to my receipt idea. I wanted to see which model could actually look at a crumpled, lit-from-behind receipt photo and pull out the totals, tax, and line items. I tested four different scenarios and ranked each model.

Test 1: Just Describing Stuff

I threw a busy street scene at each model and asked them to describe everything. The Qwen3-VL-32B absolutely crushed this thing. It picked out like 15 objects, identified brand names, even read text on signs. I had no idea AI could be that observant.

GLM-4.6V came in second and I noticed it was weirdly good at Asian contexts. Probably makes sense given it's from Zhipu. The Qwen3-Omni-30B was very good but slightly less detailed than its VL cousin. Hunyuan-Vision missed some smaller details, and GLM-4.5V did the job but felt rougher around the edges.

Test 2: Reading Text Out of Images

This one mattered most for my receipt project. I tested English, Chinese, and mixed-language documents.

Qwen3-VL-32B was basically perfect across all three. GLM-4.6V was also excellent, especially with Chinese text (shocker, I know). The Qwen3-Omni-30B did great too. Hunyuan-Vision was fine but stumbled a few times.

Honestly the difference between the top three was small. If you're doing OCR-heavy work, you can't really go wrong with any of them.

Test 3: Charts and Diagrams

I gave them a bar chart and asked for the trends. Qwen3-VL-32B pulled out the exact numbers and gave me a clean summary. GLM-4.6V was close behind. Qwen3-Omni-30B also did very well.

I didn't realize how useful this was until I started thinking about it. You could feed it screenshots of dashboards, analytics pages, whatever, and just ask questions in plain English. I had no idea this was something I could build into a project on day one.

Test 4: Code Screenshots

Okay this one was personal because I'm lazy and I take a lot of code screenshots from tutorials. I wanted to see if the AI could turn a screenshot back into actual working code.

Qwen3-VL-32B hit about 95% accuracy and even handled weird indentation and special characters. Qwen3-Omni-30B got 92%. GLM-4.6V got 90% but had some minor formatting hiccups. Honestly all of them were usable, which still blows my mind a little.

The Audio Surprise

Here's where things got really interesting. Only ONE of these models supports audio input: Qwen3-Omni-30B. The rest are vision-and-text only.

I had no idea going in that audio would be so rare. But the Omni model can:

  • Transcribe speech (and it works in multiple languages)
  • Answer questions about what's being said in audio
  • Detect emotion in someone's tone
  • Even describe music clips (though it's pretty basic on that one)

This was huge for me because I'm planning a project that needs to handle voice notes. Let me show you the code:

from openai import OpenAI

client = OpenAI(
    base_url="https://global-apis.com/v1",
    api_key="your-api-key-here"
)

response = client.chat.completions.create(
    model="Qwen/Qwen3-Omni-30B-A3B-Instruct",
    messages=[{
        "role": "user",
        "content": [
            {"type": "text", "text": "Transcribe this audio and tell me the speaker's mood"},
            {"type": "audio_url", "audio_url": {"url": "https://example.com/voice-note.mp3"}}
        ]
    }]
)

print(response.choices[0].message.content)
Enter fullscreen mode Exit fullscreen mode

That was it. That was the whole thing. I just sent an audio URL and asked a question. It still feels like cheating.

The Price Reality Check

Look, I'm a bootcamp grad. Every dollar matters right now. So I made myself a spreadsheet and did the math on what it would actually cost to process 1,000 images, then 10,000 a month.

Model Cost per Million Output Tokens 1,000 Images 10,000 Images/Month
GLM-4.5V $0.01 ~$0.05 $0.50
Qwen3-VL-8B $0.50 ~$2.50 $25
Qwen3-VL-32B $0.52 ~$2.60 $26
Qwen3-Omni-30B $0.52 ~$2.60 (+ audio) $26
GLM-4.6V $0.80 ~$4.00 $40
Hunyuan-Vision $1.20 ~$6.00 $60
Doubao-Seed-2.0-Pro $3.00 ~$15.00 $150

Okay so GLM-4.5V at $0.01 per million tokens made me actually laugh out loud. That's basically free. The catch is it's the budget option and you can feel it in the quality. But for low-stakes stuff? Unbeatable.

The Doubao model at $3.00 per million was a gut punch. That's $150 a month for 10,000 images. I'm sure it's good but my broke bootcamp brain can't justify it.

Qwen3-VL-32B at $0.52 was the sweet spot for me. You get top-tier quality without the price tag. The Qwen3-Omni-30B is the same price but adds audio and video support, so for $26 a month you basically get a Swiss Army knife.

I was shocked at how cheap this all is. A few years ago this stuff would have been science fiction. Now I'm paying cents to have an AI look at pictures for me.

Some Code That Actually Worked

Here's the basic setup I used for most of my image tests. Super simple once you get past the initial "wait, this is all I have to do?" moment:

from openai import OpenAI

client = OpenAI(
    base_url="https://global-apis.com/v1",
    api_key="your-api-key-here"
)

response = client.chat.completions.create(
    model="Qwen/Qwen3-VL-32B-Instruct",
    messages=[{
        "role": "user",
        "content": [
            {"type": "text", "text": "What's the total on this receipt?"},
            {"type": "image_url", "image_url": {"url": "https://example.com/receipt.jpg"}}
        ]
    }],
    max_tokens=500
)

print(response.choices[0].message.content)
Enter fullscreen mode Exit fullscreen mode

That's literally it. You send a URL, you ask a question, you get an answer. The OpenAI Python client works with Global API's base URL, so if you've ever used OpenAI before, this feels familiar.

For my receipt project I added a loop to handle multiple images and stored the results in a JSON file. Not gonna lie, I felt like a wizard the first time it actually worked.

What I Actually Picked

After all this testing, here's where I landed:

For everyday image stuff: Qwen3-VL-32B. The $0.52 price is fair and the quality is top-tier. If I were building a real product I'd start here.

For Chinese-heavy projects: GLM-4.6V. It's slightly more expensive at $0.80 but it's noticeably better at Chinese OCR and cultural context.

For budget projects: GLM-4.5V at $0.01 is unbeatable. The quality is acceptable for low-stakes stuff. I'd use this for personal projects or prototypes.

For audio and video: Qwen3-Omni-30B. It's literally the only choice in this lineup. But hey, it's the same price as the regular Qwen3-VL-32B so you're not paying extra for the extra abilities.

For when money is no object: Maybe Doubao-Seed-2.0-Pro. It has a 128K context window

Top comments (0)