DEV Community

Cover image for ✨ So... real tests of the local Qwen 3.8 27B model
Vic Shóstak
Vic Shóstak

Posted on

✨ So... real tests of the local Qwen 3.8 27B model

I came across an interesting discussion in several AI-related communities about this Reddit post: one user decided to test how the local Qwen 3.8 27B model behaves in two different agent shells — PI Agent and OpenCode.

From his observations, PI Agent delivers higher-quality results, uses fewer tokens, runs faster and more stably, and most importantly — it doesn’t have a hard 32k output limit.

What impressed me most was context compression: in OpenCode it starts kicking in at around 67k (with a total context window of 100k), while in PI Agent the model “holds up” until 90k, even if you set output to 64k and above.

For those who want to reproduce this locally — even an RTX 3090 is enough, plus a small fine-tune of the model itself (you can find that in the original post).

At the same time, one of the commenters already staged a “duel” between local Qwen paired with PI Agent and Claude Code. The results were very close, and after a small refinement, the PI version even slightly outperformed Claude.

☝️ The main takeaway: with the same model, final quality depends heavily on the “wrapper” — the environment, context engineering, planning mode, overall agent-system setup, and so on...

That’s exactly what I’ve been saying for a long time across all my platforms — without a skilled AI engineer and a properly built agent system, nothing will work well out of the box. Sad but true.

And yes, DM me if you need AI solutions tailored to your tasks 😎

ai #aiagents #qwen

💬 Found this useful? Follow me on all platforms so you don’t miss new posts 👉 Telegram, VK, TenChat, Dzen, Teletype, or vc.ru

Top comments (0)