This article was originally published on runaihome.com
TL;DR: The GMKtec EVO-X2 puts 128GB of unified LPDDR5X behind an AMD Ryzen AI Max+ 395, so it loads models that physically don't fit on any single consumer GPU — Qwen3-235B (22B active) runs at ~11 tok/s. The catch is bandwidth: at 256 GB/s it's ~3.6× slower than a used RTX 3090, so anything under 24GB runs faster on a real GPU. Buy it for capacity, not speed.
| GMKtec EVO-X2 128GB | Used RTX 3090 build | Mac Studio M4 Max 64GB | |
|---|---|---|---|
| Best for | 100B–235B MoE models in memory | ≤24GB models at top speed | 30–70B, silent, low power |
| Price (Jun 2026) | $1,999–$2,199 (complete) | ~$1,400 (complete build) | ~$2,200 (complete) |
| Memory bandwidth | 256 GB/s | 936 GB/s | 546 GB/s |
| The catch | Bandwidth-bound; ~5 tok/s on dense 70B | Hard 24GB VRAM ceiling | 64GB max at this price |
Honest take: If your goal is running a 100B+ MoE model at home for under $2,000, nothing in this class touches the EVO-X2. If you mostly run 7B–32B models, a used RTX 3090 build is cheaper and roughly 3× faster on tokens/sec.
What you actually get for the money
The GMKtec EVO-X2 is a complete mini PC built around the AMD Ryzen AI Max+ 395 — the "Strix Halo" APU with 16 Zen 5 cores and a Radeon 8060S integrated GPU. The chip itself is the same one we covered in our Strix Halo deep dive; this review is about the specific machine you can put on your desk and what its price-to-capacity ratio means for a home lab.
GMKtec sells three configurations as of June 2026:
| Config | Memory | SSD | Price |
|---|---|---|---|
| Base | 64GB LPDDR5X | 1TB | $1,499 |
| Mid | 96GB LPDDR5X | 2TB | $1,799 |
| Max | 128GB LPDDR5X | 2TB | $1,999–$2,199 |
The memory is soldered LPDDR5X-8000 across an 8-channel (256-bit) bus — there are no DIMM slots, so the RAM you buy is the RAM you keep. That's the single most important purchase decision: for local AI, buy the 128GB model or don't bother. The 64GB config is a fine gaming and general-work box, but the whole reason to choose Strix Halo over a discrete GPU is the ability to allocate up to 96GB as graphics memory and load models that don't fit anywhere else. At $9 per GB of GPU-accessible memory, that allocation is the cheapest large unified-memory pool on the x86 market right now.
Connectivity is generous for the form factor: dual USB4, Wi-Fi 7, an SD 4.0 card reader, and quad 8K display output. None of that matters for headless inference, but it does mean the machine doubles as a workstation when you're not running models.
Tokens per second, by model tier
Bandwidth is the whole story with Strix Halo, and the EVO-X2 is no exception. LLM decode speed is bound by how fast the chip can stream model weights out of memory, not by raw compute. At 256 GB/s theoretical bandwidth — and real-world figures lower than that — the EVO-X2 lands well behind any discrete GPU on a per-token basis but makes up for it on sheer capacity.
Here's what community and review benchmarks report on the 128GB EVO-X2:
| Model | Type | Tokens/sec |
|---|---|---|
| 7B–13B (Q4/Q6) | Dense | 30–45 tok/s |
| 30B-class MoE | Sparse (~3B active) | 70–100 tok/s |
| Llama 3.3 70B (Q6_K) | Dense | ~5 tok/s |
| Qwen3-235B-A22B | Sparse (22B active) | ~11 tok/s |
The most instructive line in that table is the one that looks backwards: the 235-billion-parameter Qwen3 model runs more than twice as fast as the 70-billion-parameter Llama. That's not a typo. Qwen3-235B is a Mixture-of-Experts model — 235B total parameters, but only about 22B are activated per token. Dense Llama 3.3 70B activates all 70B every single token. On a bandwidth-starved machine, the active parameter count is what sets your speed, so a sparse 235B beats a dense 70B handily.
This reframes how you should pick models for the EVO-X2. Dense models above ~30B feel sluggish — readable, but you'll be waiting. MoE models are where the machine shines, because the 128GB pool holds the full expert set while only the active slice streams per token. If you came here to run 70B dense models fast, this is the wrong machine. If you came to run modern MoE models that don't fit a GPU at all, it's close to ideal.
For context, human reading speed is roughly 7–10 tokens/sec, so the 30B-MoE range (70–100 tok/s) feels instant, the 235B MoE (~11 tok/s) feels like a fast typist, and dense 70B (~5 tok/s) is genuinely slow for interactive chat but fine for batch jobs you walk away from.
Power draw and running cost
The EVO-X2 is frugal in a way no discrete GPU tower can match. Reviewers measured idle draw in the 8–14W range, with one putting it nearer 22W. Under a sustained Llama 3.3 70B Q6_K inference load it pulls 147–160W; gaming pushes it to 170–180W.
Put that against electricity. At the US average of about $0.12/kWh, running inference at 160W for an hour costs roughly $0.019 — call it two cents. Leave it idling 24/7 at 12W and you're looking at about $0.035 per day, or near a dollar a month. A discrete RTX 3090 build idles higher and peaks at 285W+ under load, so the EVO-X2 is the cheaper machine to leave running as an always-on home AI server. We worked through the full 24/7 server math in our power bill breakdown — the short version is that idle power, not peak, dominates a year of always-on use, and the EVO-X2 wins on idle decisively.
EVO-X2 vs a discrete GPU build
This is the comparison most buyers actually face. A complete build around a used RTX 3090 — card at roughly $1,070, plus a basic host — lands near $1,400 and gives you 936 GB/s of bandwidth and ~95 tok/s on a 7B model. That's roughly 3× the EVO-X2's small-model speed. For anyone whose workload lives under 24GB — 7B–14B chat, code completion, image generation — the discrete card is faster and cheaper.
The 3090 hits a wall the EVO-X2 doesn't: 24GB. The moment your model needs 30GB, 60GB, or 120GB, a single 3090 is out, and you're into multi-GPU territory with its own cost and complexity. The EVO-X2's 96GB allocatable pool clears that wall in a box that draws less than a single 3090 at idle. A RTX 5060 Ti 16GB build is cheaper still but caps out even sooner.
So the decision is clean:
- Mostly run models that fit in 24GB? Discrete GPU. Faster, cheaper, done.
- Need 100B+ MoE models in memory, in one quiet low-power box? EVO-X2.
For the Apple-shaped alternative, a Mac Studio M4 Max brings 546 GB/s — more than double the EVO-X2's bandwidth — but tops out at 64GB at a similar price, and Apple has pulled its highest-RAM Studio configs. The EVO-X2 trades bandwidth for capacity; the Mac trades capacity for bandwidth. We compared the Apple side directly in our Mac Studio vs Mac Mini piece.
EVO-X2 vs DGX Spark
NVIDIA's DGX Spark is the other "AI in a box" people cross-shop, and on paper it should win — it's an NVIDIA platform with CUDA. In practice, for the kind of large-MoE inference the EVO-X2 targets, the Spark is bandwidth-limited too: a single unit decodes Llama 70B at around 2.7 tok/s. The EVO-X2 runs the much larger Qwen3-235B at ~11 tok/s for less money. The Spark's advantages are real — CUDA toolchain maturity, NVLink-style clustering, and fine-tuning throughput (it tops 5,000 tok/s on a 70B QLoRA run) — but for a home lab that mostly does inference, the EVO-X2 delivers more usable tokens per dollar. We're publishing a full head-to-head on the $3K–$4K developer-kit segment next; the short version is that the Spark earns its premium only if you fine-tune or live inside the CUDA ecosystem.
Top comments (0)