I Got vLLM Running Natively on Windows on RX 6750 XT (RDNA2) – ROCm 7.15 PoC at 25.9 TFLOPS, No WSL2

I'm 17, mechanic from Torino. I built vLLM to run NATIVELY on Windows on my RX 6750 XT 12GB (gfx1031 / RDNA2).

AMD lists RDNA2 as "runtime-only" on ROCm 7.15 Windows. I got around it.

Repo PoC: https://github.com/sebastianmechno-sys/vllm-rocm-windows-rdna2
Upstream issue: https://github.com/ROCm/TheRock/issues/7341

The Problem

• RX 6750 XT = gfx1031, not officially supported for full ROCm 7.15 Windows
• vLLM depends on Triton attention kernels tuned for CDNA, they crash on RDNA2
• FP8 not supported on RDNA2 (only FP16/INT8/INT4)

How I Fixed It

1. Built rocBLAS for gfx1031 via TheRock with HSA_OVERRIDE_GFX_VERSION=10.3.1
2. Custom ROCM_PATH + TheRock artifacts
3. vLLM 0.19 with custom plugin:

bash
VLLM_USE_TRITON_ATTN=0
VLLM_ROCM_USE_AITER=0
enforce_eager=True
torch.compile = off

Benchmarks (native Windows, no WSL2)
GEMM 4096x4096 FP16: 25.97 TFLOPS
opt-125m prompt: 107.9 tok/s, output: 54.2 tok/s (batch 8-32)
12GB VRAM: 10.3GB alloc, 5.47GB KV cache
FP16 stable, FP8 fails as expected on RDNA2
![ ](https://dev-to-uploads.s3.us-east-2.amazonaws.com/uploads/articles/hd9fxjwyruywcos112xw.png)
![ ](https://dev-to-uploads.s3.us-east-2.amazonaws.com/uploads/articles/a4p1357aiqgf9cm0w61w.png)