Elemetry data: Running 284B MoE at 0.00 GB Active VRAM

I wanted to share some hardware telemetry data from an architectural test evaluating frontier-scale model execution on highly constrained, commodity hardware footprints.

Using an open-source diagnostic environment, I benchmarked a 284B parameter Mixture-of-Experts (MoE) architecture (DeepSeek-V4-Flash) under a custom layer-streaming configuration. By isolating the active execution graph layer-by-layer and utilizing direct memory-mapping loops, the system managed to completely bypass standard VRAM bottlenecks.

📊 Verified Performance Thresholds:

• Peak Active GPU VRAM: 0.00 GB (Successfully decoupled physical weight storage from active local graphics allocation).
• Peak Host System RAM: 19.28 GB (Executed the massive layer-streaming file footprint entirely within standard consumer limits).
• Optimization Framework: Low-overhead predictive gating heuristics combined with a hybrid FP4/FP8 quantization engine.

The full benchmark harness, baseline tokenizer pipelines, and diagnostics environment loops are open-sourced under the MIT license for peer auditing:
👉 https://github.com/Aubyte-Admin/layer-streaming-telemetry-benchmark

For a deep-dive into the underlying systems architecture—specifically how the engine mitigates NVMe read-latency spikes during data-transfer scheduling—you can read my comprehensive technical whitepaper on Medium:
👉 https://medium.com/@britzbernu