501B Stored, 23B Awake: What Reflection's Beam Means for Builders Who Self-Host
Reflection AI unveiled Beam on October 5, 2026: a 501B-parameter open-weight MoE (Apache 2.0, weights land later this month) with a 1M-token context window. The headline screams 501B. If you self-host or serve models, here's the builder's reading — because the headline number is the least useful number in the announcement.
The only numbers that matter
| What | Number |
|---|---|
| Total parameters | 501B (must ALL sit in memory) |
| Active per token | 23B (this drives your per-token compute) |
| Context | 256K default, 1M via midtraining extension |
| Serving footprint | ~500GB at 8-bit, ~half at 4-bit |
| Weights | Apache 2.0, later this month |
MoE routing means ~4.6% of the network wakes up per token. Your inference bill follows the 23B, not the 501B. But your GPU memory bill follows the full 501B — warehouses still count. Until quantized community builds appear, this is a multi-GPU server model, not a workstation one.
How it compares (company-reported, not yet independently verified)
- SWE-bench Verified: 80.9 vs. 70.7 (Nemotron 3 Ultra)
- Terminal Bench v2.1: 80.1 vs. 81.0 (GLM-5.2), vs. 90.6 (DeepSeek V4.1 Flash)
- DeepSWE v1.1: 44.4 — trails GLM-5.3 (61.0) and Kimi K3 (68.0)
Reflection's pitch is not "best scores." It's a cost ratio: comparable reasoning to GLM-5.2 at roughly 3–4x less inference compute. That claim rests on their own benchmark estimates — not measured dollar costs. Reproduce it the day weights ship before you believe it.
What to build this week
- Evaluation harness first. Get SWE-bench Verified + Terminal Bench running locally against whatever open model you serve today. When Beam lands, you swap it in and measure — the 3–4x claim is testable, so test it.
- Cost-per-token model. Active params (23B) drive compute cost; total params (501B) drive memory. Put both in your infra spreadsheet for every MoE — this generalizes beyond Beam.
- Don't plan prod on unreleased weights. Weights + technical report + model card + fine-tuning tooling are all "later this month." Build the serving path with a downloadable model; treat Beam as a drop-in candidate.
The engineering details worth knowing
- Pretraining: 23.8T tokens on 6,144 GB300 GPUs (<4 weeks) — ~48 tokens/param, right at the compute-optimal ratio the industry converged on.
- RL: 10,500 GB300 GPUs for 4 weeks, 100M+ rollouts. Browsing skill improved without browsing tasks in the mix — real transfer across agentic domains.
- Safety: separate alignment teacher merged with the RL teacher via multi-teacher on-policy distillation + deliberative alignment. Watch the technical report for evals.
The open-weight race just changed its metric from capability to cost. Verify first, then adopt.
Sources: Reflection AI's Oct 5 announcement; benchmark tables as published by Reflection (unverified); reporting from TechCrunch, tpsreport.news, marktechpost.com.
Top comments (0)