DEV Community

武乐丹
武乐丹

Posted on

Nemotron 3.5 Lightning: Nvidia's Open-Weight Agent Executor, the Switchyard Routing Debate, and Qwen's 27B Coming in 48 Hours

Nvidia dropped Nemotron 3.5 Lightning on Aug 11 and the open-source community spent two days arguing about it — not about the model itself, but about the routing system Nvidia shipped alongside it. Meanwhile, Qwen's 3.8-27B hits Hugging Face in two days. Here's the signal inside the noise.

What Lightning actually is

Nemotron 3.5 Lightning is a 30B mixture-of-experts with 3B active parameters, built as the execution layer of long-running agents: the tool calls, result validation, and subagent handoffs a reasoning model triggers but doesn't do itself. Three details matter:

  • Hybrid Mamba-2 / Transformer architecture. The Nemotron 3 family bet on state-space models (Mamba-2) as the backbone. HN commenters flagged this as notable — SSMs are "catching up to regular transformer architectures," and a flagship-ish open model shipping on one is a real data point for the field.
  • NVFP4 quantization out of the box. Shipped in 4-bit FP format, the model card shows a massive SWEBench drop from bf16 to fp4 — one of the clearest public measurements of what quantization costs on agentic coding.
  • Fully open pipeline, not just weights. Nvidia published the complete training recipe (data + recipes alongside weights) in the NeMo repo. As one commenter put it: "I don't think another model this performant exists with fully open source data and recipes alongside the weights."

Real-world numbers from HN: ~100 tok/s on an M5 Max MacBook Pro (128GB), ~50 tok/s on a 64GB M1 Max. The recurring complaint: it over-thinks — long reasoning traces, second-guessing, sometimes bad output. "It sketched four SVGs before returning a bad pelican riding a bicycle."

The Switchyard fight: does smart routing break prompt caching?

The more interesting debate is over NeMo Switchyard, Nvidia's open-source library for routing each request to the "most capable and suitable model." The HN thread (257 pts) went deep on a real tension:

  • Routers want to switch models per request; prompt caches want you to stay on one model. If you've built a 200k-token context on model A and the router bounces you to model B, you lose the cache and pay full prefill again.
  • The counterpoint: cache stickiness vs. routing quality is a tunable tradeoff. Some routers are configurable to pick a middle point — and if all models share a distributed cache, switching is far cheaper than people assume.
  • The deeper read: with most agentic API spend sitting in cached reads (not generation), anything that invalidates cache — including "smart" routing — can quietly double your bill. That's why several commenters called router products "snake-oil marketing" and why the ones that survive expose the cache-vs-routing tradeoff explicitly.

Qwen 3.8-27B lands Friday

Qwen 3.8-27B goes openweight in 2 days (Aug 15). Context that makes this worth watching: Qwen3.6-35B-A3B (27B-active-class MoE) is already holding up remarkably well against Nemotron — "sure it's ~20% larger, but its scores are also ~20% higher with the same active params," per the HN thread. And Qwen 3.8 Max is described by informed commenters as "really really close to Opus 4.8." The 27B dense/open-weight release Friday is the one to watch for local-dev sweet-spot arguments.

The meta-signal: open weights are now a business strategy

The most important thing Nvidia did this week wasn't the model — it's the pattern: open weights, open training recipes, open routing, all positioned as the on-ramp to their hardware. "Commoditize your complements" was the top-voted framing in the thread. Whether you read it as generosity or moat-building, the result is the same: the open-weight ecosystem just got a lot more credible, and the local/on-prem argument gets stronger every release cycle.


AI Tools Pulse is a daily briefing on AI models, tools, and the debates around them.

Top comments (0)