DEV Community

Cover image for The context window has been shattered: Subquadratic debuts a 12M token window
Ashish
Ashish

Posted on

The context window has been shattered: Subquadratic debuts a 12M token window

Context Windows Are Breaking — And So Is How We Think About Vision Training

Subquadratic just dropped a 12-million-token context window. For developers, this is the kind of infrastructure leap that opens up entirely new application architectures — persistent memory across massive documents, agents that never lose the plot, reasoning chains that don't degrade over length.

But while the AI world digests what this means, I want to talk about a different kind of context window: the one running between your two eyes.

The Binocular Integration Problem

Every frame, your visual cortex receives two slightly offset images — one from each retina. The brain's job is to fuse them into a single coherent 3D perception. It's a real-time integration challenge that makes a 12M token transformer look almost straightforward.

For roughly 2–3% of people, this system breaks. Amblyopia (lazy eye) means one eye's signal gets suppressed — the brain essentially mutes a noisy input channel rather than integrating it. Over time, that channel atrophies, and depth perception suffers. The traditional treatment window was considered closed by around age eight, leaving millions of adults with no options beyond patching — an approach with notoriously poor compliance because, frankly, who wants to walk around with one eye covered?

VR as a Training Environment

Here's where it gets interesting from a developer perspective. VR headsets like Meta Quest render independent images per eye — it's literally a dual-output pipeline. This creates a controlled environment where you can:

  • Deliver different visual content to each eye
  • Adjust difficulty by modulating per-eye shaders (contrast, opacity, blur)
  • Apply AI-driven effects like figure sharpening or flicker stimulation selectively to the weaker eye
  • Track engagement and improvement over sessions

What makes the VR approach fundamentally different from patching is that it doesn't just block the dominant eye — it actively rebalances the visual input so both eyes are forced to collaborate. The dominant eye still sees the scene, but with carefully calibrated degradation, while the weaker eye receives enhanced, easier-to-process content. This forces the brain to integrate both streams rather than defaulting to the stronger signal.

Amblyotube by Seven Sports is one implementation of this concept. It overlays dichoptic training onto YouTube-style content, so users are doing visual coordination work while consuming media they'd watch anyway. Key features include a dominant eye shader with adjustable blur, contrast, brightness, and opacity; a lazy eye sharpener that uses AI processing to identify and sharpen human figures for the weaker eye; and a magenta focus cue designed to promote binocular fusion and neuroplasticity. The approach essentially gamifies the therapeutic mechanism — users watch content they choose, and the system dynamically adjusts the difficulty of binocular fusion as their coordination improves.

The Technical Angle

If you're building in the health-tech or XR space, a few things worth noting:

  1. Dichoptic rendering isn't trivial — you need per-eye shader control and careful calibration to avoid discomfort. Getting the luminance balance right between eyes is critical because mismatched brightness between the two retinal images can trigger visual discomfort or even nausea. The per-eye opacity gradient needs to be smooth enough that the brain accepts the fused image rather than fighting it.

  2. Engagement is the hard problem — clinical efficacy means nothing without compliance, which is why embedding training in entertainment content is a smart architectural choice. Traditional vision therapy exercises are repetitive and boring; by layering the training onto content users already want to watch, the compliance problem largely solves itself. The user doesn't feel like they're doing therapy — they're just watching videos.

  3. Adult neuroplasticity is real — the old "can't fix lazy eye after childhood" line is crumbling under research. The bottleneck was never biology; it was consistent, accessible training at the right difficulty gradient. VR enables precisely calibrated, daily training sessions that adapt to the user's progress, making adult amblyopia treatment viable for the first time at scale.

  4. AI on the edge — using computer vision to identify human figures in video and apply per-eye effects in real time is a non-trivial pipeline on mobile XR hardware. Running inference on every frame to detect and segment human figures, then compositing sharpened overlays onto the weaker eye's render while simultaneously degrading the dominant eye's view, all within a 72Hz or 90Hz frame budget, demands tight optimization. The magenta focus cue adds another layer — it's a visual anchor designed to draw both eyes toward the same fixation point, reinforcing binocular coordination.

This is one of those spaces where developer tooling (Unity/Unreal VR pipelines, per-eye rendering APIs) is mature enough to build genuinely novel therapeutic applications. The bottleneck isn't technology — it's awareness and distribution. The rendering techniques are well-understood, the hardware is in millions of homes, and the clinical evidence base is growing. What's missing is more developers recognizing that XR isn't just for games — it's a platform for rewiring visual perception.

Anyone here working on vision-related XR projects? Would love to compare notes on the rendering pipeline challenges — especially around maintaining frame timing when running per-eye shader effects on video content.


Amblyotube is available on Meta Quest (ages 13+): https://www.meta.com/en-gb/experiences/amblyotube/25906906972338493/

Top comments (0)