DEV Community

Lola Lin
Lola Lin

Posted on

1.04M Tokens of Context: What You Can Actually Do With It


A million tokens is enough to read a mid-sized codebase in a single request. GLM-5.3-Flash gives you 1,040,000 of them — and at the pricing Zhipu announced in August 2026, filling that window costs less than a coffee. That combination is the interesting part, not the number itself.

This article is about what a 1.04M-token context window actually changes for developers building with long-context LLMs: the use cases it unlocks, the engineering habits you can finally drop, and the ones you still can't — plus a concrete way to budget the fill.

What 1.04M tokens means, concretely

Most production models developers reach for today ship context windows in the 128K–200K range — enough for a few source files, a long conversation, or a section of a document. A 1.04M-token window is a different class:

Unit Approximate tokens
A mid-size source file 1K–3K
A 60-minute meeting transcript 15K–30K
A large codebase module 20K–100K
GLM-5.3-Flash context 1,040,000

Within the 2026 Chinese flagship cohort, GLM-5.3-Flash's 1.04M is only marginally larger than DeepSeek V4's and Kimi K3's 1M — among these three, the context race is basically a tie. The qualitative jump is from the 128K–200K you're used to, to any 1M-token window at all. A window this size can hold a mid-size repository, several hours of transcripts, or a stack of long documents, with room left over for the instructions and the answer.

What a 1M window actually unlocks

Whole-repo analysis and cross-file refactoring. The canonical use case. The source comparison notes that at this scale, coding agents can stuff an entire mid-size repo into context for cross-file refactoring without relying on fragmented RAG. Instead of "find the three files related to this change and hope you got them all," you ask the model about the whole tree and let it trace the connections itself. Multi-file agents — agents that edit across many files in one pass — get dramatically more reliable when the full dependency surface is visible.

Long transcripts and mixed-media input. GLM-5.3-Flash is natively multimodal (text, image, video, and file input). A 1M window plus video input means a meeting's full recording, its auto-generated transcript, and the supporting slides can all go in as one request, and the model answers with the whole context in view — not a summary-of-a-summary.

Large document sets. Contracts, research papers, spec packs, or a batch of pull-request descriptions. Tasks that used to require a loop — chunk, embed, retrieve, summarize, repeat — become a single pass: dump the set, ask for the synthesis, and cross-check the numbers yourself afterward.

Long-horizon software engineering. The sources note that the related model family ranks first on SWE Marathon-style tasks, and the shared ~1M context is a big reason long-horizon tasks are feasible at all. An agent that can keep a whole task history plus the codebase in view is qualitatively better at a 20-step refactor than one that keeps losing the plot.

The honest reality: what a big window does NOT fix

Long context removes some pain, but it does not remove all of it. This is engineering common sense, not a promise about any specific model:

Filling the window costs real money, every time. This is the big one. A 1M-token fill at GLM-5.3-Flash's international input price ($0.3 per million) is about $0.30 per request — cheap once. Do it on every call of a long agent loop and it compounds; and the more you re-read the same corpus on repeated runs, the more you pay to re-send the same tokens. (More on pricing below.)

Output is still the bottleneck, not input. A 1.04M-token window describes what the model can read, not what it can write. Every LLM shipping today has a maximum output budget that is a small fraction of its input window. So the realistic pattern is huge input, concise output — summaries, plans, diffs, structured JSON — or staged passes where each pass produces the next chunk of context.

Chunking is still a tool, just a different one. With 1M context, chunking's job changes from "make it fit" to "make it precise and cheap." You still don't want to dump 900K tokens of tangentially related docs when the task is about one function — a narrower prompt is cheaper, faster, and often more accurate.

Retrieval still wins for things that don't fit or repeat. A monorepo can be tens of millions of tokens — it will not fit in 1M. And for workloads that query the same large corpus repeatedly (support bots, document Q&A), retrieval beats full-window fill on cost by a wide margin, because you only ship the relevant slice each time. The sweet spot is a hybrid: retrieval to narrow to a few hundred K tokens, then the big window to do the deep reasoning.

Long context is not infinite attention. Every long-context model degrades somewhere in the middle — details buried mid-window are easier to miss than the head or the tail. Keep critical instructions and load-bearing data near the edges, and verify important facts rather than trusting that the model "saw" them.

Full window vs retrieval: when to use which

Use the full window when the task is one-shot and broad: analyze the whole repo, synthesize the whole document set, trace a cross-cutting change. Pay the fill cost once, get the answer.

Use retrieval when the corpus is bigger than the window, when you'll run the same corpus many times, or when latency matters: narrow to the relevant slice first, then hand the model a tight context. Here is a cheap decision-and-budget sketch:

def fill_cost(input_tokens, price_per_million):
    """One-shot full-window fill cost in USD, input side only."""
    return input_tokens / 1_000_000 * price_per_million

# GLM-5.3-Flash international pricing, per 1M tokens (source-stated)
GLM_IN, GLM_OUT = 0.30, 1.20
# DeepSeek V4 Flash pricing, per 1M tokens (source-stated)
DSF_IN, DSF_OUT = 0.14, 0.28

repo_tokens = 800_000        # a mid-size repo, example
relevant_slice = 80_000      # the retrieval result, example
answer_tokens = 10_000       # budget for the answer, example

full = fill_cost(repo_tokens, GLM_IN) + answer_tokens / 1e6 * GLM_OUT
retr = fill_cost(relevant_slice, DSF_IN) + answer_tokens / 1e6 * DSF_OUT
print(f"full-window (GLM): ${full:.2f}")   # ~$0.25 per one-shot pass
print(f"retrieval (DSF):   ${retr:.2f}")   # ~$0.01 per query
Enter fullscreen mode Exit fullscreen mode

Run this math before you wire a workflow together. If you run the "full-window" path ten times, it stops looking cheap; the retrieval path pays its rent on the tenth run.

Cost reality check

The pricing numbers that make 1M-context experiments affordable today (per 1M tokens, source-stated):

Model Input Output
GLM-5.3-Flash (domestic) ¥0.8 ¥2.8
GLM-5.3-Flash (international) $0.3 $1.2 (half-price promo: $0.6)
DeepSeek V4 Pro $0.435 $0.87
DeepSeek V4 Flash $0.14 $0.28
Kimi K3 (official API) $3.00 (uncached) $15.00

So a full 1M-token fill runs about ¥0.8 domestic or $0.30 international on GLM-5.3-Flash, $0.435 on DeepSeek V4 Pro, $0.14 on DeepSeek V4 Flash — and $3.00 on Kimi K3's official API before you write a single output token. Output compounds on top: a 10K-token answer at GLM's international output price adds about $0.012; the same answer on Kimi's API costs $0.15. "We have 1M context" and "we can afford to use it" are two different budgets — which is exactly why cheap-input, open-weight models changed the calculus.

Conclusion

A 1.04M-token window is not a magic setting — it is a genuinely new capability that changes what you can attempt in a single request, from whole-repo refactors to multi-hour transcript analysis. The 2026 Chinese flagship cohort (GLM-5.3-Flash at 1.04M, DeepSeek V4 and Kimi K3 at 1M) made that window cheap enough to actually use, at a fraction of the old price per token. But the economics still punish lazy fills: budget the input, keep retrieval for repeated or oversized corpora, keep outputs small relative to inputs, and verify what the model claims to have "seen." Used that way, the 1M window is one of the most useful tools a developer building on LLMs can reach for this year — and it is reachable through a standard OpenAI-compatible endpoint if you don't want to manage three separate accounts.

Top comments (0)