DEV Community

T.M. Gunderson
T.M. Gunderson

Posted on

The 1M-Token Filing Cabinet: Whole-Document AI Just Got Cheap Enough to Use

The question you stopped asking

Somewhere in the last two years, you probably asked an AI tool some version of "can you read all of this?" — a folder of invoices, a year of support tickets, every contract you've signed — and got the practical answer: no. Not because the model couldn't technically handle it. Because it cost too much, ran slow, or silently forgot half of it along the way.

That answer is expiring. Two things changed this month:

  1. One-million-token context windows went mainstream. Google's Gemini 4 Argon ships a unified 1M-token context window, and Inception Labs' Mercury 3 arrived with 1M tokens at a launch price of about $0.10 per million input tokens — generating at over 1,000 tokens per second.

  2. The memory cost underneath long context collapsed. DeepSeek's reported memory-architecture results show KV cache — the "short-term memory" a model uses to hold a document while it reads — cut by up to 93.3% compared with traditional multi-head attention, needing roughly a quarter of the high-bandwidth memory and an eighth of the SSD storage.

Benchmark talk is benchmark talk. Here's the owner's translation: reading your entire archive in one pass just went from a priced-out consulting project to a line item that rounds to pennies.

What a million tokens is, in business terms

A token is roughly three-quarters of a word, so a million tokens is about 750,000 words. For a 20-person business, that's commonly:

  • A full year of invoices — all of them, not samples
  • The operations manual plus twelve months of support tickets
  • Every contract signed since the company started
  • A year of customer email threads

The filing-cabinet framing matters more than the number. A model with a 1M-token context isn't "AI with a bigger memory." It's a colleague who has read the entire filing cabinet before the meeting starts — which changes which questions are worth asking.

The questions you couldn't afford to ask

The unlock isn't the technology. It's the work the technology finally makes viable. Three passes worth running:

1. The invoice pattern review. Put twelve months of invoices in one context and ask: Which vendors raised prices, when, and by how much? Any duplicate or unusual charges? What does spend look like by category, quarter over quarter? This used to take a bookkeeper's day or a small data project. Now it's one prompt plus a verification pass. Price creep across a dozen small vendors is exactly the pattern a human never catches and a whole-archive read does.

2. The onboarding brain. Your ops manual says how refunds are supposed to work. Your ticket history says how they actually work. Load both and ask new-hire questions against the combined record: "What do we do when a customer disputes a charge after 60 days?" The answer reflects what actually happened, not just what the document claims — and every gap between the two is a to-do item for your manual.

3. The contract-versus-practice audit. Every agreement you've signed, one pass: Which SLAs do we promise? Which ones do we routinely miss? Which renewal or price-change notice windows exist, and when do they next open? Where does the paper say one thing and daily practice another? This is the pass that surfaces the renewal you're about to sleep through and the promise you're quietly breaking.

All three share one shape: these are pattern questions across a whole archive, not chat questions. That distinction decides how to run them.

The honest boundaries

  • Run these as batch passes, not chat habits. A whole-archive job is one-shot: load, ask, read, done. Re-uploading the archive into every interactive conversation is still the expensive way to use AI — context you re-send on every message is a tax, whatever the window size. Keep the archive in your storage; bring it out for scheduled passes (monthly invoices, quarterly contracts), not casual chat.
  • Ask for patterns, not recall. Long-context models are strong at finding the pattern across a million tokens and weaker at perfectly quoting line 400 of document 23. Ask "which vendors raised prices," not "what did invoice #4812 say." And verify anything consequential — a vendor confrontation, a missed SLA — against the source document before you act on it.
  • Privacy is a decision, not a setting. A year of customer emails is a disclosure event. Before uploading a whole archive to any third-party model, check what your contracts, payment-processor terms, or professional obligations say. Invoices and internal documents are usually safe ground; customer communications deserve a second look.
  • Watch the price you build on. The $0.10-per-million-input figure is a launch discount. Cheap enough to experiment with tonight — but check current pricing before you build a recurring monthly habit on it.

Your first pass: twenty minutes, tonight

  1. Pick one archive. Invoices are the classic first pass. Export twelve months as PDFs or text into one folder.
  2. One prompt, three questions: "Here are all our invoices from the last twelve months. List every vendor whose pricing increased and when, any duplicate or unusual charges, and spend by category. Flag anything you'd double-check."
  3. Verify before you act. Pick two or three of its claims and check them against the actual documents. If it holds up, you've found the pattern of a dozen hidden price increases. If it doesn't, you spent a dime learning where this tool's limits are — cheaper than most consultants' intake calls.

The businesses that get value out of long-context AI won't be the ones following model releases. They'll be the ones who know which filing cabinet to open first.


Want templates for the boring passes — invoice reviews, contract audits, quarterly sweeps? The Boring Automation Pack includes them, built to run as scheduled one-shot jobs rather than endless chats.

Top comments (0)