You comparison-shop AI tools by sticker price. That's exactly what the vendors want.
Here's the thing nobody in AI sales will tell you: the price per token on the pricing page is almost irrelevant for small businesses. The real lever is something called cache economics — and understanding it can cut your AI bill by nearly half without switching tools.
The Number That Actually Moves Your Bill
When you send a prompt to an AI model, most of what you're sending is the same every single time:
- Your system instructions ("You are a helpful assistant for Smith & Sons Plumbing...")
- Your business context (company policies, FAQ answers, service descriptions)
- Your conversation history (if you're in a long chat)
- Formatting rules, tone guidelines, output templates
A typical business prompt might be 10,000 tokens — but 9,000 of those are identical across every call. Only 1,000 tokens change each time (the actual question, the specific customer data, the new instruction).
The question that determines your bill: what does your AI vendor charge for those 9,000 repeated tokens?
How Cache Economics Works (In Plain English)
Some AI providers recognize that repeated context is, well, repeated. They cache it — store a copy — so they don't have to reprocess the whole thing from scratch on every call. When they do, they charge you less for the cached portion.
Here's what that looks like with real numbers:
| Scenario | Full Price (no cache) | With Cache |
|---|---|---|
| Input: 10K tokens | $0.30 | $0.045 (cache read) |
| Output: 500 tokens | $0.15 | $0.15 (no change) |
| Per-call total | $0.45 | ~$0.20 |
Same sticker price. Same model. 55% cheaper per call because the vendor handles repeated context efficiently.
This isn't hypothetical. When Anthropic shipped Claude Fable 5.1, the sticker price stayed the same as Fable 5 — but the cache read price quietly dropped, cutting real-world costs roughly 45% for heavy users who send consistent context.
Why This Matters More for Small Businesses
Enterprise AI teams have procurement specialists who model total cost of ownership. You probably don't. You see "$0.003 per 1K tokens" and make a decision.
But if you're running any of these, cache economics determines your real spend:
- Customer service bots that load your full knowledge base on every query
- Document processing that sends the same formatting instructions every time
- Data extraction where the schema and rules are identical across jobs
- Email triage where the categorization rules never change
- Report generation with the same template on repeat
That's most SMB AI use cases. The repetitive ones. The ones where cache savings pile up fastest.
The 5-Minute Audit: Ask Before You Sign
Before committing to any AI tool or API, ask the vendor these three questions:
1. "How do you handle repeated context?"
If they say "we don't cache" or give you a blank stare, that's a red flag. You'll pay full price for the same 9,000 tokens on every single call.
2. "What does a cache hit cost compared to a regular input token?"
Good answers:
- "Cache reads are 90% cheaper than regular input tokens"
- "We charge $0.003 for regular input and $0.0003 for cached input"
Red flags:
- No cache pricing listed at all
- Cache pricing barely different from regular pricing
- "Cache is available but only on our enterprise plan"
3. "What percentage of my typical prompt would be cacheable?"
A vendor who understands your use case should be able to estimate this. If you're sending the same system prompt and business context every call, the answer should be 70-90%. If the vendor can't answer this, they're not optimizing for your cost — they're optimizing for their margin.
The One Rule That Would Have Saved Cursor's Customers
In September 2026, the AI code editor Cursor got banned from a major provider. Thousands of customers who relied on one company for both their AI memory and their AI files suddenly had neither.
The lesson extends beyond code editors: never let one provider hold both your memory and your files.
For small businesses, this means:
- Your AI instructions (system prompts, business rules) should live in a document you own, not just inside one vendor's app
- Your data should be exportable in a format any other AI can read
- Your workflow should be replicable across at least two providers
Cache economics makes this practical: when you control your context (system prompts, business docs, templates), you can test whether a new provider handles it efficiently before migrating. You're not locked in.
A Practical Framework: Tier Your AI Spending
Combine cache awareness with a two-tier model strategy:
Tier 1 — Routine work (cheap model, cache-heavy):
- Email sorting and draft responses
- Data entry and formatting
- First-pass document review
- Appointment scheduling
- Use the least expensive model that handles these reliably
- Ensure your vendor caches your system prompt and rules
Tier 2 — Judgment calls (capable model, cache still matters):
- Pricing decisions
- Customer conflict resolution
- Strategic planning
- Hiring assessments
- Use the most capable model you can afford
- Cache your business context to keep costs predictable
The beauty: your Tier 1 system prompt is probably 95% cacheable, and your Tier 2 context is probably 80% cacheable. Both tiers benefit from cache economics — but the savings on Tier 1 (where you make 10x more calls) is where the money adds up.
What To Do Right Now
- Check your current AI tool's pricing page. Look for "cache" or "cached input." If it's not there, you're overpaying.
- Estimate your cache ratio. Take your typical prompt. Count how many tokens are your system instructions, business rules, and recurring context. Divide by total tokens. That's your cache ratio — and it's probably 70-90%.
- Calculate the gap. Multiply your cache ratio by your monthly AI spend. That's roughly what you'd save if your vendor cached properly. If the number surprises you, it's time to shop.
- Add the lock-in rule to your vendor evaluation. Can you export your data? Can you move your system prompts to another tool in under an hour? If not, negotiate that before signing.
The AI market is consolidating and pricing is shifting fast. The businesses that understand cache economics will lock in savings while everyone else pays sticker price for the same service.
Want a template for auditing your AI vendor costs? The SMB Scale Up cost audit checklist walks through these questions with scoring — grab it from our resources.
Top comments (0)