Modern AI coding and shopping agents (ClaudeBot, OAI-SearchBot, PerplexityBot, Claude Code) waste up to 85% of their context window parsing inline CSS, SVGs, and layout boilerplate when fetching raw HTML.
In February 2026, HTTP content negotiation via Accept: text/markdown and the Content-Signal header emerged as the cleanest white-hat Generative Engine Optimization (GEO) pattern for SaaS and Shopify sites:
- Human browsers (
Accept: text/html) receive your normal interactive page; - AI agents (
Accept: text/markdown) receive 1:1 visible content converted into clean YAML-frontmatter Markdown tables (Vary: Accept), cutting payload size from ~16,000 tokens to ~2,000 tokens with zero SEO cloaking risk.
Testing Your Site Across All 8 GEO Signals
We built a free real-time edge inspector — GeoReady — plus an open-source zero-dependency MCP server (yixuanrobot/geoready-mcp) that audits any URL in 5 seconds across:
-
AI Crawler Access &
robots.txt(OAI-SearchBot,PerplexityBot,ClaudeBot,Google-Extended+ firewall HTTP 403 challenge detection) -
/llms.txt&/llms-full.txt(catching broken SPA routerindex.htmlfallbacks) Accept: text/markdownNegotiation & Token Waste %-
JSON-LD Entity Graph & ChatGPT Shopping Offers (
Organization,Product/SoftwareApplication,FAQPage) -
2026
Content-SignalHTTP Headers (ai-train=yes, search=yes, ai-input=yes)
Minimal Cloudflare Pages _headers Snippet
Drop this into your static output folder's _headers file:
/*
Content-Signal: ai-train=yes, search=yes, ai-input=yes
Vary: Accept
Link: <https://yourdomain.com/llms.txt>; rel="llms-txt", <https://yourdomain.com/llms-full.txt>; rel="llms-full-txt"
Run via Claude Desktop or Cursor (uvx)
{
"mcpServers": {
"geoready-auditor": {
"command": "uvx",
"args": [
"--from",
"git+https://github.com/yixuanrobot/geoready-mcp",
"geoready-mcp"
]
}
}
}
Test your own domain's live score and generate a tailored llms.txt + robots.txt + JSON-LD kit free at https://geoready.aitruelabs.com.
Top comments (0)