Hook
Google Search is rewriting organic result links to google.com/goto?url=…. The destination isn't in the query string anymore — it's an opaque reference you can only resolve by asking Google (read the Location header, don't follow the redirect). As of late August 2026, it shows up consistently when you're logged out or in private mode.
If you build anything on top of search-result HTML, this is the latest rent increase. Google already removed &num=100 and tightened BotGuard/SearchGuard. The pattern is obvious: make naive SERP scraping slower, noisier, and easier to detect.
Why cross-border sellers feel this first
Solo sellers and small agencies are the most exposed, because SERP scraping is the cheapest tool we reach for:
- Rank tracking for your own listings
- Keyword and demand research before sourcing
- Competitor price/title monitoring across marketplaces
None of that is evil. But most of it was built on the assumption that reading a search page was free. That assumption is what's being revoked.
The three-tier response
Tier 1 — Own your data first. Your best rank signal isn't scraped — it's first-party. Search Console, your storefront analytics, and your marketplace's official APIs tell you what actually converts. Scraped rankings are a proxy; your own conversion data is ground truth.
Tier 2 — Use official APIs where they exist. Marketplaces, ad platforms, and logistics providers increasingly expose structured endpoints. They cost money and have limits, but they're stable, and stability is the point.
Tier 3 — If you must scrape, do it like you're being audited. Resolve links properly (read Location, don't follow), rate-limit hard, cache aggressively, and log provenance for every field. Accept that this is an arms race you don't win — you just stay one revision behind.
The uncomfortable part
Every anti-scraping move is really a pricing signal. Google isn't trying to stop you; it's trying to make you pay — in latency, in detection risk, in engineering hours. Once you price that in, a lot of "free" data turns out to be expensive.
The sellers who win the next cycle won't be the best scraper operators. They'll be the ones whose growth doesn't collapse when a door closes.
Takeaway
Audit your stack this week and label every data source "owned / licensed / scraped." For each scraped source, name the official API or first-party signal that could replace it. You don't have to switch today — you just need to know which door is load-bearing before it closes.
Top comments (0)