Google doesn't scan the live internet every time you search — it queries a pre-built index. Here's the 7-step pipeline that gets a page from "just published" to "ranking on page 1."
The chain: URL Discovery → Crawling → Rendering → Indexing → Query Understanding → Ranking → Serving Results
1. URL Discovery
Google can't crawl what it doesn't know exists. Pages get discovered via:
- Internal links (from other pages on your site)
- External links (from other sites)
- XML sitemaps (submitted via Google Search Console)
Quick distinction devs often mix up: a sitemap tells crawlers where to go, robots.txt tells them where not to go.
2. Crawling
Googlebot fetches the URL. Crawl frequency depends on site authority, update cadence, and your crawl budget — basically how many pages Google's willing to crawl on your site in a given window.
3. Rendering & Processing
Google renders HTML/CSS/JS using an evergreen Chromium engine. Block critical JS and your interactive content may never get parsed — a common SEO bug in JS-heavy frontend apps.
4. Indexing
Crawling ≠ indexing. Crawling reads the page; indexing decides whether to store it. If a page isn't showing up in search, check your Search Console indexing report — it could be a noindex tag, thin content, or duplicate content issue.
5. Query Understanding
NLP interprets what the user actually wants — informational, navigational, or transactional intent — before ranking even starts.
6. Ranking
No definitive "200 factors" list actually exists in practice, but relevance, page speed, and backlink quality (not quantity) are consistently the heavy hitters.
7. Serving Results
The SERP assembles featured snippets, People Also Ask boxes, and knowledge panels — increasingly optimized for zero-click answers.
Myths, Busted
- ❌ Sitemap submission guarantees ranking → it only aids discovery
- ❌ More backlinks = better rank → relevance/context matters more than volume
- ❌ Google searches the live web → it searches its stored index
FAQ
Can a page rank without being indexed?
No — indexing is a hard prerequisite for ranking.
How long does indexing take?
Hours to weeks, depending on site authority and technical health.
Originally published on my blog, where I write about AI, SEO, and web dev.
Top comments (0)