Ever wondered when Googlebot last visited your page? It's surprisingly useful for debugging crawl issues or confirming indexing. I wrote a quick script that uses the SERPSpur API to fetch the last crawl date for any URL:
python
import requests
API_KEY = "your_api_key_here"
def get_last_crawl_date(url):
response = requests.get(
"https://api.serspur.com/v1/crawl-check",
headers={"Authorization": f"Bearer {API_KEY}"},
params={"url": url}
)
data = response.json()
print(f"URL: {data['url']}")
print(f"Last crawled: {data['last_crawl']}")
print(f"Crawl frequency: {data['crawl_frequency']}")
return data
Example usage
get_last_crawl_date("https://example.com/blog/post")
This is especially handy when you've updated content and want to confirm Googlebot has re-crawled it. I've caught pages that hadn't been crawled in months—often due to internal linking issues or sitemap gaps. Do you monitor crawl activity regularly, or only when you see ranking drops?
Top comments (1)
Super useful! I once had a page that hadn't been crawled in 6 months because of a broken internal link—this would have caught it way earlier. Do you have a way to automate alerts for pages that haven't been crawled in a while?