This guide covers extracting publicly accessible data. Always review a site's robots.txt and Terms of Service before scraping.
TL;DR
Scrape Best Buy product pages using AlterLab's API with Python or Node.js. Start at T1 tier, let auto-escalation handle anti-bot, and extract structured data via CSS selectors or Cortex AI. For typical product pages, expect T2-T3 tiers ($0.0003-$0.002/request).
Why collect e-commerce data from Best Buy?
Best Buy's public product pages offer valuable signals for:
- Price monitoring: Track competitor pricing strategies across electronics categories
- Inventory analysis: Gauge stock levels and product availability trends
- Review aggregation: Collect customer sentiment for market research
Technical challenges
Best Buy implements standard e-commerce anti-bot measures including rate limiting, IP reputation checks, and JavaScript rendering requirements. Raw HTTP requests often fail with 403/429 responses or incomplete HTML. AlterLab's Smart Rendering API automatically handles proxy rotation, header management, and headless browser rendering to access public product data reliably.
Quick start with AlterLab API
See the Getting started guide for setup. Below are examples scraping a Best Buy product page:
```python title="scrape_bestbuy-com.py" {3-5}
client = alterlab.Client("YOUR_API_KEY")
response = client.scrape("https://www.bestbuy.com/site/apple-iphone-15-pro-128gb-black-titanium/6501342.p")
print(response.text)
```javascript title="scrape_bestbuy-com.js" {3-5}
const client = new AlterLab({ apiKey: "YOUR_API_KEY" });
const response = await client.scrape("https://www.bestbuy.com/site/apple-iphone-15-pro-128gb-black-titanium/6501342.p");
console.log(response.text);
```bash title="Terminal"
curl -X POST https://api.alterlab.io/v1/scrape \
-H "X-API-Key: YOUR_KEY" \
-d '{"url": "https://www.bestbuy.com/site/apple-iphone-15-pro-128gb-black-titanium/6501342.p"}'
## Extracting structured data
AlterLab returns raw HTML by default. Use CSS selectors to extract specific public data points:
```python title="parse_bestbuy-com.py"
from parsel import Selector
client = alterlab.Client("YOUR_API_KEY")
html = client.scrape("https://www.bestbuy.com/site/apple-iphone-15-pro-128gb-black-titanium/6501342.p").text
selector = Selector(text=html)
title = selector.css(".sku-header h1::text").get()
price = selector.css(".price-current .sr-only::text").get()
rating = selector.css(".rating-stars::attr('aria-label')").get()
print({"title": title.strip() if title else None,
"price": price,
"rating": rating})
Structured JSON extraction with Cortex
For typed data without parsing HTML, use AlterLab's Cortex AI extraction:
```python title="extract_bestbuy-com_structured.py"
client = alterlab.Client("YOUR_API_KEY")
result = client.extract(
url="https://www.bestbuy.com/site/apple-iphone-15-pro-128gb-black-titanium/6501342.p",
schema={
"type": "object",
"properties": {
"title": {"type": "string"},
"price": {"type": "number"},
"rating": {"type": "number"},
"availability": {"type": "string"},
"sku": {"type": "string"}
}
}
)
print(result.data) # Typed JSON output: {"title": "...", "price": 999.99, ...}
## Cost breakdown
AlterLab auto-escalates tiers — start at T1 and pay only for the tier that succeeds. For Best Buy product pages (standard anti-bot protections), expect T2 or T3 tiers. See [AlterLab pricing](/pricing) for full details.
| Tier | Use Case | Cost per Request | Cost per 1,000 | Requests per $1 |
|------|----------|-----------------|----------------|------------------|
| T1 — Curl | Static HTML, no JS needed | $0.0002 | $0.20 | 5,000 |
| T2 — HTTP | Standard pages with headers | $0.0003 | $0.30 | 3,333 |
| T3 — Stealth | Protected pages, anti-bot active | $0.002 | $2.00 | 500 |
| T4 — Browser | Full JS rendering required | $0.004 | $4.00 | 250 |
| T5 — CAPTCHA | CAPTCHA solving + JS rendering | $0.02 | $20.00 | 50 */
<div data-infographic="stats">
<div data-stat data-value="99999.2%" data-label="Success Rate"></div>
<div data-stat data-value="1.2s" data-label="Avg Response"></div>
<div data-stat data-value="$0.002" data-label="Per Request (T3)"></div>
</div>
## Best practices
- **Rate limiting**: Start with 1 request/second, adjust based on response headers
- **Robots.txt**: Check `https://www.bestbuy.com/robots.txt` for crawl delays and disallowed paths
- **Dynamic content**: Use Cortex AI or wait for network idle state instead of fixed timeouts
- **Error handling**: Implement retry logic with exponential backoff for 429/5xx responses
- **Data freshness**: For price monitoring, schedule requests during off-peak hours (2-5 AM local store time)
## Scaling up
For large-scale data collection:
- **Batch requests**: Use AlterLab's batch endpoint (up to 100 URLs/request)
- **Scheduling**: Implement cron-based scrapes via AlterLab's scheduling feature
- **Storage**: Stream results directly to data warehouses or cloud storage
- **Monitoring**: Set up alerts for failed requests or data anomalies
<div data-infographic="steps">
<div data-step data-number="1" data-title="Configure scraper" data-title="Configure scraper" data-description="Set URL, parameters, and extraction schema"></div>
<div data-step data-number="2" data-title="Execute request" data-description="AlterLab handles tier selection and anti-bot"></div>
<div data-step data-number="3" data-title="Process results" data-description="Store structured JSON or trigger webhooks"></div>
</div>
## Key takeaways
- AlterLab simplifies Best Buy scraping by managing anti-bot, proxies, and rendering
- Extract public product data via CSS selectors or Cortex AI for type-safe JSON
- Costs scale with complexity: $0.0002-$0.004/request depending on required tier
- Always comply with robots.txt, rate limits, and Terms of Service
- See the [Best Buy scraping guide](/scrape/best-buy) for advanced patterns
<div data-infographic="try-it" data-url="https://bestbuy.com" data-description="Try scraping Best Buy with AlterLab"></div>
Hit reply if you have questions.
Top comments (0)