Crawlee is the scraping framework behind Apify: auto-retries, proxy rotation, request queuing, anti-bot evasion — all built in.
import { PlaywrightCrawler } from 'crawlee'
const crawler = new PlaywrightCrawler({
async requestHandler({ page }) {
const products = await page.$$eval('.product', cards =>
cards.map(c => ({ name: c.querySelector('h2')?.textContent }))
)
await Dataset.pushData(products)
}
})
await crawler.run(['https://example.com'])
Production-ready scraping without months of infrastructure work.
Need to automate data collection or build custom scrapers? Check out my Apify actors for ready-made tools, or email spinov001@gmail.com for custom solutions.
Top comments (0)