DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

Comments
4 min read
How to find Dubai jobs before they appear on job boards

How to find Dubai jobs before they appear on job boards

Comments
3 min read
The same job is posted on three boards. Here's how to deduplicate job listings properly.

The same job is posted on three boards. Here's how to deduplicate job listings properly.

Comments
3 min read
Web Scraping with Playwright: Handle Any Website

Web Scraping with Playwright: Handle Any Website

Comments
4 min read
Reducing Browser Fingerprint Detection Starts With Consistency

Reducing Browser Fingerprint Detection Starts With Consistency

Comments
5 min read
Track new job postings the week they appear, with a scheduled scraper and a diff

Track new job postings the week they appear, with a scheduled scraper and a diff

Comments
4 min read
Give Your AI Agent a Web Scraper, Not Just a Browser

Give Your AI Agent a Web Scraper, Not Just a Browser

7
Comments 1
4 min read
Trendigger – Aggregated Google Trends with AI keyword summaries and daily historical archives

Trendigger – Aggregated Google Trends with AI keyword summaries and daily historical archives

Comments
1 min read
Your scraping framework already exists: it's Scrapy

Your scraping framework already exists: it's Scrapy

1
Comments
14 min read
How to use Camoufox with Scrapy (New EASY Method)

How to use Camoufox with Scrapy (New EASY Method)

Comments
7 min read
How to stop LLMs from hallucinating on complex HTML tables (Python)

How to stop LLMs from hallucinating on complex HTML tables (Python)

Comments
3 min read
Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Comments
2 min read
Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Comments
2 min read
Build a SHEIN price tracker in 20 minutes with n8n and an Apify actor

Build a SHEIN price tracker in 20 minutes with n8n and an Apify actor

Comments
4 min read
Rotating Residential Proxies in Python: requests, Scrapy & Sticky Sessions

Rotating Residential Proxies in Python: requests, Scrapy & Sticky Sessions

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.