DEV Community

# webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Built 3 APIs for Turkey’s Used-Car Market with Apify

I Built 3 APIs for Turkey’s Used-Car Market with Apify

Comments
4 min read
CSS Selectors Keep Breaking? Why It Happens and How to Fix It

CSS Selectors Keep Breaking? Why It Happens and How to Fix It

1
Comments
9 min read
Building a Price Tracker with Python and BeautifulSoup

Building a Price Tracker with Python and BeautifulSoup

1
Comments
5 min read
Scraped 300 pages successfully. Site updated robots.txt at page 187 and blocked me.

Scraped 300 pages successfully. Site updated robots.txt at page 187 and blocked me.

Comments 1
2 min read
The Complete Guide to Web Scraping in 2026: Tools, Techniques, and Real-World Projects

The Complete Guide to Web Scraping in 2026: Tools, Techniques, and Real-World Projects

2
Comments
7 min read
Pass Python Requests to PHP via PSR-7 Message Format

Pass Python Requests to PHP via PSR-7 Message Format

1
Comments
3 min read
How to Handle Pagination in Web Scraping (2026 Guide)

How to Handle Pagination in Web Scraping (2026 Guide)

Comments
3 min read
Stop Breaking Your Pipeline: Using Schema Validation to Clean Scraped Zappos Data

Stop Breaking Your Pipeline: Using Schema Validation to Clean Scraped Zappos Data

1
Comments
4 min read
How to Scrape Twitter/X Without an API Key in Python (2026 Guide)

How to Scrape Twitter/X Without an API Key in Python (2026 Guide)

1
Comments
5 min read
Refactoring the Nike Scraper: Replacing In-Memory Deduplication with SQLite

Refactoring the Nike Scraper: Replacing In-Memory Deduplication with SQLite

2
Comments
4 min read
Feed Rescue: Converting Raw Ulta Scrapes into Google Merchant Center XML

Feed Rescue: Converting Raw Ulta Scrapes into Google Merchant Center XML

1
Comments
5 min read
How We Built an Autonomous Growth Engine with OpenClaw, MCP, and Clura

How We Built an Autonomous Growth Engine with OpenClaw, MCP, and Clura

1
Comments
15 min read
When Your AI Pipeline Hits the Wall

When Your AI Pipeline Hits the Wall

1
Comments
3 min read
Selenium vs Playwright in 2026: Which Should You Use for Web Scraping?

Selenium vs Playwright in 2026: Which Should You Use for Web Scraping?

2
Comments 1
5 min read
How to Bypass Akamai Bot Detection in 2026

How to Bypass Akamai Bot Detection in 2026

1
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.