DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Handle JavaScript-Rendered Pages Without a Full Browser
john_rooney profile

How to Handle JavaScript-Rendered Pages Without a Full Browser

#webscraping #python #zyte #programming
Comments
5 min read
How to Store What You Scrape (Without Making a Mess)
john_rooney profile

How to Store What You Scrape (Without Making a Mess)

#webscraping #python #zyte #progrmaming
Comments
5 min read
Why Your Scraper Works in the Browser But Fails in Python
john_rooney profile

Why Your Scraper Works in the Browser But Fails in Python

#webscraping #python #zyte #programming
Comments
7 min read
How to Scrape RedNote (Xiaohongshu) Without Coding
gary_lee_fa84612d248568a4 profile

How to Scrape RedNote (Xiaohongshu) Without Coding

#automation #socialmedia #tutorial #webscraping
Comments
4 min read
How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it
sami_8858131362756585e4f4 profile
Sami

How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it

#china #webscraping #python #datascience
Comments
4 min read
Bing Search API Replacement: scrape SERP results for $1.05/1K
devil_scrapes profile

Bing Search API Replacement: scrape SERP results for $1.05/1K

#webscraping #python #apify #seo
Comments
7 min read
Google AI Overview Tracker: 8-selector battery + citation drift telemetry
devil_scrapes profile

Google AI Overview Tracker: 8-selector battery + citation drift telemetry

#webscraping #seo #python #apify
Comments
8 min read
How to Scrape Reddit Without the API (After the 2023 Price Changes)
odeeb profile

How to Scrape Reddit Without the API (After the 2023 Price Changes)

#webscraping #python #api #datascience
Comments
6 min read
A free proxy list that's actually checked (HTTP/SOCKS4/SOCKS5, updated every 30 min)
devyjones profile
Billy

A free proxy list that's actually checked (HTTP/SOCKS4/SOCKS5, updated every 30 min)

#proxy #python #webscraping #opensource
Comments
2 min read
Rotating proxies for Scrapy, Playwright and requests — one small library
devyjones profile
Billy

Rotating proxies for Scrapy, Playwright and requests — one small library

#python #webscraping #scrapy #proxy
Comments
3 min read
Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K
devil_scrapes profile

Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K

#webscraping #python #apify #data
Comments
7 min read
Bluesky Starter Pack Scraper: export any community list for $2.05/1K
devil_scrapes profile

Bluesky Starter Pack Scraper: export any community list for $2.05/1K

#webscraping #python #apify #data
Comments
8 min read
DEV.to Scraper: pull articles by tag, author, or feed into clean JSON
devil_scrapes profile

DEV.to Scraper: pull articles by tag, author, or feed into clean JSON

#webscraping #python #apify #data
Comments
8 min read
ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K
devil_scrapes profile

ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K

#webscraping #python #apify #data
Comments
8 min read
arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K
devil_scrapes profile

arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

#webscraping #python #apify
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.