DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
A finished scraper sat on a git branch for 19 days. Nothing noticed.
devil_scrapes profile

A finished scraper sat on a git branch for 19 days. Nothing noticed.

#webscraping #python #git #devops
Comments
5 min read
Designing AI agents that can use live web data
anakin_writers profile

Designing AI agents that can use live web data

#ai #webscraping #automation #api
Comments 1
4 min read
I pulled the full ingredient lists of Olive Young's top 100 serums. 71 of them contain niacinamide.
cocomoon profile
MOON

I pulled the full ingredient lists of Olive Young's top 100 serums. 71 of them contain niacinamide.

#showdev #datascience #webscraping #korea
1
Comments
4 min read
Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python
captainhandsome profile

Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python

#python #datascience #webscraping #automation
Comments 1
2 min read
Three Playwright/Apify bugs that took me way too long to find (and the fixes)
donerightlabs profile

Three Playwright/Apify bugs that took me way too long to find (and the fixes)

#automation #debugging #programming #webscraping
Comments
4 min read
Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment
marcos_faccindasilva_c3 profile

Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

#webscraping #automation #api #python
Comments
2 min read
Tennis, football and basketball results as clean JSON, without a sports data contract
clearfetch profile

Tennis, football and basketball results as clean JSON, without a sports data contract

#api #webscraping #sports #python
Comments
4 min read
How to find every Shopify store in a list of 10,000 domains
clearfetch profile

How to find every Shopify store in a list of 10,000 domains

#webscraping #api #saas #javascript
Comments
3 min read
Tracking which companies are hiring (Greenhouse, Lever, Ashby, Workday) as a sales signal with Python
ivanpetrus profile

Tracking which companies are hiring (Greenhouse, Lever, Ashby, Workday) as a sales signal with Python

#python #sales #webscraping #tutorial
Comments 1
9 min read
Remote Job Aggregators on Apify Compared (September 2026)
7_akariae profile

Remote Job Aggregators on Apify Compared (September 2026)

#webscraping #api #python #career
Comments
6 min read
"A Raw JSON Textarea Was Quietly Costing Me Users"
timmkal01 profile

"A Raw JSON Textarea Was Quietly Costing Me Users"

#buildinpublic #webscraping #api #ux
1
Comments 4
2 min read
How I scrape any website in under 5 minutes (Python + Playwright)
praman profile

How I scrape any website in under 5 minutes (Python + Playwright)

#python #tutorial #webdev #webscraping
9
Comments 20
4 min read
How to find AliExpress best sellers for a keyword, with sold counts and ratings
furqan_ahmed profile

How to find AliExpress best sellers for a keyword, with sold counts and ratings

#python #webscraping #ecommerce #api
Comments 1
8 min read
pytrends keeps returning 429? Get Google Trends data from Python with one API call
hiver profile
hiver

pytrends keeps returning 429? Get Google Trends data from Python with one API call

#python #datascience #api #webscraping
Comments
5 min read
Headless browsers vs. SERP APIs: Why your Playwright scraper fails in production
eunit profile

Headless browsers vs. SERP APIs: Why your Playwright scraper fails in production

#playwright #dataextraction #serpapi #webscraping
5
Comments
15 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.