DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Designing AI agents that can use live web data
anakin_writers profile

Designing AI agents that can use live web data

#ai #webscraping #automation #api
Comments 1
4 min read
I pulled the full ingredient lists of Olive Young's top 100 serums. 71 of them contain niacinamide.
cocomoon profile
MOON

I pulled the full ingredient lists of Olive Young's top 100 serums. 71 of them contain niacinamide.

#showdev #datascience #webscraping #korea
1
Comments
4 min read
10,000 popular Shopify stores: e-mails, socials, shipping and discounts (October 2026)
insanedevhq profile

10,000 popular Shopify stores: e-mails, socials, shipping and discounts (October 2026)

#shopify #ecommerce #data #webscraping
Comments
5 min read
Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python
captainhandsome profile

Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python

#python #datascience #webscraping #automation
Comments 1
2 min read
Ask Threads for 50 Replies and Half of What Comes Back Is Other People's Posts
matveyg profile

Ask Threads for 50 Replies and Half of What Comes Back Is Other People's Posts

#webscraping #api #data #node
Comments
6 min read
A Threads Search Result Is a Thread, Not a Post
matveyg profile

A Threads Search Result Is a Thread, Not a Post

#webscraping #javascript #data #api
Comments
6 min read
I stopped checking competitor Shopify stores by hand. Here's what I use instead
ivanpetrus profile

I stopped checking competitor Shopify stores by hand. Here's what I use instead

#shopify #ecommerce #python #webscraping
Comments
3 min read
Checking hotel prices on every booking site at once (and catching rate parity problems)
ivanpetrus profile

Checking hotel prices on every booking site at once (and catching rate parity problems)

#travel #python #webscraping #automation
Comments 1
3 min read
Three Playwright/Apify bugs that took me way too long to find (and the fixes)
donerightlabs profile

Three Playwright/Apify bugs that took me way too long to find (and the fixes)

#automation #debugging #programming #webscraping
Comments
4 min read
407 Proxy Authentication Required: causes and client fixes
proxymint profile

407 Proxy Authentication Required: causes and client fixes

#proxies #webscraping #tutorial #devops
Comments 2
2 min read
Zillow Ships One Schema and Two Datasets: Sale Pages and Rental Pages Fill Different Fields
matveyg profile

Zillow Ships One Schema and Two Datasets: Sale Pages and Rental Pages Fill Different Fields

#python #webscraping #api #data
Comments
6 min read
Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment
marcos_faccindasilva_c3 profile

Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

#webscraping #automation #api #python
Comments
2 min read
How to find every Shopify store in a list of 10,000 domains
clearfetch profile

How to find every Shopify store in a list of 10,000 domains

#webscraping #api #saas #javascript
Comments
3 min read
Tennis, football and basketball results as clean JSON, without a sports data contract
clearfetch profile

Tennis, football and basketball results as clean JSON, without a sports data contract

#api #webscraping #sports #python
Comments
4 min read
LinkedIn's Own JSON-LD Lists One of Satya Nadella's Three Schools
matveyg profile
Matvey

LinkedIn's Own JSON-LD Lists One of Satya Nadella's Three Schools

#javascript #webscraping #api #webdev
Comments 2
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.