DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
pytrends is dead. Here's a maintained drop-in replacement
leewilliam200 profile

pytrends is dead. Here's a maintained drop-in replacement

#python #opensource #webscraping #api
Comments
2 min read
Scraping YouTube transcripts at scale for RAG (and the 3 things that break it)
casaucao profile

Scraping YouTube transcripts at scale for RAG (and the 3 things that break it)

#python #webscraping #llm #ai
Comments 1
4 min read
Export Olive Young and Naver Shopping reviews into one JSON schema
webistudio_kr profile

Export Olive Young and Naver Shopping reviews into one JSON schema

#webscraping #api #javascript #tutorial
Comments
2 min read
Scraping Google News search results with the public RSS feed (no API key, no browser)
siftwright profile

Scraping Google News search results with the public RSS feed (no API key, no browser)

#webscraping #javascript #node #tutorial
Comments
3 min read
Google Ads Transparency Center API: export a competitor's Google ads
garje profile

Google Ads Transparency Center API: export a competitor's Google ads

#marketing #python #api #webscraping
5
Comments 4
3 min read
10,000 popular Shopify stores: e-mails, socials, shipping and discounts (October 2026)
insanedevhq profile

10,000 popular Shopify stores: e-mails, socials, shipping and discounts (October 2026)

#shopify #ecommerce #data #webscraping
Comments
5 min read
Apple's app review RSS feed is empty now — here's what the App Store itself uses
chorelet profile

Apple's app review RSS feed is empty now — here's what the App Store itself uses

#webscraping #aso #ios #python
Comments
4 min read
Korean cosmetic labels are in Korean. I mapped 50,000 ingredient entries to English INCI names — here's what matched and what broke.
cocomoon profile
MOON

Korean cosmetic labels are in Korean. I mapped 50,000 ingredient entries to English INCI names — here's what matched and what broke.

#showdev #datascience #webscraping #korea
1
Comments
4 min read
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You
yuhehe profile

Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You

#python #softwaredevelopment #webscraping
Comments 1
2 min read
I checked a million free proxies. One in five of the working ones rewrote my pages.
taventix profile
Maxi

I checked a million free proxies. One in five of the working ones rewrote my pages.

#python #opensource #security #webscraping
Comments
3 min read
LinkedIn's Own JSON-LD Lists One of Satya Nadella's Three Schools
nikita_iakovlev_415524c19 profile

LinkedIn's Own JSON-LD Lists One of Satya Nadella's Three Schools

#javascript #webscraping #api #webdev
Comments 2
6 min read
Apple's review feed went quiet, and my scraper believed it
garje profile

Apple's review feed went quiet, and my scraper believed it

#api #debugging #programming #webscraping
1
Comments 1
7 min read
AI Agent Web Scraping Playwright: Zero-Cost 45s Blueprint
umair24171 profile

AI Agent Web Scraping Playwright: Zero-Cost 45s Blueprint

#aiagents #webscraping #playwright #node
1
Comments
8 min read
I searched Google Hotels for a city that does not exist. It found five hotels.
garje profile

I searched Google Hotels for a city that does not exist. It found five hotels.

#debugging #python #testing #webscraping
Comments
7 min read
Proxy bills are up and AI scraping is coming. What that means if you sell Apify Actors
ispyhumanfly profile

Proxy bills are up and AI scraping is coming. What that means if you sell Apify Actors

#showdev #webscraping #apify #ai
1
Comments 1
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.