DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Reddit RSS ends Nov 13: keep a feed of new subreddit posts
benthepythondev profile
Ben

Reddit RSS ends Nov 13: keep a feed of new subreddit posts

#reddit #rss #automation #webscraping
Comments
4 min read
UK company directors as clean JSON from Companies House: current or full history, no dates of birth
rowcraft profile

UK company directors as clean JSON from Companies House: current or full history, no dates of birth

#webscraping #data #api #uk
Comments
2 min read
Get the open jobs of any company from its website: Greenhouse, Lever, Ashby or Workday detected for you
rowcraft profile

Get the open jobs of any company from its website: Greenhouse, Lever, Ashby or Workday detected for you

#webscraping #jobs #api #automation
Comments
2 min read
reCAPTCHA v2 in Puppeteer: solve the checkbox with an API (no plugin) and submit the token
bshahin profile

reCAPTCHA v2 in Puppeteer: solve the checkbox with an API (no plugin) and submit the token

#javascript #puppeteer #webscraping #captcha
Comments
11 min read
CommonSpirit Health, Crunch Fitness and The Joint jobs API: the pay in a job page's schema.org markup
glitchbound profile

CommonSpirit Health, Crunch Fitness and The Joint jobs API: the pay in a job page's schema.org markup

#api #python #webscraping #career
Comments
3 min read
Rippling, Carbon Health and Barry's jobs API: the pay in each job's own record, one location at a time
glitchbound profile

Rippling, Carbon Health and Barry's jobs API: the pay in each job's own record, one location at a time

#api #python #webscraping #career
Comments
4 min read
Publix, General Atomics and Hobby Lobby jobs API: BrassRing job details and the pay questions each employer names
glitchbound profile

Publix, General Atomics and Hobby Lobby jobs API: BrassRing job details and the pay questions each employer names

#api #python #webscraping #career
Comments
3 min read
How to Scrape Bilibili Comments, Danmaku and UP主 Data in Python (2026, No Login)
meme_india_eeebe519dd204a profile

How to Scrape Bilibili Comments, Danmaku and UP主 Data in Python (2026, No Login)

#python #ai #productivity #webscraping
1
Comments
4 min read
How Much Does a Custom Web Scraper Cost to Build?
aqib_javaid profile

How Much Does a Custom Web Scraper Cost to Build?

#webscraping #dataengineering #datapipelines #softwareestimation
Comments 1
6 min read
How to monitor your competitors' Google Ads with the Ads Transparency Center (API, no login)
ociusdata profile

How to monitor your competitors' Google Ads with the Ads Transparency Center (API, no login)

#marketing #python #api #webscraping
Comments 2
4 min read
Build a list of niche Shopify stores as a CSV
hapoldata profile

Build a list of niche Shopify stores as a CSV

#shopify #ecommerce #csv #webscraping
Comments 2
3 min read
Google Gave Me 62 Days of Flight Price History. 23 of My 30 Reads Dated Today as Yesterday
matveyg profile
Matvey

Google Gave Me 62 Days of Flight Price History. 23 of My 30 Reads Dated Today as Yesterday

#api #python #webscraping #travel
Comments 2
6 min read
Simple DeepSeek web search cli written in TypeScript. Cheap + fast search tool for agents (built on DS web search API)
laishglenberg profile

Simple DeepSeek web search cli written in TypeScript. Cheap + fast search tool for agents (built on DS web search API)

#deepseek #ai #webscraping #agents
Comments
1 min read
What 34 tech companies say they pay software engineers (from 1,067 job postings)
devcolton profile

What 34 tech companies say they pay software engineers (from 1,067 job postings)

#career #data #webscraping #python
Comments
3 min read
Reading one legally required sentence from 31 broker websites
tradinglookup profile

Reading one legally required sentence from 31 broker websites

#python #webscraping #opendata #datascience
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.