DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to pull public emails and social links from a list of company websites with Python
emirmrkaljevic profile

How to pull public emails and social links from a list of company websites with Python

#python #webscraping #leadgen #tutorial
Comments
6 min read
An isinstance(str) check that was always False capped every Facebook Page at exactly 3 posts
devil_scrapes profile

An isinstance(str) check that was always False capped every Facebook Page at exactly 3 posts

#webscraping #python #api #debugging
Comments
4 min read
Building a Self-Healing Scraper: Let AI Fix Your Selectors When Sites Change
ahmed_shamandy_17cae30af0 profile

Building a Self-Healing Scraper: Let AI Fix Your Selectors When Sites Change

#python #webscraping #ai #tutorial
Comments
6 min read
I Broke My Instagram Giveaway Picker With Rate Limits — Here’s What I Learned
tay_clompson_122f694e0475 profile

I Broke My Instagram Giveaway Picker With Rate Limits — Here’s What I Learned

#python #webscraping #api
Comments
2 min read
Designing Apify Actors that AI agents actually pick (and can afford)
locaihost_data profile

Designing Apify Actors that AI agents actually pick (and can afford)

#apify #ai #mcp #webscraping
Comments 10
10 min read
My URL-to-Markdown API served a nav menu as an 'article' — detecting JS-rendered SPA shell pages
imapphelp profile
InApp

My URL-to-Markdown API served a nav menu as an 'article' — detecting JS-rendered SPA shell pages

#webscraping #rag #markdown #ai
Comments 1
2 min read
Let Claude Desktop or Cursor run Apify actors: MCP setup with two real examples
jeezleweez_71e2a581f71298 profile

Let Claude Desktop or Cursor run Apify actors: MCP setup with two real examples

#mcp #ai #webscraping #tutorial
Comments 1
3 min read
Rotating vs. Sticky Proxy Sessions: Which One Should You Use for Web Scraping?
emily_907ad7e854942748eb profile

Rotating vs. Sticky Proxy Sessions: Which One Should You Use for Web Scraping?

#discuss #webscraping #programming #tutorial
3
Comments
4 min read
Cómo solucionar el error “Enable JavaScript and cookies to continue”
erickeduardoramos03 profile

Cómo solucionar el error “Enable JavaScript and cookies to continue”

#javascript #security #webscraping
Comments
3 min read
Proxies for AI agents: giving an agent reliable web access
proxymint profile

Proxies for AI agents: giving an agent reliable web access

#proxies #webscraping #tutorial #devops
Comments
2 min read
Proxies in Java: Setting Up HttpClient and OkHttp
proxiesthatwork profile

Proxies in Java: Setting Up HttpClient and OkHttp

#java #proxies #tutorial #webscraping
Comments
4 min read
Jev, the model that cannot write a word, and where it fits in web scraping (does it?)
iayanpahwa profile

Jev, the model that cannot write a word, and where it fits in web scraping (does it?)

#ai #webscraping #python #machinelearning
1
Comments
12 min read
Four ways an invisible character makes a scraper return zero rows — all found in our own code
fetchsmith profile

Four ways an invisible character makes a scraper return zero rows — all found in our own code

#webscraping #javascript #api #debugging
Comments 2
7 min read
Proxies for AI training data: throughput, sizing and rules
proxymint profile

Proxies for AI training data: throughput, sizing and rules

#proxies #webscraping #tutorial #devops
Comments
2 min read
How to Build an Anti-Bot Web Scraping MCP Server for Claude & Cursor with Clean Markdown Extraction in Python
johann_schiffer profile

How to Build an Anti-Bot Web Scraping MCP Server for Claude & Cursor with Clean Markdown Extraction in Python

#mcp #webscraping #python #ai
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.