DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a Lightning-Fast NSE Stock Data Scraper: From API Calls to Full-Stack Web App

Building a Lightning-Fast NSE Stock Data Scraper: From API Calls to Full-Stack Web App

Comments
6 min read
Automated Web Scraping: Building Smarter Data Pipelines Without Manual Effort

Automated Web Scraping: Building Smarter Data Pipelines Without Manual Effort

Comments
4 min read
Scraping JavaScript-Rendered Web Pages with Python

Scraping JavaScript-Rendered Web Pages with Python

Comments
5 min read
Crafting a Monster Hunter Wilds AI Assistant: Scrapy, Vector Search & Prompt Engineering

Crafting a Monster Hunter Wilds AI Assistant: Scrapy, Vector Search & Prompt Engineering

Comments
8 min read
Aura – Like robots.txt, but for AI actions

Aura – Like robots.txt, but for AI actions

1
Comments
9 min read
Scrape YouTube videos in Python

Scrape YouTube videos in Python

Comments
2 min read
Best SERP APIs for Developers in 2025

Best SERP APIs for Developers in 2025

1
Comments
3 min read
5 Things You Should Know About SafeLine WAF

5 Things You Should Know About SafeLine WAF

5
Comments
2 min read
Building a Discord Controlled Web Scraper with Scrapy & Zyte API

Building a Discord Controlled Web Scraper with Scrapy & Zyte API

Comments 1
12 min read
How to Extract YouTube Video Details Using Puppeteer

How to Extract YouTube Video Details Using Puppeteer

Comments
7 min read
How to Extract YouTube Shorts Video Details Using Puppeteer

How to Extract YouTube Shorts Video Details Using Puppeteer

Comments
7 min read
Data Extraction in Automated Workflows: The Competitive Edge

Data Extraction in Automated Workflows: The Competitive Edge

39
Comments 15
5 min read
What if every time your content made an AI smarter—or more profitable—you got paid?

What if every time your content made an AI smarter—or more profitable—you got paid?

Comments
1 min read
Automating my University's STS Course & Lecturer Evaluation Process with Python + Selenium

Automating my University's STS Course & Lecturer Evaluation Process with Python + Selenium

Comments 3
1 min read
One Workflow to Scrape ANY Job Board or Career Page of any company

n8n and Bright Challenge: Unstoppable Workflow

One Workflow to Scrape ANY Job Board or Career Page of any company

9
Comments 2
2 min read
Robots are not that bad

Robots are not that bad

1
Comments
2 min read
Benchmarking LLM Search APIs: Tavily vs Web Search Plus vs OpenAI Web Search

Benchmarking LLM Search APIs: Tavily vs Web Search Plus vs OpenAI Web Search

Comments
4 min read
Transformando Trabalho em Conteúdo: Gerando Pautas para Lives com Python, RSS e Reddit

Transformando Trabalho em Conteúdo: Gerando Pautas para Lives com Python, RSS e Reddit

Comments
4 min read
Simple Auto Login Bot

Simple Auto Login Bot

11
Comments 2
2 min read
HasData vs Oxylabs vs ScrapingBee: Cost, Reliability & Output Quality

HasData vs Oxylabs vs ScrapingBee: Cost, Reliability & Output Quality

1
Comments
2 min read
🕵️‍♂️ Social Media First Post Finder

🕵️‍♂️ Social Media First Post Finder

Comments
1 min read
🔎 CloakDetect: Revealing the Hidden Side of the Web

🔎 CloakDetect: Revealing the Hidden Side of the Web

1
Comments
1 min read
Building a Production-Ready Apple Store Reviews Scraper with Python & Scrapy

Building a Production-Ready Apple Store Reviews Scraper with Python & Scrapy

Comments
7 min read
Scylla: A Proxy Pool Solution for Web Scraping

Scylla: A Proxy Pool Solution for Web Scraping

Comments
1 min read
G2.com Scraping: Handling Anti-Bot Measures with Scrapy

G2.com Scraping: Handling Anti-Bot Measures with Scrapy

Comments
4 min read
loading...