DEV Community

Greta profile picture

Greta

404 bio not found

Joined Joined on 
Politeness Is Measured at the Origin: A Global Budget That Doesn't Grow With Your Proxy Pool

Politeness Is Measured at the Origin: A Global Budget That Doesn't Grow With Your Proxy Pool

Comments
6 min read

Want to connect with Greta?

Create an account to connect with Greta. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
The CAPTCHA Is Addressed to the IP: Differential Diagnosis With Paired Requests Across Exits

The CAPTCHA Is Addressed to the IP: Differential Diagnosis With Paired Requests Across Exits

Comments
5 min read
429s Belong to the Exit, Not the Worker: Per-IP Token Buckets for Rotating Proxy Pools

429s Belong to the Exit, Not the Worker: Per-IP Token Buckets for Rotating Proxy Pools

Comments
6 min read
Does Your Proxy Rewrite Your Handshake? Auditing HTTP/2 Fingerprint Integrity Across Exit Tiers

Does Your Proxy Rewrite Your Handshake? Auditing HTTP/2 Fingerprint Integrity Across Exit Tiers

Comments
6 min read
Rotate More Than the IP: Matching TLS Fingerprint Variety to Your Proxy Exits

Rotate More Than the IP: Matching TLS Fingerprint Variety to Your Proxy Exits

Comments
6 min read
Cache Before You Route: The Cheapest Proxy GB Is the One You Never Fetch

Cache Before You Route: The Cheapest Proxy GB Is the One You Never Fetch

Comments
6 min read
ISP Proxies: The Undocumented Middle Tier Between Datacenter and Residential

ISP Proxies: The Undocumented Middle Tier Between Datacenter and Residential

Comments
6 min read
Treat Proxy IPs Like Milk, Not Hardware: A Decay Model and Health Scorecard for Your Pool

Treat Proxy IPs Like Milk, Not Hardware: A Decay Model and Health Scorecard for Your Pool

Comments
6 min read
Sticky Sessions and Static Residential IPs Solve Different Problems (Most Teams Pick Wrong)

Sticky Sessions and Static Residential IPs Solve Different Problems (Most Teams Pick Wrong)

Comments
6 min read
Stop Picking One Proxy Tier: Route by Endpoint Defense Level Instead

Stop Picking One Proxy Tier: Route by Endpoint Defense Level Instead

Comments
6 min read
Politeness at Scale: Coordinating Per-Domain Rate Limits Across Every Worker You Run

Politeness at Scale: Coordinating Per-Domain Rate Limits Across Every Worker You Run

Comments
7 min read
Your CAPTCHA Rate Is a Metric: Telemetry-Driven Challenge Avoidance in Python

Your CAPTCHA Rate Is a Metric: Telemetry-Driven Challenge Avoidance in Python

Comments
7 min read
The 429 Is Feedback: Building an Adaptive Concurrency Controller for Python Scrapers

The 429 Is Feedback: Building an Adaptive Concurrency Controller for Python Scrapers

Comments
7 min read
Fingerprint Coherence: Why a Perfect JA3 Still Gets You Blocked

Fingerprint Coherence: Why a Perfect JA3 Still Gets You Blocked

Comments
7 min read
Does Your TLS Impersonation Actually Work? Building a Fingerprint Conformance Test for Your Scraper

Does Your TLS Impersonation Actually Work? Building a Fingerprint Conformance Test for Your Scraper

Comments
7 min read
Your Scraper Logged Out Three Days Ago and You Didn't Notice: Debugging Authenticated Sessions

Your Scraper Logged Out Three Days Ago and You Didn't Notice: Debugging Authenticated Sessions

Comments
6 min read
Beyond the IP: Auditing Your Own Pipeline for Cross-Account Correlation Leaks

Beyond the IP: Auditing Your Own Pipeline for Cross-Account Correlation Leaks

Comments
6 min read
How Long Should You Hold an IP? Sizing Sticky Windows with Data Instead of Vibes

How Long Should You Hold an IP? Sizing Sticky Windows with Data Instead of Vibes

Comments
6 min read
The Birthday Problem in Proxy Pools: Why Two of Your Accounts Will Share an IP

The Birthday Problem in Proxy Pools: Why Two of Your Accounts Will Share an IP

Comments
7 min read
Checkpointing Scraper Sessions: Surviving Crashes Without Re-Logging In

Checkpointing Scraper Sessions: Surviving Crashes Without Re-Logging In

Comments
6 min read
One URL, Four Countries, Four Answers: A Controlled Geo-Divergence Experiment in Python

One URL, Four Countries, Four Answers: A Controlled Geo-Divergence Experiment in Python

Comments
6 min read
Same City, Different Internet: Detecting ISP-Level Content Splits in Your Scraping Pipeline

Same City, Different Internet: Detecting ISP-Level Content Splits in Your Scraping Pipeline

Comments
6 min read
Every Row Needs a Geo Stamp: Designing the Geography Fields of a Scraping Pipeline

Every Row Needs a Geo Stamp: Designing the Geography Fields of a Scraping Pipeline

Comments
6 min read
The Same Business, Thirty Cities: Measuring How Far Local Search Results Actually Diverge

The Same Business, Thirty Cities: Measuring How Far Local Search Results Actually Diverge

Comments
7 min read
Cost per Data Point: The Unit Economics of a Price-Monitoring Pipeline

Cost per Data Point: The Unit Economics of a Price-Monitoring Pipeline

Comments
8 min read
Snapshots Are Worthless, Deltas Are the Product: A Change-Detection Engine for Competitor Feeds

Snapshots Are Worthless, Deltas Are the Product: A Change-Detection Engine for Competitor Feeds

Comments
10 min read
One SKU, One Identity: Why Session Affinity Beats Rotation for Repeated Price Checks

One SKU, One Identity: Why Session Affinity Beats Rotation for Repeated Price Checks

Comments
8 min read
Extraction Rules as Versioned Config: Monitoring 50 Retailers Without 50 Codebases

Extraction Rules as Versioned Config: Monitoring 50 Retailers Without 50 Codebases

Comments
8 min read
Cells, Not Threads: A Failure-Isolation Architecture for Amazon Price Scrapers

Cells, Not Threads: A Failure-Isolation Architecture for Amazon Price Scrapers

Comments
9 min read
Your Scraper Did Not Get Blocked - It Got Soft-Blocked: A Field Guide to the Signals Beginners Miss

Your Scraper Did Not Get Blocked - It Got Soft-Blocked: A Field Guide to the Signals Beginners Miss

Comments
5 min read
Integrating Rotating Proxies into requests: Session-Level, Per-Request, or a Custom Adapter?

Integrating Rotating Proxies into requests: Session-Level, Per-Request, or a Custom Adapter?

Comments
5 min read
Let the Server Set Your Pace: Reading Rate-Limit Headers Before You Hit 429

Let the Server Set Your Pace: Reading Rate-Limit Headers Before You Hit 429

Comments
5 min read
Backpressure-Aware Async Crawling: Coupling Your aiohttp Semaphore to Proxy Health

Backpressure-Aware Async Crawling: Coupling Your aiohttp Semaphore to Proxy Health

Comments
5 min read
How to Buy Your First Residential Proxy Plan Without Wasting Money

How to Buy Your First Residential Proxy Plan Without Wasting Money

Comments
5 min read
Cost Optimization for Proxy Traffic: Cutting Your Per-GB Scraping Bill

Cost Optimization for Proxy Traffic: Cutting Your Per-GB Scraping Bill

Comments
5 min read
Session Management Patterns for Web Automation: Designing Identity Lifecycles

Session Management Patterns for Web Automation: Designing Identity Lifecycles

Comments
5 min read
ASN Targeting: Real Engineering Use Cases for Network-Level Data Collection

ASN Targeting: Real Engineering Use Cases for Network-Level Data Collection

Comments
6 min read
Datacenter vs Residential vs Mobile Proxies: A Deep Dive into IP Reputation Tiers

Datacenter vs Residential vs Mobile Proxies: A Deep Dive into IP Reputation Tiers

Comments
5 min read
Proxy vs VPN vs Tor for Data Collection: Which One Actually Fits Your Pipeline

Proxy vs VPN vs Tor for Data Collection: Which One Actually Fits Your Pipeline

Comments
6 min read
E-commerce Feed Monitoring for Sellers: Market Intelligence on Your Own SKUs

E-commerce Feed Monitoring for Sellers: Market Intelligence on Your Own SKUs

Comments
5 min read
News Monitoring in Multiple Languages: Geographic Variants and Cross-Language Story Clustering

News Monitoring in Multiple Languages: Geographic Variants and Cross-Language Story Clustering

Comments
6 min read
A Review Aggregation Pipeline: Multi-Platform Collection and Sentiment Preprocessing

A Review Aggregation Pipeline: Multi-Platform Collection and Sentiment Preprocessing

Comments
6 min read
Building a Job Market Data Pipeline: From ATS Endpoints to Salary Normalization

Building a Job Market Data Pipeline: From ATS Endpoints to Salary Normalization

Comments
6 min read
Real Estate Data Collection at Scale: Compliance, Anti-Bot Tactics, and Event-Driven Schemas

Real Estate Data Collection at Scale: Compliance, Anti-Bot Tactics, and Event-Driven Schemas

Comments
6 min read
Local SEO Auditing with Geo-Targeted Crawlers: Multi-City Rank Checking for Local Businesses

Local SEO Auditing with Geo-Targeted Crawlers: Multi-City Rank Checking for Local Businesses

Comments
8 min read
Understanding HTTP/2 Fingerprinting: What Your Scraper Leaks Above the TLS Layer

Understanding HTTP/2 Fingerprinting: What Your Scraper Leaks Above the TLS Layer

Comments
7 min read
Travel Fare Monitoring Architecture: The Geography and Timing Dimensions of Price Data

Travel Fare Monitoring Architecture: The Geography and Timing Dimensions of Price Data

Comments
7 min read
Building a Resilient Scraping Queue: Failure Isolation, Priority Lanes, and Backoff That Actually Works

Building a Resilient Scraping Queue: Failure Isolation, Priority Lanes, and Backoff That Actually Works

Comments
8 min read
Scraping JavaScript-Heavy SPAs: Render Timing, Wait Strategies, and When to Reverse the API

Scraping JavaScript-Heavy SPAs: Render Timing, Wait Strategies, and When to Reverse the API

Comments
8 min read
Data Freshness Strategies for ML Pipelines: Tiering Collection by Change Frequency

Data Freshness Strategies for ML Pipelines: Tiering Collection by Change Frequency

Comments 1
6 min read
Handling CAPTCHAs the Right Way: An Avoidance-First Strategy

Handling CAPTCHAs the Right Way: An Avoidance-First Strategy

Comments 1
6 min read
Building a Price Monitoring Pipeline for Non-Amazon Retailers: The General Architecture

Building a Price Monitoring Pipeline for Non-Amazon Retailers: The General Architecture

Comments 1
6 min read
Web Scraping With Playwright and Residential Proxies: The Complete Configuration Guide

Web Scraping With Playwright and Residential Proxies: The Complete Configuration Guide

Comments 1
6 min read
IP Rotation Strategies: A Deep Dive Into Granularity, Sessions, and Task Boundaries

IP Rotation Strategies: A Deep Dive Into Granularity, Sessions, and Task Boundaries

Comments 1
6 min read
Rate Limiting Yourself: The Politeness Strategy That Keeps Scrapers Alive

Rate Limiting Yourself: The Politeness Strategy That Keeps Scrapers Alive

Comments
4 min read
Feeding AI Agents Fresh Web Data: A Practical Pipeline

Feeding AI Agents Fresh Web Data: A Practical Pipeline

Comments
4 min read
Static Residential IPs: When Your Project Needs an Address, Not a Pool

Static Residential IPs: When Your Project Needs an Address, Not a Pool

Comments
3 min read
Scraping at Scale with asyncio and aiohttp: 10x Throughput Without Getting Blocked

Scraping at Scale with asyncio and aiohttp: 10x Throughput Without Getting Blocked

Comments
4 min read
Scraping Amazon Prices at Scale: The Survival Architecture

Scraping Amazon Prices at Scale: The Survival Architecture

Comments
4 min read
Beating TLS Fingerprinting in Python: A Hands-On Guide

Beating TLS Fingerprinting in Python: A Hands-On Guide

Comments
3 min read
loading...