Day 3 was challenging but insightful.
After my usual routine of posting updates and solving one LeetCode problem, I started building the SERP scraper using Playwright.
Things worked at first, but I quickly encountered captchas, IP blacklisting, device fingerprinting, and multiple anti-bot layers.
I spent the rest of the day modifying the scripts to better mimic real users. This included adding delays, reusing browser contexts, and adjusting execution patterns.
I did not finish the scraper by the end of the day, but the learning was significant. It became very clear that web scraping is far more complex than it appears from the outside.
Full respect to anyone working in this space.
Day 4 will continue from here.
Top comments (0)