The latest articles on DEV Community by Zai (@zai). https://dev.to/zai https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F2577976%2Fc6affcbb-756f-4119-baf2-e36144c80cab.jpeg https://dev.to/zai en Zai Mon, 16 Dec 2024 18:11:08 +0000 https://dev.to/zai/can-you-scrape-the-url-from-this-website-1ej3 https://dev.to/zai/can-you-scrape-the-url-from-this-website-1ej3 <p>I wanted to challenge myself and see if I could create a website that is quite challenging to scrape. I got an idea and built a simple website. Can you scrape it?</p> <p>Some things you should know:</p> <ol> <li>There is no encryption going on.</li> <li>The <code>deobfuscator.js</code> is not really doing anything. It was generated by a tool (wasm-pack) to load up the wasm bin, so you can safely ignore it</li> <li>The URL isn't hard-coded into the wasm bin. it's inside the HTML but encoded and obfuscated.</li> <li>You are not allowed to use selenium. </li> </ol> <p>website URL: <a href="https://scrape-my-secret.vercel.app" rel="noopener noreferrer">https://scrape-my-secret.vercel.app</a><br> Also, the code isn't open-source yet for obvious reasons. I will open-source it when I think it's time. </p> <p>Good luck!</p> webscraping discuss Zai Mon, 16 Dec 2024 16:28:41 +0000 https://dev.to/zai/hi-there-this-is-my-first-post--3l9l https://dev.to/zai/hi-there-this-is-my-first-post--3l9l welcome firstpost