DEV Community


Discussion on: WebScraping [Part-1]

zareefweb profile image

how to scrap news post in bulk which are dynamic? I searched lot unable to find

Thread Thread
sunilaleti profile image
Sunil Aleti Author

Yes, it's very difficult to scrape dynamic sites because the data is loaded dynamically with JavaScript.
In such cases, we can use the following two techniques:

  • Reverse Engineering JavaScript
  • Rendering JavaScript

And will definitely make a tutorial in future 🤞