DEV Community

loading...

Discussion on: WebScraping [Part-1]

Collapse
sunilaleti profile image
Collapse
zareefweb profile image
zareefweb

how to scrap news post in bulk which are dynamic? I searched lot unable to find

Thread Thread
sunilaleti profile image
Sunil Aleti Author

Yes, it's very difficult to scrape dynamic sites because the data is loaded dynamically with JavaScript.
In such cases, we can use the following two techniques:

  • Reverse Engineering JavaScript
  • Rendering JavaScript

And will definitely make a tutorial in future 🤞