DEV Community

Discussion on: Scraping single page applications with ease.

Collapse
 
ilyazub profile image
Illia Zub

What about sending direct HTTP requests to the API endpoints that SPA uses instead of bringing a headless browser to the game?

Collapse
 
peterrauscher profile image
Peter Rauscher

This is exactly what I do. I also wrote a chrome extension that will tell you when a page is built as an SPA and let you view the data or export it directly.

It will generate code snippets you can use to pull this data out using just HTTP requests, as well.