DEV Community

Discussion on: What have you built/automated with headless browsers (e.g. Puppeteer)?

Collapse
 
blindfish3 profile image
Ben Calder

I used CasperJS to audit pages on a university 'website' (actually many sites on the same domain) to facilitate planning for migration to responsive templates (this was a while back). I generated a site map by inspecting every page and following any links on the domain and logging what was found; including details of custom scripts etc. that would require additional manual intervention.

Some faculties/departments had their own web servers so this was the only practical way to gather all the data in one place.

Nowadays I'm really liking Cypress for end to end testing; though no idea if it could achieve the same results in terms of web-scraping.

Collapse
 
arjunattam profile image
Arjun Attam

Hey Ben, I work with Jonathan at Microsoft, and we are curious to learn more about your experience in testing/automation. Would it be possible to take this forward over email? I'm at arjun.attam@microsoft.com