DEV Community

Discussion on: How I made a web scraper because LinkedIn

Collapse
 
aarmora profile image
Jordan Hansen

I actually loved this. Nice article.

So do you perform a login with Nightmarejs and then just search from there?

I realize it's against TOS but I do believe it's still legal

arstechnica.com/tech-policy/2017/0...

The above article says you're good legally but I believe anything behind a password is where the line is drawn. I'm not sure if that means other people's passwords (hacking their accounts?) or your own. I've taken the former approach and I think the use you are doing is a perfect example of something that would be legal. You have access to all of the data already, this just speeds it up.

Anyway, great article!

Collapse
 
futoricky profile image
Ricardo A. Mercado • Edited

Thanks!

Yeah you are prompted to fill in your personal LinkedIn credentials. The script logs you in and gets the emails from your personal connections. It's basically automizing a process I could do manually.

Collapse
 
lilmissblockchain profile image
lilmissblockchain

Very good article Ricardo. Thank you.