DEV Community

Cover image for How to create a LinkedIn job scraper in Python with Crawlee

How to create a LinkedIn job scraper in Python with Crawlee

Arindam Majumder on October 17, 2024

Introduction In this article, we will build a web application that scrapes LinkedIn for job postings using Crawlee and Streamlit. We wi...
Collapse
 
oliverbennet profile image
Oliver Bennet

Yeah, a good one to test for the weekend

Collapse
 
arindam_1729 profile image
Arindam Majumder Crawlee

Let me know how it goes!

Collapse
 
ddebajyati profile image
Debajyati Dey

nice tutorial!

Collapse
 
arindam_1729 profile image
Arindam Majumder Crawlee

Thanks for checking out 😃🙌🏼

Collapse
 
akshaybond30160 profile image
Akshay bondre

Great Writeup

Collapse
 
akshaycodes profile image
Akshay SIng

Great Project

Collapse
 
arindam_1729 profile image
Arindam Majumder Crawlee

Thanks for checking out!

Collapse
 
josiahadesola profile image
Josiah Adesola

Awesome

Collapse
 
denys_bochko profile image
Denys Bochko

it's a nice tutorial on how to get that data from linkedin.

what I think is that searching by those fields is not a very big help since linked in search does the same thing. What would be a good scrapper is the one that goes through the description and saves only those jobs that match the keywords provided. We all know that backend developer or a full stack developer can reference so many things.
This is a good start though

Collapse
 
devang2304 profile image
Devang2304

Dude I tried it and also tried by cloning your repo, no job data got scrapped, does this even actually working?

Collapse
 
sirelli profile image
Jerount

Cool article, thanks for the effort!