DEV Community

Cover image for How to create a LinkedIn job scraper in Python with Crawlee

How to create a LinkedIn job scraper in Python with Crawlee

Arindam Majumder on October 17, 2024

Introduction In this article, we will build a web application that scrapes LinkedIn for job postings using Crawlee and Streamlit. We wi...
Collapse
 
akshaybond30160 profile image
Akshay bondre

Great Writeup

Collapse
 
ddebajyati profile image
Debajyati Dey

nice tutorial!

Collapse
 
arindam_1729 profile image
Arindam Majumder Crawlee

Thanks for checking out 😃🙌🏼

Collapse
 
oliverbennet profile image
Oliver Bennet

Yeah, a good one to test for the weekend

Collapse
 
arindam_1729 profile image
Arindam Majumder Crawlee

Let me know how it goes!

Collapse
 
akshaycodes profile image
Akshay SIng

Great Project

Collapse
 
arindam_1729 profile image
Arindam Majumder Crawlee

Thanks for checking out!

Collapse
 
josiahadesola profile image
Josiah Adesola

Awesome

Collapse
 
denys_bochko profile image
Denys Bochko

it's a nice tutorial on how to get that data from linkedin.

what I think is that searching by those fields is not a very big help since linked in search does the same thing. What would be a good scrapper is the one that goes through the description and saves only those jobs that match the keywords provided. We all know that backend developer or a full stack developer can reference so many things.
This is a good start though

Collapse
 
devang2304 profile image
Devang2304

Dude I tried it and also tried by cloning your repo, no job data got scrapped, does this even actually working?

Collapse
 
sirelli profile image
Jerount

Cool article, thanks for the effort!