DEV Community

Crawler Bros
Crawler Bros

Posted on

Find Target Leads with LinkedIn People Search Scraper

#linkedin #leads #marketing #automation

Have you ever spent hours manually scrolling through LinkedIn search results, trying to find that perfect lead or understand a specific market segment? Whether you're a recruiter seeking specialized talent, a marketer identifying ideal customer profiles, or a researcher analyzing industry trends, the sheer volume of LinkedIn data can be overwhelming. Manually sifting through profiles, copying URLs, and noting key details is not only time-consuming but also prone to error and inconsistency.

The good news? You don't have to anymore. With the Apify LinkedIn People Search Scraper, you can automate this tedious process, transforming hours of manual work into a few clicks. This powerful Actor allows you to programmatically search LinkedIn for people based on specific criteria, returning structured data that's ready for analysis or integration into your existing workflows.

What is the LinkedIn People Search Scraper?

The LinkedIn People Search Scraper is an Apify Actor designed to mimic your browser's LinkedIn people search functionality. It leverages LinkedIn's Voyager search API to find profiles based on your inputs and returns a clean, structured dataset. This means you get access to the same high-quality, up-to-date data you see on LinkedIn, but in a format that's easy to use for your specific needs.

A Real Use Case: Streamlining Lead Generation for a B2B SaaS Company

Imagine you're the Head of Sales for a B2B SaaS company specializing in project management software for engineering teams. Your ideal customer is a "Director of Engineering" or "VP Engineering" at mid-sized tech companies (51-200 employees) in the San Francisco Bay Area. You need a targeted list of these professionals to personalize your outreach and demonstrate your product's value.

Manually building this list would involve:

  • Repeatedly performing LinkedIn searches with various combinations of keywords and filters.
  • Clicking through countless profiles to verify job titles, companies, and locations.
  • Copying profile URLs, names, and headlines into a spreadsheet.
  • Dealing with inconsistent data entry and potential missed opportunities.

This process is incredibly inefficient and limits the scale of your lead generation efforts.

How the Scraper Solves This Problem

The LinkedIn People Search Scraper automates every step of this process. Instead of manual searching, you provide the Actor with your target criteria, and it does the heavy lifting, delivering a ready-to-use dataset of qualified leads.

Here's how it would work for our B2B SaaS example:

  1. Define your target audience: Your ideal prospect is a "Director of Engineering" or "VP Engineering" in the San Francisco Bay Area at a company with 51-200 employees.

  2. Input your criteria into the Actor:

    • Set the searchQuery to "Director of Engineering" or "VP Engineering" to target specific job titles.
    • Add location as "San Francisco Bay Area" to focus on your geographical target.
    • Specify companyHeadcount as "D" (51-200 employees) to filter by company size.
    • You can even refine the search by seniorityLevel or jobFunction if needed.
    • Crucially, you'll provide your cookie (your LinkedIn session cookie) to authenticate the search, ensuring you get results tailored to your network and access level.

  3. Run the Actor: The scraper will then execute the search on LinkedIn's Voyager API, respecting the specified filters. It paces requests to avoid rate limits, ensuring a reliable data extraction process.

  4. Receive structured data: The output will be a clean dataset, with each entry containing valuable information such as:

    • name: The full name of the prospect.
    • headline: Their professional headline, confirming their role.
    • location: Their listed location.
    • profileUrl: The direct link to their LinkedIn profile, perfect for direct outreach.
    • connectionDegree: Indicates your connection level (1st, 2nd, 3rd+).
    • scrapedAt: A timestamp of when the data was extracted.

This structured data can then be easily exported as a CSV, JSON, or Excel file and integrated into your CRM, email outreach tool, or custom lead management system. You've just transformed a manual, time-intensive process into an efficient, automated workflow, giving your sales team a consistent flow of highly qualified leads.

Beyond Lead Generation: Other Practical Applications

The versatility of the LinkedIn People Search Scraper extends far beyond lead generation:

  • Recruitment: Find specialized talent by titleKeyword, currentCompany, pastCompany, school, or even yearsOfExperience. Identify potential candidates for hard-to-fill roles quickly.
  • Market Research & Analysis: Understand the distribution of specific roles or skill sets within industries or geographical areas. For example, search for "AI Researcher" in "London" to gauge the talent pool.
  • Competitor Analysis: Identify key personnel at competitor companies using the currentCompany filter. Gain insights into their team structure and leadership.
  • Alumni Networking: Connect with alumni from your university by specifying your school and filtering by connectionDegree to find 1st or 2nd-degree connections.

How to Use the LinkedIn People Search Scraper

Using the LinkedIn People Search Scraper is straightforward:

  1. Get your LinkedIn cookie: You'll need your LinkedIn session cookie (the li_at value) to authenticate requests. This is because LinkedIn search is only accessible to logged-in users. You can easily copy this from your browser's developer tools. Your cookie is used only to authenticate requests to LinkedIn's API during the run and is stored securely.
  2. Navigate to the Actor: Find the "LinkedIn People Search Scraper" on the Apify platform.
  3. Configure your input:
    • Enter your searchQuery (e.g., "software engineer", "VP Sales").
    • Paste your cookie into the designated field.
    • Add any filters relevant to your goal, such as location ("New York"), currentCompany ("Microsoft"), school ("Stanford University"), connectionDegree ("S" for 2nd degree), or companyHeadcount ("E" for 201-500 employees).
    • You can set maxResults to control the number of profiles returned (up to 100 profiles per run).
  4. Start the Actor: Click the "Start" button. The Actor will begin processing your request.
  5. Download your data: Once the run is complete, you can download the extracted data in various formats like JSON, CSV, or Excel.

Important Considerations

  • Authentication is key: A valid li_at session cookie is essential. The Actor will not work without it.
  • Results vary by account: LinkedIn personalizes search results. Your network and account type can influence the data you retrieve.
  • Rate Limiting: The Actor is designed to pace requests to avoid LinkedIn's rate limits. For larger tasks, expect run times of a few minutes.
  • Cookie Expiry: LinkedIn cookies eventually expire. If you encounter authentication errors, simply refresh your cookie.

By integrating the LinkedIn People Search Scraper into your toolkit, you can unlock new levels of efficiency and insight in your lead generation, recruitment, and market research efforts. Stop manually sifting through data, and start extracting the exact information you need, precisely when you need it.

Ready to try it yourself? Run *LinkedIn People Search Scraper** on the Apify Store -- no setup required.*

Top comments (0)