<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: spooky bat</title>
    <description>The latest articles on DEV Community by spooky bat (@spookybat).</description>
    <link>https://dev.to/spookybat</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4194875%2F32134202-ecb2-4779-a532-97db43fe12c9.png</url>
      <title>DEV Community: spooky bat</title>
      <link>https://dev.to/spookybat</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/spookybat"/>
    <language>en</language>
    <item>
      <title>How to get job postings straight from company career pages (without scraping LinkedIn)</title>
      <dc:creator>spooky bat</dc:creator>
      <pubDate>Mon, 19 Oct 2026 20:28:16 +0000</pubDate>
      <link>https://dev.to/spookybat/how-to-get-job-postings-straight-from-company-career-pages-without-scraping-linkedin-155g</link>
      <guid>https://dev.to/spookybat/how-to-get-job-postings-straight-from-company-career-pages-without-scraping-linkedin-155g</guid>
      <description>&lt;p&gt;Job boards are late, full of duplicates and reposts, and most of them forbid scraping. But almost every tech company publishes its openings in the same handful of places: the career page that its &lt;strong&gt;applicant tracking system (ATS)&lt;/strong&gt; hosts. Greenhouse, Lever, Ashby, Personio and others all expose a &lt;strong&gt;public job feed&lt;/strong&gt; for exactly this purpose — so companies can embed their openings on their own website.&lt;/p&gt;

&lt;p&gt;That means you can build a clean, legal job dataset from the source. Here is how.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Find which ATS a company uses
&lt;/h2&gt;

&lt;p&gt;Open any job on the company's career page and look at where "Apply" leads:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;ATS&lt;/th&gt;
&lt;th&gt;Career page looks like&lt;/th&gt;
&lt;th&gt;Public feed&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Greenhouse&lt;/td&gt;
&lt;td&gt;&lt;code&gt;boards.greenhouse.io/acme&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;https://boards-api.greenhouse.io/v1/boards/acme/jobs?content=true&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Lever&lt;/td&gt;
&lt;td&gt;&lt;code&gt;jobs.lever.co/acme&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;https://api.lever.co/v0/postings/acme?mode=json&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Ashby&lt;/td&gt;
&lt;td&gt;&lt;code&gt;jobs.ashbyhq.com/acme&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;https://api.ashbyhq.com/posting-api/job-board/acme?includeCompensation=true&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Personio&lt;/td&gt;
&lt;td&gt;&lt;code&gt;acme.jobs.personio.de&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;https://acme.jobs.personio.de/xml?language=en&lt;/code&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;&lt;code&gt;acme&lt;/code&gt; is the company's board id — usually the company name in lowercase.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Fetch the feed
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight javascript"&gt;&lt;code&gt;&lt;span class="c1"&gt;// Node 18+: no dependencies&lt;/span&gt;
&lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="nx"&gt;res&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="k"&gt;await&lt;/span&gt; &lt;span class="nf"&gt;fetch&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="s1"&gt;https://boards-api.greenhouse.io/v1/boards/doctolib/jobs?content=true&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="p"&gt;);&lt;/span&gt;
&lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt; &lt;span class="nx"&gt;jobs&lt;/span&gt; &lt;span class="p"&gt;}&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="k"&gt;await&lt;/span&gt; &lt;span class="nx"&gt;res&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;json&lt;/span&gt;&lt;span class="p"&gt;();&lt;/span&gt;
&lt;span class="k"&gt;for &lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="nx"&gt;j&lt;/span&gt; &lt;span class="k"&gt;of&lt;/span&gt; &lt;span class="nx"&gt;jobs&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;slice&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="nx"&gt;console&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;log&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nx"&gt;j&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nx"&gt;title&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="s1"&gt;|&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nx"&gt;j&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nx"&gt;location&lt;/span&gt;&lt;span class="p"&gt;?.&lt;/span&gt;&lt;span class="nx"&gt;name&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="s1"&gt;|&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nx"&gt;j&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nx"&gt;absolute_url&lt;/span&gt;&lt;span class="p"&gt;);&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Lever returns a plain array of postings, Ashby returns &lt;code&gt;{ jobs: [...] }&lt;/code&gt; with optional compensation, Personio returns XML. Each has its own field names for location, department and employment type.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Things that bite you in production
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Normalising&lt;/strong&gt; ten different schemas into one row (title, department, location, country, remote/hybrid, salary, posted date, apply link).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Locations&lt;/strong&gt; are free text: "Berlin, Berlin, Germany", "Remote - EU", "London or Remote".&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Only new jobs:&lt;/strong&gt; you need to remember what you already saw, per company, between runs.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Being a good citizen:&lt;/strong&gt; check &lt;code&gt;robots.txt&lt;/code&gt;, back off on &lt;code&gt;429&lt;/code&gt;, stop when a site shows a bot challenge, and don't collect personal data (recruiter e-mails and phone numbers often sit inside descriptions).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Discovery:&lt;/strong&gt; the hard part isn't fetching one company — it's knowing &lt;em&gt;which&lt;/em&gt; companies to fetch.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  4. Or skip the plumbing
&lt;/h2&gt;

&lt;p&gt;I packaged all of the above into an Apify Actor, &lt;a href="https://apify.com/nefes-tools/eu-company-jobs" rel="noopener noreferrer"&gt;Career Page Jobs API&lt;/a&gt;. It covers 10 ATS (Greenhouse, Lever, Ashby, Personio, Teamtailor, Recruitee, Workable, Workday, BambooHR, Pinpoint), and has two modes:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Search without a company list:&lt;/strong&gt; keywords + location over a built-in list of ~550 verified companies — "software engineer, Germany" returns 118 jobs from 49 companies (German titles like "Softwareentwickler (m/w/d)" included).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Track your own list:&lt;/strong&gt; paste career pages, turn on &lt;em&gt;only new jobs&lt;/em&gt;, schedule it daily → a job alert for any set of companies, delivered to Sheets, Slack or your own API.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;It costs $1 per 1,000 jobs (you pay only for jobs delivered), and the free Apify credit is enough to try it.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I'm the developer of this Actor. The feeds in sections 1–2 are public and free to use directly — the Actor is just the shortcut if you don't want to maintain ten parsers.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>webscraping</category>
      <category>api</category>
      <category>javascript</category>
      <category>career</category>
    </item>
  </channel>
</rss>
