<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Andre van Schalkwyk</title>
    <description>The latest articles on DEV Community by Andre van Schalkwyk (@andre_vanschalkwyk_b7565).</description>
    <link>https://dev.to/andre_vanschalkwyk_b7565</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4233820%2Fc4c7416e-c9cc-4031-a22a-ffcb92fe6d2a.jpg</url>
      <title>DEV Community: Andre van Schalkwyk</title>
      <link>https://dev.to/andre_vanschalkwyk_b7565</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/andre_vanschalkwyk_b7565"/>
    <language>en</language>
    <item>
      <title>How to get every job from Greenhouse, Lever and Ashby career pages (Python)</title>
      <dc:creator>Andre van Schalkwyk</dc:creator>
      <pubDate>Sun, 08 Nov 2026 16:26:23 +0000</pubDate>
      <link>https://dev.to/andre_vanschalkwyk_b7565/how-to-get-every-job-from-greenhouse-lever-and-ashby-career-pages-python-3nf7</link>
      <guid>https://dev.to/andre_vanschalkwyk_b7565/how-to-get-every-job-from-greenhouse-lever-and-ashby-career-pages-python-3nf7</guid>
      <description>&lt;p&gt;Most tech companies don't host their own job listings. They use an applicant tracking system (ATS), and the big ones (Greenhouse, Lever and Ashby) each expose a &lt;strong&gt;public job-board feed&lt;/strong&gt; that powers the company's careers page. If you want job data for a list of companies, these feeds beat scraping LinkedIn or Indeed: they're the source of truth, they're structured, and they don't block you.&lt;/p&gt;

&lt;h3&gt;
  
  
  The catch: every ATS is different
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Greenhouse&lt;/strong&gt; boards live at &lt;code&gt;boards.greenhouse.io/&amp;lt;board&amp;gt;&lt;/code&gt;; pay ranges only appear if you ask for them and the company publishes them.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Lever&lt;/strong&gt; boards live at &lt;code&gt;jobs.lever.co/&amp;lt;company&amp;gt;&lt;/code&gt;, with "commitment" and "workplaceType" fields and a different salary shape.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Ashby&lt;/strong&gt; boards live at &lt;code&gt;jobs.ashbyhq.com/&amp;lt;company&amp;gt;&lt;/code&gt; and often include compensation, in yet another format.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;And you first need to know &lt;em&gt;which&lt;/em&gt; ATS a company uses. "Stripe" doesn't tell you that.&lt;/p&gt;

&lt;h3&gt;
  
  
  Option 1: do it yourself
&lt;/h3&gt;

&lt;p&gt;For a single ATS, it's a few lines of &lt;code&gt;requests&lt;/code&gt; against the public board endpoint plus a mapping function. Multiply that by eight platforms, add platform detection, salary parsing from free text, seniority inference and de-duplication for "new jobs only", and it becomes a small project to maintain.&lt;/p&gt;

&lt;h3&gt;
  
  
  Option 2: one normalised API
&lt;/h3&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this.&lt;/em&gt; I wrapped all of that into &lt;a href="https://apify.com/cape-data-labs/company-career-jobs-api" rel="noopener noreferrer"&gt;a hosted API on Apify&lt;/a&gt; that takes company names, careers URLs or &lt;code&gt;platform:board&lt;/code&gt; pairs and returns one schema for all eight platforms:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;cape-data-labs/company-career-jobs-api&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;
    &lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;companies&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;https://boards.greenhouse.io/airbnb&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;lever:palantir&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;ashby:ramp&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]}&lt;/span&gt;
&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;company&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;title&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;workplaceType&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;salary&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Each job comes back with title, department, location, remote/hybrid/on-site, seniority, employment type, salary (min/max/currency/period), posted date and apply URL. Turn on &lt;code&gt;onlyNewJobs&lt;/code&gt; and schedule it daily for alerts; you only pay for postings you haven't seen ($1.50 per 1,000 jobs).&lt;/p&gt;

&lt;p&gt;More examples (CSV export, Slack alerts, remote-with-salary search, hiring-intent lead scoring): &lt;a href="https://github.com/andrevs/ats-jobs-api-examples" rel="noopener noreferrer"&gt;https://github.com/andrevs/ats-jobs-api-examples&lt;/a&gt;&lt;/p&gt;

&lt;h3&gt;
  
  
  What I learned building it
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Platform detection by name is a guessing game; careers-page URLs are always faster and more reliable.&lt;/li&gt;
&lt;li&gt;Pay ranges are more common than you'd think: in one test run, 145 of Ramp's 171 open roles had one. But every ATS stores them differently.&lt;/li&gt;
&lt;li&gt;Job ads are a surprisingly good technographic source: companies name their CRM, warehouse and cloud in them. That became a second API, &lt;a href="https://apify.com/cape-data-labs/company-hiring-signals" rel="noopener noreferrer"&gt;Hiring Signals&lt;/a&gt;.&lt;/li&gt;
&lt;/ul&gt;

</description>
      <category>python</category>
      <category>api</category>
      <category>webscraping</category>
      <category>tutorial</category>
    </item>
  </channel>
</rss>
