DEV Community: Get Anything

I scraped 503 jobs from Gulf company career pages. Here's who is actually hiring.

Get Anything — Fri, 10 Jul 2026 13:04:50 +0000

Everyone quotes LinkedIn numbers when they talk about hiring in the Gulf. LinkedIn shows you what recruiters post, filtered through an algorithm, weeks after the fact.

I wanted the source. So I pulled 503 open roles straight from the applicant tracking systems behind seven Gulf employers' own career pages, on a single day in July 2026. No job boards in the middle. No login. Just the same public APIs those career pages call from your browser.

Here is what the raw data says.

Abu Dhabi is out-hiring Dubai, and it isn't close

Of the 152 Gulf-based roles in the dataset:

City	Open roles	Share
Abu Dhabi	70	46%
Dubai	50	33%
Riyadh	22	14%
Kuwait City	6	4%
Muscat	2	1%
Doha	1	1%

Dubai gets the attention. Abu Dhabi is doing the hiring. A large part of that is Aldar and Masdar, both Abu Dhabi anchors, both hiring hard into real estate and clean energy. If you are a job seeker who filters on "Dubai" by reflex, you are filtering out the larger half of this market.

Nearly half of all roles are mid-senior

Seniority	Roles	Share
Mid-Senior level	68	45%
Mid level	33	22%
Executive	24	16%
Entry level	20	13%
Internship	4	3%
Director	3	2%

This is the finding that should change how you read the Gulf market. Only 16% of these roles are entry level or internships. The Gulf is not, at least at these companies, hiring juniors in volume. It is hiring people with five to fifteen years of experience, and it is hiring a striking number of executives: 24 VP and C-suite roles across seven companies.

That executive share tells you something specific. Companies posting Senior Vice President roles publicly are building new business units, not backfilling.

Who is hiring right now

Company	Gulf roles	Where
Aldar Properties	48	Abu Dhabi
Tamara	31	Dubai, Riyadh
Deliveroo	26	Dubai
Masdar	23	Abu Dhabi
Careem	11	Dubai
Fresha	9	Riyadh
Lean Technologies	4	Riyadh

Sales leads the functions at 23 roles, followed by data at 13 and marketing at 11. Engineering is only 6. In the Gulf, at these companies, commercial roles outnumber technical ones by a wide margin. That runs against the instinct that a fintech like Tamara or a tech company like Careem is mostly hiring engineers.

The part nobody tells you: most Gulf giants cannot be scraped

I started with 42 of the region's most sought-after employers. Emirates Group, ADNOC, Emaar, Majid Al Futtaim, Qatar Airways, DP World, Emirates NBD, Aramco, Chalhoub, e&, stc, NEOM, Mubadala, talabat, noon.

Only 7 of the 42 were reachable.

The rest run on Taleo, Oracle Cloud, Phenom, or fully custom portals. None of those expose a public job API. If you have ever wondered why job aggregators show stale or incomplete listings for the biggest Gulf employers, this is why. The data simply isn't available at the source, so aggregators scrape it secondhand from job boards, with all the lag and loss that implies.

The seven that are reachable share one trait: they run modern applicant tracking systems, Greenhouse, Lever, Ashby, and SmartRecruiters, which all publish open job board APIs by design.

ATS	Gulf roles found
Lever	57
Greenhouse	42
Ashby	30
SmartRecruiters	23

Two ways the data tried to lie to me

Building this taught me to distrust my own classifiers.

"Assistant Vice President" is not an executive. In Gulf banking and real estate, AVP is an upper-mid individual contributor title. My first pass classified 37 roles as executive. Aldar alone had seven Assistant Vice Presidents. Once I separated AVP from SVP, the real executive count dropped to 24.

"Coordinator" contains "coo". A naive substring match for C-suite abbreviations classified "Emirati Programme Coordinator" as a chief operating officer. Likewise "Partner Onboarding Specialist" matched "partner" and got promoted to firm partner. Both needed word-boundary matching.

If you are doing this yourself: every seniority heuristic you write will be wrong in a way that flatters your numbers. Print the titles behind every bucket before you publish a percentage. I nearly published "18% of Gulf roles are executive level," which was an artifact of the string "coo" appearing inside "Coordinator."

Reproduce this yourself, free

The scraper is a free, open Apify Actor. It auto-detects which ATS a company uses, so you can pass a career page URL or just a company name.

{
  "companies": [
    "lever:aldar",
    "greenhouse:careem",
    "greenhouse:tamara",
    "smartrecruiters:masdar",
    "ashby:deliveroo"
  ],
  "locationFilter": "Dubai"
}

That returns 50 live Dubai jobs the moment you run it. It costs nothing because these are the companies' own public APIs. No proxies, no browser, no rate limits worth worrying about.

Run the free ATS Jobs Scraper on Apify

If you need the Gulf employers that aren't on a modern ATS, the ones running Taleo and Oracle, I built a separate tool that reaches them through Bayt, GulfTalent and NaukriGulf and merges the duplicates: GCC Jobs Aggregator.

Method

All 503 roles were pulled on 10 July 2026 from the public job board APIs of Greenhouse, Lever, Ashby and SmartRecruiters. A role counts as "Gulf" when its location string names a GCC city or country. Seniority and function are inferred from job titles, so treat them as a strong signal rather than ground truth. The scraper is free and the classification code is open, so you can check my work and disagree with it.

I plan to rerun this quarterly. If you want a specific company added, say so in the comments and I will check whether it is reachable at all.

How to scrape jobs from any company career page (Greenhouse, Lever, Ashby, Workday)

Get Anything — Fri, 10 Jul 2026 12:20:13 +0000

Most tutorials on scraping job listings reach for Selenium, a headless browser, and a proxy pool. Then they break in a month when the HTML changes.

You almost never need any of that. Company career pages are single-page apps, and the JSON they load is fetched from a public API you can call directly. No login, no key, no browser.

Here are the endpoints for the five biggest applicant tracking systems, all verified working as I write this.

Greenhouse

The simplest of the lot. Everything you need is one GET request.

import requests

r = requests.get("https://boards-api.greenhouse.io/v1/boards/stripe/jobs?content=true")
for job in r.json()["jobs"]:
    print(job["title"], "|", job["location"]["name"])

stripe is the board token, which you can read off the company's careers URL (boards.greenhouse.io/stripe). Add ?content=true and you get the full job description as HTML in each record. Stripe alone returns over 500 jobs.

Lever

r = requests.get("https://api.lever.co/v0/postings/spotify?mode=json")
for job in r.json():
    print(job["text"], "|", job["categories"].get("location"))

Lever's payload is generous: descriptionPlain gives you clean text with no HTML stripping, and workplaceType tells you whether the role is remote.

Ashby

Ashby uses GraphQL, but it accepts unauthenticated queries for public job boards.

QUERY = """
query ApiJobBoardWithTeams($organizationHostedJobsPageName: String!) {
  jobBoard: jobBoardWithTeams(organizationHostedJobsPageName: $organizationHostedJobsPageName) {
    jobPostings { id title locationName employmentType }
  }
}
"""

r = requests.post(
    "https://jobs.ashbyhq.com/api/non-user-graphql?op=ApiJobBoardWithTeams",
    json={"operationName": "ApiJobBoardWithTeams",
          "variables": {"organizationHostedJobsPageName": "ramp"},
          "query": QUERY},
)
for job in r.json()["data"]["jobBoard"]["jobPostings"]:
    print(job["title"], "|", job["locationName"])

SmartRecruiters

Paginated, 100 per page, with a totalFound you can loop against.

r = requests.get("https://api.smartrecruiters.com/v1/companies/Visa/postings?limit=100&offset=0")
for job in r.json()["content"]:
    loc = job["location"]
    print(job["name"], "|", loc.get("city"), loc.get("country"))

Workday, and its three traps

Workday is where people give up. It is a POST, and the URL contains a tenant name, a datacenter number, and a site name that all differ per company.

r = requests.post(
    "https://nvidia.wd5.myworkdayjobs.com/wday/cxs/nvidia/NVIDIAExternalCareerSite/jobs",
    json={"appliedFacets": {}, "limit": 20, "offset": 0, "searchText": ""},
    headers={"Content-Type": "application/json", "Accept": "application/json"},
)
data = r.json()
print(data["total"], "total jobs")
for job in data["jobPostings"]:
    print(job["title"], "|", job["locationsText"])

Three things cost me time here, so let me save you the trouble:

limit cannot exceed 20. Ask for 100 and Workday returns an empty jobPostings array with no error. It looks exactly like "no more results."
It throttles fast paging. If you loop without a pause, a page eventually fails, and if your loop treats a failed page as the end of the list you will silently collect a fraction of the jobs. I lost 1,960 of NVIDIA's 2,000 jobs to this before I noticed. Pause between pages and retry a failed one instead of breaking.
The URL parts are not guessable. nvidia, wd5, and NVIDIAExternalCareerSite all come from the company's real careers URL. Copy it, don't invent it.

Some sites fingerprint your TLS handshake

Greenhouse, Lever, Ashby, SmartRecruiters and Workday are all happy to serve a plain requests call. Some other job sites are not: they inspect the TLS handshake itself and block anything that doesn't look like a real browser, no matter what User-Agent header you send.

When a site returns 403 to requests but loads fine in Chrome, that's the signal. curl_cffi impersonates a real Chrome TLS fingerprint:

from curl_cffi import requests as curl_requests

r = curl_requests.get("https://www.example-jobsite.com/jobs", impersonate="chrome")

That single change fixed two sites for me that no amount of header spoofing would.

Detecting which ATS a company uses

You don't need to know in advance. Fetch the careers page and look for the signature:

import re

SIGNATURES = [
    ("greenhouse",      r"boards\.greenhouse\.io/([\w-]+)"),
    ("lever",           r"jobs\.lever\.co/([\w-]+)"),
    ("ashby",           r"jobs\.ashbyhq\.com/([\w.-]+)"),
    ("smartrecruiters", r"careers\.smartrecruiters\.com/([\w-]+)"),
    ("workday",         r"([\w-]+)\.(wd\d+)\.myworkdayjobs\.com/([\w-]+)"),
]

def detect(careers_url):
    html = curl_requests.get(careers_url, impersonate="chrome").text
    for ats, pattern in SIGNATURES:
        m = re.search(pattern, html)
        if m:
            return ats, m.groups()
    return None, None

A word of warning from running this across 42 large employers: most big companies are not on a modern ATS at all. Taleo, Oracle Cloud, Phenom and iCIMS dominate enterprise, and none of them publish an open job API. My hit rate on the Gulf's most sought-after employers was 7 out of 42. Detect first, then decide whether scraping is even possible, rather than writing a parser for a page that will never give you clean data.

Validate your own output before you trust it

Two bugs that got past me, both from naive substring matching on job titles:

"coo" in title.lower() classified "Coordinator" as a chief operating officer.
"partner" in title.lower() promoted "Partner Onboarding Specialist" to firm partner.

Use word boundaries (re.search(r"\bcoo\b", title)), and before you publish any aggregate, print the raw titles behind each bucket. Every classifier you write will be wrong in a way that flatters your numbers.

The no-code version

If you'd rather not maintain five API clients, I packaged all of this as a free Apify Actor. It auto-detects the ATS, normalizes all five payload shapes into one schema, adds seniority and function detection, and returns clean JSON or CSV.

{
  "companies": [
    "greenhouse:stripe",
    "https://jobs.lever.co/spotify",
    "https://jobs.ashbyhq.com/ramp"
  ],
  "locationFilter": "Remote"
}

Run it free on Apify — it's free because these APIs need no proxies, so a run costs essentially nothing.

It also works as an MCP tool, so you can connect it to Claude or ChatGPT and just ask "what engineering roles are open at Stripe and Ramp?"

Be a good citizen

These endpoints are public because companies want their jobs discovered. Don't abuse that. Cache aggressively, pause between requests, and don't hammer a small company's board every minute. The reason this all works without keys is that nobody has had to lock it down yet.