<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Omar Khandji</title>
    <description>The latest articles on DEV Community by Omar Khandji (@omar_khandji_0135ce9388bb).</description>
    <link>https://dev.to/omar_khandji_0135ce9388bb</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4152476%2F27a772ef-51f6-41b7-ad4a-c5dababb4425.png</url>
      <title>DEV Community: Omar Khandji</title>
      <link>https://dev.to/omar_khandji_0135ce9388bb</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/omar_khandji_0135ce9388bb"/>
    <language>en</language>
    <item>
      <title>One API for 120 applicant tracking systems: jobs from Greenhouse, Workday, Bullhorn, BrassRing and 116 more</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Tue, 10 Nov 2026 15:14:46 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/one-api-for-120-applicant-tracking-systems-jobs-from-greenhouse-workday-bullhorn-brassring-and-3d8p</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/one-api-for-120-applicant-tracking-systems-jobs-from-greenhouse-workday-bullhorn-brassring-and-3d8p</guid>
      <description>&lt;p&gt;If you run a job board, a recruiting team or a sales-prospecting list built on hiring signals, you know the problem: every company posts jobs in a different applicant tracking system (ATS). Greenhouse has one feed, Workday another, Bullhorn a third, and a retailer on IBM BrassRing has a fourth. Writing and maintaining one parser per system is a full-time job.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The short answer:&lt;/strong&gt; paste a company website or a job board link, and one Apify Actor detects the system, reads its public feed and returns the same fields for every company. It covers 120 ATS, and each one was tested on a real employer before it was added. (I won't claim it is the biggest list: another Actor advertises 200+. This one is 120 systems that were each read on real data.)&lt;/p&gt;

&lt;h2&gt;
  
  
  What goes in
&lt;/h2&gt;

&lt;p&gt;The &lt;code&gt;companyDomains&lt;/code&gt; field takes either a plain domain or a board link:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="nl"&gt;"companyDomains"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;
    &lt;span class="s2"&gt;"stripe.com"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="s2"&gt;"https://jobs.crelate.com/portal/clayco"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="s2"&gt;"https://hrmos.co/pages/moneyforward/jobs"&lt;/span&gt;
  &lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
  &lt;span class="nl"&gt;"keywords"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"engineer"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;For a bare domain like &lt;code&gt;stripe.com&lt;/code&gt;, the Actor reads the careers page, finds which system it links to and uses that system's own public endpoint. For a link, the system and the company are read from the link itself, with no guessing. A company with a self-hosted careers page and no ATS comes back as &lt;code&gt;"ats": null&lt;/code&gt;: an answer, not an error.&lt;/p&gt;

&lt;h2&gt;
  
  
  Real numbers from the less common systems
&lt;/h2&gt;

&lt;p&gt;The README lists what each newer system returned when it was tested:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;System&lt;/th&gt;
&lt;th&gt;Employer&lt;/th&gt;
&lt;th&gt;Jobs read&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;GR8 People&lt;/td&gt;
&lt;td&gt;Carrier&lt;/td&gt;
&lt;td&gt;4,276&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Crelate&lt;/td&gt;
&lt;td&gt;Clayco&lt;/td&gt;
&lt;td&gt;553&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;IBM BrassRing&lt;/td&gt;
&lt;td&gt;Publix&lt;/td&gt;
&lt;td&gt;365 (every page)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;HRMOS (Japan)&lt;/td&gt;
&lt;td&gt;Money Forward&lt;/td&gt;
&lt;td&gt;229 (3 pages)&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;These are the systems most scrapers skip, and they are where a job board's coverage gaps usually hide.&lt;/p&gt;

&lt;h2&gt;
  
  
  One call over three different systems (Python)
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"&amp;lt;YOUR_APIFY_TOKEN&amp;gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"om_kh/ats-jobs-api"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="s2"&gt;"companyDomains"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;
        &lt;span class="s2"&gt;"https://boards.greenhouse.io/stripe"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;        &lt;span class="c1"&gt;# Greenhouse&lt;/span&gt;
        &lt;span class="s2"&gt;"https://jobs.crelate.com/portal/clayco"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;     &lt;span class="c1"&gt;# Crelate&lt;/span&gt;
        &lt;span class="s2"&gt;"https://hrmos.co/pages/moneyforward/jobs"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;   &lt;span class="c1"&gt;# HRMOS&lt;/span&gt;
    &lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="s2"&gt;"keywords"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"engineer"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"defaultDatasetId"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"company"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"|"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"title"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"|"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"location"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Three different systems, one schema. With &lt;code&gt;includeDescription&lt;/code&gt; on (the default), each row also carries the full description where the system publishes it, plus facts read from the text by rules, without AI: skills, years of experience, remote or office, contract type, yearly salary when stated.&lt;/p&gt;

&lt;p&gt;You can also filter before you pay: &lt;code&gt;remoteOnly&lt;/code&gt;, &lt;code&gt;workArrangements&lt;/code&gt;, &lt;code&gt;employmentTypes&lt;/code&gt;, &lt;code&gt;countries&lt;/code&gt;, &lt;code&gt;minYearlySalary&lt;/code&gt;, &lt;code&gt;excludeAgencies&lt;/code&gt;, and &lt;code&gt;onlyNewJobs&lt;/code&gt; so a daily run only delivers jobs it has not delivered before. Don't know which companies to ask for? Set &lt;code&gt;searchAllCompanies&lt;/code&gt; to &lt;code&gt;true&lt;/code&gt; with keywords or a city and it searches an index of 8,528 companies (377,336 jobs on 7 November 2026).&lt;/p&gt;

&lt;h2&gt;
  
  
  Run it on a schedule with Make or n8n
&lt;/h2&gt;

&lt;p&gt;If you do not want to write code, the Apify module does the same thing:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Apify &amp;gt; Run an Actor&lt;/strong&gt;: choose &lt;code&gt;om_kh/ats-jobs-api&lt;/code&gt; and paste the input JSON above.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Apify &amp;gt; Get Dataset Items&lt;/strong&gt;: use the run's default dataset.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google Sheets &amp;gt; Add a Row&lt;/strong&gt; (or Airtable, your ATS, a Slack message).&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Put a daily schedule on the scenario and switch on &lt;code&gt;onlyNewJobs&lt;/code&gt;. Each morning the sheet receives only the roles that appeared since yesterday. In n8n it is the Apify node with the operation &lt;em&gt;Run Actor and get dataset&lt;/em&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  Price
&lt;/h2&gt;

&lt;p&gt;Today &lt;code&gt;ats-jobs-api&lt;/code&gt; costs $1.50 per 1,000 jobs (lower on larger Apify plans), and the first 3 jobs of every run are free. From 20 November 2026 each run also costs $0.001. A company with about 35 open roles costs around $0.05. If you only want company careers pages, &lt;code&gt;om_kh/careers-page-scraper&lt;/code&gt; uses the same engine; it costs $1.50 per 1,000 jobs plus $0.005 per run today and moves to $2.50 per 1,000 jobs on 18 November 2026.&lt;/p&gt;

&lt;h2&gt;
  
  
  Using it from an AI agent
&lt;/h2&gt;

&lt;p&gt;Both Actors work as tools through the Apify MCP server (&lt;code&gt;https://mcp.apify.com&lt;/code&gt;), so an agent can ask for "open data roles at these ten companies" and get structured rows back.&lt;/p&gt;

&lt;p&gt;Links: &lt;a href="https://apify.com/om_kh/ats-jobs-api" rel="noopener noreferrer"&gt;ATS Jobs API on Apify&lt;/a&gt; · &lt;a href="https://apify.com/om_kh/careers-page-scraper" rel="noopener noreferrer"&gt;Careers Page Scraper&lt;/a&gt; · &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;guide index&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>python</category>
      <category>api</category>
      <category>recruiting</category>
      <category>webscraping</category>
    </item>
    <item>
      <title>Only the new jobs every morning: remote, contract type, yearly salary and company size from any company's careers page</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Tue, 03 Nov 2026 16:21:31 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/only-the-new-jobs-every-morning-remote-contract-type-yearly-salary-and-company-size-from-any-ig1</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/only-the-new-jobs-every-morning-remote-contract-type-yearly-salary-and-company-size-from-any-ig1</guid>
      <description>&lt;p&gt;If you recruit, prospect companies that are hiring, or run a job board, you do not want 5,000 job rows every day. You want the 40 that appeared since yesterday and match your filters. Job aggregators make that hard: duplicates, stale copies, and no clean fields for remote, contract type or salary.&lt;/p&gt;

&lt;p&gt;The answer: read the employer's own career page feed, filter before you pay, and switch on "only new jobs" for a daily schedule. The Actor &lt;a href="https://apify.com/om_kh/careers-page-scraper" rel="noopener noreferrer"&gt;Company Careers Page Scraper&lt;/a&gt; does this. You give it company websites (&lt;code&gt;stripe.com&lt;/code&gt;) or tick "search all companies" with a keyword. It finds which applicant tracking system sits behind each careers page and reads that system's public endpoint.&lt;/p&gt;

&lt;h2&gt;
  
  
  The input
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;run_input&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="c1"&gt;# Option A: a company list
&lt;/span&gt;    &lt;span class="c1"&gt;# "companyDomains": ["stripe.com", "figma.com", "notion.so"],
&lt;/span&gt;    &lt;span class="c1"&gt;# Option B: search an index of open roles, no list needed
&lt;/span&gt;    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;searchAllCompanies&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;keywords&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;data engineer&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;

    &lt;span class="c1"&gt;# Filters, applied BEFORE you are charged
&lt;/span&gt;    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;workArrangements&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;REMOTE&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;HYBRID&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;employmentTypes&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;FULL_TIME&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;CONTRACT&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;minYearlySalary&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;90000&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;excludeAgencies&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;companySizes&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;201-500&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;501-1,000&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;1,001-5,000&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;

    &lt;span class="c1"&gt;# Only jobs this search has not delivered before
&lt;/span&gt;    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;onlyNewJobs&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;maxTotalChargeUsd&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;

&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;om_kh/careers-page-scraper&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;title&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;|&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;company_name&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;|&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;work_arrangement&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The filters that run before billing include work arrangement (remote, hybrid, on-site), contract type, countries, a minimum yearly salary (hourly and monthly pay are converted), no staffing agencies, industries and company size bands. A job you filtered out is never charged.&lt;/p&gt;

&lt;h2&gt;
  
  
  "Only new jobs" is the daily switch
&lt;/h2&gt;

&lt;p&gt;Set &lt;code&gt;onlyNewJobs&lt;/code&gt; to &lt;code&gt;true&lt;/code&gt; and schedule the run every morning. The first run delivers everything that matches. After that, each run delivers only the jobs this same search has not delivered before, and jobs already delivered are never charged again. Give &lt;code&gt;memoryKey&lt;/code&gt; a name if you want two tasks to share the same memory.&lt;/p&gt;

&lt;h2&gt;
  
  
  What a row contains
&lt;/h2&gt;

&lt;p&gt;Each row has the title, company, location, posting date, apply link and (by default) the full description. On top of that, plain rules read these facts from the posting, with no AI step and no extra cost:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Field&lt;/th&gt;
&lt;th&gt;What it holds&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;work_arrangement&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;REMOTE&lt;/code&gt;, &lt;code&gt;HYBRID&lt;/code&gt; or &lt;code&gt;ON_SITE&lt;/code&gt; (plus &lt;code&gt;office_days_per_week&lt;/code&gt; when a hybrid posting says it)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;employment_type&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;FULL_TIME&lt;/code&gt;, &lt;code&gt;PART_TIME&lt;/code&gt;, &lt;code&gt;CONTRACT&lt;/code&gt;, &lt;code&gt;INTERNSHIP&lt;/code&gt;...&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;
&lt;code&gt;city&lt;/code&gt;, &lt;code&gt;region&lt;/code&gt;, &lt;code&gt;country&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;the first location split into parts, country as a 2-letter code&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;
&lt;code&gt;salary_period&lt;/code&gt;, &lt;code&gt;salary_yearly_min&lt;/code&gt;, &lt;code&gt;salary_yearly_max&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;the pay band and its yearly equivalent, so hourly and yearly jobs compare&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;benefits&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;health, equity, paid time off, learning budget...&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;
&lt;code&gt;company_industry&lt;/code&gt;, &lt;code&gt;company_size&lt;/code&gt;, &lt;code&gt;company_headquarters&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;from Wikidata: for example Stripe = financial services, &lt;code&gt;5,001-10,000&lt;/code&gt; employees&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;A field stays empty when the posting does not say it; nothing is guessed. Measured on 592 live roles (Stripe, Palantir, Notion, Airbnb) on 28 October 2026: city found on 84%, country 75%, on-site/hybrid/remote 67%, benefits 74%, contract type 51%. So expect gaps, and tick "Not stated" in a filter when you want to keep jobs that do not say.&lt;/p&gt;

&lt;h2&gt;
  
  
  Google Jobs too
&lt;/h2&gt;

&lt;p&gt;If you also need Google Jobs results, the same author's &lt;a href="https://apify.com/om_kh/google-jobs-scraper" rel="noopener noreferrer"&gt;Google Jobs Scraper&lt;/a&gt; covers that source. For provider-level control across the main ATS systems there is the &lt;a href="https://apify.com/om_kh/ats-jobs-api" rel="noopener noreferrer"&gt;ATS Jobs API&lt;/a&gt;, which returns the same row format.&lt;/p&gt;

&lt;h2&gt;
  
  
  Run it on a schedule with Make or n8n
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;In Apify, save the run input above as a Task and add a daily Schedule (for example 7:00).&lt;/li&gt;
&lt;li&gt;Make: &lt;strong&gt;Apify &amp;gt; Run an Actor&lt;/strong&gt;, then &lt;strong&gt;Apify &amp;gt; Get Dataset Items&lt;/strong&gt;, then &lt;strong&gt;Google Sheets &amp;gt; Add a Row&lt;/strong&gt;. n8n: the Apify node, operation &lt;em&gt;Run Actor and get dataset&lt;/em&gt;, then a Google Sheets node.&lt;/li&gt;
&lt;li&gt;Because of &lt;code&gt;onlyNewJobs&lt;/code&gt;, the sheet only receives new rows, so the same flow can notify Slack or a CRM.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Pricing
&lt;/h2&gt;

&lt;p&gt;$1.50 per 1,000 jobs delivered (FREE-tier price; paid Apify plans get a discount), the first 3 jobs of every run are free, and the careers page Actor adds a small start fee of $0.005 per run, so put many companies or one broad search in a single run. The ATS Jobs API has the same per-job price without the start fee. The Pricing tab of the Actor page always shows the current numbers.&lt;/p&gt;

&lt;h2&gt;
  
  
  Use it from an AI agent
&lt;/h2&gt;

&lt;p&gt;Add &lt;code&gt;om_kh/careers-page-scraper&lt;/code&gt; as a tool in any MCP client through &lt;code&gt;https://mcp.apify.com&lt;/code&gt;; the agent passes the same JSON as the run input and reads the dataset back.&lt;/p&gt;

&lt;p&gt;More tutorials: &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>recruiting</category>
      <category>python</category>
      <category>automation</category>
    </item>
    <item>
      <title>AliExpress best sellers with real prices for dropshippers: skip the new-shopper teaser</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Tue, 27 Oct 2026 14:09:51 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/aliexpress-best-sellers-with-real-prices-for-dropshippers-skip-the-new-shopper-teaser-5fd</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/aliexpress-best-sellers-with-real-prices-for-dropshippers-skip-the-new-shopper-teaser-5fd</guid>
      <description>&lt;p&gt;If you price products for dropshipping, the number you copy from an AliExpress search page decides your margin. The catch: logged-out visitors are shown a one-time "new shopper" deal on a large share of products. On a search for "phone case" read on 2026-10-15, that teaser price appeared on 40-55% of the products. Build a margin sheet on those numbers and every product looks cheaper to source than it really is.&lt;/p&gt;

&lt;h2&gt;
  
  
  The short answer
&lt;/h2&gt;

&lt;p&gt;Use a scraper that returns the seller's normal price and keeps the teaser in a separate field. The Apify Actor &lt;a href="https://apify.com/om_kh/aliexpress-search-scraper" rel="noopener noreferrer"&gt;AliExpress Search Scraper&lt;/a&gt; does that: &lt;code&gt;price&lt;/code&gt; is what an ordinary buyer pays the seller, and the one-time deal, when there is one, goes in &lt;code&gt;newShopperPrice&lt;/code&gt;. Your price research is no longer skewed by $0.33 and $1.09 teasers.&lt;/p&gt;

&lt;p&gt;It reads public search results, logged out, and returns up to 3,000 products per search.&lt;/p&gt;

&lt;h2&gt;
  
  
  Python example
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;om_kh/aliexpress-search-scraper&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;searchTerms&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;phone case&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;led strip&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;maxProductsPerSearch&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;500&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;sortBy&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;orders&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;minRating&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mf"&gt;4.5&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;includeSponsored&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;False&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;maxTotalChargeUsd&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;3&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;})&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;title&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;][:&lt;/span&gt;&lt;span class="mi"&gt;60&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;price&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;soldCount&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;What the input does:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;searchTerms&lt;/code&gt;: one search per entry. You can also paste AliExpress search links in &lt;code&gt;searchUrls&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;sortBy&lt;/code&gt;: &lt;code&gt;best_match&lt;/code&gt;, &lt;code&gt;orders&lt;/code&gt;, &lt;code&gt;price_asc&lt;/code&gt; or &lt;code&gt;price_desc&lt;/code&gt;. For best-seller research, &lt;code&gt;orders&lt;/code&gt; is the useful one.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;minRating&lt;/code&gt;, &lt;code&gt;minOrders&lt;/code&gt;, &lt;code&gt;minPrice&lt;/code&gt;, &lt;code&gt;maxPrice&lt;/code&gt;: filters applied to the seller price, rating and units sold.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;includeSponsored&lt;/code&gt;: set to &lt;code&gt;False&lt;/code&gt; to drop the products AliExpress shows as ads.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;maxTotalChargeUsd&lt;/code&gt;: a hard cap, so a test run can never cost more than you decide.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What the output looks like
&lt;/h2&gt;

&lt;p&gt;One row per unique product, in AliExpress's order. Here is a real row from a run on 2026-10-23 (long texts cut):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"productId"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"1005013148549041"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"title"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Night Light Liquid Quicksand TPU Soft Case for IPhone Air 17 16 15 13 12 11 Pro Max ..."&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://www.aliexpress.com/item/1005013148549041.html"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"price"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;4.88&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"originalPrice"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;4.96&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"discountPercent"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"currency"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"USD"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"rating"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;4.9&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"soldCount"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;307&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"soldText"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"307 sold"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"isChoice"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"isSponsored"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;false&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"deliveryEstimate"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Fastest delivery in 6 days"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"freeShipping"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;false&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"localWarehouse"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;false&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"searchTerm"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"phone case"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"sortBy"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"best_match"&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;For a dropshipper the useful columns are &lt;code&gt;price&lt;/code&gt; (real cost), &lt;code&gt;soldCount&lt;/code&gt; (demand), &lt;code&gt;rating&lt;/code&gt;, &lt;code&gt;isChoice&lt;/code&gt; and &lt;code&gt;deliveryEstimate&lt;/code&gt; (can you promise a delivery time?), plus &lt;code&gt;freeShipping&lt;/code&gt; and &lt;code&gt;localWarehouse&lt;/code&gt;. Fields AliExpress does not show for a product come back as &lt;code&gt;null&lt;/code&gt;. Prices are in US dollars, as shown to a US visitor.&lt;/p&gt;

&lt;h2&gt;
  
  
  A simple margin check
&lt;/h2&gt;

&lt;p&gt;Once the rows are in a list, the sourcing filter is a few lines:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;rows&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;list&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;())&lt;/span&gt;
&lt;span class="n"&gt;good&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;r&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;rows&lt;/span&gt;
        &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;soldCount&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;soldCount&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;=&lt;/span&gt; &lt;span class="mi"&gt;1000&lt;/span&gt;
        &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="ow"&gt;not&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;isSponsored&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
        &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;price&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="o"&gt;&amp;lt;=&lt;/span&gt; &lt;span class="mi"&gt;6&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="n"&gt;good&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;sort&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;key&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="k"&gt;lambda&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;soldCount&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;reverse&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Because &lt;code&gt;price&lt;/code&gt; is the seller price and not the teaser, the cost you compare against your selling price is the one you will really pay.&lt;/p&gt;

&lt;h2&gt;
  
  
  Run it on a schedule with Make or n8n
&lt;/h2&gt;

&lt;p&gt;Best sellers move, so a weekly snapshot is more useful than a one-off export. In Make or n8n, use the Apify module or node:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Run an Actor&lt;/strong&gt; with &lt;code&gt;om_kh/aliexpress-search-scraper&lt;/code&gt; and your search terms.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Get Dataset Items&lt;/strong&gt; from that run.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google Sheets: Add Rows&lt;/strong&gt; to a "week of" tab.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Compare &lt;code&gt;price&lt;/code&gt; and &lt;code&gt;soldCount&lt;/code&gt; week over week to see which products are gaining orders and which are getting more expensive.&lt;/p&gt;

&lt;h2&gt;
  
  
  Pricing
&lt;/h2&gt;

&lt;p&gt;$3 per 1,000 products with no start fee, and the first 10 products of every run are free. Searches that return no product and AliExpress outages are not charged, and &lt;code&gt;maxTotalChargeUsd&lt;/code&gt; caps any run.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limits
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;AliExpress shows at most about 60 pages per search. For more, split by price range or use more specific words.&lt;/li&gt;
&lt;li&gt;It reads search result pages only, so there are no product variants or reviews.&lt;/li&gt;
&lt;li&gt;Rating, units sold and delivery estimate appear only when AliExpress shows them on the search card.&lt;/li&gt;
&lt;li&gt;Use the data in line with the laws and terms that apply to you.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Use it from an AI agent (MCP)
&lt;/h2&gt;

&lt;p&gt;AI agents can call the Actor through &lt;code&gt;https://mcp.apify.com&lt;/code&gt; as &lt;code&gt;om_kh/aliexpress-search-scraper&lt;/code&gt; (tool &lt;code&gt;aliexpress_search&lt;/code&gt;).&lt;/p&gt;

&lt;p&gt;More tutorials for this and my other Actors are in the &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;guide index&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>python</category>
      <category>ecommerce</category>
      <category>api</category>
      <category>automation</category>
    </item>
    <item>
      <title>Korean marketplace prices for cross-border sellers: 11st products, sales counts and ratings in one API call</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Tue, 20 Oct 2026 14:13:30 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/korean-marketplace-prices-for-cross-border-sellers-11st-products-sales-counts-and-ratings-in-one-3dcf</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/korean-marketplace-prices-for-cross-border-sellers-11st-products-sales-counts-and-ratings-in-one-3dcf</guid>
      <description>&lt;p&gt;If you sell in or source from South Korea, you need to know what a product really costs on a local marketplace, who sells it, and how well it sells. Checking by hand means reading Korean search pages one product at a time. Most scraping tools skip 11st (11번가), one of the country's largest online marketplaces.&lt;/p&gt;

&lt;p&gt;Here is the short version: give one API call a search word, in Korean or English, and get back a table of products with the price in won, the list price, the discount, the brand, the sales count, the rating and the review count.&lt;/p&gt;

&lt;h2&gt;
  
  
  The answer first
&lt;/h2&gt;

&lt;p&gt;I built an &lt;a href="https://apify.com/om_kh/11st-korea-product-scraper" rel="noopener noreferrer"&gt;11st Korea Product Scraper on Apify&lt;/a&gt;. It reads 11st's public search results, logged out, with no account or proxy setup on your side. When I checked on 15 October 2026, no other 11st scraper was listed on the Apify Store.&lt;/p&gt;

&lt;p&gt;A run returns up to 2,500 unique products per search. Ads and products repeated across pages are removed, and each row says whether it was sponsored. In my tests, about 500 products came back in 20 seconds.&lt;/p&gt;

&lt;p&gt;You can search in Korean (&lt;code&gt;노트북&lt;/code&gt; is "laptop", &lt;code&gt;선크림&lt;/code&gt; is "sunscreen") or in English for brand and model names (&lt;code&gt;dyson&lt;/code&gt;, &lt;code&gt;iphone 16&lt;/code&gt;). For generic products, Korean words return far more results.&lt;/p&gt;

&lt;h2&gt;
  
  
  Working Python snippet
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;om_kh/11st-korea-product-scraper&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;searchTerms&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;노트북&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;dyson&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;maxProductsPerSearch&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;200&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;sortBy&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;best_selling&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;maxTotalChargeUsd&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;})&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;title&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;price&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;salesCount&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The inputs that matter for sourcing and price checks:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;searchTerms&lt;/code&gt;: one search per entry. You can also paste 11st search links in &lt;code&gt;searchUrls&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;maxProductsPerSearch&lt;/code&gt;: 1 to 2,500 unique products per search (default 100).&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;sortBy&lt;/code&gt;: the same seven orders as the 11st menu: &lt;code&gt;ranking&lt;/code&gt;, &lt;code&gt;popular&lt;/code&gt;, &lt;code&gt;lowest_price&lt;/code&gt;, &lt;code&gt;highest_price&lt;/code&gt;, &lt;code&gt;best_selling&lt;/code&gt;, &lt;code&gt;most_reviews&lt;/code&gt;, &lt;code&gt;newest&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;minPrice&lt;/code&gt; and &lt;code&gt;maxPrice&lt;/code&gt;: a price range in Korean won.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;includeSponsored&lt;/code&gt;: keep or drop the products 11st shows as ads.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;maxTotalChargeUsd&lt;/code&gt;: a hard cap on the cost of the run.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What the output looks like
&lt;/h2&gt;

&lt;p&gt;One row per product. This is a real row from the Actor's README, read on 15 October 2026 (search &lt;code&gt;선크림&lt;/code&gt;, sorted by &lt;code&gt;best_selling&lt;/code&gt;):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"productId"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"1085982197"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"title"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"본트리 베리 에센스 선 블럭 50ml(SPF50+) 3개"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://www.11st.co.kr/products/1085982197"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"price"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;22900&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"originalPrice"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;24000&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"discountPercent"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;4&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"currency"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"KRW"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"brand"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"본트리"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"isOfficialSeller"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"salesCount"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;18060&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"rating"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;4.5&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"reviewCount"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;3952&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"deliveryText"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"무료"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"shipsToday"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"isSoldOut"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;false&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"isLowestPrice11st"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"isSponsored"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="kc"&gt;false&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"position"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"searchTerm"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"선크림"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"sortBy"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"best_selling"&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;A few notes on reading it:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;price&lt;/code&gt; is in won and already includes the discount 11st applies. Card or membership discounts are not included.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;salesCount&lt;/code&gt;, &lt;code&gt;rating&lt;/code&gt; and &lt;code&gt;reviewCount&lt;/code&gt; appear when 11st shows them for that product. They are present on 70 to 90 percent of rows for consumer goods.&lt;/li&gt;
&lt;li&gt;Fields 11st does not show are &lt;code&gt;null&lt;/code&gt;. An official 11st listing has no third-party seller name, for example.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;deliveryText&lt;/code&gt; is 11st's own wording (&lt;code&gt;무료&lt;/code&gt; means free delivery).&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For a cross-border seller, sort by &lt;code&gt;best_selling&lt;/code&gt;, then compare &lt;code&gt;price&lt;/code&gt; against your landed cost. The &lt;code&gt;isLowestPrice11st&lt;/code&gt; flag and the sponsored flag help you separate real demand from paid placement.&lt;/p&gt;

&lt;h2&gt;
  
  
  Run it on a schedule with Make or n8n
&lt;/h2&gt;

&lt;p&gt;You do not need to host any Python. In Make or n8n, use the Apify module or node and build three steps:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Run an Actor&lt;/strong&gt;: pick &lt;code&gt;om_kh/11st-korea-product-scraper&lt;/code&gt;, set your search words, a sort order and a product limit. Schedule the scenario daily to follow prices.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Get Dataset Items&lt;/strong&gt;: use the default dataset of the run from step 1.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google Sheets: Add a Row&lt;/strong&gt;: map &lt;code&gt;title&lt;/code&gt;, &lt;code&gt;price&lt;/code&gt;, &lt;code&gt;salesCount&lt;/code&gt;, &lt;code&gt;rating&lt;/code&gt; and &lt;code&gt;url&lt;/code&gt; to columns.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;After a week, the sheet shows which products drop in price and which ones keep selling.&lt;/p&gt;

&lt;h2&gt;
  
  
  Pricing
&lt;/h2&gt;

&lt;p&gt;$4 per 1,000 products, no start fee. The first 10 products of every run are free. A search with no product, or an 11st outage, is never charged. Paid Apify plans get lower tier prices (see the Pricing tab), and &lt;code&gt;maxTotalChargeUsd&lt;/code&gt; caps any run.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limits
&lt;/h2&gt;

&lt;p&gt;11st serves about 100 new products per page, so a broad search can return thousands of products while a narrow one returns only a few dozen. It reads public search results only. Use the data in line with the laws and terms that apply to you.&lt;/p&gt;

&lt;h2&gt;
  
  
  MCP
&lt;/h2&gt;

&lt;p&gt;AI agents can call it through &lt;code&gt;https://mcp.apify.com&lt;/code&gt; as &lt;code&gt;om_kh/11st-korea-product-scraper&lt;/code&gt; (tool &lt;code&gt;elevenst_products&lt;/code&gt;), so an assistant can look up Korean prices while it researches a product.&lt;/p&gt;

&lt;p&gt;More Actors and guides: &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>python</category>
      <category>ecommerce</category>
      <category>automation</category>
      <category>api</category>
    </item>
    <item>
      <title>Google Trends for 100 keywords without failed runs: a pipeline for SEO and e-commerce teams</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Tue, 13 Oct 2026 22:21:32 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/google-trends-for-100-keywords-without-failed-runs-a-pipeline-for-seo-and-e-commerce-teams-59b2</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/google-trends-for-100-keywords-without-failed-runs-a-pipeline-for-seo-and-e-commerce-teams-59b2</guid>
      <description>&lt;p&gt;If you run SEO or an online shop, you probably check Google Trends for a list of keywords every week: which products are rising, which queries are about to break out, which country is heating up. Doing that by hand for 100 keywords means 100 tabs. Doing it with a script usually means rate limits and half-empty results.&lt;/p&gt;

&lt;p&gt;Here is the short version: pass a list of keywords (or a Google Sheet) to one API call, and get one row per keyword with the direction, the % change, the top regions and the rising "breakout" queries already computed.&lt;/p&gt;

&lt;h2&gt;
  
  
  The answer first
&lt;/h2&gt;

&lt;p&gt;I built a &lt;a href="https://apify.com/om_kh/google-trends-scraper" rel="noopener noreferrer"&gt;Google Trends Scraper on Apify&lt;/a&gt;. It reads Google Trends directly, works through your list four keywords at a time (each on its own Google session), and retries a keyword that Google rate-limits on a fresh session at the end of the run, up to two more times. A keyword that still fails comes back as an error row and is never charged.&lt;/p&gt;

&lt;p&gt;Measured on Apify on 7 October 2026, United States, with regions and related queries on:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Test&lt;/th&gt;
&lt;th&gt;Keywords delivered&lt;/th&gt;
&lt;th&gt;Run time&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;40 keywords&lt;/td&gt;
&lt;td&gt;40 of 40&lt;/td&gt;
&lt;td&gt;64 seconds&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;100 keywords&lt;/td&gt;
&lt;td&gt;100 of 100&lt;/td&gt;
&lt;td&gt;3 min 39 s&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;A run accepts up to 1,000 keywords.&lt;/p&gt;

&lt;h2&gt;
  
  
  Working Python snippet
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;om_kh/google-trends-scraper&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;searchTerms&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;standing desk&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;ergonomic chair&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;monitor arm&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;geo&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;US&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;timeRange&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;past_90_days&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;includeRelated&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;includeRegions&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;})&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;keyword&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;trendDirection&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;changePct&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The inputs that matter for a keyword-list workflow:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;searchTerms&lt;/code&gt;: your keywords, up to 1,000 per run.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;spreadsheetId&lt;/code&gt;: a link or ID of a Google Sheet shared as "Anyone with the link". The first column is read, one keyword per row, so your team keeps the list in a sheet instead of in code.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;geo&lt;/code&gt;: two-letter country code (&lt;code&gt;US&lt;/code&gt;, &lt;code&gt;FR&lt;/code&gt;, &lt;code&gt;GB&lt;/code&gt;...). Empty means worldwide.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;timeRange&lt;/code&gt; or &lt;code&gt;customTimeRange&lt;/code&gt; (&lt;code&gt;2025-01-01 2025-12-31&lt;/code&gt;).&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;searchProperty&lt;/code&gt;: &lt;code&gt;web&lt;/code&gt;, &lt;code&gt;youtube&lt;/code&gt;, &lt;code&gt;news&lt;/code&gt;, &lt;code&gt;images&lt;/code&gt; or &lt;code&gt;shopping&lt;/code&gt;. E-commerce teams often want &lt;code&gt;shopping&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;compare&lt;/code&gt;: group keywords by 5 on the same 0-100 scale, like typing them together on Google Trends.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;maxTotalChargeUsd&lt;/code&gt;: a hard cost cap for the run.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What the output looks like
&lt;/h2&gt;

&lt;p&gt;One row per keyword. This is the real example from the Actor's README (YouTube searches, year 2025, labels in French because &lt;code&gt;language&lt;/code&gt; was &lt;code&gt;fr&lt;/code&gt;; lists cut to their first entries):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"keyword"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"keyword"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"chatgpt"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"geo"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"US"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"timeRange"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2025-01-01 2025-12-31"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"searchProperty"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"youtube"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"comparedWith"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"claude ai"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"averageInterest"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;60.1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"peakInterest"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;100&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"peakDate"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2025-08-03T00:00:00Z"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"latestInterest"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;53&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"trendDirection"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"rising"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"changePct"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;20.5&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"topRegions"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[{&lt;/span&gt;&lt;span class="nl"&gt;"region"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Virginie"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"code"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"US-VA"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"value"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;100&lt;/span&gt;&lt;span class="p"&gt;}],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"relatedQueriesRising"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[{&lt;/span&gt;&lt;span class="nl"&gt;"query"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"deepseek"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"value"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;104850&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"formattedValue"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Record"&lt;/span&gt;&lt;span class="p"&gt;}],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"status"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"ok"&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;code&gt;trendDirection&lt;/code&gt; and &lt;code&gt;changePct&lt;/code&gt; are computed for you, so you can sort 100 or 1,000 keywords by momentum in a spreadsheet in seconds. The rising related queries include Google's "Breakout" queries, the earliest signal of a new trend. Values are Google's relative scale (100 is the peak for the period and place), not absolute search volumes.&lt;/p&gt;

&lt;h2&gt;
  
  
  Run it on a schedule with Make or n8n
&lt;/h2&gt;

&lt;p&gt;You do not need to host any Python. In Make or n8n, use the Apify module/node and build three steps:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Run an Actor&lt;/strong&gt;: pick &lt;code&gt;om_kh/google-trends-scraper&lt;/code&gt;, set &lt;code&gt;spreadsheetId&lt;/code&gt; to your keyword sheet and &lt;code&gt;geo&lt;/code&gt; to your market. Schedule the scenario every Monday morning.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Get Dataset Items&lt;/strong&gt;: use the default dataset of the run from step 1.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google Sheets: Add a Row&lt;/strong&gt;: map &lt;code&gt;keyword&lt;/code&gt;, &lt;code&gt;trendDirection&lt;/code&gt;, &lt;code&gt;changePct&lt;/code&gt;, &lt;code&gt;peakDate&lt;/code&gt; and &lt;code&gt;latestInterest&lt;/code&gt; to columns, plus the measurement basis: &lt;code&gt;geo&lt;/code&gt;, &lt;code&gt;timeRange&lt;/code&gt;, &lt;code&gt;searchProperty&lt;/code&gt; and &lt;code&gt;comparedWith&lt;/code&gt;.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Sort the results tab by &lt;code&gt;changePct&lt;/code&gt; and the products or topics gaining momentum are at the top.&lt;/p&gt;

&lt;p&gt;Keep the measurement-basis columns. Trends values are relative, so if the country, the period, the search property or the comparison group changes between two weekly runs, the numbers move even when demand did not. Comparing only rows with the same basis keeps a week-over-week change honest.&lt;/p&gt;

&lt;h2&gt;
  
  
  Pricing
&lt;/h2&gt;

&lt;p&gt;$2 per 1,000 keyword rows, no start fee. The first 3 results of every run are free, a keyword Google could not return is not charged, and paid Apify plans get lower tier prices (see the Pricing tab). A 100-keyword weekly check is about $0.20 per run.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limits
&lt;/h2&gt;

&lt;p&gt;Google Trends values are relative, not search volumes. Very rare keywords may return no data; they are reported and not charged. For lists over 50 keywords, leave &lt;code&gt;includeRelated&lt;/code&gt; on only if you need it, since it adds requests. Metro areas exist for the United States only. It reads public, aggregated data; use it in line with the terms that apply to you.&lt;/p&gt;

&lt;h2&gt;
  
  
  MCP
&lt;/h2&gt;

&lt;p&gt;AI agents can call it through &lt;code&gt;https://mcp.apify.com&lt;/code&gt; as &lt;code&gt;om_kh/google-trends-scraper&lt;/code&gt;, so an assistant can check whether a topic is growing before it recommends it.&lt;/p&gt;

&lt;p&gt;More Actors and guides: &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>python</category>
      <category>seo</category>
      <category>automation</category>
      <category>api</category>
    </item>
    <item>
      <title>Google Jobs to Google Sheets every morning: a recruiter's no-code-ish pipeline</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Tue, 06 Oct 2026 14:50:04 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/google-jobs-to-google-sheets-every-morning-a-recruiters-no-code-ish-pipeline-oj5</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/google-jobs-to-google-sheets-every-morning-a-recruiters-no-code-ish-pipeline-oj5</guid>
      <description>&lt;p&gt;If you recruit, you probably open Google Jobs every morning, search the same three or four roles in the same cities, and copy what looks new into a spreadsheet. It works, but it is 30 minutes a day of copy-paste, and Google only shows 10 jobs per page.&lt;/p&gt;

&lt;p&gt;Here is the short version: call one API with your searches, get one clean row per posting (salary as numbers, posted date, every apply link), and push the rows into Google Sheets on a schedule. Below is the Python version and the no-code version.&lt;/p&gt;

&lt;h2&gt;
  
  
  The answer first
&lt;/h2&gt;

&lt;p&gt;I built a &lt;a href="https://apify.com/om_kh/google-jobs-scraper" rel="noopener noreferrer"&gt;Google Jobs Scraper on Apify&lt;/a&gt;. Google Jobs merges LinkedIn, Indeed, Glassdoor, ZipRecruiter and company career pages, so one search covers all of them. You give it job titles and locations, and it returns deduplicated rows.&lt;/p&gt;

&lt;h2&gt;
  
  
  Working Python snippet
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;om_kh/google-jobs-scraper&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;queries&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;registered nurse&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;physical therapist&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;locations&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Houston&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Dallas&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;maxJobsPerSearch&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="mi"&gt;100&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;postedWithin&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;today&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;onlyWithSalary&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;})&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;title&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;companyName&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;salary&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt; &lt;span class="n"&gt;job&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;applyUrl&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The useful inputs for a daily recruiting feed:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;postedWithin&lt;/code&gt;: &lt;code&gt;today&lt;/code&gt;, &lt;code&gt;3days&lt;/code&gt;, &lt;code&gt;week&lt;/code&gt; or &lt;code&gt;month&lt;/code&gt;. Use &lt;code&gt;today&lt;/code&gt; for a morning run so you only see new postings.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;scheduleType&lt;/code&gt;: Full-time, Part-time, Contractor, Internship or Temporary.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;onlyWithSalary&lt;/code&gt;: keep only postings that show a pay range.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;radiusKm&lt;/code&gt;: a hint to Google to search around each location (1 to 300 km).&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;maxJobsPerSearch&lt;/code&gt;: 1 to 140. Google shows 10 per page, so the Actor runs several filter variants in parallel to go further.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What the output looks like
&lt;/h2&gt;

&lt;p&gt;One row per posting. This is a real example from a Chicago search (lists and description shortened):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"title"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Data Analyst II"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"companyName"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Shirley Ryan AbilityLab"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"location"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Chicago, IL"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"via"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Built In Chicago"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"postedAt"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2026-09-14"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"scheduleType"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Full-time"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"salary"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"71.2K–124K a year"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"salaryMin"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;71200.0&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"salaryMax"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;124000.0&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"salaryPeriod"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"year"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"applyUrl"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://builtin.com/job/…"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"applyLinks"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;"source"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"builtin.com"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://builtin.com/job/…"&lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;"source"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"linkedin.com"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://www.linkedin.com/jobs/view/…"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"experienceYears"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"skills"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"Workday"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Salary comes parsed into &lt;code&gt;salaryMin&lt;/code&gt;, &lt;code&gt;salaryMax&lt;/code&gt; and &lt;code&gt;salaryPeriod&lt;/code&gt;, so you can sort and filter in a sheet instead of reading text. &lt;code&gt;experienceYears&lt;/code&gt;, &lt;code&gt;skills&lt;/code&gt;, &lt;code&gt;visaSponsorship&lt;/code&gt; and &lt;code&gt;education&lt;/code&gt; are read from the description by plain rules (no AI); they stay empty when the text does not say. Each row also keeps Google's raw tags (&lt;code&gt;extensions&lt;/code&gt;), a &lt;code&gt;googleUrl&lt;/code&gt; that reopens the job on Google, and the &lt;code&gt;country&lt;/code&gt; and &lt;code&gt;language&lt;/code&gt; of the search.&lt;/p&gt;

&lt;h2&gt;
  
  
  Run it on a schedule with Make or n8n
&lt;/h2&gt;

&lt;p&gt;You do not need to host any Python. In Make or n8n, use the Apify module/node and build three steps:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Run an Actor&lt;/strong&gt;: pick &lt;code&gt;om_kh/google-jobs-scraper&lt;/code&gt; and paste your input JSON. Schedule the scenario every morning.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Get Dataset Items&lt;/strong&gt;: use the default dataset of the run from step 1.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google Sheets: Add a Row&lt;/strong&gt;: map &lt;code&gt;title&lt;/code&gt;, &lt;code&gt;companyName&lt;/code&gt;, &lt;code&gt;location&lt;/code&gt;, &lt;code&gt;salary&lt;/code&gt;, &lt;code&gt;postedAt&lt;/code&gt; and &lt;code&gt;applyUrl&lt;/code&gt; to columns.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Every morning you open the sheet and the new postings are already there, with the direct LinkedIn or Indeed link on each row.&lt;/p&gt;

&lt;h2&gt;
  
  
  Pricing
&lt;/h2&gt;

&lt;p&gt;$2.50 per 1,000 jobs on paid Apify plans (down to $2 on the largest plans), $3 on the free plan, no start fee. Searches Google cannot answer are reported in the run summary and not charged, and you can set &lt;code&gt;maxTotalChargeUsd&lt;/code&gt; as a hard cap.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limits
&lt;/h2&gt;

&lt;p&gt;Google Jobs holds a few hundred postings per search at most, so for full coverage split by city or by more specific titles. Salary only appears when the employer or the board publishes it. It reads public search results; use the data in line with the laws and terms that apply to you.&lt;/p&gt;

&lt;h2&gt;
  
  
  MCP
&lt;/h2&gt;

&lt;p&gt;AI agents can call it through &lt;code&gt;https://mcp.apify.com&lt;/code&gt; as &lt;code&gt;om_kh/google-jobs-scraper&lt;/code&gt;, so an assistant can run a search and summarize the results for you.&lt;/p&gt;

&lt;p&gt;More Actors and guides: &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>python</category>
      <category>automation</category>
      <category>productivity</category>
      <category>api</category>
    </item>
    <item>
      <title>Turn any YouTube video into SRT, VTT or RAG-ready chunks with one API call</title>
      <dc:creator>Omar Khandji</dc:creator>
      <pubDate>Wed, 30 Sep 2026 14:48:05 +0000</pubDate>
      <link>https://dev.to/omar_khandji_0135ce9388bb/turn-any-youtube-video-into-srt-vtt-or-rag-ready-chunks-with-one-api-call-50a3</link>
      <guid>https://dev.to/omar_khandji_0135ce9388bb/turn-any-youtube-video-into-srt-vtt-or-rag-ready-chunks-with-one-api-call-50a3</guid>
      <description>&lt;p&gt;If you build anything with LLMs on top of video — summaries, search, a RAG chatbot over a course — the first problem is getting clean transcripts. Most tools give you one big block of text. For RAG you want pieces of ~250 words that still know &lt;em&gt;when&lt;/em&gt; they were said, so your bot can cite the exact second.&lt;/p&gt;

&lt;p&gt;Here is the shortest path I found, using the &lt;a href="https://apify.com/om_kh/youtube-transcript-api" rel="noopener noreferrer"&gt;YouTube Transcript API&lt;/a&gt; Actor on Apify (no YouTube API key, no cookies):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;apify_client&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;ApifyClient&lt;/span&gt;

&lt;span class="n"&gt;client&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ApifyClient&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;lt;YOUR_APIFY_TOKEN&amp;gt;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;actor&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;om_kh/youtube-transcript-api&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;call&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run_input&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;videos&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;https://www.youtube.com/watch?v=dQw4w9WgXcQ&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;outputFormats&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;chunks&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;srt&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;
&lt;span class="p"&gt;})&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;client&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;dataset&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;defaultDatasetId&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]).&lt;/span&gt;&lt;span class="nf"&gt;iterate_items&lt;/span&gt;&lt;span class="p"&gt;():&lt;/span&gt;
    &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;chunk&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="n"&gt;item&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;chunks&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;]:&lt;/span&gt;
        &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;chunk&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;start&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;chunk&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;end&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt; &lt;span class="n"&gt;chunk&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;text&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;][:&lt;/span&gt;&lt;span class="mi"&gt;80&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Each chunk carries &lt;code&gt;start&lt;/code&gt; and &lt;code&gt;end&lt;/code&gt; in seconds, so a RAG answer can link to &lt;code&gt;https://youtu.be/&amp;lt;id&amp;gt;?t=&amp;lt;start&amp;gt;&lt;/code&gt;. The same run also returns a ready-to-save &lt;code&gt;.srt&lt;/code&gt; string, useful for video editors.&lt;/p&gt;

&lt;h2&gt;
  
  
  Other formats
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;vtt&lt;/code&gt; for web players&lt;/li&gt;
&lt;li&gt;plain text for summaries&lt;/li&gt;
&lt;li&gt;whole channels or playlists: the &lt;a href="https://apify.com/om_kh/youtube-channel-transcripts" rel="noopener noreferrer"&gt;YouTube Channel Transcripts&lt;/a&gt; Actor takes an &lt;code&gt;@handle&lt;/code&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  From an AI agent (MCP)
&lt;/h2&gt;

&lt;p&gt;It also works as an MCP tool through &lt;code&gt;https://mcp.apify.com&lt;/code&gt;, so Claude, Cursor or any MCP client can call it directly: "get the transcript of this video and summarize it".&lt;/p&gt;

&lt;h2&gt;
  
  
  Pricing
&lt;/h2&gt;

&lt;p&gt;Pay per transcript delivered (see the &lt;a href="https://apify.com/om_kh/youtube-transcript-api" rel="noopener noreferrer"&gt;Actor page&lt;/a&gt; for the current price); videos without captions are never charged.&lt;/p&gt;

&lt;p&gt;More step-by-step API guides (Google Trends, YouTube comments, job boards, Kalshi &amp;amp; Polymarket odds): &lt;a href="https://omarkhandji-commits.github.io/apify-actor-catalogue/guides/" rel="noopener noreferrer"&gt;github.com/omarkhandji-commits/apify-actor-catalogue&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Disclosure: I built this Actor. Happy to help if you hit issues — leave a comment.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>python</category>
      <category>rag</category>
      <category>youtube</category>
    </item>
  </channel>
</rss>
