<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Philip Kirkbride</title>
    <description>The latest articles on DEV Community by Philip Kirkbride (@kirkins).</description>
    <link>https://dev.to/kirkins</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F300454%2Fcade6323-07d1-4b5b-9c31-f18769705cb6.png</url>
      <title>DEV Community: Philip Kirkbride</title>
      <link>https://dev.to/kirkins</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/kirkins"/>
    <language>en</language>
    <item>
      <title>Our scrapers now answer like APIs: 16 Apify Actors you can call with one HTTPS request</title>
      <dc:creator>Philip Kirkbride</dc:creator>
      <pubDate>Thu, 19 Nov 2026 14:53:33 +0000</pubDate>
      <link>https://dev.to/kirkins/our-scrapers-now-answer-like-apis-14-apify-actors-you-can-call-with-one-https-request-2523</link>
      <guid>https://dev.to/kirkins/our-scrapers-now-answer-like-apis-14-apify-actors-you-can-call-with-one-https-request-2523</guid>
      <description>&lt;p&gt;Ask for one LinkedIn job, one Zillow home or today's Treasury curve, and the JSON comes back in the same HTTP response. In our test calls on November 18–19, 2026 UTC, answers took 1.8 to 11.0 seconds for 13 of the 16. Google Search Results, Reddit and ZonaProp open a real browser and took 48.9, 21.8 and 23.2 seconds. Your AI agent can call these Actors in the middle of a task and n8n, Make and Zapier can use them in a single HTTP step. Your app can treat them like any other REST API.&lt;/p&gt;

&lt;p&gt;Apify calls this a &lt;strong&gt;Server Actor&lt;/strong&gt; (it was called Standby before). You don't start a run, wait for it to finish and then read a dataset. You send a request to the Actor's own address and read the answer.&lt;/p&gt;

&lt;h2&gt;
  
  
  What changes for you
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Answers in seconds.&lt;/strong&gt; The result is in the response body, under &lt;code&gt;data&lt;/code&gt;. You don't need to poll, and you don't need a second call to fetch results.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Works anywhere you can send HTTPS.&lt;/strong&gt; That covers curl, Python &lt;code&gt;requests&lt;/code&gt;, a function-calling tool in your agent, the HTTP Request node in n8n, the HTTP module in Make and the webhook step in Zapier. All of them work the same way: a URL, query parameters and your Apify token in the &lt;code&gt;Authorization&lt;/code&gt; header.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;A schema your tools can read.&lt;/strong&gt; Every endpoint serves &lt;code&gt;GET /openapi.json&lt;/code&gt;, so an agent framework or API client can import the request and response format directly. You don't have to describe it by hand.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;The same Actor still runs in bulk.&lt;/strong&gt; The classic run with an input form, datasets and schedules works as before.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  The 16 Actors you can call today
&lt;/h2&gt;

&lt;p&gt;Each row is one live endpoint at &lt;code&gt;https://automatic--&amp;lt;actor&amp;gt;.apify.actor/&lt;/code&gt;. The response time comes from one test request per Actor: our deploy script made them right after each server went live on November 18, 2026 UTC, and we called Navent Jobs and ZonaProp ourselves on November 19, 2026 UTC. Your times will vary with the source site and with whether the server is already running.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Actor&lt;/th&gt;
&lt;th&gt;You send&lt;/th&gt;
&lt;th&gt;You get back&lt;/th&gt;
&lt;th&gt;Test response&lt;/th&gt;
&lt;th&gt;How it's billed&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/linkedin-jobs-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;LinkedIn Jobs&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;jobId&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;One job's full description, company, location, posting date and applicant count&lt;/td&gt;
&lt;td&gt;5.3 s&lt;/td&gt;
&lt;td&gt;Per request: $0.001&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/occ-mx-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;OCC Mexico Jobs&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;q&lt;/code&gt; (keyword) or a company board &lt;code&gt;url&lt;/code&gt;, plus &lt;code&gt;limit&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Matching Mexican job offers in OCC's displayed order&lt;/td&gt;
&lt;td&gt;5.9 s&lt;/td&gt;
&lt;td&gt;Per request: $0.001&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/navent-jobs-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Navent Jobs&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;site&lt;/code&gt; (job board: &lt;code&gt;bumeran-ar&lt;/code&gt;, &lt;code&gt;bumeran-mx&lt;/code&gt; or &lt;code&gt;zonajobs-ar&lt;/code&gt;), &lt;code&gt;q&lt;/code&gt; (keyword), &lt;code&gt;limit&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;One page of matching job offers from Bumeran Argentina, Bumeran Mexico or ZonaJobs Argentina: title, company, location, area, workday, posting date and link&lt;/td&gt;
&lt;td&gt;1.8 s&lt;/td&gt;
&lt;td&gt;Per request: $0.0012&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/instagram-post-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Instagram Post&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;shortcode&lt;/code&gt; or post link&lt;/td&gt;
&lt;td&gt;Caption, hashtags, engagement, timestamp and media URLs&lt;/td&gt;
&lt;td&gt;4.8 s&lt;/td&gt;
&lt;td&gt;Per request: $0.003&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/linkedin-company-posts-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;LinkedIn Company Posts&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Company &lt;code&gt;url&lt;/code&gt;, &lt;code&gt;limit&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;The company's newest public posts with reactions and media&lt;/td&gt;
&lt;td&gt;4.9 s&lt;/td&gt;
&lt;td&gt;Per request: $0.0036&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/zillow-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Zillow&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;zpid&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;One home's full details: price, beds and baths, agent, tax, HOA, price history and photos&lt;/td&gt;
&lt;td&gt;5.3 s&lt;/td&gt;
&lt;td&gt;Per request: $0.0009&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/treasury-yield-curve?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;US Treasury Yield Curve&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;date&lt;/code&gt;, or &lt;code&gt;latest=true&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;All 13 Treasury yields and the 2s10s spread for one trading day&lt;/td&gt;
&lt;td&gt;3.8 s&lt;/td&gt;
&lt;td&gt;Per row: $0.002&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/youtube-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;YouTube&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Video or channel &lt;code&gt;url&lt;/code&gt;, or a search &lt;code&gt;q&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;The video, the channel or the search results&lt;/td&gt;
&lt;td&gt;7.2 s&lt;/td&gt;
&lt;td&gt;Per row: $0.00125&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/google-trends-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Google Trends&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;keyword&lt;/code&gt;, &lt;code&gt;geo&lt;/code&gt;, &lt;code&gt;timeframe&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Interest over time with a rising/falling summary, interest by region and related searches&lt;/td&gt;
&lt;td&gt;10.8 s&lt;/td&gt;
&lt;td&gt;Per row: $0.00125&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/linkedin-company-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;LinkedIn Company Pages&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Company &lt;code&gt;url&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Size, website, description, followers and latest posts&lt;/td&gt;
&lt;td&gt;5.3 s&lt;/td&gt;
&lt;td&gt;Per row: $0.00175&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/instagram-profile-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Instagram Profile&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;username&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Bio, follower counts, category and latest posts&lt;/td&gt;
&lt;td&gt;11.0 s&lt;/td&gt;
&lt;td&gt;Per row: $0.0025&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/facebook-pages-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Facebook Pages&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Page &lt;code&gt;url&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Name, categories, contact details, followers and latest post&lt;/td&gt;
&lt;td&gt;5.4 s&lt;/td&gt;
&lt;td&gt;Per row: $0.006&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/google-search-results-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Google Search Results&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;q&lt;/code&gt;, &lt;code&gt;country&lt;/code&gt;, &lt;code&gt;language&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Google's first page of ranked results for the query&lt;/td&gt;
&lt;td&gt;48.9 s&lt;/td&gt;
&lt;td&gt;Per row: $0.0015 per results page&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/reddit-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Reddit&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;Subreddit or thread &lt;code&gt;url&lt;/code&gt;, &lt;code&gt;limit&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;Posts from a subreddit, or a public thread with its comments&lt;/td&gt;
&lt;td&gt;21.8 s&lt;/td&gt;
&lt;td&gt;Per row: $0.001 per post, $0.0005 per comment&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/ml-inmuebles-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;Mercado Libre Inmuebles&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;country&lt;/code&gt;, &lt;code&gt;operation&lt;/code&gt;, &lt;code&gt;province&lt;/code&gt;, &lt;code&gt;limit&lt;/code&gt;, or a search &lt;code&gt;url&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;A shortlist of property listings in Argentina, Mexico or Chile&lt;/td&gt;
&lt;td&gt;6.2 s&lt;/td&gt;
&lt;td&gt;Per row: $0.0004 per listing&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;a href="https://apify.com/automatic/zonaprop-ar-scraper?fpr=automatic&amp;amp;fp_sid=devto-apify-server-actors" rel="noopener noreferrer"&gt;ZonaProp&lt;/a&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;operation&lt;/code&gt;, &lt;code&gt;propertyType&lt;/code&gt;, &lt;code&gt;location&lt;/code&gt;, &lt;code&gt;limit&lt;/code&gt;, or a search &lt;code&gt;url&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;A shortlist of Argentina property listings for sale or rent: price in ARS or USD, size in m², rooms and link&lt;/td&gt;
&lt;td&gt;23.2 s&lt;/td&gt;
&lt;td&gt;Per row: $0.0006 per listing&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;Per request&lt;/strong&gt; means the server runs on our Apify account and charges you one event per successful request. Apify notes that these calls don't use your account's memory or concurrent-run limits. Failed requests are not charged. Every per-request price except Zillow's is a new event added on November 18 at the Free-plan price. Paid Apify plans pay 10–30% less.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Per row&lt;/strong&gt; means the server starts in your own Apify account and bills each result row at the Actor's normal price, just as a regular run does. The Actor page lists the full price, including any start charge. These Actors also save the rows to the run's default dataset.&lt;/p&gt;

&lt;h2&gt;
  
  
  Copy and paste: three requests
&lt;/h2&gt;

&lt;p&gt;Set your token once. You can find it in Apify Console under &lt;strong&gt;Settings → API &amp;amp; Integrations&lt;/strong&gt;.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="kd"&gt;export&lt;/span&gt; &lt;span class="nv"&gt;APIFY_TOKEN&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;your_apify_token
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;One LinkedIn job by id, billed per request:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl --get &lt;span class="s1"&gt;'https://automatic--linkedin-jobs-scraper.apify.actor/'&lt;/span&gt; \
  --header &lt;span class="s2"&gt;"Authorization: Bearer $APIFY_TOKEN"&lt;/span&gt; \
  --data-urlencode &lt;span class="nv"&gt;jobId&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;4431992044
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;One Zillow home by its zpid, billed per request:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl --get &lt;span class="s1"&gt;'https://automatic--zillow-scraper.apify.actor/'&lt;/span&gt; \
  --header &lt;span class="s2"&gt;"Authorization: Bearer $APIFY_TOKEN"&lt;/span&gt; \
  --data-urlencode &lt;span class="nv"&gt;zpid&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;30793376
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The latest US Treasury curve, billed per row in your account:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl --get &lt;span class="s1"&gt;'https://automatic--treasury-yield-curve.apify.actor/'&lt;/span&gt; \
  --header &lt;span class="s2"&gt;"Authorization: Bearer $APIFY_TOKEN"&lt;/span&gt; \
  --data-urlencode &lt;span class="nv"&gt;latest&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="kc"&gt;true&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;To send the same fields in a JSON body instead, use &lt;code&gt;POST /&lt;/code&gt;. That's often easier in n8n or Make. Every response puts the result in &lt;code&gt;data&lt;/code&gt; and adds a &lt;code&gt;billing&lt;/code&gt; object that says how the request was charged.&lt;/p&gt;

&lt;h2&gt;
  
  
  Use it from an AI agent, n8n, Make or Zapier
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;AI agents:&lt;/strong&gt; Give the agent one HTTP tool per Actor. Point it at the Actor's URL, put the Actor's query fields in the tool's parameters, and add the &lt;code&gt;Authorization: Bearer&lt;/code&gt; header in your code so the model never sees the token. Load &lt;code&gt;/openapi.json&lt;/code&gt; if your framework builds tools from OpenAPI. Apify also names its MCP server, &lt;code&gt;mcp.apify.com&lt;/code&gt;, as a way to reach Server Actors.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;n8n:&lt;/strong&gt; Add an &lt;strong&gt;HTTP Request&lt;/strong&gt; node with method GET and the Actor URL. Set &lt;strong&gt;Authentication&lt;/strong&gt; to a header credential with &lt;code&gt;Authorization: Bearer &amp;lt;token&amp;gt;&lt;/code&gt;, and add the query fields as query parameters. The node's output is the JSON, so the next node can read &lt;code&gt;data&lt;/code&gt; directly.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Make:&lt;/strong&gt; Use the &lt;strong&gt;HTTP → Make a request&lt;/strong&gt; module with the same URL, header and query string, and turn on &lt;strong&gt;Parse response&lt;/strong&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Zapier:&lt;/strong&gt; Use a &lt;strong&gt;Webhooks by Zapier&lt;/strong&gt; GET step, or a &lt;strong&gt;Code by Zapier&lt;/strong&gt; step that calls &lt;code&gt;fetch&lt;/code&gt;, with the same header.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  When to start a normal run instead
&lt;/h2&gt;

&lt;p&gt;Use the classic Actor run when the job is a list, not a question. Examples are thousands of job ids, every listing in a city, a nightly schedule or a monitor that remembers what it saw last time. That run reads a long input, saves everything to a dataset you can export as CSV or Excel, and sends a webhook when it finishes. If you would otherwise loop over a long list of requests, one run is simpler to manage.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limits
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Each request returns one object or a short list. Use &lt;code&gt;limit&lt;/code&gt; where an Actor offers it, and use a normal run for bulk work.&lt;/li&gt;
&lt;li&gt;A server stops after 60 seconds without requests (120 seconds for per-row Actors). The next request starts it again, which adds start-up time to that first answer.&lt;/li&gt;
&lt;li&gt;Every request needs an Apify API token. Wrong or missing fields return HTTP 400 with an &lt;code&gt;error&lt;/code&gt; object. Errors are not charged.&lt;/li&gt;
&lt;li&gt;Results are the public data the source site shows at request time. If the source site fails or blocks a request, you get an error response.&lt;/li&gt;
&lt;li&gt;Prices are Apify list prices read on November 18–19, 2026 UTC. Google Search Results moves to $0.002 per results page on November 23, 2026. Mercado Libre Inmuebles and ZonaProp change to tiered listing prices on December 3, 2026. The Actor's Store page always has the current price.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Apify's own announcement is &lt;a href="https://blog.apify.com/introducing-server-actors/" rel="noopener noreferrer"&gt;Introducing Server Actors&lt;/a&gt;, and the full list from all developers is in the &lt;a href="https://apify.com/store/collections/server-actors" rel="noopener noreferrer"&gt;Server Actors collection&lt;/a&gt;.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Affiliate disclosure:&lt;/strong&gt; The Apify Store links carry our referral code. If you sign up for a paid plan through one, ssh.autos may earn a commission at no cost to you.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;&lt;em&gt;Originally published at &lt;a href="https://ssh.autos/guides/apify-server-actors.html" rel="noopener noreferrer"&gt;ssh.autos&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>api</category>
      <category>webscraping</category>
      <category>ai</category>
      <category>automation</category>
    </item>
    <item>
      <title>Google showed an AI Overview on all 40 email-marketing searches. YouTube was its top source</title>
      <dc:creator>Philip Kirkbride</dc:creator>
      <pubDate>Wed, 18 Nov 2026 20:18:07 +0000</pubDate>
      <link>https://dev.to/kirkins/google-showed-an-ai-overview-on-all-40-email-marketing-searches-youtube-was-its-top-source-12j</link>
      <guid>https://dev.to/kirkins/google-showed-an-ai-overview-on-all-40-email-marketing-searches-youtube-was-its-top-source-12j</guid>
      <description>&lt;p&gt;If you market an email tool, assume your buyers will see Google's AI Overview before your ranking. It appeared on &lt;strong&gt;all 40&lt;/strong&gt; US searches in this test, covering how-to questions, best-of lists and brand comparisons. The source it cited most often was &lt;strong&gt;YouTube&lt;/strong&gt;, in &lt;strong&gt;31 of the 40&lt;/strong&gt; Overviews. YouTube ranked among the regular results on only &lt;strong&gt;4&lt;/strong&gt; of the 40 pages. Of the domains cited in an Overview, only &lt;strong&gt;62 of 283&lt;/strong&gt; also appeared in the regular results on the same page.&lt;/p&gt;

&lt;h2&gt;
  
  
  What the Overviews cited
&lt;/h2&gt;

&lt;p&gt;I ran 40 email-marketing searches through &lt;a href="https://apify.com/automatic/google-search-results-scraper?fpr=automatic&amp;amp;fp_sid=devto-google-ai-overviews-email-marketing" rel="noopener noreferrer"&gt;automatic/google-search-results-scraper&lt;/a&gt; on November 18, 2026 UTC, in English with the country set to &lt;code&gt;us&lt;/code&gt;. Each search read one results page. The Actor reports the Overview's status and its cited links on that page. All 40 rows came back &lt;code&gt;present&lt;/code&gt;. The 40 Overviews held &lt;strong&gt;308&lt;/strong&gt; cited links from &lt;strong&gt;139&lt;/strong&gt; distinct domains. One Overview, for "best email service provider for developers", had no cited links.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Domain&lt;/th&gt;
&lt;th&gt;Overviews citing it&lt;/th&gt;
&lt;th&gt;Cited links&lt;/th&gt;
&lt;th&gt;Pages where it ranked in regular results&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;youtube.com&lt;/td&gt;
&lt;td&gt;31&lt;/td&gt;
&lt;td&gt;49&lt;/td&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;reddit.com&lt;/td&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;16&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;zapier.com&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;mailchimp.com&lt;/td&gt;
&lt;td&gt;11&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;campaignmonitor.com&lt;/td&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Domains are hostnames without &lt;code&gt;www.&lt;/code&gt;, so &lt;code&gt;help.klaviyo.com&lt;/code&gt; counts separately from &lt;code&gt;klaviyo.com&lt;/code&gt;. Regular results are the page's organic list, with roughly 7 to 10 links per page. Some Overviews cited several YouTube videos, giving 49 YouTube links across 31 Overviews. Reddit was closer to its regular ranking. It ranked among the regular results on 16 pages and was cited in 24 Overviews.&lt;/p&gt;

&lt;h2&gt;
  
  
  Does the type of search matter?
&lt;/h2&gt;

&lt;p&gt;I wrote 14 how-to questions, 13 best-of or tool searches and 13 searches that name a brand. The full list is in the snapshot.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Search type&lt;/th&gt;
&lt;th&gt;Searches&lt;/th&gt;
&lt;th&gt;With an Overview&lt;/th&gt;
&lt;th&gt;Citing YouTube&lt;/th&gt;
&lt;th&gt;Citing Reddit&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Question or how-to&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;12&lt;/td&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Best-of or tool search&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Brand, pricing or comparison&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;10&lt;/td&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Questions leaned most on video. Brand searches still sent readers toward the brands. In &lt;strong&gt;all 12&lt;/strong&gt; brand searches that named a vendor, the Overview cited at least one named vendor's own site. "Mailchimp pricing", "sendgrid vs mailgun" and "brevo review" were among them. I counted &lt;code&gt;twilio.com&lt;/code&gt; as SendGrid's site. I left out "substack alternatives" because it asks for rivals.&lt;/p&gt;

&lt;p&gt;For an email product, I'd put a short video and an honest Reddit answer on my content list next to the blog post. On these pages, they were the two most-cited sources. Keep your own pricing and comparison pages current, too, because Overviews for brand searches cited them.&lt;/p&gt;

&lt;h2&gt;
  
  
  Limits
&lt;/h2&gt;

&lt;p&gt;This is a single collection from one country, in English, without a signed-in Google account. AI Overviews change between runs and between users, so repeat the searches before relying on one count. I chose the 40 searches. They indicate patterns for this niche and do not measure all of Google. The regular results include a YouTube link only when Google ranks it among the organic links. A separate row of videos elsewhere on the page might not be counted. Nine organic links could not be resolved, and the script skips them. The first run reached its 300-second limit after 18 searches. I split the remaining 22 into two more runs with the same country and language. Every search has exactly one results page in the snapshot.&lt;/p&gt;

&lt;h2&gt;
  
  
  Reproduce the tables
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://ssh.autos/recipes/examples/google-ai-overviews-email-marketing-2026-11-18.json" rel="noopener noreferrer"&gt;Download the captured analysis fields&lt;/a&gt; as &lt;code&gt;overviews.json&lt;/code&gt;. The snapshot preserves the returned order. It keeps the cited and organic URLs and omits answer text. Save the code as &lt;code&gt;overviews.py&lt;/code&gt; and run &lt;code&gt;python3 overviews.py overviews.json&lt;/code&gt;.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="n"&gt;json&lt;/span&gt;
&lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="n"&gt;sys&lt;/span&gt;
&lt;span class="k"&gt;from&lt;/span&gt; &lt;span class="n"&gt;collections&lt;/span&gt; &lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="nc"&gt;Counter&lt;/span&gt;
&lt;span class="k"&gt;from&lt;/span&gt; &lt;span class="n"&gt;pathlib&lt;/span&gt; &lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="nc"&gt;Path&lt;/span&gt;
&lt;span class="k"&gt;from&lt;/span&gt; &lt;span class="n"&gt;urllib&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;parse&lt;/span&gt; &lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="n"&gt;urlparse&lt;/span&gt;

&lt;span class="n"&gt;runs&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;json&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;loads&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nc"&gt;Path&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;sys&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;argv&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;read_text&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"runs"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="n"&gt;pages&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;run&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;runs&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;run&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"items"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="n"&gt;order&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;runs&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"input"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"queries"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;  &lt;span class="c1"&gt;# all 40; runs 2 and 3 finish the rest&lt;/span&gt;
&lt;span class="n"&gt;groups&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"Question or how-to"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;order&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="mi"&gt;14&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"Best-of or tool search"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;order&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;14&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="mi"&gt;27&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
          &lt;span class="s2"&gt;"Brand, pricing or comparison"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;order&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;27&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;

&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nf"&gt;urlparse&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;hostname&lt;/span&gt; &lt;span class="ow"&gt;or&lt;/span&gt; &lt;span class="s2"&gt;""&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;removeprefix&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"www."&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;url&lt;/span&gt; &lt;span class="k"&gt;else&lt;/span&gt; &lt;span class="kc"&gt;None&lt;/span&gt;

&lt;span class="n"&gt;by_term&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"term"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;pages&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="k"&gt;assert&lt;/span&gt; &lt;span class="nb"&gt;sorted&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;by_term&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;==&lt;/span&gt; &lt;span class="nb"&gt;sorted&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;order&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;present&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;p&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;pages&lt;/span&gt; &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewStatus"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="o"&gt;==&lt;/span&gt; &lt;span class="s2"&gt;"present"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"Searches"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;pages&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"with an AI Overview"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;present&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;cited_in&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;Counter&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;links&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;Counter&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;present&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;domains&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="nf"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;url&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewSources"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
    &lt;span class="n"&gt;links&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;update&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;domains&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="n"&gt;cited_in&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;update&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="kt"&gt;set&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;domains&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"Cited links"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;links&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;values&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"distinct domains"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;links&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"Overviews with no cited links"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="ow"&gt;not&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewSources"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;present&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;in_organic&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;site&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="n"&gt;site&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nf"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;url&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"organicUrls"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;

&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;site&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;overviews&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;cited_in&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;most_common&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;organic&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nb"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nf"&gt;in_organic&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;site&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;pages&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"{site}: cited in {overviews} overviews ({links[site]} links), "&lt;/span&gt;
          &lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"organic results on {organic} pages"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;name&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;terms&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;groups&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;items&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;group&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;by_term&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;t&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;t&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;terms&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;name&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;group&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
          &lt;span class="s2"&gt;"overviews"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewStatus"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="o"&gt;==&lt;/span&gt; &lt;span class="s2"&gt;"present"&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;group&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
          &lt;span class="s2"&gt;"youtube"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"youtube.com"&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="nb"&gt;map&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewSources"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;group&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
          &lt;span class="s2"&gt;"reddit"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;sum&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"reddit.com"&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="nb"&gt;map&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewSources"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;p&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;group&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;pairs&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;shared&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;present&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;cited&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nf"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;url&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewSources"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;
    &lt;span class="n"&gt;organic&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nf"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;url&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"organicUrls"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;url&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;
    &lt;span class="n"&gt;pairs&lt;/span&gt; &lt;span class="o"&gt;+=&lt;/span&gt; &lt;span class="nb"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;cited&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="n"&gt;shared&lt;/span&gt; &lt;span class="o"&gt;+=&lt;/span&gt; &lt;span class="nb"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;cited&lt;/span&gt; &lt;span class="o"&gt;&amp;amp;&lt;/span&gt; &lt;span class="n"&gt;organic&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"Cited domains also in the same page's organic results: {shared} of {pairs}"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;vendors&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"mailchimp"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"mailchimp.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"klaviyo"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"klaviyo.com"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"help.klaviyo.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
           &lt;span class="s2"&gt;"beehiiv"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"beehiiv.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"substack"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"substack.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"kit"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"kit.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
           &lt;span class="s2"&gt;"sendgrid"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"sendgrid.com"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"twilio.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"mailgun"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"mailgun.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
           &lt;span class="s2"&gt;"brevo"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"brevo.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"mailerlite"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"mailerlite.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
           &lt;span class="s2"&gt;"activecampaign"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"activecampaign.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"hubspot"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"hubspot.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
           &lt;span class="s2"&gt;"postmark"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"postmarkapp.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"constant contact"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="s2"&gt;"constantcontact.com"&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="n"&gt;named&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;own_site&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;term&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;groups&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"Brand, pricing or comparison"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;term&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;endswith&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"alternatives"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
        &lt;span class="k"&gt;continue&lt;/span&gt;  &lt;span class="c1"&gt;# names one brand but asks for its rivals&lt;/span&gt;
    &lt;span class="n"&gt;sites&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="kt"&gt;set&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;union&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="o"&gt;*&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;v&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;k&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;v&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;vendors&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;items&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;" {k} "&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;" {term} "&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="n"&gt;named&lt;/span&gt; &lt;span class="o"&gt;+=&lt;/span&gt; &lt;span class="mi"&gt;1&lt;/span&gt;
    &lt;span class="n"&gt;own_site&lt;/span&gt; &lt;span class="o"&gt;+=&lt;/span&gt; &lt;span class="kt"&gt;bool&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;sites&lt;/span&gt; &lt;span class="o"&gt;&amp;amp;&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nf"&gt;domain&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;u&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;u&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;by_term&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;term&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"aiOverviewSources"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"Brand searches citing a named vendor's own site: {own_site} of {named}"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;To run a fresh check in your own niche, put your searches in &lt;code&gt;queries&lt;/code&gt; and use the saved first &lt;code&gt;input&lt;/code&gt; object as the body for &lt;code&gt;POST https://api.apify.com/v2/acts/automatic~google-search-results-scraper/runs?maxTotalChargeUsd=0.15&amp;amp;timeout=600&lt;/code&gt; with an Apify bearer token. When the run finishes, read &lt;code&gt;defaultDatasetId&lt;/code&gt; from the run record, then fetch &lt;code&gt;GET https://api.apify.com/v2/datasets/{datasetId}/items?format=json&lt;/code&gt;. Each row's &lt;code&gt;aiOverview&lt;/code&gt; has &lt;code&gt;status&lt;/code&gt;, &lt;code&gt;text&lt;/code&gt; and &lt;code&gt;sources&lt;/code&gt;. Use the 600-second timeout above for 40 searches, or split them across runs as I did.&lt;/p&gt;

&lt;p&gt;On November 18, 2026 UTC, the run records listed customer prices of $0.0015 per results page and $0.005 per GB of memory per run start. At the default 2 GB, that's $0.01 per start. The Actor's README says the page price becomes $0.002 on November 23, 2026. At the November 18 prices, these three runs would have cost a customer about $0.09 for 40 pages. On the publisher account, they used $0.067 of platform usage.&lt;/p&gt;

&lt;h2&gt;
  
  
  Apify run IDs
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Searches&lt;/th&gt;
&lt;th&gt;Run ID&lt;/th&gt;
&lt;th&gt;Dataset ID&lt;/th&gt;
&lt;th&gt;Result&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;1–18&lt;/td&gt;
&lt;td&gt;&lt;code&gt;WxcfF9xAOIuMtUN8c&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;uiugKAd9X4qNPoSy3&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;18 pages, stopped at the time limit&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;19–29&lt;/td&gt;
&lt;td&gt;&lt;code&gt;aTFyGo3gFj0xJvd5s&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;W9QPJVBfhOlMcJcbz&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;11 pages&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;30–40&lt;/td&gt;
&lt;td&gt;&lt;code&gt;5wsKVXR4phhWe6THj&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;SDdG5aZ6jvzBTgyJb&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;11 pages&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Affiliate disclosure:&lt;/strong&gt; The Apify Store link carries our referral code. If you sign up for a paid plan through it, ssh.autos may earn a commission at no cost to you.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;&lt;em&gt;Originally published at &lt;a href="https://ssh.autos/recipes/google-ai-overviews-email-marketing.html" rel="noopener noreferrer"&gt;ssh.autos&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>seo</category>
      <category>ai</category>
      <category>webscraping</category>
      <category>python</category>
    </item>
    <item>
      <title>Connect Claude Desktop, Claude Code, Cursor, or Meta Muse to Apify's web scraping tools</title>
      <dc:creator>Philip Kirkbride</dc:creator>
      <pubDate>Wed, 18 Nov 2026 03:18:46 +0000</pubDate>
      <link>https://dev.to/kirkins/connect-claude-desktop-claude-code-cursor-or-meta-muse-to-apifys-web-scraping-tools-51km</link>
      <guid>https://dev.to/kirkins/connect-claude-desktop-claude-code-cursor-or-meta-muse-to-apifys-web-scraping-tools-51km</guid>
      <description>&lt;p&gt;You're in Claude Desktop, Claude Code, or Cursor and you want to pull 20 local&lt;br&gt;
businesses from Google Maps, check Trustpilot reviews for a competitor, or find&lt;br&gt;
breakout YouTube videos — without leaving your assistant or writing scraping code.&lt;/p&gt;

&lt;p&gt;Apify publishes a Model Context Protocol (MCP) server at &lt;code&gt;https://mcp.apify.com&lt;/code&gt;.&lt;br&gt;
Connect it once and your assistant can search the Apify Store and run its&lt;br&gt;
web-scraping Actors directly from a prompt.&lt;/p&gt;


&lt;h2&gt;
  
  
  Step 1: Create a free Apify account
&lt;/h2&gt;

&lt;p&gt;Go to &lt;a href="https://apify.com/automatic?fpr=automatic&amp;amp;fp_sid=devto-connect-ai-to-apify-mcp" rel="noopener noreferrer"&gt;apify.com&lt;/a&gt; and sign up with&lt;br&gt;
Google, GitHub, or email. No credit card needed for the free plan.&lt;/p&gt;


&lt;h2&gt;
  
  
  Step 2: Copy your Apify API token
&lt;/h2&gt;

&lt;p&gt;In Apify Console, open &lt;strong&gt;Settings → API &amp;amp; Integrations&lt;/strong&gt;&lt;br&gt;
(&lt;code&gt;console.apify.com/settings/integrations&lt;/code&gt;) and copy the &lt;strong&gt;Personal API token&lt;/strong&gt;.&lt;br&gt;
Treat it like a password.&lt;/p&gt;


&lt;h2&gt;
  
  
  Step 3: Add the MCP server to your assistant
&lt;/h2&gt;
&lt;h3&gt;
  
  
  Claude Desktop
&lt;/h3&gt;

&lt;p&gt;Edit &lt;code&gt;~/Library/Application Support/Claude/claude_desktop_config.json&lt;/code&gt; (macOS) or&lt;br&gt;
&lt;code&gt;%APPDATA%\Claude\claude_desktop_config.json&lt;/code&gt; (Windows):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="nl"&gt;"mcpServers"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="nl"&gt;"apify"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
      &lt;span class="nl"&gt;"command"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"npx"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
      &lt;span class="nl"&gt;"args"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"-y"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"@apify/actors-mcp-server"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
      &lt;span class="nl"&gt;"env"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
        &lt;span class="nl"&gt;"APIFY_TOKEN"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"your-token-here"&lt;/span&gt;
      &lt;span class="p"&gt;}&lt;/span&gt;
    &lt;span class="p"&gt;}&lt;/span&gt;
  &lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Restart Claude Desktop.&lt;/p&gt;

&lt;h3&gt;
  
  
  Claude Code
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;claude mcp add apify -e &lt;span class="nv"&gt;APIFY_TOKEN&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;your-token-here -- npx -y @apify/actors-mcp-server
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  Cursor
&lt;/h3&gt;

&lt;p&gt;Open &lt;strong&gt;Settings → Features → MCP Servers&lt;/strong&gt; and add:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="nl"&gt;"apify"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="nl"&gt;"command"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"npx"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="nl"&gt;"args"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"-y"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"@apify/actors-mcp-server"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="nl"&gt;"env"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
      &lt;span class="nl"&gt;"APIFY_TOKEN"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"your-token-here"&lt;/span&gt;
    &lt;span class="p"&gt;}&lt;/span&gt;
  &lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  Meta Muse
&lt;/h3&gt;

&lt;p&gt;Open a new Muse chat and paste:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Create a custom connector for Apify's MCP server at https://mcp.apify.com.
It authenticates with my Apify API token, sent as a bearer token in the
Authorization header. Ask me for the token in a secure prompt.
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;When Muse asks for the token, paste it into the secure prompt — not the chat.&lt;/p&gt;




&lt;h2&gt;
  
  
  Step 4: Verify the connection
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Using the Apify connector, fetch the details of the Actor
automatic/google-maps-places-scraper and show its title and pricing.
Don't run it.
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;It's working if you see the Actor's title and its price per result.&lt;/p&gt;




&lt;h2&gt;
  
  
  Step 5: Run your first Actor
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Local businesses from Google Maps (~$0.03)&lt;/strong&gt;&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Use the Apify connector to run the Actor
automatic/google-maps-places-scraper with searchQueries ["coffee shop"],
location "London, ON", countryCode "ca" and maxPlaces 20.
If the run hasn't finished when the call returns, check its status until
it has, then fetch the dataset items. Give me a table of name, rating,
reviews, phone and website, best rated first.
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Competitor Facebook/Instagram ads (~$0.04 for 25 ads)&lt;/strong&gt;&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Use the Apify connector to run the Actor
automatic/facebook-ads-library-scraper with searchTerms ["meal kit"],
country "US", activeStatus "active" and maxItems 25.
If the run hasn't finished when the call returns, check its status until
it has, then fetch the dataset items. Tell me which advertisers have
the most ads and what offers they're making.
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Trustpilot complaints for any company (~$0.03)&lt;/strong&gt;&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Use the Apify connector to run the Actor
automatic/trustpilot-reviews-scraper with companies ["chewy.com"],
maxReviewsPerCompany 50 and stars ["1", "2"].
If the run hasn't finished when the call returns, check its status until
it has, then fetch the dataset items. List the five most common complaints
with a count and one quote each.
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;






&lt;h2&gt;
  
  
  Troubleshooting
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Symptom&lt;/th&gt;
&lt;th&gt;Fix&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;"No Apify connector"&lt;/td&gt;
&lt;td&gt;Re-run setup step and restart the assistant&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Run starts but no results&lt;/td&gt;
&lt;td&gt;Add "check its status until finished, then fetch the dataset items"&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Token rejected&lt;/td&gt;
&lt;td&gt;No spaces before or after the token&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Run charged but empty&lt;/td&gt;
&lt;td&gt;The search term returned no results; the Actor reports this&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;




&lt;h2&gt;
  
  
  Good to know
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Each Actor run is billed on completion. Approve when your assistant asks.&lt;/li&gt;
&lt;li&gt;The free plan's $5/month covers ~150–200 small runs. See &lt;a href="https://apify.com/pricing?fpr=automatic&amp;amp;fp_sid=devto-connect-ai-to-apify-mcp" rel="noopener noreferrer"&gt;Apify pricing&lt;/a&gt; for paid plans.&lt;/li&gt;
&lt;li&gt;Pricing is per row of output on most Actors. Check the Actor's page for today's rate.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The original setup guide (with Muse-specific screenshots) is at&lt;br&gt;
&lt;a href="https://ssh.autos/guides/muse-apify.html" rel="noopener noreferrer"&gt;https://ssh.autos/guides/muse-apify.html&lt;/a&gt;.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Affiliate disclosure:&lt;/strong&gt; links to apify.com in this post carry &lt;code&gt;?fpr=automatic&lt;/code&gt;. If you sign up for a paid Apify plan, ssh.autos may earn a commission at no cost to you.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;&lt;em&gt;Originally published at &lt;a href="https://ssh.autos/guides/muse-apify.html" rel="noopener noreferrer"&gt;https://ssh.autos&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>api</category>
      <category>automation</category>
      <category>python</category>
      <category>webscraping</category>
    </item>
  </channel>
</rss>
