DEV Community: CleanScrape

Comparing store prices on Google Shopping: the same Sony headphones were $199.99 and $349.99

CleanScrape — Fri, 06 Nov 2026 06:58:47 +0000

Google Shopping shows one store per product and a note that more stores sell it. Checking each one by hand gets old quickly, so I built a Google Shopping scraper and price tracker on Apify. You type a product name, model number or barcode, pick a country, and get every listing back as a row you can export. Turn on "Compare stores" and each product also gets a table of the stores Google lists for it. Put it on a schedule and each run keeps only price changes.

The input

This is the run from the video:

{
  "queries": ["sony wh-1000xm5"],
  "country": "us",
  "compareStores": true,
  "storesForTopProducts": 3
}

A search can be words, a model number, a UPC/EAN barcode, or a Google Shopping link. A results link keeps the filters you set on Google (price range, brand, store); a product link reads that product's stores directly. There are 32 countries, each in its own currency.

The output

The search returned 40 products in under a minute, together with the store pages for 3 of them. One product row:

{
  "title": "Sony WH-1000XM5 Wireless Noise Canceling Headphones",
  "price": 224.99,
  "currency": "USD",
  "originalPrice": 398,
  "discountPercent": 43,
  "store": "Best Buy",
  "moreStores": true,
  "delivery": "Free delivery",
  "rating": 4.6,
  "reviewCount": 13000
}

The Stores table for that product listed five stores: Sony at $199.99 (marked "Best price"), Best Buy at $224.99, Greentoe at $249, a Walmart seller at $249.99 and TikTok Shop at $349.99. That's $150 apart for the same headphones. Each store row has stock, delivery, returns and the link to the product on the store's own site, and the product carries Google's typical price range: $199 to $300.

What testing found

Google sometimes answers from the wrong country. Requests go through Apify's Google search proxy, and about one page in seven came back localised to wherever the exit IP was: a US search priced in Brazilian reais, Saudi riyals or Colombian pesos. The gl parameter didn't stop it, and neither did Google's uule location parameter (5 of 24 US searches were still wrong). What works is checking the answer: a page from another country prices nearly everything in its own currency. Those pages are asked again and never charged, and a search that keeps coming back from abroad fails for free. In a 100-search test, 17 such answers were caught and retried.

Two card layouts. US and Canadian results use one card layout, UK and European ones another ("Current price ... And more prices"). Class names change often, so the parser reads each card's text and accessibility labels in order instead. A "3D" badge on cards with a 3D viewer looked like an amount and pushed the title into the store column until a fixture caught it.

Prices come in every format. $1,299.99, £199.00, 2 547,00 kr, CHF 199.00, R$417.08, ¥20,800, US$249. A bare $ means US, Canadian or Australian dollars depending on the country searched.

Some product pages have no details. Google answers some of them with "Details aren't available for this product". Those pages are free, and the run tries the next product instead, so you still get the number of store lists you asked for. Products Google sells at several stores go first; a single marketplace listing has only one store to show.

Tracking needed three fixes. The first version flagged cent-level changes on sellers abroad (exchange rates move), treated every eBay seller as one store, and called listings "new" when Google simply rotated them back in. It now follows Google's listing IDs, ignores moves under 0.5% and exchange-rate-only changes, and remembers listings for 30 days.

Tracking prices

Turn on "Only new products and price changes", give it a tracking name and schedule it. Google rotates marketplace listings (eBay, Poshmark and similar) between runs, so the first few runs still find listings they haven't seen; "Skip new listings" keeps a schedule to real price moves. In my test, the first run saved 49 listings for three products, and a later run with "Skip new listings" found no price changes and saved nothing.

Pricing

$1.50 per 1,000 products, $6 per 1,000 searches and $7 per 1,000 product pages for store comparison, less on paid Apify plans. One search with 40 products costs about seven cents. Searches that fail, wrong-country answers and product pages without details are free.

Try it

https://apify.com/cleanscrape/google-shopping-scraper

Questions or ideas: contact.cleanscrape@gmail.com, or the Issues tab on the Actor page.

Niko, CleanScrape developer

Tracking Google Flights fares: New York to London was $197 on December 8 and $512 on December 20

CleanScrape — Thu, 05 Nov 2026 18:51:45 +0000

Flight prices change every day, and checking them by hand gets old quickly. So I built a Google Flights scraper and fare tracker on Apify. You type routes the way you'd say them, pick dates, and get every flight back as a row in a table you can export. Put it on a schedule and each run gives you only new flights or lower prices.

The input

This is the run from the video:

{
  "routes": ["New York to London"],
  "departureDates": ["+30"],
  "maxFlightsPerSearch": 20
}

A route can be airport codes (JFK-LAX), a city code that covers all of a city's airports (NYC-LON), or plain city names. Dates can be one day, a range like 2026-12-01..2026-12-31, or +30, which means 30 days after the run date. That last one is what makes scheduled runs useful: a daily schedule always looks the same distance ahead.

There's also round trips (with the real return flights for the cheapest outbound options), passengers, cabin, nonstop or one-stop limits, airlines or alliances, 22 currencies and the country you're buying from.

The output

New York to London for December 5 came back with 20 flights in 3 seconds, from all three New York airports to three London airports. One row looks like this:

{
  "route": "NYC-LON",
  "from": "JFK",
  "to": "LHR",
  "departure": "2026-12-05T18:00:00-05:00",
  "arrival": "2026-12-06T06:20:00+00:00",
  "duration": "7 h 20 min",
  "stops": 0,
  "airlines": "Virgin Atlantic",
  "flightNumbers": "VS4",
  "aircraft": "Airbus A330-900neo",
  "price": 300,
  "currency": "USD",
  "co2Kg": 369
}

Each search also gets a row in a second table with the cheapest fare ($270 here), the cheapest nonstop ($300), Google's typical price for the trip ($279) and its verdict: low, typical or high. It includes Google's own price history for about the last 60 days. For this trip it was $197 two months ago and dipped to $109 one day.

The cheapest day in a month

One search per departure day from December 5 to January 4, keeping only the cheapest flight each day, turns the Searches table into a price calendar. December 8 to 10 cost $197. December 20 cost $512, and Google marked it high. That's 31 searches, which ran in 14 seconds.

What testing found

Time zones matter more than they look. An evening flight from New York lands in London the next morning. Each time keeps its UTC offset, so arrival above is Dec 6 even though the search was for Dec 5. I checked this on every row of a 300-search run: no arrival before its departure, and every duration matches the two timestamps.

Google's price level isn't three values. I first mapped it to low, typical and high, and an audit showed "high" days sitting inside Google's typical range. The real scale has five steps: one below the typical range, three inside it and one above. Comparing every search with its range made that obvious.

Not every city code works. City codes like NYC, LON, PAR and TYO cover several airports, but Google rejects Dallas's code and treats a few others as a single airport. I tested every code in the table and mapped those cities to their main airport. An example task that searched "Dallas to Cancun" caught it before release.

Memory. Google's result pages are 3.5 MB each, and the first version ran out of memory at 256 MB with six searches in parallel. It now decodes only the part of the page that holds the flights, about 70 KB, and peaks around 150 MB.

Pages sometimes arrive incomplete. About one page in twelve came back without flight data and worked on the next try, so every search retries a few times before it counts as failed. In a 300-search test, all 300 got an answer.

Tracking fares

Turn on "Only new flights or lower prices", give it a tracking name and schedule it. The first run saves everything it finds. Later runs save a flight only if it's new for that route and date, or its price dropped, with the previous price next to it. In my two test runs 12 minutes apart nothing had changed, so the second run saved nothing, and its Searches rows showed the cheapest fare at the same $270 and $384 as before.

Pricing

$1 per 1,000 flights saved and $0.50 per 1,000 searches, less on paid Apify plans. One route on one date with 20 flights costs about two cents. The search fee is there so scheduled checks that find nothing new still cover their cost; failed searches are free.

Try it

https://apify.com/cleanscrape/google-flights-scraper

Questions or ideas: contact.cleanscrape@gmail.com, or the Issues tab on the Actor page.

Niko, CleanScrape developer

Turning podcasts into text: a 52-minute NASA episode, 8,022 words, and the bugs real audio found

CleanScrape — Sat, 31 Oct 2026 17:41:45 +0000

A podcast holds a lot of useful information, and almost none of it can be searched, quoted or passed to another tool. So I built a podcast transcription tool on Apify. You paste a feed, an Apple Podcasts link or a link to an audio file, and you get the text back with timestamps and subtitle files.

The input

One link is enough. This is the run from the video, an episode of NASA's Houston We Have a Podcast:

{
  "sources": ["https://podcasts.apple.com/us/podcast/the-moon-base/id1262594123?i=1000789048885"],
  "quality": "accurate"
}

It also accepts an RSS feed, a podcast's website, or a direct link to an MP3, M4A, WAV or MP4 file. At launch, Standard used the Whisper base model and Accurate used Whisper small, both inside the Actor. Standard now runs Whisper large-v3-turbo on Cloudflare Workers AI (see the update below). Either way there's no OpenAI key to bring.

The output

The 52:18 episode became 8,022 words in 23 minutes on Accurate. Each row has the show, the title, the date, the length, the detected language, the full text and timestamped segments:

{
  "title": "The Moon Base",
  "duration": "00:52:18",
  "language": "en",
  "wordCount": 8022,
  "segments": [
    { "start": 80.5, "text": "a home for astronauts on another celestial body." }
  ]
}

You also get TXT, SRT and VTT files, so the transcript can go straight onto a video or into a search index.

What real audio taught me

The first version passed its tests on short clean clips. Real podcasts found the interesting bugs.

Memory grows with the audio. Whisper's memory use went up by about 55 MB per minute of audio. A 5-minute test looked fine, and a 5-hour file crashed a 4 GB run. The fix was to feed it 5-minute chunks, each cut at the quietest tenth of a second near the boundary so no word gets split. A 5-hour file now peaks at 1.75 GB.

The first 30 seconds can lie. Whisper detects the language from the start of the file. Podcasts often start with an ad, and one Finnish episode opened with an English ad, so the whole episode was transcribed as English. It now takes short samples across the file and lets them vote, weighted by confidence.

The same show, pasted twice, cost double. A feed link and an Apple link for one show are different links to the same audio. Episodes already in the run are now skipped, whichever link they came from.

Real speech costs more than a test sample. My first benchmark used a clean narration. Real conversation ran about 25% slower, and Finnish was the slowest of the languages I tried. That changed the price of the Accurate tier before launch.

Following a show

Give a run a watch name and put it on a schedule. The first run takes the newest episode, and each later run transcribes only what has appeared since. A check with nothing new costs $0.003.

What it can't do

It doesn't label speakers. On Apify only it works on one language per file; Standard detects the language for every 90 seconds or so. Some podcast hosts refuse automated downloads: in a test of 134 shows, the newest episode of 127 could be reached. The rest are reported in the run and their audio isn't charged. YouTube, TikTok and Spotify links aren't supported.

Update, November 2026: a faster Standard

Standard now sends the audio in 90-second pieces to Whisper large-v3-turbo on Cloudflare Workers AI. On this same episode it made 4.2% word errors against NASA's own transcript, against 5.2% for the run above, and took about a minute instead of 23. One setting mattered: with condition_on_previous_text left on, the model invented about 300 words in repeating loops.

When Cloudflare's daily capacity is used up or it doesn't answer, Whisper base on Apify finishes the file at the same price, and the model field says which ran. Accurate is now called Apify only, for audio that has to stay on Apify.

Try it

https://apify.com/cleanscrape/podcast-transcription

$6 per 1,000 audio minutes on Standard and $15 on Apify only, less on paid Apify plans. The episode above cost $0.80. You can export to Excel, CSV or JSON, or call it from your own code or an AI agent through Apify's MCP server.

Niko, CleanScrape developer

An economic calendar built only from official sources: the Fed, ECB, BLS, ONS and more in one table

CleanScrape — Tue, 27 Oct 2026 16:07:47 +0000

Every number on an economic calendar has a release time set by an official agency: the Bureau of Labor Statistics for CPI and jobs, the BEA for GDP, the Fed and the ECB for rate decisions. Those agencies all publish their schedules openly, but each in its own format: an iCalendar file, a JSON feed, an HTML table, a paged API. So I built a small tool on Apify that reads 13 of those official calendars and returns one clean table.

The input

Pick economies and dates. Everything else is optional.

{
  "countries": ["US", "EA", "UK", "CA", "AU"],
  "dateRange": "next7",
  "minimumImpact": "medium"
}

That run took 26 seconds and saved 20 releases for 27 October to 2 November 2026. Wednesday had Australia's CPI at 00:30 UTC, the Bank of Canada at 13:45 and the Fed's decision at 18:00. Thursday had US GDP at 12:30 and the ECB at 13:15. The UK had no medium or high impact releases that week.

Times you can trust, and when you can't

Every row has the time in UTC and in the agency's local time, plus a status:

confirmed: the agency published the exact time (14 of the 20)
standard: a central bank's usual time, like the ECB's 14:15 Frankfurt time
provisional: a weekly schedule that can shift around holidays (US jobless claims)
date only: the agency publishes the day but not the time

Past releases come with values

For past CPI releases the tool adds the value. US CPI and euro area HICP carry the first published annual rate; the UK, Canada and Australia carry the current official series value. One run over the past year returned 76 inflation releases from all five economies. In the euro area, inflation went from 1.7% in January 2026 to 3.8% in September.

There are no consensus forecasts: those are compiled privately and are not free to reuse.

Following changes

Give the run a watch name and schedule it daily. After the first run, each run returns only what changed: new, moved, cancelled or released events.

Try it

https://apify.com/cleanscrape/economic-calendar-api

$3 per 1,000 events plus half a cent per country checked, less on paid Apify plans. The week above cost $0.08. Export to Excel, CSV or Google Sheets, or call it from your own code or an AI agent through Apify's MCP server.

Niko, CleanScrape developer

Every cut in a 15-minute film: extracting 166 scene frames from a video link

CleanScrape — Sun, 25 Oct 2026 14:21:19 +0000

If you want to send a video to an AI vision model, build a thumbnail picker, or index a lecture by its slides, you rarely want every frame. You want one frame per shot. So I built a small tool on Apify that takes a video link and returns those frames as images, with their exact times.

Here is what it does on Sintel, the 14:48 open movie from the Blender Foundation.

The input

{
  "videos": ["https://archive.org/download/Sintel/sintel-2048-stereo.mp4"],
  "mode": "scenes",
  "contactSheet": true
}

It found 166 shots and saved one frame for each. The scan took 3 minutes 22 seconds.

How it finds the cuts

In this precise mode it compares every frame with the one before. When the picture changes completely, that is a cut, and a frame is saved there. When the camera only pans or zooms, the picture changes a little at a time; that is not counted as a cut. (An earlier version did count fast camera moves, which is how I learned to require a sharp peak rather than a large change.)

When you don't need every cut

Overview mode reads only the keyframes, the full pictures a video file stores every few seconds. On the same film it returned 24 frames in 21 seconds.

Slides and screen recordings

On a 60-second lecture recording with a moving mouse pointer, precise mode with high sensitivity found all 6 slides (at 0:00, 0:10, 0:20, 0:30, 0:40 and 0:50) and ignored the pointer.

What you get

Every frame comes with its time, timecode, size and an image link (JPG, PNG or WebP), and every video gets a contact sheet: all its frames on one page. Other modes: a frame every N seconds, a set number of evenly spaced frames, or exact timestamps.

It reads MP4, MOV, WebM, MKV, AVI, MPEG-TS, OGV and animated GIF from direct links, S3 and other storage links, Dropbox and Google Drive.

Try it

https://apify.com/cleanscrape/video-frame-extractor

$2 per 1,000 frames, $0.005 per video, and in precise mode $0.01 per minute of 1080p video at 30 fps (smaller videos count less): the 166-frame Sintel run costs about $0.45, the overview run about $0.05. Use it on videos you own or may use.

Sintel © Blender Foundation, durian.blender.org, CC BY 3.0.

Niko, CleanScrape developer

Which AI companies are hiring engineers, and what they pay: 691 jobs from career pages in 9 seconds

CleanScrape — Sun, 25 Oct 2026 14:20:08 +0000

Job boards repost, duplicate and keep expired listings. The cleanest source for who is hiring is the company's own careers page, and most companies run it on one of a handful of job board systems: Greenhouse, Lever, Ashby, Workable, Recruitee, Personio or Teamtailor. So I built a small tool on Apify that reads those boards directly.

Here is one real run: engineering jobs at seven AI companies.

The input

You can paste a careers link, the company's website, or just its name. The tool finds the right board and says how it found it, so nothing is guessed.

{
  "companies": [
    "https://jobs.ashbyhq.com/openai",
    "https://job-boards.greenhouse.io/anthropic",
    "perplexity.ai",
    "ElevenLabs",
    "https://jobs.ashbyhq.com/cohere",
    "https://jobs.lever.co/mistral",
    "huggingface.co"
  ],
  "titleKeywords": ["engineer"]
}

The run took 9 seconds and saved 691 open jobs.

Who is hiring

OpenAI: 356 engineering jobs
Anthropic: 209
Perplexity 46, ElevenLabs 41, Cohere 34, Hugging Face 5
Mistral's board had no open jobs that day

What they pay

497 of the 691 jobs publish a yearly salary range in US dollars. Take the middle of each range, and half of them are above $355,500 a year.

Where

483 of the jobs (about 7 in 10) are in the United States. The rest are spread across 20 other countries.

Following hiring over time

Give the run a watch name and schedule it. The first run saves every job as a starting point; after that, each run saves only the jobs that are new, and lists the ones that closed in a separate table.

I tried it on 25 tech companies with 7,492 open jobs between them. Checked again five hours later (on a Saturday), the next run found 1 new job (a senior engineer at Cloudflare) and 1 that closed (a compliance role at Stripe). Small, but that is the point: a daily check returns only what changed.

Try it

https://apify.com/cleanscrape/career-site-jobs-scraper

$1 per 1,000 jobs plus $2 per 1,000 companies, less on paid Apify plans: the run above costs about $0.70. Export to Excel, CSV or Google Sheets, or call it from your own code or an AI agent through Apify's MCP server.

Niko, CleanScrape developer

Checking casino affiliate pages for 18+ notices and terms, page by page

CleanScrape — Mon, 19 Oct 2026 10:23:50 +0000

Casino brands work with hundreds of affiliate and review sites, and each of those pages tells players something about the brand's bonus. Whether a page shows an age notice, links to safer-gambling help and puts the terms next to the offer is something compliance teams check by hand, page by page. I built a small tool on Apify that does the reading: it searches Google from the country you choose, reads every page through a connection in that country, and returns one row per page.

No casino is named or shown in this video: brands, sites, offers, promo codes and links are blurred. It is about checking pages, not about any offer.

What one run found

The numbers are from one real run on Oct 18 2026 (United Kingdom, one brand): 10 pages on 8 sites, checked in under a minute and a half. Across those pages the brand's offer appeared in 9 different versions. All 5 affiliate pages showed an age notice and linked to safer-gambling help; 4 pages showed the offer with no terms next to it. Pages built with JavaScript are marked, so a notice they show later is not counted as missing. The rows report what each page shows and what is missing from it; they are not a legal verdict, since the rules differ by country and by who a page targets.

How it reads a page

The offer: from the title, the main heading, offer cards and comparison tables. In a table that lists several casinos, an offer counts only when it sits in your brand's row.
Notices: age notices (18+, 19+, 21+), safer-gambling links and helplines (BeGambleAware, GamCare, GAMSTOP, 1-800-GAMBLER, ConnexOntario and others), an ad or affiliate disclosure, and wording such as "risk-free".
Terms next to the offer: T&Cs, wagering, expiry or minimum deposit in the offer's box, or within about 500 characters of the offer's numbers in the page text.
Country: each page is read from the country being checked; in our tests one page in eight showed a different offer to visitors from another country.
Pages it cannot read (bot checks, files, JavaScript-only pages) are listed in the run report with the reason, and never charged.

The price is $8 per 1,000 saved pages; pages without an offer and pages that could not be read are free.

Try it: https://apify.com/cleanscrape/casino-bonus-checker

Maintained by CleanScrape. Questions or a reproducible issue: contact.cleanscrape@gmail.com

CleanScrape is independent of Apify and of every casino, affiliate site and network.

Which Kick streamers your competitors sponsor: 26 energy-drink sponsorships from 10,000 live streams

CleanScrape — Mon, 12 Oct 2026 17:15:31 +0000

Kick streamers advertise their sponsors in plain sight: a chat command in the stream title, a brand link in the channel's link panel, sometimes a promo code. Nobody collects that across channels, so I built a small tool on Apify that does: it scans the live streams on Kick, reads each channel's titles, links and the last month of broadcasts, and returns one row per streamer and brand.

Here is one real use: an energy-drink brand for gamers checking which streamers its competitors sponsor.

The input

{
  "brands": ["HOLY", "G FUEL", "Red Bull", "DZIK"],
  "maxLiveStreams": 10000,
  "minViewers": 1
}

The run looked through 10,000 live streams, picked the 26 streamers whose live title named one of the brands, and checked each channel in depth. It took about four minutes.

One row per streamer and brand

Each sponsorship row says where the brand shows up (live title, past broadcast titles, channel links, bio), how many of the streamer's last 30 broadcasts named it, how many hours those were, and any promo or affiliate codes. One example: rybsonlol, live with 20,518 viewers at the time, named HOLY in all 30 recent broadcasts, 276.6 hours.

The brand summary

HOLY: 16 streamers, 26,211 live viewers at the time, 357 broadcasts and 2,507 hours in the past month.
DZIK and G FUEL: 5 streamers each.
Red Bull: none in this scan.

A sponsorship here means the channel points viewers to the brand. It is what the channel shows publicly, not a confirmed contract.

Running it every day

Give the run a watch name and schedule it. Each row then carries isNew, so a new sponsorship (a streamer starting with a brand) stands out. Export any table to Excel or CSV.

Try it

https://apify.com/cleanscrape/kick-sponsor-tracker

About 110 brands are recognised out of the box (drinks, gear, game stores, VPNs, skin sites, sportsbooks and more), and any brand you type is tracked the same way. $3 per 1,000 sponsorships, no start fee: this run cost about $0.18. No login, public data only.

Niko, CleanScrape developer

Who sold the most Pokémon cards on Whatnot in a day: two checks of the top 50 sellers

CleanScrape — Mon, 12 Oct 2026 16:00:06 +0000

Whatnot ranks its top sellers per category every week, but the leaderboard does not say how much each seller sold or who is growing. I built a small tool on Apify that saves the top sellers with their lifetime items sold, followers, rating and rank, and compares every run with the one before.

Here is one real use: the top 50 Pokémon card sellers, checked twice, a day apart.

The input

{
  "categories": ["Pokémon Cards"],
  "topSellers": 50,
  "historyName": "Daily check"
}

The history name ties runs together: each run is compared with the last run under the same name. The first run, on Oct 11 at 14:51 UTC, saved the 50 sellers as a starting point. The second, 24.5 hours later, saved them again in 15 seconds.

What changed in a day

Each row of the second run has the change since the first: items sold since the last check, sales per day, new followers and the rank change.

The 48 sellers in the top 50 on both days sold 41,380 items between the checks.
outsidehits sold 2,633 items, gained 1,447 followers and moved from #13 to #10.
The biggest climber, pokeynpulls, went from #23 to #16.
Two sellers are new in the top 50.

Items sold come from Whatnot's own lifetime count on each profile, so "sold since the last check" is simply the difference between two checks. Whatnot can show the count a little late for sellers who are live, which is why a daily schedule works better than an hourly one.

Running it every day

Save the input as a task and schedule it daily. Every run adds a day of sales, followers and rank for each seller, and the "Changes since last check" view shows only the columns that moved. Export any view to Excel or CSV.

Try it

https://apify.com/cleanscrape/whatnot-seller-tracker

$3 per 1,000 sellers, no start fee: a daily check of 50 sellers costs about $0.15. No login, public data only.

Niko, CleanScrape developer

What a PSA 10 Charizard costs on Whatnot, from 73 live listings

CleanScrape — Sun, 11 Oct 2026 15:43:20 +0000

Whatnot is the live shopping marketplace where a lot of trading cards, sneakers and collectibles change hands, often during live streams. It has no public API for listings, so I built a small tool on Apify that turns a Whatnot search into a table, with the seller's track record on every row.

Here is one real use: what does a PSA 10 Charizard cost on Whatnot right now, and who is selling them?

The search

The input works like the filters on the website: a keyword, a category, and Whatnot's own card filters.

{
  "searchQueries": ["charizard"],
  "categories": ["Pokémon Cards"],
  "gradedOnly": true,
  "gradingServices": ["PSA"],
  "grades": ["10"],
  "buyFormat": "buy_it_now",
  "sort": "price_asc",
  "maxResultsPerSearch": 300
}

The run returned 73 listings in 16 seconds. Each row has the price, currency, quantity, category, the date it was listed and a link, plus the seller's items sold on Whatnot, followers, rating and number of reviews.

The prices

Price	Listings
Under $100	10
$100 to $499	36
$500 to $1,999	17
$2,000 and up	9

The cheapest was $15 and the most expensive $490,000, a 1999 first edition. One more listing asked $999,999, a placeholder price rather than a real offer, so I left it out of the table. The middle listing of all 73 was $300 ($292.50 without the placeholder).

Two things to keep in mind. These are asking prices: Whatnot shows sold prices only to logged-in users, and the tool never logs in. And "PSA 10" is a filter on how sellers tag their listings, so a few titles mention other grades. Read the titles before you compare.

Who is selling

The seller columns are what make this more than a price list. The cheapest PSA 10 Charizard from a seller rated 5.0 with over a thousand sales was $100, from a seller with 11,846 items sold. In Python, with the Apify client:

from statistics import median
from apify_client import ApifyClient

client = ApifyClient("YOUR_TOKEN")
run = client.actor("cleanscrape/whatnot-scraper").call(run_input={
    "searchQueries": ["charizard"],
    "categories": ["Pokémon Cards"],
    "gradedOnly": True, "gradingServices": ["PSA"], "grades": ["10"],
    "buyFormat": "buy_it_now", "sort": "price_asc", "maxResultsPerSearch": 300,
})
rows = list(client.dataset(run["defaultDatasetId"]).iterate_items())
real = [r for r in rows if r["price"] < 999999]
print(len(rows), "listings, median", median(r["price"] for r in real))
trusted = [r for r in real if r["sellerRating"] == 5 and (r["sellerSoldCount"] or 0) >= 1000]
for r in trusted[:5]:
    print(r["price"], r["title"], r["sellerUsername"], r["sellerSoldCount"])

Live shows

Switch "What to find" to live and upcoming shows and the same category gives you the streams. The top 100 live Pokémon card shows had 6,041 viewers between them when I ran it, the biggest over a thousand. Each show row has the title, viewers, start time, format (52 Singles, 29 Surprise Sets and 19 Breaks in this run), tags and seller, and you can ask for the items for sale in each show too.

Only new listings

For deal alerts, sort by "Newly listed", turn on "Only listings or shows not saved before" and schedule the task. Each run looks at the newest listings and returns the ones earlier runs did not save, plus price drops on ones they did. The skipped ones are not charged.

Try it

Whatnot Scraper on Apify. You pay per listing saved, and the search above cost about $0.15. It works on all eight Whatnot marketplaces: the US, Canada, the UK, Germany, France, Belgium, the Netherlands and Australia.

What a data analyst earns in New York, Chicago and Austin, from 150 Google Jobs listings

CleanScrape — Wed, 07 Oct 2026 18:31:59 +0000

Google Jobs is the job search built into Google. It pulls listings from LinkedIn, Indeed, Glassdoor, company career sites and local job boards into one place, which makes it a good single source when you want to compare jobs across cities. It has no public API, so I built a small tool on Apify that turns a Google Jobs search into a table.

Here is one real use: I wanted to see what data analyst jobs pay in New York, Chicago and Austin.

The search

The input is a job title and a list of locations. Every title is searched in every location:

{
  "queries": ["data analyst"],
  "locations": ["New York, NY", "Chicago, IL", "Austin, TX"],
  "maxJobsPerSearch": 50
}

The run returned 150 jobs in 43 seconds. Most came via LinkedIn (34), Indeed (16), Dice (8) and Monster (8); the rest from company career sites and smaller boards.

Salaries as numbers

Google shows pay as text, such as "$124K–$177K a year" or "$57.70–$62.50 an hour". The tool splits that into salaryMin, salaryMax, salaryCurrency and salaryPeriod, so you can sort and filter without parsing anything yourself.

64 of the 150 jobs listed a salary. Taking the midpoint of each yearly range and the median per city:

City	Jobs with a yearly salary	Median of range midpoints
New York	21	$106,734
Chicago	19	$97,500
Austin	13	$110,000

These are small samples from one search on October 6, 2026, not a salary survey. Austin coming out on top surprised me; with 13 jobs it can easily move by the next run.

In Python, with the Apify client:

from statistics import median
from apify_client import ApifyClient

client = ApifyClient("YOUR_TOKEN")
run = client.actor("cleanscrape/google-jobs-scraper").call(run_input={
    "queries": ["data analyst"],
    "locations": ["New York, NY", "Chicago, IL", "Austin, TX"],
    "maxJobsPerSearch": 50,
})
jobs = list(client.dataset(run["defaultDatasetId"]).iterate_items())
for city in ["New York, NY", "Chicago, IL", "Austin, TX"]:
    mids = [(j["salaryMin"] + j["salaryMax"]) / 2 for j in jobs
            if j["searchLocation"] == city and j["salaryPeriod"] == "year"]
    print(city, len(mids), median(mids) if mids else None)

More than 10 jobs per search

Google Jobs shows 10 jobs per search. To get more, the tool runs close variations of the same search (posted today, this week, full time, remote, senior and so on) and keeps each job once. A search stops when the variations stop finding new jobs, so a narrow search ends early instead of paying for repeats.

Only new jobs

For job alerts, turn on "Only jobs not saved before" and schedule the task. Each run returns only jobs earlier runs did not save, and the skipped ones are not charged.

Try it

Google Jobs Scraper on Apify. You pay per job saved: $2.95 per 1,000 jobs since October 21, 2026, less on paid Apify plans. At that price the 150-job run above costs about $0.44. It works in 36 countries; outside English-speaking ones, type the job title in the local language.

What Chinese viewers say about coffee, second by second

CleanScrape — Tue, 06 Oct 2026 05:50:02 +0000

If you want to know what Chinese viewers watch and say about a topic, Bilibili is one of the best places to look. It is one of China's biggest video sites, and its viewers comment in two ways: ordinary comments under the video, and danmaku, the comments that fly across the video at the moment they were written.

I built CleanScrape's Bilibili Scraper to get both into a spreadsheet without a Bilibili account. I'm the developer, so this is a walkthrough of my own tool, not an independent review. Every number in it was checked against my runs.

One search term, 100 videos

For the example I searched for 咖啡 (coffee) and turned on top comments and danmaku. You need an Apify account to run the Actor, but no Bilibili login or cookies. The same input as JSON:

{
  "searchQueries": ["咖啡"],
  "maxVideosPerQuery": 100,
  "includeComments": true,
  "includeDanmaku": true,
  "maxDanmakuPerVideo": 500
}

The run took 81 seconds and saved 100 videos with views, likes, coins, favorites, shares and tags, plus 1,357 top comments and replies and 12,055 danmaku. Videos, comments, danmaku and creators each land in their own table, so an export holds one kind of row.

Why it doesn't get blocked

Bilibili limits how fast one visitor can read each kind of data, and it blocks an IP for minutes to an hour when that limit is crossed. I measured those limits field by field before building the Actor. It spreads the work over several proxy connections at once (nine in this run), keeps each one under the measured pace, and moves work elsewhere when Bilibili refuses a request. In this run, 5 of 604 requests were refused, all for danmaku, and every one was retried on another connection. No video is missing its danmaku.

What the danmaku show

The most-watched video in the results, about drinking six cups of coffee a day, has 5,108,457 views and 63,604 coins. A second run collected the 1,800 danmaku Bilibili's player loads for it (10,343 were sent in total), each with its time in the video.

Count them in 20-second steps and the busiest stretch after the opening is 0:40 to 1:00, with 136 danmaku. 21 of those are about bitterness, and the running joke is that life is more bitter than coffee:

再苦能有生活苦: "Can it be more bitter than life?"
咖啡没有我的命苦: "Coffee isn't as bitter as my life"
因为生活比咖啡还苦: "Because life is even more bitter than coffee"

That kind of moment-by-moment reaction is hard to get any other way. Comments tell you what people thought after watching; danmaku tell you what they felt at a given second.

Top comments

Without login Bilibili shows the top comments of a video (usually 3) and the first 20 replies under each, so this is a sample, not every comment. On the coffee video, the pinned top comment asks whether anyone has managed to quit coffee. It has 5,941 likes and 714 replies.

Export and cost

Open Storage > Dataset, choose Default (videos), Comments, Danmaku or Creators, and download CSV, Excel or JSON. From the API, the run object lists the four datasets under storageIds.datasets.

At base prices a video costs $1.49 per 1,000, a comment $0.49 per 1,000 and a danmaku $0.10 per 1,000, with no start fee and platform usage included. 100 videos with tags cost about $0.15. There are also ready-made examples for a keyword, one video's danmaku and a creator's profile and videos.

Besides search terms, you can paste video links, BV ids, creator links or UIDs, or the whole text the Bilibili app copies with Share > Copy link.

What it can't do without login: every comment of a video, a creator's full upload history (it uses their public collections and series), subtitles, and bilibili.tv, the international site.

Questions or a reproducible problem: use the Actor's Issues tab or email contact.cleanscrape@gmail.com. CleanScrape is independent of Bilibili and Apify.