DEV Community: Tapaswai Choudhary

Google News alerts with real article URLs - to Slack or Google Sheets

Tapaswai Choudhary — Fri, 06 Nov 2026 11:58:22 +0000

Google Alerts emails are hard to automate, and the Google News RSS feed gives you
news.google.com/rss/articles/... redirect links instead of the publisher's URL. This
tutorial builds a news monitor that:

searches Google News for any keywords, sites, language and country
returns the publisher's real article URL, publisher, date and related coverage
returns only articles you haven't seen yet, on a schedule
delivers them to Slack, email or a spreadsheet

One article looks like this

{
  "title": "Trump AI deal rebrands 'artificial intelligence' as 'superintelligence'",
  "url": "https://www.theguardian.com/us-news/2026/sep/29/trump-ai-deal-tech-ceos-superintelligence",
  "publisher": "theguardian.com",
  "publishedAt": "2026-09-30T17:37:00+00:00",
  "query": "artificial intelligence",
  "language": "en",
  "country": "US",
  "urlResolved": true
}

Step 1 - choose what to watch

In Google News Scraper:

Search queries take Google News operators: "exact phrase", -exclude, OR, intitle:word. Example: "Acme Corp" -stock.
Topics: Top stories, Business, Technology, Science...
Only from these sites / Never from these sites: e.g. reuters.com, bbc.co.uk.
Published within: past hour, 24 h, week...
Language / Country: de + DE, hi + IN, ja + JP, and so on.

Step 2 - try it from code

import os, requests

articles = requests.post(
    "https://api.apify.com/v2/acts/tacps126~google-news/run-sync-get-dataset-items",
    headers={"Authorization": f"Bearer {os.environ['APIFY_TOKEN']}"},
    json={"queries": ['"generative AI" -stock'], "timeframe": "1d", "maxItems": 50},
    timeout=300,
).json()

for a in articles:
    print(a["publishedAt"][:10], a["publisher"], "-", a["title"])
    print("   ", a["url"])

In my test runs, 100 articles come back in about 11 seconds, publisher URLs included.

Step 3 - turn it into alerts

Save the input as a task and turn on Only new articles. Each run then returns only articles no earlier run delivered, and you pay only for those.
Add a schedule: hourly for breaking news, daily for a digest.
Add an integration: Slack (a message per run), Google Sheets (append rows), email, or a webhook into your own app or RAG index.

Running several monitors? Give each a different Monitor name so they keep separate
histories.

Use cases

PR and brand monitoring: your brand, executives, competitors.
Investment research: tickers and company names, filtered to trusted publishers.
AI and RAG pipelines: a fresh, deduplicated stream of article URLs to fetch and embed.
Local news in any language, using the country and language editions.

Cost

About $3 per 1,000 articles, and with "only new" you pay only for articles you
haven't already received.

Missing a filter? Open an issue on the
Actor's Issues tab.

How to download the transcripts of a whole YouTube channel or playlist (without an API key)

Tapaswai Choudhary — Fri, 06 Nov 2026 11:52:20 +0000

A channel's back catalogue is hours of expert talk that search engines and AI tools never see. Turning it into
text makes it searchable, quotable and ready for an AI knowledge base, show notes or a newsletter. Copying
captions one video at a time does not scale, and the official API does not hand out other people's captions.

This guide gets you the transcript of every video in a channel, playlist or search, as clean text with
timestamps, for $2.50 per 1,000 videos.

What you get

One row per video:

Field	Example
Title, channel, link	the video's details
Published, length, views	when, how long, how popular
Transcript	the full text
Segments	each caption line with its start time, for quoting or jumping to the moment
Caption language, auto-generated	which track was used, and whether it was typed by a person
Word count	487 for a three-and-a-half-minute music video

Videos without captions are listed in the run summary and are not charged.

Step 1: open the tool

Go to YouTube Transcript Scraper and click Try for free.
No Apify account? Create one free; no card needed. The free plan returns
up to 100 transcripts per run.

Step 2: paste a channel, playlist or videos

{
  "videos": ["https://www.youtube.com/@YourChannel"],
  "maxVideosPerSource": 50,
  "languages": ["en"]
}

Use a playlist link, single video links or searchQueries the same way. Ask for another language with
translateTo.

Step 3: run and export

Click Start. A single video comes back in about a second. Export as JSON for an AI pipeline, or as CSV or
Excel for reading.

New videos only, every week

Add "onlyNew": true, "monitorName": "my-channel" and schedule it weekly: each run returns only the videos
earlier runs did not deliver. A ready n8n workflow
puts them in a Google Sheet every Friday.

Ideas

Feed a channel into a retrieval (RAG) knowledge base and answer questions with sources and timestamps.
Turn talks into blog posts, show notes or newsletter quotes.
Track what competitors and creators say about your product across their videos.

The best ImmobilienScout24 scrapers in 2026 (compared by price, data and features)

Tapaswai Choudhary — Fri, 06 Nov 2026 11:51:06 +0000

ImmobilienScout24 (ImmoScout24) is Germany's largest property portal, and it has no
public API for listings. If you want rental or sale listings in a spreadsheet for price
analysis, investment screening, relocation or a proptech product, a ready-made scraper on
Apify is the quickest route. I compared the five that are actively maintained.

Disclosure: I built one of them (tacps126). I've kept the comparison to facts you can
check on each Store page (pricing and features as listed on 2026-10-13), and I note where
others do things mine doesn't.

The comparison

Scraper	Price per 1,000 listings	Start fee per run	Countries	Notable extras
memo23 - ImmoScout24 .de/.ch/.at + Price-Cut Archive	$1.75	$0.005	DE, CH, AT	Price-cut archive, phone numbers (extra fee), market analysis add-on
azzouzana - ImmobilienScout24 Scraper	$1.00	$0.006	DE	Search-URL based
clearpath - ImmoScout24 API Pro	$1.19	$0.002	DE	50+ fields
igolaizola - ImmobilienScout24 Scraper	$1.00 (+$1 for details)	$0.01	DE	Optional detail pages
tacps126 - ImmobilienScout24 Scraper	$0.95	$0.006	DE	Plain-word locations, price per m², coordinates, seller filter, only-new alerts

Start fees matter if you run small scheduled jobs: an hourly alert costs 24 starts a day.

How to choose

You need Switzerland or Austria, price history or phone numbers: memo23 is the most complete and the most used (about 190 users a month, 5★).
You want the lowest cost for frequent, small monitoring runs: pick one with no real start fee, so a daily "only new listings in Berlin" run costs cents.
You want full exposé details (description text, full equipment list): igolaizola and memo23 offer detail fetching.
You start from a city name rather than a URL: tacps126 lets you type Berlin or München Schwabing and set price/area/rooms filters, or paste search URLs.

What a listing looks like (tacps126)

{
  "title": "Wohnen mit Herz - wie geschaffen für zwei",
  "offerType": "rent",
  "price": { "amount": 594.78, "currency": "EUR", "period": "month" },
  "totalRent": 800.94,
  "livingArea": 51.72,
  "rooms": 2,
  "pricePerSqm": 11.5,
  "address": { "postcode": "12619", "city": "Berlin", "district": "Kaulsdorf (Hellersdorf)" },
  "latitude": 52.52485,
  "longitude": 13.58695,
  "energyClass": "B",
  "features": ["balcony", "cellar", "lift"],
  "url": "https://www.immobilienscout24.de/expose/168986388"
}

In my test runs it returned 1,112 listings (Hamburg houses for sale and Berlin rentals, 50
result pages) in 21 seconds.

Calling it from code

import os, requests

rows = requests.post(
    "https://api.apify.com/v2/acts/tacps126~immobilienscout24-scraper/run-sync-get-dataset-items",
    headers={"Authorization": f"Bearer {os.environ['APIFY_TOKEN']}"},
    json={"locations": ["Berlin"], "offerType": "rent", "maxPrice": 1500, "minRooms": 2, "sort": "newest", "maxItems": 200},
    timeout=300,
).json()
avg = sum(r["pricePerSqm"] for r in rows if r.get("pricePerSqm")) / max(1, sum(1 for r in rows if r.get("pricePerSqm")))
print(f"{len(rows)} listings, average cold rent {avg:.2f} €/m²")

Legal note

All of these collect publicly listed ads. Listings can include contact names, so handle
them under GDPR (purpose limitation, no unsolicited marketing to private landlords).

How to screen a customer or supplier list against OFAC, UN, EU and UK sanctions lists (cheaply)

Tapaswai Choudhary — Fri, 06 Nov 2026 11:44:46 +0000

If you onboard customers, pay suppliers abroad or ship goods across borders, you are expected to check names
against the sanctions lists. Commercial screening suites start at hundreds of dollars a month. For a small
team with a few hundred or a few thousand names, that is a lot to pay for a lookup.

This guide screens a whole list against seven official lists in one run, for $3 per 1,000 names, with a
verdict per name you can hand to whoever signs off.

Which lists

Read fresh from each publisher on every run:

US OFAC Specially Designated Nationals (SDN) list and the consolidated non-SDN list
UN Security Council consolidated list
EU consolidated financial sanctions list
UK sanctions list
Canada's consolidated autonomous sanctions list
Switzerland's SECO list

About 46,000 entries in all.

What you get

One row per name you screened:

Field	Example
Verdict	`match`, `possible-match` or `no-match`
Top score	100
Best matches	the listed name or alias that matched, which list, the sanctions programme
Details	countries, birth dates, passport or registration numbers where the list gives them
Checks	`birthYear: consistent`, `country: different` when you supply them
Link	the entry on the publisher's site

Matching that copes with real names

Names arrive in every spelling. Владимир Путин, PUTIN, Vladimir and V. Putin are found as the same
person; Mohammed and Muhammad match; company forms such as Ltd, LLC or GmbH are ignored; and common
words like Trading or Bank count for less, so Bank alone does not match every listed bank. Give a date of
birth or a country and a different one lowers the score and is flagged, so you review fewer false alarms.

Step 1: open the tool

Go to Sanctions Screener and click Try for free. No
Apify account? Create one free; no card needed. The free plan screens up
to 100 names per run.

Step 2: paste your names

One per line in Names, or switch to JSON and send your own references:

{
  "names": ["Rosneft", "Acme Trading LLC"],
  "subjects": [
    { "name": "Jane Example", "id": "customer-17", "dateOfBirth": "1980", "country": "GB" }
  ],
  "minScore": 85
}

Step 3: run and export

Click Start. Each run loads all seven lists fresh, which takes about a minute, then screens your names in
seconds; one run can screen thousands. Export the verdicts to Excel, CSV or Google Sheets.

Keep it current

Rescreen weekly. Schedule the same input; there is a ready n8n workflow that writes each week's verdicts to a Google Sheet.
Follow the lists themselves. Mode changes reports new designations and removals since the last run.
Screen during onboarding. Standby mode keeps the lists in memory and answers each check in milliseconds.

A screening result is a lead for your compliance review, not a legal determination. Check every match against
the publisher's entry before you act on it.

A daily list of newly registered companies in France, Norway, Finland and Estonia, from the official registers

Tapaswai Choudhary — Fri, 06 Nov 2026 11:43:32 +0000

A company that registered this week needs an accountant, a bank account, insurance, payroll, a website, a
phone plan and a point-of-sale system, and it has not chosen any of them yet. If you sell any of those, new
registrations are the warmest list you can get. Lead vendors resell them weeks later. The registers publish
them every day.

This guide gets you the companies registered since yesterday, straight from the official registers, in about
three seconds.

Where the data comes from

France: BODACC, the official bulletin of company announcements
Norway: the Brønnøysund Register Centre
Finland: the PRH / YTJ business information system
Estonia: the e-Business Register
United States: the open business registers of New York, Colorado, Connecticut and Oregon

Insolvencies and other events are in the same feed for credit and collections teams.

What you get

Field	Example
Name, register id, country	KL-Steel Oy, 3612917-2, FI
Legal form	Limited company
Registered on	2026-11-01
Address, city	Hämeenlinna
Website	when the register has it
Industry code and activity	where published
Officers	directors and board members, when you turn them on and the register publishes them
Link	the company's page in the register

Step 1: open the tool

Go to Company Registry and click Try for free. No Apify
account? Create one free; no card needed. The free plan returns up to
100 companies per run.

Step 2: choose countries and filters

The prefilled input returns 40 companies registered this week across four countries. To focus, switch to JSON:

{
  "mode": "new",
  "countries": ["FI", "NO"],
  "registeredWithinDays": 2,
  "keywords": ["software", "consulting"]
}

Filter by industry codes or locations the same way.

Step 3: run and export

Click Start and export to Excel, CSV or Google Sheets.

Get it every morning

Add "onlyNew": true, "monitorName": "new-companies" and schedule the run daily: each run returns only
companies the earlier runs did not deliver. A ready n8n workflow
appends them to a Google Sheet every morning.

Price

$2.50 per 1,000 companies. A daily feed for one country is a few cents a week.

Sole traders appear in some registers under a person's name. Follow your local rules on direct marketing
before you contact them.

Foreclosure and court auctions in Germany, Spain, Italy and India in one spreadsheet, ranked

Tapaswai Choudhary — Fri, 06 Nov 2026 11:42:18 +0000

Court and bank auctions are where property sells below market, and they are hard to follow. Germany
publishes its court foreclosures (Zwangsversteigerungen) per state, Spain runs its public auctions on the
BOE portal, Italy lists court sales on the national sales portal, and Indian banks auction repossessed
homes and vehicles on their own e-auction portal. Four countries, four languages, four layouts, and no
way to compare one lot with the next.

This guide gets you every lot in one table, scored against similar lots nearby and against your budget,
in about 20 seconds.

What you get

One row per lot, in the same format for every country:

Field	Example
Score and verdict	100, "1st of 9 in land, IT. 15% below the typical price per m² of 5 similar lots; vacant."
Price, valuation, currency	12,000 EUR, official valuation where published
Debts that stay with the property, total cost	Spanish lots often carry them; total cost adds them
Area, price per m²	788 m², 15.23 EUR per m²
Possession	vacant, occupied, or the bank holds physical possession
Auction date, days left, deposit	when bidding closes and what you put down
Seller, case number, documents, photos	court or bank, valuation report, notice

How the score works

Each lot is compared with its peers: flats with flats in the same town, Tata trucks with Tata trucks. When a
town has too few lots, the region or country is used, and the row says which group and how many lots were in
it. Lots are never compared across countries or currencies.

The score weighs price per m², discount to valuation, how far the reserve has been cut after failed
sales, possession, clear title, how much paperwork is published and time to the auction. Then it adds how well
the lot fits you: budget, distance from your place, area and dates. Lots that look far too cheap get a
warning to check the stated area, because a very low price per m² is more often a plot size or a share of a
property than a bargain.

Step 1: open the tool

Go to Auctions Radar and click Try for free. No Apify
account? Create one free; no card needed. The free plan returns up to
50 lots per run.

Step 2: say what you want

The prefilled input reads all four countries. To narrow it, switch to JSON and paste, for example, homes
within 25 km of Milan under 250,000 EUR:

{
  "countries": ["IT"],
  "assetTypes": ["apartment", "house"],
  "location": "Milano",
  "radiusKm": 25,
  "budgetMax": 250000,
  "profile": "bargainHunter"
}

Other ideas:

German foreclosures in Bavaria in the next 60 days: "countries": ["DE"], "regions": ["Bayern"], "auctionWithinDays": 60
Vacant Spanish property with no debts to inherit: "countries": ["ES"], "vacantOnly": true, "profile": "lowRisk"
Indian bank auctions in Kerala from 20 to 80 lakh: "countries": ["IN"], "regions": ["Kerala"], "budgetMin": 2000000, "budgetMax": 8000000, "budgetCurrency": "INR"

Step 3: run and export

Click Start. Lots come back best score first. Export to Excel, CSV or Google Sheets from the
Export button.

Get new lots and price cuts every week

Add "monitorName": "my-watch", "changesOnly": true and schedule the run weekly. Each run then returns only
new lots and lots whose price, date or status changed, with the price history. Send them to email, Slack or a
Google Sheet; there is a ready n8n workflow
for the sheet.

Price

$15 per 1,000 lots until 1 December 2026, then $5 per 1,000 lots. A typical weekly watch for one city costs
a few cents.

Always read the official notice and documents before you bid: the tool reads public listings and does not
bid or register for you.

Find companies hiring for the roles you sell to - every week, automatically

Tapaswai Choudhary — Fri, 06 Nov 2026 11:20:49 +0000

Job postings are one of the most honest buying signals in B2B. A company that just
opened four data-engineering roles is about to spend on data tooling; one hiring its
first RevOps lead will soon shop for a CRM stack. The postings are public. The hard part
is checking hundreds of career pages every week.

This tutorial sets up a weekly list of target accounts that are hiring for the roles
you care about, one row per company, with what changed since last week.

What you get

One record per company with a signal, for example:

{
  "company": "Stripe",
  "board": "greenhouse",
  "matchingRoles": 10,
  "newMatchingRoles": 10,
  "newestRolePostedAt": "2026-09-28T15:58:13+00:00",
  "functions": { "data": 7, "engineering": 3 },
  "matchedKeywords": { "data": 7, "machine learning": 3 },
  "roles": [
    { "title": "Data Scientist", "location": "Seattle, WA", "postedAtIso": "2026-09-22T00:23:42+00:00", "isNew": true, "url": "https://stripe.com/jobs/search?gh_jid=8222149" }
  ]
}

Companies without a matching role are skipped, and you aren't charged for them.

Step 1 - list your accounts

Paste career-page URLs. Greenhouse, Lever, Ashby, Workday, SmartRecruiters, Recruitee,
Personio and Teamtailor pages are detected automatically:

https://boards.greenhouse.io/stripe
https://jobs.lever.co/spotify
https://jobs.ashbyhq.com/ramp

No account list yet? Use searches instead (e.g. data engineer in Germany) to
discover companies hiring for a role.

Step 2 - describe the roles that signal intent

roleKeywords matches job titles: data, analytics, machine learning. Narrow it
further with seniority, job function, work mode, locations, or "posted within N days".
minMatchingRoles: 3 keeps only companies hiring for several of those roles at once,
which is a much stronger signal.

Step 3 - run it

Open Hiring Signals on Apify, paste the
input, and click Start. Or call it from code:

import os, requests

run = requests.post(
    "https://api.apify.com/v2/acts/tacps126~hiring-signals/run-sync-get-dataset-items",
    headers={"Authorization": f"Bearer {os.environ['APIFY_TOKEN']}"},
    json={
        "companies": ["https://boards.greenhouse.io/stripe", "https://jobs.lever.co/spotify"],
        "roleKeywords": ["data", "analytics", "machine learning"],
        "postedWithinDays": 30,
    },
    timeout=300,
)
for c in run.json():
    print(c["company"], c["matchingRoles"], "matching roles,", c["newMatchingRoles"], "new")

Step 4 - make it weekly

Save the input as a task, then add a schedule (e.g. Mondays 08:00).
Turn on Only new or changed. Each run then returns only companies whose matching roles changed since the last run, so the weekly list stays short.
Add an integration: Slack, email, Google Sheets, HubSpot via Zapier/Make, or a webhook to your CRM.

Step 5 - add contacts (optional)

Chain the Website Contact Details Actor
after it to collect emails and social links from each company's website. Use that data
within GDPR / CAN-SPAM rules.

Cost

About 1 cent per company with a signal. Companies with nothing matching are free.
A 300-account list where 40 accounts are hiring costs about $0.40 a run.

Questions or a board that isn't supported yet? Open an issue on the
Actor's Issues tab. Requests decide
what gets built next.

How to get the Automechanika Dubai 2026 exhibitor list with emails (in 2 minutes)

Tapaswai Choudhary — Fri, 06 Nov 2026 11:15:39 +0000

Automechanika Dubai runs 10-12 November 2026 at Expo City Dubai. More than 800 companies
exhibit: parts makers, distributors, workshop-equipment brands, tyre and lubricant traders from
the UAE, India, China, Turkey, Germany and beyond.

If you sell to the automotive aftermarket, that exhibitor list is the best lead list of the
year. The show's website lets you browse it one company at a time. This guide gets you the
whole list as a spreadsheet, with emails, phones, websites and booths, in about two minutes.

What you get

One row per exhibitor:

Field	Example
Company	(exhibitor's legal name)
Booth	S / 04742
Email	sales@...
Phone	+971 ...
Website	https://...
City, country	Sharjah, United Arab Emirates
Description, product categories	...

In our run, 790 of 804 exhibitors came with an email address.

Step 1: open the tool

Go to Trade Show Exhibitor List Scraper and
click Try for free. If you don't have an Apify account, create one free;
no card needed. The free plan returns up to 200 exhibitors per show, enough to check the data.

Step 2: pick the show

In Exhibitions, choose Automechanika Dubai. Or switch to JSON and paste:

{
  "exhibitionList": ["automechanika-dubai"],
  "maxResults": 1000,
  "includeDetails": true
}

Leave Include contact details on: that's what adds email, phone and address.

Step 3: run and download

Press Start. When it finishes, open Output > Export and pick CSV or Excel. The Contacts
view gives you a flat table ready for your CRM.

Cost on a paid plan: about $3 per 1,000 exhibitors, so the whole show costs less than a coffee.

Step 4: narrow it down

A few filters that work well in a spreadsheet:

Country = India (or your market): 23 Indian exhibitors this year, a short list to call first.
Country = United Arab Emirates: about 120 local traders and distributors, the buyers most exhibitors want to meet.
Description contains brake, filter, battery, lubricant: your product category only.

Step 5: book meetings before the show

The list is worth most before the doors open. Email the companies you want to meet with their
booth number in the first line ("I'll be at Automechanika, could I stop by S / 04742 on the 11th?").
Short, specific, booth in the subject: reply rates are far higher than cold email without a reason.

Keep it fresh

Exhibitor lists keep growing until the show opens. Turn on Only new exhibitors and schedule the
tool daily (Apify > Schedules): each run returns only companies added since the last one.

Send it to your tools automatically

Google Sheets: the tool's Integrations tab, or our ready n8n workflow (show > Google Sheet).
Clay: Import from Apify > Actor run, then enrich each exhibitor with your usual providers.
Make / Zapier: the Apify app > Run an Actor tacps126/exhibition-scraper > Get dataset items.

Setup steps for all four: integrations guide.

Other shows

The same tool covers 90+ trade shows (MEDICA, Automechanika Frankfurt, Riyadh and Shanghai, SEMA Show,
World Health Expo, Intersec Saudi Arabia...) and any show by link: paste the
exhibitor-list URL into Start URLs.

Found it useful? A short review on the tool's page
helps others find it.