DEV Community

Cover image for I built an API to extract SEO metadata, images, JS & CSS from any website or HTML — use it for audits, automation, or analysis 🔍
Tamer
Tamer

Posted on

I built an API to extract SEO metadata, images, JS & CSS from any website or HTML — use it for audits, automation, or analysis 🔍

Hey devs 👋

As someone building tools for digital marketers and devs, I was constantly hacking together different libraries to extract SEO and asset data from web pages.

Most tools were either overkill, slow, or blocked by CORS. So I built a simple solution and just launched it on RapidAPI:
⚙️ SmartWeb Web Scraper API

A fast, server-side API to extract SEO info and page assets (JS, CSS, images) from any website URL or raw HTML.
🔍 What It Can Do:
✅ SEO Metadata Extraction

Title, description, canonical URL

Robots tag, language, charset

Open Graph & Twitter cards

Viewport, structured data, H1/H2s

Favicon details
Enter fullscreen mode Exit fullscreen mode

🖼️ Asset Extraction (great for optimization tools)

JS links (inline + external)

CSS links (including stylesheets)

Image links (with alt text, formats)
Enter fullscreen mode Exit fullscreen mode

🧪 Two Ways to Use It:

  1. From a Webpage URL

httpCopyEditGET /SmartWeb/Page-Seo-data?siteurl=https://example.com
GET /SmartWeb/Page-img-links?siteurl=https://example.com
GET /SmartWeb/Page-css-links?siteurl=https://example.com
GET /SmartWeb/Page-js-links?siteurl=https://example.com

  1. From Raw HTML

httpCopyEditPOST /SmartWeb/html-Seo-data
POST /SmartWeb/html-img-links
POST /SmartWeb/html-css-links
POST /SmartWeb/html-js-links

🛠️ Use Cases

SEO auditing dashboards

Blog/CMS publishing validators

Static site SEO testing

Competitor metadata analysis

Image/CSS/JS optimization tools

Browserless crawlers & scrapers
Enter fullscreen mode Exit fullscreen mode

🔓 Available on RapidAPI (free tier included)

If you’re building anything related to SEO, devtools, automation, or site audits, I’d love for you to give it a try. It’s super fast and easy to use.

📎 Try the SmartWeb API on RapidAPI
(No signup required to preview the endpoints)

Would love to hear:

What you'd build with this

What SEO fields or data you want next

Any dev pain points in scraping you’re facing
Enter fullscreen mode Exit fullscreen mode

Thanks for reading and happy building!
— I’ll be in the comments if you want to brainstorm or give feedback.Hey devs 👋
As someone building tools for digital marketers and devs, I was constantly hacking together different libraries to extract SEO and asset data from web pages.
Most tools were either overkill, slow, or blocked by CORS. So I built a simple solution and just launched it on RapidAPI:

⚙️ SmartWeb Web Scraper API
A fast, server-side API to extract SEO info and page assets (JS, CSS, images) from any website URL or raw HTML.

🔍 What It Can Do:
✅ SEO Metadata Extraction
Title, description, canonical URL
Robots tag, language, charset
Open Graph & Twitter cards

Viewport, structured data, H1/H2s
Favicon details
🖼️ Asset Extraction (great for optimization tools)
JS links (inline + external)
CSS links (including stylesheets)
Image links (with alt text, formats)

🛠️ Use Cases

SEO auditing dashboards

Blog/CMS publishing validators

Static site SEO testing

Competitor metadata analysis

Image/CSS/JS optimization tools

Browserless crawlers & scrapers

🔓 Available on RapidAPI (free tier included)
If you’re building anything related to SEO, devtools, automation, or site audits, I’d love for you to give it a try. It’s super fast and easy to use.
📎 Try the SmartWeb API on RapidAPI

Would love to hear:

What you'd build with this

What SEO fields or data you want next

Any dev pain points in scraping you’re facing

Thanks for reading and happy building!

— I’ll be in the comments if you want to brainstorm or give feedback.

Top comments (0)