DEV Community: Akash Kumar Naik

🛒 Amazon Product Scraper: Extract Prices, Reviews & Images at Scale

Akash Kumar Naik — Sun, 15 Mar 2026 04:35:49 +0000

Tired of manually tracking Amazon prices? Want to build a price comparison tool or analyze competitor products?

Today, I'm excited to share Amazon Product Scraper — a powerful Apify Actor designed to extract comprehensive product data from Amazon.com with built-in anti-blocking protection.

🌟 What Makes This Different?

While there are many Amazon scrapers out there, this one focuses on reliability and clean data extraction:

Feature	Benefit
📦 Product Details	Extract prices, ratings, descriptions, and specs
🖼️ Product Images	Get all product images including thumbnails
🛡️ Anti-Detection	Built-in proxy support and anti-scraping protection
✨ Clean Data	Automatically formats and cleans extracted data
⚡ Fast Performance	Optimized scraping with session management

🎯 Who Is This For?

E-commerce entrepreneurs building price comparison sites
Market researchers analyzing product trends
Developers creating product catalog databases
Competitive analysts monitoring competitor pricing

🚀 Getting Started

Quick Start (No-Code)

Go to Amazon Product Scraper
Add Product URL — Enter an Amazon product URL you want to scrape
Configure Proxy — Choose proxy settings (residential recommended)
Run — Get comprehensive product data in JSON format

Example Input

{
  "productUrl": "https://www.amazon.com/dp/B0CL61F39H",
  "proxyConfig": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

📊 Output Format

{
  "title": "PlayStation®5 console (slim)",
  "asin": "B0CL61F39H",
  "url": "https://www.amazon.com/dp/B0CL61F39H",
  "price": "$499.99",
  "price_striked": "$599.99",
  "rating": 4.6,
  "rating_count": 5815,
  "description": "Product description...",
  "feature_bullets": ["Feature 1", "Feature 2"],
  "images": ["https://image1.jpg", "https://image2.jpg"],
  "scrapedAt": "2026-02-18T10:30:00Z"
}

💰 Transparent Pricing

Pay-Per-Event (PPE) pricing:

Service	Cost
Product scraped	$0.005 per product
Residential proxy	$0.005 per product

Example: Scraping 100 products with residential proxies:

Product scraping: $0.50
Proxy cost: $0.50
Total: $1.00 for 100 products

🛡️ Best Practices for Success

Recommended Settings:

Use Residential Proxies for reliable scraping
Use valid product URLs — direct DP URLs work best
Enable proxy to avoid Amazon blocks
Monitor runs and adjust settings if needed

Avoiding Blocks:

✓ Use proxy rotation (residential recommended)
✓ Don't scrape too aggressively
✓ Consider rate limiting between requests
✓ Use direct product URLs (not shortened links)

💻 API Integration

cURL Example

curl -X POST \
  https://api.apify.com/v2/actors/akash9078~amazon-product-scraper/runs \
  -H "Authorization: Bearer YOUR_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "productUrl": "https://www.amazon.com/dp/B0CL61F39H",
    "proxyConfig": {
      "useApifyProxy": true,
      "apifyProxyGroups": ["RESIDENTIAL"]
    }
  }'

JavaScript/Node.js

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_TOKEN' });

const run = await client.actor('akash9078/amazon-product-scraper').call({
  productUrl: 'https://www.amazon.com/dp/B0CL61F39H',
  proxyConfig: { useApifyProxy: true, apifyProxyGroups: ['RESIDENTIAL'] }
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

📈 Use Cases

Use Case	Application
Price Monitoring	Track product prices over time
Market Research	Analyze product trends and competition
Product Catalogs	Build comprehensive product databases
Competitive Intelligence	Monitor competitor products

🔧 Technical Specifications

Property	Value
Memory	256MB (default), 512MB recommended
Timeout	5 minutes default
Data Format	JSON
Proxy Support	Apify Proxy (residential/datacenter)
Supported Stores	Amazon.com, Amazon.in, and other regional stores

🆘 Troubleshooting

Common Issues:

❌ No results → Check if URL is a valid Amazon product page
❌ Blocked requests → Enable residential proxies
❌ Timeout errors → Increase timeout or enable more memory
❌ Missing data → Some fields may not be available for all products

📝 Data Compliance

This Actor extracts publicly available data from Amazon. Please ensure compliance with:

Amazon's Terms of Service
Local data protection laws (GDPR, CCPA, etc.)
Your intended use case requirements

🎉 Try It Now!

Ready to start scraping Amazon product data?

👉 Try Amazon Product Scraper for Free

📖 View Full Documentation

Questions? Drop a comment below or reach out via the Apify Console!

Built with ❤️ using Apify — The web scraping and automation platform

webscraping #ecommerce #automation #productivity

🌫️ Air Quality Index API: Real-Time AQI

Akash Kumar Naik — Sun, 15 Mar 2026 04:27:33 +0000

🌫️ Air Quality Index API: Real-Time AQI Data + AI Health Recommendations

Air pollution affects 99% of the global population. Whether you're planning a morning jog, managing asthma, or building a health app — knowing the air quality before you step outside is critical.

That's why I built the Air Quality Index (AQI) API — a real-time API that delivers AQI data, pollution metrics, weather info, and AI-powered health recommendations for outdoor activities.

✨ What You Get

📊 Real-Time AQI & Pollution Metrics

AQI (Air Quality Index) - Overall air quality score
PM2.5 - Fine particulate matter (most harmful)
PM10 - Coarse particulate matter
CO - Carbon monoxide levels
Temperature, Humidity, Wind Speed - Weather context

🧠 AI-Powered Health Recommendations

Personalized guidance based on:

Your planned outdoor activity (running, cycling, walking)
Duration of exposure
Medical conditions (asthma, allergies, respiratory issues)

No API key required — Mistral credentials are managed by the actor.

🎯 Perfect For

Use Case	Application
Fitness Apps	Warn users before outdoor workouts
Travel Platforms	Route planning around pollution hotspots
Health Assistants	Daily air quality briefings for sensitive users
Smart Cities	Environmental dashboards & alerts
Wearables	Real-time AQI notifications

🚀 How to Use It

Option 1: Apify Console (No-Code)

Visit AQI API on Apify
Enter your city (e.g., "Delhi", "Los Angeles", "Beijing")
Specify planned activity (e.g., "morning jog for 45 minutes")
Add medical conditions if applicable (e.g., "asthma")
Click Start → Get results in seconds

Option 2: API Integration

curl -X POST \
  https://api.apify.com/v2/acts/akash9078~air-quality-index-aqi-api/runs \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer YOUR_APIFY_TOKEN' \
  -d '{
    "city": "Delhi",
    "state": "Delhi",
    "country": "India",
    "plannedActivity": "morning walk",
    "medicalConditions": "asthma"
  }'

📊 Sample Output

{
  "success": true,
  "location": {
    "city": "Delhi",
    "state": "Delhi",
    "country": "India"
  },
  "aqi_data": {
    "aqi": 135,
    "temperature": 31.4,
    "humidity": 41.0,
    "wind_speed": 16.6,
    "pm25": 51.0,
    "pm10": 65.0,
    "co": 312.0
  },
  "recommendations": "AQI is 135 (Unhealthy for Sensitive Groups). For a 30-minute morning walk with asthma: wear an N95 mask, avoid busy roads, consider indoor exercise if symptoms appear.",
  "charges": [
    { "event": "aqi_data_fetch", "price": 0.005 },
    { "event": "health_recommendation", "price": 0.005 }
  ],
  "total_price": 0.01
}

💰 Transparent Pricing

Pay-per-event pricing:

Event	Price
AQI Data Fetch	$0.005
Health Recommendation	$0.005
Total per run	$0.01

That's 1 cent per query — affordable for apps of any scale.

🔧 Technical Details

Data Source: aqi.in with resilient scraping logic
AI Model: Mistral Large for health recommendations
Runtime: Python with fallback extraction methods
Output: Structured JSON with full charge transparency

🌍 Real-World Use Cases

The Fitness App Developer

"Integrated the AQI API into our running app. Now users get automatic air quality alerts before their outdoor workouts. Reduced user complaints about breathing issues by 60%."

The Travel Planner

"We use this to warn travelers about pollution in destinations like Delhi, Beijing, and Bangkok. Helps them pack masks and plan indoor alternatives."

The Asthma Management App

"Daily AQI checks with personalized recommendations are now a core feature. Users love the 'should I go outside today?' guidance."

⚠️ Important Notes

Not a medical diagnosis — provides informational guidance only
Always consult healthcare professionals for medical advice
Data sourced from third-party providers; occasional delays possible
Zero AQI values may indicate temporary source unavailability

🌱 Why Air Quality Matters

7 million premature deaths annually linked to air pollution (WHO)
PM2.5 particles can enter bloodstream and affect organs
Real-time awareness helps vulnerable populations stay safe
AI recommendations bridge data → actionable health guidance

🔗 Try It Now

Protect your users, yourself, and your community with real-time air quality intelligence.

Try AQI API for Free

Built with ❤️ by @akash9078 on the Apify platform.

What's your city's AQI today? Let me know in the comments! 👇

🌍 AI Travel Planner: Generate Personalized Itineraries with AI-Powered Research

Akash Kumar Naik — Sun, 15 Mar 2026 04:21:16 +0000

Planning a trip used to mean:

🔍 Hours of browsing travel blogs
📱 Opening 47 different tabs
😰 Stressing about missing hidden gems
📅 Manually creating day-by-day schedules

Those days are over. Meet AI Travel Planner — your AI-powered travel assistant that creates complete, research-backed itineraries in seconds.

✨ What It Does

The AI Travel Planner combines Mistral Large (advanced AI model) with real-time web research to build custom travel plans that actually make sense.

🧠 AI-Powered Planning

Uses Mistral Large to generate intelligent, context-aware itineraries based on:

Your destination
Trip duration
Real-time web research

🔍 Built-in Web Research

Integrates Apify's Google SERP scraper to find:

Top attractions & activities
Hidden local gems
Best restaurants & cafes
Practical travel tips

📅 Calendar Export

Automatically generates ICS calendar files — import directly into:

Google Calendar
Apple Calendar
Microsoft Outlook
Any calendar app

🚀 How to Use It

Option 1: Apify Console (No-Code)

Visit AI Travel Planner on Apify
Enter your destination (e.g., "Paris", "Tokyo", "Bali")
Set trip duration (1-30 days)
Click Start → Get your itinerary in seconds

Option 2: API Integration

curl -X POST \
  https://api.apify.com/v2/acts/akash9078~ai-travel-planner/runs \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer YOUR_APIFY_TOKEN' \
  -d '{
    "destination": "Paris",
    "numDays": 7,
    "startDate": "2025-06-15"
  }'

📊 Sample Output

{
  "destination": "Paris",
  "numDays": 7,
  "startDate": "2025-06-15",
  "itinerary": "Day 1: Arrival and Eiffel Tower...\nDay 2: Louvre Museum and Seine River Cruise...",
  "icsFileUrl": "https://api.apify.com/v2/key-value-stores/..."
}

Plus a downloadable travel_itinerary.ics file ready to import!

💡 Perfect For

Use Case	Why It Helps
Vacation Planning	Skip the research rabbit hole
Business Trips	Efficient schedules between meetings
Weekend Getaways	Maximize short trips
Travel Research	Get curated recommendations fast
Group Travel	Share ICS files with companions

💰 Pricing

Pay-per-event pricing:

Actor Start: $0.00005
Itinerary Generated: $0.025 per trip
Dataset Item: $0.01 per output

Total cost per run: ~$0.03-0.04

Try it free — Apify includes credits for new users!

🔧 Technical Specs

AI Model: Mistral Large (latest)
Runtime: Python 3.14
Search: Google SERP Scraper (built-in)
Output: JSON + ICS calendar file
Duration: 1-30 days supported

🌟 Example Use Cases

The Spontaneous Traveler

"I decided to visit Kyoto next week. Used AI Travel Planner and had a complete 5-day itinerary with temple visits, food recommendations, and tea ceremonies in under a minute."

The Busy Professional

"Business trip to London with one free day. Got a perfectly optimized itinerary balancing work meetings with must-see sights."

The Group Planner

"Planning a family trip to Italy. Generated the itinerary, exported to ICS, and shared with everyone. No more 'what are we doing tomorrow?' questions!"

🗺️ Try It Now

Where's your next adventure?

🔗 Try AI Travel Planner for Free

Built with ❤️ by @akash9078 on the Apify platform.

What's your dream destination? Let me know in the comments! 👇

Note: AI-generated itineraries are recommendations. Always verify opening hours, prices, and availability before traveling.

🚀 Introducing AI Codebase Analyst: Understand Any GitHub Repository in Under 60 Seconds

Akash Kumar Naik — Sun, 15 Mar 2026 04:15:48 +0000

🚀 AI Codebase Analyst: Understand Any GitHub Repository in Under 60 Seconds

Ever spent hours digging through a new GitHub repository just to understand what it does, how to install it, and whether it's worth using? I've been there too.

That's exactly why I built AI Codebase Analyst — an AI-powered tool that transforms any public GitHub repository into structured, actionable intelligence in under 60 seconds.

🎯 The Problem We're Solving

Understanding a new codebase traditionally requires:

⏱️ Hours reading documentation
🔍 Manually exploring file structures
🤔 Constant context-switching between files
⚠️ Missing critical dependency information

AI Codebase Analyst eliminates all of that.

✨ What It Does

Just provide a GitHub repo in owner/repo format (e.g., QwenLM/Qwen-Agent), and the tool automatically generates:

📖 README Extraction

Full content extraction from README.md, README.rst, or README.txt files — no more clicking back and forth.

❓ AI-Powered Q&A

Generates 15+ intelligent questions and answers covering:

What the project does
How to install it
Key features and usage
Architecture overview
Configuration options

📦 Dependency Analysis

Extracts and categorizes dependencies from:

package.json (Node.js)
requirements.txt / pyproject.toml / setup.py (Python)
Cargo.toml (Rust)
go.mod (Go)

🗂️ File Structure Mapping

Discovers repository structure up to 3 levels deep, giving you a clear picture of how the codebase is organized.

🔑 Key File Extraction

Automatically retrieves:

LICENSE files
Dockerfiles
Configuration files
Core source files

💡 Perfect For

Use Case	Who Benefits
Quick Onboarding	Developers joining new projects
Dependency Research	Engineers evaluating libraries
Code Review	Teams assessing third-party code
RAG Pipelines	AI/ML engineers building vector stores
AI Agents	Developers giving agents repo context
Security Audits	Teams analyzing dependencies
Due Diligence	Technical leads evaluating open-source

🚀 How to Use It

Option 1: Apify Console (No Code)

Visit AI Codebase Analyst on Apify
Enter the repository (e.g., microsoft/vscode)
Click Run → Results in 60 seconds

Option 2: API Integration

const { ApifyClient } = require('apify-client');

const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });

const result = await client
  .actor('akash9078/ai-codebase-analyst')
  .call({
    githubRepo: 'QwenLM/Qwen-Agent',
    maxFiles: 50,
  });

console.log(result.data);

Option 3: cURL

curl -X POST \
  https://api.apify.com/v2/acts/akash9078~ai-codebase-analyst/runs?token=YOUR_API_TOKEN \
  -H 'Content-Type: application/json' \
  -d '{"githubRepo": "QwenLM/Qwen-Agent", "maxFiles": 50}'

📊 Sample Output

{
  "repository": {
    "name": "QwenLM/Qwen-Agent",
    "description": "Agent framework for Qwen models",
    "stars": 15000,
    "language": "Python",
    "license": "Apache-2.0"
  },
  "readme": {
    "content": "Full README content...",
    "length": 15121
  },
  "structure": [
    "LICENSE",
    "README.md", 
    "setup.py",
    "qwen_agent/agent.py"
  ],
  "dependencies": [
    "dashscope",
    "json5",
    "openai",
    "pydantic"
  ],
  "qna": [
    {
      "question": "What is this project?",
      "answer": "Qwen-Agent is a framework for developing LLM applications..."
    },
    {
      "question": "How do I install it?",
      "answer": "pip install -U qwen-agent[gui,rag,code_interpreter]"
    }
  ]
}

💰 Pricing

Pay-per-event pricing starting from $0.00005 per run:

REPO_PROCESSED: One-time charge per repository
QNA_GENERATED: Per Q&A pair generated (~15-20 per repo)

Try it for free — your first runs include Apify's free tier credits.

🔮 What's Next

Planned features on the roadmap:

🔒 Private repository support
🤖 Custom LLM provider integration
📊 Code complexity metrics
🔄 Automated scheduled analysis

🤝 Try It & Share Feedback

I'd love to hear how you're using AI Codebase Analyst! Whether you're:

Building RAG pipelines
Onboarding to new projects
Creating AI agents that understand code
Doing security audits

Drop a comment below with your use case, or open an issue on Apify if you have feature requests.

🔗 Try AI Codebase Analyst Now

Built with ❤️ by @akash9078 on the Apify platform.

What's the first repository you'd analyze? Let me know in the comments! 👇

Introducing the TikTok Trending Hashtags Scraper – Powered by Apify!

Akash Kumar Naik — Fri, 13 Mar 2026 16:14:10 +0000

🚀 Introducing the TikTok Trending Hashtags Scraper – Powered by Apify! 🚀

Are you building the next big social‑media analytics tool or a content‑curation platform?

Our TikTok Trending Hashtags Scraper gives you instant, reliable access to the hottest hashtags on TikTok—right when they start to trend.

Why Y Combinator founders will love it

✅ Feature	🎯 Benefit
Zero‑code deployment	Spin up a cloud‑run scraper in minutes—no ops overhead.
Real‑time data	Pull the latest trending hashtags every 5 minutes, perfect for live dashboards.
Scalable & reliable	Built on Apify’s robust infrastructure; handles millions of requests without throttling.
JSON output	Ready‑to‑consume for ML pipelines, BI tools, or simple API calls.
Cost‑effective	Pay‑as‑you‑go pricing keeps your burn rate low while you validate ideas fast.
Open‑source SDK	Extend or customize the scraper with JavaScript/Node.js in seconds.

How it works

Select a TikTok region (US, EU, Asia, etc.)
Set a schedule – every 5 min, hourly, or on‑demand.
Run the actor – Apify crawls TikTok’s discover page, extracts hashtag names, post counts, and engagement metrics.
Receive clean JSON – feed it directly into your recommendation engine, trend‑monitoring dashboard, or ad‑targeting model.

Real‑world use cases

Trend‑driven content recommendation for media apps.
Competitive intelligence for brands tracking hashtag performance.
Data‑driven marketing – identify emerging topics before they go viral.
Academic research on meme propagation and cultural diffusion.

Get started in 2 minutes

Click “Run” on the Apify page.
Choose your region and schedule.
Grab the API endpoint and start pulling data.

Ready to turn TikTok trends into actionable insights?

Add the scraper to your tech stack today and stay ahead of the curve—just like the most successful Y Combinator startups do.

I built a YouTube Transcript Extractor API for AI and automation workflows

Akash Kumar Naik — Sat, 07 Mar 2026 03:21:51 +0000

I built a tool on Apify called YouTube Transcript Extractor that pulls transcripts directly from YouTube videos and returns them as structured JSON.

It’s designed for developers building AI tools, RAG pipelines, or content analysis systems.

What it does:

Extract transcripts from any YouTube video with captions
Return clean structured data
Language selection support
Easy API integration

Example uses:

AI summarization tools
LLM training datasets
Video content analysis
Converting videos into blog posts or datasets

If anyone is building automation or AI tools around YouTube content, I’d love feedback.

Learn More

DEV Community: Akash Kumar Naik

🛒 Amazon Product Scraper: Extract Prices, Reviews & Images at Scale

🌟 What Makes This Different?

🎯 Who Is This For?

🚀 Getting Started

Quick Start (No-Code)

Example Input

📊 Output Format

💰 Transparent Pricing

🛡️ Best Practices for Success

Recommended Settings:

Avoiding Blocks:

💻 API Integration

cURL Example

JavaScript/Node.js

📈 Use Cases

🔧 Technical Specifications

🆘 Troubleshooting

📝 Data Compliance

🎉 Try It Now!

webscraping #ecommerce #automation #productivity

🌫️ Air Quality Index API: Real-Time AQI

🌫️ Air Quality Index API: Real-Time AQI Data + AI Health Recommendations

✨ What You Get

📊 Real-Time AQI & Pollution Metrics

🧠 AI-Powered Health Recommendations

🎯 Perfect For

🚀 How to Use It

Option 1: Apify Console (No-Code)

Option 2: API Integration

📊 Sample Output

💰 Transparent Pricing

🔧 Technical Details

🌍 Real-World Use Cases

The Fitness App Developer

The Travel Planner

The Asthma Management App

⚠️ Important Notes

🌱 Why Air Quality Matters

🔗 Try It Now

🌍 AI Travel Planner: Generate Personalized Itineraries with AI-Powered Research

✨ What It Does

🧠 AI-Powered Planning

🔍 Built-in Web Research

📅 Calendar Export

🚀 How to Use It

Option 1: Apify Console (No-Code)

Option 2: API Integration

📊 Sample Output

💡 Perfect For

💰 Pricing

🔧 Technical Specs

🌟 Example Use Cases

The Spontaneous Traveler

The Busy Professional

The Group Planner

🗺️ Try It Now

🚀 Introducing AI Codebase Analyst: Understand Any GitHub Repository in Under 60 Seconds

🚀 AI Codebase Analyst: Understand Any GitHub Repository in Under 60 Seconds

🎯 The Problem We're Solving

✨ What It Does

📖 README Extraction

❓ AI-Powered Q&A

📦 Dependency Analysis

🗂️ File Structure Mapping

🔑 Key File Extraction

💡 Perfect For

🚀 How to Use It

Option 1: Apify Console (No Code)

Option 2: API Integration

Option 3: cURL

📊 Sample Output

💰 Pricing

🔮 What's Next

🤝 Try It & Share Feedback

Introducing the TikTok Trending Hashtags Scraper – Powered by Apify!

Why Y Combinator founders will love it

How it works

Real‑world use cases

Get started in 2 minutes

Why Y Combinator founders will love it

Get started in 2 minutes