DEV Community

Crawler Bros
Crawler Bros

Posted on

How to Scrape Amazon Brand Stores for Competitor Research

Auditing Competitor Merchandising on Amazon Brand Stores

Amazon Brand Stores (/stores/{Brand}/page/{ID}) serve as dedicated, editorial storefronts where brands showcase their top products, promotional campaigns, and creative assets. For e-commerce analysts, marketers, and brand managers, monitoring competitor storefronts is vital for tracking seasonal merchandising, copy changes, featured deal collections, and product positioning.

However, extracting structured data from Brand Stores presents specific challenges. Unlike standard Amazon search result grids, Brand Stores use multi-page navigation menus, custom banners, video modules, and editorial product tiles. Manually auditing dozens of subpages across multiple competitors is time-consuming and prone to gaps.

The amazon-brand-store-scraper Actor on Apify solves this by automating the discovery, crawling, and extraction of Amazon Brand Store pages, creative elements, and featured products.

How the Amazon Brand Store Scraper Works

The Actor crawls public Amazon Brand Store pages without requiring user accounts or cookies. It handles the dynamic architecture of Amazon storefronts and extracts data into clean, structured records.

Comprehensive Navigation and Subpage Crawling

Brand Stores often contain multi-tiered category navigation—such as Home, Featured Deals, Soundbars, or Accessories. When crawlSubpages is set to true, the Actor follows the store's internal navigation menu. You can control the depth of navigation-link hops using maxDepth and set a hard limit on total pages fetched via maxPages.

Automatic Store Resolution via ASIN or Product URL

If you do not have the direct Brand Store URL, you do not need to hunt for it manually. You can pass product URLs via productUrls or standard ASINs via asins. The Actor visits the product listing, locates the "Visit the {Brand} Store" link, and automatically crawls the corresponding store.

Multi-Type Structured Output

The Actor categorizes extracted data into distinct record types:

  • storePage: Captures store metadata, page name, meta description, logo URL, position, depth, and the full navigation[] structure.
  • product: Details every /dp/{ASIN} link visible on the page, capturing asin, title, url, thumbnailImage, and contextual attributes like price, listPrice, stars, reviewsCount, badge (such as BestSeller or LimitedTimeDeal), and discountPercent whenever they are rendered near the link.
  • asset: When includeAssets is enabled, the Actor emits module-level data for banners and videos, including moduleType (image or video), heading, bodyText, ctaText, imageUrl, videoUrl, and non-product destinationUrl targets.
  • storePageError: If a page cannot be accessed due to Amazon rate limits, blocks, or missing pages, the Actor emits an explicit error record with pageClassification (such as NOT_FOUND or DOG_PAGE_503) rather than silently returning an empty dataset.

How to Scrape an Amazon Brand Store: Step-by-Step

Follow these steps to set up and run the scraper using the Apify Console or API:

Step 1: Define Target Stores or Products

Gather your target inputs. You can provide direct Brand Store URLs, product URLs, or ASINs:

  • Store URL example: https://www.amazon.com/stores/soundcore/page/AD6AD8C0-90C7-4C65-8000-0AC741FA2633
  • ASIN example: B09X7MPX8L

Step 2: Configure Scraper Parameters

Set your crawl depth and asset extraction preferences in the Actor input:

  • Set crawlSubpages to true to capture all sub-categories.
  • Configure maxDepth (e.g., 2) and maxPages (e.g., 15) to control crawl breadth.
  • Set includeAssets to true if you need copy, banner images, and video assets for creative audits.
  • Use maxProducts to define a hard cap on emitted product records per store.

Step 3: Run the Actor and Export Data

Execute the run. The Actor uses Apify proxy configuration (starting with datacenter proxies and escalating to residential if repeated blocks occur) to fetch the data. Once complete, export your datasets in JSON, CSV, or Excel formats.

Key Applications for Brand Store Scraping

Competitive Creative and Copy Audits

By reviewing asset records, marketing teams can monitor competitor taglines, call-to-action text (ctaText), and visual themes across different product lines. This makes it straightforward to detect when a rival launches a new campaign or updates their seasonal branding.

Featured Product and Merchandising Mix Analysis

Because a Brand Store represents an editorially curated catalog rather than an exhaustive SKU list, analyzing product records highlights the specific products a brand chooses to spotlight. Tracking these selections over time reveals which items competitors prioritize for deal events and cross-selling.

Navigation and Category Benchmarking

Examining the navigation[] array inside storePage records helps e-commerce teams benchmark how leading brands structure their Amazon storefronts, helping you design more intuitive navigation paths for your own brand.


Ready to try it yourself? Run *Amazon Brand Store Scraper** on the Apify Store -- no setup required.*

Top comments (0)