DEV Community

Crawler Bros
Crawler Bros

Posted on

How to Scrape Target Product Data, Prices, and Stock Levels

#ecommerce #scraping #automation #retail

The Challenge of Monitoring Competitor Catalogs on Target

E-commerce analysts, retail brand managers, and market researchers frequently need structured data from major retailers like Target. Tracking promotional discounts, stock status, customer review counts, and fulfillment options across product categories helps teams benchmark prices and monitor competitive trends.

Manually checking Target.com pages or building custom scrapers from scratch presents significant obstacles. Target's product endpoints are geo-restricted to US IP addresses, product page layouts change, and identifying specific items requires handling Target Corporation Item Numbers (TCINs).

The target-scraper (Target Product Scraper) actor on Apify solves this by pulling structured data directly via Target's RedSky API without requiring custom authentication or manual proxy configuration.

How the Target Product Scraper Works

The Target Product Scraper extracts product details across five flexible modes:

  • search: Queries products by keyword, matching Target's main search landing page results.
  • byTcin: Fetches exact items using an array of Target product IDs (TCINs).
  • byCategory: Browses top-level departments such as electronics, kitchen, beauty, or toys.
  • byUrl: Parses a direct Target product detail page URL or search URL.
  • deals: Retrieves currently trending deals.

Because Target geo-restricts its product API to US IP addresses, the actor automatically handles requests using US residential proxies. Users must be on an Apify Starter plan or above to provide the required residential proxy access. No API keys or Target account credentials are required.

Structured Output Fields

The actor returns clean datasets where empty fields are omitted. Each product record contains comprehensive product, pricing, and fulfillment details, including:

  • Identifiers & Core Data: tcin, title, brand, description, itemType, productUrl, recordType ("product"), and siteName ("Target").
  • Price & Discounts: price (current selling price in USD), originalPrice, isOnSale (boolean), saleSavings, and promotions (active promotional label texts).
  • Customer Feedback: rating (0–5 average rating), ratingCount, and questionCount.
  • Fulfillment & Stock: availability (IN_STOCK, LIMITED_STOCK, or OUT_OF_STOCK), along with a fulfillment object detailing boolean flags for shipping, pickup, and sameDay.
  • Media & Metadata: primaryImageUrl, additionalImages, and the scrapedAt ISO-8601 timestamp.

Key Filtering Parameters

You can fine-tune your dataset before extracting records to save processing time and keep data focused:

  • onSaleOnly: A boolean toggle that filters out full-price items and only emits products currently on sale.
  • inStockOnly: When set to true, limits output strictly to items with IN_STOCK availability.
  • minPrice and maxPrice: Numerical boundaries to filter out products above or below target price points.
  • minRating: A numerical filter (0.0 to 5.0) to extract only highly rated products.
  • maxItems: Sets a hard cap on returned products between 1 and 500 records per run.

Step-by-Step: How to Scrape Target Products

Setting up a data extraction task with the Target Product Scraper requires just a few basic steps.

Step 1: Select Your Operating Mode

Choose the mode that fits your workflow. For broad market research, select search or byCategory. For monitoring specific product lists, choose byTcin.

Step 2: Configure Your Search or Target Parameters

Enter the necessary search or targeting criteria based on your mode:

  • For mode: "search", provide a search term in query (e.g., query: "bluetooth headphones").
  • For mode: "byCategory", choose a supported category name like electronics, home, health, or sports-outdoors.
  • For mode: "byTcin", provide an array of numeric TCIN strings in tcins (e.g., tcins: ["84512345", "12345678"]).
  • For mode: "byUrl", paste a full URL into the url field.

Step 3: Apply Filters and Limits

Set optional filters to refine your data collection:

  • Toggle inStockOnly to true to skip out-of-stock items.
  • Define minRating: 4.0 to focus on top-rated products.
  • Set maxItems up to 500 to define the maximum record count for the run.

Step 4: Run the Actor and Export Data

Start the run in the Apify Console. Once complete, you can download your dataset in formats like JSON, CSV, Excel, or access it programmatically via API integrations for reporting and analytics.

Ready to try it yourself? Run *Target Product Scraper** on the Apify Store -- no setup required.*

Top comments (0)