DEV Community

Web Obsidians
Web Obsidians

Posted on

How to Scrape Shopify App Store Reviews with Python (Ratings, Dates and Developer Replies)

Shopify App Store reviews are one of the most honest sources of product feedback in e-commerce. Merchants say exactly what broke, what they love, and why they left, and developers answer in public. There is no official API for these reviews, but the review pages on apps.shopify.com are public and need no login. This post shows two ways to collect them: a short Python script, and a no-code option for when you need many apps, a schedule or a clean export.

Option 1: the public review pages in Python

Every app has a review page at https://apps.shopify.com/<app-handle>/reviews. Add sort_by=newest and page=N and you get 10 reviews per page, newest first. Each review is an element with a data-review-content-id attribute, and the app's overall rating sits in the page's JSON-LD.

import json
import re
import time
import urllib.request

from bs4 import BeautifulSoup  # pip install beautifulsoup4

BASE = "https://apps.shopify.com/"
HEADERS = {"User-Agent": "Mozilla/5.0", "Accept-Language": "en-US,en;q=0.9"}
UI_WORDS = {"Show more", "Show less", "Translate", "Show original"}
DATE = re.compile(r"^(Edited )?[A-Z][a-z]+ \d{1,2}, \d{4}$")


def fetch(path):
    req = urllib.request.Request(BASE + path, headers=HEADERS)
    with urllib.request.urlopen(req) as r:
        return r.read().decode("utf-8")


def texts(node):
    found = (" ".join(t.split()) for t in node.stripped_strings) if node else []
    return [t for t in found if t and t not in UI_WORDS]


def app_summary(html):
    for raw in re.findall(r'<script type="application/ld\+json">(.*?)</script>', html, re.S):
        data = json.loads(raw)
        if isinstance(data, dict) and data.get("@type") == "SoftwareApplication":
            rating = data.get("aggregateRating") or {}
            return {"name": data.get("name"), "rating": rating.get("ratingValue"), "reviews": rating.get("ratingCount")}


def reviews(app, max_pages=3):
    out = []
    for page in range(1, max_pages + 1):
        html = fetch(f"{app}/reviews?sort_by=newest&page={page}")
        if page == 1:
            print(app_summary(html))
        blocks = BeautifulSoup(html, "html.parser").select("[data-review-content-id]")
        for b in blocks:
            stars = b.select_one('[aria-label$="out of 5 stars"]')
            body = texts(b.select_one(".tw-order-2"))
            side = texts(b.select_one(".tw-order-1"))
            reply = texts(b.select_one(".tw-order-last"))
            date = body.pop(0) if body and DATE.match(body[0]) else None
            out.append({
                "id": b["data-review-content-id"],
                "rating": int(stars["aria-label"][0]) if stars else None,
                "date": date,
                "text": "\n".join(body) or None,
                "store": side[0] if side else None,
                "country": side[1] if len(side) > 1 and "using the app" not in side[1] else None,
                "reply": "\n".join(reply[1:]) if reply and " replied " in reply[0] else None,
            })
        if len(blocks) < 10:
            break
        time.sleep(1)
    return out


for r in reviews("klaviyo-email-marketing", max_pages=2):
    print(r["date"], r["rating"], "stars |", r["store"], "|", (r["text"] or "(no text)")[:50].replace("\n", " "))
Enter fullscreen mode Exit fullscreen mode

A few things worth knowing before you build on it:

  • Star-only reviews are common. Many merchants leave a rating without writing anything, so expect text to be empty.
  • The developer's reply sits inside the same review block. Its first line reads " replied ", and the reply text follows.
  • The overall rating and review count come from the SoftwareApplication JSON-LD on the page, not from counting reviews yourself.
  • A handle that does not exist answers 404, so check the handle before you loop over pages.
  • Class names like tw-order-2 are styling classes and can change with a redesign. data-review-content-id is the stable anchor; if parsing breaks, start there.
  • Big apps have tens of thousands of reviews. Pause between pages and stop as soon as you reach the dates you already have.

For a quick look at one app, this script is all you need.

Option 2: a ready-made Actor for many apps and monitoring

Once you track several competitors, want only the 1 and 2 star reviews, need a date range, or want "only reviews I have not seen yet" every morning, the plumbing grows: paging, retries on busy answers, star and date filters, and remembering what you already returned.

I packaged all of that as an Apify Actor: Shopify App Store Reviews Scraper. You paste app handles or links and get one clean row per review:

{
  "app": "klaviyo-email-marketing",
  "appName": "Klaviyo: Email Marketing & SMS",
  "reviewId": "2435048",
  "rating": 1,
  "date": "2026-11-19",
  "text": "logo wat jullie maken voor me email klopt niet met mijn chelsys.nl",
  "storeName": "chelsy's",
  "country": "Netherlands",
  "usageDuration": "1 day using the app",
  "developerReply": "Hallo, bedankt dat u uw feedback met ons deelt. ...",
  "developerReplyDate": "2026-11-20",
  "url": "https://apps.shopify.com/klaviyo-email-marketing/reviews/2435048"
}
Enter fullscreen mode Exit fullscreen mode

What it adds on top of the script above:

  • Many apps in one run, by handle or by link
  • Star filters (for example only 1 and 2 star reviews) and a date range
  • Return only new reviews: schedule it every day and each run returns only reviews that earlier runs did not return
  • The app's name, average rating and total number of reviews, saved for every app
  • Export to JSON, CSV or Excel, or send each new review to Slack, Google Sheets or a webhook with Apify integrations

You can also call it from code with the Apify client:

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("webobsidians/shopify-app-store-reviews-scraper").call(
    run_input={"apps": ["klaviyo-email-marketing"], "maxReviewsPerApp": 20, "ratings": ["1", "2"]}
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["date"], item["rating"], item["storeName"], item["text"])
Enter fullscreen mode Exit fullscreen mode

It costs $1.00 per 1,000 reviews plus $0.00005 per run start, and Apify's free plan includes monthly credit, so small jobs cost nothing to try.

Which one should you use?

  • One app, once: the Python script.
  • Several apps, only the complaints, on a schedule, or for a teammate who wants a spreadsheet: the Actor.

Either way, you are reading reviews that Shopify shows to anyone, so keep request rates reasonable.

Top comments (0)