DEV Community

Ankit Prajapati
Ankit Prajapati

Posted on

Measuring AI Search Visibility Like a Developer: GA4 Segments, Prompt Suites and Tracker APIs

#seoanalyticswebdevai

If you build or maintain sites for clients, sooner or later someone asks: "Are we showing up in ChatGPT?" Here's a lightweight, data-first way to answer that, plus what to look for if you want the numbers in your own dashboards.

Step 1: Segment AI referral traffic in GA4

AI trackers report mentions, but they don't report visits. Visits live in GA4. Create a custom segment or exploration that filters session source on AI assistant referrers such as:

chat.openai.com
perplexity.ai
gemini.google.com
Enter fullscreen mode Exit fullscreen mode

Save it as "AI referral traffic" and watch the trend month over month. It's free, and it gives you the outcome metric that sits alongside any mention data.

Step 2: Build a prompt set like a test suite

Treat prompts like test cases. Write 15 to 25 conversational prompts in three groups:

  • Direct comparison: "X vs Y for small teams"
  • Category recommendation: "best X for agencies"
  • Problem-based: "how do I fix X"

Run them against ChatGPT, Gemini, Perplexity and Google AI Overviews or AI Mode. AI output varies between runs, so a single run is noisy. Repeat on a schedule and compare rates, not one-off results.

Step 3: If you buy a tracker, check the data path first

For developers, export and API matter more than the dashboard. From the tools I compared:

Need Options
Full API + CSV/JSON export Profound (Enterprise)
API + CSV at a low price LLMrefs ($79/month, 500 prompts)
API on a lightweight tool AmIOnAI
CSV only Semrush (10 CSV exports a day)

Also ask how the tool collects data, whether through live APIs or simulated browser sessions, because that affects how closely it matches what real users see.

Step 4: Validate before trusting

Run 5 to 10 prompts manually, then run the same prompts in two trial tools. If a tool disagrees with your manual results on most prompts, don't pipe its data anywhere.

I've written up the full comparison, including engine coverage and prompt limits for each tool, in my guide to AI visibility trackers with API and export options.

Written by Ankit Prajapati, SEO & GEO consultant.

Top comments (0)