DEV Community

Aageno AI
Aageno AI

Posted on • Edited on

From GSC/GA4 to Optimization Tasks: How to Build a Content Growth Diagnostic System

In recent years, one shift has become increasingly obvious: content operations are moving from a traffic mindset to a growth mindset.

As AI search and content distribution become more complex, simply doing SEO, publishing content, and tracking impressions or clicks is no longer enough. Content teams are now expected to understand the full user journey: how users arrive, why they stay, why they fail to convert, and what should be optimized at each step.

In other words, content roles are gradually evolving from content executors into participants and even designers of growth systems.

This has become very clear to me while working on content growth projects.

Metrics such as impressions, clicks, rankings, indexing status, and article volume still matter. But the real driver of outcomes is not whether a site has more content. It is whether existing content successfully connects search demand with business action.

This is especially true for B2B SaaS, independent websites, e-commerce sites, and manufacturing websites. Many pages are not completely without traffic. Instead, traffic arrives and then fails to move further down the funnel. Users enter through search, but the page does not properly receive their intent. Users read the article, but do not see a CTA. Users click a CTA, but do not reach a key event.

The issue is not a lack of data. The issue is the absence of a decision-making chain that connects:

Search demand → Page intent matching → User behavior → Business action → Optimization task → Performance feedback

To solve this, we built an internal content growth diagnostic system and have validated it across multiple independent websites in e-commerce, manufacturing, consumer electronics, and AI SaaS.

This system is not a standard SEO report. It is also not a tool that simply asks AI to generate generic optimization suggestions. Instead, it connects GSC, GA4, the brand knowledge base, AI referrals, and AI crawler logs into a page-level diagnostic workflow.

It helps teams answer the following questions:

  1. Which queries and intents bring users to a page?
  2. Does the page properly match and satisfy that intent?
  3. After users land on the page, do they read, see CTAs, and click?
  4. Is the product information on the page accurate?
  5. Do AI products bring visits, and can AI crawlers access the page?
  6. How can the evidence be converted into an actionable optimization task?
  7. Which metrics should be tracked after the page is updated?

The overall data flow works like this:

First, data is connected. Then data from different sources is aligned to the same URL. Query clusters are used to identify search intent. Page DOM analysis is used to determine whether the content satisfies that intent. GSC and GA4 funnel data are combined to identify where users drop off. The brand knowledge base is used to verify content facts. AI/GEO signals are used to evaluate AI referral traffic and crawler accessibility. Finally, all evidence is converted into optimization tasks, and performance is continuously tracked after updates go live.

System overview diagram

Below is a walkthrough of the full workflow.


1. Data Ingestion: Put Search, Behavior, Facts, and AI Signals Into One Chain

The first layer is data ingestion. We mainly connect five types of data:

  • Google Search Console, or GSC
  • Google Analytics 4, or GA4
  • Brand knowledge base
  • AI referral sessions
  • AI crawler logs

1.1 GSC and GA4

GSC is responsible for search-side performance. It provides impressions, clicks, CTR, average position, and detailed query-level performance.

Through GSC, the system can identify which queries help users discover a page, and which pages still receive impressions but are starting to lose click-through rate.

GA4 is responsible for on-site behavior. It provides organic search landing sessions, engagement rate, scroll behavior, CTA impressions, CTA clicks, sign-ups, and key events.

Through GA4, the system can determine whether users continue reading after they land on the page, whether they see product entry points, whether they click CTAs, and whether they enter business-critical actions.

GSC and GA4 only become powerful when they are used together.

If we only look at GSC, we can only see what happens in search results. If we only look at GA4, we can only see what happens after users enter the site. When the two are connected, the system can identify exactly where an article is stuck.

For example:

  1. High impressions but low CTR

    Prioritize the title, meta description, and search result relevance.

  2. High clicks but low engagement

    Prioritize the opening section, table of contents, page structure, and content-intent match.

  3. Good engagement but low CTA clicks

    Prioritize product modules, CTA copy, and CTA placement.

  4. CTA clicks exist but key events remain low

    Continue checking the registration path, demo path, or landing page flow.

1.2 Brand Knowledge Base

The brand knowledge base is responsible for product fact verification.

Teams can sync the latest product features, pricing plans, screenshot versions, brand messaging, competitor comparison standards, FAQ answers, and important product updates into the knowledge base.

The system then compares page content against the knowledge base to determine whether product information in an article has become outdated.

The purpose of this module is to give the LLM a current, unified, and trustworthy source of product facts.

Without a brand knowledge base, the system can only infer whether content may be outdated based on publication date, year-related wording, screenshots, or SERP freshness. After the knowledge base is connected, the system can generate much more specific tasks, such as:

  • Replace outdated product screenshots
  • Correct pricing plan descriptions
  • Rewrite competitor comparison tables
  • Sync the latest FAQ answers

1.3 AI Referrals and AI Crawler Logs

AI/GEO data is split into two categories:

  • AI referral sessions
  • AI crawler logs

AI referral sessions come from GA4. They show whether products such as ChatGPT or Perplexity bring real visits to the website, and whether those visits generate engagement or key events.

AI crawler logs come from server logs, Cloudflare, CDN logs, or edge logs. They show whether crawlers such as GPTBot, PerplexityBot, and ClaudeBot have accessed a page, whether the status code is normal, and whether access is affected by robots rules, WAF, CDN configuration, or missing logs.

This distinction is important:

AI crawlers are not GA4 traffic sources.

GA4 is suitable for measuring referral sessions from AI products. Crawler access must be checked through logs.

A page may have been crawled by GPTBot but have no ChatGPT referral sessions. Another page may already have Perplexity referral traffic, but incomplete crawler logs. Only when both signals are reviewed together can the team determine whether a page needs more quotable content or whether technical accessibility should be checked first.


2. Data Processing: Align URLs First, Then Build Page-Level Evidence

After the data is connected, the system does not immediately generate suggestions. It first processes the data.

The goal of the processing layer is to turn scattered data into page-level evidence.

2.1 URL-Level Data Alignment

The first step is URL alignment.

GSC, GA4, and server logs often record page addresses differently.

For example, the same article may appear in GSC as a full URL, in GA4 with tracking parameters, and in server logs as only a page path. If the system does not standardize these addresses first, the same article will be split into multiple records: search clicks in one place, on-site sessions in another, CTA clicks elsewhere, and crawler access in yet another location.

Therefore, the system first cleans page addresses by removing UTM parameters, ad click parameters, page anchors, and other elements that do not change the page content itself. It then maps the same article to one canonical page URL.

Only after this step can impressions, clicks, sessions, CTAs, key events, and AI crawler records be correctly attributed to the same article.

2.2 Query Clustering

A query cluster means grouping similar search queries based on user intent.

GSC often contains a large number of fragmented queries. If the content team looks at these queries one by one, it is difficult to understand what users are actually trying to accomplish.

The system groups queries by search intent and labels them with intent types, such as:

  • Definition intent
  • Tool-selection intent
  • Comparison intent
  • Commercial intent
  • Pricing intent
  • Support intent
  • Navigational intent

In the future, this can also be mapped to user intent in AI marketing and AI search scenarios.

This changes the team’s view from thousands of scattered keywords to a smaller number of user needs.

It is also important to clarify the boundary of this feature:

This is not precise query-to-conversion attribution.

The system does not pretend to know that one specific query directly caused one specific sign-up. Instead, it solves the problem of search intent and content matching: which user needs bring people to the page, and whether the page has corresponding content to receive those needs.

2.3 Page DOM Parsing

The third step is page DOM parsing.

The system crawls and analyzes the page structure, including:

  • Title
  • H1
  • H2
  • H3
  • FAQ sections
  • Tables
  • CTAs
  • Internal links
  • Body content snippets

It then determines whether each query cluster has a corresponding content position on the page.

For example, if users search for tool comparison queries but the page only explains concepts, with no tool selection criteria, comparison table, or use cases, the system can identify weak intent matching.

2.4 Data Quality Assessment

Not all data is suitable for automatic task generation.

The system also checks whether:

  • GSC data is missing
  • GA4 data is missing
  • URLs are correctly matched
  • Sample size is sufficient
  • Event tracking is complete
  • The brand knowledge base is available
  • AI crawler logs are connected

Data quality directly determines what the system is allowed to do:

Data Quality System Behavior
High Generate task drafts
Medium Generate tasks only after manual confirmation
Low Show diagnostics only, without automatic task generation
Invalid Do not judge or generate tasks

This step is critical.

A content diagnostic system should not only know how to generate recommendations. It should also know when the evidence is insufficient and automation should not be used.


3. Diagnostic Loop: From Search Demand to Page Matching, User Behavior, and Business Action

After data processing is complete, the system enters the diagnostic layer.

3.1 Search Side: Which Queries and Intents Bring Users In?

The system first reviews GSC queries and query clusters.

For the same AI visibility-related page, user intent may vary significantly:

  • “What is AI visibility?” indicates conceptual understanding.
  • “Best AI visibility tools for SaaS” indicates tool selection.
  • “Compare GEO monitoring platforms” indicates solution comparison.
  • “Track brand mentions in ChatGPT” indicates a specific workflow.

If a page previously served mainly definition-based queries, but new impressions now come from tool-selection, comparison, or workflow queries, the system identifies that user demand has changed.

This step answers one question:

What task is the user trying to complete when entering the page?

3.2 Page Side: Does the Page Match the User’s Search Intent?

After query clusters are identified, the system analyzes the page DOM.

Different intents require different content structures:

Intent Type Content Needed
Definition intent Clear definition, explanation, and FAQ
Tool-selection intent Tool list, selection criteria, use cases, and CTA
Comparison intent Tables, pricing, differences, and use cases
Workflow intent Steps, metrics, templates, and common mistakes
Commercial intent Product modules, case studies, CTA, and next-step path

The system checks whether these elements appear in the Title, H1, H2, FAQ, tables, CTAs, or whether they are missing entirely.

If a query cluster has search impressions but the page covers that need only shallowly, the system marks it as a content gap, a new query opportunity, or weak search intent matching.

This step answers:

Did the page properly receive and satisfy the user’s need?

3.3 Behavior Side: Do Users Read, See CTAs, and Click?

Content matching alone is not enough. GA4 behavior data is needed to verify whether users actually continue taking action.

The system builds a page funnel from search exposure to business action.

Page funnel diagram

This is one of the most important perspectives in the diagnostic process because it helps locate where users are stuck.

For example:

  • If users land on the page but engagement is low, the problem may be the opening section, table of contents, content structure, or page loading experience.
  • If users read the page but CTA impressions are low, the CTA may be placed too deep.
  • If CTA impressions are normal but clicks are low, the CTA copy, product module, or user intent may be mismatched.
  • If CTA clicks exist but sign-up clicks, demo clicks, or key events are low, the issue may be in the subsequent registration, demo, or landing page path.

This step answers:

Are users stuck at reading, CTA exposure, CTA click, or business conversion?

3.4 Fact Side: Is the Content Outdated, and Is Product Information Accurate?

For B2B SaaS content, outdated content is not only a matter of publication date.

An article published last year may still be accurate. Another article updated last month may already contain incorrect pricing, features, screenshots, or competitor comparisons.

The brand knowledge base aligns page content with the latest product facts. The system checks whether:

  • Features mentioned on the page still exist
  • Pricing is still current
  • Screenshots are outdated
  • Competitor comparisons follow the current standard
  • FAQ answers are consistent with official answers

This module prevents two common problems:

  1. Old articles continue giving users incorrect product information.
  2. The LLM generates misleading recommendations based on outdated page content.

This step answers:

Are the system’s recommendations based on the latest product facts?

3.5 AI/GEO Side: Can AI Sources Access and Cite the Page?

The AI/GEO module mainly makes two judgments.

First, AI referral sessions show whether AI products bring real visits. For example, the system checks whether ChatGPT, Perplexity, and similar sources bring sessions, and whether those sessions generate engagement or key events.

Second, AI crawler logs show whether AI crawlers can access the page. The system checks whether GPTBot, PerplexityBot, ClaudeBot, and similar crawlers have visited the page, whether they returned 200, 304, 403, or 404, whether there is a blocked reason, and whether logs are missing.

These two signals together determine the next action:

  • If the page has AI referrals but weak conversion, prioritize content matching and CTA optimization.
  • If crawler status is abnormal, prioritize robots rules, WAF, CDN, or log integration checks.
  • If crawler access is normal but the page lacks clear definitions, steps, FAQs, and answer-style summaries, prioritize quotable content.
  • If AI referrals are growing but key events are weak, AI traffic exists, but business-side page matching still needs improvement.

This step answers:

In AI search and LLM citation scenarios, is the problem traffic, content, or technical visibility?


4. Issue Type Identification: Turn Diagnostic Results Into an Operations Queue

After completing the diagnostic steps above, the system assigns each page to a specific issue type.

The value of issue grouping is that content optimization becomes batch operations instead of one-off article editing.

Common issue groups include:

  • Traffic decline
  • CTR decline
  • Weak content or weak search intent matching
  • Old or outdated content
  • Conversion weakness
  • Duplicate or competing pages
  • Missing content opportunities
  • Technical or data issues
  • GEO or AI visibility issues

Issue type identification diagram

The page group does not only display issue names. It also shows:

  • Triggering evidence
  • Page funnel snapshot
  • Main affected query clusters
  • Content positions
  • Data quality
  • Recommended action summary
  • Owner
  • Status

This allows content owners to manage work by issue group every week.

For example:

  • This week: handle CTR decline.
  • Next week: handle weak conversion.
  • The following week: handle outdated content and page cannibalization.

The team no longer randomly edits whichever page looks wrong. Instead, they can move through optimization work by issue type and priority.


5. Task Generation: The System Outputs Optimization Recommendations

Page groups are used for filtering. Single-page diagnostics are used for task generation.

When entering a single-page diagnostic view, the system places all evidence for an article on one page:

  1. Page funnel
  2. Query clusters
  3. Content matching positions
  4. GA4 page behavior
  5. Brand knowledge base verification results
  6. Data quality
  7. Recommended actions

Recommended actions are mainly determined by a combination of evidence types:

Issue type rules
+ Query clusters
+ Page content matching positions
+ GA4 page performance
+ Brand knowledge base verification
+ AI/GEO signals
+ Data quality
Enter fullscreen mode Exit fullscreen mode

Task generation interface

The output is not a vague suggestion like “optimize this article.” It should become a task that clearly explains:

  • Why this page needs to be updated
  • Which part of the page has a problem
  • What should be changed
  • Who should own the task
  • Which metrics should be checked after the update

6. Example: How the Full Diagnostic Chain Works on One Page

Take this page as an example:

https://dageno.ai/en/blog/top-tools-to-track-ai-mentions-in-llms

Step 1: GSC Finds Search Demand

GSC shows that this page is starting to receive impressions from queries related to “AI mention tracking tools.”

If we only look at GSC, we can see that there is search demand, but we still cannot determine whether the page satisfies that demand.

Step 2: Query Clustering Identifies Tool-Selection Intent

The system groups these queries into a tool-selection intent cluster.

This means users are not just trying to understand a concept. They are looking for a category of tools, comparing tool capabilities, and may even be ready to start a trial or purchase process.

Step 3: DOM Analysis Finds Weak Intent Matching

The system parses the page DOM and finds that the opening section and H2 structure still mainly explain the concept.

The page does not provide clear tool selection criteria, comparison dimensions, or use cases.

In other words, the search-side intent has shifted toward tool selection, but the page still behaves like a concept explanation article.

Step 4: GA4 Adds Behavioral Evidence

GA4 shows that the page has relatively high engagement, but low CTA clicks.

This means users are willing to read, but the page does not guide them smoothly toward a product action.

Step 5: The Brand Knowledge Base Verifies Product Facts

The brand knowledge base finds that product screenshots in the page are outdated, and some feature descriptions have not been updated to the latest version.

If this is not corrected, the LLM may continue using outdated product information when generating optimization recommendations.

Step 6: AI Crawler Logs Check Technical Accessibility

AI crawler logs show that GPTBot can crawl the page normally.

This means the priority issue is not technical crawling. The more urgent problems are whether the content is quotable enough, whether product information is accurate, and whether the CTA matches tool-selection users.

Final Task Draft

The system generates a task draft like this:

Page: /blog/top-tools-to-track-ai-mentions-in-llms

Issue Type:
- Weak search intent matching
- Weak conversion
- Outdated content

Triggering Evidence:
- Tool-selection queries have search impressions
- The opening section and H2 structure still focus on concept explanation
- Engagement is high, but CTA clicks are low
- The brand knowledge base finds outdated product screenshots
- GPTBot crawling is normal

Recommended Actions:
- Add a tool selection criteria module
- Add a tool comparison table
- Update product screenshots
- Change the generic sign-up CTA to "View AI Mention Monitoring Solution"
- Add FAQ content
- Add step-by-step content that is easier for LLMs to cite

Metrics to Track After Update:
- CTR
- Organic search sessions
- CTA clicks
- Demo clicks
- Key events
- AI referrals
- Crawler status
Enter fullscreen mode Exit fullscreen mode

In this way, an article moves from “unclear data performance” to a concrete task.

The team knows:

  • Why the article needs to be changed
  • Where the problem is
  • What needs to be updated
  • Who should handle it
  • Which metrics should be reviewed afterward

7. Performance Monitoring and Review

A real content growth loop also needs to feed performance data back into the system after an article is updated.

The current version can already run the main workflow from data ingestion to page diagnosis and task draft generation.

The next stage is to add post-execution performance tracking, connecting each content update with subsequent metric changes.

The system will record:

  • Task generation time
  • Updated modules
  • Launch time
  • Owner
  • Task status
  • Follow-up performance data

This allows teams to evaluate whether each optimization action actually produces results.


8. What Still Needs to Be Built

At this point, the system can already run the main diagnostic chain. However, several capabilities still need to be improved.

8.1 Query Intent Clustering

The current version mainly relies on text similarity and rule-based judgment. In vertical industries, this already covers most common queries.

However, long-tail queries, emerging terms, and queries that are semantically similar but intent-wise different may still be grouped incorrectly.

In the future, the system will combine keyword matching and LLM-based judgment to classify query clusters more accurately.

For low-confidence intent clusters, the system will automatically mark them as “manual confirmation required,” preventing incorrect tasks from being generated when evidence is insufficient.

8.2 Automatic Brand Knowledge Base Updates

The current brand knowledge base is still mainly maintained through manual import. This works well for first centralizing core information such as product features, pricing, screenshots, FAQ answers, and competitor messaging standards.

But in the long run, the knowledge base cannot rely only on manual maintenance.

The next step is to connect product changelogs, CMS data, or internal documentation sources, so that the knowledge base version can update automatically as the product evolves.

This will make outdated content checks less dependent on manual review. The system will also be able to identify outdated features, old screenshots, incorrect pricing, and product descriptions that no longer match the current messaging more quickly.

8.3 Performance Tracking

The system can already determine which article should be updated, why it should be updated, where it should be changed, and how to generate an evidence-backed optimization task.

The next step is to add performance tracking after task execution and connect each content update with later metric changes.

Once this is complete, content teams will be able to understand:

  • Whether an optimization actually created growth
  • Which types of updates are more effective
  • Which pages still need further iteration

Conclusion

The goal of this content growth diagnostic system is not to provide another SEO report.

Its goal is to turn organic traffic optimization into a process that is:

  • Executable
  • Trackable
  • Reviewable
  • Connected to business outcomes

It connects search data, page content, user behavior, brand facts, AI/GEO visibility, optimization tasks, and performance feedback into one closed loop.

As a result, the content team no longer receives a vague instruction like “optimize the article.”

Instead, they can clearly understand:

  • Why the page needs to be changed
  • Where the problem is
  • What should be updated
  • Who should execute the task
  • Which metrics should be checked after the update

GitHub: https://github.com/dageno-agents/organic-content-intelligence

If you are also building an independent website for overseas markets, focusing on content growth or AI search, and would like to discuss this solution or learn more about the system's implementation details, you can add WeChat: dudulhc.

Top comments (0)