I Built an Open-Source AI Visibility Tool, Tested It on Myself, and Scored 0/16 (OpenGEO)

cooleryu — Sat, 14 Nov 2026 09:08:08 +0000

I’m building OpenGEO
in public — an open-source, local-first workbench that checks whether ChatGPT and Google AI Overviews actually mention and cite your product. Last week I used it to audit OpenGEO itself across 8 real buyer prompts (16 live answers).

Our score came back at a brutal 0 out of 16. When I asked what are the best open-source alternatives to Otterly AI and Profound for AI search visibility?, both engines returned tidy shortlists of five to six projects — Elmo, Limelit Open, GEO/AEO Tracker, OneGlanse, Gego, Searchstack AEO — complete with comparison tables and a top pick. Worse, when I asked directly What is OpenGEO?, both engines confused my repo with a completely unrelated Pupok462/open-geo project. The uncomfortable realization wasn't that everyone else built a better product — it's that AI search builds shortlists exclusively from pages already legible to it, and our repo wasn't even in the pool.

Our baseline in OpenGEO before rewriting docs — 0 out of 16 captured ChatGPT and Google AI answers mentioned cooleryu/opengeo.

Here is the practical audit-and-rewrite loop that gets you into that pool, and you can run the first round in an evening: ask the exact questions buyers actually type, store every verbatim answer and cited source, inspect the top three winner pages side by side, and rewrite your own front page and onboarding docs to close the structural gaps. Once your changes ship, re-run the identical prompts and keep both rounds on one timeline.

What does an AI answer look like when it recommends your competitor?

It reads like a procurement brief with sourcing baked in. Look closely at what showed up when we opened Question #2 (open-source alternatives to Otterly AI and Profound) inside our captured evidence view:

Capturing the exact question alongside the full answer and every competing tool named instead of you.

Every candidate that made the cut carried four consistent building blocks: a plain category definition in line one, a clear license and deployment signal (Self-hosted · GPL-3.0 or MIT · SQLite), a bulleted capability list using buyer language, and an implicit or explicit best for sentence. Beneath the prose sat GitHub repositories and concise product homepages. You aren't competing with a competitor's roadmap in that moment — you're competing with how clearly their landing page answers the prompt.

How do I capture real answers without buying an enterprise tracker?

Start with a fixed list of real buyer phrasing, ask across the engines your users trust, and keep the full raw text — never summaries. Four fields per record decide whether later comparisons actually mean anything:

The exact prompt word for word. Best GEO tools and how can indie SaaS teams run local GEO checks without enterprise subscriptions trigger completely different retrieval sets. Lock the prompt once and reuse it unchanged.
Engine, entry point, and date. ChatGPT logged-in web answers, Google AI Overviews, and developer API endpoints read different source snapshots on the same day. Never diff an API response against a consumer browser capture.
Verbatim answer text. If your product name or disambiguating context isn't inside the captured text, you were skipped — full stop.
Every named competitor and external link. These URLs are your real content competition for the next sprint.

Doing this in spreadsheets works for three prompts and falls apart once you track eight prompts across two platforms before and after edits. That bookkeeping annoyance is why we keep everything local inside OpenGEO: it runs your question set inside your own logged-in browser session at a calm human pace (pausing and handing control right back to you if Google pops a verification challenge), or takes full manual copy/pastes from an incognito tab, and keeps mentions and official-site citations audited separately on one screen.

flowchart LR
    A["Ask the exact question a buyer types"] --> B["Save the full answer and every cited URL"]
    B --> C["Open the winner pages and map their structure"]
    C --> D["Rewrite your front page and guides to answer that gap"]
    D --> E["Publish, then re-ask the identical question"]
    E --> F["Compare before and after on one timeline"]

Which pages actually got cited, and what do they share?

Before changing a single paragraph on your own site, probe the external pages that already won the prompt. Across the winners we inspected (getgego.org, elmohq/elmo, limelit-co/open), five patterns showed up over and over again:

A category definition in sentence one. Not marketing copy. Plain grammar: subject, category, deployment model, primary job (Self-hosted GPL-3.0 CLI + dashboard or Open-source, local-first AI search visibility workbench).
H2 headings phrased around buyer concerns. Look at the live headings we pulled from getgego.org: Know how AI sees your brand, One tracker for every major LLM, From SEO research to competitive GEO. Models extract section headings verbatim when assembling "how it works" summaries.
Explicit disambiguation if a similar name exists. If another repository or extension shares your name, state who you are and who you are not directly on your canonical README so retrieval models stop merging the two entities.
Honest best-for and not-for boundaries. Saying hosted SaaS tools are better if you want zero setup and weekly hands-off reporting builds credibility and gives comparison prompts clean material to quote.
Real product screenshots with descriptive alt text. Explaining an abstract workflow with three tables loses both developers and extractors; showing what the evidence view and draft diff look like anchors every claim.

What you borrow from winners is their outline clarity and directness — never their wording, claims, or benchmarks.

How do open-source and local GEO tools differ from paid SaaS monitors?

They answer different halves of the problem. Hosted monitors tell a marketing team whether share-of-voice moved last Tuesday. Self-hosted and local tools keep the raw evidence in your hands so engineers and docs owners know which exact file to ship next week.

Tool	Best for	How answers are collected	Where data lives	What you walk away with
Otterly.AI / Profound / Peec AI	Teams with budget who want scheduled multi-engine tracking and weekly reporting dashboards	Cloud-scheduled runs on vendor infrastructure	Vendor cloud (monthly SaaS subscription)	Trend charts, share-of-voice metrics, CSV/PDF exports
Elmo	Teams wanting an open-source monitoring platform closest to a SaaS tracker	Self-hosted workers calling your own model/API keys	Your server & database	Brand mention rates, citation logs, competitor tracking
Limelit Open	Developers looking for a compact self-hosted setup	Self-hosted single binary + SQLite	Your host machine	Mention & citation tracking plus MCP integration
Gego	Teams running scheduled prompt analytics across providers	Self-hosted CLI + dashboard	Your server	Keyword/domain analytics across supported LLMs
GEO/AEO Tracker	Engineers customizing automated scoring and sentiment pipelines	Self-hosted CLI & dashboard	Your machine or server	Visibility scoring, position tracking, battlecards
GetCito / Selfwin	Small teams wanting self-hosted prompt tracking plus light recommendations	Self-hosted app	Your server	Prompt tracking, citation loss checks, fix hints
OpenGEO	Maintainers and indie SaaS teams who want browser-captured evidence paired directly with ready-to-publish rewrites	Real logged-in browser session for ChatGPT & Google AI Overviews (or manual paste) + optional DeepSeek/Qwen/Doubao APIs	100% local SQLite on your machine	Verbatim answers, cited-winner structure breakdown, 1–3 complementary drafts with before/after diff, per-draft adoption, same-question retest

Two practical realities belong right next to that table: self-hosted still incurs API or model billing when you query online or generate drafts, and if all you want is hands-off weekly keyword reporting across ten engines, a paid SaaS monitor genuinely saves time. Choose the tool built for the bottleneck you actually have.

Turning cited-page gaps into drafts you actually ship

Finding a gap isn't the finish line; staring at an empty Markdown file next Tuesday is where most teams stall. Inside OpenGEO's optimization studio, once we pick the missing questions (0/16 baseline across category and brand prompts), the workbench probes the cited winner pages first and lays out a small set of complementary deliverables rather than three copies of the same pitch: a clearer repository README, a concrete Getting Started guide, and a public field teardown like this post.

Optimization Studio — review each draft against its target prompts, inspect what changed line by line, and adopt or export one piece at a time.

Every project profile, captured answer, and API key stays on your own disk, so browsing saved evidence costs nothing and nothing ever pushes online without you choosing to adopt or copy it out.

What should I rewrite first, and how do I verify it worked?

Focus on your highest-leverage canonical page before scattering edits everywhere else:

Rewrite sentence one of your README or homepage to state category + deployment + core loop in plain nouns and verbs.
Turn major H2 headings into concrete buyer questions, especially comparison and setup questions (How it differs, Supported platforms, How it works).
Add one explicit disambiguation line near the footer (or quick intro if actively confused) naming the canonical repo URL and what unrelated projects it isn't affiliated with.
Ship one workflow guide or comparison teardown backed by real captures and real UI screens instead of generic marketing claims.

After shipping, give search crawlers and model indexes several days to two weeks — re-testing ten minutes later just hits stale caches. Then re-run the exact same prompt on the exact same browser or API entry point and compare before vs. after side by side: first look for your domain appearing inside cited links (that unlocks the candidate pool), then verify whether your product's description stopped getting mixed up with lookalikes.

Try a ten-minute audit tonight

Pick one question a real customer would ask before buying your product, run it in a clean ChatGPT or Google session, and save the full text and every link underneath. Count how many of those cited URLs point back to you. That single honest baseline is worth more than any guesswork dashboard.

If you want to manage that whole loop — local browser capture, winner breakdowns, draft diffs, and side-by-side retesting — on your own machine, OpenGEO is open source at https://github.com/cooleryu/opengeo. Drop the repo URL into the AI coding assistant you already use (Claude Code, Cursor, Codex, or Antigravity) and ask it to get the local workbench running so you can inspect your own first eight questions tonight.

DEV Community: cooleryu