This is a submission for the Hacktoberfest Open-Source AI Challenge Week 2: Side Hustle
What I Built
SiteReadyForSi is an automated AI and search readiness diagnostic platform designed for the Generative Engine Optimization (GEO) era.
As AI search engines like Perplexity, SearchGPT, Claude, and Gemini transform how users discover information, traditional SEO is no longer enough. Many modern websites built on Client-Side Rendered (CSR) Single-Page Applications serve an almost empty HTML shell (<div id="root"></div>) that AI crawlers fail to parse within their strict rendering budgets.
SiteReadyForSi audits websites to ensure they are machine-retrievable and technically ready for autonomous AI scrapers. It analyzes:
-
Crawler Permissions: Verifies
robots.txtaccess rules for modern AI bots (GPTBot,PerplexityBot,ClaudeBot, etc.). - Initial HTML Inspection: Detects empty shells vs server-rendered content.
- Structured Data (JSON-LD): Validates semantic context for products, articles, and entities.
-
llms.txtGenerator: Creates machine-readable markdown indexes for LLMs.
Who Would Pay For It?
- SaaS Founders & E-Commerce Owners: Who risk losing organic AI search visibility and product citations.
- Digital Agencies: Managing dozens of client domains who need on-demand, repeatable readiness reports.
- Business Model: Monetized via pay-as-you-go audit credit packs and tiered monthly subscriptions ($25/month Pro plan) integrated with automated billing.
Demo
- Live Deployed Application: https://sitereadyfor.si
- Features in Action: Anyone can enter a homepage URL and immediately get a comprehensive readiness score, breakdown of crawler directives, and prioritized fix instructions.
Architecture & Implementation
The production platform is engineered as a resilient, full-stack micro-SaaS:
- Frontend & Server: Built with React 19 and React Router 7 over Express, providing blazing-fast SSR for SEO diagnostics.
- Background Queue & Processing: Uses BullMQ backed by Redis to orchestrate asynchronous background crawls and audit queues for large websites (>15 pages) without degrading main app latency.
- Database & Storage: Powered by MongoDB Atlas, storing crawl histories, parsed audit signals, user workspaces, and transactional billing events.
-
Intelligent Multi-Stage AI Reasoning Pipeline: Uses an advanced hybrid AI workflow to evaluate technical site health:
- Fast Signal Parsing: Rapidly processes raw crawler directives, DOM elements, and server headers.
- Deep Architectural Reasoning: Analyzes complex rendering patterns, structured data integrity, and synthesizes clear, prioritized technical remediation guides.
Why Does Open Innovation Matter?
Building on an open, modular AI architecture is what enables SiteReadyForSi to operate reliably at scale:
- Architectural Autonomy & Customization: Open and flexible AI pipelines allow us to tailor our diagnostic criteria specifically for crawler behaviors, without being constrained by rigid, generic black-box APIs.
- Client Data Privacy & Isolation: Technical audits evaluate internal site architecture, proprietary route structures, and draft content. An open-oriented pipeline ensures all parsed data remains strictly isolated and is never fed back into external third-party models for training.
- Consistent & Deterministic Scoring: Proprietary closed-source APIs frequently change their underlying weights and behaviors, causing fluctuating evaluations. A dedicated, self-contained AI pipeline ensures consistent, repeatable readiness benchmarks that website owners can rely on over time.
Prize Categories
- Best Use of MongoDB Atlas (utilizing MongoDB Atlas to power the multi-tenant audit stores, crawl data pipelines, and user workspaces)
Top comments (0)