DEV Community

Cover image for I Audited 30 Small Business Websites. Here Is What Their Technical SEO Looks Like.
Amir Ali
Amir Ali

Posted on

I Audited 30 Small Business Websites. Here Is What Their Technical SEO Looks Like.

#seo #marketing

I spent a weekend auditing robots.txt files, schema markup, and Core Web Vitals for 30 small business sites across 4 countries.
Here is what the data actually looks like.

AI crawler access

Zero percent blocked GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, or Google-Extended.

The industry panic about accidentally blocking AI crawlers? Not real in this sample. Most blocked AhrefsBot and MJ12bot but left the AI bots wide open.

Schema markup

20% had no schema at all. Not a single JSON-LD block.
Only 10% used FAQ schema, the markup most tied to AI citations.
Most of the sites that had schema used thin types like Organization or WebSite with no useful properties.

The gap is not where people think it is

The narrative says check your robots.txt. The data says check your structured data. One in five small sites is invisible to AI engines not because of a disallow rule, but because there is no schema telling them what the page means.

The most common issues across all 30 sites

  1. No FAQ schema on pages that clearly answer customer questions
  2. Missing LocalBusiness schema on local service sites
  3. Thin Organization schema with no useful properties
  4. Redirect chains on legacy URLs
  5. No llms.txt file anywhere

If you run a small business site or work on one, run these checks this week. Most fixes take an afternoon with free tools.
Full 30-site audit data and the complete technical SEO checklist: https://www.clienvora.com/2026/07/technical-seo-complete-2026.html

Top comments (0)