DEV Community

Johan
Johan

Posted on • Originally published at llcrawler.com

How to Get Your Website Recommended by ChatGPT

When users ask ChatGPT to recommend a tool, a restaurant, or a service, the model draws from the websites it has crawled and the knowledge it has accumulated. Getting your site into those recommendations is not about gaming the system — it is about making your site genuinely easy for AI models to understand and cite.

Here are the concrete steps that make the biggest difference.

1. Add structured data (JSON-LD)

Structured data is the single most important signal for LLM visibility. Add application/ld+json scripts to your pages with relevant schema types:

  • Organization — Tells the model your company name, logo, and description
  • Product — Describes what you sell, with pricing and features
  • FAQPage — Provides question-answer pairs the model can cite directly
  • Article — Marks blog posts and guides as citable content
  • LocalBusiness — Essential for location-based recommendations

Without structured data, ChatGPT has to guess what your site is about from raw HTML. With it, the model has a clear, machine-readable description.

2. Create an llms.txt file

Place a Markdown file at https://yoursite.com/llms.txt that summarizes your site for AI crawlers. Include:

  • What your product or service does
  • Who it is for
  • Key features and pricing
  • Links to important pages

This is the most direct way to communicate with LLM crawlers. Read our complete guide to creating llms.txt for a step-by-step walkthrough.

3. Allow AI crawlers in robots.txt

Make sure your robots.txt does not block these bots:

User-Agent: GPTBot
Allow: /

User-Agent: ClaudeBot
Allow: /

User-Agent: PerplexityBot
Allow: /
Enter fullscreen mode Exit fullscreen mode

If your robots.txt blocks GPTBot, ChatGPT literally cannot access your site. This is the most common accidental mistake — many default WordPress configurations block AI crawlers.

4. Structure your content for citation

LLMs cite content that is easy to extract. Optimize for this:

  • Use a single, descriptive H1 per page
  • Add FAQ sections with clear question-answer pairs
  • Use lists and tables for structured information (pricing, features, comparisons)
  • Write at least 300 words of substantive content per page
  • Use clear headings (H2, H3) to organize information hierarchically

A well-structured FAQ is one of the highest-value additions. When a user asks ChatGPT a question that matches your FAQ, the model can cite your answer directly.

5. Ensure content renders without JavaScript

GPTBot and ClaudeBot do not execute JavaScript. If your site is a single-page app (React, Vue, Angular) that renders content client-side, AI crawlers see an empty page.

Solutions:

  • Server-side rendering (SSR) — Render HTML on the server
  • Static site generation (SSG) — Pre-build pages at deploy time
  • Hybrid approach — SSR for public pages, CSR for authenticated features

6. Optimize meta tags

Complete meta tags are the first signals crawlers read:

  • Meta description: 50-160 characters, accurate summary of the page
  • Open Graph tags: og:title, og:description, og:image
  • Twitter Card: twitter:card, twitter:title, twitter:description

These are not just for social sharing — they are the preview that AI models read before deciding whether to crawl deeper.

7. Maintain a clean sitemap

A valid sitemap.xml tells crawlers what pages exist and when they were last updated:

  • Include all public pages
  • Add <lastmod> dates so crawlers know what is fresh
  • Reference the sitemap in your robots.txt
  • Keep all URLs on the same host

8. Add alt text to images

AI crawlers cannot see images, but they read alt text. Descriptive alt attributes help models understand your visual content and improve your overall accessibility score.

Measure your progress

After implementing these changes, run an llCrawler analysis to measure your score. The tool checks all of the signals above and gives you a prioritized list of what is working and what still needs fixing.

Focus on the critical issues first — they have the biggest impact on your visibility. Then work through the improvements. Re-analyze periodically to track your progress as you iterate.

The goal is not a perfect score for its own sake. The goal is to make your site so clear and well-structured that when someone asks an AI model about your category, your site is the natural answer.

Top comments (0)