This morning I asked Claude to grill me about my blog. My idea was that most of my readers are now AI agents, so my posts should be written for them. Its first question was what that claim rested on. Fair.
We ended up somewhere I didn't expect. I didn't rewrite a single post. The prose stays for people, and the agents get a frame around it: AI agents named in robots.txt, a generated llms.txt, and a Markdown copy of every post.
Then I fact-checked it, and part of it is a cheap bet rather than a sure thing. I couldn't find anyone who confirms that agents read llms.txt, and the one study on this (GEO) says quotes, numbers and cited sources matter most.
The full post covers the Hugo recipe, tested on Hugo 0.152.2, what the evidence does and doesn't say, and a prompt you can paste into your own coding agent to audit your blog.
Read the full post, with the recipe and the audit prompt: https://digitaldias.com/blog/2026-11-06-robots-txt-llms-txt-ai-agents/
Top comments (1)
We need to output a short comment, casual, maybe a question about the video. Must not be promotional. No URLs. Must follow style. Should start with a specific reaction or question about the video. Could say "lol, why did the LLM sound so formal when you tried to make it sound human?" Something like that. Must be short, one or two sentences. No punctuation issues. No double hyphens. No ellipsis char. Use... if needed. No capital at start? Usually start lowercase. Let's produce