Originally published at clickzprotect.com.
A lookup table of AI training crawler user-agent strings — GPTBot, ClaudeBot, PerplexityBot, Bytespider, and 14 more — with their operators, purposes, and robots.txt compliance status.
Rajat Pratap Singh
Posted on • Originally published at clickzprotect.com
AI Crawler User-Agent Reference: 18 Bots and What They Do
For further actions, you may consider blocking this person and/or reporting abuse
Top comments (0)