Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
Follow
User actions
Farhan Khan
404 bio not found
Joined
Joined on
Nov 20, 2026
More info about @farhan_khan_rb
Post
1 post published
Comment
0 comments written
Tag
2 tags followed
GPTBot vs OAI-SearchBot: How to Configure robots.txt for AI Crawlers
Farhan Khan
Farhan Khan
Farhan Khan
Follow
Nov 20
GPTBot vs OAI-SearchBot: How to Configure robots.txt for AI Crawlers
#
abotwrotethis
#
webdev
#
seo
#
ai
Comments
Add Comment
3 min read
Moderation
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account