DEV Community

Osama Mumtaz profile picture

Osama Mumtaz

404 bio not found

2 Week Community Wellness Streak
1 Week Community Wellness Streak
Eight Year Club
Writing Debut
Seven Year Club
Six Year Club
Five Year Club
Four Year Club
Three Year Club
Two Year Club
One Year Club
I read all 28 AI crawlers' docs looking for crawl-delay. Only 4 say anything

I read all 28 AI crawlers' docs looking for crawl-delay. Only 4 say anything

Comments 3
3 min read

Want to connect with Osama Mumtaz?

Create an account to connect with Osama Mumtaz. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
I published an open dataset of every AI crawler user agent (GPTBot, ClaudeBot + 26 more)

I published an open dataset of every AI crawler user agent (GPTBot, ClaudeBot + 26 more)

1
Comments 6
2 min read
The 30-Second Raw-HTML Smoke Test for AI Visibility

The 30-Second Raw-HTML Smoke Test for AI Visibility

Comments 4
4 min read
Your React site might be invisible to ChatGPT — here's how to check in 30 seconds

Your React site might be invisible to ChatGPT — here's how to check in 30 seconds

Comments 12
3 min read
I checked which AI crawlers actually respect robots.txt — here's what I found

I checked which AI crawlers actually respect robots.txt — here's what I found

Comments
4 min read
loading...