DEV Community

Cover image for Should we get a AI-noindex ?
Mbenga
Mbenga

Posted on

4 1

Should we get a AI-noindex ?

Artificial Intelligences like Chat-GPT & Bard work by happily feeding on the entire Internet. Many of the sites derive some (if not all) of their funding from advertising revenue. Unfortunately, once the info has been ingested by the AI, it can be returned an infinite number of times without offering compensation to the original sites, wich won't get any visit anymore.

This also raises a question of intellectual property. Currently, any creation you post on the internet can be freely used to feed an AI, without even giving you the opportunity to give or refuse your consent.

This is why I come to ask myself the following questions:
Shouldn't we put in place a system to indicate that we refuse or authorize indexing by AIs? And if so, what form should it take? Should this take the form of a tag on the site, like the NoIndex currently? or a license file? or something else ?

I look forward to reading your response

Image of Datadog

The Future of AI, LLMs, and Observability on Google Cloud

Datadog sat down with Google’s Director of AI to discuss the current and future states of AI, ML, and LLMs on Google Cloud. Discover 7 key insights for technical leaders, covering everything from upskilling teams to observability best practices

Learn More

Top comments (4)

Collapse
 
michaeltharrington profile image
Michael Tharrington

Really great topic!

I can tell you that we adapted our plagiarism guidelines on DEV to include a note on Ai-assisted plagiarism because like you've noted these AI-driven tools are pulling info from existing sources and it's not fair to not give these original sources credit.

I would love to see an AI-noindex tag for this very reason! I do think SEO should at least try to prioritize human generated content over AI-generated content. If the AI-generated content is particularly good in some way, then perhaps the SEO bots should have other ways of detecting that and then index that content if it fits certain criteria or reaches a certain threshold, BUT I think that should be the exception to the rule and the rule should slant toward deindexing AI generated content.

Anywho, that's my take.

Collapse
 
jeremymonatte profile image
Mbenga

Your point is really interesting and I didn't at that in a first sight. I think the main problem on prioritize Human-generated content in SEO is to detect it. Unless the content creator declares it himself, it is difficult to detect the intervention of an AI in the creative process. And as it develops it will be more and more difficult.

The point I wanted to discuss was a little different (sorry English isn't my native langague so i might be not clear). I meaned a meta tag which makes it possible to prohibit AIs from drawing inspiration from its content.

Collapse
 
michaeltharrington profile image
Michael Tharrington • Edited

Oh you're all good! Now I totally understand ya... an HTML tag that would prohibit AI tools (like ChatGPT) from taking your work, that's a fantastic idea!

Thread Thread
 
jeremymonatte profile image
Mbenga

Exactly 👌

The Most Contextual AI Development Assistant

Pieces.app image

Our centralized storage agent works on-device, unifying various developer tools to proactively capture and enrich useful materials, streamline collaboration, and solve complex problems through a contextual understanding of your unique workflow.

👥 Ideal for solo developers, teams, and cross-company projects

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay