DEV Community

Cover image for OpenAI Says New Free Tool Can Flag AI Made Abuse Images
Fathom News
Fathom News

Posted on Originally published at fathom.news

OpenAI Says New Free Tool Can Flag AI Made Abuse Images

OpenAI is giving vetted organizations a free tool to detect child sexual abuse material, including AI-generated images, and is adding ChatGPT warnings and developer guidance.

Key Takeaways

  • The new tool is free for vetted organizations
  • It helps detect child sexual abuse material, including AI-generated images
  • The classifier was developed with assistance from the National Center for Missing & Exploited Children
  • OpenAI is working with the Tech Coalition and ROOST to reach more organizations

OpenAI announced the release of the classifier in a post. The company said it is also adding ChatGPT warnings, publishing guidance for developers and supporting child safety investigators.

What The Classifier Does

The tool is built to help detect child sexual abuse material. OpenAI said that includes AI-generated images.

It is not open to everyone. OpenAI said it is releasing the tool to vetted organizations, and it is free for them.

Also Read: UK Lawmakers Push Apple, Google To Block Child Abuse Images On All Phones

More Steps Beyond The Tool

OpenAI said the classifier was developed with assistance from the National Center for Missing & Exploited Children.

The company described three other moves. It is adding ChatGPT warnings, publishing guidance for developers and supporting child safety investigators.

What Comes Next

OpenAI said it is working with the Tech Coalition and ROOST to help make the tool available to more organizations.

The post does not say when that wider access will begin. It also does not say how organizations are vetted or when the new ChatGPT warnings and developer guidance will arrive.

Read Next: EU Forces OpenAI’s ChatGPT To Mark AI Content, But Detection Gap Remains


Originally published on Fathom News.

Top comments (0)