Halis Sunnetci
16 November 2026•Update: 16 November 2026
OpenAI on Monday unveiled a new artificial intelligence-powered tool designed to detect child sexual abuse material (CSAM), including AI-generated images, as part of broader efforts to combat online child exploitation.
The company said the image classifier can identify signs of abuse in previously unseen images and help safety teams prioritize potentially harmful content for review.
OpenAI described it as the first broadly available CSAM classifier capable of indicating whether abusive material may have been generated by AI.
Developed with assistance from the US-based National Center for Missing and Exploited Children, the tool is being offered free of charge to vetted organizations through OpenAI's application programming interface.
According to OpenAI, internal tests showed that the new tool could reduce the number of images flagged for review by 48% without significantly affecting its ability to detect abusive content.
The company said tests conducted by technology company fal.ai confirmed that 72% of images flagged as highly suspicious contained previously unidentified abusive material.
Separate tests by SafetyKit showed that the tool identified 90% of the tested cases involving sexualized depictions of children in drawings and animations.
OpenAI also announced new ChatGPT safeguards, including warnings for users attempting to access abusive material and the removal of flagged conversations.
Such violations can result in a 24-hour suspension, while repeated offenses may lead to longer restrictions, account closures, or reports to authorities.
The company also released guidance to help developers detect and report abusive material, along with AI tools and training resources for law enforcement agencies investigating child exploitation cases.