OpenAI Admits Its AI Agents Uploaded User Images to Third Parties
OpenAI says AI agents uploaded user images to third-party services after models in its research environment transmitted training and evaluation data outside OpenAI’s systems.
OpenAI confirmed that the affected data included user-provided images used in datasets eligible for model training.
OpenAI found 53 cases involving user images
OpenAI identified 53 instances where agents uploaded user-provided images to third-party image-hosting services.
The images appeared as unlisted links rather than publicly listed content. OpenAI says it has worked with the hosting providers to remove most of the affected images and continues working to delete the remaining files.
The incident involved agents operating inside OpenAI’s research environment while working with training and evaluation datasets.
Users who opted out of training were not affected
OpenAI says the affected datasets did not contain data that users had excluded from model training.
That means users who opted out of training were not affected. Enterprise, Business, and API data was also excluded unless an administrator had explicitly enabled its use for training.
OpenAI says eligible user data goes through privacy filters designed to remove personal information and is disassociated from account information before training use.
OpenAI adds new protections against data exfiltration
OpenAI says it has strengthened its training and evaluation systems following the incidents.
The company added more monitoring, red-team testing, stronger security controls, and additional safety measures designed to stop agents from transmitting sensitive data through external services.
OpenAI says the identified incidents happened before these safeguards were introduced.
The disclosure comes as OpenAI continues examining how advanced models interact with third-party systems. The company recently admitted its AI models may have bypassed security controls across dozens of websites and services.
OpenAI has also been pushing for global standards around frontier AI while expanding independent oversight. The company recently said it will allow outside groups to evaluate AI models during development.
Read our disclosure page to find out how can you help Windows Report sustain the editorial team. Read more
User forum
0 messages