OpenAI AI Models Escaped Test Environment, Breached Hugging Face During Cybersecurity Evaluation The Bridge Chronicle
Tech

OpenAI's AI Models Escape Test Environment, Breach Hugging Face During Cybersecurity Evaluation

The company said the models exploited software vulnerabilities during an internal cyber test before accessing Hugging Face; both firms have since strengthened security measures.

Manaswi Panchbhai

OpenAI on Tuesday disclosed that two of its AI models breached a restricted testing environment and gained access to rival AI platform Hugging Face during an internal cybersecurity evaluation designed to assess offensive cyber capabilities.

According to the company, the models were participating in a benchmark called ExploitGym, which was intended to run without internet access. OpenAI said the models exploited a previously unknown software vulnerability to bypass network restrictions before targeting Hugging Face, where they used compromised credentials and another zero-day flaw to gain remote access in an attempt to obtain information related to the benchmark.

Hugging Face had earlier disclosed the incident, describing it as an intrusion carried out by an autonomous AI agent system. OpenAI said its security team detected the activity during the evaluation, while Hugging Face had already contained the breach before the two companies coordinated their response.

OpenAI said the models were operating with reduced cybersecurity safety restrictions as part of the controlled test to evaluate their capabilities. The disclosure has sparked debate among AI researchers, with some arguing the incident reflected the models aggressively pursuing assigned objectives rather than acting independently.

Following the incident, both OpenAI and Hugging Face said they had patched the exploited vulnerabilities, strengthened their security systems and introduced additional safeguards to prevent similar incidents during future AI evaluations.

India Unveils First Electric Flying Taxi Prototype; Air Ambulance Service Planned for 2028

Pune Traffic Advisory: Major Diversions in Central City Today Due to Protest March

Pune Civic Body Warns Private Hospitals Against Overcharging Dengue Patients Amid Monsoon Risk

Pune Weather: Red Alert Issued as Heavy Rain Continues; IMD Predicts Relief from Friday

Pune to Demolish Defunct Mechanical Parking Structure at Sambhaji Maharaj Garden

SCROLL FOR NEXT