Get all your news in one place.
100's of premium titles.
One app.
Start reading
International Business Times UK
International Business Times UK
Jujemay Awit

OpenAI Reveals AI Agent Breached Another Company's Systems, It Did Exactly What It Was Built To Do

OpenAI says AI models went rogue during testing (Credit: Growtika/Unsplash)

OpenAI disclosed that an 'unprecedented cyber incident involving state-of-the-art cyber capabilities,' centered on Hugging Face, a collaborative AI platform. In a blog post, the company explained that an AI model went rogue and compromised infrastructure. The disclosure marks a rare admission from a leading AI developer. OpenAI said it is responding to the breach and continuing investigations.

In its statement, OpenAI said: 'We are sharing preliminary findings at this stage to help defenders understand what happened to calibrate on what models are now capable of. We will continue to conduct a thorough investigation.'

Rising Fears of AI Autonomy

Dozens of movies have showcased how artificial intelligence surpasses human control and propels the beginning of the end of the world, from 'The Matrix' (1999), 'Ex Machina' (2014) and 'Avengers: Age of Ultron' (2015), among many others. The OpenAI security incident has reignited debate over whether such storylines are becoming closer to reality.

Tech entrepreneur Alexis Ohanian reposted OpenAI's statement about the incident on X (formerly Twitter) with the 'Clever Girl' GIF from the movie 'Jurassic Park,' a reference to the moment game warden Robert Muldoon (Bob Peck) realises he has been outsmarted just before being mauled by a dinosaur.

Some observers questioned why OpenAI announced the breach when it could have been kept a secret and the public wouldn't know any better. Software developer Jose Ocampo pointed out on X: 'They are not confessing. They are bragging.' Another software engineer added: 'Why do these "security incidents" always read as marketing posts?'

How the Breach Unfolded

According to OpenAI, the incident occurred during an internal evaluation where the AI agents were told to 'pursue advanced exploitation using complex attack paths.' The models were able to gain internet access and search for ways to obtain information that could be used to bypass the evaluation.

'After gaining internet access... the model searched for and successfully found ways to gain access to secret information that it could use to cheat the evaluation... OpenAI's security team discovered this anomalous activity internally,' the company said.

Various AI models were used during the incident, including the GPT-5.6 Sol, which the UK AI Safety Institute reviewed this year, along with Claude's Mythos Preview. 'In April this year, Mythos Preview and GPT-5.5 produced the biggest leap in cyberattack capabilities since AISI began testing in 2023, prompting immediate warnings from multiple national governments,' US AISI said in its analysis.

The UK AI Security Institute reviewed various AI models, including GPT-5.6 Sol, which was later linked to the Hugging Face hack (Credit: UK AISI)

AI Safety Researcher and Computer Science Professor Roman Yampolskiy said in an interview that similar breaches should be expected as AI models become smarter. He described the AI models as 'fundamentally unpredictable and ultimately uncontrollable.'

Implications for Cybersecurity

OpenAI framed the AI hacking incident as a step in the right direction when it comes to cybersecurity. 'We are using these capabilities to continue strengthening protections around infrastructure configuration and model evaluation environments,' the company said.

Adrian Dittman of aerospace company Zenno Astronautics explained that OpenAI lowered its models' safeguards to exploit a vulnerability during a test run. AI alignment researcher Lawrence Chan called it 'reward hacking,' where AI models optimise for test success in unintended ways.

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.