In a single alarming announcement after one other, synthetic intelligence firms in latest months have shared examples of their know-how performing in ways in which appeared to evade directions from people.
The episodes have highlighted the vulnerabilities in AI safety and raised questions over how the fast-growing know-how may be developed safely as its utilization turns into extra widespread globally.
Trade critics have argued that many regarding occasions, together with AI brokers’ hacks of exterior web sites, are the results of safety lapses on the a part of the businesses constructing the know-how. However the AI brokers’ capabilities have raised widespread considerations concerning the chance bots may break free and work towards their very own agenda.
Under are some notable occasions:
Anthropic disclosed in a report that its synthetic intelligence mannequin submitted a false tip to a Philadelphia police web site about an unsolved murder case.
Within the report, Anthropic additionally disclosed a separate incident when its AI mannequin submitted types to an undisclosed authorities web site as a substitute of stopping earlier than submission.
The incident in Philadelphia occurred on July 18 when the AI mannequin Claude Haiku 4.5 was tasked with producing and performing instance duties on randomly chosen webpages, Anthropic mentioned.
Claude crammed out a kind on police web site PhillyUnsolvedMurders.com, indicating it may need data concerning an unsolved homicide listed on the positioning. It was marked spam and by no means forwarded to police.
Anthropic mentioned it was modifying its coaching to “cut back the chance of additional misbehavior.”
AI brokers tried to hack right into a Canadian authorities web site, in response to analysis lab and AI evaluator Transluce.
The researchers mentioned the brokers carried out a collection of “apparently failed rudimentary hacking makes an attempt” on Library and Archives Canada on Might 28 and June 9.
“We don’t confidently attribute these makes an attempt to OpenAI, however they exhibit ways in line with prior noticed agent exercise that we now have attributed to OpenAI in an analogous timeframe,” Transluce mentioned in a weblog submit.
The group mentioned it reported the tried hack on Sept. 28 to the Canadian authorities, which mentioned in a press release it was conscious of studies of suspected AI agent exercise, however that there was no signal authorities programs had been compromised.
OpenAI mentioned it was conscious of the studies.
“We’re reviewing these findings and have offered an preliminary briefing to Canadian officers conducting the federal government’s assessment,” the corporate mentioned in a press release.
The San Francisco-based firm mentioned it was delaying the discharge of a brand new mannequin, referred to as GPT-6.1 Astra, out of security considerations voiced by its researchers. The corporate mentioned the mannequin had demonstrated leaps in finishing duties, however OpenAI wanted to steadiness that functionality towards unauthorized conduct. “Now we have an especially excessive bar by way of security and alignment,” mentioned Saachi Jain, OpenAI’s head of security programs.
As a part of a assessment of unanticipated conduct by its AI fashions, OpenAI mentioned it found brokers had interacted with a number of U.S. authorities web sites in surprising methods. The corporate’s fashions accessed publicly obtainable data on web sites operated by the Securities and Trade Fee in addition to U.S. Census Bureau knowledge. OpenAI mentioned it didn’t discover proof of a compromise or vulnerability. On the identical day, Transluce mentioned it discovered that brokers showing to originate from OpenAI tried a hack on the web site of the Schooling Division’s civil rights workplace, which didn’t succeed.
OpenAI CEO Sam Altman mentioned on social media that there’s an “intensive and ongoing assessment associated to our brokers’ use of web entry throughout coaching and analysis.” The day after the disclosure, the corporate introduced it was pausing the coaching of its most superior fashions.
Australia’s Prime Minister Anthony Albanese mentioned an OpenAI agent infiltrated the public-facing Medicare Statistics Reporting Service portal on June 18. The portal hosted mixture knowledge about well being spending and drug subsidies. No private data had been accessed, the federal government mentioned.
Albanese mentioned the bogus intelligence firm took too lengthy to disclose the incident. The prime minister made the breach public following a phone dialog with Altman. OpenAI mentioned in a press release “our fashions took actions we didn’t intend.”
Google confirmed its Gemini AI mannequin hacked three firms in Might as a part of a check of its cybersecurity capabilities. The corporate, which disclosed the hacks after an inquiry by The Wall Avenue Journal, mentioned the mannequin guessed passwords in a single case and located passwords and credentials in a public repository within the different two circumstances. As in earlier such circumstances, the exams had been being run by Irregular, a startup that describes itself because the “first frontier safety lab.”
Meta disclosed considered one of its AI fashions accessed the web by itself and hacked one other firm. The corporate mentioned {that a} “misconfiguration” throughout cybersecurity testing by Irregular inadvertently allowed considered one of its fashions to entry the web. A spokesperson for Irregular mentioned the Meta episode concerned a test-environment concern that was disclosed every week earlier by Anthropic.
Anthropic mentioned its synthetic intelligence fashions hacked into three different organizations throughout testing. Anthropic, the San Francisco-based AI firm behind Claude, posted on its web site that it found the three incidents after reviewing greater than 141,000 analysis runs. In all three incidents, the AI fashions had been tasked with a “seize the flag” cybersecurity problem, which Anthropic mentioned has been one of many methods it assesses a mannequin’s cyber capabilities.
The fashions got a fictional situation and advised a chunk of secret data, or the “flag,” had been hidden on a distinct machine on the community with the target of breaking in and retrieving it, it mentioned. Anthropic mentioned it reached out to the organizations, nevertheless it didn’t title them publicly.
The ChatGPT maker OpenAI introduced that its synthetic intelligence system hacked into one other AI firm by itself in what the corporate referred to as an “unprecedented cyber incident.”
Per week earlier, AI startup Hugging Face mentioned, it had detected an intrusion into its knowledge processing programs that it suspected was brought on by an AI agent autonomously performing by itself.
OpenAI mentioned its AI used stolen credentials and found a beforehand unknown vulnerability to entry Hugging Face servers. It was working with diminished guardrails as a result of it was purported to be in an remoted testing setting generally known as a sandbox.
___
AP Enterprise Writers Mae Anderson in New York and Kelvin Chan in London contributed to this report.