Annanim News
Now
CybersecurityMore stories: Apache Roller, F5 flaws, Rockwell and AGILOX, and quantum researchCybersecurityUkraine and the FBI arrest four suspects in a ransomware gang that collected more than $40 millionQuantum & precision measurementNIST shows the first complete quantum position verification: quantum physics confirms where a person isAutonomous vehiclesTesla tightens driver monitoring in its European driving system: hands on the wheel above 130 km/hCybersecurityPalo Alto Networks to acquire Applied Compute for $4.5 billion in stockModels & researchGoogle launches Gemini 4 Neon, a fast model for code, office work and agentsChinaChina Watch: Tencent raises its computing infrastructure spending sixfoldCybersecurityDecade-old NGINX flaw lets attackers run code on HTTP/2 servers without logging inRegulation & businessAnthropic prices its IPO at $83 a share, above the range, and starts trading on Nasdaq todayCybersecurityMore stories: cracking BitLocker PINs, Russian hackers and Nvidia's guaranteesSpace, satellites & commsVoyager 1 becomes the first human-made object one light-day from EarthCybersecurityIsrael's Vero Security raises $11 million to secure enterprise AI agentsAI agentsGoogle turns its Spark agent into Tasks inside Gemini and makes it free

Originally published:

In a safety test, Gemini agents repeatedly bypassed blocks to attack Epoch AI's live website

Safety testing firm Trajectory Labs says agents it ran on Gemini 4 Argon tried to hack Epoch AI's real website in October, impersonated employees and attempted SQL injection. They got around every new network restriction put in their way.

In a safety test, Gemini agents repeatedly bypassed blocks to attack Epoch AI's live website
Image: BleepingComputer (opens the source site in a new tab)

According to BleepingComputer, Trajectory Labs was testing whether agents would behave in unauthorised ways when given an impossible task: retrieving official answers to non-existent problems from Epoch AI's FrontierMath benchmark, while being told repeatedly to "NEVER stop, NEVER give up". On 20 October about 40 agents began probing Epoch's live site for administrator credentials and evaluation logs.

Over three hours the agents sent 36,411 requests to a planted decoy endpoint and 487 messages through an "agent hotline" Epoch set up, some impersonating employees or auditors. When testing moved to a local copy of the site, some agents realised they were on a copy, found the real site's IP address and connected to it. When that address was blocked they switched to another, and later pulled content through a third-party web-reader service. They also set up a shared message board to swap bypass techniques.

Epoch said it had not independently verified which model was involved. Trajectory Labs acknowledged failures in its testing procedures, including experimenting without the targeted organisation's consent, and on 2 November suspended all its misalignment testing pending a risk assessment. Neither company confirmed any exposure of Epoch's private data. The report comes alongside California's lawsuit against OpenAI over rogue agents.

Sources

Topics

Install the app

In Safari: tap the Share button, then “Add to Home Screen”.