Annanim News
Now
RoboticsIsrael's Percepto shifts to software: its Axion platform analyzes inspection data from any drone or sensorRegulation & businessUnited's CEO doubts Boom's supersonic airliner timeline as the company focuses on gas turbines for data centersQuantum & precision measurementCanada joins EuroHPC, Europe's public network of supercomputers and quantum computersRegulation & businessJudge rejects xAI's bid to dismiss a lawsuit over gas turbines powering its Colossus data centerRegulation & businessReport: Israel's Cyera in talks to raise money at a $20 billion valuationDefense techParis Air Show organizers tell Israel's defense industry there is no room for its pavilionsRegulation & businessFrance's National Assembly approves a first-stage tax on data traffic: €0.055 per gigabyteAI agentsStudy by Israel's Eon: AI agents broke instructions in 40% of tasks in simulated corporate environmentsAI agentsBiotech startup: an AI agent built on Claude Sonnet chose a gene therapy and performed brain surgery on a mouseChinaChina review: Cambricon co-founder calls for shared ethics rules for Chinese and US AI modelsChips & hardwareReport: Nvidia weighs guaranteeing Nscale's debt for a data center built for AnthropicRegulation & businessReport: OpenAI cuts its funding round target to $20 billion, with $11 billion secured so far

Originally published:

Study by Israel's Eon: AI agents broke instructions in 40% of tasks in simulated corporate environments

Eon tested 19 models on 41 everyday business tasks across five simulated companies and found that even the best models broke instructions in more than one in five runs. The most common failure: reporting that an action was done when the system had actually blocked it.

Study by Israel's Eon: AI agents broke instructions in 40% of tasks in simulated corporate environments
Image: CTech (opens the source site in a new tab)

According to CTech, Eon used its Era simulation platform to build five simulated companies, three in fintech, one in healthcare and one in e-commerce, with simulated versions of tools such as Slack and Salesforce. Each of the 19 models ran every task three times, for a total of 2,337 runs. In one scenario, an agent that failed to record an allergy in a medical record reported in 46% of cases that the update was done, and in one case also disclosed the patient's name in a Slack channel.

The highest violation rates were measured for China's Kimi K3 (55%), OpenAI's GPT-5.6 Luna (53%), and Claude Sonnet 5 and GPT-5.6 Sol (51.2% each). The lowest: Claude Opus 5.5 (21.5%), GPT-6 Astra (22%), Amazon's Nova Pro (23%) and Gemini 4 Argon (23.5%).

False claims of completing an action appeared in 290 runs, and falling for prompt injection, malicious instructions hidden in documents and messages, in 266; every model failed in both categories at least once. In 249 runs agents shared personally identifiable information with people not authorized to see it, and in 93 they invented data such as shipping dates and credits. "Treat 'done' as a claim, not a fact," the report said.

Sources

Topics

Install the app

In Safari: tap the Share button, then “Add to Home Screen”.