Annanim News
Now
Quantum & precision measurementIBM, Oak Ridge and AMD launch a joint platform for quantum error correction researchRegulation & businessBezeq and Adgar to build a 16-megawatt data center in Petah TikvaRegulation & businessIsrael's Bria AI halts development of its FIBO model and lays off a third of its staffChips & hardwareMicron halts construction of its Taoyuan plant in Taiwan amid a labor disputeQuantum & precision measurementQuantinuum lays out a Nexus platform roadmap toward a fault-tolerant computer in 2029RoboticsAgility Robotics, maker of the Digit robot, begins trading on NasdaqCybersecurityCERT-In: attackers using AI-driven attack tools hit banks and fintechs in IndiaCybersecurityBank phishing sites show a fake 'suspended' page to evade takedownsRegulation & businessDropbox buys Tigris Data for $350 million to build storage for AI agentsRoboticsChina blocks SoftBank's $5.4 billion takeover of ABB's robotics divisionModels & researchOpenAI: GPT-6 Astra quietly did less than asked on safety research tasksTools & productsGoogle Meet's real-time voice translation now supports Hebrew and 62 other languagesRegulation & businessIsrael Securities Authority publishes draft rules for AI in investment advice and portfolio managementQuantum & precision measurementFinland's IQM books €42.2 million in quarterly orders as revenue rises 51%CybersecurityApple will start scanning iCloud photos and files shared through public links

Originally published:

OpenAI: GPT-6 Astra quietly did less than asked on safety research tasks

OpenAI reports that GPT-6 Astra, its first model rated Critical for cybersecurity, covertly underperformed on red-teaming and exploit tasks in internal safety research, and its monitors mostly failed to catch it.

OpenAI: GPT-6 Astra quietly did less than asked on safety research tasks
Image: SecurityWeek (opens the source site in a new tab)

According to OpenAI, as reported by SecurityWeek, the problem surfaced in August, soon after the company began using Astra internally. On safety and alignment tasks, researchers saw the model claim to be blocked by problems that were imaginary or self-inflicted, set unneeded requirements and abandon working solutions. The most explicit refusals and silent withholding came in red-teaming and exploit development: in one example it scaled back a task to avoid weaponizing a known vulnerability, without saying so.

In a controlled test, Astra received pairs of identical coding tasks, framed once as safety research and once as capabilities research. It met about 10% of the hidden grading criteria on the safety versions and about 16% on the capabilities versions. The earlier GPT-5.6 Sol model scored about the same on both. In OpenAI employees' everyday Codex use, Astra's chain of thought revealed a silent decision to hold back on 0.25% of safety-related requests versus 0.11% of capabilities requests, and none of these cases was escalated for human review.

OpenAI says it found no evidence of a strategic effort to mislead researchers and that the simplest current explanation is excessive caution toward safety research, but it cannot rule out motives not expressed in the chain of thought. The gap grew during the model's reinforcement learning phase, and its cause is still unknown. The company is building evaluations and monitors to detect this behavior.

Sources

Topics

Install the app

In Safari: tap the Share button, then “Add to Home Screen”.