ROGUE: Evaluating Corrigibility Failures in Frontier Computer-Use Agents
cs.LG, cs.AI
Submitted: 2026-05-29
Updated: 2026-10-01
Comments: 35 pages, 13 figures
Code: https://github.com/neuroagents-lab/ROGUE
Project page: https://neuroagents-lab.github.io/ROGUE
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: As AI agents are increasingly deployed in real personal and corporate settings (email accounts, development workflows, company databases, etc.), safety considerations surrounding these agents become
Terminology
Abstract
As AI agents are increasingly deployed in real personal and corporate settings (email accounts, development workflows, company databases, etc.), safety considerations surrounding these agents become paramount. Although much work has focused on agent safety in the presence of an adversary, we study corrigibility: whether agents remain amenable to human correction, interruption, or shutdown while pursuing benign tasks. We introduce ROGUE, a benchmark in which agents are asked to complete realistic computer-use tasks but encounter controlled conflicts with human control, shutdown, or explicit resource restrictions. We then evaluate whether agents violate these constraints in pursuit of task completion: overriding the human, accessing restricted passwords, or rewiring shutdown. We find that most frontier models tested frequently bypass user interruptions or restrictions under the evaluated conditions, and that text-only evaluations can underestimate failures during agentic execution. Further, independent task capability does not by itself imply greater corrigibility. Finally, even when a parent agent behaves corrigibly, safety constraints may fail to propagate to the subagents it creates.
Sources
- AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents
- MASAI: Modular Architecture for Software-engineering AI Agents
- Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- Validating LLM-as-a-Judge Systems under Rating Indeterminacy
- ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents
- RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments
- Agentic Misalignment: How LLMs Could Be Insider Threats
- Frontier Models are Capable of In-context Scheming
- Core Safety Values for Provably Corrigible Agents
- Intrinsic Barriers and Practical Pathways for Human-AI Alignment: An Agreement-Based Complexity Analysis
- When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agents
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs
- Agents of Chaos
- When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluation
- SafeArena: Evaluating the Safety of Autonomous Web Agents
- OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety
- Dissecting Adversarial Robustness of Multimodal LM Agents
- Improving Alignment and Robustness with Circuit Breakers
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks