ProtoArena: Can AI Agents Discover and Exploit Real-World Cross-Component Protocol Vulnerabilities?

arXiv:2610.17837 · cs.CR, cs.AI · Submitted 2026-10-13 · Read on arXiv

cs.CR, cs.AI

Submitted: 2026-10-13

Updated: 2026-10-13

Comments: 18 pages, 5 figures

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• AI Agents — 1× in this paper · explained in 2 episodes

Sources

• Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models
• ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents
• NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security
• ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?
• InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback

Related papers

• SoK: AI-Augmented Binary Reversing
• Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
• Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
• Efficient Fuzzy PSI under One-Sided Assumptions
• Sealing the Audit-Runtime Gap for LLM Skills
• Token Composition: A Graph Based on EVM Logs