No, Your Tools Are Not Enough: It's Time to Bring Agents to the Hunt
cs.CR
Submitted: 2026-10-10
Updated: 2026-10-10
Code: https://github.com/apple-oss-distributions/xnu
Project page: https://google.github.io/security-research/kernelctf/rules.html
License: http://creativecommons.org/licenses/by/4.0/
The gist: Modern software systems are large and complex, demanding scalable and autonomous techniques for vulnerability discovery.
Abstract
Modern software systems are large and complex, demanding scalable and autonomous techniques for vulnerability discovery. Existing approaches still depend on human expertise for domain knowledge, and on human intervention throughout the process of vulnerability discovery. AI agents offer us an opportunity to make vulnerability discovery more adaptive, scalable, and autonomous. Agents bring the ability to make continuous decisions and adapt, and general knowledge that can be augmented. In this paper, we present our experience using AI agents to find vulnerabilities across diverse programs such as Windows drivers, the Linux kernel, XNU, firmware, and web applications. We use an iterative agentic workflow and find that it generalizes across these targets. We discuss tasks that agents help with, which were previously challenging, and some future research directions we consider important for advancing autonomous vulnerability discovery.
Sources
- Mistral 7B
- ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents
- IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilities
- ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?
- Qwen3 Technical Report
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs