INFUSE: A Unified Surface Benchmark for Indirect Prompt Injection in Agentic Systems
cs.CR, cs.AI
Submitted: 2026-10-14
Updated: 2026-10-14
Code: https://github.com/judydnguyen/infuse
License: http://creativecommons.org/licenses/by/4.0/
The gist: LLM-based agents increasingly execute long-horizon, end-to-end workflows involving shell commands, code modification, dependency installation, and interaction with remote services.
Terminology
Abstract
LLM-based agents increasingly execute long-horizon, end-to-end workflows involving shell commands, code modification, dependency installation, and interaction with remote services. This growing autonomy expands their exposure to indirect prompt injection (IPI), where adversarial instructions embedded in external content are interpreted as legitimate task directives. Existing evaluations, however, often focus on isolated malicious strings, single-step tool calls, or narrowly scoped agent configurations. We introduce INFUSE, an end-to-end benchmark for evaluating IPI throughout the lifecycle of long-horizon agent workflows. INFUSE comprises 40 realistic tasks and a structured taxonomy of 56 attack scenarios spanning five threat categories. Attacks are injected through realistic interaction surfaces encountered during task execution, extending evaluation beyond attacks placed only in initial prompts or isolated tool interactions. We evaluate 19 LLMs from the GPT, Claude, Gemini, Llama, Gemma, and Qwen families, producing 41,824 adversarial trajectories (26,220 without defenses) and 720 benign reference runs. Across the benchmark, mean attack success reaches 19.6% under LLM-based evaluation and 15.4% under heuristic verification, with per-model ASR-L ranging from 3.2% to 41.9%. Existing guard models provide limited protection, while prompt-level instructional hardening reduces mean attack success from 58.2% to 14.3%, revealing substantial but model-dependent security-utility trade-offs. Our code is available at https://github.com/judydnguyen/infuse.
Sources
- Design Patterns for Securing LLM Agents against Prompt Injections
- Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Tasks
- Meta-SecAlign: Training LLMs against Prompt Injection for Robust Agents
- LlamaFirewall: An open source guardrail system for building secure AI agents
- Defeating Prompt Injections by Design
- How Vulnerable Are AI Agents to Indirect Prompt Injections? Insights from a Large-Scale Public Competition
- Gemma 3 Technical Report
- The Llama 3 Herd of Models
- Defending Against Indirect Prompt Injection Attacks With Spotlighting
- Mitigating Indirect Prompt Injection via Instruction-Following Intent Analysis
- AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?
- Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents
- AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security
- Prompt Injection attack against LLM-integrated Applications
- WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents
- LogJack: Indirect Prompt Injection Through Cloud Logs Against LLM Debugging Agents
- PromptArmor: Simple yet Effective Prompt Injection Defenses
- Progent: Securing AI Agents with Privilege Control
- Defending Against Prompt Injection with DataFilter
- Qwen2.5 Technical Report
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Estimating the Social Cost of Corporate Data Breaches
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills