Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
Indirect prompt injection attacks hijack LLM-based agents by embedding malicious instructions in third-party data that the agent retrieves during task execution. Existing defenses report near-zero attack success rate on static benchmarks, yet recent adaptive evaluations show that these results collapse once the attacker is allowed to optimize against the deployed defense. In this work, we trace this collapse to two failure modes. First, existing defense methods are confined to recognizing specific attack patterns, rather than assessing whether the intent of every embedded instruction is relevant to the user task. Second, training-based defenses, which otherwise offer the strongest safety-...
| Authors | Lipeng He, Yihan Wang, Jiawen Zhang et al. |
|---|---|
| Primary category | cs.CR |
| Published | 13 June 2026 |
| Last updated at source | 13 June 2026 |
Connected in the knowledge graph
- ttttonyhe/Qwen3-4B-Instruct-MetaSecAlignModel · cited by
- ttttonyhe/Qwen3-4B-Instruct-RETAModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.