Research
Prevented is Not Protected: What Attack Success Rate Hides about RAG
Publication date unknown · Discovered arxiv.org
Page published
Publication date unknown · First observed: 17 Nov 2026
Coverage timeline
Single-source research — one report is available.
Why it matters
Aligned RAG Evaluation shows why defenders evaluating RAG poisoning protections should measure defense-induced failures and model endorsement rather than rely solely on attack success rate.
Prevented is Not Protected introduces Aligned RAG Evaluation, a protocol comparing matched clean and poisoned queries with and without defenses to distinguish prevented attacks from defense-induced failures. Experiments on HotpotQA and Natural Questions find that defenses can introduce unexpected target-positive answers and that evaluation criteria can change defense rankings.