Research

Prevented is Not Protected: What Attack Success Rate Hides about RAG

Page published

Publication date unknown · First observed: 17 Nov 2026

Coverage timeline

17 Nov 2026arxiv.orgobservedprimary

Single-source research — one report is available.

Why it matters

Aligned RAG Evaluation shows why defenders evaluating RAG poisoning protections should measure defense-induced failures and model endorsement rather than rely solely on attack success rate.

Prevented is Not Protected introduces Aligned RAG Evaluation, a protocol comparing matched clean and poisoned queries with and without defenses to distinguish prevented attacks from defense-induced failures. Experiments on HotpotQA and Natural Questions find that defenses can introduce unexpected target-positive answers and that evaluation criteria can change defense rankings.