Benchmarking and Defending against Indirect Prompt Injection Attacks on Large Language Models | Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1

PromptShield is a benchmark introduced in an ACM SIGKDD paper for training and evaluating deployable prompt injection detectors, curated to include both conversational and application-structured data. The authors also fine-tune a new prompt injection detector that achieves higher performance in the low false-positive-rate regime than prior schemes.