Tool · curated 29 Jun 2026
GitHub - bastion-soft/pi-detector-bench: Open, model-agnostic benchmark for prompt-injection detectors — scored on both axes (attack catch-rate and false positives on real traffic), threshold-agnostic, and reproducible from raw scores.
First reported github.com
Coverage timeline
Single-source research — first reported, latest, and curated coincide.
Why it matters
Defenders evaluating or selecting prompt-injection detection tooling can use a reproducible benchmark to compare detector effectiveness and false-positive rates.
pi-detector-bench is an open, model-agnostic benchmark from bastion-soft for evaluating prompt-injection detectors, scoring both attack catch-rate and false positives on real traffic, with threshold-agnostic, reproducible results. It is published as a runnable GitHub repo with notebooks, scripts, and results.