Analysis
Is indirect prompt injection still a big threat as models get more advanced? | Hi, I am Nishant J.
Publication date not yet evaluated · Added · 2 reports realarcherl.github.io
Page published
Coverage timeline
Why it matters
Indirect prompt injection remains an unsolved, general-case weakness in LLM-driven agents, and this analysis quantifies how unevenly different frontier models resist it—useful for defenders choosing and hardening agentic deployments.
An analysis by Nishant J. examines whether indirect prompt injection remains a serious threat as frontier models improve, drawing on Anthropic's Claude Opus 5 system card benchmarks that show attacker success within 15 attempts dropping to 2.0% for Opus 5 versus 16.5%–43.9% for various non-Claude models. The piece argues that while newest models resist current web-planted injection attempts (which remain crude and mostly fail), the threat persists for weaker models and that criminals have begun using injection to steal API keys.