发现信息

  • 作者:Sizhe Chen, Yu-Lin Tsai, Ivan Evtimov, Kamalika Chaudhuri, Raluca Ada Popa, David Wagner, Arman Zharmagambetov
  • 年份:2026
  • 发表源:ACM Workshop on Artificial Intelligence and Security (AISec)
  • OpenAlex ID:https://openalex.org/W7211868593
  • DOI:https://doi.org/10.1145/3847352.3848100
  • arXiv:待核验
  • 检索主题:memory-evaluation
  • OpenAlex 引用数快照:2(2026-11-12)

摘要线索

Prompt injection is widely recognized as a major security threat to AI agents that interact with untrusted external data, such as websites, documents, and emails. Prior work has shown that, in the text domain, black-box prompt injection can achieve near-perfect attack success rates (ASRs). In the image domain, however, existing visual prompt injection methods are substantially less effective in attacking frontier commercial VLMs for materially harmful behavior. Achieving such outputs is hard because it requires a long and/or format-compliant target string, such as a precise, parseable native tool call with exact function names and arguments. We present Repeat-After-Me, a black-box adaptive visual prompt injection attack that can reveal personally identifiable information or make malicious tool calls. Across both open-weight and commercial frontier VLMs, including Qwen3.6-27B and GPT-5.5, our method achieves ASRs exceeding 82% and 47%, respectively, under a realistic setting in which the benign user prompt is semantically unrelated to the injected task and does not verbally authorize it. Our optimized injection has non-trivial attack transferability across commercial VLMs and benign samples. We show our attack works in cases where adaptive textual prompt injection fails. In a real-world OpenClaw agent connected to Discord, an untrusted user can use a minimally injected image from our attack to overwrite TOOLS.md , enabling future sensitive behaviors like remote code execution and secret exfiltration. We discuss potential defenses.

核验与筛选

  • 当前状态:待筛选、去重和一手来源核验。
  • OpenAlex 元数据和引用数只用于发现,不作为正式引文或质量判断。
  • 记录正式版本、venue、方法细节、实验协议和局限后,才迁入稳定论文卡片。