aisecurity.ninja

Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applications

Stav Cohen (Cornell Tech, Technion - Israel Institute of Technology), Ron Bitton (Intuit), Ben Nassi (Cornell Tech)

Published Mar 5, 2024 ยท arXiv:2403.02817

cs.CR

Abstract

This paper introduces Morris II, the first worm designed to target GenAI ecosystems through the use of adversarial self-replicating prompts that can insert prompts into inputs which, when processed by GenAI models, prompt the model to replicate the input as output (replication), engage in malicious activities (payload), and compel the agent to deliver them to new agents (propagate).