I Spent $500 To Test Devin AI For Prompt Injection So That You Don't Have To
MentionsGitHub
Today we cover Devin AI from Cognition, the first AI Software Engineer. We will cover Devin proof-of-concept exploits in multiple posts over the next few days. In this first post, we show how a prompt injection payload hosted on a website leads to a full compromise of Devin’s DevBox.
Summary from Embrace The Red.
Explained
The technology and terms in this story. Learn more
- AttackPrompt injectionHiding instructions in content an AI reads, so it follows the attacker instead of its user.
- ConceptProof of conceptA demonstration that a flaw can be exploited, usually published by researchers.
- AttackRemote code execution · RCEA flaw that lets an attacker run their own code on someone else's machine over the network.
- ConceptExploitCode or a technique that turns a software flaw into something an attacker can actually use.