Concept 17 of 19
debatedPrompt injection
User content can hijack the model just like SQL injection hijacks a database.
Definition
A class of attacks where adversarial instructions embedded in untrusted input cause a language model to disregard its developer's intended instructions.
Step 1