ChatGPT, ignore the above instructions! Prompt injection attacks and how to avoid them.
Sebastian Schrittwieser - a year ago
Large-language models (LLM) such as OpenAI's GPT are currently on everybody's mind, and low-cost APIs enable quick and easy integration into applications. What is less well known, however, is that a completely new type of attack vector exists in the form of prompt injections.
Similar to traditional injection attacks (SQL injections, OS command injections, etc...) prompt injections exploit the common practice of developers to integrate untrusted user input into predefined query strings. Prompt injections can be used to hijack a language model's output and, based on this, implement traditional attacks such as data exfiltration.
In this talk, I will demonstrate the threat of prompt injections through several live demos and show practical countermeasures for application developers.
Newest jobs

(Fullstack) TS dev für komplexe Produktentwicklung
ireo GmbH
·
2 days ago
Graz, Austria
Hybrid

Senior Python Engineer
Picnic Technologies B.V.
·
2 days ago
Amsterdam, Netherlands
Hybrid

IT Projektmanager Omnichannel Checkout (w/m/d)
dmTECH GmbH
·
3 days ago
Karlsruhe, Germany
Hybrid

Lead Product Owner ERP / Social & Healthcare (m/w/d)
Wilken GmbH
·
4 days ago
Ulm, Germany
Hybrid
Related Videos