Defending against Prompt Injection with Structured Queries (StruQ) and Preference Optimization (SecAlign)
• LLMs power new apps but prompt injection is top OWASP threat. • Attack injects malicious instructions into untrusted data, overriding trusted prompts. • Real-world examples: Yelp