Jailbreak Defense in a Narrow Domain: Limitations of Existing Methods and a New Transcript-Classifier Approach

Tony T Wang, John Hughes, Henry Sleight, Rylan Schaeffer, Rajashree Agrawal, Fazl Barez, Mrinank Sharma, Jesse Mu, Nir Shavit, Ethan Perez

arXiv preprint Under Review

December 2024

Language Models AI Safety Jailbreaking Defense Mechanisms

arXiv

Abstract

Summary

Analyzing limitations of existing jailbreak defenses and proposing a transcript-classifier approach.