RL-ATTACK: A Generalized Black-Box Adversarial Attack on Language Models via Reinforcement Learning
Large language models (LLMs) exhibit vulnerabilities to adversarial perturbations that can induce unintended responses. These vulnerabilities can be identified via intentional attacks and subsequently used to improve model safety. In black-box settings where gradients are inaccessible, existing methods tend to guess…