New 'CoFiBreak' Framework Enhances LLM Jailbreak Diversity
Researchers introduced CoFiBreak, a reward mechanism for training attacker LLMs that forces a higher diversity of jailbreak strategies. By using a coarse-to-fine reward structure in Group Relative Policy Optimization, the method avoids the typical reinforcement learning collapse where models converge on a narrow set of repetitive prompts.