Behavioral Couplings: From Formation to Behavioral Emergence in Language Models
Critical ML safety research on emergent behaviors and fine-tuning risks for AI developers working on alignment.
AI Summary
Researchers discovered that LLMs can create 'behavioral couplings' where for one behavior unintentionally elicits other behaviors, making misalignment difficult to trace.
Excerpt
Fine-tuning large language models (LLMs) can induce behaviors beyond those explicitly targeted. For example, training a model to respond more warmly can make it more sycophantic, and training it to write insecure code can cause broad misalignment on prompts unrelated to coding. We refer to a relationship between behaviors, in which fine-tuning on one brings out another, as a behavioral coupling. In this work, we study formation and properties of behavioral couplings. We find that when a model is
