The Continual Constitutional Convention: How language models revise the documents that govern them
Explores advanced AI alignment techniques through simulated value reflection processes relevant to AI safety research.
AI Summary
Researchers simulate moral progress in AI systems by having language models recursively revise their own governing documents like constitutions and system prompts.
Excerpt
Executive Summary Human societies exhibit broad shifts in values and norms over time, often driven by moral disagreements. One way of understanding moral progress is the resolution of these disagreements through a process of reflection by rational agents. Frontier AI companies use documents such as constitutions, model specs, and system prompts to guide the moral orientation of AI systems. In this experiment, we simulate value reflection in LLMs by asking them to edit these documents. We provid