Labs’ current alignment plans seem terrible
Critical analysis of alignment strategy for researchers working on AI safety and catastrophic risk prevention.
AI Summary
Frontier AI companies' current plans center on rushing towards RSI with current models, which many believe will have catastrophic consequences.
Excerpt
Tl;dr: The frontier AI companies’ implicit alignment plans center on rushing towards RSI with something like current models. This plan is (at best) contentious, and many believe it will have catastrophic consequences. Nonetheless, it is the track we are on. It is therefore important to collect evidence which helps us anticipate how this will go. — Note: This post is based on conversations inside the Arcadia Impact alignment team, thinking about what constitutes “good” work in third-party alignme
