The Dynamics of Intelligence Explosions
Provides rigorous mathematical framework for understanding AI self-improvement feedback loops and their limits.
AI Summary
Toby Ord's arXiv paper analyzes the mathematical dynamics of intelligence explosions, showing singular growth requires generation time to approach zero.
Excerpt
AI is increasingly being used to help with AI R&D. Under certain conditions this feedback loop might be able to produce an intelligence explosion, with rapidly escalating AI capabilities. I explore the mathematics of the most explosive possibilities, with an eye to understanding what drives the dynamics. I show that singular growth (towards a vertical asymptote) is harder to achieve than would be expected from recent economics-inspired modelling, and that there is an important but neglected