The Dynamics of Intelligence Explosions
Critical analysis of intelligence explosion dynamics for AI safety researchers and theorists
AI Summary
Toby Ord explores the mathematical dynamics of intelligence explosions where AI assists AI R&D, showing singular growth is harder than economic models suggest.
Excerpt
Toby Ord [1] Abstract AI is increasingly being used to help with AI R&D. Under certain conditions this feedback loop might be able to produce an intelligence explosion, with rapidly escalating AI capabilities. I explore the mathematics of the most explosive possibilities, with an eye to understanding what drives the dynamics. I show that singular growth (towards a vertical asymptote) is harder to achieve than would be expected from recent economics-inspired modelling, and that there i
