Kids outlearn AI—and we still don’t know why
Examines a core challenge in AI model training that questions fundamental architectural approaches and has long-term implications for scaling.
AI Summary
Children learn language far more data-efficiently than AI models, using just 100-300 million words compared to models' trillions, highlighting a fundamental gap in how language is acquired.
Excerpt
People have been talking to each other for at least 100,000 years, as best we can tell. And in all that time, there has been only one thing in the world that could learn a human language to perfect fluency: a human child. Now there are two. Four short years after the release of ChatGPT,…
