← Back to feed

Ethan Mollick (@emollick.bsky.social): Randomized trials with GPT-4o: "AI access raises test scores, and a smaller gain persists a week later. Gains remain for students who use AI as a tutor (“augmentation”) and fade for students who have…

L5 · ResearcherResearch@emollick.bsky.social· 10/9/2026

Provides experimental evidence on AI's educational impact with clear differentiation between augmentation vs automation effects.

AI Summary

Randomized controlled trial shows GPT-4o access improves student learning outcomes, with persistent gains when used as a tutor but fading benefits when used for automation.

Excerpt

Randomized trials with GPT-4o: "AI access raises test scores, and a smaller gain persists a week later. Gains remain for students who use AI as a tutor (“augmentation”) and fade for students who have AI write for them (“automation”)" Across all experiments, positive effects arxiv.org/abs/2607.08849

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearchLessWrong AI
New Math from OpenAI

OpenAI released 722 mathematical proofs generated by an internal frontier model, including solutions to 90 top open problems from Proof of Atlas.

L5 · ResearcherResearchThe Verge AI
‘Pure insanity’: Mathematicians will need years to make sense of OpenAI’s latest drop

OpenAI released nearly 400 AI-generated mathematical results across 700 manuscripts, overwhelming mathematicians who say it could take years to verify and understand the implications.

L5 · ResearcherResearchLessWrong AI
What can language models teach us about understanding?

The author proposes developing a mathematical theory of 'intuition' inspired by language models, aiming to establish a formal framework similar to how logic and computation were formalized historically.

L5 · ResearcherResearcharXiv
WOVEN: Weaving Visual World Modeling into Multimodal LLMs

Researchers introduce WOVEN, a benchmark and training method that improves multimodal LLMs' visual transition reasoning capabilities by up to 27.3 percentage points on external benchmarks.

L5 · ResearcherResearchLessWrong AI
AI Scaling vs Human Scaling

Examines whether AI models scale as efficiently with additional tokens as humans do with more time, questioning if token scaling requires disproportionate increases.