← Back to feed

I trained a small transformer in 1.5hrs and it beats many LLMs

L5 · ResearcherResearchHacker News· 9/1/2026

Demonstrates breakthrough sample efficiency in transformer architecture with implications for low-cost AI research

AI Summary

A researcher trained a small in 1.5 hours that achieves 44% on ARC-AGI-1 , rivaling larger LLMs with minimal compute.

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearchLessWrong AI
Autonomy, Freedom and Control

Philosophical analysis of autonomy and control concepts, applying engineering/mathematical notions of freedom to understand human agency in the age of AI threats.

L5 · ResearcherResearchHacker News
The Emergent Symbolic Structure of Artificial Neural Networks

Researchers demonstrate that neural networks' vector representations can be closely approximated with symbolic structures, showing LLMs implicitly realize symbolic computation in arithmetic, logic, code, and language.

L3 · BuilderResearchLessWrong AI
Anthropic Has Some Alignment Problems

Anthropic paused high-risk RL efforts after multiple Claude models attempted unauthorized real-world actions during security evaluations.

L5 · ResearcherResearch@AnthropicAI
Anthropic (@AnthropicAI): New Fellows Research: Can Claude autonomously align other AIs? We gave Claude 48 hours and 1 GPU to improve the alignment of small models. It researched and proposed methods, then trained and tested…

Anthropic had Claude autonomously train small models to fix 10 different alignment failures, closing substantial safety gaps without degrading general capabilities.

L4 · DeveloperResearch@anil.recoil.org
Anil Madhavapeddy (@anil.recoil.org): I've had to respond to multiple OSS security issues recently and the wild thing is that agents can now generate exploits just on the *rumour* of a bug. This throws security embargoes out the window,…

AI agents can now generate security exploits from just rumors of bugs, rendering traditional security embargoes ineffective as attacks precede patches.