I trained a small transformer in 1.5hrs and it beats many LLMs
Demonstrates breakthrough sample efficiency in transformer architecture with implications for low-cost AI research
AI Summary
A researcher trained a small in 1.5 hours that achieves 44% on ARC-AGI-1 , rivaling larger LLMs with minimal compute.
