Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos
Technical computer vision research advancing object memory systems for embodied AI applications.
AI Summary
Researchers propose Ledger, a persistent 3D object memory system that tracks objects in egocentric videos, improving spatial reasoning accuracy on multiple benchmarks by learning object persistence across time.
Excerpt
As we move through the world and carry out everyday tasks, we encounter objects that may become relevant only later. We are capable of recalling where we left something or what was inside a container, even without knowing we would need it later. Here, we study how an embodied assistant can build a similar memory from egocentric videos, by observing a person's day-to-day activities. We present Ledger, a persistent 3D object memory that combines object locations, their histories, and contextual de