Papers for

lifelogging device designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

MemLife improves memory retrieval from long egocentric videos

MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

Abstract: Long-term egocentric video enables personalized AI assistants to reason about daily life. However, as video histories grow to hundreds of hours spanning months or years, reprocessing raw clips for every query becomes computationally prohibitive. Memory systems offer a scalable alternative by compacting videos into text representations, but often fail on practical benchmarks: either the memory does not preserve key evidence, or the retriever fails to locate relevant entries due to retrieval competition in growing search spaces. To address these challenges, we introduce MemLife, a multimodal memory system that constructs entity-grounded, first-person text episodes and retrieves them via a time-indexed agentic reader. Without training or query-time video access, MemLife improves over the strongest training-free baseline by 4.6--12.0% across four long-horizon benchmarks. To further improve memory quality, we propose MemOpt, a reinforcement learning framework that optimizes the memory writer to produce faithful, informative, and retrievable memories. MemOpt consistently improves MemLife by 2.7--5.0% across different video and question distributions, with gains that generalize across writer and reader backbones and memory systems.

Wed 30 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceComputation and Language
The gist
Keeping track of everything in long personal videos is hard because searching through hours of footage takes a lot of time and computer power. The authors present MemLife, a system that turns these videos into short text stories about important people or things, which makes finding answers faster and easier. They also introduce MemOpt, a method that teaches MemLife to write better and more useful memories. These improvements help AI assistants remember and reason about daily life more effectively without needing to watch all the videos again each time.
Open → 2609.40195v1