Holi-World: Building Holistic World Intelligence from Human-Ego Experience

What this work does

Holi-World converts egocentric recordings into a shared representation of persistent scene structure and changing object states. Automatically generated grounding and question-answer supervision trains a vision-language model, while independent human annotations evaluate record quality and learned reasoning.