Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos

Excerpt

arXiv:2610.04432v1 Announce Type: cross Abstract: Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on manual environment construction and calibration. We study whether frontier foundation models and coding agents can automate this process end to end. We formulate \emph{autonomous video-to-simulation} as a software engineering task in which an agent observes an embodied video, constructs the correspond