Know What's Happening in AI

NVIDIA Adds Cosmos Policy to Its World Foundation Models

NVIDIA introduced Cosmos Policy, a post‑trained robot control policy built on its Cosmos Predict‑2 world foundation model. By encoding actions, future states and reward signals as latent video frames, the single diffusion‑based model achieves state‑of‑the‑art results on the LIBERO and RoboCasa benchmarks. The approach requires only one fine‑tuning stage on demonstration data and can operate either as a direct policy or as a model‑based planner. Real‑world tests on the ALOHA robot show reliable long‑horizon manipulation.