ω-0: One Humanoid Policy for Manipulate-While-Moving Chores
Household humanoids do not fail only on grasp precision. They fail when wiping needs a step, mopping needs a lean, or fridge retrieval needs bend-plus-reach as one motion. ω-0 (omega-0), a preprint from NTU, PKU, BAAI, and HKUST(GZ) posted August 6, 2026 (arXiv:2608.06375), treats that as the product: concurrent loco-manipulation from a single whole-body world-action model.
What the model does
Given a language instruction, visual observation, and robot proprioception, ω-0 predicts controller-compatible whole-body action latents for real-robot execution via the SONIC low-level controller. It does not reconstruct future video as the main path. Instead it learns compact future observation embeddings as a light predictive objective, then couples that foresight with diffusion-based whole-body action generation.
Inputs can be egocentric RGB, exocentric RGB, or exocentric depth. Training grounds human and public visual-motion priors into robot-executable latents through controller-based simulation replay, then fine-tunes on real hardware data.
ω-HOME and the 11-task suite
The team collected ω-HOME: about 40.3 hours, 4,827 episodes, and 24 tasks at 30 Hz, with synchronized multi-view RGB-D, SMPL whole-body motion, robot state, and action latents. Teleop uses a Pico headset and trackers, Inspire dexterous hands, and ZED cameras.
Evaluation focuses on 11 household loco-manipulation tasks — table wipe, floor mop, laundry, fridge drink, multi-height trash, and more — under one multi-task policy (not eleven specialists). The abstract reports that a single ω-0 model produces smooth manipulate-while-moving behavior and outperforms representative imitation learning, VLA, humanoid, and WAM baselines under the paper’s protocol. HTML tables put the full omni variant at the top of the suite on success rate, subtask score, and task progress among listed methods.
A Human’s Take
I care less about another arm-only VLA and more about whether the base and torso show up in the same action chunk when the table is wider than the reach envelope. ω-0’s design bet — latent foresight instead of a full video world model at runtime — is the right engineering trade for a biped that has to keep balance while it wipes. The next receipt I want is third-party hardware hours outside the authors’ kitchen lab, on a platform that is not already wired for SONIC.