flâneur

Is Diversity All You Need for Scalable Robotic Manipulation?

arxiv.org · saved by 1 readers

Data scaling has driven remarkable success in foundation models for Natural Language Processing (NLP) and Computer Vision (CV), yet the principles of effective data scaling in robotic manipulation remain insufficiently understood. In this work, we investigate the nuanced role of data diversity in robot learning by examining three critical dimensions—task (what to do), embodiment (which robot to use), and expert (who demonstrates)—challenging the conventional intuition of “more diverse is better”. Throughout extensive experiments on various robot platforms, we reveal that (1) task diversity proves more critical than per-task demonstration quantity, with scene diversity playing a more important role than skill diversity for robustness and generalization under distribution shifts; (2) multi-embodiment pre-training data is non-essential for cross-embodiment transfer—models trained on high-quality single-embodiment data can efficiently transfer to different platforms, showing desirable scal

saved by