VLA-Replica
Abstract Vision-Language-Action (VLA) models have shown strong promise for general-purpose robotic manipulation, but their real-world evaluation remains limited by a lack of accessible, reproducible, and consistent benchmarks. Simulation benchmarks fail to capture real-world complexity, while existing real-world benchmarks often require expensive hardware, centralized evaluation, or are limited i
Abstract Vision-Language-Action (VLA) models have shown strong promise for general-purpose robotic manipulation, but their real-world evaluation remains limited by a lack of accessible, reproducible, and consistent benchmarks. Simulation benchmarks fail to capture real-world complexity, while existing real-world benchmarks often require expensive hardware, centralized evaluation, or are limited in task diversity. We introduce VLA-REPLICA, a low-cost, easily reproducible real-world benchmark for evaluating VLA models. Built from off-the-shelf components, our system can be quickly assembled…
related reading
- State of Vision-Language-Action (VLA) Research at ICLR 2026 – Moritz Reussmbreuss.github.io
- SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningalphaxiv.org
- How Claude Performs on Robotics Tasks \ Anthropicanthropic.com
- A VLA with Open-World Generalizationpi.website
- [2510.13626] LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelsarxiv.org
- Precise Manipulation with Efficient Online RLpi.website
- Beyond Human Demonstrations: Diffusion-Based Reinforcement Learning to Generate Data for VLA Trainingalphaxiv.org
- Sporks of AGIsergeylevine.substack.com
- Pretrained to Imagine, Fine-Tuned to Act: The Rise of World-Action Models | NVIDIA Technical Blogdeveloper.nvidia.com
- Helix: A Vision-Language-Action Model for Generalist Humanoid Controlfigure.ai
- Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
- State of Robot Learning, December 2025vedder.io