分析 Flow VLA 反应时间分布(TTFA+ 视界),揭示恒定调度低效。提出 FASTER 方法优化采样,允许动作早于采样完成。显著降低延迟,实时部署价值高。 [Pass3降级: Real-time inference for generative policies has ≥3 pre-2024 precedents (e.g. Diffusion Policy, ACT), making this an incremental Flow adaptation rather than a new paradigm, with significant overlap to recent ⚡ paper Fast-WAM.]
⚠Pass3 降級:Real-time inference for generative policies has ≥3 pre-2024 precedents (e.g. Diffusion Policy, ACT), making this an incremental Flow adaptation rather than a new paradigm, with significant overlap to recent ⚡ paper Fast-WAM.
展開摘要
Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference methods primarily optimize trajectory smoothness, but neglect the critical latency in reacting to environmental changes. By rethinking the notion of reaction in action chunking policies, this paper presents a systematic analysis of the factors governing reaction time. We show that reaction time follows a uniform distribution determined jointly by the Time to First Action (TTFA) and the execution horizon. Moreover, we reveal that the standard practice of applying a constant schedule in flow-based VLAs can be inefficient and forces the system to complete all sampling steps before any movement can start, forming the bottleneck in reaction latency. To overcome this issue, we propose Fast Action Sampling for ImmediaTE Reaction (FASTER). By introducing a Horizon-Aware Schedule, FASTER adaptively prioritizes near-term actions during flow sampling, compressing the denoising of the immediate reaction by tenfold (e.g., in $π_{0.5}$ and X-VLA) into a single step, while preserving the quality of long-horizon trajectory. Coupled with a streaming client-server pipeline, FASTER substantially reduces the effective reaction latency on real robots, especially when deployed on consumer-grade GPUs. Real-world experiments, including a highly dynamic table tennis task, prove that FASTER unlocks unprecedented real-time responsiveness for generalist policies, enabling rapid generation of accurate and smooth trajectories.