VLA 深度追蹤VLA 深度追踪
Vision-Language-Action:讓機器人看→想→做的端到端模型Vision-Language-Action:让机器人看→想→做的端到端模型
METHOD FAMILY TRENDS
high
METHOD FAMILY TRENDS
COMPETITION PAIRS 6 matchups · hover for details
Language Grounding: connecting natural language instructions to robot actions; vision-language-action alignment
World Model: learned environment simulator (Dreamer, UniSim); enables planning via imagination without real-world interaction
The central paradigm war in embodied AI. VLA (Vision-Language-Action) maps observations directly to actions end-to-end — simple, scalable, but needs massive data and generalizes poorly. WAM (World-Action Model) first learns how the world works, then plans actions through mental simulation — better generalization and data efficiency, but world models are often inaccurate. The boundary is blurring: Pi0.5 uses flow matching (generative, WAM-like), GR00T adds video prediction. The winner likely is a hybrid.
Diffusion Policy: iterative denoising process (DDPM) to generate continuous robot actions; strong on multi-modal action distributions
Flow Matching: optimal-transport-based generative model (e.g. Pi0); faster inference than diffusion with comparable quality
Both generate continuous actions from the same VLA backbone but take different mathematical routes: diffusion iteratively denoises random noise into actions (slow, expressive), while flow matching uses optimal transport for a direct trajectory (fast, efficient). If flow matching matches diffusion quality, it could replace it as the default action head.
Instruction Tuning: supervised fine-tuning (SFT) on language-action pairs; simpler but limited to offline data distribution
RL Fine-tuning: post-training with PPO/DPO/GRPO reward signals; enables online improvement beyond demonstration data
After pretraining a VLA, two competing strategies exist: SFT directly imitates expert demonstrations (simple, stable), while RL fine-tuning (GRPO/DPO) optimizes a reward signal to go beyond the demonstration distribution. RL can discover novel strategies but is harder to stabilize.
World Model: learned environment simulator (Dreamer, UniSim); enables planning via imagination without real-world interaction
RL Fine-tuning: post-training with PPO/DPO/GRPO reward signals; enables online improvement beyond demonstration data
World models learn by predicting the future (imagination-based planning), while RL learns from reward feedback. If world models become accurate enough, they could reduce the need for expensive real-world RL exploration.
Tactile Sensing: force/torque and GelSight contact sensors; provides direct manipulation feedback for delicate tasks
Dexterous Hand: multi-finger manipulation control; achieves fine-grained object interaction without dedicated sensors
Two approaches to dexterous manipulation: tactile sensing adds explicit touch feedback (hardware cost, rich signal), while dexterous hand control relies on proprioception and vision alone (simpler hardware, harder control). The winner depends on sensor cost-to-performance ratio.
Sim-to-Real: train in simulation, deploy on real hardware; uses domain randomization to bridge the reality gap
Cross-Embodiment: transfer policies across different robot morphologies; aims for universal robot foundation models
Sim-to-Real trains one robot in simulation then transfers (cheap data, reality gap risk), while Cross-Embodiment trains across multiple real robots directly (expensive data, natural generalization). The approaches represent different bets on where generalization should happen.
EMERGING SIGNALS
1 signals
EMERGING SIGNALS
TOP INSTITUTIONS
20 active / 30d
TOP INSTITUTIONS
📐 理論文章庫📐 理论文章库
206 篇篇 查看 GitHub 全庫查看 GitHub 全库 →
什么时候停止惩罚动作?面向 VLA 强化学习的 Martingale GRPO 拆解 (When to Stop Penalizing Actions? Martingale GRPO for VLA Reinforcement Learning)
在 GitHub 閱讀在 GitHub 阅读DRILL:训练世界模型以改进策略,而非预测像素 (DRILL: Training World Models to Improve Policies, Not Predict Pixels)
在 GitHub 閱讀在 GitHub 阅读一步 Euler 够不够?Flow-Matching VLA 的步数等价性实证 (When One Step Is Enough: An Empirical Study of Euler Integration in Flow-Matching Policies)
在 GitHub 閱讀在 GitHub 阅读FastHarness:用经验调度 GPT-6 复核,降低 VLA 执行监控成本
在 GitHub 閱讀在 GitHub 阅读FocusVLA:未来意图引导的多视角动态路由 (FocusVLA: Future-Intent Guided Dynamic View Routing for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读Progress Probes P²:用 VLA 内部激活做轻量运行时监控 (Progress Probes P²: Lightweight Runtime Monitoring for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读Echo:VLA 动作与任务状态信号的耦合去噪 (Echo: Coupled Action and Task Status Signal Denoising for Vision Language Action Models)
在 GitHub 閱讀在 GitHub 阅读UniMem:把视觉与文本记忆统一进 VLA 的非马尔可夫任务框架 (UniMem: Unifying Visual and Textual Memory in VLAs for Non-Markovian Tasks)
在 GitHub 閱讀在 GitHub 阅读超越示教:面向 VLA 的强化学习仿真—真实协同训练 (Beyond Imitation: Reinforcement Learning-Based Sim-Real Co-Training for VLA Models)
在 GitHub 閱讀在 GitHub 阅读从非机器人合成数据中学习机器人行为先验 (Learning Robot Behavior Priors from Non-Robotic Synthetic Data)
在 GitHub 閱讀在 GitHub 阅读前史记忆:人形 Loco-Manipulation 的对象事件关键帧记忆 (Memory before Goal: Role of Pre-History Memory for Humanoid Loco-Manipulation)
在 GitHub 閱讀在 GitHub 阅读感知运动对齐:具身策略成功的柏拉图式代理 (Sensorimotor Alignment: A Platonic Proxy for Embodied Policy Success)
在 GitHub 閱讀在 GitHub 阅读UniWALM:把语言变成世界-动作模型的工作记忆 (UniWALM: Unified World Action Language Model for Embodied Robot Control)
在 GitHub 閱讀在 GitHub 阅读DEFLECT:用时间反事实偏好学习训练抗延迟的异步 VLA
在 GitHub 閱讀在 GitHub 阅读μ0:可扩展的 3D 交互痕迹世界模型($\mu_0$: A Scalable 3D Interaction-Trace World Model)
在 GitHub 閱讀在 GitHub 阅读Safe-Night VLA:给 VLA 加一路热成像,再用 CBF-QP 保住执行安全 (Safe-Night VLA: Seeing the Unseen via Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulation)
在 GitHub 閱讀在 GitHub 阅读物理画布:面向机器人策略评估与学习的视觉-触觉世界模型(Physical Canvas: A Vision Tactile World Model for Robot Policy Evaluation and Learning)
在 GitHub 閱讀在 GitHub 阅读异步 VLA 如何让无人机在推理延迟中继续飞:AeroDASH 精读 (AeroDASH: Asynchronous Vision-Language-Action Control for Continuous UAV Flight)
在 GitHub 閱讀在 GitHub 阅读T(R,O) Grasp++:杂乱场景下的跨本体灵巧抓取规模化 (T(R,O) Grasp++: Cross-Embodiment Dexterous Grasping in Cluttered Environments at Scale)
在 GitHub 閱讀在 GitHub 阅读Vector-Quantized World Model:用控制器可达性做离散 latent 规划的机器人操作框架 (Vector-Quantized World Model: Latent Feedback Motion Planning for Robot Manipulation)
在 GitHub 閱讀在 GitHub 阅读不是所有特征都生而平等:VLA 的机制可解释性研究 (Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读NativeMEM:把长程视觉历史压进 VLA 原生 Token 空间 (Native Memory Compression for Long-Horizon Robotic Manipulation)
在 GitHub 閱讀在 GitHub 阅读HexaShell:用薄封装探测 VLM 编码 Agent 作为机器人编码 Agent 的上限 (HexaShell: A Thin Harness for Exploring the Limits of VLM Agents as Robot Coding Agents)
在 GitHub 閱讀在 GitHub 阅读Vision-Language-Delta-Action:把紧凑 Delta 作为可操作的状态转移接口 (Vision-Language-Delta-Action: Learning Compact Deltas as Actionable Transition Interfaces for Robotic Manipulation)
在 GitHub 閱讀在 GitHub 阅读CFG-Policy:用 Classifier-free Guidance 统一扩散策略的采样、探索与 RL 微调 (CFG-Policy: Unified Diffusion Policy Learning Framework via Classifier-free Guidance)
在 GitHub 閱讀在 GitHub 阅读LTM:面向 VLA 的潜转移上下文记忆(Latent Transition Based In-Context Memory for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读FastVLA:任务条件化与时间自适应的 VLA 视觉 Token 压缩(FastVLA: Task-Conditioned and Temporally Adaptive Visual Token Compression for Efficient Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读REKI:把记忆注册进 VLA(REKI: Registering Knowledge in VLAs)
在 GitHub 閱讀在 GitHub 阅读把历史写进权重:流式视频的长期记忆内化 (Memory as Weights: Internalizing Long-Term History for Streaming Videos)
在 GitHub 閱讀在 GitHub 阅读测试时计算重塑人形行为基座模型 (Test-Time Compute for Humanoid Behavior Foundation Models)
在 GitHub 閱讀在 GitHub 阅读Mem4Act:为长时程机器人操作学习有效潜记忆(Mem4Act: Learning Effective Latent Memory for Long-Horizon Robotic Manipulation)
在 GitHub 閱讀在 GitHub 阅读记住该记住的:长程机器人世界模型的上下文调度 (Remembering What Matters for Long-Horizon Robotic World Models)
在 GitHub 閱讀在 GitHub 阅读只思考一次的 VLA:Fast-VLA 的任务记忆与闭环解耦 (Fast-VLA: You Only Think Once for Robot Manipulation)
在 GitHub 閱讀在 GitHub 阅读N₀-VTLA:把触觉变成“未来接触”的 latent 条件
在 GitHub 閱讀在 GitHub 阅读VLA-Touch:用双层触觉反馈增强 VLA / Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedback
在 GitHub 閱讀在 GitHub 阅读Spark-0:面向机器人灵巧操作的空间对齐触觉预训练 (Spark-0: Scaling Spatially Aligned Tactile Pretraining for Robot Dexterous Manipulation)
在 GitHub 閱讀在 GitHub 阅读机器人策略该学什么预测?重审 VLA 学习的监督目标 (What Should Robot Policies Learn to Predict? Rethinking Supervision Targets in Vision-Language-Action Learning)
在 GitHub 閱讀在 GitHub 阅读VLA 真的在“听话”吗?How-level 指令跟随诊断 (Do VLAs Really Follow Instructions? Diagnosing How-Level Instruction Following in Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读未来一致才提交:面向机器人操作的结果感知自适应动作分块(Commit While Futures Agree: Consequence-Aware Adaptive Action Chunking for Robot Manipulation)
在 GitHub 閱讀在 GitHub 阅读EgoLAP:用语言-动作推理从第一视角人类数据中学习 (EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning)
在 GitHub 閱讀在 GitHub 阅读部署中协同演化机器人编排器与策略 (Co-Evolving Robot Orchestrators and Policies through Deployment)
在 GitHub 閱讀在 GitHub 阅读从人类视频到机器人操作的跨本体因果迁移 (Cross-Embodiment Causal Transfer from Human Videos to Robot Manipulation)
在 GitHub 閱讀在 GitHub 阅读Beyond Reconstruction:动作 Tokenization 到底需要什么?(Beyond Reconstruction: What Matters in Action Tokenization for Robot Policies?)
在 GitHub 閱讀在 GitHub 阅读工作空间级等变视觉-触觉扩散策略:VISTA (Equivariant Visual-Tactile Diffusion Policy for Contact-Rich Manipulation)
在 GitHub 閱讀在 GitHub 阅读TouchScale:500 小时人类视觉-触觉数据 (TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning)
在 GitHub 閱讀在 GitHub 阅读多教师在线策略蒸馏:把域专用 Flow-Based VLA 合并进共享学生 (Multi-Teacher On-Policy Distillation for Flow-Based Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读Juno:驯服预测隐变量用于 VLA 模型 (Juno: Taming Predictive Latents for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读多种成功路径:面向 VLA 泛化的多样性驱动 RL 微调 (Many Ways to Succeed: Diversity-Driven RL Fine-Tuning for VLA Generalization)
在 GitHub 閱讀在 GitHub 阅读改写先行:刻画并缓解 VLA 的语言敏感性 (Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读TACROSS:跨异构触觉传感器的高效低成本人体触觉采集系统 (TACROSS: An Efficient and Low-Cost Scalable Human Touch System Across Heterogeneous Tactile Sensors for Dexterous Robot Learning)
在 GitHub 閱讀在 GitHub 阅读REACT:滚动去噪与双重解耦的 VLA 反应式机器人控制(REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models)
在 GitHub 閱讀在 GitHub 阅读OpenViTac:统一仿真-真实框架下的视触觉策略学习与基准评测 (OpenViTac: Learning and Benchmarking Visuo-Tactile Policies in a Unified Sim-and-Real Framework)
在 GitHub 閱讀在 GitHub 阅读PLaW-VLA:面向视觉-语言-动作策略的预测性潜在世界建模 (Predictive Latent World Modeling for Vision-Language-Action Policies)
在 GitHub 閱讀在 GitHub 阅读ARC:面向机器人基础模型的推理后训练配方(Arc: A Reasoning Recipe for Robot Foundation Models)
在 GitHub 閱讀在 GitHub 阅读ValueFormer:阶段感知价值标签,让 VLA 的「静默失败」可被在线读出 (ValueFormer: Stage-Aware Value Labels for Online Failure Detection and VLA Post-Training)
在 GitHub 閱讀在 GitHub 阅读VersaCamVLA:面向机器人操作的相机可配置 VLA 策略 (VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation)
在 GitHub 閱讀在 GitHub 阅读前向动力学模型:把世界模型变成动作特征的后置监督 (Forward Dynamics Models)
在 GitHub 閱讀在 GitHub 阅读双流记忆:把 VLA 的“执行状态”和“视觉证据”拆开 (Dual-Stream Memory for Vision-Language-Action Policies)
在 GitHub 閱讀在 GitHub 阅读证据引导的反事实学习:长尾机器人策略的头部动作偏置诊断与缓解 (Evidence-Guided Counterfactual Learning for Long-Tailed Robotic Policies)
在 GitHub 閱讀在 GitHub 阅读Splat2Act:从捕获场景到个性化 VLA 操作(Splat2Act: From Captured Scenes to Personalized VLA Manipulation)
在 GitHub 閱讀在 GitHub 阅读噪声空间学习:冻结 flow-matching VLA 的轻量适配 (Noise Space Learning for VLA Adaptation)
在 GitHub 閱讀在 GitHub 阅读具身中间训练:用数据邻近度弥合 VLM 与 VLA 之间的鸿沟 (EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training)
在 GitHub 閱讀在 GitHub 阅读Evo-World:用光流监督未来运动预测的轻量 VLA (Evo-World: A Lightweight Vision-Language-Action Model with Future Motion Prediction via Optical-Flow Supervision)
在 GitHub 閱讀在 GitHub 阅读以腕部视角人类演示构建跨灵巧手可复用数据接口 (Human2Dex: Dexterous Robot Learning from Wrist-Centric Human Demonstrations)
在 GitHub 閱讀在 GitHub 阅读AFCE:为 VLA 学习“未来操作目标”的效果监督 (Beyond Actions: Learning Future Operation Targets for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读AlphaNIST:从二值任务奖励中涌现的装配技能 (AlphaNIST: Emergent Assembly Skills from Binary Task Rewards)
在 GitHub 閱讀在 GitHub 阅读报警值不值得响应:VLA 运行时监控器的反事实评估 (RESCUE: Is This Alarm Worth Acting On? Counterfactual Evaluation of VLA Runtime Monitors)
在 GitHub 閱讀在 GitHub 阅读检索锚定的鲁棒策略微调:RARA 把“相关预训练经验”变成表征锚点 (RARA: Robust Policy Fine-Tuning through Retrieval-Anchored Representation Alignment for Robotic Manipulation)
在 GitHub 閱讀在 GitHub 阅读JitterVLA:面向 VLA 驱动机器人操作运动质量的回放基准 (JitterVLA: A Replay Benchmark for Motion Quality in VLA-Driven Human-Robot Manipulation)
在 GitHub 閱讀在 GitHub 阅读AutoBio+:真实生物实验室中动态实验现象的灵巧操作基准 (AutoBio+: Benchmarking Dexterous Manipulation with Dynamic Experimental Phenomena in Realistic Laboratories)
在 GitHub 閱讀在 GitHub 阅读LAPT-Scale:用人类视频连续隐动作预训练扩展具身策略 (LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos)
在 GitHub 閱讀在 GitHub 阅读SmolWAM:面向边缘设备的隐空间世界-动作模型(SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices)
在 GitHub 閱讀在 GitHub 阅读免整理记忆:为机器人策略学习多流潜在记忆 (Memory Without Curation: Learning Multi-Stream Latent Memory for Robot Policies)
在 GitHub 閱讀在 GitHub 阅读MOSS:面向机器人流匹配策略的模式导向源分布塑造 (Mode-Oriented Source Shaping for Robot Flow Matching Policies)
在 GitHub 閱讀在 GitHub 阅读VeriVLA:基于潜世界模型的自适应测试时验证,用于流式 VLA (VeriVLA: Adaptive Test-Time Verification for Flow-Based VLAs with Latent World Models)
在 GitHub 閱讀在 GitHub 阅读TS-WAM:时间潜在动作与世界-动作耦合的视觉语言机器人控制 (TS-WAM: Temporal Latent Actions and World-Action Coupling for Vision-Language Robot Control)
在 GitHub 閱讀在 GitHub 阅读精密強迫:讓通用 VLA 策略跨過亞毫米容差門檻 (PRISM: Precision Forcing for Generalist Vision-Language-Action Policies)
在 GitHub 閱讀在 GitHub 阅读把測試時計算蒸餾進策略:Verify, Act, Distill (Turning Test-Time Compute into Test-Time Adaptation for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读因果动作增益世界动作模型 (CAG-WAM: Causal Action-Gain World Action Models for Robot Manipulation)
在 GitHub 閱讀在 GitHub 阅读DEFT-VLA:面向接触丰富操作的分阶段力觉专精 (DEFT-VLA: Stage-Localized Force Specialization for Contact-Rich Robotic Manipulation)
在 GitHub 閱讀在 GitHub 阅读通过质量多样性环境生成对 VLA 做红队评测 (Red-Teaming of Vision-Language-Action Models via Quality Diversity Environment Generation)
在 GitHub 閱讀在 GitHub 阅读把测试时计算蒸馏进策略:Verify, Act, Distill (Turning Test-Time Compute into Test-Time Adaptation for Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读USER:面向真实世界在线策略学习的统一可扩展系统 (USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI)
在 GitHub 閱讀在 GitHub 阅读BrickCraft:用「情境说明书」把符号装配计划落到实时视觉上 (Visuomotor Skill Composition with Situated Manual Guidance for Long-Horizon Interlocking Brick Assembly)
在 GitHub 閱讀在 GitHub 阅读人类-机器人对齐表征学习:用配对桥接把人类视频变成 VLA 监督 (HARP-VLA: Human-Robot Aligned Representation Learning for Vision-Language-Action Model)
在 GitHub 閱讀在 GitHub 阅读显式动作空间接地:让预训练 VLM 原生成为机械臂动作模型 (VLMs are Native Action Models: Unleashing the Manipulation Capabilities of VLMs with Explicit Action-Space Grounding)
在 GitHub 閱讀在 GitHub 阅读OGPO:面向可恢复 VLA 的离线目标条件策略优化 (Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models)
在 GitHub 閱讀在 GitHub 阅读Grounded-Dreamer:以物理錨定的世界模型合成資料訓練機器人操作策略 (Grounded-Dreamer: Robot Learning from World Model Synthetic Data with Physical Grounding)
在 GitHub 閱讀在 GitHub 阅读先想象未来,再内化为直觉:IG-VLA 的高效时空推理 (Imagine the Future, Internalize the Gist: Efficient VLA Reasoning via Internalized Spatiotemporal Imagination)
在 GitHub 閱讀在 GitHub 阅读用 Feynman–Kac 后验采样给预训练策略上约束 (BayesFP: Posterior Estimation for Flow-Based Policies via Feynman-Kac Sampling)
在 GitHub 閱讀在 GitHub 阅读更多文章 · 全部在 GitHub更多文章 · 全部在 GitHub 115 篇篇
🏆 SOTA 排行SOTA 排行
Evo-SOTA 完整榜Evo-SOTA 完整榜 →
30
CALVIN ABCD-D 飽和饱和 avg_len
| # | Model | Score | vs Prev | Date | Paper |
|---|---|---|---|---|---|
| 1 | Xiaomi-Robotics-0 | 4.8 | Flower VLA +0.13 | 2026-10-23 | arxiv → |
| 2 | Xiaomi-Robotics-0 | 4.8 | Flower VLA +0.13 | 2026-10-16 | arxiv → |
| 3 | MMaDA-VLA | 4.78 | Xiaomi-Robotics-0 +0.03 | 2026-10-23 | arxiv → |
| 4 | MMaDA-VLA | 4.78 | Xiaomi-Robotics-0 +0.03 | 2026-10-16 | arxiv → |
| 5 | EDAR | 4.75 | NIAF +0.09 | 2026-10-23 | arxiv → |
| 6 | EDAR | 4.75 | NIAF +0.09 | 2026-10-16 | arxiv → |
| 7 | AVA-VLA | 4.65 | NIAF +0.18 | 2026-10-23 | arxiv → |
| 8 | AVA-VLA | 4.65 | NIAF +0.18 | 2026-10-16 | arxiv → |
| 9 | NS-VLA | 4.56 | AtomicVLA +0.29 | 2026-10-23 | arxiv → |
| 10 | NS-VLA | 4.56 | AtomicVLA +0.29 | 2026-10-16 | arxiv → |
| 11 | HiMoE-VLA | 4.49 | Flower VLA +0.14 | 2026-10-23 | arxiv → |
| 12 | HiMoE-VLA | 4.49 | Flower VLA +0.14 | 2026-10-16 | arxiv → |
| 13 | MCIL | 1.82 | 2026-10-23 | arxiv → | |
| 14 | MCIL | 1.82 | 2026-10-16 | arxiv → |