Lost in Reconstruction: Aligning Action Representations with Language in Vision-Language-Action Models
Li Wenjie et al. · 指出VLA中动作表示仅优化重建损失导致语义对齐缺失的问题,提出将语言指令与动作表征对齐的新方法。可直接改进现有VLA训练流程,提升指令遵循能力。
Li Wenjie et al. · 指出VLA中动作表示仅优化重建损失导致语义对齐缺失的问题,提出将语言指令与动作表征对齐的新方法。可直接改进现有VLA训练流程,提升指令遵循能力。
Huosen Ou et al. · 利用语义3D高斯泼溅实现开放词汇移动操作的具身 grounding。结合了新颖的3D表征与VLA需求,提供了在复杂场景中定位目标的具体技术路径,具有较高复用价值。
Xiao Liu et al. · 提出阶段级联合嵌入预测的世界-动作模型(WAM),解决现有方法短期未来捕捉局限。引入JEPA架构到机器人控制,为长视界规划提供新视角,值得深入阅读。
Zhijie Wu et al. · 针对VLA实时推理计算瓶颈,提出神经内省门控机制以自适应复用KV缓存。显著降低推理延迟,是VLA部署优化的重要工程突破,本周即可集成测试。
Yuhang Zheng et al. · 提出视触觉世界模型以处理接触丰富操作。填补了触觉VLA方向空白,结合多模态感知与世界模型,为灵巧操作提供新范式,具有高参考价值。
David D. Yuan et al. · 由Chelsea Finn团队提出,通过轻量RL加速策略执行。解决IL策略速度慢的问题,方法简单有效,可直接应用于现有VLA/策略模型的后处理优化。
Xinyu Wang et al. · 实现VLA模型的均匀W4A4量化。解决VLA部署显存与速度瓶颈,提供具体的量化技术方案,具有极高的工程复用价值和落地意义。
Ziming Li et al. · 针对大物体双臂协作抓取,提出基于单目视觉的策略。虽涉及真实机器人实验,但属于特定任务优化,非通用VLA架构或训练范式创新。
Jusuk Lee et al. · 通过桥接语义与运动实现技能高效迁移。主要关注技能抽象与转移,虽与VLA相关,但更偏向传统模仿学习/技能库构建,缺乏对VLA核心端到端范式的直接贡献。
Guangrui Shen et al. · WBCD 2026变形操作挑战赛冠军方案报告。属于工程系统总结,针对特定任务(叠衣服),缺乏通用方法论创新,适合作为案例参考而非核心进展。
Wenrui Bao et al. · 将世界-动作模型应用于手术机器人,解决数据稀缺问题。虽方法有效,但领域过于垂直(医疗),且未展示在通用基准上的泛化能力,暂归为值得了解。
Jiahui Han et al. · 揭示VLA模型面临的扩散基无限制对抗攻击风险。安全研究重要,但属于防御/攻击分析范畴,非VLA性能提升或架构创新,作为安全意识补充阅读。
James Zhao et al. · 探索三臂系统的视觉运动模仿学习。针对特殊形态机器人,方法具有一定特殊性,但未明确是否采用VLA架构或在通用基准上验证,暂归为值得了解。
Tianyu Yang et al. · 改进导航扩散策略的泛化能力,使用Q-score重加权匹配。主要关注移动导航而非操作,且为Diffusion Policy的变体,非VLA核心架构创新。
Yongkang Yang et al. · 关于LLM自蒸馏的通用框架,虽提及机器人背景,但核心贡献在于NLP训练技巧,与VLA具体架构或操作控制关联较弱,属相邻领域。
Yidong Wang et al. · 提出新的机器人奖励模型评分编辑方法。涉及RLHF/Reward Modeling,虽对VLA RL精调有用,但更偏向奖励函数设计工具,非VLA本体创新。
Alexander Hackett et al. · 分析动作后训练对VLM深度解码能力的影响。属于机理分析/诊断研究,有助于理解VLA内部表征,但不提供新方法或性能提升。
Peterson Co et al. · 提出诊断动作条件世界模型仿真忠实度的工具。评估方法重要,但非算法本身创新,适合用于后续研究中的基准测试参考。
Yapeng Liu et al. · 结合能量结构与神经时间场的潜空间世界模型。理论性强,但主要面向运动规划,且未明确在VLA操纵任务上的应用,属相邻物理AI研究。
Puzhen Yuan et al. · 基于多智能体协作的长视界操作框架。侧重高层规划与Agent协作,若未深入底层VLA控制耦合,则更接近Agentic Workflow而非核心VLA模型。
Hunter Schofield et al. · 提出空间思维链以增强VLM的空间 grounding。虽对具身AI有用,但主要贡献在NLP/VLM表征层面,未直接涉及动作生成或VLA控制闭环。
Kiet T. Nguyen et al. · 通过多视图关系蒸馏提升VLM空间推理。纯视觉/语言模型改进,未涉及机器人动作输出或具身交互,属相邻领域。
Haiyu Wu et al. · 提出VIScore指标以诊断潜空间世界模型的规划质量。评估工具类论文,有助于理解世界模型,但不直接提供VLA算法改进。
Jiazhuo Li et al. · arXiv:2608.10386v1 Announce Type: cross Abstract: Sample-efficient reinforcement learning for autonomous driving is often limited by the trade-off between data efficiency and model bias. While world models reduce the reliance on costly environment interactions, policy optimization over learned dynamics remains sensitive to prediction errors. This paper proposes the Dreamer-SAC framework, which integrates a recurrent state-space world model with an off-policy soft actor-critic algorithm trained d
XPolicyLab Community et al. · arXiv:2608.09892v2 Announce Type: replace Abstract: Robot policy evaluation and deployment remain fragmented by model-specific software dependencies, data representations, and runtime interfaces, so that connecting N policies to M evaluation environments requires O(NM) separate integrations. We present XPolicyLab, a unified standard and open ecosystem that reduces this cost to O(N+M). XPolicyLab specifies common observation, action, and trajectory schemas together with a minimal adapter interfac
Yiyao Zhang et al. · arXiv:2608.07809v1 Announce Type: new Abstract: A world model is only useful for physical AI if it changes what the agent does, and only safe if it declines to do so when it is wrong. We study both halves of that requirement with CausalNav, a controller built around a signed, action-conditioned transition graph over identified state coordinates. At deployment CausalNav simulates a small library of intervention sequences, converts their objective error into policy-logit advice, and admits that ad
Wei Wang et al. · arXiv:2608.08689v1 Announce Type: new Abstract: The state evolution of a complex system arises jointly from object laws, relational propagation, domain conservation, and unmodeled error. Forcing all sources into one black box makes mechanism attribution and constraint preservation unauditable; forcing every mechanism into one equation family discards mature domain solvers. We propose SD-GWM, a Structural Dynamics Graph World Model as an executable structural contract: nodes declare self-dynamics
Junyu Wu et al. · arXiv:2608.09537v1 Announce Type: new Abstract: Foundation world models have made remarkable progress in planning, simulation, and embodied intelligence. However, optimizing a pretrained world model toward a user-specified objective remains difficult: each campaign typically rediscovers optimization strategies from scratch, and the resulting knowledge rarely transfers to the next model. Existing research agents automate the optimization loop but treat successful strategies as directly reusable r
Kevin Murphy · arXiv:2608.09696v2 Announce Type: new Abstract: Predicting the answer to interventional ``what if'' questions --- the outcome of an action never taken --- requires a \emph{mechanistic}, causal model, not a curve fit; and learning such a model requires \emph{experiments}, because passive data leaves its mechanisms unidentified. Experiments are expensive, so the central problem is \emph{data efficiency}. We present the Model Discovery Agent (MDA), which couples a large language model (LLM), used a
Ziqiao Yu · arXiv:2608.07712v1 Announce Type: cross Abstract: A predictive model receives a self-supervised signal whenever the consequence of an action is observed. Using that signal after deployment is difficult when dynamics and semantics share parameters: freezing prevents adaptation, whereas weight updates require optimizer state and may alter the learned representation. Here we introduce SpikeWorld, a 1.45M-parameter sparse spiking model jointly trained for heterogeneous sensory prediction, semantics,
Daniele Molino et al. · arXiv:2608.08135v1 Announce Type: cross Abstract: Cross-modality medical image translation can reduce the burden of multi-modal acquisitions, yet the field remains constrained by two coupled limitations: methods operate on 2D slices or 3D patches rather than whole volumes, and train a separate model for each translation task. Both stem from a single cause, the absence of a sufficiently strong volumetric prior, which forces generative models to learn anatomical appearance and cross-modality mappi
Renjie Zhao et al. · arXiv:2608.08600v1 Announce Type: cross Abstract: World models have recently achieved impressive progress in visual prediction and interactive generation, but extending them to multi-agent environments introduces a fundamental scalability challenge. Existing methods generally assume a fixed number of agents during training and inference, which ties the model to a pre-determined agent population and limits inference-time scalability. Our key insight is that cross-view consistency should arise fro
Yukuan Lu et al. · arXiv:2607.15142v2 Announce Type: replace Abstract: World models are usually evaluated as components of model-based reinforcement learning (MBRL) systems, leaving their standalone reliability understudied. We reproduce five visual world-model agents in Atari Pong -- DreamerV3, DIAMOND, TWISTER, Simulus, and STORM -- and match their reported agent performance. We then freeze the learned world models and evaluate them in two ways. In a closed-loop rollout diagnostic, a policy trained separately fr
Yibin Dong · arXiv:2608.00591v2 Announce Type: replace Abstract: A calibrated stochastic world model can reveal how uncertain a future is without revealing why it branches. The same conditional future law can arise because an observation aliases physical states or because dynamics remain random after the declared full state is fixed. We prove that ordinary transitions cannot identify these two sources, even for a perfect probabilistic predictor. ClosurePairs makes them identifiable by crossing compatible mic
Xuan Zhang et al. · arXiv:2512.07195v2 Announce Type: replace-cross Abstract: Multi-agent role-playing has recently shown promise for studying social behavior with language agents, but existing simulations are mostly monolingual without cross-lingual interaction, an essential property of real societies. We introduce MAWM, the first Multilingual Agent-based World Modeling framework that supports multi-turn multilingual interactions among generative agents with diverse sociolinguistic profiles. MAWM enables two modes
Xiaoxin Lu et al. · arXiv:2606.14574v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly deployed as planners for autonomous agents in household environments. While existing benchmarks evaluate whether LLM-generated plans execute successfully, they overlook a critical type of failure: latent failures. Unlike immediate failures that trigger instant feedback at execution time and enable timely correction, latent failures do not immediately halt plan execution but silently compromise
Jiacheng Fu et al. · arXiv:2608.10107v1 Announce Type: new Abstract: Emerging World-Action Models (WAMs) have demonstrated promising performance in autonomous driving by jointly modeling future driving scene evolution and trajectory planning. However, existing WAMs are typically trained with video data, which is only 2D projections of the underlying 4D driving scene. Consequently, WAMs fail to understand and capture the structure of 4D scenes and thus generate visually plausible yet 4D inconsistent future prediction
Sangwoo Jo et al. · arXiv:2608.10544v1 Announce Type: new Abstract: Image restoration is fundamentally constrained by the tradeoff between distortion and perception: minimizing pixel-wise error yields over-smoothed results, whereas optimizing for perceptual realism often introduces structural deviations. Recent approaches attempt to balance this tradeoff via posterior sampling or multi-stage generative pipelines, yet remain computationally expensive and architecturally complex. To overcome these limitations, we pro
Kang He et al. · arXiv:2608.09449v2 Announce Type: replace Abstract: Video world models must capture how scenes evolve over time and across viewpoints. Training them for long-horizon generation and camera control therefore benefits from long videos paired with camera trajectories and temporally grounded semantics. Existing corpora rarely offer the three together: large-scale web video provides broad visual diversity but no trajectories or time-aligned text, while pose-annotated datasets are typically short-range
Jiale Xu et al. · arXiv:2607.28675v2 Announce Type: replace-cross Abstract: Polygonal meshes are the standard surface representation of modern 3D pipelines, and generating high-quality meshes with artist-style topology is essential for film, gaming, and interactive 3D applications. Mainstream approaches serialize a mesh into a token sequence and decode it autoregressively, which is slow at inference and sensitive to error accumulation, making them impractical for interactive asset creation. We present Meshy T2, a
Chenguang Wang et al. · arXiv:2602.13136v2 Announce Type: replace Abstract: Template-free retrosynthesis methods treat the task as black-box sequence generation, limiting learning efficiency, while semi-template approaches rely on rigid reaction libraries that constrain generalization. We address this gap with a key insight: atom ordering in neural representations matters. Building on this insight, we propose a structure-aware template-free framework that encodes the two-stage nature of chemical reactions as a position
Thomas Sesmat et al. · arXiv:2606.07271v3 Announce Type: replace Abstract: Understanding memorization in generative models remains challenging, with implications for copyright and privacy. Beyond verbatim reproduction, models can encode subtler traces of their training data that never surface in their outputs yet remain exploitable. We refer to these measurable asymmetries as the \emph{membership signal}, and we study this regime for Flow Matching, which are increasingly used in deployed generative systems. We analyze
Jianbin Tan et al. · arXiv:2508.13831v4 Announce Type: replace-cross Abstract: Functional data, i.e., random functions observed over a continuous domain, are increasingly available in areas such as biomedical research, health informatics, and epidemiology. However, effective statistical analysis for functional data is often hindered by challenges such as privacy constraints, sparse and irregular sampling, infinite-dimensionality, and non-Gaussian structures. To address these challenges, we introduce a novel framewor
Junjie Zhao et al. · arXiv:2604.22005v2 Announce Type: replace-cross Abstract: Accurate yet low-latency channel state information (CSI) acquisition is essential for multiple-input multiple-output (MIMO) communication systems. While advanced deep generative models, such as score-based and diffusion models, enable high-fidelity CSI reconstruction from limited pilot observations, they often suffer from high inference latency. To achieve accurate CSI estimation under stringent latency constraints, this paper proposes a