AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios
推荐理由
与当前方向有可迁移方法或背景价值，但不是本轮核心问题；注意：更像自动驾驶多模态/大模型背景材料，V2X 约束不足
核心判断
论文摘要（中文）
论文提出 AnchorReasoning 长尾驾驶视觉推理数据集，包含 416,119 帧和 395,379 个决策关键元素，并把元素定位、属性影响、驾驶动作理由与轨迹规划组织成视觉依据链。作者还提出课程式监督微调和考虑目标尺寸的 grounding 指标。
Vision-language models (VLMs) offer a promising approach to long-tail autonomous driving, but existing driving datasets provide limited supervision for connecting decision-critical visual evidence with reasoning and planning. We introduce AnchorReasoning, a visually grounded reasoning dataset built on WODE2E, containing 416,119 annotated frames and 395,379 decision-critical elements across four major categories and 19 fine-grained types. Each frame is organized as a visually grounded chain-of-thought (VG-CoT) that links decision-critical element identification and localization, element attributes and implications, drivingaction rationale, and action and trajectory planning. We further develop a curriculum supervised fine-tuning strategy that progressively learns these hierarchical capabilities, together with an object-size-aware grounding metric for evaluating localization quality. Experiments across eight general-purpose, embodied-AI, and A V-specific backbones show that VG-CoT supervision improves grounded reasoning and trajectory prediction. Across models, 5-s ADE and FDE decrease by 7.84 and 11.86, while RFS Frame and Cluster improve by 1.66 and 1.70. These gains are achieved with 18.5 fewer reasoning tokens and 0.32 s/frame lower inference latency on average, demonstrating the value of visually grounded, decision-focused supervision for VLM reasoning and planning in long-tail autonomous driving.
研究动机（中文总结）
现有驾驶数据对“哪些视觉证据影响决策，以及证据如何支撑推理和规划”的监督不足，限制了视觉语言模型在长尾场景中的可靠性。
To address these limitations, we introduce AnchorReasoning, a visual grounding and causal reasoning dataset for VLMs in long-tail driving scenarios (Table 1).
创新与贡献（中文总结）
提供大规模、分层的视觉依据推理数据，并将目标定位、语义影响、动作理由和轨迹规划连成一条可训练、可评估的链路。
These annotations enable models to identify, localize, and correctly interpret the elements that truly influence driving decisions, thereby improving their trajectory planning performance in long-tail autonomous driving scenarios. • We propose a curriculum SFT strategy that follows the structure of VG-CoT, allowing models to fully leverage the hierarchical supervision and progressively acquire visual grounding, element implication, driving action rationale, behavior planning, and trajectory generation capabilities.
方法与证据
方法（中文总结）
基于 WOD-E2E 标注决策关键元素并构造 VG-CoT；使用课程式 SFT 逐步训练模型理解元素、推断影响、解释动作并生成轨迹，同时提出目标尺寸感知的定位评价指标。
These annotations enable models to identify, localize, and correctly interpret the elements that truly influence driving decisions, thereby improving their trajectory planning performance in long-tail autonomous driving scenarios. • We propose a curriculum SFT strategy that follows the structure of VG-CoT, allowing models to fully leverage the hierarchical supervision and progressively acquire visual grounding, element implication, driving action rationale, behavior planning, and trajectory generation capabilities.
实验结果（中文总结）
在八种通用、具身和自动驾驶模型上的实验中，摘要报告 5 秒 ADE/FDE 分别降低 7.84/11.86，RFS Frame/Cluster 分别提升 1.66/1.70；推理 token 平均减少 18.5，延迟降低 0.32 秒/帧。
5 EXPERIMENTS 5.1 MODELS We evaluate eight representative models to assess the effectiveness of AnchorReasoning across diverse model foundations.(i) General-purpose VLMs.Qwen2.5-VL-7B (Bai et al., 2025b) and Qwen3-VL-8B (Bai et al., 2025a) serve as general-purpose baselines.(ii) Embodied-AI foundation models.Cosmos-Reason2-2B and Cosmos-Reason2-8B (NVIDIA, 2025) provide embodiedreasoning baselines without driving-specific adaptation.(iii) A V-specific VLMs.Alpamayo-R1- 10B and Alpamayo-1.5-10B (Wang et al., 2025) are driving-specialized models capable of joint reasoning and trajectory prediction.