Learning from Distributed Eyes: Leveraging Collaborative Perception for Automated Model Adaptation
推荐理由
直接命中当前方向的任务、场景或系统约束
核心判断
论文摘要(中文)
论文提出 LDE(Learning from Distributed Eyes),把协同感知中较可靠的多车感知结果用作无监督域适应的教师信号,生成伪标签。方法针对通信带宽、协同视角与单车视角不一致、伪标签仍可能不可靠三类问题,设计面向适应的特征共享、视场过滤和课程学习,并在 V2X-Sim、DAIR-V2X 上验证。
In autonomous driving, perception models often struggle to generalize to new environments due to domain shifts. While unsupervised model adaptation offers a feasible solution without labor-intensive manual labeling, existing methods that rely solely on the ego-vehicle’s data often lead to inferior pseudo-labeling performance. To address this critical issue, we proposeLDE, Learning from Distributed “Eyes”, a novel framework that transforms collaborative perception (CP) into a source of high-quality supervision for model adaptation. This pseudo-labeling approach is hyperparameter-insensitive and relatively reliable, assuming CP often outperforms singleagent’s perception. However, naively implementing this approach encounters (1) the communication bottleneck of sharing rich features under time and bandwidth constraints, (2) the view discrepancy between the CP view and the learner’s Field of View (FoV), and (3) the unreliability even in CP-generated labels. To address these issues, we design an adaptationoriented feature sharing mechanism that selectively transmits the most critical information for adaptation, an FoV filtering method that meticulously eliminates mismatched labels, and a curriculum learning strategy to progressively exploit pseudo labels. Extensive experiments on 3D object detection tasks demonstrate thatLDEconsistently outperforms both the pretrained models and state-of-the-art unsupervised adaptation methods.
研究动机(中文总结)
单车数据在新环境下容易发生域偏移,且仅靠本车生成伪标签质量有限;直接共享协同感知特征又受带宽、视角差异和标签噪声制约。
To address this critical issue, we proposeLDE, Learning from Distributed “Eyes”, a novel framework that transforms collaborative perception (CP) into a source of high-quality supervision for model adaptation.
创新与贡献(中文总结)
把协同感知从单纯的融合模块转为无监督适应的教师监督来源,并联合处理通信约束、视场不匹配和伪标签可靠性。
To address this critical issue, we proposeLDE, Learning from Distributed “Eyes”, a novel framework that transforms collaborative perception (CP) into a source of high-quality supervision for model adaptation.
方法与证据
方法(中文总结)
按适应任务价值选择性共享特征,用视场过滤剔除协作者视角中本车不可见的标签,再通过课程学习逐步利用伪标签。
To address this critical issue, we proposeLDE, Learning from Distributed “Eyes”, a novel framework that transforms collaborative perception (CP) into a source of high-quality supervision for model adaptation.
实验结果(中文总结)
作者报告 LDE 在 V2X-Sim 和 DAIR-V2X 的 3D 检测域适应任务上优于预训练模型及现有无监督适应方法;摘要未列出具体提升数值。
The main contributions of this paper are summarized as follows. •We propose a novel unsupervised model adaptation framework namedLDE, which leverages CP as a source of “teacher” supervision to generate high-quality pseudo labels and overcome the unreliability of single-agent adaptation. •We design an adaptation-oriented feature-sharing approach by considering practical communication constraints, utilize FoV filtering to eliminate out-of-range labels caused by view discrepancies, and employ curriculum learning to enhance adaptation reliability. •We conduct extensive performance evaluations on both simulated and real-world datasets, i.e., V2X-Sim and DAIR-V2X datasets, to demonstrate that ourLDE framework outperforms non-adaptive baselines and existing unsupervised benchmarks on 3D object detection tasks.