《计算机应用》唯一官方网站

• •    下一篇

针对关联不确定性的双流Mamba在线多目标跟踪方法

王旭1,2,成苗3,何莲1   

  1. 1. 中国科学院成都计算机应用研究所
    2. 中国科学院大学计算机科学与技术学院
    3. 深圳市中钞科信金融科技有限公司
  • 收稿日期:2026-07-29 修回日期:2026-09-15 发布日期:2026-11-03 出版日期:2026-11-03
  • 通讯作者: 成苗

Dual-stream Mamba online multi-object tracking method addressing association uncertainty

  • Received:2026-07-29 Revised:2026-09-15 Online:2026-11-03 Published:2026-11-03

摘要: 为提高鱼眼俯拍密集场景中径向畸变和频繁遮挡条件下的身份保持稳定性,提出针对关联不确定性的双流Mamba在线多目标跟踪方法。该方法在轨迹层分别利用Motion-Mamba和Appearance-Mamba建模运动与外观时序先验;基于历史几何一致性和预测几何一致性构造关联歧义区间(Association Ambiguity Interval,AAI),将候选对划分为确信、歧义和非关联三类;仅对AAI候选由GrayFusion依据运动—外观置信度差分和外观时效性进行自适应融合。在鱼眼俯拍密集行人数据集(Fisheye Overhead Multi-person Dense,FOMD)测试集上,所提方法的身份F1分数(Identification F1 Score,IDF1)和多目标跟踪准确率(Multiple Object Tracking Accuracy,MOTA)分别达到86.72%和82.73%,身份切换(Identity Switches,IDSW)为7次;相较交并比(Intersection over Union,IoU)基线,IDF1和MOTA分别提高10.89和3.55个百分点,IDSW减少26次。与BoostTrack++和ClarityTrack相比,IDF1/MOTA分别提高0.57/0.34和2.77/2.17个百分点,IDSW分别减少5次和12次。实验结果表明,所提方法在保持较高总体精度的同时,可减少密集遮挡与非线性运动条件下的身份切换,并对候选级关联不确定性进行差异化处理。

关键词: 在线多目标跟踪, 自适应融合, Mamba, 关联不确定性, 状态空间模型, 运动预测, 遮挡处理

Abstract: To improve identity preservation in dense overhead fisheye scenes affected by radial distortion and frequent occlusion, a dual-stream Mamba online multi-object tracking method addressing association uncertainty was proposed. Motion-Mamba and Appearance-Mamba were used to model trajectory-level motion and appearance temporal priors, respectively. Historical and predicted geometric consistency were combined to construct the Association Ambiguity Interval (AAI), which partitioned candidate pairs into confident, ambiguous, and non-association regions. GrayFusion was activated only for AAI candidates and adaptively fused motion and appearance cues according to their confidence difference and appearance timeliness. On the Fisheye Overhead Multi-person Dense (FOMD) test set, the proposed method achieves an Identification F1 Score (IDF1) of 86.72% and a Multiple Object Tracking Accuracy (MOTA) of 82.73%, with 7 Identity Switches (IDSW). Compared with the Intersection over Union (IoU) baseline, IDF1 and MOTA increase by 10.89 and 3.55 percentage points, respectively, and IDSW decreases by 26. Compared with BoostTrack++ and ClarityTrack, IDF1/MOTA increase by 0.57/0.34 and 2.77/2.17 percentage points, respectively, while IDSW decreases by 5 and 12. Experimental results show that the proposed method reduces identity switches under dense occlusion and nonlinear motion while maintaining high overall tracking accuracy, and provides differentiated handling of candidate-level association uncertainty.

Key words: online multi-object tracking, adaptive fusion, Mamba, association uncertainty, state space model, motion prediction, occlusion handling

中图分类号: