《计算机应用》唯一官方网站 ›› 2026, Vol. 46 ›› Issue (8): 2612-2619.DOI: 10.11772/j.issn.1001-9081.2025070846

• 多媒体计算与计算机仿真 • 上一篇    下一篇

结合DINOv2与ByteTracker的跨摄像头多目标在线跟踪算法

史世豪, 施群山(), 周杨, 胡校飞, 齐凯, 李丰超   

  1. 信息工程大学 地理空间信息学院,郑州 450001
  • 收稿日期:2025-07-28 修回日期:2025-10-31 接受日期:2025-11-04 发布日期:2025-12-22 出版日期:2026-08-10
  • 通讯作者: 施群山
  • 作者简介:史世豪(1999—),男,河南开封人,硕士研究生,主要研究方向:摄影测量与遥感、目标检测跟踪
    施群山(1985—),男,江苏盐城人,副教授,博士,主要研究方向:摄影测量与遥感。
  • 基金资助:
    国家自然科学基金资助项目(42501543)

Cross-camera multi-target online tracking algorithm combining DINOv2 and ByteTracker

Shihao SHI, Qunshan SHI(), Yang ZHOU, Xiaofei HU, Kai QI, Fengchao LI   

  1. School of Geospatial Information,Information Engineering University,Zhengzhou Henan 450001,China
  • Received:2025-07-28 Revised:2025-10-31 Accepted:2025-11-04 Online:2025-12-22 Published:2026-08-10
  • Contact: Qunshan SHI
  • About author:SHI Shihao, born in 1999, M. S. candidate. His research interests include photogrammetry and remote sensing, target detection and tracking.
  • Supported by:
    National Natural Science Foundation of China(42501543)

摘要:

多摄像机多目标跟踪(MTMCT)在智能监控和智能交通等领域具有重要应用价值。然而,由于不同摄像头之间的视角、光照以及成像质量存在差异,具有较高的目标内差异性和目标间相似性,使跨摄像头多目标跟踪面临严峻挑战。现有的离线方法虽取得了一定进展,但它们因高延迟和后处理操作复杂,难以适用于通常需在线处理的现实场景,因此,提出一种结合DINOv2(Data-efficient image network version 2)与ByteTracker的跨摄像头多目标在线跟踪算法。首先,在特征提取阶段引入DINOv2,设计并训练一种外观特征提取网络,以获取更具鲁棒性和判别力的目标外观特征;其次,基于ByteTrack算法,通过优化数据关联策略和轨迹管理机制,提出ByteTracker算法,为每个摄像头生成候选轨迹;最后,通过跨摄像头间关联(ICA)模块,采用分层聚类在不同摄像机之间关联这些候选轨迹,从而将目标与全局身份相关联。在CityFlowV2数据集的S02场景上进行验证的结果表明,所提算法的识别F1分数(IDF1)、识别精度(IDP)和识别召回率(IDR)指标值分别为81.24%、84.59%和78.14%,相较于对比模型Shim分别提高了2.84、5.79和0.14个百分点,且在多个摄像头在线的情况下的跟踪时间仅为0.14 s。

关键词: 多摄像机, 多目标跟踪, DINOv2, ByteTrack, 目标关联

Abstract:

Multi-Target Multi-Camera Tracking (MTMCT) holds significant application values in fields such as intelligent surveillance and intelligent transportation. However, due to differences in visual angles, lighting, and imaging quality of different cameras, there are high intra-target variability and inter-target similarity, posing severe challenges to cross-camera multi-target tracking. Although the existing offline methods have made progress, the limitations such as high latency and complex post-processing operations make them unsuitable for real-world scenarios requiring online processing. Therefore, an online cross-camera multi-target tracking algorithm combining DINOv2 (Data-efficient image network version 2) and ByteTracker was proposed. First, during feature extraction, DINOv2 was employed to design and train an appearance feature extraction network, thereby obtaining more robust and discriminative target appearance features. Then, based on the ByteTrack algorithm, by optimizing the data association strategy and trajectory management mechanism, the ByteTracker algorithm was proposed to generate candidate trajectories for each camera. Finally, through the Inter-Camera Association (ICA) module, hierarchical clustering was employed to associate these candidate trajectories across different cameras, thereby linking the targets to the global identities. Validation results on the CityFlowV2 dataset’s Scene 02 (S02) show that the IDentification F1 score (IDF1), IDentification Precision (IDP), and IDentification Recall (IDR) metrics of proposed algorithm are 81.24%, 84.59%, and 78.14%, respectively, which are improved by 2.84, 5.79, and 0.14 percentage points, respectively compared to those of the baseline model Shim. Moreover, the tracking time of the proposed algorithm under multi-camera online conditions is only 0.14 seconds.

Key words: multi-camera, multi-target tracking, DINOv2, ByteTrack, target association

中图分类号: