• •    

CCML2021+282: 基于联合损失胶囊网络的换衣行人重识别

刘乾1,王洪元2,曹亮1,孙博言1,肖宇3,张继4   

  1. 1. 常州大学
    2. 常州大学 信息科学与工程学院,江苏 常州 213164
    3. 常州工程职业技术学院
    4. 常州大学武进校区
  • 收稿日期:2021-06-25 修回日期:2021-08-05 发布日期:2021-08-05
  • 通讯作者: 王洪元

Cloth-changing Person Re-Identification Based on Joint loss Capsules Network (CCML2021+282)

  • Received:2021-06-25 Revised:2021-08-05 Online:2021-08-05
  • Contact: WANG Hongyuan

摘要: 摘 要: 目前的行人重识别研究主要是集中在短时间情况下,即一个人的衣着不太可能发生改变。然而现实中更常见的情况是长时间情况下,一个人有很大的机会更换衣服——行人重识别模型应该考虑这种情况。为此,研究了一种基于联合损失胶囊网络的换衣行人重识别方法。所提方法基于换衣行人重识别ReIDCaps胶囊网络模型,使用与传统的标量神经元相比包含更多的信息的矢量胶囊,用其长度表示行人身份信息,用方向表示行人衣着信息;采用软嵌入注意力(SEA)防止模型过拟合;特征稀疏表示(FSR)机制提取具有判别性的特征;增加标签平滑正则化交叉熵损失与Circle Loss的联合损失以提高模型的泛化能力和鲁棒性。本文方法在三个换衣行人重识别数据集Celeb-reID、Celeb-reID-light和NKUP上进行实验,实验结果证明本文方法与目前已有的行人重识别方法相比有一定优势。

关键词: 换衣行人重识别, 胶囊网络, 矢量胶囊, 标签平滑正则化损失, Circle Loss

Abstract: Abstract: Current research on person re-identification mainly concentrated on short-term situations, on the basis of remaining person’s clothing unchanged. However, in more practical cases, it is common to see that people has higher possibility to change their cloth, which should also be considered within person re-identification models. Hence, a new method of person re-identification of changing clothes based on the joint loss capsule network is conducted. The proposed method is based on the ReIDCaps capsule network model for person re-identification when changing clothes, which uses vector capsules that contain more information than traditional scalar neurons. The length of the vector capsule is used to represent the identity information of the person, and the direction is used to represent the clothing information of the person; Soft Embedding Attention (SEA) is used to prevent model over-fitting; Feature Sparse Representation (FSR) mechanism extracts discriminative features; increases the joint loss of label smoothing regularization cross-entropy loss and Circle Loss to improve the generalization ability and robustness of the model. The method is tested on three datasets Celeb-reID, Celeb-reID-light and NKUP. The experimental results can prove that the method has certain advantages compared with some existing person re-identification methods.

Key words: Keywords: cloth-changing person re-identification, capsules network, vector-neuron capsules, label smoothing cross entropy loss, circle loss

中图分类号: