《计算机应用》唯一官方网站 ›› 2022, Vol. 42 ›› Issue (5): 1398-1406.DOI: 10.11772/j.issn.1001-9081.2021030512

• 人工智能 • 上一篇    下一篇

基于非局部高分辨率网络的轻量化人体姿态估计方法

孙琪翔1, 何宁2(), 张敬尊2, 宏晨1   

  1. 1.北京联合大学 机器人学院,北京 100101
    2.北京联合大学 智慧城市学院,北京 100101
  • 收稿日期:2021-04-04 修回日期:2021-06-02 接受日期:2021-06-03 发布日期:2022-06-11 出版日期:2022-05-10
  • 通讯作者: 何宁
  • 作者简介:孙琪翔(1994-),男,黑龙江大兴安岭人,硕士研究生,主要研究方向:数字图像处理、计算机视觉
    何宁(1970-),女,辽宁盘锦人,教授,博士,主要研究方向:数字图像处理 xxthening@buu.edu.cn
    张敬尊(1980-),女,河北衡水人,讲师,博士,主要研究方向:数字图像处理
    宏晨(1974-),男,宁夏青铜峡人,副教授,博士,主要研究方向:多媒体信息处理。
  • 基金资助:
    国家自然科学基金资助项目(61872042);国家重点研发计划项目(2018AAA0100804);北京市教委科技计划重点项目(KZ201911417048);北京市教委科技计划面上项目(KM202111417009);北京联合大学人才强校优选计划项目(BPHR2020AZ01);北京联合大学研究生科研创新项目(YZ2020K001)

Lightweight human pose estimation method based on non-local high-resolution network

Qixiang SUN1, Ning HE2(), Jingzun ZHANG2, Chen HONG1   

  1. 1.College of Robotics,Beijing Union University,Beijing 100101,China
    2.Smart City College,Beijing Union University,Beijing 100101,China
  • Received:2021-04-04 Revised:2021-06-02 Accepted:2021-06-03 Online:2022-06-11 Published:2022-05-10
  • Contact: Ning HE
  • About author:HONG Chen, born in 1974,Ph. D.,associate professor. Hisresearch interests include multimedia information processing.
    HE Ning, born in 1970,Ph. D.,professor. Her research interestsinclude digital image processing.
    ZHANG Jingzun, born in 1980,Ph. D.,lecturer. Her researchinterests include digital image processing.
    HONG Chen, born in 1974,Ph. D.,associate professor. Hisresearch interests include multimedia information processing.
    First author contact:SUN Qixaing, born in 1994, M. S. candidate. His researchinterests include digital image processing,computer vision.
  • Supported by:
    National Natural Science Foundation of China(61872042);National Key Research and Development Program of China(2018AAA0100804);Key Program of Science and Technology Plan of Beijing Municipal Education Commission(KZ201911417048);General Program of Science and Technology Plan of Beijing Municipal Education Commission(KM202111417009);Premium Program of Strengthening University by Talents of Beijing Union University(BPHR2020AZ01);Research and Innovation Program for Graduate Students of Beijing Union University(YZ2020K001)

摘要:

人体姿态估计是计算机视觉中的基本任务之一,可应用于动作识别、游戏、动画制作等领域。当前深度网络模型的设计大多通过加深网络以获得更好的性能,结果导致计算资源的需求超出嵌入式设备和移动设备的计算能力,达不到实际应用要求。针对上述问题,提出了一种融合Ghost模块结构的轻量级网络模型,即使用Ghost模块替换原高分辨率网络中的基础模块,从而减少网络模型的参数量。此外,设计了非局部高分辨率网络,即在网络1/32分辨率阶段融合非局部网络模块,使网络具有获取全局特征的能力,从而提高人体姿态估计的准确率,并在保证模型准确率的前提下降低网络参数量。在MPII人体姿态估计数据集和COCO人体姿态估计数据集上的实验结果表明,所提网络模型与原高分辨率网络相比,在网络模型参数量降低40%的情况下,人体姿态估计准确率提升了1.8个百分点。

关键词: 人体姿态估计, 非局部模块, 轻量化, Ghost模块, 高分辨率网络

Abstract:

Human pose estimation is one of the basic tasks in computer vision, which can be applied to the fields such as action recognition, games, and animation production. The current designs of deep network model mostly use deepening the network to obtain better performance. As a result, the demand for computing resources is beyond the computing power of embedded devices and mobile devices, and the requirements of actual applications can not be met. In order to solve the problems, a new lightweight network model integrating Ghost module structure was proposed, that is, the Ghost module was used to replace the basic module in the original high-resolution network, thereby reducing the number of network parameters. In addition, a non-local high-resolution network was designed, that is, the non-local network module was fused in the 1/32 resolution stage of the network, so that the network has the ability to obtain global features, thereby improving the accuracy of human pose estimation, and reducing the network parameters while ensuring the accuracy of model. Experiments were carried out on the human pose estimation datasets such as Max Planck Institut Informatik (MPII) and the Common Objects in COntext (COCO).Experimental results indicate that, compared with the original high-resolution network, the proposed network model has the accuracy of human pose estimation increased by 1.8 percentage points with the number of network parameters reduced by 40%.

Key words: human pose estimation, non-local module, lightweight, Ghost module, high-resolution network

中图分类号: