基于欧拉影像放大的非接触式心率测量方法

doi:10.11772/j.issn.1001-9081.2017071808

计算机应用 ›› 2018, Vol. 38 ›› Issue (3): 916-922.DOI: 10.11772/j.issn.1001-9081.2017071808

• 应用前沿、交叉与综合 • 上一篇

基于欧拉影像放大的非接触式心率测量方法

苏培权, 许亮, 梁永坚

广东工业大学自动化学院, 广州 510006

收稿日期:2017-07-25 修回日期:2017-09-17 发布日期:2018-03-07 出版日期:2018-03-10
通讯作者: 许亮
作者简介:苏培权(1991-),男,广东潮州人,硕士研究生,主要研究方向:机器视觉、机器学习;许亮(1971-),男,甘肃白银人,高级工程师,博士,主要研究方向:机器视觉、机器学习、无线传感器网络;梁永坚(1991-),男,广东清远人,硕士研究生,主要研究方向:机器视觉、机器学习。
基金资助:
国家自然科学基金资助项目（21376091）；广东省科技计划项目（2015A030401089，2015B090922004，2016B090927004）。

Non-contact heart rate measurement method based on Eulerian video magnification

SU Peiquan, XU Liang, LIANG Yongjian

School of Automation, Guangdong University of Technology, Guangzhou Guangdong 510006, China

Received:2017-07-25 Revised:2017-09-17 Online:2018-03-07 Published:2018-03-10
Supported by:
This work is partially supported by the National Natural Science Foundation of China (21376091), the Guangdong Provincial Science and Technology Plan Project (2015A030401089, 2015B090922004, 2016B090927004).

摘要/Abstract

摘要： 针对目前非接触式心率测量存在操作不便、心率同频段噪声干扰大和受环境温度影响较大等问题，提出一种基于欧拉影像放大技术的非接触式心率测量方法。首先，运用欧拉影像放大技术实现手腕处桡动脉微小跳动的动作放大；然后，对脉搏跳动视频帧的像素点亮度值在时域上进行亮度方差统计，同时在YCrCb颜色空间中分割出皮肤区域；其次，根据亮度方差统计和皮肤分割结果，结合图像形态学处理方法提取视频中桡动脉跳动区域；最后，对所提取桡动脉部位时域上亮度信号采用傅里叶变换进行时频分析，实现心率非接触式测量。实验结果表明该方法与独立成分分析法（ICA）和脉搏交流信号分析法相比，均方根误差（RMSE）分别下降50.5%和32.6%；与小波滤波法相比，平均绝对误差下降12%。非接触式心率测量方法测量结果与脉搏血氧仪测量法具有很好一致性，满足中国医药行业标准，可用于日常保健和远程医疗的心率监测。

关键词: 心率测量, 非接触, 桡动脉, 欧拉影像放大

Abstract: Aiming at problems of inconvenient operations, large noise interference of same frequency band in heart rate, and great influence by environmental temperature in existing non-contact measurement of heart rate, a non-contact measurement method of heart rate based on Eulerian video magnification technology was proposed. Firstly, a tiny beating of radial artery of wrist was magnified by Eulerian video magnification technology. Secondly, a statistics of luminance variance for pixels in an enlarged video frame was performed in time domain. Meanwhile, skin area in YCrCb color space was segmented. Thirdly, the pulsing region of radial artery in a video was extracted by luminance variance statistics and skin segmentation incorporating with image morphological processing. Finally, the non-contact measurement of heart rate was implemented by time-frequency analysis through Fourier transform of luminance signal of radial artery extracted in time domain. The experimental results show that Root Mean Square Error (RMSE) is reduced by 50.5% and 32.6%, respectively compared to Independent Component Analysis (ICA) and pulse alternating current signal analysis; Mean Absolute Difference (MAD) is 12% lower than wavelet filtering method. In this paper, the proposed approach for non-contact measurement of heart rate has a good consistency with pulse oximeter measurement, which is satisfied to pharmaceutical industry standards. It also can be used in daily family health care and telemedicine to monitor heart rate.

Key words: heart rate measurement, non-contact, radial artery, Eulerian video magnification

中图分类号:

TP391.41

苏培权, 许亮, 梁永坚. 基于欧拉影像放大的非接触式心率测量方法[J]. 计算机应用, 2018, 38(3): 916-922.

SU Peiquan, XU Liang, LIANG Yongjian. Non-contact heart rate measurement method based on Eulerian video magnification[J]. Journal of Computer Applications, 2018, 38(3): 916-922.

参考文献

[1] STONE M L, TATUM P M, WEITKAMP J-H, et al. Abnormal heart rate characteristics before clinical diagnosis of necrotizing enterocolitis[J]. Journal of Perinatology Official Journal of the California Perinatal Association, 2013, 33(11):847-850.
[2] OGLIARI G, MAHINRAD S, STOTT D J, et al. Resting heart rate, heart rate variability and functional decline in old age[J]. Canadian Medical Association Journal, 2015, 187(15):E442-E449.
[3] GRENEKER E F. Radar sensing of heartbeat and respiration at a distance with applications of the technology[C]//RADAR 97:Proceedings of the 1997 Radar Systems.[S.l.]:The Institution of Engineering and Technology, 1997:150-154.
[4] HIGASHIKATURAGI K, NAKAHATA Y, MATSUNAMI I, et al. Non-invasive respiration monitoring sensor using UWB-IR[C]//ICUWB 2008:Proceedings of the 2008 IEEE International Conference on Ultra-Wideband. Piscataway, NJ:IEEE, 2008:29-34.
[5] LAZARO A, GIRBAU D, VILLARINO R. Analysis of vital signs monitoring using an Ir-UWB radar[J]. Progress in Electromagnetics Research, 2010, 100:265-284.
[6] GARBEY M, SUN N, MERLA A, et al. Contact-free measurement of cardiac pulse based on the analysis of thermal imagery[J]. IEEE Transactions on Biomedical Engineering, 2007, 54(8):1418-1426.
[7] TRESKES R W, van de VELDE V, ATSMA D E, et al. Redesigning healthcare:The 2.4 billion euro question?:Connecting smart technology to improve outcome of patients[J]. Netherlands Heart Journal:Monthly Journal of the Netherlands Society of Cardiology & the Netherlands Heart Foundation, 2016, 24(7/8):441-446.
[8] TAKANO C, OHTA Y. Heart rate measurement based on a time-lapse image[J]. Medical Engineering & Physics, 2007, 29(8):853-857.
[9] ZHENG J, HU S, CHOULIARAS V, et al. Feasibility of imaging photoplethysmography[C]//BMEI'08:Proceedings of the 2008 International Conference on Biomedical Engineering and Informatics. Washington, DC:IEEE Computer Society, 2008, 2:72-75.
[10] VERKRUYSSE W, SVAASAND L O, NELSON J S. Remote plethysmographic imaging using ambient light[J]. Optics Express, 2008, 16(26):21434-21445.
[11] POH M Z, McDUFF D J, PICARD R W. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation[J]. Optics Express, 2010, 18(10):10762-10774.
[12] POH M Z, McDUFF D J, PICARD R W. Advancements in noncontact, multiparameter physiological measurements using a webcam[J]. IEEE Transactions on Bio-medical Engineering, 2011, 58(1):7-11.
[13] PURSCHE T, KRAJEWSKI J, MOELLER R. Video-based heart rate measurement from human faces[C]//ICCE 2012:Proceedings of the 2012 IEEE International Conference on Consumer Electronics. Piscataway, NJ:IEEE, 2012:544-545.
[14] 刘祎,欧阳健飞,闫勇刚.基于普通摄像头的心率测量方法研究[J].计算机工程与应用,2016,52(7):210-214. (LIU Y, OUYANG J F, YAN Y G. Method of measuring heart rate using a webcam[J]. Computer Engineering and Applications, 2016, 52(7):210-214.)
[15] ZHAO F, LI M, QIAN Y, et al. Remote measurements of heart and respiration rates for telemedicine[J]. PLOS ONE, 2013, 8(10):e71384.
[16] XU S, SUN L, ROHDE G K. Robust efficient estimation of heart rate pulse from video[J]. Biomedical Optics Express, 2014, 5(4):1124-35.
[17] YU Y-P, KWAN B-H, LIM C-L, et al. Video-based heart rate measurement using short-time Fourier transform[C]//ISPACS 2013:Proceedings of the 2013 International Symposium on Intelligent Signal Processing and Communications Systems. Piscataway, NJ:IEEE, 2013:704-707.
[18] YU Y-P, RAVEENDRAN P, LIM C-L. Dynamic heart rate measurements from video sequences[J]. Biomedical Optics Express, 2015, 6(7):2466-2480.
[19] LI X, CHEN J, ZHAO G, et al. Remote heart rate measurement from face videos under realistic situations[C]//CVPR'14:Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2014:4264-4271.
[20] LAM A, KUNO Y. Robust heart rate measurement from video using select random patches[C]//ICCV'15:Proceedings of the 2015 IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2015:3640-3648.
[21] ZHANG X Y, ZHANG Y T. The effect of local mild cold exposure on pulse transit time[J]. Physiological Measurement, 2006, 27(7):649-660.
[22] KHAN M, PRETTY C G, AMIES A C, et al. Analysing the effects of cold, normal, and warm digits on transmittance pulse oximetry[J]. Biomedical Signal Processing & Control, 2016, 26:34-41.
[23] WU H-Y, RUBINSTEIN M, SHIH E, et al. Eulerian video magnification for revealing subtle changes in the world[J]. ACM Transactions on Graphics, 2012, 31(4):Article No. 65.
[24] MAHMOUD T M. A new fast skin color detection technique[J]. World Academy of Science:Engineering & Technolog, International Journal of Computer and Information Engineering, 2008, 2(7):2354-2358.

基于欧拉影像放大的非接触式心率测量方法

Non-contact heart rate measurement method based on Eulerian video magnification

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	况世雄姚俊波陆佳炜王琪冰肖刚. 基于动态图卷积网络的电梯乘客异常行为数据增强方法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[2]	康斌陈斌王俊杰李昱林赵军智咸伟志. 基于多粒度共享语义中心关联的文本到人物检索方法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[3]	王子怡李卫军刘雪洋丁建平刘世侠苏易礌. 基于Swin Transformer与多尺度特征融合的图像描述方法#br# [J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[4]	付可意, 王高才, 邬满. 基于改进区域提议网络和特征聚合小样本目标检测方法[J]. 《计算机应用》唯一官方网站, 2024, 44(12): 3790-3797.
[5]	庞玉东, 李志星, 刘伟杰, 李天昊, 王宁宁. 基于改进实时检测Transformer的塔机上俯视场景小目标检测模型[J]. 《计算机应用》唯一官方网站, 2024, 44(12): 3922-3929.
[6]	赵欣, 李鑫杰, 徐健, 刘步云, 毕祥. 基于卷积神经网络与Transformer并行的医学图像配准模型[J]. 《计算机应用》唯一官方网站, 2024, 44(12): 3915-3921.
[7]	颜承志陈颖钟凯高寒. 基于多尺度网络与轴向注意力的3D目标检测算法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[8]	王静刘嘉星宋婉莹薛嘉兴丁温欣. 基于空间变换和特征分布校准的小样本皮肤图像分类模型[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[9]	廖炎华鄢元霞潘文林. 基于YOLOv9的交通路口图像的多目标检测算法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[10]	谢斌红剌颖坤张英俊张睿. 自步学习指导下的半监督目标检测框架[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[11]	邹耀斌, 张彬. 四向加权香农熵最大化导向的自动阈值分割方法[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3565-3573.
[12]	刘涛, 鞠事宏, 高一萌. 基于改进YOLOv8n的无人机视角下小目标检测算法[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3603-3609.
[13]	胡立华, 李小平, 胡建华, 张素兰. 基于四叉树先验辅助的多视图立体方法[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3556-3564.
[14]	顾聪, 段其强, 任思雨. 基于上下文感知网络的息肉分割算法[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3617-3622.
[15]	刘雨生, 肖学中. 基于扩散模型微调的高保真图像编辑[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3574-3580.