《计算机应用》唯一官方网站

• •    下一篇

基于时空Mamba模型的生理信号提取和心率测量

高艳1,2,姚育东3   

  1. 1. 宁波大学信息科学与工程学院
    2. 宁波大学智能医学与生物医学工程研究院
    3. 史蒂文斯理工学院 电气与计算机工程系
  • 收稿日期:2025-08-05 修回日期:2025-10-29 发布日期:2025-12-22 出版日期:2025-12-22
  • 通讯作者: 高艳

Physiological signal extraction and heart rate measurement based on spatial-temporal Mamba model

  • Received:2025-08-05 Revised:2025-10-29 Online:2025-12-22 Published:2025-12-22

摘要: 基于远程光电容积脉搏波(rPPG)技术的非接触式心率测量方法主要有两个方面的挑战:一是面部感兴趣区域的准确选取;二是从长视频序列中准确理解rPPG的周期模式。针对现有工作中面部感兴趣区域定位不精准和未考虑到不同信号源之间的时间滞后性问题,提出了一个端到端的rPPG信号提取模型RppgMamba,用于非接触式心率测量。其中设计的具有交叉扫描机制的分层时空Mamba模块从多尺度的时空感受场中挖掘弱信号的空间感知关系,能够自适应地定位面部感兴趣区域,避免受到背景和运动噪声等带来的干扰。设计的频域细化模块在频域进一步学习rPPG信号的准周期模式,用于提高输出信号质量并结合相位补偿器对输出信号进行相位校正,改善固有时间滞后问题带来的影响。实验结果表明,所提模型在三个公开数据集上获得最佳的性能,证明提出模型对心率测量良好的精确度和适用性。

关键词: 非接触式, 心率测量, Mamba模型, 远程光电容积描记术, RGB面部视频

Abstract: Non-contact heart rate measurement methods based on remote PhotoPlethysmoGraphy (rPPG) technology faced two main challenges: the accurate selection of facial regions of interest, and the precise interpretation of periodic patterns in rPPG from long video sequences. To address the inaccurate localization of facial regions of interest in existing works and the neglect of temporal lag among different signal sources, an end-to-end rPPG signal extraction model named RppgMamba was proposed. A hierarchical spatial-temporal Mamba model with cross-scan mechanism was designed to capture spatial perception relationships of weak signals from multi-scale spatial-temporal receptive fields. This module adaptively localized facial regions of interest and avoided interference from background and motion noise. A frequency-domain refinement module was further designed to learn the quasi-periodic patterns of rPPG signals in the frequency domain, which enhanced output signal quality. A phase compensator was incorporated to correct phase shifts, mitigating the impact of inherent temporal lags. Experimental results demonstrate that the proposed model achieves state-of-the-art performance on three public datasets, confirming its high accuracy and applicability in heart rate measurement.

Key words: non-contact, heart rate measurement, Mamba model, remote photoplethysmography, RGB facial video

中图分类号: