计算机应用 ›› 2020, Vol. 40 ›› Issue (3): 832-836.DOI: 10.11772/j.issn.1001-9081.2019071257

• 虚拟现实与多媒体计算 • 上一篇    下一篇

基于鸽视顶盖神经元动作电位的图像重建

王治忠, 庞晨   

  1. 郑州大学 电气工程学院, 郑州 450001
  • 收稿日期:2019-07-19 修回日期:2019-09-02 出版日期:2020-03-10 发布日期:2019-09-11
  • 通讯作者: 王治忠
  • 作者简介:王治忠(1982-),男,山东蓬莱人,副教授,博士,主要研究方向:生物信号检测与处理、智能控制;庞晨(1994-),男,河南商丘人,硕士研究生,主要研究方向:生物信号检测与处理。
  • 基金资助:
    国家自然科学基金资助项目(61673353);国家自然科学基金青年科学基金资助项目(61603344);河南省高等教育重点研究项目(15A120017)。

Image reconstruction based on neuron spike signals in pigeon optic tectum

WANG Zhizhong, PANG Chen   

  1. School of Electrical Engineering, Zhengzhou University, Zhengzhou Henan 450001, China
  • Received:2019-07-19 Revised:2019-09-02 Online:2020-03-10 Published:2019-09-11
  • Supported by:
    This work is partially supported by the National Natural Science Foundation of China (61673353), the Youth Science Foundation of the National Natural Science Foundation of China (61603344), the Henan Provincial Higher Education Key Research Project (15A120017).

摘要: 针对从神经元响应信号中解码视觉输入的问题,提出了一种利用神经元动作电位(Spike)信号重建视觉输入的方法。首先,记录鸽视顶盖(OT)神经元的Spike信号,提取Spike发放率特征;然后,构建线性逆滤波器和卷积神经网络重建模型,实现视觉输入的重建;最后,对通道数量、时间窗口、数据时间长度、延迟时间等参数进行优化。在相同参数条件下,利用线性逆滤波器重建图像的互相关系数达到0.910 7±0.021 9,利用卷积神经网络模型重建图像的互相关系数达到0.927 1±0.017 6。重建结果表明,提取神经元Spike发放率特征并运用线性逆滤波器和卷积神经网络重建模型可以有效重建视觉输入。

关键词: 视顶盖, 动作电位, 发放率, 图像重建, 互相关系数

Abstract: Focused on the issue of decoding visual input from neuron response signal, a method to reconstruct visual input using neurons action potential (Spike) signal was proposed. Firstly, the Spike signal from the pigeon Optic Tectum (OT) neurons was recorded and the firing rate characteristics of Spike were extracted. Then, a linear inverse filter reconstruction model and a convolution neural network reconstruction model were constructed to realize the reconstruction of the visual input. Finally, the number of channels, time bin, data time length and delay time were optimized. Under the same parameter condition, the cross correlation coefficient of image reconstruction using linear inverse filter reconstruction model reached 0.910 7±0.021 9, and the cross correlation coefficient of image reconstruction using convolution neural network reconstruction model reached 0.927 1±0.017 6. The results show that the visual input can be reconstructed effectively by extracting firing rate characteristics of neuron Spike and using linear inverse filter reconstruction model and convolution neural network reconstruction model.

Key words: optic tectum, Spike, firing rate, image reconstruction, cross correlation coefficient

中图分类号: