计算机应用 ›› 2017, Vol. 37 ›› Issue (3): 817-822.DOI: 10.11772/j.issn.1001-9081.2017.03.817

• 计算机视觉与虚拟现实 • 上一篇    下一篇

基于自相似性车载采集城市街景图像的重建

杨伟, 谢维成, 蒋文波, 石林玉   

  1. 西华大学 电气与电子信息学院, 成都 610039
  • 收稿日期:2016-08-24 修回日期:2016-09-13 出版日期:2017-03-10 发布日期:2017-03-22
  • 通讯作者: 谢维成
  • 作者简介:杨伟(1990-),女,四川都江堰人,硕士研究生,主要研究方向:图像超分辨率重建;谢维成(1973-),男,重庆人,教授,硕士,主要研究方向:信号检测与信息处理;蒋文波(1981-),男,重庆人,副教授,博士,主要研究方向:光学信息处理;石林玉(1991-),女,四川南充人,硕士研究生,主要研究方向:智能信息处理。
  • 基金资助:
    国家自然科学基金资助项目(61307063);教育部“春晖计划”项目(Z2015115);四川省教育厅自然科学基金重点项目(15ZA0127);四川省信号与信息处理高校重点实验室开放基金资助项目(szjj2015-072);西华大学研究生创新基金资助项目(ycjj2016161)。

Self-examples reconstruction of city street image from driving recorder

YANG Wei, XIE Weicheng, JIANG Wenbo, SHI Linyu   

  1. School of Electrical Engineering and Electronic Information, Xihua University, Chengdu Sichuan 610039, China
  • Received:2016-08-24 Revised:2016-09-13 Online:2017-03-10 Published:2017-03-22
  • Supported by:
    This work is partially supported by the National Natural Science of Foundation of China (61307063), the Chunhui Plan of Ministry of Education (Z2015115), the Key Project of Natural Science Funds of Education Department of Sichuan Province (15ZA0127), the Open Research Subject of Key Laboratory of Signal and Information Processing in Sichuan Province (szjj2015-072), the Graduate Student Innovation Fund Project of Xihua University (ycjj2016161).

摘要: 大众化的车载为确保实时、高速的图像显示及图像存储,其捕获的图像通常会呈现出较低的分辨率,严重影响了突发状况时有效图像信息的获取。针对该低分辨率的城市街景图像采用了一种基于透视变换、高频补偿的自相似性图像重建方法。该算法在仿射变换的基础上增加了透视变换来进行图像块的匹配,并对每一个匹配的图像块进行高频补偿以恢复构建图像金字塔时丢失的高频信息,通过多尺度非局部方法搜索图像金字塔,合成匹配图像块得到最终的高分辨率图像。采用该算法对采集到的大量低分辨率城市街景图像进行重建,并与ScSR、Upscaling、SCN这三种典型的算法进行对比,实验结果表明该算法在几种盲评价指标上较其他算法好,在提高图像分辨率的同时能保持图像的边缘和细节信息。

关键词: 仿射变换, 透视变换, 高频补偿, 图像金字塔, 图像重建

Abstract: In order to ensure the high speed of image display and storage in real-time, the image captured by the popular driving recorder usually shows a low resolution, which has a serious impact on effective image information acquisition under unexpected situation. To solve this problem, a perspective transformation based on self-examples of the images and high-frequency compensation were used to reconstruct the city street images with low resolution. Perspective transformation was added to the affine transformation to match image patches, match image patch and high frequency compensation was used to recover the lost high frequency information of each matched image patch when image pyramid was constructed. The image pyramid was searched by non-local multi-scale method to get the matched patches, which were synthesized to obtain the images of high resolution. Many low resolution street view images were used to verify the effectiveness of this algorithm. Compared it to existing typical algorithms such as ScSR (Sparse coding Super-Resolution), Upscaling, SCN (Sparse Coding based Network), the experimental results show that the algorithm in several blind evaluation indices is better than other algorithms and it can improve the image resolution while keeping the edges and details of the image.

Key words: affine transformation, perspective transformation, high-frequency compensation, image pyramid, image reconstruction

中图分类号: