Super-resolution reconstruction based on multi-dictionary learning and image patches mapping
MO Jianwen1, ZENG Ermeng1, ZHANG Tong2, YUAN Hua1
1. School of Information and Communication, Guilin University of Electronic Technology, Guilin Guangxi 541004, China; 2. School of Mechanical and Electrical Engineering, Guilin University of Electronic Technology, Guilin Guangxi 541004, China
Abstract：To overcome the disadvantages of the unclear results and time consuming in the sparse representation of image super-resolution reconstruction with single redundant dictionary, a single image super-resolution reconstruction method based on multi-dictionary learning and image patches mapping was proposed. In the framework of the traditional sparse representation, firstly the gradient structure information of local image patches was explored, and a large number of training image patches were clustered into several groups by their gradient angles, from those clustered patches the corresponding dictionary pairs were learned. And then the mapping function was computed from low resolution patch to high resolution patch in each clustered group via learned dictionary pairs with the idea of neighbor embedding. Finally the reconstruction process was reduced to a projection of each input patch into the high resolution space by multiplying with the corresponding precomputed mapping function, which improved the images quality with less running time. The experimental results show that the proposed method improves the visual quality significantly, and increases the PSNR (Peak Signal-to-Noise Ratio) at least 0.4 dB compared with the anchored neighborhood regression algorithm.
[1] CHEN X, QI C. Nonlinear neighbor embedding for single image super-resolution via kernel mapping[J]. Signal Processing, 2014, 94(1):6-22. [2] LIU X, ZHAO D, ZHOU J, et al. Image interpolation via graph-based Bayesian label propagation[J]. IEEE Transactions on Image Processing, 2014, 23(3):1084-1096. [3] RASTI P, DEMIREL H, ANBARJAFARI G. Image resolution enhancement by using interpolation followed by iterative back projection[C]//Proceedings of the 21st IEEE on Signal Processing and Communications Applications Conference. Piscataway, NJ:IEEE, 2013:1-4. [4] TIMOFTE R, DE V, VAN GOOL L. Anchored neighborhood regression for fast example-based super-resolution[C]//Proceedings of the 2013 IEEE International Conference on Computer Vision. Piscataway, NJ:IEEE, 2013:1920-1927. [5] YANG J, WRIGHT J, HUANG T S, et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing, 2010, 19(11):2861-2873. [6] YANG J, WRIGHT J, HUANG T, et al. Image super-resolution as sparse representation of raw image patches[C]//Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2008:1-8. [7] ZEYDE R, ELAD M, PROTTER M. On single image scale-up using sparse-representations[C]//Proceedings of the 7th International Conference on Curves and Surfaces. Heidelberg:Springer, 2012:711-730. [8] AHARON M, ELAD M, BRUCKSTEIN A. The K-SVD:an algorithm for designing overcomplete dictionaries for sparse representation[J]. IEEE Transactions on Signal Processing, 2006, 54(11):4311-4322. [9] CHANG H, YEUNG D Y, XIONG Y. Super-resolution through neighbor embedding[C]//Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2004, 1:275-282. [10] RUBINSTEIN R, ZIBULEVSKY M, ELAD M. Efficient implementation of the K-SVD algorithm using batch orthogonal matching pursuit[R/OL].[2015-11-04].https://www.researchgate.net/publication/251229200. [11] DONG W, ZHANG L, LUKAC R, et al. Sparse representation based image interpolation with nonlocal autoregressive modeling[J]. IEEE Transactions on Image Processing, 2013, 22(4):1382-1394. [12] ELAD M, YAVNEH I. A plurality of sparse representations is better than the sparsest one alone[J]. IEEE Transactions on Information Theory, 2009, 55(10):4701-4714. [13] FENG X G, MILANFAR P. Multiscale principal components analysis for image local orientation estimation[C]//Proceedings of IEEE Conference Record of the 36th Asilomar Conference on Signals, Systems and Computers. Piscataway, NJ:IEEE, 2002, 1:478-482. [14] YANG S, WANG M, CHEN Y, et al. Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding[J]. IEEE Transactions on Image Processing, 2012, 21(9):4016-4020. [15] TIKHONOV A N, ARSENIN V I A. Solutions of ill-posed problems[J]. Mathematics of Computation, 1978, 32(144):491. [16] AJA-FERNANDEZ S, SAN-JOSÉ-ESTÉPAR R, ALBEROLA-LOPEZ C, et al. Image quality assessment based on local variance[C]//Proceedings of the 28th Annual IEEE International Conference on Engineering in Medicine and Biology Society. Piscataway, NJ:IEEE, 2006:4815-4818. [17] 黄文辉, 陈仁雷, 张家谋. 数字视频图像质量客观测量方法的改进与实现[J]. 北京邮电大学学报, 2005, 28(4):87-90. (HUANG W H, CHEN R L, ZHANG J M. Improvement and implementation of objective digital video quality measurement[J].Journal of Beijing University of Posts and Telecommunications, 2005, 28(4):87-90.) [18] WANG Z, SHEIKH H R, BOVIK ALAN C. Objective Video Quality Assessment[M]. Boca Raton:CRC Press, 2003:214-220.
2016, Vol. 36 
