No-reference image quality assessment based on scale invariance

doi:10.11772/j.issn.1001-9081.2016.03.789

Journal of Computer Applications ›› 2016, Vol. 36 ›› Issue (3): 789-794.DOI: 10.11772/j.issn.1001-9081.2016.03.789

Previous Articles Next Articles

No-reference image quality assessment based on scale invariance

TIAN Jinsha¹, HAN Yongguo¹, WU Yadong¹, ZHAO Xiaole¹, ZHANG Hongying²

1. School of Computer Science and Technology, Southwest University of Science and Technology, Mianyang Sichuan 621010, China;
2. School of Information Engineering, Southwest University of Science and Technology, Mianyang Sichuan 621010, China

Received:2015-08-25 Revised:2015-09-21 Online:2016-03-10 Published:2016-03-17
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61303127), Sichuan Science and Technology Support Program (2014GZ0100,2014SZ0223), the "West Light" Training Project of Chinese Academy of Sciences (13ZS0106), the Major Project of Education Office Sichuan Province (13ZA0169).

基于尺度不变性的无参考图像质量评价

田金沙¹, 韩永国¹, 吴亚东¹, 赵小乐¹, 张红英²

1. 西南科技大学计算机科学与技术学院, 四川绵阳 621010;
2. 西南科技大学信息工程学院, 四川绵阳 201010

通讯作者: 吴亚东
作者简介:田金沙(1988-),女,河北衡水人,硕士研究生,主要研究方向:数字图像处理;韩永国(1963-),男,四川遂宁人,教授,博士,主要研究方向:虚拟现实、仿真;吴亚东(1979-),男,河南周口人,教授,博士,CCF会员,主要研究方向:图像图形处理、信息可视化、人机交互;赵小乐(1987-),男,四川南部人,硕士研究生,CCF会员,主要研究方向:数字图像处理;张红英(1976-),女,四川德阳人,教授,博士,主要研究方向:图像处理。
基金资助:
国家自然科学基金资助项目(61303127);四川省科技支撑计划项目(2014GZ0100,2014SZ0223);中国科学院"西部之光"人才培养计划项目(13ZS0106);四川省教育厅重点项目(13ZA0169)。

Abstract

Abstract: The existing general no-reference image quality assessment methods mostly use machine learning method to learn regression models from training images with associated human subjective scores to predict the perceptual quality of testing image. However, such opinion-aware methods expend much time on training, and rely on the distortion types of the training database. These methods have weak generalization capability, hereby limiting their usability in practice. To solve the database dependence, a normalized scale invariance based no-reference image quality assessment method was proposed. In the proposed method, the Natural Scene Statistic (NSS) feature and edge characteristic were combined as the valid features for image quality assessment, and no extra information was required beyond the testing image, then the two feature vectors were used to compute the global difference across scales as the image quality score. The experimental results show that the proposed method has good evaluation for multi-distorted images with low computational complexity. Compared to the state-of-the-art no-reference image quality assessment models, the proposed method has better comprehensive performance, and it is suitable for applications.

Key words: multi-scale, no-reference, image quality assessment, Natural Scene Statistic (NSS), structure feature

摘要： 现有的通用型无参考图像质量评价方法大多是利用失真图像及其主观值来训练回归模型预测图像质量指标,然而这种方法需要消耗大量的时间进行训练,并且评价效果依赖于训练图像库中的失真类型,通用性较差,很难应用到实际场合中。为了解决数据库依赖问题,提出一种归一化的基于图像尺度不变性的无参考图像质量评价方法。该方法不依赖外部数据,将图像的统计特性及边缘结构特性作为图像质量评价的有效特征,利用图像多尺度不变性计算多尺度间的整体特征差异,从而预测图像质量。实验结果表明,所提方法对混合失真图像质量评价效果好,运行效率高,与目前现有的无参考图像质量评估方法相比具有较好的综合性能,具有较好的应用价值。

关键词: 多尺度, 无参考, 图像质量评估, 自然场景统计特性, 结构特征

CLC Number:

TP391

TIAN Jinsha, HAN Yongguo, WU Yadong, ZHAO Xiaole, ZHANG Hongying. No-reference image quality assessment based on scale invariance[J]. Journal of Computer Applications, 2016, 36(3): 789-794.

田金沙, 韩永国, 吴亚东, 赵小乐, 张红英. 基于尺度不变性的无参考图像质量评价[J]. 计算机应用, 2016, 36(3): 789-794.

References

[1] WANG Z. Applications of objective image quality assessment methods [J]. IEEE Signal Processing Magazine, 2011,28(6):137-142.
[2] ZHANG L, ZHANG L, BOVIK A C. A feature-enriched completely blind image quality evaluator [J]. IEEE Transactions on Image Processing, 2015, 24(8):2579-2591.
[3] MOORTHY A K, BOVIK A C. A two-step framework for constructing blind image quality indices [J]. IEEE Signal Processing Letters, 2010,17(5):513-516.
[4] MOORTHY A K, BOVIK A C. Blind image quality assessment: from natural scene statistics to perceptual quality [J]. IEEE Transactions on Image Processing, 2011,20(12):3350-3364.
[5] SAAD M A, BOVIK A C, CHARRIER C. A DCT statistics-based blind image quality index [J]. IEEE Signal Processing Letters, 2010,17(6):583-586.
[6] SAAD M A, BOVIK A C, CHARRIER C. Blind image quality assessment: a natural scene statistics approach in the DCT domain [J]. IEEE Transactions on Image Processing, 2012,21(8):3339-3352.
[7] MITTAL A, MOORTHY A K, BOVIK A C. No-reference image quality assessment in the spatial domain [J]. IEEE Transactions on Image Processing, 2012, 21(12): 4695-4708.
[8] HE L, TAO D, LI X, et al. Sparse representation for blind image quality assessment [C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2012:1146-1153.
[9] LIU L, DONG H, HUANG H, et al. No-reference image quality assessment in curvelet domain [J]. Signal Processing Image Communication, 2014,29(4):494-505.
[10] YE P, DOERMANN D. No-reference image quality assessment using visual codebooks [J]. IEEE Transactions on Image Processing, 2012, 21(7):3129-3138.
[11] YE P, KUMAR J, KANG L, et al. Unsupervised feature learning framework for no-reference image quality assessment [C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2012:1098-1105.
[12] LI C, BOVIK A C, WU X. Blind image quality assessment using a general regression neural network [J]. IEEE Transactions on Neural Networks, 2011,22(5):793-799.
[13] XUE W, ZHANG L, MOU X. Learning without human scores for blind image quality assessment [C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2013:995-1002.
[14] MITTAL A, MURALIDHAR G S, GHOSH J, et al. Blind image quality assessment without human training using latent quality factors [J]. IEEE Signal Processing Letters, 2012,19(2):75-78.
[15] MITTAL A, SOUNDARARAJAN R, BOVIK A C. Making a "completely blind" image quality analyzer [J]. IEEE Signal Processing Letters, 2013,20(3):209-212.
[16] LI C, JU Y, BOVIK A C, et al. No-training, no-reference image quality index using perceptual features [J]. Optical Engineering, 2013,52(5):532-543.
[17] LINDEBERG T. Scale-space theory: a basic tool for analysing structures at different scales [J]. Journal of Applied Statistics, 1994,21(2):224-270.
[18] RUDERMAN D L. The statistics of natural images [J]. Network Computation in Neural Systems, 1994,5(4):517-548.
[19] KIM D O, HAN H S, PARK R H. Gradient information-based image quality metric [J]. IEEE Transactions on Consumer Electronics, 2010,56(2):930-936.
[20] LIU A, LIN W, NARWARIA M. Image quality assessment based on gradient similarity [J]. IEEE Transactions on Image Processing, 2012,21(4):1500-1512.
[21] XUE W, ZHANG L, MOU X, et al. Gradient magnitude similarity deviation: a highly efficient perceptual image quality index [J]. IEEE Transactions on Image Processing, 2014,23(2):684-695.
[22] RUDERMAN D L, BIALEK W. Statistics of natural images: scaling in the woods [J]. Physical Review Letters, 1994,73(6):814-817.
[23] SHARIFI K, LEON-GARCIA A. Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video [J]. IEEE Transactions on Circuits and Systems for Video Technology, 1995,5(1):52-56.
[24] GEUSEBROEK J M, SMEULDERS A W M. A six-stimulus theory for stochastic texture [J]. International Journal of Computer Vision, 2005,62(1/2):7-16.
[25] PONOMARENKO N, IEREMEIEV O, LUKIN V, et al. A new color image database TID2013: innovations and results [EB/OL]. [2015-01-22]. http://www.comlab.uniroma3.it/BattistiPapers/ACIVS2013_Battisti.pdf.
[26] SHEIKH H R, WANG Z, CORMACK L, et al. Live image quality assessment database release2 [DB/OL]. [2005-01-22]. http://live.ece.utexas.edu/research/quality.
[27] LARSON E C, CHANDLER D M. Most apparent distortion: full reference image quality assessment and the role for strategy [J]. Journal of Electronic Imaging, 2010,19(1):143-153.
[28] JAYARAMAN D, MITTAL A, MOORTHY A K, et al. Live multiply distorted image quality database [DB/OL]. [201207-23]. http://live.ece.utexas.edu/research/quality/live_multidistortedimage.html.

No-reference image quality assessment based on scale invariance

基于尺度不变性的无参考图像质量评价

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	NIU Kangli, CHEN Yuzhang, SHEN Junfeng, ZENG Zhangfan, PAN Yongcai, WANG Yichong. Dual-channel night vision image restoration method based on deep learning [J]. Journal of Computer Applications, 2021, 41(6): 1775-1784.
[2]	CAO Jianfang, TIAN Xiaodong, JIA Yiming, YAN Minmin. Application of improved DeepLabV3+ model in mural segmentation [J]. Journal of Computer Applications, 2021, 41(5): 1471-1476.
[3]	JIANG Li, HUANG Shijian, YAN Wenjuan. Human action recognition method based on low-rank action information and multi-scale convolutional neural network [J]. Journal of Computer Applications, 2021, 41(3): 721-726.
[4]	DU Peide, YAN Hua. Crowd counting network based on multi-scale spatial attention feature fusion [J]. Journal of Computer Applications, 2021, 41(2): 537-543.
[5]	HAN Jiandong, LI Xiaoyu. Pedestrian re-identification method based on multi-scale feature fusion [J]. Journal of Computer Applications, 2021, 41(10): 2991-2996.
[6]	XIAO Yong, ZHENG Kaihong, ZHENG Zhenjing, QIAN Bin, LI Sen, MA Qianli. Multi-scale skip deep long short-term memory network for short-term multivariate load forecasting [J]. Journal of Computer Applications, 2021, 41(1): 231-236.
[7]	WEN Jing, SONG Jianwei. Visual saliency detection based on multi-level global information propagation model [J]. Journal of Computer Applications, 2021, 41(1): 208-214.
[8]	ZHANG Yonghong, LIU Hao, TIAN Wei, WANG Jiangeng. Rainfall cloud segmentation method in Tibet based on DeepLab v3 [J]. Journal of Computer Applications, 2020, 40(9): 2781-2788.
[9]	GAO Zhiyong, HUANG Jinzhen, DU Chenggang. Pulmonary nodule detection based on feature pyramid networks [J]. Journal of Computer Applications, 2020, 40(9): 2571-2576.
[10]	ZHU Xingdong, TIAN Shaobing, HUANG Kui, FAN Jiali, WANG Zheng, CHENG Huacheng. Target detection of carrier-based aircraft based on deep convolutional neural network [J]. Journal of Computer Applications, 2020, 40(5): 1529-1533.
[11]	ZHANG Junsheng, XU Jingjing, YU Wei. No-reference image quality assessment method for facial beautification image [J]. Journal of Computer Applications, 2020, 40(4): 1184-1190.
[12]	BIAN Xiaoyong, FEI Xiongjun, MU Nan. Remote sensing image scene classification based on scale-attention network [J]. Journal of Computer Applications, 2020, 40(3): 872-877.
[13]	FAN Fan, GAO Yuan, QIN Pinle, WANG Lifang. Abdominal MRI image multi-scale super-resolution reconstruction based on parallel channel-spatial attention mechanism [J]. Journal of Computer Applications, 2020, 40(12): 3624-3630.
[14]	CAO Yudong, CAI Xibiao. No-reference image quality assessment algorithm with enhanced adversarial learning [J]. Journal of Computer Applications, 2020, 40(11): 3166-3171.
[15]	LI Cuijin, QU Zhong. Review of image edge detection algorithms based on deep learning [J]. Journal of Computer Applications, 2020, 40(11): 3280-3288.