基于蚁群优化算法的弱光图像显著性目标检测

doi:10.11772/j.issn.1001-9081.2020111814

摘要/Abstract

摘要： 近年来，显著性目标检测受到工业界和学术界的大量关注，成为了计算机视觉领域中一项重要的基础研究，该问题的解决有助于各类视觉任务取得突破性进展。尽管针对可见光场景的显著性检测工作已经取得了有效成果，但如何在信噪比偏低、可用有效信息匮乏的弱光图像中提取边界清晰、内部结构准确的显著性目标，仍然是具有挑战性的难题。针对弱光场景下显著性目标检测存在边界模糊、结构不完整等造成准确率较低的问题，提出基于蚁群优化（ACO）算法的显著性检测模型。首先，通过多尺度超像素分割将输入图像转换为具有不同节点的无向图；其次，基于最优特征选择策略来更充分地获取低对比度弱光图像中所包含的更多显著目标的特征信息，并摒弃冗余的噪声信息；然后，引入空间对比度策略用于探索弱光图像中具有相对较高对比度的全局显著性线索。而为了在低信噪比情况下也能获取准确的显著性估计，利用ACO算法对显著图进行优化。通过在3个公共数据集（MSRA、CSSD和PASCAL-S）以及夜间弱光图像（NI）数据集上进行实验，可以看出，所提模型在3个公共数据集上的曲线下面积（AUC）值分别达到了87.47%、84.27%和81.58%，在NI数据集上的AUC值比排名第2的低秩矩阵恢复（LR）模型提高了2.17个百分点。实验结果表明，相较于11种主流的显著性检测模型，所提模型具有结构更准确且边界更清晰的检测效果，有效抑制了弱光场景对显著性目标检测性能的干扰。

关键词: 显著性目标检测, 弱光图像, 蚁群优化算法, 超像素, 最优特征

Abstract: With substantial attention being received from industry and academia over last decade, salient object detection has become an important fundamental research in computer vision. The solution of salient object detection will be helpful to make breakthroughs in various visual tasks. Although various works have achieved remarkable success for saliency detection tasks in visible light scenes, there still remain a challenging issue on how to extract salient objects with clear boundary and accurate internal structure in weak light images with low signal-to-noise ratios and limited effective information. For that fuzzy boundary and incomplete internal structure cause low accuracy of salient object detection in weak light scenes, an Ant Colony Optimization (ACO) algorithm based saliency detection framework was proposed. Firstly, the input image was transformed into an undirected graph with different nodes by multi-scale superpixel segmentation. Secondly, the optimal feature selection strategy was adopted to capture the useful information contained in the salient object and eliminate the redundant noise information from weak light image with low contrast. Then, the spatial contrast strategy was introduced to explore the global saliency cues with relatively high contrast in the weak light image. To acquire more accurate saliency estimation at low signal-to-noise ratio, the ACO algorithm was used to optimize the saliency map. Through the experiments on three public datasets (MSRA, CSSD and PASCAL-S) and the Nighttime Image (NI) dataset, it can be seen that the Area Under the Curve (AUC) value of the proposed model reached 87.47%, 84.27% and 81.58% on three public datasets respectively, and the AUC value of the model was increased by 2.17 percentage points compared to that of the Low Rank Matrix Recovery (LR) model (which ranked the second) on the NI dataset. The results demonstrate that the proposed model has the detection effect with more accurate structure and clearer boundary compared to 11 mainstream saliency detection models and effectively suppresses the interference of weak light scenes on the detection performance of salient objects.

Key words: salient object detection, weak light image, Ant Colony Optimization (ACO) algorithm, superpixel, optimal feature

中图分类号:

TP391.41

汪虹余, 张彧, 杨恒, 穆楠. 基于蚁群优化算法的弱光图像显著性目标检测[J]. 计算机应用, 2021, 41(10): 2970-2978.

WANG Hongyu, ZHANG Yu, YANG Heng, MU Nan. Salient object detection in weak light images based on ant colony optimization algorithm[J]. Journal of Computer Applications, 2021, 41(10): 2970-2978.

参考文献

[1] PÉREZ DE SAN ROMAN P, BENOIS-PINEAU J, DOMENGER JP, et al. Saliency driven object recognition in egocentric videos with deep CNN:toward application in assistance to neuroprostheses[J]. Computer Vision and Image Understanding, 2017, 164:82-91.
[2] SU Y Y, ZHAO Q J, ZHAO L J, et al. Abrupt motion tracking using a visual saliency embedded particle filter[J]. Pattern Recognition, 2014, 47(5):1826-1834.
[3] YANG X Y, QIAN X M, XUE Y. Scalable mobile image retrieval by exploring contextual saliency[J]. IEEE Transactions on Image Processing, 2015, 24(6):1709-1721.
[4] MARTINEL N, MICHELONI C, FORESTI G L. Kernelized saliency-based person re-identification through multiple metric learning[J]. IEEE Transactions on Image Processing, 2015, 24(12):5645-5658.
[5] ITTI L, KOCH C, NIEBUR E. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(11):1254-1259.
[6] ZHANG P P, LIU W, WANG D, et al. Non-rigid object tracking via deep multi-scale spatial-temporal discriminative saliency maps[J]. Pattern Recognition, 2020, 100:No. 107130.
[7] JIAN M W, ZHANG W Y, YU H, et al. Saliency detection based on directional patches extraction and principal local color contrast[J]. Journal of Visual Communication and Image Representation, 2018, 57:1-11.
[8] 杨小冈, 李维鹏, 马玛双. 概率框架下多特征显著性检测算法[J]. 电子学报, 2019, 47(11):2378-2385.(YANG X G, LI W P, MA M S. Saliency detection with multi-features in probability framework[J]. Acta Electronica Sinica, 2019, 47(11):2378-2385.)
[9] WU Z, SU L, HUANG Q M. Cascaded partial decoder for fast and accurate salient object detection[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2019:3902-3911.
[10] WANG W G, ZHAO S Y, SHEN J B, et al. Salient object detection with pyramid attention and salient edges[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2019:1448-1457.
[11] ZHAO T, WU X Q. Pyramid feature attention network for saliency detection[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2019:3080-3089.
[12] 杨兴明, 王雨廷, 谢昭, 等. 基于"轮廓-区域" 多层互补特性的显著性检测[J]. 电子学报, 2018, 46(11):2688-2695.(YANG X M, WANG Y T, XIE Z, et al. Saliency detection with multilayer contour-region complementary[J]. Acta Electronica Sinica, 2018, 46(11):2688-2695.)
[13] 凌艳, 陈莹. 多尺度上下文信息增强的显著目标检测全卷积网络[J]. 计算机辅助设计与图形学学报, 2019, 31(11):2007-2016. (LING Y, CHEN Y. Salient object detection with multiscale context enhanced fully convolutional network[J]. Journal of Computer-Aided Design and Computer Graphics, 2019, 31(11):2007-2016.)
[14] 纪超, 黄新波, 曹雯, 等. 结合深度学习和全局-局部特征的图像显著区域计算[J]. 计算机辅助设计与图形学学报, 2019, 31(10):1838-1846.(JI C, HUANG X B, CAO W, et al. Fusion of deep learning and global-local features of the image salient region calculation[J]. Journal of Computer-Aided Design and Computer Graphics, 2019, 31(10):1838-1846.)
[15] DORIGO M, MANIEZZO V, COLORNI A. The ant system:an autocatalytic optimizing process:91-016[R]. Milano:Politecnico di Milano, 1991.
[16] HAN Y F, SHI P F. An improved ant colony algorithm for fuzzy clustering in image segmentation[J]. Neurocomputing, 2007, 70(4/5/6):665-671.
[17] TIAN J, CHEN L. Depth image up-sampling using ant colony optimization[C]//Proceedings of the 21st International Conference on Pattern Recognition. Piscataway:IEEE, 2012:3795-3798.
[18] WANG M W, WAN Y C, YE Z W, et al. Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm[J]. Information Sciences, 2017, 402:50-68.
[19] LIU T, SUN J, ZHENG N N, et al. Learning to detect a salient object[C]//Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2007:1-8.
[20] YAN Q, XU L, SHI J P, et al. Hierarchical saliency detection[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2013:1155-1162.
[21] LI Y, HOU X D, KOCH C, et al. The secrets of salient object segmentation[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2014:280-287.
[22] ACHANTA R, SHAJI A, SMITH K, et al. SLIC superpixels compared to state-of-the-art superpixel methods[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11):2274-2282.
[23] OTSU N. A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1):62-66.
[24] MURRAY N, VANRELL M, OTAZU X, et al. Saliency estimation using a non-parametric low-level vision model[C]//Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2011:433-440.
[25] GOFERMAN S, ZELNIK-MANOR L, TAL A. Context-aware saliency detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(10):1915-1926.
[26] SHEN X H, WU Y. A unified approach to salient object detection via low rank matrix recovery[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2012:853-860.
[27] MARGOLIN R, TAL A, ZELNIK-MANOR L. What makes a patch distinct?[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2013:1139-1146.
[28] YANG C, ZHANG L H, LU H C, et al. Saliency detection via graph-based manifold ranking[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2013:3166-3137.
[29] ZHU W J, LIANG S, WEI Y C, et al. Saliency optimization from robust background detection[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2014:2814-2821.
[30] TONG N, LU H C, RUAN X, et al. Salient object detection via bootstrap learning[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2015:1884-1892.
[31] JIANG P, VASCONCELOS N, PENG J L. Generic promotion of diffusion-based salient object detection[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision. Piscataway:IEEE, 2015:217-225.
[32] ZHANG J, WANG M, ZHANG S P, et al. Spatiochromatic context modeling for color saliency analysis[J]. IEEE Transactions on Neural Networks and Learning Systems, 2016, 27(6):1177-1189.
[33] PENG H W, LI B, LING H B, et al. Salient object detection via structured matrix decomposition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4):818-832.
[34] HUANG F, QI J Q, LU H C, et al. Salient object detection via multiple instance learning[J]. IEEE Transactions on Image Processing, 2017, 26(4):1911-1922.
[35] BEYER H G, SENDHOFF B. Robust optimization-a comprehensive survey[J]. Computer Methods in Applied Mechanics and Engineering, 2007, 196(33/34):3190-3218.
[36] GOH C K, TAN K C, CHEONG C Y, et al. An investigation on noise-induced features in robust evolutionary multi-objective optimization[J]. Expert Systems with Applications, 2010, 37(8):5960-5980.
[37] BRANKE J. Evolutionary Optimization in Dynamic Environments[M]. Boston, MA:Springer, 2002:11-12.