Abstract：The idea of hierarchical processing of convolution features in neural networks has a significant effect on saliency object detection. However, when integrating hierarchical features, it is still an open problem how to obtain rich global information, as well as effectively integrate the global information and of the higher-level feature space and low-level detail information. Therefore, a saliency detection algorithm based on a multi-level global information propagation model was proposed. In order to extract rich multi-scale global information, a Multi-scale Global Feature Aggregation Module (MGFAM) was introduced to the higher-level, and feature fusion operation was performed to the global information extracted from multiple levels. In addition, in order to obtain the global information of the high-level feature space and the rich low-level detail information at the same time, the extracted discriminative high-level global semantic information was fused with the lower-level features by means of feature propagation. These operations were able to extract the high-level global semantic information to the greatest extent, and avoid the loss of this information when it was gradually propagated to the lower-level. Experimental results on four datasets including ECSSD,PASCAL-S,SOD,HKU-IS show that compared with the advanced NLDF (Non-Local Deep Features for salient object detection) model, the proposed algorithm has the F-measure (F) value increased by 0.028、0.05、0.035 and 0.013 respectively, the Mean Absolute Error (MAE) decreased by 0.023、0.03、0.023 and 0.007 respectively, and the proposed algorithm was superior to several classical image saliency detection methods in terms of precision, recall, F-measure and MAE.
温静, 宋建伟. 基于多级全局信息传递模型的视觉显著性检测[J]. 计算机应用, 2021, 41(1): 208-214.
WEN Jing, SONG Jianwei. Visual saliency detection based on multi-level global information propagation model. Journal of Computer Applications, 2021, 41(1): 208-214.
[1] HONG S,YOU T,KWAK S,et al. Online tracking by learning discriminative saliency map with convolutional neural network[C]//Proceedings of the 2015 International Conference on Machine Learning. New York:JMLR. org,2015:597-606. [2] LONG J,SHELHAMER E,DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:3431-3440. [3] ZHAO R,OUYANG W,WANG X. Unsupervised salience learning for person re-identification[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2013:3586-3593. [4] CHENG M,ZHANG F,MITRA N J,et al. RepFinder:finding approximately repeated scene elements for image editing[J]. ACM Transactions on Graphics,2010,29(4):No. 83. [5] ITTI L,KOCH C,NIEBUR E. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259. [6] BORJI A,ITTI L. Exploiting local and global patch rarities for saliency detection[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2012:478-485. [7] WANG L,LU H,RUAN X,et al. Deep networks for saliency detection via local estimation and global search[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:3183-3192. [8] LI G,YU Y. Visual saliency based on multiscale deep features[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:5455-5463. [9] LEE G,TAI Y W,KIM J. Deep saliency with encoded low level distance map and high level features[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2016:660-668. [10] LIU N,HAN J. DHSNet:deep hierarchical saliency network for salient object detection[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2016:678-686. [11] WANG L,WANG L,LU H,et al. Saliency detection with recurrent fully convolutional networks[C]//Proceedings of the 2016 European Conference on Computer Vision,LNCS 9908. Cham:Springer,2016:825-841. [12] LUO Z,MISHRA A,ACHKAR A,et al. Non-local deep features for salient object detection[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:6593-6601. [13] ZHANG L,DAI J,LU H,et al. A bi-directional message passing model for salient object detection[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2018:1741-1750. [14] WANG T,BORJI A,ZHANG L,et al. A stagewise refinement model for detecting salient objects in images[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway:IEEE,2017:4039-4048. [15] WANG T,ZHANG L,WANG S,et al. Detect globally,refine locally:a novel approach to saliency detection[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2018:3127-3135. [16] WANG L,LU H,WANG Y,et al. Learning to detect salient objects with image-level supervision[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:3796-3805. [17] LI Y,HOU X,KOCH C,et al. The secrets of salient object segmentation[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2014:280-287. [18] YAN Q,XU L,SHI J,et al. Hierarchical saliency detection[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2013:1155-1162. [19] MOVAHEDI V,ELDER J H. Design and perceptual validation of performance measures for salient object segmentation[C]//Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Piscataway:IEEE,2010:49-56. [20] LI G,YU Y. Visual saliency based on multiscale deep features[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:5455-5463. [21] YANG C,ZHANG L,LU H,et al. Saliency detection via graphbased manifold ranking[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2013:3166-3173. [22] CHEN L C,PAPANDREOU G,KOKKINOS I,et al. DeepLab:semantic image segmentation with deep convolutional nets,atrous convolution,and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(4):834-848. [23] YAN Q,XU L,SHI J,et al. Hierarchical saliency detection[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2013:1155-1162. [24] ZHU W,LIANG S,WEI Y,et al. Saliency optimization from robustbackground detection[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2014:2814-2821. [25] ZHAO T,WU X. Pyramid feature attention network for saliency detection[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2019:3080-3089. [26] HOU Q,CHENG M,HU X,et al. Deeply supervised salient object detection with short connections[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:5300-5309.
2021, Vol. 41 
