基于熵驱动域适应学习的单幅图像阴影检测方法

doi:10.11772/j.issn.1001-9081.2019122068

计算机应用 ›› 2020, Vol. 40 ›› Issue (7): 2131-2136.DOI: 10.11772/j.issn.1001-9081.2019122068

• 虚拟现实与多媒体计算 • 上一篇下一篇

基于熵驱动域适应学习的单幅图像阴影检测方法

袁园¹, 吴文¹, 万毅²

1. 新疆理工学院信息工程系, 新疆阿克苏 843100;
2. 温州大学电气与电子工程学院, 浙江温州 325035

收稿日期:2019-12-09 修回日期:2020-03-02 出版日期:2020-07-10 发布日期:2020-05-14
通讯作者: 万毅
作者简介:袁园(1982-),女,重庆人,副教授,硕士,主要研究方向:图像处理、深度学习;吴文(1994-),男,湖北武汉人,硕士,主要研究方向:图像处理、深度学习;万毅(1974-),男,浙江温州人,教授,博士,主要研究方向:系统可行性、智能检测。
基金资助:
浙江省科技计划基础公益研究计划项目（LGG18F040002）；浙江省自然科学基金资助项目（LY19F020035）。

Single image shadow detection method based on entropy driven domain adaptive learning

YUAN Yuan¹, WU Wen¹, WAN Yi²

1. Department of Information Engineering, Xinjiang Institute of Technology, Aksu Xinjiang 843100, China;
2. School of Electrical and Electronic Engineering, Wenzhou University, Wenzhou Zhejiang 325035, China

Received:2019-12-09 Revised:2020-03-02 Online:2020-07-10 Published:2020-05-14
Supported by:
This work is partially supported by the Basic Public Welfare Research Program of Zhejiang Science and Technology Plan (LGG18F040002), the Natural Science Foundation of Zhejiang (LY19F020035).

摘要/Abstract

摘要： 跨域差异常常会阻碍深度神经网络的泛化，使其不能适应不同的数据集，为了提高模型阴影检测的鲁棒性，提出了一种新颖的无监督域适应阴影检测框架。首先，为了缩小域间的数据偏差，采用分层域适应策略校准源域和目标域间从低层到高层的特征分布；其次，为了加强模型软阴影的检测能力，提出边界对抗分支以确保模型在目标数据集上同样可以得到结构化的阴影边界；然后，结合熵对抗分支进一步抑制预测结果中边界处的高不确定性，从而得到边界平滑、准确的阴影掩膜。与已有深度学习检测方法相比，所提方法在客观数据集ISTD、SBU上的平衡误差率（BER）分别降低了10.5%、18.75%。实验结果表明所提方法的阴影检测结果具有更好的边缘结构性。

关键词: 非监督域适应, 深度学习, 图像处理, 阴影检测, 信息熵

Abstract: Cross-domain discrepancy frequently hinders deep neural networks to generalize to different datasets. In order to improve the robustness of shadow detection, a novel unsupervised domain adaptive shadow detection framework was proposed. Firstly, in order to reduce the data bias between different domains, a multi-level domain adaptive model was introduced to align the feature distributions of source domain and target domain from low level to high level. Secondly, to improve the model ability of soft shadow detection, a boundary-driven adversarial branch was proposed to guarantee the structured shadow boundary was also able to be obtained by the model on the target dataset. Thirdly, the entropy adversarial branch was combined to further suppress the high uncertainty at shadow boundary of the prediction result, so as to obtain an accurate and smooth shadow mask. Compared with the existing deep learning-based shadow detection methods, the proposed method has the Balance Error Rate (BER) averagely reduced by 10.5% and 18.75% on ISTD dataset and SBU dataset respectively. The experimental results demonstrate that the shadow detection results of the proposed algorithm have better boundary structure.

Key words: unsupervised domain adaptation, deep learning, image processing, shadow detection, information entropy

中图分类号:

TP391.41

袁园, 吴文, 万毅. 基于熵驱动域适应学习的单幅图像阴影检测方法[J]. 计算机应用, 2020, 40(7): 2131-2136.

YUAN Yuan, WU Wen, WAN Yi. Single image shadow detection method based on entropy driven domain adaptive learning[J]. Journal of Computer Applications, 2020, 40(7): 2131-2136.

参考文献

[1] SUN G,HUANG H,WENG Q,et al. Combinational shadow index for building shadow extraction in urban areas from Sentinel-2A MSI imagery[J]. International Journal of Applied Earth Observation and Geoinformation,2019,78:53-65.
[2] CHAI D,NEWSAM S,ZHANG H K,et al. Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks[J]. Remote Sensing of Environment, 2019, 225:307-316.
[3] SCHEEL A,DIETMAYER K. Tracking multiple vehicles using a variational radar model[J]. IEEE Transactions on Intelligent Transportation Systems,2019,20(10):3721-3736.
[4] ZHU J,SAMUEL K G G,MASOOD S Z,et al. Learning to recognize shadows in monochromatic natural images[C]//Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2010:223-230.
[5] GUO R,DAI Q,HOIEM D. Paired regions for shadow detection and removal[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(12):2956-2967.
[6] VICENTE T F Y,HOAI M,SAMARAS D. Leave-one-out kernel optimization for shadow detection and removal[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,40(3):682-695.
[7] KHAN S H,BENNAMOUN M,SOHEL F,et al. Automatic shadow detection and removal from a single image[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(3):431-446.
[8] VICENTE T F Y,HOU L,YU C P,et al. Large-scale training of shadow detectors with noisily-annotated shadow examples[C]//Proceedings of the 14th European Conference on Computer Vision, LNCS 9910. Cham:Springer,2016:816-832.
[9] NGUYEN V,VICENTE T F Y,ZHAO M,et al. Shadow detection with conditional generative adversarial networks[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway:IEEE,2017:4520-4528.
[10] LE H,VICENTE T F Y,NGUYEN V,et al. A+D Net:training a shadow detector with adversarial shadow attenuation[C]//Proceedings of the 15th European Conference on Computer Vision. Cham:Springer,2018:680-696.
[11] WANG J,LI X,YANG J. Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2018:1788-1797.
[12] MOHAJERANI S,SAEEDI P. CPNet:a context preserver convolutional neural network for detecting shadows in single RGB images[C]//Proceedings of the IEEE 20th International Workshop on Multimedia Signal Processing. Piscataway:IEEE,2018:1-5.
[13] ZHANG Z,LIU Q,WANG Y. Road extraction by deep residual U-Net[J]. IEEE Geoscience and Remote Sensing Letters,2018, 15(5):749-753.
[14] KAMNITSAS K,BAUMGARTNER C,LEDIG C,et al. Unsupervised domain adaptation in brain lesion segmentation with adversarial networks[C]//Proceedings of the 25th International Conference on Information Processing in Medical Imaging,LNCS 10265. Cham:Springer,2017:597-609.
[15] CHEN Y,LI W,SAKARIDIS C,et al. Domain adaptive faster RCNN for object detection in the wild[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2018:3339-3348.
[16] LONG M,CAO Y,WANG J,et al. Learning transferable features with deep adaptation networks[C]//Proceedings of the 32nd International Conference on Machine Learning. New York:JMLR.org, 2015:97-105.
[17] HUANG H,HUANG Q,KRÄHENBÜHL P. Domain transfer through deep activation matching[C]//Proceedings of the 15th European Conference on Computer Vision,LNCS 11220. Cham:Springer,2018:611-626-605.
[18] XIE R,YU F,WANG J,et al. Multi-level domain adaptive learning for cross-domain detection[EB/OL].[2019-03-20]. https://arxiv.org/pdf/1907.11484.pdf.
[19] VU T H,JAIN H,BUCHER M,et al. ADVENT:adversarial entropy minimization for domain adaptation in semantic segmentation[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2019:2512-2521.
[20] ISOLA P,ZHU J,ZHOU T,et al. Image-to-image translation with conditional adversarial networks[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:5967-5976.
[21] LOFFE S,SZEGEDY C. Batch normalization:accelerating deep network training by reducing internal covariate shift[C]//Proceedings of the 32nd International Conference on Machine Learning. New York:JMLR.org,2015:448-456.
[22] 廖斌, 吴文. 区域配对引导的光照传播视频阴影去除方法[J]. 计算机应用,2019,39(2):556-563.(LIAO B,WU W. Video shadow removal using region matching guided by illumination transfer[J]. Journal of Computer Applications,2019,39(2):556-563.)

基于熵驱动域适应学习的单幅图像阴影检测方法

Single image shadow detection method based on entropy driven domain adaptive learning

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	陈成瑞, 孙宁, 何世彪, 廖勇. 面向C-V2X通信的基于深度学习的联合信道估计与均衡算法[J]. 计算机应用, 2021, 41(9): 2687-2693.
[2]	谢德峰, 吉建民. 融入句法感知表示进行句法增强的语义解析[J]. 计算机应用, 2021, 41(9): 2489-2495.
[3]	代雨柔, 杨庆, 张凤荔, 周帆. 基于自监督学习的社交网络用户轨迹预测模型[J]. 计算机应用, 2021, 41(9): 2545-2551.
[4]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[5]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[6]	郑志强, 胡鑫, 翁智, 王雨禾, 程曦. 基于改进DenseNet的牛眼图像特征提取方法[J]. 计算机应用, 2021, 41(9): 2780-2784.
[7]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[8]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[9]	何正海, 线岩团, 王蒙, 余正涛. 融合句法指导与字符注意力机制的案情阅读理解方法[J]. 计算机应用, 2021, 41(8): 2427-2431.
[10]	李亚芳, 梁烨, 冯韦玮, 祖宝开, 康玉健. 基于社区优化的深度网络嵌入方法[J]. 计算机应用, 2021, 41(7): 1956-1963.
[11]	王月, 江逸茗, 兰巨龙. 基于改进三元组网络和K近邻算法的入侵检测[J]. 计算机应用, 2021, 41(7): 1996-2002.
[12]	谭道强, 曾诚, 乔金霞, 张俊. 基于混合注意力模型的阴影检测方法[J]. 计算机应用, 2021, 41(7): 2076-2081.
[13]	杜炎, 吕良福, 焦一辰. 基于模糊推理的模糊原型网络[J]. 计算机应用, 2021, 41(7): 1885-1890.
[14]	高钦泉, 黄炳城, 刘文哲, 童同. 基于改进CenterNet的竹条表面缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1933-1938.
[15]	侯笑晗, 金国栋, 谭力宁, 薛远亮. 基于自适应和最优特征的合成孔径雷达舰船检测方法[J]. 计算机应用, 2021, 41(7): 2150-2155.