基于熵驱动域适应学习的单幅图像阴影检测方法

doi:10.11772/j.issn.1001-9081.2019122068

计算机应用 ›› 2020, Vol. 40 ›› Issue (7): 2131-2136.DOI: 10.11772/j.issn.1001-9081.2019122068

• 虚拟现实与多媒体计算 • 上一篇下一篇

基于熵驱动域适应学习的单幅图像阴影检测方法

袁园¹, 吴文¹, 万毅²

1. 新疆理工学院信息工程系, 新疆阿克苏 843100;
2. 温州大学电气与电子工程学院, 浙江温州 325035

收稿日期:2019-12-09 修回日期:2020-03-02 发布日期:2020-05-14 出版日期:2020-07-10
通讯作者: 万毅
作者简介:袁园(1982-),女,重庆人,副教授,硕士,主要研究方向:图像处理、深度学习;吴文(1994-),男,湖北武汉人,硕士,主要研究方向:图像处理、深度学习;万毅(1974-),男,浙江温州人,教授,博士,主要研究方向:系统可行性、智能检测。
基金资助:
浙江省科技计划基础公益研究计划项目（LGG18F040002）；浙江省自然科学基金资助项目（LY19F020035）。

Single image shadow detection method based on entropy driven domain adaptive learning

YUAN Yuan¹, WU Wen¹, WAN Yi²

1. Department of Information Engineering, Xinjiang Institute of Technology, Aksu Xinjiang 843100, China;
2. School of Electrical and Electronic Engineering, Wenzhou University, Wenzhou Zhejiang 325035, China

Received:2019-12-09 Revised:2020-03-02 Online:2020-05-14 Published:2020-07-10
Supported by:
This work is partially supported by the Basic Public Welfare Research Program of Zhejiang Science and Technology Plan (LGG18F040002), the Natural Science Foundation of Zhejiang (LY19F020035).

摘要/Abstract

摘要： 跨域差异常常会阻碍深度神经网络的泛化，使其不能适应不同的数据集，为了提高模型阴影检测的鲁棒性，提出了一种新颖的无监督域适应阴影检测框架。首先，为了缩小域间的数据偏差，采用分层域适应策略校准源域和目标域间从低层到高层的特征分布；其次，为了加强模型软阴影的检测能力，提出边界对抗分支以确保模型在目标数据集上同样可以得到结构化的阴影边界；然后，结合熵对抗分支进一步抑制预测结果中边界处的高不确定性，从而得到边界平滑、准确的阴影掩膜。与已有深度学习检测方法相比，所提方法在客观数据集ISTD、SBU上的平衡误差率（BER）分别降低了10.5%、18.75%。实验结果表明所提方法的阴影检测结果具有更好的边缘结构性。

关键词: 非监督域适应, 深度学习, 图像处理, 阴影检测, 信息熵

Abstract: Cross-domain discrepancy frequently hinders deep neural networks to generalize to different datasets. In order to improve the robustness of shadow detection, a novel unsupervised domain adaptive shadow detection framework was proposed. Firstly, in order to reduce the data bias between different domains, a multi-level domain adaptive model was introduced to align the feature distributions of source domain and target domain from low level to high level. Secondly, to improve the model ability of soft shadow detection, a boundary-driven adversarial branch was proposed to guarantee the structured shadow boundary was also able to be obtained by the model on the target dataset. Thirdly, the entropy adversarial branch was combined to further suppress the high uncertainty at shadow boundary of the prediction result, so as to obtain an accurate and smooth shadow mask. Compared with the existing deep learning-based shadow detection methods, the proposed method has the Balance Error Rate (BER) averagely reduced by 10.5% and 18.75% on ISTD dataset and SBU dataset respectively. The experimental results demonstrate that the shadow detection results of the proposed algorithm have better boundary structure.

Key words: unsupervised domain adaptation, deep learning, image processing, shadow detection, information entropy

中图分类号:

TP391.41

袁园, 吴文, 万毅. 基于熵驱动域适应学习的单幅图像阴影检测方法[J]. 计算机应用, 2020, 40(7): 2131-2136.

YUAN Yuan, WU Wen, WAN Yi. Single image shadow detection method based on entropy driven domain adaptive learning[J]. Journal of Computer Applications, 2020, 40(7): 2131-2136.

参考文献

[1] SUN G,HUANG H,WENG Q,et al. Combinational shadow index for building shadow extraction in urban areas from Sentinel-2A MSI imagery[J]. International Journal of Applied Earth Observation and Geoinformation,2019,78:53-65.
[2] CHAI D,NEWSAM S,ZHANG H K,et al. Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks[J]. Remote Sensing of Environment, 2019, 225:307-316.
[3] SCHEEL A,DIETMAYER K. Tracking multiple vehicles using a variational radar model[J]. IEEE Transactions on Intelligent Transportation Systems,2019,20(10):3721-3736.
[4] ZHU J,SAMUEL K G G,MASOOD S Z,et al. Learning to recognize shadows in monochromatic natural images[C]//Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2010:223-230.
[5] GUO R,DAI Q,HOIEM D. Paired regions for shadow detection and removal[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(12):2956-2967.
[6] VICENTE T F Y,HOAI M,SAMARAS D. Leave-one-out kernel optimization for shadow detection and removal[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,40(3):682-695.
[7] KHAN S H,BENNAMOUN M,SOHEL F,et al. Automatic shadow detection and removal from a single image[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(3):431-446.
[8] VICENTE T F Y,HOU L,YU C P,et al. Large-scale training of shadow detectors with noisily-annotated shadow examples[C]//Proceedings of the 14th European Conference on Computer Vision, LNCS 9910. Cham:Springer,2016:816-832.
[9] NGUYEN V,VICENTE T F Y,ZHAO M,et al. Shadow detection with conditional generative adversarial networks[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway:IEEE,2017:4520-4528.
[10] LE H,VICENTE T F Y,NGUYEN V,et al. A+D Net:training a shadow detector with adversarial shadow attenuation[C]//Proceedings of the 15th European Conference on Computer Vision. Cham:Springer,2018:680-696.
[11] WANG J,LI X,YANG J. Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2018:1788-1797.
[12] MOHAJERANI S,SAEEDI P. CPNet:a context preserver convolutional neural network for detecting shadows in single RGB images[C]//Proceedings of the IEEE 20th International Workshop on Multimedia Signal Processing. Piscataway:IEEE,2018:1-5.
[13] ZHANG Z,LIU Q,WANG Y. Road extraction by deep residual U-Net[J]. IEEE Geoscience and Remote Sensing Letters,2018, 15(5):749-753.
[14] KAMNITSAS K,BAUMGARTNER C,LEDIG C,et al. Unsupervised domain adaptation in brain lesion segmentation with adversarial networks[C]//Proceedings of the 25th International Conference on Information Processing in Medical Imaging,LNCS 10265. Cham:Springer,2017:597-609.
[15] CHEN Y,LI W,SAKARIDIS C,et al. Domain adaptive faster RCNN for object detection in the wild[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2018:3339-3348.
[16] LONG M,CAO Y,WANG J,et al. Learning transferable features with deep adaptation networks[C]//Proceedings of the 32nd International Conference on Machine Learning. New York:JMLR.org, 2015:97-105.
[17] HUANG H,HUANG Q,KRÄHENBÜHL P. Domain transfer through deep activation matching[C]//Proceedings of the 15th European Conference on Computer Vision,LNCS 11220. Cham:Springer,2018:611-626-605.
[18] XIE R,YU F,WANG J,et al. Multi-level domain adaptive learning for cross-domain detection[EB/OL].[2019-03-20]. https://arxiv.org/pdf/1907.11484.pdf.
[19] VU T H,JAIN H,BUCHER M,et al. ADVENT:adversarial entropy minimization for domain adaptation in semantic segmentation[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2019:2512-2521.
[20] ISOLA P,ZHU J,ZHOU T,et al. Image-to-image translation with conditional adversarial networks[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:5967-5976.
[21] LOFFE S,SZEGEDY C. Batch normalization:accelerating deep network training by reducing internal covariate shift[C]//Proceedings of the 32nd International Conference on Machine Learning. New York:JMLR.org,2015:448-456.
[22] 廖斌, 吴文. 区域配对引导的光照传播视频阴影去除方法[J]. 计算机应用,2019,39(2):556-563.(LIAO B,WU W. Video shadow removal using region matching guided by illumination transfer[J]. Journal of Computer Applications,2019,39(2):556-563.)

基于熵驱动域适应学习的单幅图像阴影检测方法

Single image shadow detection method based on entropy driven domain adaptive learning

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	李顺勇, 李师毅, 胥瑞, 赵兴旺. 基于自注意力融合的不完整多视图聚类算法[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2696-2703.
[2]	黄云川, 江永全, 黄骏涛, 杨燕. 基于元图同构网络的分子毒性预测[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2964-2969.
[3]	潘烨新, 杨哲. 基于多级特征双向融合的小目标检测优化模型[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2871-2877.
[4]	秦璟, 秦志光, 李发礼, 彭悦恒. 基于概率稀疏自注意力神经网络的重性抑郁疾患诊断[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2970-2974.
[5]	王熙源, 张战成, 徐少康, 张宝成, 罗晓清, 胡伏原. 面向手术导航3D/2D配准的无监督跨域迁移网络[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2911-2918.
[6]	刘禹含, 吉根林, 张红苹. 基于骨架图与混合注意力的视频行人异常检测方法[J]. 《计算机应用》唯一官方网站, 2024, 44(8): 2551-2557.
[7]	顾焰杰, 张英俊, 刘晓倩, 周围, 孙威. 基于时空多图融合的交通流量预测[J]. 《计算机应用》唯一官方网站, 2024, 44(8): 2618-2625.
[8]	石乾宏, 杨燕, 江永全, 欧阳小草, 范武波, 陈强, 姜涛, 李媛. 面向空气质量预测的多粒度突变拟合网络[J]. 《计算机应用》唯一官方网站, 2024, 44(8): 2643-2650.
[9]	赵亦群, 张志禹, 董雪. 基于密集残差物理信息神经网络的各向异性旅行时计算方法[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2310-2318.
[10]	徐松, 张文博, 王一帆. 基于时空信息的轻量视频显著性目标检测网络[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2192-2199.
[11]	孙逊, 冯睿锋, 陈彦如. 基于深度与实例分割融合的单目3D目标检测方法[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2208-2215.
[12]	吴筝, 程志友, 汪真天, 汪传建, 王胜, 许辉. 基于深度学习的患者麻醉复苏过程中的头部运动幅度分类方法[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2258-2263.
[13]	李欢欢, 黄添强, 丁雪梅, 罗海峰, 黄丽清. 基于多尺度时空图卷积网络的交通出行需求预测[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2065-2072.
[14]	张郅, 李欣, 叶乃夫, 胡凯茜. 基于暗知识保护的模型窃取防御技术DKP[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2080-2086.
[15]	赵雅娟, 孟繁军, 徐行健. 在线教育学习者知识追踪综述[J]. 《计算机应用》唯一官方网站, 2024, 44(6): 1683-1698.