基于改进的三向流Faster R-CNN的篡改图像识别

doi:10.11772/j.issn.1001-9081.2019081515

计算机应用 ›› 2020, Vol. 40 ›› Issue (5): 1315-1321.DOI: 10.11772/j.issn.1001-9081.2019081515

基于改进的三向流Faster R-CNN的篡改图像识别

徐代¹, 岳璋¹, 杨文霞¹, 任潇²

1.武汉理工大学理学院, 武汉 430070
2.武汉理工大学自动化学院，武汉 430070

收稿日期:2019-09-05 修回日期:2019-11-30 发布日期:2020-05-15 出版日期:2020-05-10
通讯作者: 杨文霞（1978—）
作者简介:徐代(1998—)，男，黑龙江齐齐哈尔人，主要研究方向：数字图像处理、模式识别；岳璋(1999—)，男，河南商丘人，主要研究方向：数字图像处理；杨文霞（1978—），女，湖北天门人，副教授，博士，主要研究方向：数字图像处理、模式识别；任潇(1999—)，男，湖北武汉人，主要研究方向：数字图像处理。
基金资助:
国家级大学生创新创业训练计划项目(20191049714009)。

Tampered image recognition based on improved three-stream Faster R-CNN

XU Dai¹, YUE Zhang¹, YANG Wenxia¹, REN Xiao²

1.School of Science, Wuhan University of Technology, WuhanHubei 430070, China
2.School of Automation, Wuhan University of Technology, WuhanHubei 430070, China

Received:2019-09-05 Revised:2019-11-30 Online:2020-05-15 Published:2020-05-10
Contact: YANG Wenxia, born in 1978, Ph. D., associate professor. Her research interests include digital image processing, pattern recognition.
About author:XU Dai, born in 1998. His research interests include digital image processing, pattern recognition.YUE Zhang, born in 1999. His research interests include digital image processing.YANG Wenxia, born in 1978, Ph. D., associate professor. Her research interests include digital image processing, pattern recognition.REN Xiao, born in 1999. His research interests include digital image processing.
Supported by:
This work is partially supported by the National Students Innovation and Entrepreneurship Training Program (20191049714009).

摘要/Abstract

摘要：

为了进一步提高对拼接、缩放旋转、复制粘贴三种主要篡改手段的识别准确率，增强算法普适性，提出了一个基于三向流特征提取的卷积神经网络篡改图像识别系统。首先，分别根据图像局部彩色不变量特性比较特征子块相似度，根据噪声相关性比较篡改区域边缘的噪声相关系数，以及根据图像重采样痕迹计算子块标准偏差对比度，完成了对图像RGB流、噪声流和信号流的特征提取；然后，通过多线性池化，结合改进的分段AdaGrad梯度算法，实现了特征降维和参数自适应更新；最后，通过网络训练和分类，完成了对拼接、缩放旋转、复制粘贴这三种主要的图像篡改手段的识别与相应的篡改区域的定位。为衡量所提模型的效果，在VOC2007和CIFAR-10两个数据集上进行了实验。在约9 000张图像上的实验结果表明，该模型对拼接、缩放旋转、复制粘贴这三种篡改手段均能进行较准确的识别与定位，识别率分别为0.962、0.956和0.935。与对照文献的双向流特征提取方法相比，该模型的识别率分别提高了1.050%、2.137%、2.860%。三向流特征提取模型丰富了卷积神经网络对图像的特征信息采集，提高了网络的学习性能与识别精度，同时改进的梯度算法通过分段控制参数学习率的下降速度，降低了过拟合，减少了收敛震荡，提高了收降速度，实现了算法的优化设计。

关键词: 深度学习, 篡改图像识别, Faster R-CNN, 三向流特征提取, 梯度算法

Abstract:

A tampered image recognition system with better universality based on convolutional neural network of three-stream feature extraction was proposed to improve the recognition accuracy of three main tampering methods stitching, scaling and rotating, copying and pasting. Firstly, by comparing the similarity of feature sub-blocks according to image local color invariant feature, comparing the noise correlation coefficients of tampered region edges with noise correlation, and calculating the standard deviation contrast of sub-blocks based on image resampling trace, the features of the RGB stream, noise stream and signal stream of the image were extracted separately. Then, through multilinear pooling, combined with an improved piecewise AdaGrad gradient algorithm, the feature dimension reduction and parameter self-adaptive updating were realized. Finally, through network training and classification, three main image tampering methods of stitching, scaling and rotating, copying and pasting were identified and the corresponding tampered areas were located. In order to measure the performance of this model, experiments were carried out on VOC2007 and CIFAR-10 datasets. The experimental results of about 9 000 images show that the proposed model can accurately identify and locate the three tampering methods stitching, scaling and rotating, copying and pasting, and its recognition rates are 0.962,0.956 and 0.935 respectively. Compared with the two-stream feature extraction method in the latest literature, the model has the recognition rates increased by 1.050%, 2.137% and 2.860% respectively. The proposed three-stream model enriches the image feature extraction by convolutional neural network, improves the training performance and recognition accuracy of the network. Meanwhile, controlling the descent speed of parameter learning rate piecewisely by the improved gradient algorithm reduces the over-fitting and convergence oscillation, as well as increases the convergence speed, so as to realize the optimization design of the algorithm.

Key words: deep learning, tampered image recognition, Faster Region-Convolutional Neural Network (faster R-CNN), three-stream feature extraction, gradient algorithm

中图分类号:

TP391.411

徐代, 岳璋, 杨文霞, 任潇. 基于改进的三向流Faster R-CNN的篡改图像识别[J]. 计算机应用, 2020, 40(5): 1315-1321.

XU Dai, YUE Zhang, YANG Wenxia, REN Xiao. Tampered image recognition based on improved three-stream Faster R-CNN[J]. Journal of Computer Applications, 2020, 40(5): 1315-1321.

参考文献

1 WANG W , DONG J , TAN T . A survey of passive image tampering detection[C]// Proceedings of the 2009 International Workshop on Digital Watermarking, LNCS 5703. Berlin: Springer, 2009:308-322.
2 ZHANG H , SHU H , HAN G N , et al . Blurred image recognition by Legendre moment invariants[J]. IEEE Transactions on Image Processing, 2010, 19(3):596-611.
3 刘一,刘本永 .基于再采样的图像重采样伪作检测[J]. 计算机应用, 2014, 34(3):815-819. (LIU Y, LIU B Y. Image resampling artifact detection based on resampling[J]. Journal of Computer Applications, 2014, 34(3):815- 819.)
4 王春华,韩栋 . 基于区域直方图和特征相关匹配规则的图像复制-粘贴篡改检测算法[J]. 电子测量与仪器学报, 2018, 32(4):103-109. (WANG C H, HAN D. Algorithm for image copy-paste forgery detection based on region histogram and feature correlation matching rule[J]. Journal of Electronic Measurement and Instrumentation, 2018, 32(4): 103-109.)
5 及莹,陆月明 . 一种基于SIFT算法的图像镜像变换识别方法[J]. 计算机应用研究, 2013, 30(3):924-925, 941. (JI Y, LU Y M. Method based on SIFT for recognition of flip images[J]. Application Research of Computers, 2013, 30(3):924-925, 941.)
6 郑继明,崔玉岩,耿金玲,等 . 运用DWT和ORB的图像篡改检测方法[J]. 计算机工程与应用, 2017, 53(11): 187-191. ZHENG J M , CUI Y Y , GENG J L , et al . Image tampering detection method using DWT and ORB[J]. Computer Engineering and Applications, 2017, 53(11): 187-191.
7 BAYAR B , STAMM M C . A deep learning approach to universal image manipulation detection using a new convolutional layer[C]// Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security. New York: ACM, 2016:5-10.
8 常亮,邓小明,周明全,等 . 图像理解中的卷积神经网络[J]. 自动化学报, 2016, 42(9):1300-1312. CHANG L , DENG X M , ZHOU M Q , et al . Convolution neural networks in image understanding[J]. Acta Automatica Sinica, 2016, 42(9): 1300-1312.
9 刘万军,梁雪剑,曲海成 . 基于双重优化的卷积神经网络图像识别算法[J]. 模式识别与人工智能, 2016, 29(9):856-864. (LIU W J, LIANG X J, QU H C. Convolutional neural network algorithm based on double optimization for image recognition[J]. Pattern Recognition and Artificial Intelligence, 2016, 29(9):856-864.)
10 张文达,许悦雷,倪嘉成,等 . 基于多尺度分块卷积神经网络的图像目标识别算法[J]. 计算机应用, 2016, 36(4):1033-1038 ZHANG W D , XU Y L , NI J C , et al . Image target recognition based on multi-scale block convolution neural network[J]. Journal of Computer Applications, 2016, 36(4):1033-1038.
11 曲长文,刘晨,周强,等 . 基于分块 CNN 的多尺度SAR图像目标分类算法[J]. 雷达科学与技术, 2018, 16(2):169-173,180. QU C W , LIU C , ZHOU Q , et al . Multi-scale SAR image target classification algorithm based on block convolutional neural network[J]. Radar Science and Technology, 2018, 16(2):169-173,180.
12 REN S , HE K , GIRSHICK R , et al . Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6):1137-1149.
13 ZHOU P , HAN X , MORARIU V I , et al . Learning rich features for image manipulation detection[C]// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018:1053-1061.
14 亚春,武金岗,王净,等 . 小波变换图像融合规则性能的分析研究[J].计算机工程与应用, 2010, 46(8):180-182, 189. YA C, WU J G , WANG J , et al . Analysis on image fusion rules based on wavelet transform[J]. Computer Engineering and Applications, 2010, 46(8):180-182, 189.
15 刘淑春 . 基于RGB颜色特征和小波变换的图像复制-粘贴篡改检测[D]. 昆明:云南大学, 2011. (LIU S C. The copy-move forgery detection based on RGB color feature and wavelet transform[D]. Kunming: Yunnan University, 2011.)
16 洪拥筠,刘本永 . 基于图像背景噪声相关性的篡改检测[J]. 贵州大学学报(自然科学版), 2015, 32(3):93-96, 118. (HONG Y J, LIU B Y. Image forgery detection using correlation of background noise[J]. Journal of Guizhou University (Natural Science), 2015, 32(3): 93-96, 118.)
17 姚恒,魏为民,唐振军 . 重采样图像的盲检测技术[J]. 计算机工程与应用, 2010, 46(30):166-168, 187. (YAO H, WEI W M, TANG Z J. Survey of digital forensics technology for image resampling detection[J]. Computer Engineering and Applications, 2010, 46(30): 166-168, 187.)
18 左菊仙,邓坚 . 基于重采样痕迹的图像伪造检测[J]. 计算机应用与软件, 2016, 33(10):328-333. (ZUO J X, DENG J. Image forgery detection based on resampling traces[J]. Computer Applications and Software, 2016, 33(10): 328-333.)
19 骆伟祺,黄继武,丘国平 . 鲁棒的区域复制图像篡改检测技术[J]. 计算机学报, 2007, 30(11):1998-2007. (LUO W Q, HUANG J W, QIU G P. Robust detection of region-duplication forgery in digital image[J]. Chinese Journal of Computers, 2007, 30(11): 1998-2007.)
20 刘帆,刘鹏远,张峻宁,等 . 一种改进的深度学习模型自适应学习率策略[J]. 兵工自动化, 2019, 38(1):72-77. LIU F , LIU P Y , ZHANG J N , et al . An improved depth learning model adaptive learning rate strategy[J]. Ordnance Industry Automation, 2019, 38(1):72-77.

[1]	李顺勇, 李师毅, 胥瑞, 赵兴旺. 基于自注意力融合的不完整多视图聚类算法[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2696-2703.
[2]	黄云川, 江永全, 黄骏涛, 杨燕. 基于元图同构网络的分子毒性预测[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2964-2969.
[3]	潘烨新, 杨哲. 基于多级特征双向融合的小目标检测优化模型[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2871-2877.
[4]	秦璟, 秦志光, 李发礼, 彭悦恒. 基于概率稀疏自注意力神经网络的重性抑郁疾患诊断[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2970-2974.
[5]	王熙源, 张战成, 徐少康, 张宝成, 罗晓清, 胡伏原. 面向手术导航3D/2D配准的无监督跨域迁移网络[J]. 《计算机应用》唯一官方网站, 2024, 44(9): 2911-2918.
[6]	刘禹含, 吉根林, 张红苹. 基于骨架图与混合注意力的视频行人异常检测方法[J]. 《计算机应用》唯一官方网站, 2024, 44(8): 2551-2557.
[7]	顾焰杰, 张英俊, 刘晓倩, 周围, 孙威. 基于时空多图融合的交通流量预测[J]. 《计算机应用》唯一官方网站, 2024, 44(8): 2618-2625.
[8]	石乾宏, 杨燕, 江永全, 欧阳小草, 范武波, 陈强, 姜涛, 李媛. 面向空气质量预测的多粒度突变拟合网络[J]. 《计算机应用》唯一官方网站, 2024, 44(8): 2643-2650.
[9]	吴筝, 程志友, 汪真天, 汪传建, 王胜, 许辉. 基于深度学习的患者麻醉复苏过程中的头部运动幅度分类方法[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2258-2263.
[10]	李欢欢, 黄添强, 丁雪梅, 罗海峰, 黄丽清. 基于多尺度时空图卷积网络的交通出行需求预测[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2065-2072.
[11]	张郅, 李欣, 叶乃夫, 胡凯茜. 基于暗知识保护的模型窃取防御技术DKP[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2080-2086.
[12]	赵亦群, 张志禹, 董雪. 基于密集残差物理信息神经网络的各向异性旅行时计算方法[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2310-2318.
[13]	徐松, 张文博, 王一帆. 基于时空信息的轻量视频显著性目标检测网络[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2192-2199.
[14]	孙逊, 冯睿锋, 陈彦如. 基于深度与实例分割融合的单目3D目标检测方法[J]. 《计算机应用》唯一官方网站, 2024, 44(7): 2208-2215.
[15]	刘源泂, 何茂征, 黄益斌, 钱程. 基于ResNet50和改进注意力机制的船舶识别模型[J]. 《计算机应用》唯一官方网站, 2024, 44(6): 1935-1941.

基于改进的三向流Faster R-CNN的篡改图像识别

Tampered image recognition based on improved three-stream Faster R-CNN

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics