Tampered image recognition based on improved three-stream Faster R-CNN

doi:10.11772/j.issn.1001-9081.2019081515

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (5): 1315-1321.DOI: 10.11772/j.issn.1001-9081.2019081515

• Artificial intelligence • Previous Articles Next Articles

Tampered image recognition based on improved three-stream Faster R-CNN

XU Dai¹, YUE Zhang¹, YANG Wenxia¹, REN Xiao²

1.School of Science, Wuhan University of Technology, WuhanHubei 430070, China
2.School of Automation, Wuhan University of Technology, WuhanHubei 430070, China

Received:2019-09-05 Revised:2019-11-30 Online:2020-05-10 Published:2020-05-15
Contact: YANG Wenxia, born in 1978, Ph. D., associate professor. Her research interests include digital image processing, pattern recognition.
About author:XU Dai, born in 1998. His research interests include digital image processing, pattern recognition.YUE Zhang, born in 1999. His research interests include digital image processing.YANG Wenxia, born in 1978, Ph. D., associate professor. Her research interests include digital image processing, pattern recognition.REN Xiao, born in 1999. His research interests include digital image processing.
Supported by:
This work is partially supported by the National Students Innovation and Entrepreneurship Training Program (20191049714009).

基于改进的三向流Faster R-CNN的篡改图像识别

徐代¹, 岳璋¹, 杨文霞¹, 任潇²

1.武汉理工大学理学院, 武汉 430070
2.武汉理工大学自动化学院，武汉 430070

通讯作者: 杨文霞（1978—）
作者简介:徐代(1998—)，男，黑龙江齐齐哈尔人，主要研究方向：数字图像处理、模式识别；岳璋(1999—)，男，河南商丘人，主要研究方向：数字图像处理；杨文霞（1978—），女，湖北天门人，副教授，博士，主要研究方向：数字图像处理、模式识别；任潇(1999—)，男，湖北武汉人，主要研究方向：数字图像处理。
基金资助:
国家级大学生创新创业训练计划项目(20191049714009)。

Abstract

Abstract:

A tampered image recognition system with better universality based on convolutional neural network of three-stream feature extraction was proposed to improve the recognition accuracy of three main tampering methods stitching, scaling and rotating, copying and pasting. Firstly, by comparing the similarity of feature sub-blocks according to image local color invariant feature, comparing the noise correlation coefficients of tampered region edges with noise correlation, and calculating the standard deviation contrast of sub-blocks based on image resampling trace, the features of the RGB stream, noise stream and signal stream of the image were extracted separately. Then, through multilinear pooling, combined with an improved piecewise AdaGrad gradient algorithm, the feature dimension reduction and parameter self-adaptive updating were realized. Finally, through network training and classification, three main image tampering methods of stitching, scaling and rotating, copying and pasting were identified and the corresponding tampered areas were located. In order to measure the performance of this model, experiments were carried out on VOC2007 and CIFAR-10 datasets. The experimental results of about 9 000 images show that the proposed model can accurately identify and locate the three tampering methods stitching, scaling and rotating, copying and pasting, and its recognition rates are 0.962,0.956 and 0.935 respectively. Compared with the two-stream feature extraction method in the latest literature, the model has the recognition rates increased by 1.050%, 2.137% and 2.860% respectively. The proposed three-stream model enriches the image feature extraction by convolutional neural network, improves the training performance and recognition accuracy of the network. Meanwhile, controlling the descent speed of parameter learning rate piecewisely by the improved gradient algorithm reduces the over-fitting and convergence oscillation, as well as increases the convergence speed, so as to realize the optimization design of the algorithm.

Key words: deep learning, tampered image recognition, Faster Region-Convolutional Neural Network (faster R-CNN), three-stream feature extraction, gradient algorithm

摘要：

为了进一步提高对拼接、缩放旋转、复制粘贴三种主要篡改手段的识别准确率，增强算法普适性，提出了一个基于三向流特征提取的卷积神经网络篡改图像识别系统。首先，分别根据图像局部彩色不变量特性比较特征子块相似度，根据噪声相关性比较篡改区域边缘的噪声相关系数，以及根据图像重采样痕迹计算子块标准偏差对比度，完成了对图像RGB流、噪声流和信号流的特征提取；然后，通过多线性池化，结合改进的分段AdaGrad梯度算法，实现了特征降维和参数自适应更新；最后，通过网络训练和分类，完成了对拼接、缩放旋转、复制粘贴这三种主要的图像篡改手段的识别与相应的篡改区域的定位。为衡量所提模型的效果，在VOC2007和CIFAR-10两个数据集上进行了实验。在约9 000张图像上的实验结果表明，该模型对拼接、缩放旋转、复制粘贴这三种篡改手段均能进行较准确的识别与定位，识别率分别为0.962、0.956和0.935。与对照文献的双向流特征提取方法相比，该模型的识别率分别提高了1.050%、2.137%、2.860%。三向流特征提取模型丰富了卷积神经网络对图像的特征信息采集，提高了网络的学习性能与识别精度，同时改进的梯度算法通过分段控制参数学习率的下降速度，降低了过拟合，减少了收敛震荡，提高了收降速度，实现了算法的优化设计。

关键词: 深度学习, 篡改图像识别, Faster R-CNN, 三向流特征提取, 梯度算法

CLC Number:

TP391.411

XU Dai, YUE Zhang, YANG Wenxia, REN Xiao. Tampered image recognition based on improved three-stream Faster R-CNN[J]. Journal of Computer Applications, 2020, 40(5): 1315-1321.

徐代, 岳璋, 杨文霞, 任潇. 基于改进的三向流Faster R-CNN的篡改图像识别[J]. 计算机应用, 2020, 40(5): 1315-1321.

References

1 WANG W , DONG J , TAN T . A survey of passive image tampering detection[C]// Proceedings of the 2009 International Workshop on Digital Watermarking, LNCS 5703. Berlin: Springer, 2009:308-322.
2 ZHANG H , SHU H , HAN G N , et al . Blurred image recognition by Legendre moment invariants[J]. IEEE Transactions on Image Processing, 2010, 19(3):596-611.
3 刘一,刘本永 .基于再采样的图像重采样伪作检测[J]. 计算机应用, 2014, 34(3):815-819. (LIU Y, LIU B Y. Image resampling artifact detection based on resampling[J]. Journal of Computer Applications, 2014, 34(3):815- 819.)
4 王春华,韩栋 . 基于区域直方图和特征相关匹配规则的图像复制-粘贴篡改检测算法[J]. 电子测量与仪器学报, 2018, 32(4):103-109. (WANG C H, HAN D. Algorithm for image copy-paste forgery detection based on region histogram and feature correlation matching rule[J]. Journal of Electronic Measurement and Instrumentation, 2018, 32(4): 103-109.)
5 及莹,陆月明 . 一种基于SIFT算法的图像镜像变换识别方法[J]. 计算机应用研究, 2013, 30(3):924-925, 941. (JI Y, LU Y M. Method based on SIFT for recognition of flip images[J]. Application Research of Computers, 2013, 30(3):924-925, 941.)
6 郑继明,崔玉岩,耿金玲,等 . 运用DWT和ORB的图像篡改检测方法[J]. 计算机工程与应用, 2017, 53(11): 187-191. ZHENG J M , CUI Y Y , GENG J L , et al . Image tampering detection method using DWT and ORB[J]. Computer Engineering and Applications, 2017, 53(11): 187-191.
7 BAYAR B , STAMM M C . A deep learning approach to universal image manipulation detection using a new convolutional layer[C]// Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security. New York: ACM, 2016:5-10.
8 常亮,邓小明,周明全,等 . 图像理解中的卷积神经网络[J]. 自动化学报, 2016, 42(9):1300-1312. CHANG L , DENG X M , ZHOU M Q , et al . Convolution neural networks in image understanding[J]. Acta Automatica Sinica, 2016, 42(9): 1300-1312.
9 刘万军,梁雪剑,曲海成 . 基于双重优化的卷积神经网络图像识别算法[J]. 模式识别与人工智能, 2016, 29(9):856-864. (LIU W J, LIANG X J, QU H C. Convolutional neural network algorithm based on double optimization for image recognition[J]. Pattern Recognition and Artificial Intelligence, 2016, 29(9):856-864.)
10 张文达,许悦雷,倪嘉成,等 . 基于多尺度分块卷积神经网络的图像目标识别算法[J]. 计算机应用, 2016, 36(4):1033-1038 ZHANG W D , XU Y L , NI J C , et al . Image target recognition based on multi-scale block convolution neural network[J]. Journal of Computer Applications, 2016, 36(4):1033-1038.
11 曲长文,刘晨,周强,等 . 基于分块 CNN 的多尺度SAR图像目标分类算法[J]. 雷达科学与技术, 2018, 16(2):169-173,180. QU C W , LIU C , ZHOU Q , et al . Multi-scale SAR image target classification algorithm based on block convolutional neural network[J]. Radar Science and Technology, 2018, 16(2):169-173,180.
12 REN S , HE K , GIRSHICK R , et al . Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6):1137-1149.
13 ZHOU P , HAN X , MORARIU V I , et al . Learning rich features for image manipulation detection[C]// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018:1053-1061.
14 亚春,武金岗,王净,等 . 小波变换图像融合规则性能的分析研究[J].计算机工程与应用, 2010, 46(8):180-182, 189. YA C, WU J G , WANG J , et al . Analysis on image fusion rules based on wavelet transform[J]. Computer Engineering and Applications, 2010, 46(8):180-182, 189.
15 刘淑春 . 基于RGB颜色特征和小波变换的图像复制-粘贴篡改检测[D]. 昆明:云南大学, 2011. (LIU S C. The copy-move forgery detection based on RGB color feature and wavelet transform[D]. Kunming: Yunnan University, 2011.)
16 洪拥筠,刘本永 . 基于图像背景噪声相关性的篡改检测[J]. 贵州大学学报(自然科学版), 2015, 32(3):93-96, 118. (HONG Y J, LIU B Y. Image forgery detection using correlation of background noise[J]. Journal of Guizhou University (Natural Science), 2015, 32(3): 93-96, 118.)
17 姚恒,魏为民,唐振军 . 重采样图像的盲检测技术[J]. 计算机工程与应用, 2010, 46(30):166-168, 187. (YAO H, WEI W M, TANG Z J. Survey of digital forensics technology for image resampling detection[J]. Computer Engineering and Applications, 2010, 46(30): 166-168, 187.)
18 左菊仙,邓坚 . 基于重采样痕迹的图像伪造检测[J]. 计算机应用与软件, 2016, 33(10):328-333. (ZUO J X, DENG J. Image forgery detection based on resampling traces[J]. Computer Applications and Software, 2016, 33(10): 328-333.)
19 骆伟祺,黄继武,丘国平 . 鲁棒的区域复制图像篡改检测技术[J]. 计算机学报, 2007, 30(11):1998-2007. (LUO W Q, HUANG J W, QIU G P. Robust detection of region-duplication forgery in digital image[J]. Chinese Journal of Computers, 2007, 30(11): 1998-2007.)
20 刘帆,刘鹏远,张峻宁,等 . 一种改进的深度学习模型自适应学习率策略[J]. 兵工自动化, 2019, 38(1):72-77. LIU F , LIU P Y , ZHANG J N , et al . An improved depth learning model adaptive learning rate strategy[J]. Ordnance Industry Automation, 2019, 38(1):72-77.

[1]	ZHENG Zhiqiang, HU Xin, WENG Zhi, WANG Yuhe, CHENG Xi. Cattle eye image feature extraction method based on improved DenseNet [J]. Journal of Computer Applications, 2021, 41(9): 2780-2784.
[2]	CHEN Chengrui, SUN Ning, HE Shibiao, LIAO Yong. Deep learning-based joint channel estimation and equalization algorithm for C-V2X communications [J]. Journal of Computer Applications, 2021, 41(9): 2687-2693.
[3]	XIE Defeng, JI Jianmin. Syntax-enhanced semantic parsing with syntax-aware representation [J]. Journal of Computer Applications, 2021, 41(9): 2489-2495.
[4]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[5]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[6]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[7]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[8]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[9]	HE Zhenghai, XIAN Yantuan, WANG Meng, YU Zhengtao. Case reading comprehension method combining syntactic guidance and character attention mechanism [J]. Journal of Computer Applications, 2021, 41(8): 2427-2431.
[10]	LI Yafang, LIANG Ye, FENG Weiwei, ZU Baokai, KANG Yujian. Deep network embedding method based on community optimization [J]. Journal of Computer Applications, 2021, 41(7): 1956-1963.
[11]	WU Zeju, JIAO Cuijuan, CHEN Liang. Tire defect detection method based on improved Faster R-CNN [J]. Journal of Computer Applications, 2021, 41(7): 1939-1946.
[12]	WANG Yue, JIANG Yiming, LAN Julong. Intrusion detection based on improved triplet network and K-nearest neighbor algorithm [J]. Journal of Computer Applications, 2021, 41(7): 1996-2002.
[13]	DU Yan, LYU Liangfu, JIAO Yichen. Fuzzy prototype network based on fuzzy reasoning [J]. Journal of Computer Applications, 2021, 41(7): 1885-1890.
[14]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.
[15]	HOU Xiaohan, JIN Guodong, TAN Lining, XUE Yuanliang. Synthetic aperture radar ship detection method based on self-adaptive and optimal features [J]. Journal of Computer Applications, 2021, 41(7): 2150-2155.

Tampered image recognition based on improved three-stream Faster R-CNN

基于改进的三向流Faster R-CNN的篡改图像识别

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics