Plant image recoginiton based on family priority strategy

doi:10.11772/j.issn.1001-9081.2018041309

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (11): 3241-3245.DOI: 10.11772/j.issn.1001-9081.2018041309

Previous Articles Next Articles

Plant image recoginiton based on family priority strategy

CAO Xiangying¹, SUN Weimin¹, ZHU Youxiang¹, QIAN Xin², LI Xiaoyu¹, YE Ning¹

1. School of Information Technology, Nanjing Forestry University, Nanjing Jiangsu 210037, China;
2. Housing and Real Estate Promotion Center of Jiangsu Provincial Department of Housing and Urban Rural Development, Nanjing Jiangsu 210009, China

Received:2018-04-29 Revised:2018-05-31 Online:2018-11-10 Published:2018-11-10
Supported by:
This work is partially supported by the National Key Research and Development Program (2016YFD0600101), the National Natural Science Foundation of China (31570662, 31500533, 61401214), the Undergraduate Research and Innovation Program Project in Jiangsu Province (201710298029Z), the Jiangsu Provincial Department of Housing and Urban-Rural Development (2016ZD44), the Priority Academic Program of Jiangsu Higher Education Institutions.

基于科优先策略的植物图像识别

曹香滢¹, 孙卫民¹, 朱悠翔¹, 钱鑫², 李晓宇¹, 业宁¹

1. 南京林业大学信息科学技术学院, 南京 210037;
2. 江苏省住房和城乡建设厅住宅与房地产业促进中心, 南京 210009

通讯作者: 业宁
作者简介:曹香滢(1997-),女,江苏南通人,主要研究方向:深度学习;孙卫民(1997-),男,江苏盐城人,主要研究方向:深度学习;朱悠翔(1994-),男,福建福州人,主要研究方向:深度学习;钱鑫(1978-),男,江苏南京人,硕士,主要研究方向:房地产信息化;李晓宇(1998-),女,湖北荆州人,主要研究方向:深度学习;业宁(1967-),男,江苏江宁人,教授,博士,CCF会员,主要研究方向:数据挖掘。
基金资助:
国家重点研发计划项目（2016YFD0600101）；国家自然科学基金资助项目（31570662，31500533，61401214）；江苏省大学生创新计划项目（201710298029Z）；江苏省住建厅科技计划项目（2016ZD44）；江苏省优势学科项目。

Abstract

Abstract: Plant recognition includes two kinds of tasks:specimen recognition and real-environment recognition. Due to the existence of background noise, real-environment plant image recognition is more difficult. To reduce the weight of Convolutional Neural Networks (CNN), to improve over-fitting, to improve the recognition rate and generalization ability, a method of plant identification with Family Priority (FP) was proposed. Combined with the lightweight CNN MobileNet model, a plant recognition model Family Priority MobileNet (FP-MobileNet) was established by means of migration learning. On the single background plant dataset flavia, the MobileNet model achieved 99.8% of accuracy. For the more challenging real-environment flower dataset flower102, when the number of samples in the training set was greater than that in the test set FP-MobileNet achieved 99.56% of accuracy. When the number of samples in the training set was smaller than that in the test set, FP-MobileNet still obtained 95.56% of accuracy. The experimental results show that the accuracies of FP-MobileNet under two different data set partitioning schemes are both higher than those of the pure MobileNet model. In addition, FP-MobileNet weighs only occupy 13.7 MB with high recognition rate. It takes into account both accuracy and delay, and is suitable for promotion to mobile devices that require a lightweight model.

Key words: Family Priority (FP) strategy, real-environment plant image, plant image recognition, deep learning, Convolutional Neural Network (CNN)

摘要： 植物识别领域的研究包括单一背景和自然环境植物图像识别，由于背景噪声的存在，自然环境植物图像识别难度更大。针对如何降低卷积神经网络（CNN）的权重大小、如何改善过拟合、如何提高模型对自然环境植物的识别率和泛化能力的问题，提出科优先（FP）的植物识别方法。与轻量卷积神经网络MobileNet模型结合，利用迁移学习的方法，建立基于MobileNet的科优先（FP-MobileNet）植物识别模型。单纯使用MobileNet模型在单一背景植物数据集flavia上获得了99.8%的识别率；对于更具挑战的自然环境花卉数据集flower102，在训练集样本数量大于测试集时FP-MobileNet获得了99.56%识别率，在训练集样本数量小于测试集时FP-MobileNet仍获得了95.56%的识别率。实验结果表明，两种数据集划分方案下FP-MobileNet的识别率均高于单纯的MobileNet模型；并且FP-MobileNet模型在获得较高识别率的同时，权重仅占13.7 MB，兼顾了精度和延迟，适合推广到需要轻量模型的移动设备。

关键词: 科优先策略, 自然环境植物图像, 植物图像识别, 深度学习, 卷积神经网络

CLC Number:

TP391.4

CAO Xiangying, SUN Weimin, ZHU Youxiang, QIAN Xin, LI Xiaoyu, YE Ning. Plant image recoginiton based on family priority strategy[J]. Journal of Computer Applications, 2018, 38(11): 3241-3245.

曹香滢, 孙卫民, 朱悠翔, 钱鑫, 李晓宇, 业宁. 基于科优先策略的植物图像识别[J]. 计算机应用, 2018, 38(11): 3241-3245.

References

[1] 王丽君,淮永建,彭月橙.基于叶片图像多特征融合的观叶植物种类识别[J].北京林业大学学报,2015,37(1):55-61.(WANG L J, HUAI Y J, PENG Y C. Method of identification of foliage from plants based on extraction of multiple features of leaf images[J]. Journal of Beijing Forestry University, 2015, 37(1):55-61.)
[2] ZHU F, YANG J, XU S, et al. Relative density degree induced boundary detection for one-class SVM[J]. Soft Computing, 2016, 20(11):1-13.
[3] YAN H, YE Q, ZHANG T, et al. Least squares twin bounded support vector machines based on L1-norm distance metric for classification[J]. Pattern Recognition, 2017, 74:434-447.
[4] YE Q, ZHAO C, YE N, et al. Multi-weight vector projection support vector machines[J]. Pattern Recognition Letters, 2014, 42(13):91-100.
[5] YE Q, ZHAO C, GAO S, et al. Weighted twin support vector machines with local information and its application[J]. Neural Networks, 2012, 35(11):31-39.
[6] 邓立苗,唐俊,马文杰.基于图像处理的玉米叶片特征提取与识别系统[J]. 中国农机化学报, 2014, 35(6):72-75, 79.(DENG L M, TANG J, MA W J. Feature extraction and recognition system of maize leaf based on image processing[J]. Journal of Chinese Agricultural Mechanization, 2014, 35(6):72-75, 79.)
[7] NARESH Y G, NAGENDRASWAMY H S. Classification of medicinal plants:an approach using modified LBP with symbolic representation[J]. Neurocomputing, 2016, 173:1789-1797.
[8] CHAKI J, PAREKH R, BHATTACHARYA S. Plant leaf recognition using texture and shape features with neural classifiers[J]. Pattern Recognition Letters, 2015, 58(C):61-68.
[9] JIN T, HOU X, LI P, et al. A novel method of automatic plant species identification using sparse representation of leaf tooth features[J]. Plos One, 2015, 10(10):e0139482.
[10] OLSEN A, HAN S, CALVERT B, et al. In Situ leaf classification using histograms of oriented gradients[C]//Proceedings of the 2015 International Conference on Digital Image Computing:Techniques and Applications. Piscataway, NJ:IEEE, 2016:1-8.
[11] GHASAB M A J, KHAMIS S, MOHAMMAD F, et al. Feature decision-making ant colony optimization system for an automated recognition of plant species[J]. Expert Systems with Applications, 2015, 42(5):2361-2370.
[12] LECUN Y, BENGIO Y, HINTON G. Deep learning[J]. Nature, 2015, 521(7553):436.
[13] LECUN Y, BENGIO Y. Convolutional Networks for Images, Speech, and Time Series[M]. Cambridge, MA:MIT Press, 1998:255-258.
[14] LIU Y, TANG F, ZHOU D, et al. Flower classification via convolutional neural network[C]//Proceedings of the 2016 IEEE International Conference on Functional-Structural Plant Growth Modeling, Simulation, Visualization and Applications. Piscataway, NJ:IEEE, 2017:110-116.
[15] GRINBLAT G L, UZAL L C, LARESE M G, et al. Deep learning for plant identification using vein morphological patterns[J]. Computers & Electronics in Agriculture, 2016, 127:418-424.
[16] BARRÉ P, STÖVER B C, KAI F M, et al. LeafNet:a computer vision system for automatic plant species identification[J]. Ecological Informatics, 2017, 40:50-56.
[17] PAWARA P, OKAFOR E, SURINTA O, et al. Comparing local descriptors and bags of visual words to deep convolutional neural networks for plant recognition[C]//Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods. Piscataway, NJ:IEEE, 2017:479-486.
[18] JEON W S, RHEE S Y. Plant leaf recognition using a convolution neural network[J]. International Journal of Fuzzy Logic & Intelligent Systems, 2017, 17(1):26-34.
[19] TANG P, WANG H, KWONG S. G-MS2F:GoogleNet based multi-stage feature fusion of deep CNN for scene recognition[J]. Neurocomputing, 2016, 225:188-197.
[20] SU J, FARAONE J, LIU J, et al. Redundancy-reduced MobileNet acceleration on reconfigurable logic for ImageNet classification[C]//Proceedings of the 14th International Symposium on Applied Reconfigurable Computing. Berlin:Springer, 2018:16-28.
[21] PAN S J, TSANG I W, KWOK J T, et al. Domain adaptation via transfer component analysis[J]. IEEE Transactions on Neural Networks, 2011, 22(2):199-210.
[22] WU S G, BAO F S, XU E Y, et al. A leaf recognition algorithm for plant classification using probabilistic neural network[C]//Proceedings of the 7th IEEE International Symposium on Signal Processing and Information Technology. Piscataway, NJ:IEEE, 2008:11-16.
[23] NILSBACK M E, ZISSERMAN A. Automated flower classification over a large number of classes[C]//Proceedings of the 6th Indian Conference on Computer Vision, Graphics & Image Processing. Piscataway, NJ:IEEE, 2009:722-729.
[24] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[J/OL]. arXiv Preprint, 2014, 2014:arXiv:1409.1556(2014-09-04)[2015-04-10]. https://arxiv.org/abs/1409.1556.
[25] WU S, ZHONG S, LIU Y. Deep residual learning for image steganalysis[J]. Multimedia Tools & Applications, 2017, 77(9):10437-10453.
[26] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, Nevada:Curran Associates Inc., 2012:1097-1105.
[27] GRIFFING L R. Who invented the dichotomous key? Richard Waller's watercolors of the herbs of Britain[J]. American Journal of Botany, 2011, 98(12):1911.
[28] SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al. Dropout:a simple way to prevent neural networks from overfitting[J]. Journal of Machine Learning Research, 2014, 15(1):1929-1958.
[29] CARUANA R. Multitask learning[J]. Machine Learning, 1997, 28(1):41-75.
[30] KADIR A. A model of plant identification system using GLCM, lacunarity and shen features[J]. Research Journal of Pharmaceutical Biological & Chemical Sciences, 2014, 5(2):1-10.

Plant image recoginiton based on family priority strategy

基于科优先策略的植物图像识别

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	XIE Defeng, JI Jianmin. Syntax-enhanced semantic parsing with syntax-aware representation [J]. Journal of Computer Applications, 2021, 41(9): 2489-2495.
[2]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[3]	CHEN Chengrui, SUN Ning, HE Shibiao, LIAO Yong. Deep learning-based joint channel estimation and equalization algorithm for C-V2X communications [J]. Journal of Computer Applications, 2021, 41(9): 2687-2693.
[4]	SONG Zhongshan, LIANG Jiarui, ZHENG Lu, LIU Zhenyu, TIE Jun. Remote sensing scene classification based on bidirectional gated scale feature fusion [J]. Journal of Computer Applications, 2021, 41(9): 2726-2735.
[5]	LI Kangkang, ZHANG Jing. Multi-layer encoding and decoding model for image captioning based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(9): 2504-2509.
[6]	ZHANG Yongbin, CHANG Wenxin, SUN Lianshan, ZHANG Hang. Detection method of domains generated by dictionary-based domain generation algorithm [J]. Journal of Computer Applications, 2021, 41(9): 2609-2614.
[7]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[8]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[9]	WANG Hebing, ZHANG Chunmei. Facial landmark detection based on ResNeXt with asymmetric convolution and squeeze excitation [J]. Journal of Computer Applications, 2021, 41(9): 2741-2747.
[10]	ZHENG Zhiqiang, HU Xin, WENG Zhi, WANG Yuhe, CHENG Xi. Cattle eye image feature extraction method based on improved DenseNet [J]. Journal of Computer Applications, 2021, 41(9): 2780-2784.
[11]	HE Zhenghai, XIAN Yantuan, WANG Meng, YU Zhengtao. Case reading comprehension method combining syntactic guidance and character attention mechanism [J]. Journal of Computer Applications, 2021, 41(8): 2427-2431.
[12]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[13]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[14]	HUANG Chengcheng, DONG Xiaoxiao, LI Zhao. Deep pipeline 5×5 convolution method based on two-dimensional Winograd algorithm [J]. Journal of Computer Applications, 2021, 41(8): 2258-2264.
[15]	ZENG Xiangyin, ZHENG Bochuan, LIU Dan. Detection of left and right railway tracks based on deep convolutional neural network and clustering [J]. Journal of Computer Applications, 2021, 41(8): 2324-2329.