基于机器视觉和轻量级卷积网络的安瓿瓶包装质量检测算法

doi:10.11772/j.issn.1001-9081.2020020143

计算机应用 ›› 2020, Vol. 40 ›› Issue (10): 2899-2903.DOI: 10.11772/j.issn.1001-9081.2020020143

基于机器视觉和轻量级卷积网络的安瓿瓶包装质量检测算法

郜明, 任德均, 胡云起, 付磊, 邱吕

四川大学机械工程学院, 成都 610065

收稿日期:2020-02-15 修回日期:2020-03-31 出版日期:2020-10-10 发布日期:2020-04-13
通讯作者: 任德均
作者简介:郜明(1996-),男,安徽阜阳人,硕士研究生,主要研究方向:机器视觉、机器学习;任德均(1972-),男,四川南充人,副教授,博士,主要研究方向:机器智能、机器视觉;胡云起(1995-),男,江西赣州人,硕士研究生,主要研究方向:智能控制、机器视觉;付磊(1995-),男,江西丰城人,硕士研究生,主要研究方向:深度学习、图像处理;邱吕(1996-),女,四川广安人,硕士研究生,主要研究方向:图像处理、机器学习。

Ampoule packaging quality inspection algorithm based on machine vision and lightweight neural network

GAO Ming, REN Dejun, HU Yunqi, FU Lei, QIU Lyu

School of Mechanical Engineering, Sichuan University, Chengdu Sichuan 610065, China

Received:2020-02-15 Revised:2020-03-31 Online:2020-10-10 Published:2020-04-13

摘要/Abstract

摘要： 针对人工检测安瓿瓶包装质量时存在的速度慢以及受主观因素影响导致的准确率低等问题，提出一种机器视觉和轻量级卷积神经网络结合的安瓿瓶包装质量检测方法。首先，采用机器视觉中基于阈值分割以及仿射变换的方法对待测图片进行阈值处理、倾斜校正和安瓿瓶区域的裁剪；然后，根据图像特点以及缺陷识别要求设计分类算法的网络结构；最后，采集生产现场图片构建安瓿瓶包装缺陷数据集，之后对提出的安瓿瓶包装缺陷识别网络进行了验证，并测试了部署在Jetson Nano嵌入式平台上的算法的准确率及检测速度。实验结果表明：以每盒五支装的产品为例，所提安瓿瓶包装质量检测算法平均每盒耗时70.1 ms，即可达14盒/秒，而准确率为99.94%，能够实现在Jetson Nano嵌入式平台上的在线高精度安瓿瓶包装质量检测。

关键词: 机器视觉, 安瓿瓶包装, 卷积神经网络, 质量检测, Jetson Nano嵌入式平台

Abstract: Focusing on the problems such as low inspection speed and low accuracy caused by subjective factors in the manual inspection method of ampoule packaging quality, an inspection algorithm based on machine vision and lightweight neural network was proposed. First, threshold processing, tilt correction and cutting of ampoule regions were performed on the images to be inspected by using the threshold segmentation and affine transformation methods in machine learning. Second, the network structure of the classification algorithm was designed according to the characteristics of images and the requirements of defect recognition. Finally, the ampoule packaging defect dataset was constructed by collecting the images of the production site. After that, the proposed ampoule packaging defect identification network was verified, and the accuracy and inspection speed of the algorithm deployed on the Jetson Nano embedded platform were tested. Experimental results show that, taking the product of five ampoules each box as the example, the proposed ampoule packaging quality inspection algorithm takes 70.1 ms/box averagely, that is up to 14 boxes/s, and has the accuracy of 99.94%. It can achieve online high-precision ampoule packaging quality inspection on the Jetson Nano embedded platform.

Key words: machine vision, ampoule packaging, Convolutional Neural Network (CNN), quality inspection, Jetson Nano embedded platform

中图分类号:

郜明, 任德均, 胡云起, 付磊, 邱吕. 基于机器视觉和轻量级卷积网络的安瓿瓶包装质量检测算法[J]. 计算机应用, 2020, 40(10): 2899-2903.

GAO Ming, REN Dejun, HU Yunqi, FU Lei, QIU Lyu. Ampoule packaging quality inspection algorithm based on machine vision and lightweight neural network[J]. Journal of Computer Applications, 2020, 40(10): 2899-2903.

参考文献

[1] Banner Engineering. 安瓿瓶装盒检测[EB/OL].[2020-02-29]. https://www.bannerengineering.com.cn/cn/zh/solutions/partquality-inspection/Ampoule-Bottles-Inspection.html. (Banner engineering. Ampoule bottles inspection[EB/OL].[2020-02-29]. https://www.bannerengineering.com.cn/cn/zh/solutions/partquality-inspection/Ampoule-Bottles-Inspection.html.)
[2] 方文星, 王野. 一种铝塑泡罩药品包装缺陷检测方法[J]. 包装工程,2019,40(1):133-139.(FANG W X,WANG Y. Defect detection method for drug packaging with aluminum plastic bubble cap[J]. Packaging Engineering,2019,40(1):133-139.)
[3] QASIM R H,AL-ANI M S. Efficient approach of detection and visualization of the damaged tablets[J]. Journal of Theoretical and Applied Information Technology,2018,96(3):643-656.
[4] RAWAT W,WANG Z. Deep convolutional neural networks for image classification:a comprehensive review[J]. Neural Computation,2017,29(9):2352-2449.
[5] 姚明海, 陈志浩. 基于深度主动学习的磁片表面缺陷检测[J]. 计算机测量与控制,2018,26(9):29-33.(YAO M H,CHEN Z H. Deep active learning in detection of surface defects on magnetic sheet[J]. Computer Measurement and Control,2018,26(9):29-33.)
[6] 张琪, 王国栋, 赵希梅, 等. 基于轻量级卷积神经网络的肝部病理组织切片分类[J]. 青岛大学学报(自然科学版),2018,31(4):76-82.(ZHANG Q,WANG G D,ZHAO X M,et al. Classification of liver pathological tissue sections based on the lightweight convolutional neural network[J]. Journal of Qingdao University (Natural Science Edition),2018,31(4):76-82.)
[7] HOWARD A G,ZHU M,CHEN B,et al. MobileNets:efficient convolutional neural networks for mobile vision applications[EB/OL].[2020-02-29]. https://arxiv.org/pdf/1704.04861.pdf.
[8] SANDLER M, HOWARD A, ZHU M, et al. MobileNetv2:inverted residuals and linear bottlenecks[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2018:4510-4520.
[9] HE K,ZHANG X,REN S,et al. Deep residual learning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2016:770-778.
[10] 刘平, 陈斌, 阮波. 基于边缘信息的图像阈值化分割方法[J]. 计算机应用,2004,24(9):28-30,36.(LIU P,CHEN B,RUAN B. Image thresholding segmentation based on edge information[J]. Journal of Computer Applications, 2004, 24(9):28-30,36.)
[11] GONZALEZ R C,WOODS R E. 数字图像处理[M]. 3版. 阮秋琦,阮宇智,译. 北京:电子工业出版社,2011:424-486. (GONZALEZ R C,WOODS R E. Digital Image Processing[M]. 3rd ed. RUAN Q Q,RUAN Y Z,translated. Beijing:Publishing House of Electronics Industry,2011:424-486.)
[12] 纪姚林, 黄慧明. 基于边缘信息的二维Otsu阈值分割算法的改进[J]. 信息技术,2017(11):43-45,48. (JI Y L,HUANG H M. Improvement of 2-D Otsu threshold segmentation algorithm based on edge information[J]. Information Technology,2017(11):43-45,48.)
[13] PyTorch. AdaptiveAvgPool2d[EB/OL].[2020-02-29]. https://pytorch.org/docs/master/generated/torch.nn. AdaptiveAvgPool2d.html#torch. nn. AdaptiveAvgPool2d.
[14] IOFFE S,SZYEGEDY C. Batch normalization:accelerating deep network training by reducing internal covariate shift[C]//Proceedings of the 32nd International Conference on Machine Learning. New York:JMLR. org,2015:448-456.
[15] KRIZHEVSKY A, HINTON G. Convolutional deep belief networks on CIFAR-10[EB/OL].[2020-02-29]. https://www.cs.toronto.edu/~kriz/conv-cifar10-aug2010.pdf.
[16] SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al. Dropout:a simple way to prevent neural networks from overfitting[J]. Journal of Machine Learning Research,2014,15(1):1929-1958.
[17] BOTTOU L. Large-scale machine learning with stochastic gradient descent[C]//Proceedings of the 19th International Conference on Computational Statistics. Heidelberg:Physica-Verlag, 2010:177-186.
[18] LOSHCHILOV I, HUTTER F. Decoupled weight decay regularization[EB/OL].[2020-02-29]. https://arxiv.org/pdf/1711.05101.pdf.
[19] MA N,ZHANG X,ZHENG H,et al. ShuffleNet V2:practical guidelines for efficient CNN architecture design[C]//Proceedings of the 2018 European Conference on Computer Vision,LNCS 11218. Cham:Springer,2018:122-138.
[20] IANDOLA F N,HAN S,MOSKEWICZ M W,et al. SqueezeNet:AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size[EB/OL].[2020-02-29]. https://arxiv.org/pdf/1602.07360.pdf.
[21] HUANG D,SHAN C,ARDABILIAN M,et al. Local binary patterns and its application to facial image analysis:a survey[J]. IEEE Transactions on Systems,Man,and Cybernetics,Part C (Applications and Reviews),2011,41(6):765-781.
[22] HUANG G B,WANG D H,LAN Y. Extreme learning machines:a survey[J]. International Journal of Machine Learning and Cybernetics,2011,2(2):107-122.

基于机器视觉和轻量级卷积网络的安瓿瓶包装质量检测算法

Ampoule packaging quality inspection algorithm based on machine vision and lightweight neural network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[2]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[3]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[4]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[5]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[6]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[7]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[8]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[9]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[10]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[11]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[12]	谭道强, 曾诚, 乔金霞, 张俊. 基于混合注意力模型的阴影检测方法[J]. 计算机应用, 2021, 41(7): 2076-2081.
[13]	吴则举, 焦翠娟, 陈亮. 基于改进Faster R-CNN的轮胎缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1939-1946.
[14]	杨粟, 欧阳智, 杜逆索. 基于相关度距离的无监督并行哈希图像检索[J]. 计算机应用, 2021, 41(7): 1902-1907.
[15]	武光利, 李雷霆, 郭振洲, 王成祥. 基于改进的双向长短期记忆网络的视频摘要生成模型[J]. 计算机应用, 2021, 41(7): 1908-1914.