Abstract: The number of defect region samples is far less than that of the normal region samples in aircraft engine borescope inspection image defect detection task, and the defect samples cannot cover the whole sample space, which result in poor generalization of the detection algorithms. In order to solve the problems, a new interactive data augmentation method based on style transfer technology was proposed. Firstly, background image and defect targets were selected according to the interactive interface, and the informations such as size, angle and position of the target needed to be pasted were specified according to the background image. Then, the style of background image was transferred to the target image through style transfer technology, so that the background image and the target to be detected had the same style. Finally, the boundary of the fusion region was modified by Poisson fusion algorithm to achieve the effect of natural transition of the connected region. Two-class classification and defect detection were conducted to verify the effectiveness of the proposed method. The testers achieve 44.0% classification error rate for the two-class classification on the dataset with real images and augmented images averagely. In the detection task based on Mask Region-based Convolutional Neural Network (Mask R-CNN) model, the proposed method has the Average Precision (AP) of classification and segmentation improved by 99.5% and 91.9% respectively compared to those of the traditional methods.

Key words: interactive, Poisson fusion, style transfer, data augmentation, borescope inspection image

摘要： 在航空发动机孔探图像缺陷检测任务中，缺陷区域样本数量远少于正常样本数量，且缺陷样本无法覆盖整个样本空间，导致检测算法泛化能力较差。针对上述问题，提出了一种基于风格迁移技术的交互式数据扩展方法。首先，通过交互界面选择背景图像和缺陷目标，并根据背景图像指定需要粘贴的目标的大小、角度和位置等信息；其次，通过风格迁移技术将背景图像的风格迁移到目标图像上，使得背景图像和待检测目标具有相同的风格；最后，利用泊松融合算法对融合区域的边界进行修正，以达到连接区域自然过渡的效果。通过二分类和缺陷检测验证了该方法的有效性。在包含真实图像和扩展后图像的二分类实验中，测试人员的平均分类错误率达到了44.0%；而在基于Mask R-CNN模型的检测任务中，所提方法的检测和分割平均精度（AP）较传统方法分别提高了99.5%和91.9%。

关键词: 交互式, 泊松融合, 风格迁移, 数据扩展, 孔探图像