Abstract:

Focusing on the issue that embedding the attention mechanism module into Convolutional Neural Network （CNN） to improve the application accuracy will increase the parameters and the computational cost， the lightweight Height Dimensional Squeeze and Excitation （HD-SE） module and Width Dimensional Squeeze and Excitation （WD-SE） module based on squeeze and excitation were proposed. To make full use of the potential information in the feature maps， two kinds of height and width dimensional weight information of feature maps was respectively extracted by HD-SE and WD-SE through squeeze and excitation operations， then the obtained weight information was respectively applied to corresponding tensors of the feature maps of two dimensions to improve the application accuracy of the model. Experiments were implemented on CIFAR10 and CIFAR100 datasets after embedding HD-SE and WD-SE into Visual Geometry Group 16 （VGG16）， Residual Network 56 （ResNet56）， MobileNetV1 and MobileNetV2 models respectively. Experimental results show fewer parameters and computational cost added by HD-SE and WD-SE to the network models when the models achieve the same or even better accuracy， compared with the state-of-the-art attention mechanism modules， such as Squeeze and Excitation （SE） module， Coordinate Attention （CA） block， Convolutional Block Attention Module （CBAM） and Efficient Channel Attention （ECA） module.

Key words: Convolutional Neural Network (CNN), squeeze and excitation, lightweight, multi-dimension, attention mechanism module

摘要：

针对向卷积神经网络（CNN）中嵌入注意力机制模块以提高模型应用精度导致参数和计算量增加的问题，提出基于挤压激励的轻量化高度维度挤压激励（HD-SE）模块和宽度维度挤压激励（WD-SE）模块。为了充分利用特征图中潜在的信息，HD-SE对卷积层输出的特征图在高度维度上进行挤压激励操作，获得高度维度上的权重信息；而WD-SE在宽度维度上进行挤压激励操作，以得到特征图宽度维度上的权重信息；然后，将得到的权重信息分别应用于对应维度的特征图张量，以提高模型的应用精度。将HD-SE与WD-SE分别嵌入VGG16、ResNet56、MobileNetV1和MobileNetV2模型中，在CIFAR10和CIFAR100数据集上进行的实验结果表明，与挤压激励（SE）模块、协调注意力（CA）模块、卷积块注意力模块（CBAM）和高效通道注意力（ECA）模块等先进的注意力机制模块相比，HD-SE与WD-SE在向网络模型中增加的参数和计算量更少的同时得到的精度相似或者更高。

关键词: 卷积神经网络, 挤压激励, 轻量化, 多维度, 注意力机制模块