《计算机应用》唯一官方网站

• •    下一篇

基于层间引导的低光照图像渐进增强算法

黄梦源1,常侃1,凌铭阳1,韦新杰1,覃团发2   

  1. 1. 广西大学计算机与电子信息学院
    2. 广西大学
  • 收稿日期:2023-06-08 修回日期:2023-08-08 发布日期:2023-08-30 出版日期:2023-08-30
  • 通讯作者: 黄梦源
  • 基金资助:
    国家自然科学基金资助项目

A progressive enhancement algorithm for low-light images based on layer guidance

  • Received:2023-06-08 Revised:2023-08-08 Online:2023-08-30 Published:2023-08-30
  • Supported by:
    the National Natural Science Foundation of China

摘要: 摘 要: 低光照图像的图像质量往往较低,而低光照图像增强(LLIE)旨在提高这类图像的视觉质量。针对现有的低光照图像增强算法大多专注于增强亮度和对比度、忽略细节增强的问题,提出一个基于层间引导的低光照图像渐进增强算法,兼顾图像亮度和细节增强。首先,使用拉普拉斯金字塔(LP)降低任务复杂度,提高算法效率;然后,利用各频率分量间的相关性,在低频和高频分量之间构建基于Transformer的层间引导融合模块,在各高频分量之间构建轻量级的层间引导融合模块,有效精炼金字塔较低层增强信息指导较高层处理图像,实现基于层间引导的渐进增强;最后,通过拉普拉斯金字塔重建出亮度均匀、细节清晰的增强图像。实验结果表明,所提算法在LOL(LOw-Light)-v1数据集上比DSLR(Deep Stacked Laplacian Restorer)高了2.3dB,在LOL-v2数据集上比UNIE(Unsupervised Night Image Enhancement)高了0.55dB。与其他基于深度学习的低光照图像增强算法相比,该算法运行速度快,增强结果在客观和主观质量上均获得明显提升,更适用于实际场景。

关键词: 关键词: 低光照图像增强, 拉普拉斯金字塔, 图像处理, 卷积神经网络, Transformer

Abstract: Abstract: The quality of low-light images is poor and low-light image enhancement (LLIE) aims to improve the visual quality. Most of LLIE algorithms focus on enhancing luminance and contrast, while neglecting details. To solve this issue, a progressive enhancement algorithm for low-light images based on layer guidance was proposed, which enhanced images to a suitable illumination level and reconstructed clear details. First, to reduce the complexity and improve the efficiency, the low-light image was decomposed into several frequency components by Laplace pyramid (LP) decomposition. Secondly, since different frequency components exhibit pixel-level correlation, a Transformer-based fusion model and a lightweight fusion model were respectively proposed for layer guidance. The Transformer-based model was applied between the low-frequency and the lowest high-frequency components. The lightweight fusion model was applied between two neighbouring high-frequency components. By doing so, the layer guidance features were continuously fed to a higher layer and components were enhanced in a coarse-to-fine manner. Finally, the LP was used to reconstruct the enhanced image with normal illumination and clear details. The experimental results show, the proposed algorithm is 2.3 dB higher than DSLR(Deep Stacked Laplacian Restorer) on LOL(LOw-Light)-v1 dataset and 0.55 dB higher than UNIE(Unsupervised Night Image Enhancement) on LOL-v2 dataset. Compared with other state-of-the-art LLIE algorithms, this algorithm has shorter runtime and achieves significant improvement in objective and subjective quality, which is more suitable for real-world.

Key words: Keywords: low-light image enhancement, Laplace pyramid, image processing, Convolutional Neural Network, Transformer