Journal of Computer Applications ›› 2025, Vol. 45 ›› Issue (9): 2966-2974.DOI: 10.11772/j.issn.1001-9081.2024081187

• Multimedia computing and computer simulation • Previous Articles    

Noise and semantic prior guided low-light image enhancement algorithm

Xuejin WANG, Leilei HUANG(), Zhenhui ZHONG   

  1. School of Computer Science and Mathematics,Fujian University of Science and Technology,Fuzhou Fujian 350118,China
  • Received:2024-08-21 Revised:2024-10-19 Accepted:2024-10-22 Online:2024-11-07 Published:2025-09-10
  • Contact: Leilei HUANG
  • About author:WANG Xuejin, born in 1989, Ph. D., associate professor. Her research interests include image processing, computer vision.
    ZHONG Zhenhui, born in 2000, M. S. candidate. His research interests include image processing, image quality assessment.
  • Supported by:
    Natural Science Foundation of Fujian Province(2022J01954);Education and Scientific Research Project for Middle-aged and Young Teachers of Education Department of Fujian Province(JAT210288)

噪声与语义先验引导的低照度图像增强算法

王雪津, 黄雷雷(), 钟祯辉   

  1. 福建理工大学 计算机科学与数学学院,福州 350118
  • 通讯作者: 黄雷雷
  • 作者简介:王雪津(1989—),女,福建莆田人,副教授,博士,主要研究方向:图像处理、计算机视觉
    钟祯辉(2000—),男(畲族),福建福州人,硕士研究生,主要研究方向:图像处理、图像质量评价。
  • 基金资助:
    福建省自然科学基金资助项目(2022J01954);福建省自然科学基金资助项目(2023J01348);福建省教育厅中青年教师教育科研项目(JAT210288)

Abstract:

There are non-uniform distribution characteristics of brightness, noise, and contrast in low-light images, however, the existing Low-Light Image Enhancement (LLIE) algorithms fail to fully utilize these characteristics. As a result, issues such as detail loss, color distortion, and visual discontinuity may occur, affecting the visual quality of the images. To address these problems, a noise and semantic prior guided LLIE algorithm was proposed to consider characteristics of different regions in low-light images and their semantic information adaptively. Specifically, a novel Image block Classification based Global Feature Extraction network (ICGFE) was designed to extract global features, an Information Compensation based Local Feature Extraction network (ICLFE) was introduced to extract local features, and a noise prior-guided feature fusion strategy was proposed to perform adaptive enhancement operations on image regions with different characteristics. Furthermore, a new semantic prior-guided color loss function was presented to maintain consistency of instance colors. Experimental results on the public dataset LOL (LOw-Light dataset) show that the proposed algorithm improves the Peak Signal-to-Noise Ratio (PSNR) by 1.9%-89.1% and achieves good results in Structural SIMilarity (SSIM) compared to the algorithms such as Retinex and Underexposed Photo Enhancement using Deep illumination estimation (DeepUPE). It can be seen that the proposed algorithm can enhance image regions with different characteristics adaptively and has significant advantages in perspectives such as color restoration, detail and texture reconstruction, and noise suppression.

Key words: Low-Light Image Enhancement (LLIE), semantic prior, image block classification, noise prior, self-adaption

摘要:

低照度图像的亮度、噪声和对比度等具有非均匀分布的特性,然而现有的低照度图像增强(LLIE)算法未能充分利用这些特性,在增强过程中容易导致细节丢失、颜色失真和视觉不连贯等问题,从而影响图像的视觉质量。针对上述问题,提出噪声与语义先验引导的LLIE算法,以自适应地考虑低照度图像中不同区域的特性及其语义信息。具体来说,设计一种新的基于图像块分类的全局特征提取网络(ICGFE)提取全局特征,引入基于信息补偿的局部特征提取网络(ICLFE)提取局部特征,并提出基于噪声先验引导的特征融合策略对具有不同特性的图像区域进行自适应增强操作;此外,提出新的语义先验引导的颜色损失函数保持实例颜色的一致性。在公开数据集LOL(LOw-Light dataset)上的实验结果表明,所提算法相较于Retinex和DeepUPE(Underexposed Photo Enhancement using Deep illumination estimation)等算法,峰值信噪比(PSNR)提高了1.9%~89.1%,结构相似性(SSIM)也取得了较好的结果。可见,所提算法能自适应增强具有不同特性的图像区域,并且在颜色恢复、细节纹理还原和噪声抑制等方面均具有明显优势。

关键词: 低照度图像增强, 语义先验, 图像块分类, 噪声先验, 自适应

CLC Number: