Light-Aware Contrastive Learning for Low-Light Image Enhancement

W. U. Xu, L. A.I. Zhihui, Jie Zhou, H. O.U. Xianxu, Witold Pedrycz, Linlin Shen

Research output: Journal PublicationArticlepeer-review

1 Citation (Scopus)

Abstract

Low-Light Image Enhancement (LLIE) presents challenges due to texture information loss and uneven illumination, which can distort feature distribution and reduce the quality of the enhanced images. However, current deep learning methods for LLIE only use supervised information from clear images to extract low-light image features, while disregarding the negative information in low-light images (i.e., low illumination and noise). To address these challenges, we propose a novel LLIE method, LACR-VAE, by leveraging the negative information and considering the uneven illumination. In particular, a Light-Aware Contrastive Regularization (LACR) based on contrastive learning is designed to exploit information from both clear and low-light images. The LACR aims to align latent variables of enhanced images with clear images, away from those of low-light images. This allows the method to prioritize essential elements for LLIE and minimize noise and lighting variations. Furthermore, considering the uneven illumination with diverse region sizes and shapes, a Region-CAlibrated Module (RCAM) is present to learn local and global illumination relations among image regions, and an Attention-guided Multi-Scale Module (AMSM) is designed to extract multi-scale features that improve the model’s representation capability. Extensive experiments show that our method achieves superior performance than previous works. Specifically, our method yields a significant enhancement in the National Aeronautics and Space Administration (NASA) testset, achieving an improvement of at least 0.99 in PSNR and 0.0409 in SSIM. Codes and datasets are available at https://github.com/csxuwu/LACR-VAE.

Original languageEnglish
Article number-ART276
JournalACM Transactions on Multimedia Computing, Communications and Applications
Volume20
Issue number9
DOIs
Publication statusPublished - 23 Sept 2024

Keywords

  • Low-light image enhancement
  • contrastive learning
  • transformer
  • variational autoencoder

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Light-Aware Contrastive Learning for Low-Light Image Enhancement'. Together they form a unique fingerprint.

Cite this