Spectral Dual-Channel Encoding for Image Dehazing

Zhanchen Zhu, Daokun Zhang, Zhikang Wang, Siyuan Feng, Peibo Duan

Research output: Journal PublicationArticlepeer-review

3 Citations (Scopus)

Abstract

In recent years, deep learning-based dehazing models have presented a momentum of dramatic growth. Unfortunately, most deep learning-based approaches heavily rely on synthetically hazed images for model training, which makes these methods brittle to restore hazy images taken from real-world scenes, due to the sample distribution discrepancy between synthetic and realistic images. Although some attempts have been made to overcome this difficulty by augmenting image spatial features with spectral features, the power of the spectral features still remains underutilized. In this paper, we propose the Spectral Dual-Channel Encoding (SDCE) framework for high-quality image dehazing, by unleashing the power of spectral feature encoding. We argue that hazes impose more adverse impacts on high-frequency image features (e.g., outlines and textures) than low-frequency features (e.g., colors), with theoretical and empirical justifications. To better restore hazed high- and low-frequency features, we decompose the hazed images into high- and low-frequency feature components with spectral dual-channel encoding and respectively design effective neural network architectures to recover hazed images on the two feature components. To be specific, we recover the low-frequency feature components with an encoder-decoder, while we specially design a high-frequency aggregation component (HFAC) to recover hazed images on high-frequency feature components, by referring to neighboring feature distributions. We conduct extensive experiments on four real-world image dehazing benchmarks. The experimental results show that our proposed SDCE framework outperforms the state-of-the-art baselines significantly, with an average 4.4% improvement in PSNR and an average 7.7% gain in SSIM.

Original languageEnglish
Pages (from-to)6236-6248
Number of pages13
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume33
Issue number11
DOIs
Publication statusPublished - 1 Nov 2023
Externally publishedYes

Keywords

  • Dehazing
  • disentanglement
  • encoding
  • spectrum

ASJC Scopus subject areas

  • Media Technology
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Spectral Dual-Channel Encoding for Image Dehazing'. Together they form a unique fingerprint.

Cite this