ICCV

Dancing in the Dark: A Benchmark towards General Low-light Video Enhancement

Huiyuan Fu 1,  Wenkai Zheng 1,  Xicong Wang 1,  Jiaxuan Wang 1,  Heng Zhang 2Huadong Ma 1
1 Beijing University of Posts and Telecommunications
2 Xiaomi

TL;DR: This paper introduces a high-quality low-light video dataset (DID) and a Retinex-based method called Light Adjustable Network (LAN) for general low-light video enhancement. The dataset features dynamic videos with multiple exposures and cameras, while LAN iteratively refines illumination for adaptive enhancement.


Abstract

Low-light video enhancement is a challenging task with broad applications. However, current research in this area is limited by the lack of high-quality benchmark datasets. To address this issue, we design a camera system and collect a high-quality low-light video dataset with multiple exposures and cameras. Our dataset provides dynamic video pairs with pronounced camera motion and strict spatial alignment. To achieve general low-light video enhancement, we also propose a novel Retinex-based method named Light Adjustable Network (LAN). LAN iteratively refines the illumination and adaptively adjusts it under varying lighting conditions, leading to visually appealing results even in diverse real-world scenarios. The extensive experiments demonstrate the superiority of our low-light video dataset and enhancement method. Our dataset is available at https://github.com/ciki000/DID.

Optical System to Collect Dataset

Optical system to collect DID dataset
The camera system consists of 5 capture devices (Sony RX100 M4, Canon EOS R10, Panasonic G9, Fujifilm XT4, Nikon Z5), an electric gimbal, a signal generator, and a central processing device. It collects paired low/normal-light videos by shooting frame by frame, adjusting camera ISO to capture low-light and normal-light frames at the same location, checking and synthesizing frames, and introducing slight gimbal movements (less than 1° horizontal + vertical) between pairs to ensure dynamic motion and continuity.
BibTeX
@inproceedings{fuDancingDarkICCV2023,
  author={Fu, Huiyuan and Zheng, Wenkai and Wang, Xicong and Wang, Jiaxuan and Zhang, Heng and Ma, Huadong},
  booktitle={IEEE/CVF International Conference on Computer Vision (ICCV)}, 
  title={Dancing in the Dark: A Benchmark towards General Low-light Video Enhancement}, 
  year={2023},
  pages={12831-12840}
}