TreEnhance: A tree search method for low-light image enhancement

被引:28
作者
Cotogni, Marco [1 ]
Cusano, Claudio [1 ]
机构
[1] Univ Pavia, Dept Elect Comp & Biomed Engn, Via Ferrata 1, I-27100 Pavia, Italy
关键词
Low-light image enhancement; Deep reinforcement learning; Automatic image retouching; Image processing; Tree search;
D O I
10.1016/j.patcog.2022.109249
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present TreEnhance, an automatic method for low-light image enhancement capable of improving the quality of digital images. The method combines tree search theory, and in particular the Monte Carlo Tree Search (MCTS) algorithm, with deep reinforcement learning. Given as input a low light image, TreEnhance produces as output its enhanced version together with the sequence of image editing operations used to obtain it. During the training phase, the method repeatedly alternates two main phases: a generation phase, where a modified version of MCTS explores the space of image editing operations and selects the most promising sequence, and an optimization phase, where the parameters of a neural network, implementing the enhancement policy, are updated. Two different inference solutions are proposed for the enhancement of new images: one is based on MCTS and is more accurate but more time and memory consuming; the other directly applies the learned policy and is faster but slightly less precise. As a further contribution, we propose a guided search strategy that "reverses" the enhancement procedure that a photo editor applied to a given input image. Unlike other methods from the state of the art, TreEnhance does not pose any constraint on the image resolution and can be used in a variety of scenarios with minimal tuning. We tested the method on two datasets: the Low-Light dataset and the Adobe Five-K dataset obtaining good results from both a qualitative and a quantitative point of view.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 41 条
[1]  
Batzolis G, 2021, Arxiv, DOI [arXiv:2111.13606, DOI 10.48550/ARXIV.2111.13606]
[2]  
Bianco S., 2017, J. Electron. Imaging, V27
[3]   Personalized Image Enhancement Using Neural Spline Color Transforms [J].
Bianco, Simone ;
Cusano, Claudio ;
Piccoli, Flavio ;
Schettini, Raimondo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :6223-6236
[4]   Learning Parametric Functions for Color Image Enhancement [J].
Bianco, Simone ;
Cusano, Claudio ;
Piccoli, Flavio ;
Schettini, Raimondo .
COMPUTATIONAL COLOR IMAGING, CCIW 2019, 2019, 11418 :209-220
[5]   A Survey of Monte Carlo Tree Search Methods [J].
Browne, Cameron B. ;
Powley, Edward ;
Whitehouse, Daniel ;
Lucas, Simon M. ;
Cowling, Peter I. ;
Rohlfshagen, Philipp ;
Tavener, Stephen ;
Perez, Diego ;
Samothrakis, Spyridon ;
Colton, Simon .
IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2012, 4 (01) :1-43
[6]  
Bychkovsky V, 2011, PROC CVPR IEEE, P97
[7]  
Cai YH, 2021, ADV NEUR IN, V34
[8]   Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Hu, Xiaowan ;
Wang, Haoqian ;
Yuan, Xin ;
Zhang, Yulun ;
Timofte, Radu ;
Van Gool, Luc .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17481-17490
[9]  
Cai YH, 2022, Arxiv, DOI [arXiv:2203.04845, DOI 10.48550/ARXIV.2203.04845]
[10]  
Chai Y, 2020, IEEE WINT CONF APPL, P981, DOI 10.1109/WACV45572.2020.9093321