SDRTV-to-HDRTV via Hierarchical Dynamic Context Feature Mapping

被引:17
作者
He, Gang [1 ,2 ]
Xu, Kepeng [1 ]
Xu, Li [1 ]
Wu, Chang [1 ]
Sun, Ming [2 ]
Wen, Xing [2 ]
Tai, Yu-Wing [2 ]
机构
[1] Xidian Univ, Xian, Peoples R China
[2] Kuaishou Technol, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022 | 2022年
关键词
Standard Dynamic Range; High Dynamic Range; Feature Transformation; Dynamic Convolution; Neural Network;
D O I
10.1145/3503161.3548043
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this work, we address the task of SDR videos to HDR videos(SDRTV-to-HDRTV conversion). Previous approaches use global feature modulation for SDRTV-to-HDRTV conversion. Feature modulation scales and shifts the features in the original feature space, which has limited mapping capability. In addition, the global image mapping cannot restore detail in HDR frames due to the luminance differences in different regions of SDR frames. To resolve the appeal, we propose a two-stage solution. The first stage is a hierarchical Dynamic Context feature mapping (HDCFM) model. HDCFM learns the SDR frame to HDR frame mapping function via hierarchical feature modulation (HME and HM) module and a dynamic context feature transformation (DYCT) module. The HME estimates the feature modulation vector, HM is capable of hierarchical feature modulation, consisting of global feature modulation in series with local feature modulation, and is capable of adaptive mapping of local image features. The DYCT module constructs a feature transformation module in conjunction with the context, which is capable of adaptively generating a feature transformation matrix for feature mapping. Compared with simple feature scaling and shifting, the DYCT module can map features into a new feature space and thus has a more excellent feature mapping capability. In the second stage, we introduce a patch discriminator-based context generation model PDCG to obtain subjective quality enhancement of over-exposed regions. The proposed method can achieve state-of-the-art objective and subjective quality results. Specifically, HDCFM achieves a PSNR gain of 0.81 dB at about 100K parameters. The number of parameters is 1/14th of the previous state-of-the-art methods. The test code will be released on https://github.com/cooperlike/HDCFM.
引用
收藏
页码:2890 / 2898
页数:9
相关论文
共 47 条
  • [1] [Anonymous], 2020, ACM T GRAPH
  • [2] [Anonymous], 2014, ST 2084 2014, V2014, P1, DOI DOI 10.5594/SMPTE.ST2084.2014
  • [3] Banterle Francesco, 2009, EUROGRAPHICS
  • [4] Banterle Francesco, 2008, SPRING C COMP GRAPH
  • [5] Cao Y, 2019, IEEE ICC
  • [6] Chen Xiangyu, 2021, ARXIV IMAGE VIDEO PR
  • [7] Chen Y, 2018, PICT COD SYMP, P41, DOI 10.1109/PCS.2018.8456249
  • [8] De Brabandere Bert, 2016, ARXIV160509673CSLG
  • [9] Debevec Paul E., 1997, Progress, DOI DOI 10.1145/258734.258884
  • [10] Eilertsen Gabriel, 2017, INT C COMP GRAPH INT