Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral Learning

被引:20
|
作者
Zheng, Zhuoran [1 ,2 ,3 ]
Ren, Wenqi [2 ,3 ]
Cao, Xiaochun [3 ]
Wang, Tao [4 ]
Jia, Xiuyi [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing, Peoples R China
[3] Chinese Acad Sci, IIE, SKLOIS, Beijing, Peoples R China
[4] Huawei Noahs Ark Lab, London, England
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
DYNAMIC-RANGE EXPANSION;
D O I
10.1109/ICCV48922.2021.00441
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing single image high dynamic range (HDR) reconstruction methods attempt to expand the range of illuminance. They are not effective in generating plausible textures and colors in the reconstructed results, especially for high-density pixels in ultra-high-definition (UHD) images. To address these problems, we propose a new HDR reconstruction network for UHD images by collaboratively learning color and texture details. First, we propose a dual-path network to extract the content and chromatic features at a reduced resolution of the low dynamic range (LDR) input. These two types of features are used to fit bilateral-space affine models for real-time HDR reconstruction. To extract the main data structure of the LDR input, we propose to use 3D Tucker decomposition and reconstruction to prevent pseudo edges and noise amplification in the learned bilateral grid. As a result, the high-quality content and chromatic features can be reconstructed capitalized on guided bilateral upsampling. Finally, we fuse these two full-resolution feature maps into the HDR reconstructed results. Our proposed method can achieve real-time processing for UHD images (about 160 fps). Experimental results demonstrate that the proposed algorithm performs favorably against the state-of-the-art HDR reconstruction approaches on public benchmarks and real-world UHD images.
引用
收藏
页码:4429 / 4438
页数:10
相关论文
共 50 条
  • [41] Initial Experience With Ultra-High-Definition 3D Exoscope in Thyroid and Parathyroid Surgery
    Bernes, Steen
    Lilja-Fischer, Jacob
    Petersen, Niels Krintel
    Udholm, Nichlas
    Reinholdt, Kasper Basse
    Londero, Stefano
    Kjaergaard, Thomas
    Rolighed, Lars
    SURGICAL INNOVATION, 2024,
  • [42] HDR-DANet: single HDR image reconstruction via dual attentionHDR-DANet: single HDR image reconstruction via dual attentionJ. Ma, H. Zhang
    Jindong Ma
    Haitao Zhang
    Multimedia Systems, 2025, 31 (1)
  • [43] Ultra-high-definition (22 MHz) ultrasound of the ulnar nerve: additional value and normative data
    Ruettermann, Mike
    Broekstra, Dieuwke C.
    Groen, Gerbrand J.
    Elting, Jan Willem
    JOURNAL OF HAND SURGERY-EUROPEAN VOLUME, 2023, 48 (10) : 1036 - 1041
  • [44] Optical design and evaluation of a 4 mm cost-effective ultra-high-definition arthroscope
    Cheng, Dewen
    Wang, Yongtian
    Yu, Lu
    Liu, Xiaohua
    BIOMEDICAL OPTICS EXPRESS, 2014, 5 (08): : 2697 - 2714
  • [45] Automatic Detection and Localization of Surface Defects for Whole Piece of Ultra-high-definition Leather Images
    Fan Dahuang
    Ding Lei
    Deng Jiehang
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2019), 2019, : 229 - 232
  • [46] Mechanism and design of a novel 8K ultra-high-definition video microscope for microsurgery
    Yamashita, Hiromasa
    Kobayashi, Eiji
    HELIYON, 2021, 7 (02)
  • [47] Laparoscopic surgery using 8 K ultra-high-definition technology: Outcomes of a phase II study
    Tsukamoto, Shunsuke
    Kuchiba, Aya
    Moritani, Konosuke
    Shida, Dai
    Katayama, Hiroshi
    Yorikane, Eiko
    Kanemitsu, Yukihide
    ASIAN JOURNAL OF ENDOSCOPIC SURGERY, 2022, 15 (01) : 7 - 14
  • [48] Fruitful first experience with an 8K ultra-high-definition endoscope for laparoscopic colorectal surgery
    Ohigashi, Seiji
    Taketa, Takashi
    Shimada, Gen
    Kubota, Keisuke
    Sunagawa, Hiroki
    Kishida, Akihiro
    ASIAN JOURNAL OF ENDOSCOPIC SURGERY, 2019, 12 (03) : 362 - 365
  • [49] Quality of 8K Ultra-High-Definition Television Viewing Experience in Practical Viewing Conditions
    Shishikui, Yoshiaki
    Sawahata, Yasuhito
    IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (01) : 2 - 12
  • [50] The global lambda visualization facility: An international ultra-high-definition wide-area visualization collaboratory
    Leigh, Jason
    Renambot, Luc
    Johnson, Andrew
    Jeong, Byungil
    Jagodic, Ratko
    Schwarz, Nicholas
    Svistula, Dmitry
    Singh, Rajvikram
    Aguilera, Julieta
    Wang, Xi
    Vishwanath, Venkatram
    Lopez, Brenda
    Sandin, Dan
    Peterka, Tom
    Girado, Javier
    Kooima, Robert
    Ge, Jinghua
    Long, Lance
    Verlo, Alan
    DeFanti, Thomas A.
    Brown, Maxine
    Cox, Donna
    Patterson, Robert
    Dorn, Patrick
    Wefel, Paul
    Levy, Stuart
    Talandis, Jonas
    Reitzer, Joe
    Prudhomme, Tom
    Coffin, Tom
    Davis, Brian
    Wielinga, Paul
    Stolk, Bram
    Koo, Gee Bum
    Kim, Jaeyoun
    Han, Sangwoo
    Kim, JongWon
    Corrie, Brian
    Zimmerman, Todd
    Boulanger, Pierre
    Garcia, Manuel
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2006, 22 (08): : 964 - 971