Blind Image Decomposition

被引:17
作者
Han, Junlin [1 ,2 ]
Li, Weihao [1 ]
Fang, Pengfei [1 ,2 ]
Sun, Chunyi [2 ]
Hong, Jie [1 ,2 ]
Armin, Mohammad Ali [1 ]
Petersson, Lars [1 ]
Li, Hongdong [2 ]
机构
[1] Data61 CSIRO, Sydney, NSW, Australia
[2] Australian Natl Univ, Canberra, ACT, Australia
来源
COMPUTER VISION - ECCV 2022, PT XVIII | 2022年 / 13678卷
关键词
Image decomposition; Low-level vision; Rain removal; ICA MIXTURE-MODELS; QUALITY ASSESSMENT; REMOVAL; VISIBILITY; NETWORK;
D O I
10.1007/978-3-031-19797-0_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose and study a novel task named Blind Image Decomposition (BID), which requires separating a superimposed image into constituent underlying images in a blind setting, that is, both the source components involved in mixing as well as the mixing mechanism are unknown. For example, rain may consist of multiple components, such as rain streaks, raindrops, snow, and haze. Rainy images can be treated as an arbitrary combination of these components, some of them or all of them. How to decompose superimposed images, like rainy images, into distinct source components is a crucial step toward real-world vision systems. To facilitate research on this new task, we construct multiple benchmark datasets, including mixed image decomposition across multiple domains, real-scenario deraining, and joint shadow/reflection/watermark removal. Moreover, we propose a simple yet general Blind Image Decomposition Network (BIDeN) to serve as a strong baseline for future work. Experimental results demonstrate the tenability of our benchmarks and the effectiveness of BIDeN. Codes and datasets are available at GitHub.
引用
收藏
页码:218 / 237
页数:20
相关论文
共 98 条
  • [1] Intrinsic Autoencoders for Joint Deferred Neural Rendering and Intrinsic Image Decomposition
    Abu Alhaija, Hassan
    Mustikovela, Siva Karthik
    Thies, Justus
    Jampani, Varun
    Niesner, Matthias
    Geiger, Andreas
    Rother, Carsten
    [J]. 2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 1176 - 1185
  • [2] The Visual Centrifuge: Model-Free Layered Video Representations
    Alayrac, Jean-Baptiste
    Carreira, Joao
    Zisserman, Andrew
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2452 - 2461
  • [3] Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration
    Alpert, Sharon
    Galun, Meirav
    Brandt, Achi
    Basri, Ronen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (02) : 315 - 327
  • [4] Asha C. S., 2019, P IEEE INT C DISTR C, P1
  • [5] Non-Local Image Dehazing
    Berman, Dana
    Treibitz, Tali
    Avidan, Shai
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1674 - 1682
  • [6] Blinn J. F., 1982, Computer Graphics, V16, DOI 10.1145/965145.801290
  • [7] Chen X, 2021, P 2021 ACM AS C COMP, P321
  • [8] CANet: A Context-Aware Network for Shadow Removal
    Chen, Zipei
    Long, Chengjiang
    Zhang, Ling
    Xiao, Chunxia
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4723 - 4732
  • [9] Cichocki A., 2002, ADAPTIVE BLIND SIGNA
  • [10] Cohen J., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P115, DOI 10.1145/280814.280832