Uncertainty-aware image inpainting with adaptive feedback network

被引:2
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Uncertainty-Aware Boundary Attention Network for Real-Time Semantic Segmentation
    Zhu, Yuanbing
    Zhu, Bingke
    Chen, Yingying
    Wang, Jinqiao
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 388 - 400
  • [22] Evidence-based uncertainty-aware semi-supervised medical image segmentation
    Chen, Yingyu
    Yang, Ziyuan
    Shen, Chenyu
    Wang, Zhiwen
    Zhang, Zhongzhou
    Qin, Yang
    Wei, Xin
    Lu, Jingfeng
    Liu, Yan
    Zhang, Yi
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 170
  • [23] Image inpainting based on cross-hierarchy global and local aware network
    Jiang, Bin
    Huang, Wei
    Yang, Chao
    Huang, Yun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (12) : 18747 - 18760
  • [24] Diverse image inpainting with disentangled uncertainty
    Wang, Wentao
    He, Lu
    Niu, Li
    Zhang, Jianfu
    Liu, Yue
    Ling, Haoyu
    Zhang, Liqing
    PATTERN RECOGNITION, 2023, 137
  • [25] Image inpainting based on cross-hierarchy global and local aware network
    Bin Jiang
    Wei Huang
    Chao Yang
    Yun Huang
    Multimedia Tools and Applications, 2023, 82 : 18747 - 18760
  • [26] Robust Tracking via Uncertainty-Aware Semantic Consistency
    Ma, Jie
    Lan, Xiangyuan
    Zhong, Bineng
    Li, Guorong
    Tang, Zhenjun
    Li, Xianxian
    Ji, Rongrong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1740 - 1751
  • [27] Uncertainty-aware pseudo-label and consistency for semi-supervised medical image segmentation
    Lu, Liyun
    Yin, Mengxiao
    Fu, Liyao
    Yang, Feng
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 79
  • [28] μDARTS: Model Uncertainty-Aware Differentiable Architecture Search
    Chakraborty, Biswadeep
    Mukhopadhyay, Saibal
    IEEE ACCESS, 2022, 10 : 98670 - 98682
  • [29] Uncertainty-Aware Data Augmentation for Offline Reinforcement Learning
    Su, Yunjie
    Kong, Yilun
    Wang, Xueqian
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [30] An Adaptive Matching Algorithm for Image Inpainting
    Xie, Zhen
    Zhang, Fan
    Zhang, Conggui
    2011 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND CONTROL (ICECC), 2011, : 1293 - 1296