Uncertainty-aware image inpainting with adaptive feedback network

被引:5
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
[31]   Uncertainty-Aware Data Augmentation for Offline Reinforcement Learning [J].
Su, Yunjie ;
Kong, Yilun ;
Wang, Xueqian .
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
[32]   μDARTS: Model Uncertainty-Aware Differentiable Architecture Search [J].
Chakraborty, Biswadeep ;
Mukhopadhyay, Saibal .
IEEE ACCESS, 2022, 10 :98670-98682
[33]   An Adaptive Matching Algorithm for Image Inpainting [J].
Xie, Zhen ;
Zhang, Fan ;
Zhang, Conggui .
2011 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND CONTROL (ICECC), 2011, :1293-1296
[34]   IMAGE INPAINTING WITH ADAPTIVE LINEAR PREDICTOR [J].
Liu, Jing ;
Zhai, Guangtao ;
Yang, Xiaokang ;
Chen, Chang Wen .
2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,
[35]   Uncertainty-Aware Knowledge Distillation for Collision Identification of Collaborative Robots [J].
Kwon, Wookyong ;
Jin, Yongsik ;
Lee, Sang Jun .
SENSORS, 2021, 21 (19)
[36]   DeepGIN: Deep Generative Inpainting Network for Extreme Image Inpainting [J].
Li, Chu-Tak ;
Siu, Wan-Chi ;
Liu, Zhi-Song ;
Wang, Li-Wen ;
Lun, Daniel Pak-Kong .
COMPUTER VISION - ECCV 2020 WORKSHOPS, PT IV, 2020, 12538 :5-22
[37]   Uncertainty-aware semi-supervised few shot segmentation [J].
Kim, Soopil ;
Chikontwe, Philip ;
An, Sion ;
Park, Sang Hyun .
PATTERN RECOGNITION, 2023, 137
[38]   A Hybrid Framework for Uncertainty-Aware Depth Prediction in the Underwater Environment [J].
Marques, Filipe ;
Castro, Filipa ;
Parente, Manuel ;
Costa, Pedro .
2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020), 2020, :102-107
[39]   UPL-Net: Uncertainty-aware prompt learning network for semi-supervised action recognition [J].
Yang, Shu ;
Li, Ya-Li ;
Wang, Shengjin .
NEUROCOMPUTING, 2025, 619
[40]   Federated Uncertainty-Aware Aggregation for Fundus Diabetic Retinopathy Staging [J].
Wang, Meng ;
Wang, Lianyu ;
Xu, Xinxing ;
Zou, Ke ;
Qian, Yiming ;
Goh, Rick Siow Mong ;
Liu, Yong ;
Fu, Huazhu .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT II, 2023, 14221 :222-232