Uncertainty-aware image inpainting with adaptive feedback network

被引:5
作者
Ma, Xin [1 ]
Zhou, Xiaoqiang [3 ,4 ]
Huang, Huaibo [3 ]
Jia, Gengyun [2 ]
Wang, Yaohui [5 ]
Chen, Xinyuan [5 ]
Chen, Cunjian [1 ]
机构
[1] Monash Univ, Clayton, Australia
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
[4] Univ Sci & Technol China, Hefei, Peoples R China
[5] Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
Image inpainting; Uncertainty estimation; Feedback mechanism;
D O I
10.1016/j.eswa.2023.121148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
引用
收藏
页数:8
相关论文
共 50 条
[41]   Uncertainty-Aware Pedestrian Crossing Prediction via Reinforcement Learning [J].
Dai, Siyang ;
Liu, Jun ;
Cheung, Ngai-Man .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) :9540-9549
[42]   Uncertainty-aware self-supervised neural network for liver T 1? mapping with relaxation constraint [J].
Huang, Chaoxing ;
Qian, Yurui ;
Yu, Simon Chun-Ho ;
Hou, Jian ;
Jiang, Baiyan ;
Chan, Queenie ;
Wong, Vincent Wai-Sun ;
Chu, Winnie Chiu-Wing ;
Chen, Weitian .
PHYSICS IN MEDICINE AND BIOLOGY, 2022, 67 (22)
[43]   Elucidating robust learning with uncertainty-aware corruption pattern estimation [J].
Park, Jeongeun ;
Shin, Seungyoun ;
Hwang, Sangheum ;
Choi, Sungjoon .
PATTERN RECOGNITION, 2023, 138
[44]   EDBGAN: Image Inpainting via an Edge-Aware Dual Branch Generative Adversarial Network [J].
Chen, Minyu ;
Liu, Zhi .
IEEE SIGNAL PROCESSING LETTERS, 2021, 28 :842-846
[45]   An Effective Content-Aware Image Inpainting Method [J].
Wu, Jiunn-Lin ;
Chou, Yi-Ying .
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2012, 28 (04) :755-770
[46]   EDGE-AWARE CONTEXT ENCODER FOR IMAGE INPAINTING [J].
Liao, Liang ;
Hu, Ruimin ;
Xiao, Jing ;
Wang, Zhongyuan .
2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, :3156-3160
[47]   SEMANTIC-AWARE CONTEXT AGGREGATION FOR IMAGE INPAINTING [J].
Huang, Zhilin ;
Qin, Chujun ;
Liu, Ruixin ;
Weng, Zhenyu ;
Zhu, Yuesheng .
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, :2465-2469
[48]   Cascading Blend Network for Image Inpainting [J].
Jin, Yiting ;
Wu, Jie ;
Wang, Wanliang ;
Yan, Yidong ;
Jiang, Jiawei ;
Zheng, Jianwei .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (01)
[49]   Hourglass Attention Network for Image Inpainting [J].
Deng, Ye ;
Hui, Siqi ;
Meng, Rongye ;
Zhou, Sanping ;
Wang, Jinjun .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :483-501
[50]   Dynamic Selection Network for Image Inpainting [J].
Wang, Ning ;
Zhang, Yipeng ;
Zhang, Lefei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :1784-1798