Uncertainty-aware image inpainting with adaptive feedback network

doi:10.1016/j.eswa.2023.121148

CORC > 自动化研究所 > 中国科学院自动化研究所 > 多模态人工智能系统全国重点实验室

	Uncertainty-aware image inpainting with adaptive feedback network
	Ma, Xin 3; Zhou, Xiaoqiang 1,5; Huang, Huaibo 5; Jia, Gengyun 4; Wang, Yaohui 2; Chen, Xinyuan 2; Chen, Cunjian 3
刊名	EXPERT SYSTEMS WITH APPLICATIONS
	2024
卷号	235 页码:8
关键词	Image inpainting Uncertainty estimation Feedback mechanism
ISSN号	0957-4174
DOI	10.1016/j.eswa.2023.121148
通讯作者	Chen, Cunjian(cunjian.chen@monash.edu)
英文摘要	While most image inpainting methods perform well on small image defects, they still struggle to deliver satisfactory results on large holes due to insufficient image guidance. To address this challenge, this paper proposes an uncertainty-aware adaptive feedback network (U2AFN), which incorporates an adaptive feedback mechanism to refine inpainting regions progressively. U2AFN predicts both an uncertainty map and an inpainting result simultaneously. During each iteration, the adaptive integration feedback block utilizes inpainting pixels with low uncertainty to guide the subsequent learning iteration. This process leads to a gradual reduction in uncertainty and produces more reliable inpainting outcomes. Our approach is extensively evaluated and compared on multiple datasets, demonstrating its superior performance over existing methods. The code is available at: https://codeocean.com/capsule/1901983/tree.
资助项目	Faculty Initiatives Research, Monash University[2901912] ; NVIDIA Academic Hardware Grant Program ; National Key R&D Program of China[2022ZD0160100] ; Shanghai Committee of Science and Technology[21DZ1100100]
WOS研究方向	Computer Science ; Engineering ; Operations Research & Management Science
语种	英语
出版者	PERGAMON-ELSEVIER SCIENCE LTD
WOS记录号	WOS:001063057000001
资助机构	Faculty Initiatives Research, Monash University ; NVIDIA Academic Hardware Grant Program ; National Key R&D Program of China ; Shanghai Committee of Science and Technology
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/53167]
专题	多模态人工智能系统全国重点实验室
通讯作者	Chen, Cunjian
作者单位	1.Univ Sci & Technol China, Hefei, Peoples R China 2.Shanghai Artificial Intelligence Lab, Shanghai, Peoples R China 3.Monash Univ, Clayton, Australia 4.Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing, Peoples R China 5.Chinese Acad Sci, Inst Automat, Nanjing, Peoples R China
推荐引用方式 GB/T 7714	Ma, Xin,Zhou, Xiaoqiang,Huang, Huaibo,et al. Uncertainty-aware image inpainting with adaptive feedback network[J]. EXPERT SYSTEMS WITH APPLICATIONS,2024,235:8.
APA	Ma, Xin.,Zhou, Xiaoqiang.,Huang, Huaibo.,Jia, Gengyun.,Wang, Yaohui.,...&Chen, Cunjian.(2024).Uncertainty-aware image inpainting with adaptive feedback network.EXPERT SYSTEMS WITH APPLICATIONS,235,8.
MLA	Ma, Xin,et al."Uncertainty-aware image inpainting with adaptive feedback network".EXPERT SYSTEMS WITH APPLICATIONS 235(2024):8.