Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism

doi:10.1016/j.infrared.2022.104242

CORC > 长春光学精密机械与物理研究所 > 中国科学院长春光学精密机械与物理研究所

	Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
	D. D. Xu; N. Zhang; Y. X. Zhang; Z. Li; Z. K. Zhao and Y. C. Wang
刊名	Infrared Physics & Technology
	2022
卷号	125 页码:12
ISSN号	1350-4495
DOI	10.1016/j.infrared.2022.104242
英文摘要	Infrared and visible image fusion can synthesize complementary features of salient objects and texture details which are important for all-weather detection and other tasks. Nowadays, the deep learning based unsupervised fusion solutions are preferred and have obtained good results since the reference images for fusion tasks are not available. In the existing methods, some prominent features are missing in the fused images and the visual vitality needs to be improved. From this thought, attention mechanism is introduced to the fusion network. Especially, channel dimension and spatial dimension attention are jointed to supplement each other for feature extraction. Multiple attention branches emphasize on multi-scale features to complete the encoding. Skip connections are added to learn residual information. The multi-layer perceptual loss, the structure similarity loss and the content loss together construct the strong constraints for training. Comparative experiments with subjective and objective evaluations on 4 traditional and 9 deep learning based methods demonstrate the advantages of the proposed model.
URL标识	查看原文
语种	英语
内容类型	期刊论文
源URL	[http://ir.ciomp.ac.cn/handle/181722/66884]
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	D. D. Xu,N. Zhang,Y. X. Zhang,et al. Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism[J]. Infrared Physics & Technology,2022,125:12.
APA	D. D. Xu,N. Zhang,Y. X. Zhang,Z. Li,&Z. K. Zhao and Y. C. Wang.(2022).Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism.Infrared Physics & Technology,125,12.
MLA	D. D. Xu,et al."Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism".Infrared Physics & Technology 125(2022):12.