Multisensory Concept Learning Framework Based on Spiking Neural Networks

doi:10.3389/fnsys.2022.845177

CORC > 自动化研究所 > 中国科学院自动化研究所 > 类脑智能研究中心 > 类脑认知计算

	Multisensory Concept Learning Framework Based on Spiking Neural Networks
	Wang, Yuwei 3,4; Zeng, Yi 1,2,3,4
刊名	FRONTIERS IN SYSTEMS NEUROSCIENCE
	2022-05-12
卷号	16 页码:12
关键词	concept learning multisensory spiking neural networks brain-inspired Independent Merge Associate Merge
DOI	10.3389/fnsys.2022.845177
通讯作者	Zeng, Yi(yi.zeng@ia.ac.cn)
英文摘要	Concept learning highly depends on multisensory integration. In this study, we propose a multisensory concept learning framework based on brain-inspired spiking neural networks to create integrated vectors relying on the concept's perceptual strength of auditory, gustatory, haptic, olfactory, and visual. With different assumptions, two paradigms: Independent Merge (IM) and Associate Merge (AM) are designed in the framework. For testing, we employed eight distinct neural models and three multisensory representation datasets. The experiments show that integrated vectors are closer to human beings than the non-integrated ones. Furthermore, we systematically analyze the similarities and differences between IM and AM paradigms and validate the generality of our framework.
WOS关键词	MODALITY EXCLUSIVITY NORMS ; SIMPLE-MODEL ; INTEGRATION ; BRAIN ; SET
WOS研究方向	Neurosciences & Neurology
语种	英语
出版者	FRONTIERS MEDIA SA
WOS记录号	WOS:000800107100001
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/49545]
专题	类脑智能研究中心_类脑认知计算
通讯作者	Zeng, Yi
作者单位	1.Chinese Acad Sci, Inst Automat, Natl Lab PatternRecognit, Beijing, Peoples R China 2.Chinese Acad Sci, Ctr Excellence BrainScience & Intelligence Technol, Shanghai, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China 4.Chinese Acad Sci, Inst Automation, Res Ctr Brain inspired Intelligence, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Wang, Yuwei,Zeng, Yi. Multisensory Concept Learning Framework Based on Spiking Neural Networks[J]. FRONTIERS IN SYSTEMS NEUROSCIENCE,2022,16:12.
APA	Wang, Yuwei,&Zeng, Yi.(2022).Multisensory Concept Learning Framework Based on Spiking Neural Networks.FRONTIERS IN SYSTEMS NEUROSCIENCE,16,12.
MLA	Wang, Yuwei,et al."Multisensory Concept Learning Framework Based on Spiking Neural Networks".FRONTIERS IN SYSTEMS NEUROSCIENCE 16(2022):12.