The integration of facial and vocal cues during emotional change perception: EEG markers

CORC > 心理研究所 > 中国科学院心理研究所 > 中国科学院行为科学重点实验室

	The integration of facial and vocal cues during emotional change perception: EEG markers
	Chen, Xuhai 1,2; Pan, Zhihui 1; Wang, Ping 1; Yang, Xiaohong 3; Liu, Peng 1; You, Xuqun 1; Yuan, Jiajin 4
刊名	SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE
	2016-07-01
通讯作者邮箱	yuanjiajin168@126.com
卷号	11 期号:7 页码:1152-1161
关键词	emotional change bimodal integration event related potential event related spectral perturbation
ISSN号	1749-5016
通讯作者	Yuan, JJ
英文摘要	The ability to detect emotional changes is of primary importance for social living. Though emotional signals are often conveyed by multiple modalities, how emotional changes in vocal and facial modalities integrate into a unified percept has yet to be directly investigated. To address this issue, we asked participants to detect emotional changes delivered by facial, vocal and facial-vocal expressions while behavioral responses and electroencephalogram were recorded. Behavioral results showed that bimodal emotional changes were detected with higher accuracy and shorter response latencies compared with each unimodal condition. Moreover, the detection of emotional change, regardless of modalities, was associated with enhanced amplitudes in the N2 and P3 component, as well as greater theta synchronization. More importantly, the P3 amplitudes and theta synchronization were larger for the bimodal emotional change condition than for the sum of the two unimodal conditions. The superadditive responses in P3 amplitudes and theta synchronization were both positively correlated with the magnitude of the bimodal superadditivity in accuracy. These behavioral and electrophysiological data consistently illustrated an effect of audiovisual integration during the detection of emotional changes, which is most likely mediated by the P3 activity and theta oscillations in brain responses.
学科主题	认知神经科学
WOS标题词	Science & Technology ; Social Sciences ; Life Sciences & Biomedicine
类目[WOS]	Neurosciences ; Psychology ; Psychology, Experimental
研究领域[WOS]	Neurosciences & Neurology ; Psychology
关键词[WOS]	SUPERIOR TEMPORAL SULCUS ; EVENT-RELATED POTENTIALS ; MULTISENSORY INTEGRATION ; AFFECTIVE PROSODY ; HUMAN BRAIN ; FACE ; VOICE ; ERP ; EXPRESSIONS ; DYNAMICS
收录类别	SCI ; SSCI
语种	英语
WOS记录号	WOS:000381229100015
内容类型	期刊论文
源URL	[http://ir.psych.ac.cn/handle/311026/20365]
专题	心理研究所_中国科学院行为科学重点实验室
作者单位	1.Shaanxi Normal Univ, Sch Psychol, Key Lab Behav & Cognit Psychol Shaanxi Prov, Xian 710062, Peoples R China 2.Shaanxi Normal Univ, Key Lab Modern Teaching Technol, Minist Educ, Xian 710062, Peoples R China 3.Chinese Acad Sci, Inst Psychol, Key Lab Behav Sci, Beijing, Peoples R China 4.Southwest Univ, Sch Psychol, Key Lab Cognit & Personal, Minist Educ, Chongqing 400715, Peoples R China
推荐引用方式 GB/T 7714	Chen, Xuhai,Pan, Zhihui,Wang, Ping,et al. The integration of facial and vocal cues during emotional change perception: EEG markers[J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE,2016,11(7):1152-1161.
APA	Chen, Xuhai.,Pan, Zhihui.,Wang, Ping.,Yang, Xiaohong.,Liu, Peng.,...&Yuan, Jiajin.(2016).The integration of facial and vocal cues during emotional change perception: EEG markers.SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE,11(7),1152-1161.
MLA	Chen, Xuhai,et al."The integration of facial and vocal cues during emotional change perception: EEG markers".SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE 11.7(2016):1152-1161.