Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network

doi:10.1007/s11633-023-1417-9

CORC > 自动化研究所 > 中国科学院自动化研究所 > 学术期刊 > International Journal of Automation and Computing

	Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network
	Guanghui Shi 1; Shasha Mao 1; Shuiping Gou 1; Dandan Yan 1; Licheng Jiao 1; Lin Xiong 2
刊名	Machine Intelligence Research
	2024
卷号	21 期号:2 页码:331-348
关键词	Facial expression recognition, deep neural network, multiple network ensemble, attention network, facial crucial regions
ISSN号	2731-538X
DOI	10.1007/s11633-023-1417-9
英文摘要	Facial expression recognition (FER) is still challenging due to the small interclass discrepancy in facial expression data. In view of the significance of facial crucial regions for FER, many existing studies utilize the prior information from some annotated crucial points to improve the performance of FER. However, it is complicated and time-consuming to manually annotate facial crucial points, especially for vast wild expression images. Based on this, a local non-local joint network is proposed to adaptively enhance the facial crucial regions in feature learning of FER in this paper. In the proposed method, two parts are constructed based on facial local and non-local information, where an ensemble of multiple local networks is proposed to extract local features corresponding to multiple facial local regions and a non-local attention network is addressed to explore the significance of each local region. In particular, the attention weights obtained by the non-local network are fed into the local part to achieve interactive feedback between the facial global and local information. Interestingly, the non-local weights corresponding to local regions are gradually updated and higher weights are given to more crucial regions. Moreover, U-Net is employed to extract the integrated features of deep semantic information and low hierarchical detail information of expression images. Finally, experimental results illustrate that the proposed method achieves more competitive performance than several state-of-the-art methods on five benchmark datasets.
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/56042]
专题	自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位	1.School of Artificial Intelligence, Xidian University, Xi'an 710000, China 2.Applied Research Laboratory, SenseTime, Xi'an 710000, China
推荐引用方式 GB/T 7714	Guanghui Shi,Shasha Mao,Shuiping Gou,et al. Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network[J]. Machine Intelligence Research,2024,21(2):331-348.
APA	Guanghui Shi,Shasha Mao,Shuiping Gou,Dandan Yan,Licheng Jiao,&Lin Xiong.(2024).Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network.Machine Intelligence Research,21(2),331-348.
MLA	Guanghui Shi,et al."Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network".Machine Intelligence Research 21.2(2024):331-348.