Generating Emotion Descriptions for Fine Art Paintings via Multiple Painting Representations | |
Lu, Yue1,2; Guo, Chao1,2; Dai, Xingyuan1,2; Wang, Fei-Yue2 | |
刊名 | IEEE Intelligent Systems |
2023-03-23 | |
卷号 | 38期号:3页码:31-40 |
关键词 | painting captioning |
DOI | 10.1109/MIS.2023.3260992 |
文献子类 | Regular Paper |
英文摘要 | The task of generating emotion descriptions for fine art paintings using machine learning is gaining increasing attention. However, captioning the emotions depicted in paintings is challenging due to the artistic and subtle nature of the relied-upon visual clues. Previous studies on painting emotion captioning mainly focus on content-oriented semantic features, resulting in limited performance. Recognizing that facial expressions and body language can reflect human emotions, we propose a novel painting emotion captioning model that incorporates two additional features: facial expression feature and human pose feature. Our model includes a feature fusion method to incorporate these features with commonly used object features. The experiment results on public datasets demonstrate that our proposed model outperforms the baseline. Further experiments on paintings with abstract appearances and image corruptions show the promising performance of our proposed model. |
URL标识 | 查看原文 |
语种 | 英语 |
内容类型 | 期刊论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/52112] |
专题 | 自动化研究所_复杂系统管理与控制国家重点实验室_先进控制与自动化团队 |
通讯作者 | Wang, Fei-Yue |
作者单位 | 1.中国科学院大学 2.中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Lu, Yue,Guo, Chao,Dai, Xingyuan,et al. Generating Emotion Descriptions for Fine Art Paintings via Multiple Painting Representations[J]. IEEE Intelligent Systems,2023,38(3):31-40. |
APA | Lu, Yue,Guo, Chao,Dai, Xingyuan,&Wang, Fei-Yue.(2023).Generating Emotion Descriptions for Fine Art Paintings via Multiple Painting Representations.IEEE Intelligent Systems,38(3),31-40. |
MLA | Lu, Yue,et al."Generating Emotion Descriptions for Fine Art Paintings via Multiple Painting Representations".IEEE Intelligent Systems 38.3(2023):31-40. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论