A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments
German I. Parisi1; Pablo Barros1; Di Fu1,3,4; Sven Magg1; Haiyan Wu2,3,4; Xun Liu3,4; Stefan Wermter1
2019
会议日期OCT 01-05, 2018
会议地点Madrid, SPAIN
卷号2018
页码2330-2335
英文摘要

Crossmodal conflict resolution is a crucial component of robot sensorimotor coupling through interaction with the environment for swift and robust behaviour also in noisy conditions. In this paper, we propose a neurorobotic experiment in which an iCub robot exhibits human-like responses in a complex crossmodal environment. To better understand how humans deal with multisensory conflicts, we conducted a behavioural study exposing 33 subjects to congruent and incongruent dynamic audio-visual cues. In contrast to previous studies using simplified stimuli, we designed a scenario with four animated avatars and observed that the magnitude and extension of the visual bias are related to the semantics embedded in the scene, i.e., visual cues that are congruent with environmental statistics (moving lips and vocalization) induce a stronger bias. We propose a deep learning model that processes stereophonic sound, facial features, and body motion to trigger a discrete response resembling the collected behavioural data. After training, we exposed the iCub to the same experimental conditions as the human subjects, showing that the robot can replicate similar responses in real time. Our interdisciplinary work provides important insights into how crossmodal conflict resolution can be modelled in robots and introduces future research directions for the efficient combination of sensory drive with internally generated knowledge and expectations.

产权排序2
会议录2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS)
文献子类Article
语种英语
内容类型会议论文
源URL[http://ir.psych.ac.cn/handle/311026/31308]  
专题心理研究所_中国科学院行为科学重点实验室
作者单位1.Knowledge Technology, Department of Informatics, Universit¨at Hamburg, Germany.
2.Division of the Humanities and Social Sciences, Caltech, CA, USA.
3.Department of Psychology, University of CAS, Beijing, China.
4.CAS Key Laboratory of Behavioral Science, Chinese Academy of Sciences (CAS), Beijing, China.
推荐引用方式
GB/T 7714
German I. Parisi,Pablo Barros,Di Fu,et al. A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments[C]. 见:. Madrid, SPAIN. OCT 01-05, 2018.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace