Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots
Li P(李鹏); Hou, Xuebin; Duan, Xingguang; Yip, Hiuman; Song GL(宋国立); Liu YH(刘云会)
刊名IEEE ACCESS
2019
卷号7页码:25095-25110
关键词Deep learning surgical robot gaze estimation convolutional neural network
ISSN号2169-3536
产权排序4
英文摘要

Robots are playing an increasingly important role in modern surgery. However, conventional human-computer interaction methods, such as joystick control and sound control, have some shortcomings, and medical personnel are required to specifically practice operating the robot. We propose a human-computer interaction model based on eye movement with which medical staff can conveniently use their eye movements to control the robot. Our algorithm requires only an RGB camera to perform tasks without requiring expensive eye-tracking devices. Two kinds of eye control modes are designed in this paper. The first type is the pick and place movement, with which the user uses eye gaze to specify the point where the robotic arm is required to move. The second type is user command movement, with which the user can use eye gaze to select the direction in which the user desires the robot to move. The experimental results demonstrate the feasibility and convenience of these two modes of movement.

资助项目National Natural Science Foundation of China through the Shenzhen Robot Research Program[U1613221] ; Shenzhen Fundamental Research[JCYJ20170307150346964] ; Guangdong Provincial Science and Technology Funds[2017A020211001] ; National Key Research and Development Program of China[2017YFB1302800]
WOS关键词CALIBRATION
WOS研究方向Computer Science ; Engineering ; Telecommunications
语种英语
WOS记录号WOS:000461014500001
内容类型期刊论文
源URL[http://ir.sia.cn/handle/173321/24414]  
专题沈阳自动化研究所_空间自动化技术研究室
通讯作者Song GL(宋国立)
作者单位1.School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
2.School of Mechanical Engineering and Automation, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China
3.State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
4.Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
推荐引用方式
GB/T 7714
Li P,Hou, Xuebin,Duan, Xingguang,et al. Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots[J]. IEEE ACCESS,2019,7:25095-25110.
APA Li P,Hou, Xuebin,Duan, Xingguang,Yip, Hiuman,Song GL,&Liu YH.(2019).Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots.IEEE ACCESS,7,25095-25110.
MLA Li P,et al."Appearance-Based Gaze Estimator for Natural Interaction Control of Surgical Robots".IEEE ACCESS 7(2019):25095-25110.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace