Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery

doi:10.1016/j.displa.2017.03.003

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 先进控制与自动化团队

	Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery
	Wang, Rong1,2 ; Geng, Zheng1 ; Zhang, Zhaoxing1 ; Pei, Renjing1,2 ; Meng, Xiangbing1,2 ; Wang Rong
刊名	DISPLAYS
	2017-07-01
卷号	48 期号:0 页码:50-60
关键词	Visualization Augmented Reality Autostereoscopic 3d Display Depth Perception
DOI	10.1016/j.displa.2017.03.003
文献子类	Article
英文摘要	Augmented reality (AR) has received increasing attention in minimally invasive surgery (MIS) applications. The goal of applying AR techniques to MIS is to enhance a surgeon's perception of the spatial relationship by overlaying invisible structures (e.g. tumor or vessels) onto the in vivo endoscopic video acquired during the surgery. One of primary issues of AR visualization is to provide correct depth perception for visible and invisible structures. In this paper, we present a video-based AR system consisting of functional modules for real-time 3D surface capture, reconstruction, and registration with pre-operative segmented CT model. The real-time 3D registration allows precise overlay of invisible structures onto 2D video for AR visualization. The AR overlay result is displayed on a multi-view autostereoscopic lenticular LCD. To study and compare the efficacy of AR visualization techniques, we investigated five different AR visualization modes. Both simulated and in vivo experiments were carried out and autostereoscopic AR visualization results were given. Evaluation and comparison for depth perception between five AR visualization modes are presented. Finally, we conclude the characteristics of these visualization modes. The novelty of our work lies in successful implementation of an end-to-end 3D autostereoscopic AR system from real-time reconstruction and registration with our multi-channel 3D endoscope, and systematic evaluation and comparison of five different visualization modes for depth perception. (C) 2017 Elsevier B.V. All rights reserved.
WOS关键词	LAPAROSCOPIC PARTIAL NEPHRECTOMY ; IMAGE-GUIDED SURGERY ; REGISTRATION ; NAVIGATION ; DISPLAY ; OVERLAY
WOS研究方向	Computer Science ; Engineering ; Instruments & Instrumentation ; Optics
语种	英语
WOS记录号	WOS:000404312700007
资助机构	Institute of Automation, Chinese Academy of Sciences (CASIA)(2012AA011903 ; National High-tech R&D Program (863 Program) of Institute of Automation ; 2015AA015905)
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/15246]
专题	自动化研究所_复杂系统管理与控制国家重点实验室_先进控制与自动化团队
通讯作者	Wang Rong
作者单位	1.Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Wang, Rong,Geng, Zheng,Zhang, Zhaoxing,et al. Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery[J]. DISPLAYS,2017,48(0):50-60.
APA	Wang, Rong,Geng, Zheng,Zhang, Zhaoxing,Pei, Renjing,Meng, Xiangbing,&Wang Rong.(2017).Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery.DISPLAYS,48(0),50-60.
MLA	Wang, Rong,et al."Autostereoscopic augmented reality visualization for depth perception in endoscopic surgery".DISPLAYS 48.0(2017):50-60.