Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video

	Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video
	Liu, Yang; Peng, Xiaodong; Zhou, Wugen; Liu, Bo; Gerndt, Andreas; Liu, Yang (liuyang213@mails.ucas.ac.cn)
刊名	3D Research
	2018
卷号	9 期号:2
英文摘要	In this paper, we propose a template-based 3D surface reconstruction system of non-rigid deformable objects from monocular video sequence. Firstly, we generate a semi-dense template of the target object with structure from motion method using a subsequence video. This video can be captured by rigid moving camera orienting the static target object or by a static camera observing the rigid moving target object. Then, with the reference template mesh as input and based on the framework of classical template-based methods, we solve an energy minimization problem to get the correspondence between the template and every frame to get the time-varying mesh to present the deformation of objects. The energy terms combine photometric cost, temporal and spatial smoothness cost as well as as-rigid-as-possible cost which can enable elastic deformation. In this paper, an easy and controllable solution to generate the semi-dense template for complex objects is presented. Besides, we use an effective iterative Schur based linear solver for the energy minimization problem. The experimental evaluation presents qualitative deformation objects reconstruction results with real sequences. Compare against the results with other templates as input, the reconstructions based on our template have more accurate and detailed results for certain regions. The experimental results show that the linear solver we used performs better efficiency compared to traditional conjugate gradient based solver. © 2018, 3D Research Center, Kwangwoon University and Springer-Verlag GmbH Germany, part of Springer Nature.
语种	英语
内容类型	期刊论文
源URL	[http://ir.nssc.ac.cn/handle/122/6336]
专题	国家空间科学中心_空间技术部
通讯作者	Liu, Yang (liuyang213@mails.ucas.ac.cn)
推荐引用方式 GB/T 7714	Liu, Yang,Peng, Xiaodong,Zhou, Wugen,et al. Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video[J]. 3D Research,2018,9(2).
APA	Liu, Yang,Peng, Xiaodong,Zhou, Wugen,Liu, Bo,Gerndt, Andreas,&Liu, Yang .(2018).Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video.3D Research,9(2).
MLA	Liu, Yang,et al."Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video".3D Research 9.2(2018).