PSNet: LiDAR and Camera Registration Using Parallel Subnetworks

doi:10.1109/access.2022.3186974

CORC > 长春光学精密机械与物理研究所 > 中国科学院长春光学精密机械与物理研究所

	PSNet: LiDAR and Camera Registration Using Parallel Subnetworks
	Y. Wu; M. Zhu and J. Liang
刊名	Ieee Access
	2022
卷号	10 页码:70553-70561
ISSN号	2169-3536
DOI	10.1109/access.2022.3186974
英文摘要	The working environment of autonomous driving and robot navigation is so complex and dynamic that a single type of sensor is insufficient for performing object detection. Thus, in many perception schemes, the LiDAR-camera fusion strategy is preferred. However, the performance of a LiDAR-camera fusion heavily relies on a set of accurately calibrated extrinsic parameters. We propose PSNet, an end-to-end convolutional neural network (CNN) for calibration; this is the first calibration network to use parallel subnetworks to obtain multiresolution features and fuse them adaptively to encourage robustness against different initial error ranges. The method has three key characteristics: (i) Addition of a downsampling block to improve suitability for sparse projected depth maps; (ii) Connection of the high-to-low resolution convolution streams in parallel to obtain multiresolution features that are spatially more precise and contain richer semantic information; (iii) Fusion of multiresolution streams by the multiscale feature aggregation module. The network corrects errors from initial calibration to the ground truth online, rather than directly obtaining the accurate parameters. We evaluated our model on the KITTI datasets and it outperformed other CNN-based methods. In addition, extensive experiments evaluating the model with untrained and unfamiliar datasets demonstrated that our method exhibited good generalization ability.
URL标识	查看原文
语种	英语
内容类型	期刊论文
源URL	[http://ir.ciomp.ac.cn/handle/181722/67009]
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Y. Wu,M. Zhu and J. Liang. PSNet: LiDAR and Camera Registration Using Parallel Subnetworks[J]. Ieee Access,2022,10:70553-70561.
APA	Y. Wu,&M. Zhu and J. Liang.(2022).PSNet: LiDAR and Camera Registration Using Parallel Subnetworks.Ieee Access,10,70553-70561.
MLA	Y. Wu,et al."PSNet: LiDAR and Camera Registration Using Parallel Subnetworks".Ieee Access 10(2022):70553-70561.