Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter

doi:10.3390/s21062217

CORC > 长春光学精密机械与物理研究所 > 中国科学院长春光学精密机械与物理研究所

	Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter
	B. Zhao; Y. Wang; K. Su; H. Ren and H. Sun
刊名	Sensors
	2021
卷号	21 期号:6 页码:1-17
ISSN号	14248220
DOI	10.3390/s21062217
英文摘要	This paper proposes an action recognition algorithm based on the capsule network and Kalman filter called "Reading Pictures Instead of Looking" (RPIL). This method resolves the convolutional neural networks over sensitivity to rotation and scaling and increases the interpretability of the model as per the spatial coordinates in graphics. The capsule network is first used to obtain the components of the target human body. The detected parts and their attribute parameters (e.g., spatial coordinates, color) are then analyzed by Bert. A Kalman filter analyzes the predicted capsules and filters out any misinformation to prevent the action recognition results from being affected by incorrectly predicted capsules. The parameters between neuron layers are evaluated, then the structure is pruned into a dendritic network to enhance the computational efficiency of the algorithm. This minimizes the dependence of in-depth learning on the random features extracted by the CNN without sacrificing the models accuracy. The association between hidden layers of the neural network is also explained. With a 90% observation rate, the OAD dataset test precision is 83.3%, the ChaLearn Gesture dataset test precision is 72.2%, and the G3D dataset test precision is 86.5%. The RPILNet also satisfies real-time operation requirements (30 fps). 2021 by the authors. Licensee MDPI, Basel, Switzerland.
URL标识	查看原文
内容类型	期刊论文
源URL	[http://ir.ciomp.ac.cn/handle/181722/65573]
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	B. Zhao,Y. Wang,K. Su,et al. Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter[J]. Sensors,2021,21(6):1-17.
APA	B. Zhao,Y. Wang,K. Su,&H. Ren and H. Sun.(2021).Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter.Sensors,21(6),1-17.
MLA	B. Zhao,et al."Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter".Sensors 21.6(2021):1-17.