Multi-Sensor Motion Fusion Using Deep Neural Network Learning

View Sample PDF

Author(s): Xinyao Sun (University of Alberta, Canada), Anup Basu (University of Alberta, Canada)and Irene Cheng (University of Alberta, Canada)
Copyright: 2020
Pages: 19
Source title: Deep Learning and Neural Networks: Concepts, Methodologies, Tools, and Applications
Source Author(s)/Editor(s): Information Resources Management Association (USA)
DOI: 10.4018/978-1-7998-0414-7.ch032

Keywords: Artificial Intelligence / Computer Science & IT / Engineering Science Reference / Neural Networks

Purchase

View Multi-Sensor Motion Fusion Using Deep Neural Network Learning on the publisher's website for pricing and purchasing information.

Abstract

Hand pose estimation for a continuous sequence has been an important topic not only in computer vision but also human-computer-interaction. Exploring the feasibility to use hand gestures to replace input devices, e.g., mouse, keyboard, joy-stick and touch screen, has attracted increasing attention from academic and industrial researchers. The fast advancement of hand pose estimation techniques is complemented by the rapid development of smart sensors technology such as Kinect and Leap. We introduce a hand pose estimation multi-sensor system. Two tracking models are proposed based on Deep (Recurrent) Neural Network (DRNN) architecture. Data captured from different sensors are analyzed and fused to produce an optimal hand pose sequence. Experimental results show that our models outperform previous methods with better accuracy, meeting real-time application requirement. Performance comparisons between DNN and DRNN, spatial and spatial-temporal features, and single- and dual- sensors, are also presented.

The IRMA Community

Research IRM

Multi-Sensor Motion Fusion Using Deep Neural Network Learning

Purchase

Abstract

Related Content

IRMA Sponsors