Abstract
Recurrent neural network (RNN) has proven successful recently in action recognition. However, depth sequences are of high dimensionality and contain rich human dynamics, which makes traditional RNNs difficult to capture complex action information. This paper addresses the problem of human action recognition from sequences of depth maps using sequential deep learning. The proposed method first synthesizes multi-view depth sequences by rotating 3D point clouds from depth maps. Each depth sequence is then split into short-term temporal segments. For each segment, a multi-view depth motion template (MVDMT), which compresses the segment to a motion template, is constructed for short-term multi-view action representation. The MVDMT effectively characterizes the multi-view appearance and motion patterns within a short-term duration. Convolutional Neural Network (CNN) models are leveraged to extract features from MVDMT, and a CNN-RNN network is subsequently employed to learn an effective representation for sequential patterns of the multi-view depth sequence. The proposed multi-view sequential deep learning framework can simultaneously capture spatial-temporal appearance and motion features in the depth sequence. The proposed method has been evaluated on the MSR Action3D and MSR Action Pairs datasets, achieving promising results compared with the state-of-the-art methods based on depth data.
Original language | English |
---|---|
Title of host publication | Data Mining - 16th Australasian Conference, AusDM 2018, Revised Selected Papers |
Editors | Yanchang Zhao, Graco Warwick, David Stirling, Chang-Tsun Li, Yun Sing Koh, Rafiqul Islam, Zahidul Islam |
Publisher | Springer-Verlag London Ltd. |
Chapter | 28 |
Pages | 360-371 |
Number of pages | 12 |
ISBN (Electronic) | 9789811366611 |
ISBN (Print) | 9789811366604 |
DOIs | |
Publication status | Published - 2019 |
Event | 16th Australasian Conference on Data Mining, AusDM 2018 - Charles Sturt University , Bathurst, Australia Duration: 28 Nov 2018 → 30 Nov 2018 https://ausdm18.ausdm.org/ |
Publication series
Name | Communications in Computer and Information Science |
---|---|
Volume | 996 |
ISSN (Print) | 1865-0929 |
Conference
Conference | 16th Australasian Conference on Data Mining, AusDM 2018 |
---|---|
Country/Territory | Australia |
City | Bathurst |
Period | 28/11/18 → 30/11/18 |
Internet address |