Multi-Temporal Depth Motion Maps-Based Local Binary Patterns for 3-D Human Action Recognition



Journal Title

Journal ISSN

Volume Title


IEEE Electrical Electronics Engineers Inc


This paper presents a local spatio-temporal descriptor for action recognistion from depth video sequences, which is capable of distinguishing similar actions as well as coping with different speeds of actions. This descriptor is based on three processing stages. In the first stage, the shape and motion cues are captured from a weighted depth sequence by temporally overlapped depth segments, leading to three improved depth motion maps (DMMs) compared with the previously introduced DMMs. In the second stage, the improved DMMs are partitioned into dense patches, from which the local binary patterns histogram features are extracted to characterize local rotation invariant texture information. In the final stage, a Fisher kernel is used for generating a compact feature representation, which is then combined with a kernel-based extreme learning machine classifier. The developed solution is applied to five public domain data sets and is extensively evaluated. The results obtained demonstrate the effectiveness of this solution as compared with the existing approaches.



3-D video (Three-dimensional imaging)

Natural Science Foundation of China under Grant 61672079, Grant 61473086, Grant U1613209, and Grant 6167021685


OAPA: users may copy the work, as well as translate it or reuse it for text/data mining, as long as the usage is for non-commercial purposes., ©2017 IEEE