TY - JOUR
T1 - Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar
AU - Ding, Chuanwei
AU - Hong, Hong
AU - Zou, Yu
AU - Chu, Hui
AU - Zhu, Xiaohua
AU - Fioranelli, Francesco
AU - Li, Changzhi
AU - Le Kernec, Julien
N1 - Funding Information:
Manuscript received December 21, 2018; revised March 19, 2019; accepted March 25, 2019. Date of publication April 23, 2019; date of current version August 27, 2019. This work was supported in part by the National Natural Science Foundation of China under Grant 61871224 and Grant 81601568, in part by the Key Research and Development Plan of Jiangsu Province under Grant BE2018729, in part by the Fundamental Research Funds for the Central Universities under Grant 30917011316, the State Scholarship Fund of the China Scholarship Council under Grant 201806840055, and in part by the National Science Foundation (NSF) under Grant ECCS-1808613 and Grant CNS-1718483. The work of F. Fioranelli was supported by U.K. Engineering and Physical Sciences Research Council under Grant INSHEP EP/R041679/1. (Corresponding author: Hong Hong.) C. Ding is with the School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China, and also with the Department of Electrical and Computer Engineering, Texas Tech University, Lubbock, TX 79409 USA.
Publisher Copyright:
© 1980-2012 IEEE.
PY - 2019/9
Y1 - 2019/9
N2 - Radar-based human motion recognition is crucial for many applications, such as surveillance, search and rescue operations, smart homes, and assisted living. Continuous human motion recognition in real-living environment is necessary for practical deployment, i.e., classification of a sequence of activities transitioning one into another, rather than individual activities. In this paper, a novel dynamic range-Doppler trajectory (DRDT) method based on the frequency-modulated continuous-wave (FMCW) radar system is proposed to recognize continuous human motions with various conditions emulating real-living environment. This method can separate continuous motions and process them as single events. First, range-Doppler frames consisting of a series of range-Doppler maps are obtained from the backscattered signals. Next, the DRDT is extracted from these frames to monitor human motions in time, range, and Doppler domains in real time. Then, a peak search method is applied to locate and separate each human motion from the DRDT map. Finally, range, Doppler, radar cross section (RCS), and dispersion features are extracted and combined in a multidomain fusion approach as inputs to a machine learning classifier. This achieves accurate and robust recognition even in various conditions of distance, view angle, direction, and individual diversity. Extensive experiments have been conducted to show its feasibility and superiority by obtaining an average accuracy of 91.9% on continuous classification.
AB - Radar-based human motion recognition is crucial for many applications, such as surveillance, search and rescue operations, smart homes, and assisted living. Continuous human motion recognition in real-living environment is necessary for practical deployment, i.e., classification of a sequence of activities transitioning one into another, rather than individual activities. In this paper, a novel dynamic range-Doppler trajectory (DRDT) method based on the frequency-modulated continuous-wave (FMCW) radar system is proposed to recognize continuous human motions with various conditions emulating real-living environment. This method can separate continuous motions and process them as single events. First, range-Doppler frames consisting of a series of range-Doppler maps are obtained from the backscattered signals. Next, the DRDT is extracted from these frames to monitor human motions in time, range, and Doppler domains in real time. Then, a peak search method is applied to locate and separate each human motion from the DRDT map. Finally, range, Doppler, radar cross section (RCS), and dispersion features are extracted and combined in a multidomain fusion approach as inputs to a machine learning classifier. This achieves accurate and robust recognition even in various conditions of distance, view angle, direction, and individual diversity. Extensive experiments have been conducted to show its feasibility and superiority by obtaining an average accuracy of 91.9% on continuous classification.
KW - Continuous human motion recognition
KW - dynamic range-Doppler trajectory (DRDT) method
KW - frequency-modulated continuous-wave (FMCW) radar
KW - fusion of multidomain features
KW - machine learning
UR - http://www.scopus.com/inward/record.url?scp=85072049734&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2019.2908758
DO - 10.1109/TGRS.2019.2908758
M3 - Article
SN - 0196-2892
VL - 57
SP - 6821
EP - 6831
JO - Default journal
JF - Default journal
IS - 9
M1 - 8697144
ER -