Remote hand gesture recognition using radio frequency (RF) waves is an emerging approach for the interaction between users and smart devices. In this paper, the feasibility of using frequency-modulated continuous-wave (FMCW) radar to recognize hand gestures when multiple closely spaced subjects are illuminated by the same sensor is investigated. Four hand gestures are suggested. Existing radar-based hand gesture recognition mainly relied on the Doppler effect caused by one motion in the sensor's field of view. Besides, they did not consider the random body motion of targets situated at the same range, which is not practical in real-life scenarios. Leveraging the range discrimination capability of FMCW radars and characteristic signal extraction, interference rejection is achieved in this paper. Experimental results confirm the effectiveness of the FMCW radar based remote control approach in the presence of multiple interferences.