Provided is a system and method for automatically recognizing user motion. The system for automatically recognizing user motion includes an input unit configured to receive three-dimensional (3D) measurement data, a memory which stores a program for performing automatic recognition on 3D user motion using 3D low-quality depth data and a deep learning model, and a processor configured to execute the program, wherein the processor converts the 3D low-quality depth data into 3D high-quality image data.