The disclosure describes systems and methods of detecting body movements using gesture data. The gesture data may be self-referenced and may be comprised by frames which may identify locations or positions of body parts of a subject with respect to a particular reference point within the frame. A classifier may process frames to learn body movements and store the frames of gesture data in a database. Data comprising frames of self-referenced gesture data may be received by a recognizer which recognizes movements of the subject identified by the frames by matching gesture data of the incoming frames to the classified self-referenced gesture data stored in the database.