A device receives, as part of a gesture translation service, data that depicts gestures, wherein the data is image data or multimedia data. The device converts a set of frames that include the data to another set of frames that include modified data identifying a grayscale or black and white depiction of the gestures and generates graphical representations of the gestures identified by the modified data. The device selects, using a matching technique, a graphical representation of corresponding gestures that matches or satisfies a threshold level of similarity with the graphical representations of the gestures identified by the modified data. The device identifies response data that is representative of the corresponding gestures based on the response data being stored in association with an identifier of the graphical representation that has been selected. The device provides the response data to be displayed, via an interface, as text data or audio data.