Aspects of the invention include receiving performance data comprising video data and audio data associated with a performance by a performer, wherein the video data comprises audience video data for the performance, determining a performer skill score based on a feature vector generated by a performance skill machine learning model, the feature vector comprising a plurality of features extracted from the performance data, parsing the performance data into a plurality of performance segments, analyzing the performance data to determine a performer emotion of the performer for each performance segment, determining an audience emotion based on the audience video data for one or more audience members for each of the performance segments, comparing the audience emotion to the performer emotion for each performance segment to determine an emotion accuracy score, and determining a final score for the performance based on the performer skill score and the emotion accuracy score.