Systems and methods for generating decision support data for surgical videos are disclosed, the system may include at least on processor configured to implement a method. The method may include receiving video footage of a surgical procedure performed by a surgeon on a patient in an operating room and implementing a model on the received video footage to determine an existence of a surgical decision-making junction. The model may be trained to detect decision-making junctions using training data based on historical video footage depicting surgical situations. The method may include accessing, in a data structure, a correlation between an outcome and a specific action taken at the decision-making junction, and, based on the existence of the decision-making junction and the correlation, outputting a recommendation to at least one of a user device or a user interface related to the specific action.