Automatically and programmatically generating markers for streaming media in a crowdsourced manner is described herein. The method operates in a media device that is communicatively coupled to a display device. The display device includes a graphical user interface (GUI) having a playback bar. The playback bar includes a current playback time (CTI) and a plurality of markers. The method operates by detecting user interactions as an user navigates through a movie or TV show (or other content) being presented on the display device. Point values are assigned to the user interactions. The detected user interactions and assigned point values represent training data. The training data is provided to a crowdsource server. The crowdsource server is configured to determine correlations and patterns in the training data to automatically and programmatically define crowdsourced markers for the movie/TV show.