Systems and methods are described for determining playback points in media assets based on both a keyword and a context of a current playback point in a media asset. For example, in response to user input of a keyword (e.g., “Matt Damon”) while the user is consuming a media asset, a current playback point in the media asset is determined. Context of the media asset at the current playback point is then determined (e.g., the current playback point involves a car chase). Playback points in the media asset are determined that match both the context and the keyword and are presented to the user (e.g., playback points with Matt Damon in a car chase).