Tracking multiple targets can include making different observations based on multiple different frames of one or more digital video feeds, determining an initial cover based on the observations, performing one or more modifications to the initial cover to generate a final cover, and using the final cover to track multiple targets in the one or more digital video feeds. Performing one or more modifications to generate a final cover can include selecting one or more adjustments from a group that includes temporal cover adjustments and spatial cover adjustments, and can include using likelihood information indicative of similarities in motion and appearance to distinguish different targets in the frames.