A video management device includes a storage processing unit configured to store video data received through a network in a storage unit, a calculation unit configured to classify a video data group stored in the storage unit based on combinations of imaging locations and content of video data, and to calculate a frequency of appearance of each of the combinations, and a selection unit configured to select video data to be deleted from the storage unit based on the frequency of appearance, thereby increasing a possibility that the deletion of a high-value video will be avoided.