A video processing device includes: an object detector configured to detect an object included in a video so that a type of the object can be identified; an event detector configured to detect a focusing event which occurs to the detected object; a masking target setter configured to simultaneously set all objects of a selected type as masking targets, and to exclude from the masking targets, one or more objects to which occurrence of the selected focusing event has been detected by the event detector; and a masking process controller configured to generate a masking-processed video in which each video area which corresponds to the object set as the masking target by the masking target setter, has been changed to a masking image.