A privacy reserving camera including a frame buffer, an object detection and tracking module, an object identification module, an instance segmentation module and an object removal and inpainting module. The frame buffer stores frames of a video stream captured by the privacy preserving camera. The object detection and tracking module detects a moving object in the video stream. The object identification module determines whether the moving object is a privacy protecting object. The instance segmentation module parses the moving object in the video stream. The object removal and inpainting module removes at least a portion of the moving object from the video stream, fills an area of the removed moving object in the video stream with a compensated patch from a neighbor frame of the video stream, and outputs a modified video stream having at least a portion of the moving object replaced with the compensated patch.