An image processing system includes a face detection unit to detect a face in an image and a partial region detection unit to detect a partial region of the image based on a position of the face detected in the image. A tracking determination unit may also be included in the image processing system to select at least one of the face and the partial region for tracking based on a predetermined condition, and to track the selected one of the face and the partial region.