A face detection circuit of an image processing apparatus detects a face region from a video signal. An individual recognition circuit performs individual recognition processing based on a comparison of a similarity between feature information extracted from the face region and registered feature information with a predetermined threshold value. A camera microcomputer tracks a face recognized by the individual recognition circuit and stores information about the tracked face. Further, in a case where the recognized face is not tracked and recognition information about a first subject is not stored, the camera microcomputer sets a first threshold value as a predetermined threshold value for the first subject. On the other hand, in a case where the recognition information about the first subject region is stored, the camera microcomputer sets as the predetermined threshold value for the first subject a second threshold value which is lower than the first threshold value.