An image processing apparatus capable of accurate area tracking, and a method for controlling the same are provided. An image area for extracting a feature amount is identified based on a specified position. A plurality of images are searched for an image that corresponds to the image area using the feature amount extracted from the identified image area. The image area is identified using distance information if distance information that satisfies a reliability condition has been obtained regarding an area that includes the specified position, and without using the distance information if the distance information that satisfies the reliability condition has not been obtained.