An apparatus includes an imaging unit configured to capture an image formed by an optical system, a first unit configured to control the optical system to adjust a focal position of the optical system, a second unit configured to control a driving unit configured to change a direction of the imaging unit through pan or tilt driving, and a storage unit configured to store distance information where the direction and a subject distance are in association with each other. The first unit calculates a shift in the subject distance in a process in which the direction is changed from a first direction to a second direction through the pan or tilt driving, based on the stored distance information, and controls the optical system in accordance with the shift in the subject distance.