An image processing apparatus which processes a captured image including angle information of a light beam traveling from the object, comprises a generation unit configured to generate a reconstructed image by reconstructing the captured image, an extraction unit configured to extract an address of a defective photoelectric conversion element which is included in photoelectric conversion elements which captured the captured image based on a plurality of reconstructed images corresponding to different imaging distances.