A face portion of an input image, an example of a predetermined structure, is applied to a mathematical model by the image recovery/addition section to recover a missing element of the face portion in the input image. The mathematical model is generated by a predetermined statistical method, such as the AAM scheme or the like, based on a plurality of sample images representing the face portion including the recovery target element. Thereafter, the face portion is reconstructed to include the missing element based on the parameter corresponding to the face portion obtained by applying the face portion to the model, and the face portion of the input image is replaced by the reconstructed face portion to produce a restored image by the image reconstruction section.