An image processing device, comprising: a motion vector detection unit configured to detect, from frame image data made up of frame images, motion vectors representing motion of the frame images; a modeling unit configured to model the motion vector, detected by the motion vector detection unit, to a component separation expression in which a camera motion component and a focal plane distortion component are separated, using unknown component parameters respectively representing camera motion which is motion of a camera, and the amount in change in focal plane distortion; and a component calculation unit configured to calculate the component parameters used in the component separation expression, thereby calculating the camera motion component in the motion vector.