A motion vector correction unit including a correction method determination unit 40 and an inter-prediction unit 42 performs scaling processing on a motion vector of, for example, a peripheral block of a current predictive block in a fisheye image shot using a fisheye lens, on the basis of fisheye information, for example, a projection method of the fisheye lens and a radius of the fisheye image. The scaling processing performs scaling by transforming the motion vector of the peripheral block to a motion vector of an image having no fisheye distortion, and transforms the motion vector after the scaling to the motion vector in the fisheye image. By reducing a difference between a motion vector of the current predictive block and a predictive motion vector by performing the scaling processing, encoding efficiency of the fisheye image can be improved.