A motion compensation apparatus reduces the number of pixels for reading out pixel data from the multi-frame memory, and realizes the reduction of transmission and motion compensation in sub-pixel precision pixel generation, for efficient motion compensation pixel generation. The motion compensation apparatus includes a frame memory transmission control unit which, with regard to a plurality of motion compensation blocks, transmits reference pixels required in motion compensation collectively or on a per motion compensation block basis, from a multi-frame memory which stores a reference picture used in inter-picture motion compensation prediction, to a local reference memory.