An apparatus and a method of coding/decoding an image are provided. The apparatus includes: a low resolution image coding unit that codes a low resolution image corresponding to an input image using motion estimation and compensation; and a residual image coding unit that performs intra mode coding with respect to a residual image which indicates a difference between a reconstructed image of the coded low resolution image and the input image by considering temporal correlation between neighboring residual images.