Disclosed is a method for processing an image on the basis of an intra-prediction mode and an apparatus therefor. The method for processing an image on the basis of an intra-prediction mode includes generating a prediction sample by performing intra-prediction on a processing block of the image, generating a sub-sampled prediction sample by sub-sampling the prediction sample, and generating an up-sampled prediction sample by up-sampling the sub-sampled reconstructed sample.