To generate a favorable image that suppresses the occurrence of pattern noise in a method of performing patch-based noise reduction for a RAW image. In order to attain this object, the image processing apparatus of the present invention includes a pixel setting unit; a patch setting unit; and a noise reduction unit. Then, the pixel setting unit sets, for one pixel of interest, at least two kinds of pixel whose positions are different in a minimum unit of the color filter array as the plurality of reference pixels. Further, the patch setting unit sets, for one pixel of interest, at least two kinds of reference patch whose shapes are different.