An image comprising varying illumination is selected. Patches of pixels from among the plurality of pixels with the image are identified. Similarities between pairs of patches of pixels based on pixel intensities associated with the pairs of patches of pixels are calculated. Illumination values for the plurality of pixels within the image based on the calculated similarities between the pairs of patches of pixels is calculated. The illumination variation from the image is removed based on the calculated illumination values for the plurality of pixels within the image.