An image matching device includes: a dividing unit that divides a target image, contained in a search window set within an input image constituted with pixels each having a luminance component and a chrominance component, and a template image constituted with pixels each having the luminance component and the chrominance component, each into a plurality of divided areas; a representative value calculation unit that calculates a luminance component representative value and a chrominance component representative value in correspondence to each of the divided areas; a normalizing unit that normalizes the luminance component representative value having been calculated in correspondence to each divided area; and a template matching processing unit that executes template matching processing based upon the normalized luminance component representative value and the chrominance component representative value corresponding to each of the divided areas in the template image, and upon the normalized luminance component representative value and the chrominance component representative value corresponding to each of the divided areas in the target image.