An image processing apparatus includes: a first judging unit that determines an unnecessary candidate region, on a basis of first feature data based on color information of an intraluminal image; and a second judging unit that judges whether the unnecessary candidate region is an unnecessary region, based on second feature data, which is different from the first feature data, of the unnecessary candidate region.