An image processing device includes: a movement-amount calculating unit that calculates a movement amount of an object image between a latest frame and a past frame in the same color channel; a shake-correction-amount calculating unit that calculates a shake correction amount for the latest frame on the basis of the movement amount; a stable-shake-correction-amount calculating unit that calculates a stable shake-correction amount for the latest frame; a shake correcting unit that performs shake correction processing on the latest frame on the basis of the stable shake-correction amount; and a storage unit that stores the stable shake-correction amount, wherein the stable-shake-correction-amount calculating unit calculates the stable shake-correction amount for the latest frame on the basis of the shake correction amount for the latest frame and a stable shake-correction amount for a frame in a different color channel from the latest frame, stored in the storage unit.