A focus estimating device has an area setting unit which sets an area in which focusing of an image is determined and divides the area into a plurality of blocks, a block selecting unit which selects a block to be used for focus determination, a block focus determination unit which performs focus determination for each block from an edge in each color component of the block selected by the block selecting unit, and a focus determination unit which determines focusing of the area based on the focus determination.