An image processing apparatus for searching for a feature point by use of a depth image and a method thereof are provided. The image processing apparatus includes an input unit configured to input a three-dimensional image having depth information, a feature point extraction unit configured to obtain a designated point from an object image extracted from the depth image to obtain a feature point that is located at a substantially farthest distance from the designated point, and to obtain other feature points that are located at substantially farthest distances from feature points that are previously obtained as well as the designated point. The apparatus includes a control unit configured to control the input unit and the feature point extraction unit so that time in estimating a structure of the object is reduced, and a recognition result is enhanced.