The present invention relates to an image object category recognition method and device. The recognition method comprises an off-line autonomous learning process of a computer, which mainly comprises the following steps: image feature extracting, cluster analyzing and acquisition of an average image of object categories. In addition, the method of the present invention also comprises an on-line automatic category recognition process. The present invention can significantly reduce the amount of computation, reduce computation errors and improve the recognition accuracy significantly in the recognition process.