An object recognition system in which fall of the recognition rate is suppressed when an object is recognized based on an image even if there is a partial concealment and the object can be recognized even if the region of concealment is large with large calculation amount. With regard to each of a plurality of partial regions of an object image, partial recognition score of recognition object category is determined by judging whether it is a recognition object category or not. Under a condition that it is a recognition object category, total score is calculated using the total product of nonoccurrence probability of the partial recognition score, and a judgment is made that the object is not a recognition object category by that total score.