Provided is a paper sheet recognition device for recognizing a fitness and authenticity of paper sheets, by which recognition of types, authenticity, and fitness of paper sheets can be effectively performed even in the case where a large number of features should be evaluated. The paper sheet recognition device is provided with a paper sheet information acquisition unit which acquires paper sheet information which is the information relating to paper sheets, a type recognition unit which recognizes the types of the paper sheets on the basis of the paper sheet information, a fitness recognition unit which recognizes fitness of the paper sheets on the basis of the paper sheet information, and an authenticity recognition unit which recognizes the authenticity of the paper sheets on the basis of the paper sheet information, wherein the fitness recognition process of the paper sheets by the fitness recognition unit and the authenticity recognition process of the paper sheets by the authenticity recognition unit are performed in parallel.