A method, system, and computer-readable storage medium for categorizing digital images. A plurality of semantic category scores for a digital image are determined via application of a corresponding plurality of classifiers. A semantic category profile for the image is automatically determined based on the plurality of semantic category scores, where the semantic category profile characterizes semantic content of the image, and is useable to perform semantic based operations with respect to the image.