A method and system for classifying an image as a photograph or a graphic based on a ranked prevalent color histogram feature or a ranked region size feature is provided. The prevalent color histogram feature contains counts of the colors that are most prevalent in the image sorted in descending order. The region size feature contains counts of the largest regions of the image sorted in descending order. The classification system then classifies the image based on the ranked prevalent color histogram feature and/or the ranked region size feature using a previously trained classifier.