A method, executed by one or more processors, includes computing a saliency surface for an image, conducting a mean shift algorithm on the saliency surface to provide mean shift data for the saliency surface, producing a mode voting map for the saliency surface from the mean shift data, and classifying features in the image according to the mode voting map. The features may correspond to medical conditions. In some embodiments, computing the saliency surface comprises determining a distinctiveness score for each of a plurality of image patches. In some embodiments, producing the mode voting map comprises determining a plurality of modes and an area of influence for each mode of the plurality of modes where the area of influence corresponds to mean shift data that leads to a particular mode. A corresponding computer program product and computer system are also disclosed herein.