An approach for responding to a text-based query for a digital image is provided. A request that identifies one or more keywords is received. A number of annotated digital images are selected based on a previously determined optimum quantity of annotated digital images. Composite data is gathered from each annotated digital image and a set of candidate digital images is selected based on the composite data. The set of candidate images are the digital images, of a set of digital images, which have a visual appearance that is most similar to the composite data. A response is generated that identifies those digital images which are most responsive to the one or more keywords. Alternatively, a partitioned response is generated which identifies dissimilar sets of digital images.