A method of classifying and organizing digital images utilizing optical metadata (captured using multiple sensors on the camera) may define semantically coherent image classes or annotations. The method defines optical parameters based on the physics of vision and operation of a camera to cluster related images for future search and retrieval. An image database constructed using photos taken by at least thirty different users over a six year period on four different continents was tested using algorithms to construct a hierarchal clustering model to cluster related images. Additionally, a survey about the most frequent image classes shot by common people forms a baseline model for automatic annotation of images for search and retrieval by query keyword.