A system and method for mapping interpersonal relationships, the method including processing a multiplicity of images and contextual information relating thereto including creating and prioritizing a list of a plurality of candidate persons having at least a predetermined relationship with at least one person connected to at least one image, using multi-dimensional information including visually sensible information in the multiplicity of images and contextual information relating thereto and searching the list of a plurality of candidate persons based at least in part on the prioritizing to select at least one of the candidate persons as having at least a predetermined relationship with the at least one person.