A system and method matches individuals based on the content of their media libraries. The system has a media content processor that extracts information from a media file, and creates one or more media records. The system further includes a matching engine that compares the media records associated with different people, and determines the similarities between the media libraries of the different people. The matching engine may generate a match score for each pair of media records. The system also includes a presentation engine that provides an indication of the degree of match between the media file of one person and the media files of others.