A method and apparatus for providing community based metadata is disclosed. In one embodiment, the method comprises the steps of detecting an object in a frame of media program, transmitting first data comprising the frame of the media program having the detected object to display device for presentation to a user, receiving second data comprising user entered metadata associated with the identified object, tracking the object across proximate frames of the media program, associating the entered metadata with the object in at least one of the proximate frames of the media program, and storing the associated entered metadata.