A computer implemented method, apparatus, and computer program product for generating video based cohorts. Digital video data is processed to identify a set of size and shape based attributes associated with the set of objects. The digital video data comprises metadata describing the set of objects. A size and shape attribute comprises an attribute describing a shape associated with a portion of an object or a size measurement of the portion of the object. The set of size and shape based attributes are analyzed using cohort criteria to form a result. The cohort criteria specify attributes that are associated with members of a given cohort. A set of cohorts is generated based on the result. Each cohort in the set of cohorts comprises a subset of objects from the set of objects that share at least one size and shape based attribute in common.