Aspects of the present invention comprise generating and using Multi-Order Contextual co-Occurrence (MOCO) descriptors to implicitly model the high level context using detection responses from a baseline object detector. In embodiments, a 1st-order context feature is computed as a set of randomized binary comparisons on a response map of the baseline object detector. The statistics of the 1st-order binary context features are further calculated to construct a higher-order co-occurrence descriptor, which, in embodiments, may be combined with other features such as the 0th-order context features and/or the 1st-order features to form the MOCO. In embodiments, combining the MOCO feature with the original image feature, the baseline object detector may be evolved to a stronger context aware detector.