A method for conserving memory accesses in motion compensation of compressed video gathers a plurality of motion compensation data accesses into a single bounding box for direct memory access data transfer. The method places the motion compensation data of a current macroblock into a current bounding box until placing the motion compensation data into the current bounding box causes the ratio of motion compensation data to bounding box data to fall below a predetermined memory utilization threshold.