An apparatus is provided for determining motion between a first and second video image. The apparatus includes an input device for receiving the first and the second video image with a plurality of pixels, a block selector for selecting a block of pixels within the first video image, a search area selector for selecting at least part of the second video image to produce a search area, a sampler for sampling the pixels of the search area in a predetermined pattern and a comparator for comparing the selected block of pixels within the first video image with at least one block of the sampled pixels of the search area to determine the motion of the block of pixels between the images. The pattern of sampled pixels varies throughout the search area.