A motion stabilization system including a filter bank and motion stabilization logic. The filter bank receives a video signal and provides at least one high frequency sub-band signal which includes edge information of the video signal. The motion stabilization logic receives the high frequency sub-band signal, a reference image, and the video signal and provides a stabilized image. The reference image is generated from image stabilization information developed during motion processing. The motion stabilization system may include an edge detector which receives and binarizes the high frequency sub-band signal. Binarization significantly reduces the amount of information to be processes by the motion stabilization logic. The motion stabilization system may further include a tile buffer which stores a portion of the video signal and which provides a video signal portion to the filter bank. The filter bank may be implemented as a discrete wavelet transformation filter.