A method and system for reducing the appearance of jaggies when deinterlacing moving edges in a video processing system are provided. The method may comprise detecting the direction of an angled edge in an interlaced video image to determine a filtering direction to be used for approximating absent pixels in deinterlacing the interlaced video. In detecting the direction of the angled edge, a group of windows of different sizes may be used to look at the edge, where a missing pixel is the center of each of the windows. Detecting the direction of the edge, and therefore the direction of filtering, may comprise: determining the angle associated with the edge, determining the strength of the edge, examining the pixels surrounding the absent pixel, and adjusting the first angle measure and the second angle measure based on the pattern of the surrounding pixels.