A novel and useful method of processing digital images to correct distortion caused by a sheet-fed scanner. The method of the present invention derives a model which estimates the distortion. Match points are detected in the digital image and compared to match points of pre-defined templates. Treating the relative locations of the detected match points as polar coordinates (as opposed to Cartesian coordinates) enables a model to be derived to correct the distortion. In the event that there are multiple distortions to the digital image the digital image is partitioned into segments, with a separate model derived for each segment.