Systems and methods for processing images in a structured light system which may be used to determine the correspondences in a camera-projector system. Those correspondences can later be used to construct a 3D model, to calibrate a projector or for other purposes. The optical and geometric characteristics of the system are initially determined. The capability of establishing correspondences is affected by the limitations of the system and the properties of the surfaces. Once images of the patterns projected on the surface are acquired, they are iteratively segmented and deconvolved using the known characteristics of the system. The result is a set of correspondences with a reduction of artifacts introduced by the limitations of the system. The characteristics of the structured light system which may be used in the iterative segmentation and deconvolution may include the characteristics of a pattern projected on the scene or object, the physical characteristics of the structured light system, as well as the characteristics of the scene or object itself.