Methods and apparatus for detecting and removing poorly conditioned points in bundle adjustment. A detection technique may be used to detect poorly conditioned points during the bundle adjustment process or portion of a feature-based 3D reconstruction pipeline. Once the poorly conditioned points are detected, the technique removes the points from the bundle adjustment process. The technique detects and removes the poorly conditioned points before the optimization is performed, and therefore ensures that the optimization will be successful.