Systems and methods for quantifying a shift of an anatomical object of a patient are provided. A 3D medical image of an anatomical object of a patient is received. An initial location of landmarks on the anatomical object in the 3D medical image is determined using a first machine learning network. A 2D slice depicting the initial location of the landmarks is extracted from the 3D medical image. The initial location of the landmarks in the 2D slice is refined using a second machine learning network. A shift of the anatomical object is quantified based on the refined location of the landmarks in the 2D slice. The quantified shift of the anatomical object is output.