Method and system of virtual fitting a foot with a shoe by obtaining a first and second 3D model associated with the surface of the foot and interior cavity of the shoe, respectively, each 3D model comprising a point cloud; aligning the point clouds such that the heel extreme point of the two point clouds align and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator determined based on a distance between p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the fit calculated at p.