A displacement measurement system including a coherent light source, a two-dimensional grating, a photo sensor, and a signal processing apparatus is provided. After the coherent light beam enters the two-dimensional grating, a zero-order light beam and a plurality of first-order diffraction beams are generated. The zero-order light beam interferes with two of the first-order beams in different directions, so that corresponding interference fringes are formed on the photo sensor. Accordingly, when the two-dimensional grating moves, displacements of the two-dimensional grating in the different directions are obtained by calculating phase differences of the interference fringes in the corresponding directions. Besides, when the two-dimensional grating rotates, the rotational angle of the two-dimensional grating is obtained from the corresponding rotational angle of a diffraction pattern of the first-order diffraction beams.