An apparatus and method of processing three-dimensional (3D) images on a multi-layer display may generate virtual depth information based on original depth information, and display 3D images having various depth values using the generated virtual depth information. Also, the apparatus and method may appropriately provide color information to each of a plurality of display layers, thereby preventing an original image from being damaged.