An image processing apparatus that configures a single frame by determining a central image of a certain viewpoint as an original resolution, and frame another single frame by combining a left image of a left viewpoint and a right image of a right viewpoint. The image processing apparatus may generate three-dimensional (3D) image data configured using the frames, and may encode, decode, and render an image based on the 3D image data.