An encoding device that, when encoding frame image groups which represent scenes respectively viewed from plurality of viewpoints over predetermined time period, generates base-view video stream by encoding frame image group of standard viewpoint without using, as reference image, any frame image of other viewpoints, generates first-type dependent-view video stream by encoding frame image group of first-type viewpoint by using, as reference image, frame image of same time of base-view video stream or of another first-type dependent-view video stream, first-type viewpoint being positioned such that at least one viewpoint is present between first-type viewpoint and standard viewpoint, and generates second-type dependent-view video stream by encoding frame image group of second-type viewpoint by using, as reference images, frame images of same time of two viewpoints sandwiching second-type viewpoint, second-type viewpoint being neither standard viewpoint nor first-type viewpoint.