A video predictive encoding device includes an input module to receive pictures forming a video sequence, and an encoding module to encode the pictures by either intra prediction or inter prediction to generate compressed picture data, and to packetize the compressed image data along with packet header information. The packet header information includes a picture type. The encoding module determines the picture type so as to uniquely indicate whether encoded picture data is used for reference in decoding of another picture.