A video scan converter processes a video stream including a first coding unit, which has been obtained by encoding a pair of fields N1 and N2 that has come from a first frame of film video, and a second coding unit, which has been obtained by encoding a pair of a field N3 that has also come from the first frame and a field M1 that has come from a second frame, not the first frame. The video scan converter includes: a decoder, which receives the video stream, decodes the first and second coding units, and sequentially outputs the data of the respective fields N1, N2, N3 and M1; and a scan converter, which generates a frame based on associated two of those fields that have been supplied from the decoder. In outputting a frame associated with the field N3, the scan converter generates the frame based on the fields N1 and N2 without using the data of the field N3.