A moving image recording/playback device records a moving image of a subject. In the case of recording, the moving image recording/playback device sequentially outputs a plurality of image frames that constitute the moving image at a predetermined frame rate and, for the plurality of image frames, records whole image frames at intervals of a predetermined number of frames and partly records other image frames, onto at least one recording medium. In the case of playback, when reading a partly recorded image frame, the moving image recording/playback device generates a display frame from the partly recorded image frame and a recorded whole image frame.