There is provided stream generating apparatus which generates a multiplexed stream including moving picture data. The apparatus includes a moving picture encoding processing section for generating a moving picture stream by encoding the moving picture data allowing switching between a reference frame rate and more than one frame rate different from the reference frame rate according to a desired timing; a time control information generating section for generating playback time control information with certain intervals corresponding to picture frame display cycles relevant to the reference frame rate, for each picture frame inputted to the moving picture encoding processing section; and a multiplexing processing section for generating the multiplexed stream by multiplexing the moving picture stream and the playback time control information.