This document describes systems, methods, and apparatus for determining a time budget for transcoding a video. By calculating and/or monitoring the time budget in accordance with the teachings hereof, a transcoder can assess the effect its transcode duration will have on a client buffer. As a result the transcoder may adjust its processing of the video. The teachings hereof are applicable, without limitation, to the transcoding of live video.