A method for decreasing end-to-end delay in a video conferencing context is disclosed. At video conferencing system startup, a processor is initialized to receive either a top field or a bottom field of video frame data. If the first line of a new field arriving after initialization does not match a field state that the processor is initialized to, the present invention senses the state mismatch and adjusts a display buffer by one display line, and the field is stored in the display buffer. The display buffer is adjusted in order to preserve a vertical spatial relationship between the top and bottom fields.