The present invention discloses a method to generate a stereoscopic video pair which can be used in the field of multimedia communication. A stereoscopic video pair can be obtained after processing a stereoscopic video sequence by using display auxiliary information. The stereoscopic video pair is displayed on a stereoscopic display D1. The display auxiliary information comprises camera viewpoint position information, virtual viewpoint position information and display scaling factor S1. The camera viewpoint position information indicates the position of a camera viewpoint C of a three-dimensional video sequence. The virtual viewpoint position information indicates the position of a virtual viewpoint P1. The display scaling factor S1 indicates the ratio of horizontal resolution Res1 to horizontal width W1 of the stereoscopic display D1, i.e., S1=Res1/W1, where the horizontal width is the approximation of actual display screen width. The present invention also discloses the corresponding stereoscopic video pair generation apparatus. The present invention can improve visual experience of stereoscopic viewing.