During a video conference between a local endpoint and a remote endpoint, a display at the local endpoint may be configured to provide perspective-dependent views to local video conference participants. A local endpoint may receive a plurality of video streams and identify a first video stream that provides a first view of a remote participant and a second video stream that provides a second view of that participant taken concurrently from a different angle. A display at the local endpoint may display the first video stream at a first viewing angle that only allows the first view of the remote participant to be seen from a first region. The display may also concurrently display the second video stream at a second viewing angle that only allows the second view of the remote participant to be seen from a second region different than the first region.