Techniques for displaying a multiuser augmented reality world on a first augmented reality device. Embodiments capture a visual scene for display. The visual scene includes a first user and wherein the visual scene is captured using one or more camera devices. Visual scene data for a second user is received from a second augmented reality device. Embodiments rendering a sequence of frames for display which depict the first user and the second user in an augmented reality world, where the depiction of the first user is based on the captured visual scene, and where the depiction of the second user is based on the received visual scene data.