A simulated reality system is disclosed herein. The simulated reality system receives information from the sensor determinable as at least one of a position or orientation of a user of the device. The simulated reality system transmits the information to the simulated reality environment generator for converting the information to a corresponding avatar position or orientation within the simulated reality environment and for subsequent transmission of the avatar position or orientation within the simulated reality environment to at least one of a second device or simulated reality device. The handheld device receives information from the simulated reality environment generator. The information corresponds to the viewing perspective of the avatar in the simulated reality environment for display on the viewing device.