A multi-user virtual reality and/or augmented reality cluster system enabling the projection and tracking of users in a simulated environment is described. The disclosed cluster system enables both timely user action display in the first person and a timely view of a user's action by other participants of the simulation. The cluster system integrates motion capture cameras, distributed computing, and tracking devices to provide a simulation which seems lifelike to all participants and observers.