Systems and methods are provided for automatically controlling a physical device. A tracking system monitors the locations of multiple physical objects, and their respective locations are updated in a virtual environment. Within the virtual environment, a first virtual object, corresponding to a first physical object, is paired with a dynamic zone that remains constant in shape and moves with the first virtual object. When a second virtual object, corresponding to a second physical object, enters the dynamic zone, then the physical device is triggered to act. For example, the physical device is a media projector or light that shines onto the current position of the dynamic zone, or the physical device is a robotic camera that points to the dynamic zone.