A virtual reality baseball system uses a virtual reality device to present a simulated pitch to a batter. The system also includes sensors that are attached to a bat, and optionally external sensors, that sense movement of the bat. The system will generate and present a simulated pitch from a selected pitcher. The simulated pitch simulates attributes of a pitch of the selected pitcher that correspond to a particular batting simulation scenario. The sensors are configured to track movement of bat when a user swings at the simulated pitch.