A vehicle control system includes a first detection unit configured to detect a direction of a face or a line of sight of an occupant of a subject vehicle, an automatic driving control unit configured to execute an automatic driving control, and a switching control unit configured to switch an automatic driving mode for causing the automatic driving control unit to execute the automatic driving control to one of a plurality of automatic driving modes including a first automatic driving mode and a second automatic driving mode. The switching control unit prevents the automatic driving control executed by the automatic driving control unit on the basis of a detection result by the first detection unit.