A vehicle control system includes: a possible user determination section that allows a first camera having a first resolution to capture an image around a vehicle to determine whether or not the captured image includes a possible facial image of a user; a user determination section that allows a second camera having a second resolution which is higher than the first resolution and consuming more power than the first camera to capture an image around the vehicle to determine whether or not the captured image includes a facial image of the user in a case where the possible user determination section determines that the possible facial image of the user is included; and an entry permission section that permits the user to enter the vehicle in a case where the user determination section recognizes that the facial image of the user is included.