An autonomous driving system includes a waypoint destination database storing waypoint destination data associating a type of a waypoint destination with a preset action of a vehicle. The waypoint destination is a destination that the vehicle visits before arriving at a predetermined destination. The autonomous driving system includes an electronic control unit. The electronic control unit is configured to autonomously drive the vehicle toward the predetermined destination, set the waypoint destination, present the preset action performed at the waypoint destination, to an occupant of the vehicle, based on the waypoint destination and the waypoint destination data. The electronic control unit is configured to determine whether the preset action is permitted by the occupant, and cause the autonomously driven vehicle to perform the preset action at the waypoint destination when it is determined that the preset action is permitted by the occupant.