Autonomous vehicles are requested to execute a route from an origin location to a destination location. The route specifies one or more waypoints between the origin location and the destination location, with the autonomous vehicle requested to transit from the origin location to the destination location via the waypoints. Some autonomous vehicles vary their route and do not necessarily visit each of the specified waypoints along the route. To improve adherence to the waypoints specified in the route, an arranger assigns a weight to each of the waypoints. The weight is used to score the vehicle's performance of the route based at least in part on whether the vehicle visited each of the waypoints and the weight associated with each of the waypoints. The score is used to control dispatch of additional service requests to the autonomous vehicle or other autonomous vehicles operated by the same operator or manufacturer.