Invention Grant
- Patent Title: Load balancing technique selection based on estimated load
-
Application No.: US16892113Application Date: 2020-06-03
-
Publication No.: US11381639B1Publication Date: 2022-07-05
- Inventor: Terence Smith , Paul Derek DeMarco , Michael Shane Thyssen , Christopher Keakini Kaulia , Chaitanya Avinash Kulkarni
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Agency: Kowert, Hood, Munyon, Rankin & Goetzel, P.C.
- Agent Robert C. Kowert
- Main IPC: H04L67/1001
- IPC: H04L67/1001 ; H04L47/125

Abstract:
Request routing in a network of computing devices. Back-end nodes associated with a request router send load reports to request routers. To select a back-end node for processing a request, a request router determines, based on the reports, estimated loads and corresponding errors of the estimated loads for respective nodes. A load balancing technique may be selected, based on the estimated loads and corresponding errors (e.g., round robin may be selected if the significance of an average error outweighs the difference between estimated load values for the nodes, or least estimated load may be selected of the difference between load values is greater than the average error). The selected technique is applied to choose one of the nodes to process the request. Load probability distribution may also be used for request routing, in combination with or separate from the selection based on the estimated loads.
Information query