Invention Grant
- Patent Title: Allocation of workloads in dynamic worker fleet
-
Application No.: US17209008Application Date: 2021-03-22
-
Publication No.: US11863613B1Publication Date: 2024-01-02
- Inventor: Mihir Sathe , Aravind Srinivasan , Pranav Rao Perampalli Nekkar
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Agency: Knobbe, Martens, Olson & Bear, LLP
- Main IPC: H04L67/1008
- IPC: H04L67/1008

Abstract:
Systems and methods are described for allocating requests to implement new workloads within a dynamic set of servers. Existing load balancing techniques can result in “focus firing” on new servers added to the set, since a load balancer may view a new server as underloaded. With sufficient intensity, focus firing can result in overshooting target load for the new server, and the new server in fact becoming overloaded. The present disclosure modifies selection of servers as potential targets for a workload by at least partly biasing against selection of young servers. The bias imposed can be scaled to avoid overloading new servers.
Information query
IPC分类: