Adaptive cloud request handling
US11153374B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 6, 2020 |
| Grant date | Oct 19, 2021 |
| Priority date | — |
| Expiry date | Nov 6, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2209/508
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A cloud computing system receives a plurality of requests originating from a plurality of tenants. Thereafter, a load balancer forming part of the cloud computing system dispatches each request to one of a plurality of groups of servers based on a group mapping table configured to optimize a cache hit ratio. Each group of servers includes a plurality of servers dispatching each request to one of the plurality of servers within each group of servers. The cloud computing system provides responses to the requests to the respective tenants as generated by the respective servers within the respective groups of servers. The group mapping table can be generated by monitoring historical request statistics for each of the tenants, monitoring current resource consumption by the plurality of groups of servers when handling requests from the tenants, and associating each tenant with one of the groups of servers based on such monitoring.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.