Dynamic token bucket method adaptive to opaque server limits
US11463362B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 7, 2022 |
| Grant date | Oct 4, 2022 |
| Priority date | — |
| Expiry date | Mar 7, 2042 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L2463/00
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A method and system for reducing triggering of throughput penalties imposed on a group of users by a software-as-a-service (SaaS) server due to Application Programming Interface (API) calls exceeding limits of the SaaS server is disclosed. The approaches include actions of intercepting requests to the SaaS server from a user group and monitoring both a rate of API calls for the requests and a rate of API events generated by forwarding the API calls to the SaaS server, intercepting the SaaS server's responses, where some of the responses indicate a throughput penalty imposed by the server, inferring load conditions of the SaaS server by analyzing the varying rate of API events against the responses with imposition of throughput penalty and setting an API call throttle limit dynamically adaptive to the inferred load conditions, then throttling the rate of the API calls for the group's requests according to the throttle limit.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.