System and method for throttling service requests using work-based tokens
US8953453B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 15, 2011 |
| Grant date | Feb 10, 2015 |
| Priority date | — |
| Expiry date | Dec 13, 2032 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L47/215
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. An admission control mechanism may manage requests based on tokens, each of which represents a fixed amount of work. The tokens may be added to a token bucket at rate that is dependent on a target work throughput rate while the number of tokens in the bucket does not exceed its maximum capacity. If at least a pre-determined minimum number of tokens is present in the bucket when a service request is received, it may be serviced. Servicing a request may include deducting an initial number of tokens from the bucket, determining that the amount of work performed in servicing the request is different than that represented by the initially deducted tokens, and deducting additional tokens from or replacing tokens in the bucket to reflect the difference.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.