Configurable rate limiting using static token buckets, and applications thereof
US8681630B1 · kind B1 · utility
Assignee
Inventor
Key dates
| Filing date | Sep 9, 2011 |
| Grant date | Mar 25, 2014 |
| Priority date | — |
| Expiry date | Mar 5, 2032 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/54
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A system disclosed rate limits API requests. The system includes an API server that receives an API request from a developer application at an API server and a token bucket to rate limit API requests from the developer application. A token query translation module determines a number of tokens needed to process the API request based on a rate configured in predefined policy data for the developer application and a replenish rate of the token bucket. The number of tokens inversely corresponds to the rate configured in the predefined policy data. A token request module instructs the API server to process the API request if the token bucket has sufficient tokens and reduces the number of tokens in the token bucket for the developer application by the number of tokens needed to process the API request. In this way, the disclosed system effectively simulates buckets having configurable replenish rates.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.