Directing queries to nodes of a cluster of a container orchestration platform distributed across a host system and a hardware accelerator of the host system
US11436054B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 5, 2021 |
| Grant date | Sep 6, 2022 |
| Priority date | — |
| Expiry date | Apr 5, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2209/501
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Example implementations relate to edge acceleration by offloading network dependent applications to a hardware accelerator. According to one embodiment, queries are received at a cluster of a container orchestration platform. The cluster includes a host system and a hardware accelerator, each serving as individual worker machines of the cluster. The cluster further includes multiple worker nodes and a master node executing on the host system or the hardware accelerator. A first worker node executes on the hardware accelerator and runs a first instance of an application. A distribution of the queries is determined among the worker machines based on a queuing model that takes into consideration the respective compute capacities of the worker machines. Responsive to receipt of the queries by the host system or the hardware accelerator, the queries are directed to the master node or one of the worker nodes in accordance with the distribution.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.