Adaptive resource scheduling for data stream processing
US10554577B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 14, 2017 |
| Grant date | Feb 4, 2020 |
| Priority date | — |
| Expiry date | Oct 12, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/5038
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
In at least one embodiment of stream processing in a data processing system cluster, a driver requests, from a cluster manager, execution of a first task within a job including a plurality of tasks, as well as a first quantity of resources of the cluster to support execution of the task. At completion of execution of the first task by the cluster, the driver retains for a second task among the plurality of tasks at least a portion of the resources allocated to the first task by the cluster manager. The driver determines a second quantity of the resources to retain for the second task based on a relative priority of the job to other jobs in the cluster and efficiency of the cluster manager in allocating resources to the first task.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.