Learning-based data processing job performance modeling and prediction
US9766996B1 · kind B1 · utility
5Cited by
0References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Nov 26, 2013 |
| Grant date | Sep 19, 2017 |
| Priority date | — |
| Expiry date | Dec 20, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/00
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A generic performance model is generated for a program job, wherein the program job executes one or more map tasks in a map phase and one or more reduce tasks in a reduce phase in a distributed computing system. The generic performance model is trained to generate a trained performance model based on historical performance of the program job and a set of one or more program job-specific parameters. Performance of a subsequent execution of the program job is predicted based on the trained performance model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.