Method and apparatus for estimating a completion time for mapreduce jobs
US9612876B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 19, 2013 |
| Grant date | Apr 4, 2017 |
| Priority date | — |
| Expiry date | Oct 24, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2209/5013
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method, non-transitory computer readable medium, and apparatus for estimating a completion time for a MapReduce job are disclosed. For example, the method builds a general MapReduce performance model, computes one or more performance characteristics of each one of one or more benchmark workloads, computes one or more performance characteristics of the MapReduce job in the known processing system, selects a subset of the one or more benchmark workloads that have similar performance characteristics as the one or more performance characteristics of the MapReduce job, targets a cluster of processing nodes in a distributed processing system, computes one or more performance characteristics of the subset of the one or more benchmark workloads in the cluster of processing nodes and estimates the completion time for the MapReduce job.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.