Performing automatic map reduce job optimization using a resource supply-demand based approach
US10013289B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 28, 2016 |
| Grant date | Jul 3, 2018 |
| Priority date | — |
| Expiry date | Jun 11, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/5066
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Determining optimum values for Map Reduce parameters by identifying parameters that affect performance of a Map Reduce job, determining a relationship between each of the identified parameters and a maximization of resource utilization for a plurality of computing resources configured for executing the Map Reduce job, representing a workflow based upon supply-demand relationships among the plurality of computing resources, modeling an execution cost as a function of the plurality of identified parameters, formulating a non-linear programming problem to minimize the execution cost, reformulating the non-linear programming problem as a linear programming problem, and solving the linear programming problem to determine a combination of parameter values for the plurality of identified parameters that minimizes the execution cost for the Map Reduce job.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.