Hybrid parallelization strategies for machine learning programs on top of mapreduce
US10228922B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 12, 2016 |
| Grant date | Mar 12, 2019 |
| Priority date | — |
| Expiry date | Jan 12, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/4881
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Parallel execution of machine learning programs is provided. Program code is received. The program code contains at least one parallel for statement having a plurality of iterations. A parallel execution plan is determined for the program code. According to the parallel execution plan, the plurality of iterations is partitioned into a plurality of tasks. Each task comprises at least one iteration. The iterations of each task are independent. Data required by the plurality of tasks is determined. An access pattern by the plurality of tasks of the data is determined. The data is partitioned based on the access pattern.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.