Method for creating efficient application on heterogeneous big data processing platform
US10387454B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 2, 2016 |
| Grant date | Aug 20, 2019 |
| Priority date | — |
| Expiry date | Aug 22, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/21
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
This invention relates to a method and system for creating Big Data applications that can be executed on heterogeneous clusters. The applications can be executed on a particular platform, such as SPARK or UIMA-AS, but the method and system are able to translate the input to these targeted platforms without the developer needing to tailor the application specifically to the platform. The method and system are based on the use of an execution dependency graph, a cluster configuration, and a data size to create a stages table. The stages table is then optimized to increase the overall efficiency of the heterogeneous cluster. The stages table is then translated into a platform specific Big Data application.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.