Distributed pipeline optimization for data preparation
US11169978B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 14, 2015 |
| Grant date | Nov 9, 2021 |
| Priority date | — |
| Expiry date | Oct 2, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/2379
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Distributed pipeline optimization for data preparation includes receiving a specification of a set of sequenced operations to be performed on a set of organized data. It further includes dividing the set of data into a plurality of work portions based on a cost function that is dependent on at least one dimension of the set of data. It further includes distributing the plurality of work portions to a plurality of processing nodes to be processed according to the specification of operations.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.