Data processing pipeline failure recovery
US11379308B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 10, 2018 |
| Grant date | Jul 5, 2022 |
| Priority date | — |
| Expiry date | Mar 24, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2201/82
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques are disclosed for re-executing a data processing pipeline following a failure of at least one of its components. The techniques may include a syntax for defining a compute graph associated with the data processing pipeline and receiving such a compute graph in association with a specific data processing pipeline. The technique may include executing the data processing pipeline, determining that a component of the data processing pipeline failed, and determining a portion of the data processing pipeline to execute/re-execute based at least in part on dependencies defined by the data processing pipeline in association with the failed component. Re-executing the one or more components may comprise retrieving an output saved in association with a component upon which the failed component depends.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.