Cloud platform based data mesh architecture for data pipelines
US12254022B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 30, 2021 |
| Grant date | Mar 18, 2025 |
| Priority date | — |
| Expiry date | Jun 30, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F8/60
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system performs continuous delivery of a data pipeline on a cloud platform. The system receives a specification of the data pipeline that is split into smaller specifications of data pipeline units. The system identifies a target cloud platform and generates a deployment package for each data pipeline unit for the target cloud platform. The system creates a connection with the target cloud platform and uses the connection to provision computing infrastructure on the target cloud platform for the data pipeline unit according to the system configuration of the data pipeline unit. The data pipeline may be implemented as a data mesh that is a directed acyclic graph of nodes, each node representing a data pipeline unit. Different portions of the data mesh may be modified independent of each other. Partial results stored in different portions of the data mesh may be recomputed starting from different points in time.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.