Data model driven design of data pipelines configured on a cloud platform
US11343142B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 13, 2021 |
| Grant date | May 24, 2022 |
| Priority date | — |
| Expiry date | Aug 13, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F8/60
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system performs continuous delivery of a data pipeline on a cloud platform. The system receives a specification of the data pipeline comprising data pipeline units. The system generates a deployment package for each data pipeline unit for a cloud platform. The system provisions computing infrastructure on the cloud platform according to the system configuration of the data pipeline unit. The data pipeline may be implemented as a data mesh. The data pipeline generates one or more data models. The system receives a schema representing a modification in a data model based on a change in the requirements of a consumer system. The system determines the changes to the data pipeline based on the received schema and reconfigures the data pipeline to generate the modified data model. The system manages access control of data to minimize the exposure to data in case of accidental or malicious data breach.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.