Streaming architecture for improved fault tolerance
US12261755B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 22, 2023 |
| Grant date | Mar 25, 2025 |
| Priority date | — |
| Expiry date | Sep 22, 2043 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L65/60
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
In conventional networked computing systems, stream-processing software is utilized to handle real-time data feeds. For example, a stream-processing software may sort incoming data feeds into data logs, which are then consumed by various application servers within the computing system. However, this consumption process is susceptible to failure as application servers often fail to consume a full payload of data comprising a particular message. As such, a need exists for a streaming architecture with improved fault tolerance. The system provided herein solves the problem via a reliable streaming process, which regularly generates partitions within a series of data lakes. As streaming data is received, the payloads are synced into the different data lakes based on metadata associated with the streaming data. The system can then perform individual quality checks on each partition of data, enabling the system to continuously monitor data quality over time.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.