Systems and methods for fast and effective grouping of stream of information into cloud storage files
US11200258B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 12, 2018 |
| Grant date | Dec 14, 2021 |
| Priority date | — |
| Expiry date | Nov 22, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/24568
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A new approach is proposed to support grouping and storing a data stream based on the types of data items in the stream for efficient data batch processing and analysis. First, the data stream is uploaded to a cloud storage, wherein the stream of data includes a plurality of data items of different types generated by and collected from different users and/or devices. The data items are then retrieved, grouped and saved by a preprocessing unit into a plurality of batch data queues, wherein data items in each batch data queue are of the same type. One or more batch processing units are then configured to fetch and batch process data items from the batch data queues and store these data items of the same data type to one or more cloud storage files for further processing and analysis on the cloud storage one batch data queue at a time.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.