Parallelized parsing of data in cloud storage
US11914596B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | Mar 30, 2022 |
| Grant date | Feb 27, 2024 |
| Priority date | — |
| Expiry date | Mar 30, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/2379
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An example method of parsing data in a distributed computing system includes assigning a worker k to scan a data chunk k at a data storage node at which data chunk k is stored, each of one or more data chunks including a partial record, receiving, from each worker k, a number of instances of a context-varying symbol, a position in the data chunk k of a first instance of a context-dependent symbol after an even number of instances of the context-varying symbol, and a position in the data chunk k of a first instance of the context-dependent symbol after an odd number of instances of the context-varying symbol, for each data chunk that includes a partial record, computing an adjusted data chunk including data from a later data chunk to complete the partial record, parsing the adjusted data chunks and executing a query against the plurality of records.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.