Per-node custom code engine for distributed query processing
US11487771B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 7, 2016 |
| Grant date | Nov 1, 2022 |
| Priority date | — |
| Expiry date | Feb 2, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/24568
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Distributed query processing is often performed by a set of nodes that apply MapReduce to a data set and materialize partial results to storage, which are then aggregated to produce the query result. However, this architecture requires a preconfigured set of database nodes; can only fulfill queries that utilize MapReduce processing; and may be slowed down by materializing partial results to storage. Instead, distributed query processing can be achieved by choosing a node for various portions of the query, and generating customized code for the node that only performs the query portion that is allocated to the node. The node executes the code to perform the query portion, and rather than materializing partial results to storage, streams intermediate query results to a next selected node in the distributed query. Nodes selection may be involve matching the details of the query portion with the characteristics and capabilities of the available nodes.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.