Patent · US Active

Addressing data skew using map-reduce

US11531685B2 · kind B2 · utility

0Cited by
1References
20Claims
0Family size

Assignee

Inventors

Key dates

Filing dateMay 6, 2021
Grant dateDec 20, 2022
Priority date
Expiry dateJun 26, 2041

Classification

  • Technology area (CPC H)Electricity
  • CPC primaryH04L67/1095
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

A system and method includes using a queue with reduce operations. A method can include, responsive to generation of one or more markers by a first node or a second node, causing a submission of one or more markers to a queue associated with a computing cluster. Additionally, responsive to a determination that the first node has completed a first reduce operation, directing the first node to perform a first copy operation to copy first data identified by a first marker of the one or more markers in the queue, where the first copy operation is performed concurrently with the second reduce operation.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.