Control of data transfer between processing nodes
US11886934B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 14, 2020 |
| Grant date | Jan 30, 2024 |
| Priority date | — |
| Expiry date | Sep 18, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/098
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A data processing system comprising a plurality of processing nodes, each comprising at least one memory configured to store an array of data items, wherein each of the plurality of processing nodes is configured to execute compute instructions during a compute phase and following a precompiled synchronisation barrier, enter at least one exchange phase. During the at least one exchange phase, a series of collective operations are carried out. Each processing node is configured to perform a reduce scatter collective in at least one first dimension. Using the results of the reduce scatter collective, each processing node performs an allreduce in a second dimension. The processing nodes then perform an all-gather collective in the at least one first dimension using the results of the allreduce.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.