Local multicast in single-host multi-GPU machine for distributed deep learning systems
US10614356B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 24, 2017 |
| Grant date | Apr 7, 2020 |
| Priority date | — |
| Expiry date | May 17, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2212/65
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A network interface controller of a machine receives a packet including at least one model parameter of a neural network model from a server. The packet includes a virtual address associated with the network interface controller, and the machine further includes a plurality of graphics processing units coupled to the network interface controller by a bus. The network interface controller translates the virtual address to a memory address associated with each of the plurality of graphics processing units. The network interface controller broadcasts the at least one model parameter to the memory address associated with each of the plurality of graphics processing units.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.