Architecture and device for multi-stream vision processing on shared devices
US10754689B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Feb 13, 2019 |
| Grant date | Aug 25, 2020 |
| Priority date | — |
| Expiry date | Feb 22, 2039 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/60
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A stream manager for managing the distribution of instructions to a plurality of processing devices includes a dispatcher module configured to: receive multiple instruction streams, wherein each instruction stream includes a plurality of requested computations for processing perception data from a perception data source; partition each instruction stream into a plurality of partitions based on type of device to perform a requested computation from the instruction stream; assign a release time and deadline to each partition, and dispatch partition computations to a plurality of scheduling queues to distribute processing of the partition computations amongst the plurality of processing devices. The plurality of scheduling queues include: a plurality of CPU schedulers, wherein each CPU scheduler is assigned to a specific CPU and a specific scheduling queue; and a plurality of accelerator schedulers, wherein each accelerator scheduler is assigned to a specific scheduling queue and a specific type of accelerator.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.