Methods and apparatus for implementing cache policies in a graphics processing unit
US11610281B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 11, 2021 |
| Grant date | Mar 21, 2023 |
| Priority date | — |
| Expiry date | Jan 15, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2212/608
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method of processing a workload in a graphics processing unit (GPU) may include detecting a work item of the workload in the GPU, determining a cache policy for the work item, and operating at least a portion of a cache memory hierarchy in the GPU for at least a portion of the work item based on the cache policy. The work item may be detected based on information received from an application and/or monitoring one or more performance counters by a driver and/or hardware detection logic. The method may further include monitoring one or more performance counters, wherein the cache policy for the work item may be determined and/or changed based on the one or more performance counters. The cache policy for the work item may be selected based on a runtime learning model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.