Method and system for allocating on-chip memory of neural processing unit
US12229595B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | May 23, 2024 |
| Grant date | Feb 18, 2025 |
| Priority date | — |
| Expiry date | May 23, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/063
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for allocating on-chip memory of a neural processing unit is performed by one or more processors, and includes deallocating an allocated chunk in an on-chip memory area, which is finished with the use of the memory, and converting it into a cached chunk, receiving an on-chip memory allocation request for specific data, determining whether there is a cached chunk of one or more cached chunks that is allocable for the specific data, based on a comparison between a size of the specific data and the size of the one or more cached chunks, and based on a result of determining whether there is the cached chunk that is allocable for the specific data, allocating the specific data to a specific cached chunk of the one or more cached chunks, or allocating the specific data to at least a portion of the free chunk.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.