Patent · US Active

Methods and apparatus for sparse tensor storage for neural network accelerators

US12430239B2 · kind B2 · utility

0Cited by
0References
17Claims
0Family size

Assignee

Inventors

Key dates

Filing dateDec 14, 2023
Grant dateSep 30, 2025
Priority date
Expiry dateDec 14, 2043

Classification

  • Technology area (CPC Y)Emerging Cross-Sectional Technologies
  • CPC primaryY02D10/00
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

Methods, apparatus, systems and articles of manufacture are disclosed for sparse tensor storage for neural network accelerators. An example apparatus includes sparsity map generating circuitry to generate a sparsity map corresponding to a tensor, the sparsity map to indicate whether a data point of the tensor is zero, static storage controlling circuitry to divide the tensor into one or more storage elements, and a compressor to perform a first compression of the one or more storage elements to generate one or more compressed storage elements, the first compression to remove zero points of the one or more storage elements based on the sparsity map and perform a second compression of the one or more compressed storage elements, the second compression to store the one or more compressed storage elements contiguously in memory.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.