Lossless tiling in convolution networks—section cuts

US12210953B2 · kind B2 · utility

Assignee

• SambaNova Systems, Inc. · US

Inventors

• Tejas Nagendra Babu Nama · Sunnyvale, US
• Ruddhi Chaphekar · Santa Clara, US
• Ram Sivaramakrishnan · San Jose, US
• Raghu Prabhakar · San Jose, US
• Sumti Jairath · Santa Clara, US
• Junjue Wang · San Mateo, US
• Kaizhao Liang · Palo Alto, US
• Adi Fuchs · Princeton Colonial Park, US
• Matheen Musaddiq · Austin, US
• Arvind Krishna Sujeeth · San Francisco, US

Key dates

• Filing date: Mar 4, 2022
• Grant date: Jan 28, 2025
• Expiry date: Oct 29, 2042

Classification

• Technology area (CPC G): Physics
• CPC primary: G06N3/082
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A data processing system receives a graph that includes a sequence of layers and executes graph cuts between a preceding layer in the graph and a succeeding layer in the graph that succeeds the preceding layer. The preceding layer generates a set of tiles on a tile-by-tile basis and the succeeding layer processes a tensor that includes multiple tiles in the set of tiles. Thus the graph is partitioned into a sequence of subgraphs, and a subgraph in the sequence of subgraphs including a sub-sequence of layers in the sequence of layers. One or more configuration files is generated to configure runtime logic to execute the sequence of subgraphs and the one or more configuration files are stored on a computer-readable media.