Software-defined buffer/transposer for general matrix multiplication in a programmable IC

US11036827B1 · kind B1 · utility

Assignee

• XILINX, INC. · US

Inventors

• Jindrich Zejda · Saratoga, US
• Elliott Delaye · San Jose, US
• Yongjun Wu · Redmond, US
• Aaron Ng · San Jose, US
• Ashish Sirasao · San Jose, US
• Khang K. Dao · San Jose, US

Key dates

• Filing date: Oct 17, 2017
• Grant date: Jun 15, 2021
• Expiry date: Apr 1, 2038

Classification

• Technology area (CPC G): Physics
• CPC primary: G06N3/063
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Methods and apparatus are described for simultaneously buffering and reformatting (e.g., transposing) a matrix for high-speed data streaming in general matrix multiplication (GEMM), which may be implemented by a programmable integrated circuit (IC). Examples of the present disclosure increase the effective double data rate (DDR) memory throughput for streaming data into GEMM digital signal processing (DSP) engine multifold, as well as eliminate slow data reformatting on a host central processing unit (CPU). This may be accomplished through software-defined (e.g., C++) data structures and access patterns that result in hardware logic that simultaneously buffers and reorganizes the data to achieve linear DDR addressing.