Mission-critical AI processor with record and replay support

US10747631B2 · kind B2 · utility

Assignee

• DINOPLUSAI HOLDINGS LIMITED · US

Inventors

• Yujie Hu · Fremont, US
• Tong Wu · Västerås, SE
• Xiaosong Wang · Rockville, US
• Zongwei Zhu · Sunnyvale, US
• Chung Kuang Chin · Saratoga, US
• Clifford M. Gold · Fremont, US
• Steven Sertillange · San Leandro, US
• Yick Kei Wong · Union City, US

Key dates

• Filing date: Jun 5, 2018
• Grant date: Aug 18, 2020
• Expiry date: Jan 16, 2039

Classification

• Technology area (CPC Y): Emerging Cross-Sectional Technologies
• CPC primary: Y02D10/00
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Embodiments described herein provide a mission-critical artificial intelligence (AI) processor (MAIP), which includes an instruction buffer, processing circuitry, a data buffer, command circuitry, and communication circuitry. During operation, the instruction buffer stores a first hardware instruction and a second hardware instruction. The processing circuitry executes the first hardware instruction, which computes an intermediate stage of an AI model. The data buffer stores data generated from executing the first hardware instruction. The command circuitry determines that the second hardware instruction is a hardware-initiated store instruction for transferring the data from the data buffer. Based on the hardware-initiated store instruction, the communication circuitry transfers the data from the data buffer to a memory device of a computing system, which includes the mission-critical processor, via a communication interface.