Device and a method for processing data sequences using a convolutional neural network

US11521059B2 · kind B2 · utility

Assignee

• APTIV TECHNOLOGIES AG · BB

Inventors

• Weimeng Zhu · Wuppertal, DE
• Yu Su · Wuppertal, DE
• Christian Nunn · Hückeswagen, DE

Key dates

• Filing date: Apr 3, 2019
• Grant date: Dec 6, 2022
• Expiry date: Oct 6, 2041

Classification

• Technology area (CPC G): Physics
• CPC primary: G06V10/82
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.