Video system using dual stage attention based recurrent neural network for future event prediction
US10169656B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 28, 2017 |
| Grant date | Jan 1, 2019 |
| Priority date | — |
| Expiry date | Aug 28, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V20/44
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and devices including an imaging sensor to capture video sequences in an environment having safety concerns therein. The systems and devices further including a processor to generate driving series based on observations from the video sequences, and generate predictions of future events based on the observations using a dual-stage attention-based recurrent neural network (DA-RNN). The DA-RNN includes an input attention mechanism to extract relevant driving series, an encoder to encode the extracted relevant driving series into hidden states, a temporal attention mechanism to extract relevant hidden states, and a decoder to decode the relevant hidden states. The processor further generates a signal for initiating an action to machines to mitigate harm to items.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.