System and method for training a convolutional neural network and classifying an action performed by a subject in a video using the trained convolutional neural network
US10867184B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 20, 2019 |
| Grant date | Dec 15, 2020 |
| Priority date | — |
| Expiry date | May 3, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30196
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for training a convolutional neural network for classification of actions performed by subjects in a video is realized by (a) for each frame of the video, for each key point of the subject, generating a heat map of the key point representing a position estimation of the key point within the frame; (b) colorizing each heat map as a function of the relative time of the corresponding frame in the video; (c) for each key point, aggregating all the colorized heat maps of the key point into at least one image representing the evolution of the position estimation of the key point during the video; and training the convolutional neural network using as input the sets associated to each training video of images representing the evolution of the position estimation of each key point during the video.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.