System and method for vision-based joint action and pose motion forecasting
US10911775B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 11, 2020 |
| Grant date | Feb 2, 2021 |
| Priority date | — |
| Expiry date | Mar 11, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T9/001
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A computer-implemented method, comprising extracting each frame of a video sequence, estimating current poses of a subject within each frame and determining joint locations for a joint associated with the subject within each frame, computing optical flows between each pair of consecutive video frames, extracting motion features from each video frame of the video sequence based on the optical flows, encoding state information based on the current poses and the motion features, determining a current action label for each motion feature in the state information for a first frame; predicting future action labels for each motion feature in a second frame subsequent to the first frame, based on the current pose, action label and state information, predicting future poses for each motion feature in the second frame based on the current poses and the state information; and refining the current action label, the future action labels, and the future poses.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.