Video action segmentation by mixed temporal domain adaption
US11138441B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 6, 2019 |
| Grant date | Oct 5, 2021 |
| Priority date | — |
| Expiry date | Apr 1, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V20/46
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Embodiments herein treat the action segmentation as a domain adaption (DA) problem and reduce the domain discrepancy by performing unsupervised DA with auxiliary unlabeled videos. In one or more embodiments, to reduce domain discrepancy for both the spatial and temporal directions, embodiments of a Mixed Temporal Domain Adaptation (MTDA) approach are presented to jointly align frame-level and video-level embedded feature spaces across domains, and, in one or more embodiments, further integrate with a domain attention mechanism to focus on aligning the frame-level features with higher domain discrepancy, leading to more effective domain adaptation. Comprehensive experiment results validate that embodiments outperform previous state-of-the-art methods. Embodiments can adapt models effectively by using auxiliary unlabeled videos, leading to further applications of large-scale problems, such as video surveillance and human activity analysis.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.