Secondary distillation for self-supervised video representation learning
US11971956B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 3, 2021 |
| Grant date | Apr 30, 2024 |
| Priority date | — |
| Expiry date | Jan 13, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/20084
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques for training a visual neural network are described. In particular, the training of the visual neural network may be performed using one or more contrastive learning loss functions including one or more of a visual-to-visual contrastive learning function using the visual neural network on positive and negative video clips according to a first loss function, a secondary-to-secondary contrastive learning a secondary neural network on secondary positive and negative information generated from the positive and negative video clips, and a secondary-to-visual contrastive learning according to a third loss function using the visual neural network on positive and negative video clips and using the secondary neural network secondary positive and negative information generated from the positive and negative video clips.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.