Systems and methods for contrastive pretraining with video tracking supervision
US12106541B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 31, 2022 |
| Grant date | Oct 1, 2024 |
| Priority date | — |
| Expiry date | Dec 4, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30236
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Embodiments described herein provide an intelligent method to select instances, by utilizing unsupervised tracking for videos. Using this freely available form of supervision, a temporal constraint is adopted for selecting instances that ensures that different instances contain the same object while sampling the temporal augmentation from the video. In addition, using the information on the spatial extent of the tracked object, spatial constraints are applied to ensure that sampled instances overlap meaningfully with the tracked object. Taken together, these spatiotemporal constraints result in better supervisory signal for contrastive learning from videos.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.