Patent · US Active

Hierarchical video encoders

US11533495B2 · kind B2 · utility

4Cited by
0References
20Claims
0Family size

Assignee

Inventors

Key dates

Filing dateJan 29, 2021
Grant dateDec 20, 2022
Priority date
Expiry dateJan 29, 2041

Classification

  • Technology area (CPC H)Electricity
  • CPC primaryH04N19/436
  • WIPO fieldAudio-visual technology
  • WIPO sectorElectrical engineering

Abstract

A computer-implemented method for generating video representations utilizing a hierarchical video encoder includes obtaining a video, wherein the video includes a plurality of frames, processing each of the plurality of frames with a machine-learned frame-level encoder model to respectively generate a plurality of frame representations for the plurality of frames, the plurality of frame representations respective to the plurality of frames determining a plurality of segment representations representative of a plurality of video segments including one or more of the plurality of frames, the plurality of segment representations based at least in part on the plurality of frame representations, processing the plurality of segment representations with a machine-learned segment-level encoder model to generate a plurality of contextualized segment representations, determining a video representation based at least in part on the plurality of contextualized segment representations, and providing the video representation as an output.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.