Patent · US Active

System and method for attention-aware relation mixer for person search

US12260674B2 · kind B2 · utility

0Cited by
2References
16Claims
0Family size

Assignee

Inventors

Key dates

Filing dateNov 9, 2022
Grant dateMar 25, 2025
Priority date
Expiry dateNov 9, 2042

Classification

  • Technology area (CPC H)Electricity
  • CPC primaryH04N7/181
  • WIPO fieldAudio-visual technology
  • WIPO sectorElectrical engineering

Abstract

A video system and method for person search includes video cameras for capturing video images, a display device, and a computer system. The computer system including a deep learning network to determine person images, from among the video images, matching a target query person. The deep learning network having a person detection branch, a person re-identification branch, and an attention-aware relation mixer connected to the person detection branch and to the person re-identification branch. The attention-aware relation mixer including a relation mixer having a spatial and channel mixer that performs spatial attention followed by spatial mixing (tokenized multi-layered perceptron) and channel attention followed by channel mixing (channel multi-layered perceptron), and a joint spatio-channel attention layer that utilizes 3D attention weights to modulate 3D spatio-channel region of interest features and aggregate the features with output of the relation mixer. A display device displays matching person images for the person search.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.