Patent · US Active

Saliency prediction method and system for 360-degree image

US11823432B2 · kind B2 · utility

1Cited by
0References
9Claims
0Family size

Assignee

Inventors

Key dates

Filing dateFeb 5, 2023
Grant dateNov 21, 2023
Priority date
Expiry dateFeb 5, 2043

Classification

  • Technology area (CPC G)Physics
  • CPC primaryG06V20/56
  • WIPO fieldAudio-visual technology
  • WIPO sectorElectrical engineering

Abstract

The present disclosure provides a saliency prediction method and system for a 360-degree image based on a graph convolutional neural network. The method includes: firstly, constructing a spherical graph signal of an image of an equidistant rectangular projection format by using a geodesic icosahedron composition method; then inputting the spherical graph signal into the proposed graph convolutional neural network for feature extraction and generation of a spherical saliency graph signal; and then reconstructing the spherical saliency graph signal into a saliency map of an equidistant rectangular projection format by using a proposed spherical crown based interpolation algorithm. The present disclosure further proposes a KL divergence loss function with sparse consistency. The method can achieve excellent saliency prediction performance subjectively and objectively, and is superior to an existing method in computational complexity.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.