Method of gaze estimation with 3D face reconstructing
US11734889B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 13, 2022 |
| Grant date | Aug 22, 2023 |
| Priority date | — |
| Expiry date | Apr 13, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2219/2016
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The present invention proposes method of gaze estimation with 3D face reconstructing, which precisely reconstructs a 3D face to accurately calculate the gaze direction of the face. The present invention decomposes the gaze direction calculation task into two sub-tasks of gaze-aligned 3D face reconstruction, and gaze contact realized by rotation. First, a 3D morphable model is used to reconstruct a basic 3D face with a 2D reference face image as input. Then, shape adjustment is performed on the basic 3D face to obtain a shape-aligned 3D reconstructed face. Finally, a gaze-aligned 3D face is obtained by replacing the textures of the shape-aligned 3D face eye area. For the subtask of gaze contact, the present invention proposes a novel method for realizing gaze contact by rotating a 3D face, which does not depend on too many assumptions and can be widely used in the field of virtual reality.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.