Gaze determination machine learning system having adaptive weighting of inputs
US11636609B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | Sep 2, 2020 |
| Grant date | Apr 25, 2023 |
| Priority date | — |
| Expiry date | Dec 20, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30201
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject's eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject's face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of gaze direction as well as to learn a context vector of features describing subject face pose. The context vector is then used to adaptively re-weight the eye direction features determined from the eye crops. The re-weighted features are then combined with the coarse gaze prediction to determine gaze direction.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.