Machine-learning based gesture recognition using multiple sensors

US11449802B2 · kind B2 · utility

Assignee

• Apple Inc. · US

Inventors

• Charles MAALOUF · Seattle, US
• Shawn R. SCULLY · Seattle, US
• Christopher B. Fleizach · معلمی نژاد, US
• Tu K. NGUYEN · San Jose, US
• Lilian H. LIANG · Kenmore, US
• Warren J. SETO · Sunnyvale, US
• Julian QUINTANA · San Jose, US
• Michael J. Beyhs · Pfaffenheck, DE
• Hojjat Seyed Mousavi · Santa Clara, US
• Behrooz Shahsavari · Hayward, US

Key dates

• Filing date: Jul 23, 2020
• Grant date: Sep 20, 2022
• Expiry date: Jul 23, 2040

Classification

• Technology area (CPC G): Physics
• CPC primary: G06N3/08
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.