Satisfying specified intent(s) based on multimodal request(s)

US9542949B2 · kind B2 · utility

Assignee

• MICROSOFT TECHNOLOGY LICENSING, LLC · US

Inventors

• Lisa Stifelman · Palo Alto, US
• Anne K. Sullivan · San Francisco, US
• Adam D. Elman · Sunnyvale, US
• Larry Paul Heck · Los Altos, US
• Stephanos Tryphonas · San Francisco, US
• Kamran Rajabi Zargahi · Bellevue, US
• Ken H. Thai · Sunnyvale, US

Key dates

• Filing date: Jul 21, 2014
• Grant date: Jan 10, 2017
• Expiry date: Sep 29, 2034

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L2015/223
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Techniques are described herein that are capable of satisfying specified intent(s) based on multimodal request(s). A multimodal request is a request that includes at least one request of a first type and at least one request of a second type that is different from the first type. Example types of request include but are not limited to a speech request, a text command, a tactile command, and a visual command. A determination is made that one or more entities in visual content are selected in accordance with an explicit scoping command from a user. In response, speech understanding functionality is automatically activated, and audio signals are automatically monitored for speech requests from the user to be processed using the speech understanding functionality.