Voice assistant-enabled client application with user view context and multi-modal input support

US11972095B2 · kind B2 · utility

Assignee

• MICROSOFT TECHNOLOGY LICENSING, LLC · US

Inventors

• Tudor Buzasu Klein · Bellevue, US
• Viktoriya Taranov · Bellevue, US
• Sergiy Gavrylenko · Issaquah, US
• Jaclyn Carley Knapp · Seattle, US
• Andrew Paul McGovern · Seattle, US
• Harris Syed · Redmond, US
• Chad Steven Estes · Atlanta, US
• Jesse Daniel Eskes Rusak · Redmond, US
• David Ernesto Heekin Burkett · Redmond, US
• Allison O'Mahony · Bellevue, US
• Ashok Kuppusamy · Seattle, US
• Jonathan R. Harris · Redmond, US
• Jose Miguel Rady Allende · Redmond, US
• Diego Hernan Carlomagno · Redmond, US
• Talon Edward Ireland · Kirkland, US
• Michael Francis Palermiti, II · Issaquah, US
• Richard Leigh Mains · Seattle, US
• Jayant Sivarama Krishnamurthy · Redmond, US

Key dates

• Filing date: Oct 22, 2021
• Grant date: Apr 30, 2024
• Expiry date: Jun 8, 2042

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L2015/227
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.