Voice assistant-enabled client application with user view context and multi-modal input support

US12430011B2 · kind B2 · utility

Assignee

• MICROSOFT TECHNOLOGY LICENSING, LLC · US

Inventors

• Tudor Buzasu Klein · Bellevue, US
• Viktoriya Taranov · Bellevue, US
• Sergiy Gavrylenko · Issaquah, US
• Jaclyn Carley Knapp · Seattle, US
• Andrew Paul McGovern · Seattle, US
• Harris Syed · Redmond, US
• Chad Steven Estes · Atlanta, US
• Jesse Daniel Eskes Rusak · Redmond, US
• David Ernesto Heekin Burkett · Redmond, US
• Allison O'Mahony · Bellevue, US
• Ashok Kuppusamy · Seattle, US
• Jonathan R. Harris · Redmond, US
• Jose Miguel Rady Allende · Redmond, US
• Diego Hernan Carlomagno · Redmond, US
• Talon Edward Ireland · Kirkland, US
• Michael Francis Palermiti, II · Issaquah, US
• Richard Leigh Mains · Seattle, US
• Jayant Sivarama Krishnamurthy · Redmond, US

Key dates

• Filing date: Mar 27, 2024
• Grant date: Sep 30, 2025
• Expiry date: Mar 27, 2044

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L2015/088
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.