Multi-modal interaction between users, automated assistants, and other computing services

US11170772B2 · kind B2 · utility

Assignee

• Google LLC · US

Inventors

• Ulas Kirazci · San Francisco, US
• Adam Coimbra · Mountain View, US
• Abraham Lee · Belmont, US
• Wei Shan Dong · Beijing, CN
• Thushan Amarasiriwardena · Mountain View, US
• Yudong Sun · Cupertino, US
• Xiao Gao · Fremont, US

Key dates

• Filing date: Feb 6, 2019
• Grant date: Nov 9, 2021
• Expiry date: May 10, 2039

Classification

• Technology area (CPC —): General

Abstract

Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.