Facilitating end-to-end communications with automated assistants in multiple languages

US11875788B2 · kind B2 · utility

Assignee

• Google LLC · US

Inventors

• James Kuczmarski · San Francisco, US
• Vibhor Jain · Kanchinakote, IN
• Amarnag Subramanya · Sunnyvale, US
• Nimesh Ranjan · San Francisco, US
• Melvin Jose Johnson Premkumar · Sunnyvale, US
• Vladimir Vuskovic · Zollikon, CH
• Luna Dai · San Francisco, US
• Daisuke Ikeda · Hitachinaka, JP
• Nihal Sandeep Balani · Sunnyvale, US
• Jinna Lei · San Francisco, US
• Mengmeng Niu · San Jose, US

Key dates

• Filing date: Mar 24, 2021
• Grant date: Jan 16, 2024
• Expiry date: Mar 24, 2041

Classification

• Technology area (CPC —): General

Abstract

Techniques described herein relate to facilitating end-to-end multilingual communications with automated assistants. In various implementations, speech recognition output may be generated based on voice input in a first language. A first language intent may be identified based on the speech recognition output and fulfilled in order to generate a first natural language output candidate in the first language. At least part of the speech recognition output may be translated to a second language to generate an at least partial translation, which may then be used to identify a second language intent that is fulfilled to generate a second natural language output candidate in the second language. Scores may be determined for the first and second natural language output candidates, and based on the scores, a natural language output may be selected for presentation.