Facilitating communications with automated assistants in multiple languages

US11354521B2 · kind B2 · utility

Assignee

• Google LLC · US

Inventors

• James Kuczmarski · San Francisco, US
• Vibhor Jain · Kanchinakote, IN
• Amarnag Subramanya · Sunnyvale, US
• Nimesh Ranjan · San Francisco, US
• Melvin Jose Johnson Premkumar · Sunnyvale, US
• Vladimir Vuskovic · Zollikon, CH
• Luna Dai · San Francisco, US
• Daisuke Ikeda · Hitachinaka, JP
• Nihal Sandeep Balani · Sunnyvale, US
• Jinna Lei · San Francisco, US
• Mengmeng Niu · San Jose, US
• Hongjie Chai · Palo Alto, US
• Wangqing Yuan · Wilmington, US

Key dates

• Filing date: Feb 17, 2020
• Grant date: Jun 7, 2022
• Expiry date: Jun 29, 2040

Classification

• Technology area (CPC H): Electricity
• CPC primary: H04L51/222
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Techniques described herein relate to facilitating end-to-end multilingual communications with automated assistants. In various implementations, speech recognition output may be generated based on voice input in a first language. A first language intent may be identified based on the speech recognition output and fulfilled in order to generate a first natural language output candidate in the first language. At least part of the speech recognition output may be translated to a second language to generate an at least partial translation, which may then be used to identify a second language intent that is fulfilled to generate a second natural language output candidate in the second language. Scores may be determined for the first and second natural language output candidates, and based on the scores, a natural language output may be selected for presentation.