Sound source detection and localization for autonomous driving vehicle

US11430466B2 · kind B2 · utility

Assignee

• BAIDU USA LLC · US

Inventors

• Hongyi Sun · Sunnyvale, US
• Kecheng Xu · Sunnyvale, US
• Qi Luo · Sunnyvale, US
• Zejun Lin · Sunnyvale, US
• Wei Wang · Sunnyvale, US
• Wesley Reynolds · Sunnyvale, US
• Jiangtao Hu · Sunnyvale, US
• Jinghao Miao · Sunnyvale, US

Key dates

• Filing date: Jan 13, 2021
• Grant date: Aug 30, 2022
• Expiry date: Feb 3, 2041

Classification

• Technology area (CPC H): Electricity
• CPC primary: H04R2499/13
• WIPO field: Measurement
• WIPO sector: Instruments

Abstract

Systems and methods for sound source detection and localization utilizing an autonomous driving vehicle (ADV) are disclosed. The method includes receiving audio data from a number of audio sensors mounted on the ADV. The audio data comprises sounds captured by the audio sensors and emitted by one or more sound sources. Based on the received audio data, the method further includes determining a number of sound source information. Each sound source information comprises a confidence score associated with an existence of a specific sound. The method further includes generating a data representation to report whether there exists the specific sound within the driving environment of the ADV. The data representation comprises the determined sound source information. The received audio data and the generated data representation are utilized to subsequently train a machine learning algorithm to recognize the specific sound source during autonomous driving of the ADV in real-time.