Audio and depth based sound source localization

US9753119B1 · kind B1 · utility

Assignee

• AMAZON TECHNOLOGIES, INC. · US

Inventors

• Kavitha Velusamy · San Jose, US
• Ning Yao · Cupertino, US
• Wai Chung Chu · San Jose, US
• Sowmya Gopalan · Cupertino, US
• Qiang Liu · Lo Wu, CN
• Rahul Kamalkishore Agrawal · Bengaluru, IN
• Manika Puri · Santa Clara, US

Key dates

• Filing date: Jan 29, 2014
• Grant date: Sep 5, 2017
• Expiry date: Oct 22, 2034

Classification

• Technology area (CPC G): Physics
• CPC primary: G01S17/46
• WIPO field: Measurement
• WIPO sector: Instruments

Abstract

A system may utilize sound localization techniques, such as time-difference-of-arrival techniques, to estimate an audio-based sound source position from which a sound originates. An optical image or depth map of an area containing the sound source location may then captured and analyzed to detect an object that is known or expected to have produced the sound. The position of the object may also be determined based on the analysis of the optical image or depth map. The position of the sound source may then be determined based at least in part on the position of the detected object or on a combination of the audio-based sound source position and the determined position of the object.