Auxiliary sensing method and system based on sensory substitution
US11310620B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 3, 2020 |
| Grant date | Apr 19, 2022 |
| Priority date | — |
| Expiry date | Nov 3, 2040 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04S2420/11
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
An auxiliary sensing method and system based on sensory substitution includes: establishing a discrete horizontal plane included angle and a normal vector included angle in three-dimensional space as well as response functions corresponding to different discrete distances, and establishing an acoustic coding library of an object; obtaining a surrounding environmental video; obtaining object information and category of current environment; establishing a three-dimensional sound field of the object according to the image information, the object information and the three-dimensional coordinate information obtained in combination with the acoustic coding library of the object; and adjusting, for objects of different categories, the three-dimensional sound field of each object according to movement information and variations of images, and playing the three-dimensional sound field of each object in real time.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.