Method and system for recognizing activities in surrounding environment for controlling navigation of autonomous vehicle
US11987264B2 · kind B2 · utility
Assignees
Inventors
Key dates
| Filing date | Jul 16, 2021 |
| Grant date | May 21, 2024 |
| Priority date | — |
| Expiry date | Aug 29, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30252
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method and activity recognition system for recognising activities in surrounding environment for controlling navigation of an autonomous vehicle is disclosed. The activity recognition system receives first data feed from neuromorphic event-based camera and second data feed from frame-based RGB video camera. The first data feed comprises high-speed temporal information encoding motion associated with change in surrounding environment at each spatial location, and second data feed comprises spatio-temporal data providing scene-level contextual information associated with surrounding environment. An adaptive sampling of second data feed is performed with respect to foreground activity rate based on amount of foreground motion encoded in first data feed. Further, the activity recognition system recognizes activities associated with at least one object in surrounding environment by identifying correlation between both data feed by using two-stream neural network model. Thereafter, based on the determined activities, the activity recognition system controls the navigation of the autonomous vehicle.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.