System and method for real-time overlay of map features onto a video feed
US9996976B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | May 4, 2015 |
| Grant date | Jun 12, 2018 |
| Priority date | — |
| Expiry date | Mar 24, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30241
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method is provided for augmenting video feed obtained by a camera of a aerial vehicle to a user interface. The method can include obtaining a sequence of video images with or without corresponding sensor metadata from the aerial vehicle; obtaining supplemental data based on the sequence of video images and the sensor metadata; correcting an error in the sensor metadata using a reconstruction error minimization technique; creating a geographically-referenced scene model based on a virtual sensor coordinate system that is registered to the sequence of video images; overlaying the supplemental information onto the geographically-referenced scene model by rendering geo-registered data from a 3D perspective that matches a corrected camera model; creating a video stream of a virtual representation from the scene from the perspective of the camera based on the overlaying; and providing the video stream to a UI to be render onto a display.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.