Depth-guided video inpainting for autonomous driving
US11282164B2 · kind B2 · utility
Assignees
Inventors
Key dates
| Filing date | May 26, 2020 |
| Grant date | Mar 22, 2022 |
| Priority date | — |
| Expiry date | May 26, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30236
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods of video inpainting for autonomous driving are disclosed. For example, the method stitches a multiplicity of depth frames into a 3D map, where one or more objects in the depth frames have previously been removed. The method further projects the 3D map onto a first image frame to generate a corresponding depth map, where the first image frame includes a target inpainting region. For each target pixel within the target inpainting region of the first image frame, based on the corresponding depth map, the method further maps the target pixel within the target inpainting region of the first image frame to a candidate pixel in a second image frame. The method further determines a candidate color to fill the target pixel. The method further performs Poisson image editing on the first image frame to achieve color consistency at a boundary and between inside and outside of the target inpainting region of the first image frame. For each pixel in the target inpainting region of the first image frame, the method further traces the pixel into neighboring frames and replacing an original color of the pixel with an average of colors sampled from the neighboring frames.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.