System and method to convert two-dimensional video into three-dimensional extended reality content
US11551407B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 1, 2021 |
| Grant date | Jan 10, 2023 |
| Priority date | — |
| Expiry date | Sep 1, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2210/21
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
System and method are provided to detect objects in a scene frame of two-dimensional (2D) video using image processing and determine object image coordinates of the detected objects in the scene frame. The system and method deploy a virtual camera in a three-dimensional (3D) environment to create a virtual image frame in the environment and generate a floor in the environment in a plane below the virtual camera. The system and method adjust the virtual camera to change a height and angle relative to the virtual image frame. The system and method generate at an extended reality (XR) coordinate location relative to the floor for placing the detected object in the environment. The XR coordinate location is a point of intersection of a ray cast of the virtual camera through the virtual frame on the floor that translates to the image coordinate in the virtual image frame.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.