Volumetric performance capture with relighting
US12066282B2 · kind B2 · utility
Assignee
Inventors
- Sean Ryan Francesco Fanello
- Kaiwen Guo
- Peter Christopher Lincoln
- Philip L. Davidson
- Jessica Lynn Busch
- Xueming Yu
- Geoffrey Harvey
- Sergio Orts Escolano
- Rohit Kumar Pandey
- Jason Angelo Dourgarian
- Danhang Tang
- Adarsh Prakash Murthy Kowdle
- Emily B. Cooper
- Mingsong Dou
- Graham Fyffe
- Christoph Rhemann
- Jonathan James Taylor
- Shahram Izadi
- Paul E. Debevec
Key dates
| Filing date | Nov 11, 2020 |
| Grant date | Aug 20, 2024 |
| Priority date | — |
| Expiry date | Mar 10, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T17/205
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.