Scene reconstruction using geometry and reflectance volume representation of scene

US12211225B2 · kind B2 · utility

Assignee

• Adobe Inc. · US

Inventors

• Sai Bi · San Jose, US
• Zexiang Xu · San Jose, US
• Kalyan Sunkavalli · San Jose, US
• Milos Hasan · Lafayette, US
• Yannick Hold-Geoffroy · San Jose, US
• David J. Kriegman · San Diego, US
• Ravi Ramamoorthi · Carlsbad, US

Key dates

• Filing date: Apr 15, 2021
• Grant date: Jan 28, 2025
• Expiry date: Jul 18, 2042

Classification

• Technology area (CPC G): Physics
• CPC primary: G06T2207/20084
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A scene reconstruction system renders images of a scene with high-quality geometry and appearance and supports view synthesis, relighting, and scene editing. Given a set of input images of a scene, the scene reconstruction system trains a network to learn a volume representation of the scene that includes separate geometry and reflectance parameters. Using the volume representation, the scene reconstruction system can render images of the scene under arbitrary viewing (view synthesis) and lighting (relighting) locations. Additionally, the scene reconstruction system can render images that change the reflectance of objects in the scene (scene editing).