Cross-modal shape and color manipulation
US12094073B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 22, 2022 |
| Grant date | Sep 17, 2024 |
| Priority date | — |
| Expiry date | Oct 20, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2219/2021
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems, computer readable media, and methods herein describe an editing system where a three-dimensional (3D) object can be edited by editing a 2D sketch or 2D RGB views of the 3D object. The editing system uses multi-modal (MM) variational auto-decoders (VADs)(MM-VADs) that are trained with a shared latent space that enables editing 3D objects by editing 2D sketches of the 3D objects. The system determines a latent code that corresponds to an edited or sketched 2D sketch. The latent code is then used to generate a 3D object using the MM-VADs with the latent code as input. The latent space is divided into a latent space for shapes and a latent space for colors. The MM-VADs are trained with variational auto-encoders (VAE) and a ground truth.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.