Plotting behind the scenes with learnable game engines
US12390738B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 14, 2023 |
| Grant date | Aug 19, 2025 |
| Priority date | — |
| Expiry date | Sep 16, 2043 |
Classification
- Technology area (CPC A)Human Necessities
- CPC primaryA63F2300/66
- WIPO fieldFurniture, games
- WIPO sectorOther fields
Abstract
A framework trains game-engine-like neural models from annotated videos to generate a Learnable Game Engine (LGE) that maintains states of the scene, objects and agents in it, and enables rendering the environment from a controllable viewpoint. The LGE models the logic of the game and the rules of physics, making it possible for the user to play the game by specifying both high- and low-level action sequences. The LGE also unlocks a director's mode where the game is played by plotting behind the scenes, specifying high-level actions and goals for the agents using text-based instructions. To implement the director's mode, a trained diffusion-based animation model navigates the scene using high-level constraints, to enable play against an adversary, and to devise the strategy to win a point. To render the resulting state of the environment and its agents, a compositional neural radiance field (NeRF) representation is used in a synthesis model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.