Instance level scene recognition with a vision language model
US11978271B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 27, 2023 |
| Grant date | May 7, 2024 |
| Priority date | — |
| Expiry date | Oct 27, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V10/82
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods for image understanding can include one or more object recognition systems and one or more vision language models to generate an augmented language output that can be both scene-aware and object-aware. The systems and methods can process an input image with an object recognition model to generate an object recognition output descriptive of identification details for an object depicted in the input image. The systems and methods can include processing the input image with a vision language model to generate a language output descriptive of a predicted scene description. The object recognition output can then be utilized to augment the language output to generate an augmented language output that includes the scene understanding of the language output with the specificity of the object recognition output.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.