Generating super resolution images using duo-camera artificial reality device

US12412244B2 · kind B2 · utility

Assignee

• Meta Platforms Technologies, LLC · US

Inventors

• Zheng Shi · Nanhu, CN
• Grace Elizabeth Kuo · Redmond, US
• Yujia Chen · Redmond, US
• Daniel Andersen · Redmond, US
• Chao Li · New Taipei, TW
• Richard Andrew Newcombe · Seattle, US
• Michael Goesele · Darmstadt, DE

Key dates

• Filing date: Oct 30, 2023
• Grant date: Sep 9, 2025
• Expiry date: Mar 13, 2044

Classification

• Technology area (CPC G): Physics
• CPC primary: G06T2207/20221
• WIPO field: Audio-visual technology
• WIPO sector: Electrical engineering

Abstract

In particular embodiments, a computing system may capture a first image of a scene using a first camera of an artificial reality device. The system may capture a second image of the scene using a second camera and one or more optical elements of the artificial reality device. The second image may include an overlapping portion of multiple shifted copies of the scene. The system may generate an upsampled first image by applying a particular sampling technique to the first image. The system may generate a tiled image comprising a plurality of repeated second images by applying a tiling process to the second image. The system may generate an initial output image by processing the upsampled first image and the tiled image using a machine learning model. The system may generate a final output image by normalizing the initial output image using the upsampled first image.