Methods, systems, and computer readable media for deriving a three-dimensional (3D) textured surface from endoscopic video

US10614580B1 · kind B1 · utility

Assignee

• The University of North Carolina at Chapel Hill · US

Inventors

• Stephen Pizer · Chapel Hill, US
• Jan-Michael Frahm · Chapel Hill, US
• Julian Gary Rosenman · Chapel Hill, US
• Qingyu Zhao · Beijing, CN
• Rui Wang · Tangxia, CN
• Ruibin Ma · Durham, US
• James True Price · Chapel Hill, US
• Miao Fan · Carrboro, US
• Sarah Kelly McGill · Chapel Hill, US

Key dates

• Filing date: Jan 7, 2019
• Grant date: Apr 7, 2020
• Expiry date: Jan 7, 2039

Classification

• Technology area (CPC —): General

Abstract

Methods, systems, and computer readable media for deriving a three-dimensional (3D) textured surface from endoscopic video are disclosed. According to one method for deriving a 3D textured surface from endoscopic video, the method comprises: performing video frame preprocessing to identify a plurality of video frames of an endoscopic video, wherein the video frame preprocessing includes informative frame selection, specularity removal, and key-frame selection; generating, using a neural network or a shape-from-motion-and-shading (SfMS) approach, a 3D textured surface from the plurality of video frames; and optionally registering the 3D textured surface to at least one CT image.