Convolutional localization networks for intelligent captioning of medical images

US11836997B2 · kind B2 · utility

Assignee

• KONINIKLIJKE PHILIPS N.V. · NL

Inventors

• Christine Menking Swisher · San Diego, US
• Sheikh Sadid Al Hasan · Cambridge, US
• Jonathan Rubin · Beekman, US
• Cristhian Mauricio Potes Blandon · Salem, US
• Yuan Ling · San Francisco, US
• Oladimeji Feyisetan Farri · Yorktown Heights, US
• Rithesh Sreenivasan · Kanchinakote, IN

Key dates

• Filing date: May 7, 2019
• Grant date: Dec 5, 2023
• Expiry date: May 18, 2039

Classification

• Technology area (CPC G): Physics
• CPC primary: G06V2201/031
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A method (100) for generating a textual description of a medical image, comprising: receiving (130) a medical image of an anatomical region, the image comprising one or more abnormalities; segmenting (140) the anatomical region in the received medical image from a remainder of the image; identifying (150) at least one of the one or more abnormalities in the segmented anatomical region; extracting (160) one or more features from the identified abnormality; generating (170), using the extracted features and a trained text generation model, a textual description of the identified abnormality; and reporting (180), via a user interface of the system, the generated textual description of the identified abnormality.