Inferring topics with entity linking and ontological data

US10936630B2 · kind B2 · utility

Assignee

• MICROSOFT TECHNOLOGY LICENSING, LLC · US

Inventors

• Royi Ronen · Nes Ziona, IL
• Oron Nir · Herzliya, IL
• Chin-Yew Lin · Redmond, US
• Ohad JASSIN · Even Yehuda, IL
• Daniel NURIELI · Nes Ziona, IL
• Eylon Ami · Givatayim, IL
• Avner Levi · Kiryat Ono, IL

Key dates

• Filing date: Sep 13, 2018
• Grant date: Mar 2, 2021
• Expiry date: Jun 4, 2039

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L15/26
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Systems and methods are disclosed for inferring topics from a file containing both audio and video, for example a multimodal or multimedia file, in order to facilitate video indexing. A set of entities is extracted from the file and linked to produce a graph, and reference information is also obtained for the set of entities. Entities may be drawn, for example, from Wikipedia categories, or other large ontological data sources. Analysis of the graph, using unsupervised learning, permits determining clusters in the graph. Extracting features from the clusters, possibly using supervised learning, provides for selection of topic identifiers. The topic identifiers are then used for indexing the file.