Detecting and correcting whiteboard images while enabling the removal of the speaker

US10497396B2 · kind B2 · utility

Assignee

• The Board of Regents of the University of Texas System · US

Inventors

• Alan Bovik · Austin, US
• Casen Hunger · Austin, US
• Zichong Li · Austin, US
• Mitchell Crooks · Austin, US
• Mark Meserve · Austin, US
• Edward Mora · Austin, US
• Mike Webb · Austin, US

Key dates

• Filing date: Aug 31, 2016
• Grant date: Dec 3, 2019
• Expiry date: Aug 31, 2036

Classification

• Technology area (CPC G): Physics
• CPC primary: G11B2220/2537
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A method, system and computer program product for improving the recording of classroom lectures or other such presentations. A video frame containing a whiteboard image is converted into a black and white image for the detection of boundaries. These boundaries are classified as horizontal or vertical lines. Quadrangles are then formed using spatial arrangements of these lines. The quadrangles that are most likely to spatially coincide with the boundaries of the whiteboard image are identified. The quadrangles are then sorted (ranked) based on specific characteristics, such as size and position. The area corresponding to the identified quadrangle in the video frame is then cropped. Furthermore, the speaker in the video frame can be removed based on detecting changes that are characteristic of movements of a speaker. In this manner, the visual and educational experience involved in the recording of classroom lectures or other such presentation is improved.