Multimodal safety systems and methods

US12067707B2 · kind B2 · utility

Inventors

• Sandeep Pandya · Irvine, US
• Sundeep Ahluwalia · San Diego, US
• Changsoo Jeong · Rancho Palos Verdes, US
• Michael Korkin · Glendale, US
• Kyungsuk David Lee · Redmond, US
• Christopher Ro · Williston, US
• Yong Wu · Signal Hill, US

Key dates

• Filing date: Oct 30, 2023
• Grant date: Aug 20, 2024
• Expiry date: Oct 30, 2043

Classification

• Technology area (CPC G): Physics
• CPC primary: G06T2207/30108
• WIPO field: Control
• WIPO sector: Instruments

Abstract

Multimodal systems are provided for managing safety in an industrial environment. The system comprises: (a) a computer vision component for generating a first output data; (b) a real-time locating component for generating a second output data about an object within the industrial environment and a mobile tag device deployed to the object; (c) a LIDAR component for generating a third output data; and (d) an edge computing device connected to the computer vision component, the real-time locating component and the LIDAR component via a local network, and is configured to: (i) receive a data stream including the first output data, the second output data and the third output data, (ii) process the data stream using a machine learning algorithm trained model to generate a safety related result and feedback data, and (iii) deliver the feedback data to the object via the mobile tag device.