Closed-loop real time SSVEP-based heads-up display to control in vehicle features using deep learning

US12358370B2 · kind B2 · utility

Assignees

• TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC. · US
• University of Connecticut Health Center · US

Inventors

• Hossein Hamidi Shishavan · Meridian Avenue, US
• Insoo Kim · Busan, KR
• Mohammad Behzadi · Storrs, US
• Ercan Mehmet Dede · Ann Arbor, US
• Danny J. Lohan · Ann Arbor, US

Key dates

• Filing date: Dec 16, 2022
• Grant date: Jul 15, 2025
• Expiry date: Oct 4, 2043

Classification

• Technology area (CPC B): Performing Operations; Transporting
• CPC primary: B60K2360/188
• WIPO field: Medical technology
• WIPO sector: Instruments

Abstract

A vehicle system includes a controller programmed to display a plurality of icons on a heads-up-display (HUD) of the vehicle, receive electroencephalography (EEG) data from a driver of the vehicle, perform a Fast Fourier Transform of the EEG data to obtain an EEG spectrum, input the EEG spectrum into a trained machine learning model, determine which of the plurality of icons the driver is viewing based on an output of the trained machine learning model, and perform one or more vehicle operations based on the output of the trained machine learning model.