Methods and systems for enabling human robot interaction by sharing cognition

US11654573B2 · kind B2 · utility

Assignee

• Tata Consultancy Services Limited · IN

Inventors

• Soumyadip Maity · Sherghati, IN
• Gourav Kumar · Ludhiana, IN
• Ruddra Dev Roy Choudhury · Sherghati, IN
• Brojeshwar Bhowmick · Sherghati, IN

Key dates

• Filing date: Feb 4, 2021
• Grant date: May 23, 2023
• Expiry date: Nov 19, 2041

Classification

• Technology area (CPC B): Performing Operations; Transporting
• CPC primary: B25J13/088
• WIPO field: Handling
• WIPO sector: Mechanical engineering

Abstract

The disclosure generally relates to methods and systems for enabling human robot interaction by cognition sharing which includes gesture and audio. Conventional techniques that use the gestures and the speech, require extra hardware setup and are limited to navigation in structured outdoor driving environments. The present disclosure herein provides methods and systems that solves the technical problem of enabling the human robot interaction with a two-step approach by transferring the cognitive load from the human to the robot. An accurate shared perspective associated with the task is determined in the first step by computing relative frame transformations based on understanding of navigational gestures of the subject. Then, the shared perspective transformed to the robot in the field view of the robot. The transformed shared perspective is then given to a language grounding technique in the second step, to accurately determine a final goal associated with the task.