Robotic vision

US11433545B2 · kind B2 · utility

Assignee

• SAMSUNG ELECTRONICS CO., LTD. · KR

Inventors

• Philipp Schoessler · Scotts Valley, US
• Thibault Neveu · Mountain View, US
• Dane Mason · Mountain View, US
• Kathleen Sofia Hajash · Sunnyvale, US
• Brian Harms · San Jose, US

Key dates

• Filing date: Feb 14, 2020
• Grant date: Sep 6, 2022
• Expiry date: Dec 5, 2040

Classification

• Technology area (CPC G): Physics
• CPC primary: G06T7/75
• WIPO field: Handling
• WIPO sector: Mechanical engineering

Abstract

A method includes accessing RGB and depth image data representing a scene that includes at least a portion of a robotic limb. Using this data, a computing system may segment the image data to isolate and identify at least a portion of the robotic limb within the scene. The computing system can determine a current pose of the robotic limb within the scene based on the image data, joint data, or a 3D virtual model of the robotic limb. The computing system may then determine a desired goal pose, which may be based on the image data or the 3D virtual model. Based on the determined goal pose, the computing device determines the difference between the current pose and the goal pose of the robotic limb, and using this difference, provides a pose adjustment that for the robotic limb.