Patent · US Active

Systems and methods for virtual environment for reinforcement learning in manufacturing

US11609546B2 · kind B2 · utility

0Cited by
2References
15Claims
0Family size

Assignee

Inventors

Key dates

Filing dateNov 6, 2020
Grant dateMar 21, 2023
Priority date
Expiry dateApr 23, 2041

Classification

  • Technology area (CPC G)Physics
  • CPC primaryG05B2219/37228
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

Systems, devices, and methods including: receiving, by an interpreter component having a processor with addressable memory, a first state of a tool of a computer numerical control (CNC) machine; determining, by the interpreter component, a reward and a value of the reward based on the received first state, where the reward is at least one of: positive and negative; transmitting, by the interpreter component, a set of information comprising the determined reward and the value of the reward to an agent component; performing, by the agent component, at least one action to generate a tool path and to proceed to a second state, where the second state is combined with the first state; and determining, by the agent component, the generated tool path based on the determined reward and value associated with the at least one action.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.