Machine learning device, control system, control device, and machine learning method
US11029651B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 13, 2018 |
| Grant date | Jun 8, 2021 |
| Priority date | — |
| Expiry date | Oct 24, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG05B2219/49065
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A machine learning device includes: a state information acquisition unit configured to cause the control device to execute a tapping program to acquire from the control device, state information including a torque command value with respect to the spindle motor, a drive state including deceleration, a ratio of a movement distance in acceleration and a movement distance in deceleration; an action information output unit configured to output action information including adjustment information of the ratio of the movement distance in acceleration and the movement distance in deceleration, to the control device; a reward output unit configured to output a reward value in reinforcement learning based on a torque command value in deceleration, and a target torque command value in deceleration; and a value function update unit configured to update an action value function based on the reward value, the state information, and the action information.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.