Active imitation learning in high dimensional continuous environments
US11410030B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 6, 2018 |
| Grant date | Aug 9, 2022 |
| Priority date | — |
| Expiry date | Apr 16, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/01
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
According to one embodiment, a computer-implemented method for active, imitation learning, includes: providing training data comprising an expert trajectory to a processor; querying the expert trajectory during an iterative, active learning process; generating a decision policy based at least in part on the expert trajectory and a result of querying the expert trajectory; attempting to distinguish the decision policy from the expert trajectory; in response to distinguishing the decision policy from the expert trajectory, outputting a policy update and generating a new decision policy based at least in part on the policy update; and in response to not distinguishing the decision policy from the expert trajectory, outputting the decision policy. Importantly, the expert trajectory is queried for only a subset of iterations of the iterative, active learning process, wherein the most uncertain state/action pair(s) from the expert trajectory are determined using one or more disagreement functions.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.