Creating a global reinforcement learning (RL) model from subnetwork RL agents
US12388719B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 9, 2023 |
| Grant date | Aug 12, 2025 |
| Priority date | — |
| Expiry date | Apr 5, 2044 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L43/55
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
Methods are provided for recommending actions to improve operability of a network. In one implementation, a method includes acknowledging a plurality of subnetworks in a whole network, each subnetwork including multiple nodes and being represented by a tunnel group having multiple end-to-end tunnels through the subnetwork. The method also includes selecting a first group of subnetworks from the plurality of subnetworks and generating a Reinforcement Learning (RL) agent for each subnetwork of the first group. Each RL agent is based on observations of end-to-end metrics of the end-to-end tunnels of the respective subnetwork. The observations are independent of specific topology information of the subnetwork. Also, the method includes training a global model based on the RL agents of the first group of subnetworks and applying the global model to an Action Recommendation Engine (ARE) configured for recommending actions that can be taken to improve a state of the whole network.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.