Patent · US Active

Control apparatus, control method and program

US11765036B2 · kind B2 · utility

0Cited by
4References
15Claims
0Family size

Assignee

Inventors

Key dates

Filing dateOct 29, 2019
Grant dateSep 19, 2023
Priority date
Expiry dateOct 29, 2039

Classification

  • Technology area (CPC H)Electricity
  • CPC primaryH04L41/5054
  • WIPO fieldDigital communication
  • WIPO sectorElectrical engineering

Abstract

Provided is a control device that includes one or more processors configured to: select an agent gk that executes an action that represents allocation of a virtual network onto a physical network at a time point t from a plurality of agents; observe a state st at the time point t with an input of network configuration information of the physical network, network observation information, and user demand information; select and execute, on basis of an action value function Q representing an expected value of a sum total of a reward received in future, an action atk from possible actions for the agent gk; calculate a reward rt using of the action atk, the state st, and a state st+1 at a time point t+1; and update the action value function Q with use of the action ajk, the state sj, and the state sj+1, where 1≤j≤t is satisfied.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.