Patent · US Active

Traffic signal control using multiple Q-learning categories

US10002530B1 · kind B1 · utility

8Cited by
1References
6Claims
0Family size

Assignee

Inventors

Key dates

Filing dateJul 3, 2017
Grant dateJun 19, 2018
Priority date
Expiry dateJul 3, 2037

Classification

  • Technology area (CPC G)Physics
  • CPC primaryG06N7/01
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

Technologies are described to provide control of traffic signals based at least in part on multiple Q-learning categories. In some examples, a method may include clustering historical traffic data into multiple traffic pattern clusters, and generating multiple Q-learning categories, where each Q-learning category corresponds to a traffic pattern cluster of the multiple traffic pattern clusters. The method may also include determining a first Q-learning category of the multiple Q-learning categories to use in controlling traffic signals at an intersection based at least in part on a first traffic data of the intersection, where the first Q-learning category corresponds to a first traffic pattern cluster, and the first traffic data corresponds to the first traffic pattern cluster. The method may additionally include generating a first control action for the traffic signals at the intersection based at least in part on the first Q-learning category.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.