Traffic signal control using multiple Q-learning categories
US10395529B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 7, 2018 |
| Grant date | Aug 27, 2019 |
| Priority date | — |
| Expiry date | Jun 7, 2038 |
Classification
- Technology area (CPC F)Mechanical Engineering; Lighting; Heating
- CPC primaryF21W2111/023
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Technologies are described to provide control of traffic signals based at least in part on multiple Q-learning categories. In some examples, a method may include clustering historical traffic data into multiple traffic pattern clusters, and generating multiple Q-learning categories, where each Q-learning category corresponds to a traffic pattern cluster of the multiple traffic pattern clusters. The method may also include determining a first Q-learning category of the multiple Q-learning categories to use in controlling traffic signals at an intersection based at least in part on a first traffic data of the intersection, where the first Q-learning category corresponds to a first traffic pattern cluster, and the first traffic data corresponds to the first traffic pattern cluster. The method may additionally include generating a first control action for the traffic signals at the intersection based at least in part on the first Q-learning category.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.