Decoder-only transformer model for time series data
US12346404B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 23, 2024 |
| Grant date | Jul 1, 2025 |
| Priority date | — |
| Expiry date | Dec 23, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F17/15
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system and method include forecasting a series of future data points in a long sequence time series data using a decoder-only transformer model by dividing the long sequence time series data into a plurality of sequences, converting each sequence of the plurality of sequences into a first vector to obtain a plurality of first vectors, creating a plurality of second vectors from the time stamps associated with the plurality of data points, combining the first vector with the second vector of each sequence of the plurality of sequences to obtain a plurality of third vectors, computing a context matrix from the plurality of third vectors, performing a convolution operation on the context matrix to forecast the series of future data points, and outputting the series of future data points from the prediction layer.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.