Fully bayesian linear regression
US7565334B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 16, 2007 |
| Grant date | Jul 21, 2009 |
| Priority date | — |
| Expiry date | Nov 16, 2027 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N7/01
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A simple yet powerful Bayesian model of linear regression is disclosed for methods and systems of machine learning. Unlike previous treatments that have either considered finding hyperparameters through maximum likelihood or have used a simple prior that makes the computation tractable but can lead to overfitting in high dimensions, the disclosed methods use a combination of linear algebra and numerical integration to work a full posterior over hyperparameters in a model with a prior that naturally avoids overfitting. The resulting algorithm is efficient enough to be practically useful. The approach can be viewed as a fully Bayesian version of the discriminative regularized least squares algorithm.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.