Automated experiment scheduling
US9978074B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 12, 2013 |
| Grant date | May 22, 2018 |
| Priority date | — |
| Expiry date | Feb 2, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F11/3692
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Various embodiments are generally directed to an automated A/B testing system using a combination of classical and alternative statistical analysis to control the performance A/B tests. An apparatus includes a processor circuit; and logic to commence collection of a specified number of samples of user responses to multiple versions of a user interface in a test, employ an alternative statistical analysis to analyze the samples as they are collected, determine whether a proposed version elicits a statistically significant improvement in user response over a control version, terminate the test before the specified number of samples are collected in response to a statistically significant improvement over the control version elicited by the proposed version, and complete collection of the specified number of samples and employ a classical statistical analysis to analyze the samples in response to the proposed version not eliciting the statistically significant improvement. Other embodiments are described and claimed.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.