Patent · US Active

A/B testing sample ratio mismatch solver

US11544178B2 · kind B2 · utility

0Cited by
1References
14Claims
0Family size

Assignee

Inventor

Key dates

Filing dateOct 22, 2020
Grant dateJan 3, 2023
Priority date
Expiry dateOct 22, 2040

Classification

  • Technology area (CPC G)Physics
  • CPC primaryG06F2201/875
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

A method of executing an A/B test includes configuring the A/B test to comprise a first plurality of users in a control group and a second plurality of users in a test group, wherein the first plurality of users and the second plurality of users are to be provided two different versions of a webpage. The method further includes, while the A/B test is executing, determining, by a processing device, that a sample ratio mismatch corresponding to the second plurality of users has occurred, wherein the sample ratio mismatch is determined before the A/B test ends executing. The method further includes, in response to the determining, ending the executing of the A/B test before a previously scheduled end of the A/B test.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.