Method and system for automatic detection and prevention of quality issues in online experiments
US12299705B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 6, 2016 |
| Grant date | May 13, 2025 |
| Priority date | — |
| Expiry date | Nov 27, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06Q30/0254
- WIPO fieldIT methods for management
- WIPO sectorElectrical engineering
Abstract
The present teaching relates to managing online experiments. In one example, a plurality of experiment layers is created with respect to a plurality of online users. Each experiment layer includes at least one experiment each of which includes one or more buckets associated with respective features to be experimented on. Each of the plurality of online users is assigned to a corresponding bucket in each experiment layer, such that the user is simultaneously associated with multiple experiments in different layers. User event data related to the plurality of experiment layers are collected from the plurality of online users. One or more contaminated buckets are automatically detected based on the user event data.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.