Methods and systems for automatic evaluation of electronic discovery review and productions
US9600568B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | May 18, 2011 |
| Grant date | Mar 21, 2017 |
| Priority date | — |
| Expiry date | Jun 28, 2032 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/3347
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques are provided for automatic sampling evaluation. An automatic sampling evaluation system enables users to evaluate convergence of one or more search processes. For example, given a set of searches that were validated by human review, a system can implement a retrieval process that samples one or more non-retrieved collections. Each individual document's similarity in the one or more non-retrieved collections is automatically evaluated to other documents in any retrieved sets. Given a goal of achieving a high recall, documents with high similarity can then be analyzed for additional noun phrases that may be used for a next iteration of a search. Convergence can be expected if the information gain in the new feedback loop is less than previous iterations, and if the additional documents identified are below a certain threshold document count.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.