Generic architecture for indexing document groups in an inverted text index

US8131726B2 · kind B2 · utility

Assignee

• International Business Machines Corporation · US

Inventors

• Andrei Broder · Menlo Park, US
• Marcus Fontoura · Mountain View, US
• Michael Herscovici · Haifa, IL
• Ronny Lempel · Haifa, IL
• John A. McPherson, Jr. · San Jose, US
• Andreas Neumann · Hamburg, DE
• Runping Qi · Cupertino, US
• Eugene J. Shekita · San Jose, US

Key dates

• Filing date: Jan 12, 2005
• Grant date: Mar 6, 2012
• Expiry date: Oct 4, 2029

Classification

• Technology area (CPC G): Physics
• CPC primary: G06F16/319
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

A method for indexing a plurality of documents, that includes a plurality of duplicate documents, first identifies one or more duplicate groups of documents from among the plurality of documents. Then, one index of content for the duplicate group is created instead of indexing the content from every document within the duplicate group. However, in contrast to the content index, an index of metadata for each of the documents in the duplicate group is created. Thus the content of each duplicate group is indexed only once, while a search engine using such indexing techniques retains the capability to answer queries as if the duplicated content was indexed for each document of the group.