Forum web page clustering based on repetitive regions

US8051083B2 · kind B2 · utility

Assignee

• Microsoft Corporation · US

Inventors

• Wei Lai · Mountain View, US
• Rui Cai · Beijing, CN
• Jiangming Yang · Beijing, CN
• Lei Zhang · Beijing, CN
• Wei-Ying Ma · Redmond, US

Key dates

• Filing date: Apr 16, 2008
• Grant date: Nov 1, 2011
• Expiry date: Apr 13, 2029

Classification

• Technology area (CPC G): Physics
• CPC primary: G06Q10/10
• WIPO field: IT methods for management
• WIPO sector: Electrical engineering

Abstract

Described is a technology by which forum web pages are processed into clusters for classification purposes, including by determining repetitive regions between pages and associating pages that have similar repetitive regions into a common cluster. Patterns corresponding to the regions are determined, and a feature set based at least in part on those patterns (e.g., pattern frequency) is extracted from the page. The feature set of a page is compared against the feature set of another page to determine similarity therewith, e.g., via a feature space distance computation that is evaluated against a threshold distance.