Web forum crawling using skeletal links
US8099408B2 · kind B2 · utility
5Cited by
4References
17Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jun 27, 2008 |
| Grant date | Jan 17, 2012 |
| Priority date | — |
| Expiry date | Mar 18, 2030 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/951
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method and system for identifying informative links of a web site for use in crawling the web site is provided. A forum crawler analyzes sample web pages of a web forum to identify informative links and then crawls the web forum by following links determined to be informative and not following other links. The forum crawler system determines whether links are informative based on whether they are part of the overall structure of the web site or are used to select sequential information that has been split onto multiple web pages.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.