Description: The paperanalyzes typicalopen sourceWeb crawl software, such asNutch, Heritrix, WCT, andWeb-Har-
vest. Following the analyzed result, itputs forward a targetedwebsitesharvestsystem based onNutch. Fourkey issues of
this system are discussed emphatically, which are the initial seedwebsites selection, the harvestprocessmanagement, the
web page contentdenoising, and discovering ofnew seedwebsites.
To Search:
- [sim] - The use of java code to achieve the clas
File list (Check if you may need any files):
Nutch-Web.caj
Download