This is a good use of web crawler tool, with a good demo.

WebCollector
............\.gitignore
............\Lazy
............\....\Lazy.iml
............\....\README.md
............\....\demo_task.json
............\....\pom.xml
............\....\src
............\....\...\main
............\....\...\....\java
............\....\...\....\....\cn
............\....\...\....\....\..\edu
............\....\...\....\....\..\...\hfut
............\....\...\....\....\..\...\....\dmic
............\....\...\....\....\..\...\....\....\dm
............\....\...\....\....\..\...\....\....\..\KMeans.java
............\....\...\....\....\..\...\....\....\..\example
............\....\...\....\....\..\...\....\....\..\.......\StopWords.java
............\....\...\....\....\..\...\....\....\..\.......\WebpageKmeans.java
............\....\...\....\....\..\...\....\....\..\.......\WordsBag.java
............\....\...\....\....\..\...\....\....\webcollector
............\....\...\....\....\..\...\....\....\............\lazy
............\....\...\....\....\..\...\....\....\............\....\LazyConfig.java
............\....\...\....\....\..\...\....\....\............\....\LazyCrawler.java
............\....\...\....\....\..\...\....\....\............\....\Main.java
............\....\...\....\....\..\...\....\....\............\....\util
............\....\...\....\....\..\...\....\....\............\....\....\MongoHelper.java
............\....\...\....\resources
............\....\...\....\.........\stopwords.txt
............\NewsCrawler.java
............\README.md
............\README.zh-cn.md
............\WebCollector-Hadoop
............\...................\README.md
............\...................\build.sh
............\...................\conf
............\...................\....\crawler-default.xml
............\...................\....\hadoop
............\...................\....\......\core-site.xml
............\...................\....\......\hdfs-site.xml
............\...................\....\......\mapred-site.xml
............\...................\....\regex
............\...................\pom.xml
............\...................\src
............\...................\...\main
............\...................\...\....\java
............\...................\...\....\....\cn
............\...................\...\....\....\..\edu
............\...................\...\....\....\..\...\hfut
............\...................\...\....\....\..\...\....\dmic
............\...................\...\....\....\..\...\....\....\webcollector
............\...................\...\....\....\..\...\....\....\............\crawldb
............\...................\...\....\....\..\...\....\....\............\.......\DBReader.java
............\...................\...\....\....\..\...\....\....\............\.......\DBUpdater.java
............\...................\...\....\....\..\...\....\....\............\.......\Generator.java
............\...................\...\....\....\..\...\....\....\............\.......\Injector.java
............\...................\...\....\....\..\...\....\....\............\.......\Merge.java
............\...................\...\....\....\..\...\....\....\............\.......\SegmentUtil.java
............\...................\...\....\....\..\...\....\....\............\crawler
............\...................\...\....\....\..\...\....\....\............\.......\Crawler.java
............\...................\...\....\....\..\...\....\....\............\fetcher
............\...................\...\....\....\..\...\....\....\............\.......\Fetcher.java
............\...................\...\....\....\..\...\....\....\............\.......\FetcherOutputFormat.java
............\...................\...\....\....\..\...\....\....\............\.......\FetcherReducer.java
............\...................\...\....\....\..\...\....\....\............\.......\Visitor.java
............\...................\...\....\....\..\...\....\....\............\model
............\...................\...\....\....\..\...\....\....\............\.....\Content.java
............\...................\...\....\....\..\...\....\....\...........

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．