Reptile distributed version achieved, based on Map-Reduce was realized very useful

crawler\build.xml
.......\LISENCE
.......\README.txt
.......\seeds-csb.txt
.......\seeds-hadoop.txt
.......\seeds-hadoopcn.txt
.......\seeds-hi.txt
.......\seeds-localhost.txt
.......\seeds-nyt.txt
.......\seeds-scst.txt
.......\seeds-wiki.txt
.......\bin\crawler.sh
.......\conf\configuration.xsl
.......\....\joycrawler-csb.xml
.......\....\joycrawler-default.xml
.......\....\joycrawler-hadoop.xml
.......\....\joycrawler-hadoopcn.xml
.......\....\joycrawler-hi.xml
.......\....\joycrawler-localhost.xml
.......\....\joycrawler-nyt.xml
.......\....\joycrawler-scst.xml
.......\....\joycrawler-wiki.xml
.......\....\log4j.properties
.......\lib\commons-cli-2.0-SNAPSHOT.jar
.......\...\commons-httpclient-3.1.jar
.......\...\commons-logging-1.0.4.jar
.......\...\db.jar
.......\...\hadoop-0.20.1-core.jar
.......\...\log4j-1.2.15.jar
.......\...\lucene-core-3.0.0.jar
.......\...\lucene-smartcn-3.0.0.jar
.......\...\lucene-snowball-3.0.0.jar
.......\...\nekohtml.jar
.......\...\xercesImpl.jar
.......\...\xercesMinimal.jar
.......\...\xml-apis.jar
.......\...\native\libdb_java48.dll
.......\src\contrib\java\org\joy\analyzer\Analyzer.java
.......\...\.......\....\...\...\........\Document.java
.......\...\.......\....\...\...\........\DocumentCreationException.java
.......\...\.......\....\...\...\........\DocumentFactory.java
.......\...\.......\....\...\...\........\Hit.java
.......\...\.......\....\...\...\........\HitAnalyzer.java
.......\...\.......\....\...\...\........\Main.java
.......\...\.......\....\...\...\........\Paragraph.java
.......\...\.......\....\...\...\........\PipelineAnalyzer.java
.......\...\.......\....\...\...\........\TokenAnalyzer.java
.......\...\.......\....\...\...\........\html\Anchor.java
.......\...\.......\....\...\...\........\....\HTMLDocument.java
.......\...\.......\....\...\...\........\....\Main.form
.......\...\.......\....\...\...\........\....\Main.java
.......\...\.......\....\...\...\........\....\ParagraphSplitter.java
.......\...\.......\....\...\...\........\....\ParseException.java
.......\...\.......\....\...\...\........\....\Parser.java
.......\...\.......\....\...\...\........\....\TagWindow.java
.......\...\.......\....\...\...\........\....\TextExtractor.java
.......\...\.......\....\...\...\........\....\Utility.java
.......\...\.......\....\...\...\........\scoring\FrequencyScorer.java
.......\...\.......\....\...\...\........\.......\PWFScorer.java
.......\...\.......\....\...\...\........\.......\Scorer.java
.......\...\.......\....\...\...\........\.......\ZeroScorer.java
.......\...\.......\....\...\...\........\terms\SimpleTermExtractor.java
.......\...\.......\....\...\...\........\.....\TermExtractor.java
.......\...\.......\....\...\...\db\DB.java
.......\...\.......\....\...\...\..\DBCursor.java
.......\...\.......\....\...\...\..\DocHit.java
.......\...\.......\....\...\...\..\DocumentDB.java
.......\...\.......\....\...\...\..\DocumentEntry.java
.......\...\.......\....\...\...\..\Entry.java
.......\...\.......\....\...\...\..\Env.java
.......\...\.......\....\...\...\..\IndexDB.java
.......\...\.......\....\...\...\..\IndexEntry.java
.......\...\.......\....\...\...\..\MergedDocHits.java
.......\...\.......\....\...\...\..\Proximity.java
.......\...\.......\....\...\...\..\QueryServer.java
.......\...\.......\....\...\...\..\ResultEntry.java
.......\...\.......\....\...\...\..\SearchEntry.java
.......\...\.......\....\...\...\..\Searcher.java
.......\...\.......\....\...\...\..\query\Query.java
.......\...\.......\....\...\...\..\.....\SocketClient.java
.......\...\.......\....\...\...\..\.....\SocketServer.java
.......\...\.......\....\...\...\nlp\ChineseTokenizer.java
.......\...\.......\....\...\...\...\LuceneTokenizer.java
.......\...\.......\....\...\...\...\Word.java
.......\...\.......\....\...\...\...\WordTokenizer.java
.......\...\java\org\apache\hadoop\mapreduce\lib\input\KeyValueLineRecordReader.java
.......\...\....\...\......\......\.........\...\.....\KeyValueTextInputFormat.java
.......\...\....\...\joy\crawler\Crawler.java
.......\...\....\...\

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．