Description: WebCollector is a JAVA crawler framework (kernel) that does not need to be configured and easy to develop for two times. It provides a streamlined API and implements a powerful crawler with a small amount of code. WebCollector-Hadoop is the WebCollector version of Hadoop, which supports distributed crawling.
To Search:
File list (Check if you may need any files):
weibo3.2\.classpath
weibo3.2\.project
weibo3.2\.settings\org.eclipse.core.resources.prefs
weibo3.2\.settings\org.eclipse.jdt.core.prefs
weibo3.2\bin\com\x\s\dao\Crawldao.class
weibo3.2\bin\com\x\ss\DataColumn.class
weibo3.2\bin\com\x\ss\DataRow.class
weibo3.2\bin\com\x\ss\DataTable.class
weibo3.2\bin\com\x\ss\DBHelper.class
weibo3.2\bin\com\x\ss\Test.class
weibo3.2\bin\com\x\ss\test11.class
weibo3.2\lib\cglib-nodep-2.1_3.jar
weibo3.2\lib\commons-codec-1.9.jar
weibo3.2\lib\commons-collections-3.2.1.jar
weibo3.2\lib\commons-exec-1.1.jar
weibo3.2\lib\commons-io-2.4.jar
weibo3.2\lib\commons-lang3-3.3.2.jar
weibo3.2\lib\commons-logging-1.1.3.jar
weibo3.2\lib\cssparser-0.9.14.jar
weibo3.2\lib\gson-2.3.jar
weibo3.2\lib\guava-18.0.jar
weibo3.2\lib\hamcrest-core-1.3.jar
weibo3.2\lib\htmlunit-2.15.jar
weibo3.2\lib\htmlunit-core-js-2.15.jar
weibo3.2\lib\httpclient-4.3.4.jar
weibo3.2\lib\httpcore-4.3.2.jar
weibo3.2\lib\httpmime-4.3.3.jar
weibo3.2\lib\je-5.0.73.jar
weibo3.2\lib\jetty-http-8.1.15.v20140411.jar
weibo3.2\lib\jetty-io-8.1.15.v20140411.jar
weibo3.2\lib\jetty-util-8.1.15.v20140411.jar
weibo3.2\lib\jetty-websocket-8.1.15.v20140411.jar
weibo3.2\lib\jna-3.4.0.jar
weibo3.2\lib\json-20140107.jar
weibo3.2\lib\jsoup-1.8.3.jar
weibo3.2\lib\junit-4.11.jar
weibo3.2\lib\juniversalchardet-1.0.3.jar
weibo3.2\lib\log4j-1.2.17.jar
weibo3.2\lib\nekohtml-1.9.21.jar
weibo3.2\lib\netty-3.5.2.Final.jar
weibo3.2\lib\platform-3.4.0.jar
weibo3.2\lib\sac-1.3.jar
weibo3.2\lib\selenium-api-2.44.0.jar
weibo3.2\lib\selenium-chrome-driver-2.44.0.jar
weibo3.2\lib\selenium-firefox-driver-2.44.0.jar
weibo3.2\lib\selenium-htmlunit-driver-2.44.0.jar
weibo3.2\lib\selenium-ie-driver-2.44.0.jar
weibo3.2\lib\selenium-java-2.44.0.jar
weibo3.2\lib\selenium-remote-driver-2.44.0.jar
weibo3.2\lib\selenium-safari-driver-2.44.0.jar
weibo3.2\lib\selenium-support-2.44.0.jar
weibo3.2\lib\serializer-2.7.1.jar
weibo3.2\lib\slf4j-api-1.7.9.jar
weibo3.2\lib\slf4j-log4j12-1.7.9.jar
weibo3.2\lib\sqljdbc4.jar
weibo3.2\lib\webbit-0.4.14.jar
weibo3.2\lib\WebCollector-2.24.jar
weibo3.2\lib\WeiboBot-1.0-SNAPSHOT.jar
weibo3.2\lib\xalan-2.7.1.jar
weibo3.2\lib\xercesImpl-2.11.0.jar
weibo3.2\lib\xml-apis-1.4.01.jar
weibo3.2\src\cn\edu\hfut\dmic\webcollector\example\test.java
weibo3.2\src\cn\edu\hfut\dmic\webcollector\example\TestCrawler.java
weibo3.2\src\cn\edu\hfut\dmic\webcollector\example\WeiboCN.java
weibo3.2\src\cn\edu\hfut\dmic\webcollector\example\WeiboCrawler.java
weibo3.2\src\com\x\s\dao\Crawldao.java
weibo3.2\src\com\x\ss\DataColumn.java
weibo3.2\src\com\x\ss\DataRow.java
weibo3.2\src\com\x\ss\DataTable.java
weibo3.2\src\com\x\ss\DBHelper.java
weibo3.2\src\com\x\ss\Test.java
weibo3.2\src\com\x\ss\test11.java
weibo3.2\test\00000000.jdb
weibo3.2\test\je.info.0
weibo3.2\test\je.lck
weibo3.2\test_crawler\00000000.jdb
weibo3.2\test_crawler\je.info.0
weibo3.2\test_crawler\je.lck
weibo3.2\weibo_crawler\00000006.jdb
weibo3.2\weibo_crawler\00000007.jdb
weibo3.2\weibo_crawler\00000008.jdb
weibo3.2\weibo_crawler\00000009.jdb
weibo3.2\weibo_crawler\je.info.0
weibo3.2\weibo_crawler\je.info.0.lck
weibo3.2\weibo_crawler\je.lck
weibo3.2\src\cn\edu\hfut\dmic\webcollector\example
weibo3.2\bin\cn\edu\hfut\dmic\webcollector
weibo3.2\src\cn\edu\hfut\dmic\webcollector
weibo3.2\bin\cn\edu\hfut\dmic
weibo3.2\bin\com\x\s\dao
weibo3.2\src\cn\edu\hfut\dmic
weibo3.2\src\com\x\s\dao
weibo3.2\bin\cn\edu\hfut
weibo3.2\bin\com\x\s
weibo3.2\bin\com\x\ss
weibo3.2\src\cn\edu\hfut
weibo3.2\src\com\x\s
weibo3.2\src\com\x\ss
weibo3.2\bin\cn\edu
weibo3.2\bin\com\x
Download