Description: Simple collection reptiles# 1. I only went for a collection of url feature, if you need the data storage, you can write parseData handling code inside a function# 2. Need to sqlite3 or pysqlite support# 3. DreamHost.com space to run in# 4. can modify the User-Agent posing as search engine spiders# 5. you can set the pause time, control of acquisition speed
To Search:
File list (Check if you may need any files):
collect.py
Download