CodeBus
www.codebus.net
Search
Sign in
Sign up
Hot Search :
Source
embeded
web
remote control
p2p
game
More...
Location :
Home
Search - sqlite3
Main Category
SourceCode
Documents
Books
WEB Code
Develop Tools
Other resource
Search - sqlite3 - List
[
Search Engine
]
collect
DL : 0
简易采集爬虫 # 1.我只做了一个收集url的功能,如果需要将数据入库,可在 parseData 函数里面写处理代码 # 2.需要sqlite3或者pysqlite支持 # 3.可以在DreamHost.com空间上面运行 # 4.可以修改User-Agent冒充搜索引擎蜘蛛 # 5.可以设置暂停的时间,控制采集速度-Simple collection reptiles# 1. I have only had a collection of url feature, if you need the data storage, you can write parseData handling code inside a function# 2. Need to sqlite3 or pysqlite support# 3. Can DreamHost.com space to run# 4. can modify the User-Agent posing as search engine spiders# 5. you can set the pause time, control of acquisition speed
Date
: 2025-12-31
Size
: 5kb
User
:
wangyh123
[
Search Engine
]
Simple-collection-of-reptiles
DL : 0
简易采集爬虫 # 1.我只做了一个收集url的功能,如果需要将数据入库,可在 parseData 函数里面写处理代码 # 2.需要sqlite3或者pysqlite支持 # 3.可以在DreamHost.com空间上面运行 # 4.可以修改User-Agent冒充搜索引擎蜘蛛 # 5.可以设置暂停的时间,控制采集速度- Simple collection of reptiles # 1 I just made a collection of URL function, if the data need to be put in storage, can be written in parseData function inside the processing code # 2 requires SQLite3 or pysqlite support # 3 can be run in DreamHost.com space # 4 can modify User-Agent posing as a search engine spider # 5 can set pause time, control the acquisition speed
Date
: 2025-12-31
Size
: 4kb
User
:
jt
CodeBus
is one of the largest source code repositories on the Internet!
Contact us :
1999-2046
CodeBus
All Rights Reserved.