Description: A web crawler (also known as a web spider or web robot) is a program or automated scriptwhich browses the in a methodical, automated manner. Other less frequently used names forweb crawlers are ants, automatic indexers, bots, and worms (Kobayashi and Takeda , 2000). source.
File list (Check if you may need any files):
Download