14 lines
521 B
Plaintext
14 lines
521 B
Plaintext
Gungho is Yet Another Web Crawler Framework, aimed to be extensible
|
|
and fast.
|
|
|
|
Gungho tries to build from clean structures, based upon principles
|
|
from the likes of Catalyst and Plagger, so that you can easily
|
|
extend it to your liking.
|
|
|
|
Features such as robot rules handling (robots.txt) and request
|
|
throttling can be removed/added on the fly, just by specifying
|
|
the components that you want to load. You can easily create
|
|
additional functionality by writing your own component.
|
|
|
|
WWW: http://search.cpan.org/dist/Gungho/
|