freebsd-ports/www/webcrawl
Bill Fumerola 641e13807e WebCrawl is a program designed to download an entire web-site without
user interaction (although an interactive mode is available). It works simply
by starting with a single web page, and following all links from that page
to attempt to recreate the directory structure on the remote server.

PR:		ports/9846
Submitted By:	Dima Sivachenko <dima@Chg.RU>
1999-02-03 21:26:59 +00:00
..
files WebCrawl is a program designed to download an entire web-site without 1999-02-03 21:26:59 +00:00
distinfo WebCrawl is a program designed to download an entire web-site without 1999-02-03 21:26:59 +00:00
Makefile WebCrawl is a program designed to download an entire web-site without 1999-02-03 21:26:59 +00:00
pkg-comment WebCrawl is a program designed to download an entire web-site without 1999-02-03 21:26:59 +00:00
pkg-descr WebCrawl is a program designed to download an entire web-site without 1999-02-03 21:26:59 +00:00
pkg-plist WebCrawl is a program designed to download an entire web-site without 1999-02-03 21:26:59 +00:00