cpet/openbsd-ports
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4b01747aa5
openbsd-ports/net
History
obecian 4b01747aa5 crawl-0.1b import - provos@ ok 
The crawl utility starts a depth-first traversal of the web at the
specified URLs.  It stores all JPEG images that match the configured
constraints. Crawl is fairly fast and allows for graceful termination. 
After terminating crawl, it is possible to restart it at exactly the
same spot where it was terminated. Crawl keeps a persistent database
that allows multiple crawls without revisiting sites.

The main reason for writing crawl was the lack of simple open source
web crawlers. Crawl is only a few thousand lines of code and fairly
easy to debug and customize. 

Features

+ Saves encountered JPEG images 
+ Image selection based on regular expressions and size contraints 
+ Resume previous crawl after graceful termination 
+ Persistent database of visited URLs 
+ Very small and efficient code 
+ Supports robots.txt
2001-09-09 21:57:12 +00:00
..
aggregate update to v1.3. from MAINTAINER. 2001-05-18 15:26:08 +00:00
angst
archie net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
ari-yahoo net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
arpcatch *) install documentation 2001-04-20 07:53:01 +00:00
arping Update to 1.00. 2001-08-15 13:19:56 +00:00
arpwatch - update to v2.1a11 2001-06-01 23:36:31 +00:00
axyftp sync with PKGNAME and USE_MOTIF correction from -stable 2001-06-05 20:28:24 +00:00
balance - update to balance-2.28 2001-07-21 19:11:33 +00:00
bind8
bind9 improved enable-script 2001-08-21 18:00:25 +00:00
bing net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
bitchx better way of making up PKGNAME, make use of :L variable modifier. 2001-05-06 19:29:21 +00:00
bnc net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
centericq - correct version string in the manual page 2001-08-19 07:25:00 +00:00
cidr net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
clog net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
courtney s/packetstorm.securify.com/packetstormsecurity.org/g; okay bmc@ 2001-07-22 19:39:58 +00:00
crawl crawl-0.1b import - provos@ ok 2001-09-09 21:57:12 +00:00
ctrace Update to 0.8. 2001-08-30 12:29:14 +00:00
curl upgrade to Curl 7.7.3 2001-05-30 16:01:15 +00:00
cvsup Grrr, use the right patch. 2001-06-02 22:43:51 +00:00
dlint - jsyn@nthought.com -> jsyn@openbsd.org 2001-07-21 20:46:58 +00:00
doc update to v2.2.3; BSD-license added by author 2001-07-25 11:03:09 +00:00
dxpc Modernize 2001-04-08 17:06:05 +00:00
epic4 update to the currently available help tarball. 2001-08-18 05:58:49 +00:00
ethereal workaround sh bug, ok jakob@ 2001-08-23 07:44:08 +00:00
ettercap ettercap-0.5.4 update 2001-07-27 03:34:27 +00:00
everybuddy remove 2 @dirrm's 2001-08-30 21:27:16 +00:00
firewalk net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
flow-tools update to v0.55 2001-09-04 15:22:14 +00:00
fping Fix EXTRACT_CASES as workaround to handle poorly-named distfiles 2001-08-05 20:46:50 +00:00
ftpcopy Update to ftpcopy-0.3.9; from maintainer 2001-07-04 16:30:32 +00:00
gaim - Update to 0.11.0pre14. 2001-07-30 10:41:39 +00:00
gated MASTER_SITES fix by Heikki Korpela <heko@saitti.net>: 2001-07-13 11:23:37 +00:00
gnut Import of gnut-0.4.27 2001-09-07 05:44:32 +00:00
gtk-gnutella initial import of gtk-gnutella-0.12: 2001-06-07 18:45:32 +00:00
hping net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
httptunnel
icb Make paging *not* be the default. Also regenerate patches with new naming 2001-05-14 16:42:49 +00:00
icecast add a comment to doucment a few ports which use pthreads 2001-08-30 02:10:40 +00:00
icmpinfo net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
ipcheck update net/ipcheck to 0.116 2001-06-13 15:35:15 +00:00
iperf remove leading "a" and "an" from COMMENT 2001-09-09 17:56:59 +00:00
ipfm move COMMENT to Makefile 2001-03-29 10:14:27 +00:00
iplog * integrated COMMENT 2001-04-12 15:59:15 +00:00
irc * added ipv6 flavor (if ipv6 is enabled, ipv4 does not work) 2001-04-20 07:31:35 +00:00
ircII distfile has been moved on the distsite 2001-08-22 02:03:56 +00:00
irssi +COMMENT; pointed out by Joshua Stein <jcs@rt.fm> 2001-04-20 23:45:12 +00:00
jftpgw upgrade to jftpgw 0.12.0 2001-08-09 14:17:42 +00:00
kmago /usr/local -> ${LOCALBASE} 2001-08-02 13:54:52 +00:00
kxicq2 Initial import of kxicq2-0.0.6 2001-07-15 09:28:29 +00:00
ldistfp Import of ldistfp 0.1.4. 2001-08-12 20:01:44 +00:00
lftp - upgrade to version 2.4.3 2001-09-08 06:43:10 +00:00
libnet fix configure.in so that libnet-config is actually useful, as requested by Matt Behrens <matt@zigg.com>. 2001-06-04 05:50:51 +00:00
libnids net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
libst initial import of net/libst 1.2: 2001-08-15 16:47:07 +00:00
licq Fixed dep on qt. Noticed by Alex Farber. 2001-07-08 10:53:21 +00:00
micq upgrade to version 0.4.7 2001-07-25 16:13:01 +00:00
mirror Small fixes for mirror port attached: 2001-07-25 14:06:22 +00:00
mrtd more ports which use or can use pthreads 2001-08-30 02:24:52 +00:00
mrtg upgrade to mrtg 2.9.12a 2001-06-02 02:40:09 +00:00
mtr add ugly workaround to build without gtk 2001-07-18 23:09:15 +00:00
nam remove leading "the" from COMMENT 2001-09-09 18:14:51 +00:00
nbtscan net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
ncftp o Upgrade to ncftp 3.0.3 2001-08-07 17:11:58 +00:00
ndiff * integrated COMMENT 2001-04-12 15:59:15 +00:00
nemesis nemesis-1.32 update 2001-06-24 18:41:19 +00:00
netatalk copy file from files/ dir instead of patching it into existence 2001-08-16 03:23:21 +00:00
netpipes tidy up Makefile 2001-05-21 00:11:19 +00:00
ngrep upgrade to version 1.40 2001-06-12 07:20:08 +00:00
nmap update to 2.54b25 2001-06-05 11:27:56 +00:00
ns remove leading "the" from COMMENT 2001-09-09 18:14:51 +00:00
nslint net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
nsping net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
ntop net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
ntp update to ntp 4.1.0 2001-08-10 19:08:51 +00:00
oproute - jsyn@nthought.com -> jsyn@openbsd.org 2001-07-21 20:46:58 +00:00
p5-libnet net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
p5-Net-Daemon upgrade to version 0.35 2001-05-20 12:48:27 +00:00
p5-Net-DNS - integrate COMMENT 2001-03-28 10:05:32 +00:00
p5-Net-IPv4Addr Initial import of Net-IPv4Addr-0.10 2001-07-21 04:13:51 +00:00
p5-Net-IRC fix mismatching IPv6 numeric address 2001-07-15 09:45:35 +00:00
p5-Net-ParseWhois update checksums to 0.62 as well 2001-09-09 17:32:50 +00:00
p5-Net-Pcap Use MACHINE_ARCH instead of ARCH in PLIST for m68k-based architectures. 2001-05-10 19:20:40 +00:00
p5-Net-RawIP Switch my email over @openbsd.org. 2001-05-09 23:26:16 +00:00
p5-Net-Whois update my e-mail address and add a VERSION var 2001-09-07 22:26:36 +00:00
p5-PlRPC Use MACHINE_ARCH instead of ARCH in p5-* dependencies. 2001-05-10 22:11:27 +00:00
pcapmerge * integrated COMMENT 2001-04-12 15:59:15 +00:00
pchar pchar-1.4 2001-06-13 23:22:36 +00:00
pdnsd add a comment to doucment a few ports which use pthreads 2001-08-30 02:10:40 +00:00
pop3gwd net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
popa3d mark with COMES_WITH 2001-08-18 20:57:43 +00:00
pptp Fix broken HOMEPAGE link 2001-07-25 04:17:49 +00:00
proxy-suite MASTER_SITES fix by Heikki Korpela <heko@saitti.net>: 2001-07-13 11:23:37 +00:00
queso net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
quirc upgrade to version 0.9.82 2001-08-11 15:49:11 +00:00
radiusd-cistron bump NEED_VERSION and integrate COMMENT 2001-03-28 19:35:25 +00:00
radiusd-lucent bump package revision to p1; from naddy@ 2001-08-15 19:16:20 +00:00
rain maintenance update; from maintainer 2001-08-01 10:06:08 +00:00
roxirc Initial import of roxirc 1.72 2001-04-17 15:28:54 +00:00
rrdtool - sync libtool patches 2001-08-10 19:36:31 +00:00
rsync MASTER_SITES fix by Heikki Korpela <heko@saitti.net>: 2001-07-13 11:23:37 +00:00
samba Don't try to enable Samba's ACL support when we do not have ACLs in 2001-09-01 20:13:28 +00:00
sharity-light Remove deprecated LICENSE_TYPE and set appropriate # comments 2001-06-20 01:43:11 +00:00
sing update to sing 1.1 2001-05-22 18:18:50 +00:00
sirc fmt -w 60 2001-06-25 01:44:59 +00:00
slirp Remove deprecated LICENSE_TYPE and set appropriate # comments 2001-06-20 01:43:11 +00:00
sniffit MASTER_SITES fix by Heikki Korpela <heko@saitti.net>: 2001-07-13 11:23:37 +00:00
snort * added information about avail flavors 2001-08-16 14:02:46 +00:00
ssldump
tacacs+ fix PLIST; pointed out by naddy@ 2001-08-10 04:59:41 +00:00
tcpflow net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
tcpreplay net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
tcpshow - sync MASTER_SITE with new FreeBSD-local one 2001-04-18 23:35:41 +00:00
tcpslice * integrated COMMENT 2001-04-12 15:59:15 +00:00
tcpstat net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
tcptrace net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
tcptraceroute Remove workarounds for 2.9 <net/if.h> multiple inclusion bug. 2001-08-17 18:57:40 +00:00
thcrut import THC-RUT, local network discovery tool 2001-07-18 20:30:43 +00:00
tightvnc initial import of tightvnc-1.2.0: 2001-09-08 00:38:11 +00:00
tintin++ net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
tinyfugue net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
tircproxy mark BROKEN, requires IPF. 2001-08-21 21:15:25 +00:00
tkirc upgrade to version 2.46 2001-08-11 15:44:34 +00:00
totd update to 1.2. 6to4 reverse lookup support, more pedantic about buffer length 2001-06-22 13:28:49 +00:00
trafd remove leading "the" from COMMENT 2001-09-09 18:14:51 +00:00
trafshow add HOMEPAGE. 2001-07-26 06:31:05 +00:00
ttcp tcp/udp pipe measuring tool; from sgi via freebsd port; brad@ help and ok 2001-05-08 03:58:14 +00:00
ucd-snmp sync libtool patches 2001-08-10 19:53:18 +00:00
ucspi-unix net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
udptunnel UDPTunnel is a small program which can tunnel UDP packets bi-directionally 2001-09-06 20:55:19 +00:00
uucp add mail to categories. 2001-07-13 20:16:15 +00:00
vnc - viewer subpackage, suggested by Joshua Stein <jcs@rt.fm> 2001-06-01 23:44:47 +00:00
vtun takeover as MAINTAINER 2001-05-23 21:23:25 +00:00
wget end the sentence with a period. 2001-09-06 04:02:24 +00:00
wide-dhcp net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
wmnet Maintainer update: 2001-04-14 02:49:45 +00:00
wmwave Now that ports is tracking -current, this patch brings wmwave up to 2001-08-17 16:04:23 +00:00
xarchie net: integrate COMMENT, bump NEED_VERSION. 2001-05-06 04:59:54 +00:00
xchat - Bump VERSION 2001-09-02 05:02:47 +00:00
xprobe xprobe-0.0.1p1 import 2001-07-26 02:09:47 +00:00
yafc update to yafc-0.7.3 2001-08-11 00:53:58 +00:00
ytalk bye bye comment 2001-05-05 21:41:53 +00:00
zebra Update to 0.92a - quick bugfix release for ^$ patch matching - see below. 2001-08-21 10:10:20 +00:00
Makefile remove cvsup-bin: 1 billion seconds epoch bug, no update forthcoming 2001-09-09 21:45:04 +00:00