Commit Graph

2732 Commits

Author SHA1 Message Date
ajacoutot
9a1900b8e5 Sync. 2011-06-13 07:05:15 +00:00
ajacoutot
f8a6314f8a Reserve a first class seat for the _tryton user. 2011-06-09 18:00:07 +00:00
espie
91419bfb7c spaces 2011-06-04 12:58:24 +00:00
espie
64fc6d3cf2 keep a better list of depends, so that pkg_add does add exactly what it should 2011-06-04 12:56:54 +00:00
espie
8579c8b7c3 do the fetch stuff very early, in new_path. 2011-06-03 13:38:58 +00:00
espie
9ba6fb7c5c - unify code in Fetch/Build subengines
- zap heuristic#3, not critical
- don't rebuild the Fetch queue all the time, it's too expensive
- fix bugs in FetchQueue computation, correctly handle 1 distfile case
- create a quick path thru adjust* that handles only new paths.
- use it during LISTING while fetching files, to make more files available
quicker.
- model distfiles as FDEPENDS, DIST, so that they can get dumped.
- add -v option that dumps a bit more stuff in log files.

with these, dpb will fetch all distfiles in a not too surprising order,
and it won't consume 40% cpu while doing so...
2011-06-02 17:09:25 +00:00
espie
0594474469 if stuff does not resolve, show a better error message, to help people
with broken symlinks
2011-06-02 17:00:14 +00:00
naddy
297ddb4ef7 add --disable-silent-rules for CONFIGURE_STYLE=gnu; ok kili@ 2011-06-02 15:54:10 +00:00
ajacoutot
70b2a8d326 Extended README.template.
ok jasper@ sthen@
2011-06-02 13:44:40 +00:00
espie
7d68d7e282 add stuff to do quick_dump of distinfo eventually 2011-06-02 11:53:55 +00:00
ajacoutot
06abdaec00 Punctuation in the xz WARNING. 2011-06-01 16:04:12 +00:00
espie
be6847e3c2 avoid fetching distfiles where we don't know dependencies yet 2011-06-01 15:39:47 +00:00
espie
72c6360806 optimize heuristics for fetchqueue, as they take too much time 2011-06-01 12:34:29 +00:00
espie
647950c27f typo, duplicate work 2011-06-01 12:34:09 +00:00
espie
e5e8d25a93 initial support of xz, to be polished.
most important part is nagging the user that this WILL not build on
some architectures and be very inconvenient on some others.
2011-06-01 12:04:06 +00:00
espie
1e22893e8e if we -f -a, then scan SUPBDISTFILES too, and use the Distfile cache
to write a list of all known distfiles, that can be used to remove extra
stuff from /usr/ports/distfiles
2011-05-29 11:06:23 +00:00
espie
84266ee8ac if we're running -f, do the checksum part internally, since we already
checksummed stuff we fetched (will allow auto-refetch eventually).
2011-05-29 09:30:13 +00:00
espie
aeae163983 oops, the Builder is one indirection down now 2011-05-28 19:32:59 +00:00
espie
3f2603c2f3 fix unlocking in case of errors 2011-05-28 19:24:15 +00:00
espie
9f989ffafe fix 2011-05-28 08:21:39 +00:00
espie
f4d6937978 nicer lockname 2011-05-27 13:13:43 +00:00
espie
2fd23899dd explain the dump_dependencies/find_best optimization for quick-restarting
dpb.
2011-05-27 11:22:13 +00:00
espie
7ef05495f5 start moving the fetch/build code into separate subengine classes, to make
it more obvious how much is shared (goal is to unify a large part of these).

In particular, the locking code/stuff already active is glaringly the same...

Polish the distfiles measurements. For now, 3 heuristics that kick in
at various stages of the build (a bit of black magic).

Fix pkgpath->{has} to record both "no dependencies" and "several distfiles
missing" to avoid grabbing small patchfiles which don't lead to valid
builds while heuristic#1 is active.
2011-05-27 10:27:50 +00:00
espie
a819e7f3e8 improved fetch: do checksum as a separate process, to avoid freezing
dpb while checksumming huge tarballs.
Use ftp -C in a systematic way, more complicated logic as to when to
remove temp files, when to keep them: if core exited okay, wrong size
is very bad. If checksum failed on a partial fetch, retry same site with
an empty file...
2011-05-23 09:44:05 +00:00
espie
0c1194b39b only check checksum if we just fetched it, for now. 2011-05-22 09:19:08 +00:00
espie
d2a3a0fa83 dyslexia 2011-05-22 09:06:49 +00:00
espie
fbfc4fba47 fix checksum logging, avoid checksumming twice 2011-05-22 09:01:27 +00:00
espie
8cef021866 initial support for fetching distfiles, somewhat experimental yet.
- clean up clock handling, jobs with timer.
- pass more parameters thru state
- tweak the engine to handle distfiles
- lots of new code in Fetch for new jobs.
2011-05-22 08:21:38 +00:00
sthen
62b6eeb220 ...and fix the path :/ 2011-05-17 09:17:44 +00:00
sthen
1df156eb29 add a mysql mirror which carries old versions to the top of the list. 2011-05-17 09:17:02 +00:00
espie
6fc3e924f5 dpb -f will need FETCH_MANUALL to tell people to fetch those 2011-05-16 23:40:24 +00:00
sthen
068886bea6 treat -all-static like -static; fixes sysutils/nut CGI scripts which
should be linked statically as reported by David Talkington. Tested with
all ports showing in bulk build logs as using -all-static.

"that looks ok for our needs" steven@
2011-05-16 20:09:54 +00:00
sthen
8659e4faad Remove code to support FreeBSD emulation, ok espie@ 2011-04-25 23:01:03 +00:00
espie
afdb81839a finish refactoring options.
Deprecate: -t and -T
use -DCONNECTION_TIMEOUT=... -DDISPLAY_TIMEOUT=... instead
New feature: -DSTUCK_TIMEOUT=
kill tasks when they don't show any progress for that long.
2011-04-25 11:58:46 +00:00
espie
cd0ba747ac more option handling refactoring 2011-04-24 09:14:45 +00:00
espie
41d3fc886a move $heuristics into $state 2011-04-24 08:34:05 +00:00
espie
69684267b3 get options to parse 2011-04-24 08:07:02 +00:00
espie
2ad5e5806c refactor options slightly 2011-04-24 08:02:07 +00:00
kili
9862026031 Fix missing quote around $$pkg.
ok espie@
2011-04-23 08:25:50 +00:00
eric
9e4712f0ce reserve 673 for devel/py-buildbot and 674 for devel/py-buildslave 2011-04-21 10:26:15 +00:00
espie
66650886f9 okay, we're dpb and no longer dpb3 2011-04-18 14:00:57 +00:00
espie
e7a4ca8c8a ignore whitespace 2011-04-18 11:40:23 +00:00
espie
bdca4a9a30 prefer the V- version for non-MULTI_PACKAGES vars.
fixes E on libf2c-old on i386.
2011-04-16 12:21:44 +00:00
espie
ab5cd9d6f3 redo the IGNORE dance in a smarter way:
derive IGNORE-sub from IGNORE, and then test IGNORE-sub

Define complete value for IGNORE very late, _MULTI_PACKAGES trimming only
requires subpackage-specific info.

fix bug in describe, correctly differentiate  between empty and !defined
ONLY_FOR_ARCHS.
2011-04-16 10:31:20 +00:00
sthen
b0753d8ede reserve 672 for radicale 2011-04-15 15:45:43 +00:00
sthen
f2384050ef - factor ftp.isc.org MASTER_SITES into a common MASTER_SITE_ISC
- add more mirrors, prefer http
2011-04-14 13:47:59 +00:00
espie
b5b62e9c6b if we don't have rights to write into lockdir, it's generally bad news, avoid
getting stuck.

work with Stefan Rinkes.
2011-04-13 08:37:16 +00:00
sthen
11d3ebd270 switch various sites to http, remove some dead mirrors 2011-04-12 08:20:49 +00:00
sthen
b995a05578 - add backpan.perl.org to MASTER_SITE_PERL_CPAN, allowing many of the
outdated perl modules to be fetched

- list http://ftp.cpan.org before ftp://ftp.cpan.org
2011-04-12 08:19:09 +00:00
jasper
eaf9dad616 remove USE_MOTIF bits
ok aja@ sthen@
2011-04-10 17:55:41 +00:00