Commit Graph

2813 Commits

Author SHA1 Message Date
espie
e6a94f281b when checksumming existing files work, remove a possible .part 2011-07-14 11:03:35 +00:00
espie
22f2dd40c8 give a bigger weight to unknown paths 2011-07-14 11:03:13 +00:00
espie
a76e6ce09c turn on -f2 by default 2011-07-14 11:02:50 +00:00
espie
9c3c2eeb2c document fetch jobs properly, spell out that dpb is also useful on a single
MP machine, show examples of lines displayed by dpb, document the extra
files produced by fetch. Explain how fetch works (in particular, the *.part
files and the use of ftp -C).
2011-07-14 10:48:32 +00:00
espie
904b7b580f for depends, always run checks on fullpkgname vs pkgspec upfront.
exit if the dependency doesn't match.
then do the actual dependency and the normal tests.

stop looking at full pkgnames list, makes no sense, even configure depends
can use the required ,-subpackage if they want.

This allows stuff such as BUILD_DEPENDS = dir>=5.0:configure
to get out early if the tree is not uptodate, instead of first configuring
then getting out (problem noticed by landry@).

tested by landry@ and jasper@
2011-07-12 10:04:00 +00:00
ajacoutot
9c199e02f7 When cleaning packages, remove the ones under PORTSDIR/update as well.
ok jasper@ sthen@ espie@
2011-07-12 08:08:01 +00:00
ajacoutot
6ebe2cec7c Make the xz warning fit on one line. 2011-07-12 04:26:47 +00:00
jasper
062d55772c xz doesn't need gcc3 anymore on sparc, so no need to scare people anymore
about it being a pain to build on sparc.
2011-07-11 12:21:53 +00:00
okan
c0ee56f8b9 reserve for mail/milter-checkrcpt 2011-07-11 12:02:17 +00:00
jasper
86c815a76b - move arm platforms to GCC4_ARCHS
- zap mvmeppc
2011-07-10 17:15:08 +00:00
ajacoutot
05e8dc465b Move sparc from GCC2_ARCHS to GCC4_ARCHS.
"sounds like a good plan to me" sthen@
2011-07-08 22:44:16 +00:00
naddy
f551b57bc3 treat .tgz like .tar.gz for extraction and don't rely on the fallback 2011-07-08 05:17:40 +00:00
sthen
14e3fda149 Add infrastructure for ccache in port builds.
"now is probably a good time to commit" espie@
2011-07-05 15:11:20 +00:00
jasper
cbea3481fb remove an ex-gnome mirror 2011-07-04 17:50:49 +00:00
sthen
46e584201e reserve user for owamp 2011-06-28 23:32:08 +00:00
espie
38ada0432c expose print-package-args and friends
create an all-lib-depends-args target that's ways less hackish
than _print-plist-with-extra-depends
for port-lib-depends-check
2011-06-26 14:40:21 +00:00
espie
b71c54aa8d clean-up 2011-06-24 14:44:05 +00:00
espie
2a43e0ad2a optimize newwantlib:
- if _DEPRUNLIB is empty, there's no need for any computation since the
result will be empty.

- zap the loop on _LIB4* for port-wantlib-args, as run-dir-depends already
grabs them.

- expose wantlib_args and corresponding targets for pkg_create to take
advantage of.

- add a dirty way for developers to waive the fake vs. ports check (PLEASE
use with EXTRA CAUTION).
2011-06-24 14:34:15 +00:00
naddy
dbfd750590 Cope with bsd.man.mk changes and install source man pages.
While here, also update some PLISTs, fix PREFIX use, etc.
ok landry@
2011-06-23 22:50:26 +00:00
espie
78782b3f3f turns out WKRDIR is not quite as constant as I wished...
found out by naddy@
2011-06-23 22:03:15 +00:00
espie
e428771bff decent error message 2011-06-23 21:49:18 +00:00
sthen
9ba14c5280 belatedly reserve a uid for net/scamper 2011-06-23 07:38:20 +00:00
espie
bab62dbd7b cheat a little, get FULLPKGNAME to backsubst early
"fix" fullname: subst things to find about / at beginning of name
2011-06-22 12:55:26 +00:00
espie
fb83b9e131 oops 2011-06-21 17:11:45 +00:00
espie
ad884b7af4 save the wantlibs into files before comparison and give a more useful
error message. This was always intended, I wanted to make things work
before making them beautiful.
2011-06-21 17:04:32 +00:00
ajacoutot
6d887d4df5 Reserve a seat for the _gdm user. 2011-06-21 07:55:59 +00:00
sthen
aba9bf41b5 use CTAN's mirror-director as the first entry in MASTER_SITE_TEX_CTAN. 2011-06-18 10:35:53 +00:00
espie
3fde18c238 zap old legacy compat with old depends with lots of leading ::: 2011-06-15 16:31:11 +00:00
espie
a307462266 fix some limitations of _print-package-args
* cut it into separate targets for readability and better testing
* filter libraries more efficiently
* use internal variable for resolve-lib

create two targets for solving wantlib: one (_fake-wantlib-args) which uses
the information under the fake directory and installed packages, and another
(_port-wantlib-args) which walks packing-lists. The second one can be used
to collect meta-info even when nothing is installed, and thus provide better
package-signature accuracy, or help with lib-depends-check.
The first one uses what's actually in place when a package is built.
For now, we're paranoid and use both when building a package, erroring out
if they don't match, even though _port-wantlib-args is somewhat slower.
2011-06-15 16:29:48 +00:00
espie
2cf4d84ffd fix a long-standing bug: add LIB_DEPENDS to the RUN_DEPENDS of a port, as
there's a safeguard against self-depends anyways.
This prevents ports from getting moved from "built" to "installable"
prematurely.

For instance, devel/libsoup,-gnome doesn't directly depend on
net/glib2-networking, but it depends on devel/libsoup,-main which has
the net/glib2-networking.

Without this patch, dependencies on devel/libsoup,-gnome would often build
prematurely and build net/glib2-networking with them.
2011-06-15 10:09:31 +00:00
espie
755907c973 parse regression info if present 2011-06-15 10:06:22 +00:00
ajacoutot
9a1900b8e5 Sync. 2011-06-13 07:05:15 +00:00
ajacoutot
f8a6314f8a Reserve a first class seat for the _tryton user. 2011-06-09 18:00:07 +00:00
espie
91419bfb7c spaces 2011-06-04 12:58:24 +00:00
espie
64fc6d3cf2 keep a better list of depends, so that pkg_add does add exactly what it should 2011-06-04 12:56:54 +00:00
espie
8579c8b7c3 do the fetch stuff very early, in new_path. 2011-06-03 13:38:58 +00:00
espie
9ba6fb7c5c - unify code in Fetch/Build subengines
- zap heuristic#3, not critical
- don't rebuild the Fetch queue all the time, it's too expensive
- fix bugs in FetchQueue computation, correctly handle 1 distfile case
- create a quick path thru adjust* that handles only new paths.
- use it during LISTING while fetching files, to make more files available
quicker.
- model distfiles as FDEPENDS, DIST, so that they can get dumped.
- add -v option that dumps a bit more stuff in log files.

with these, dpb will fetch all distfiles in a not too surprising order,
and it won't consume 40% cpu while doing so...
2011-06-02 17:09:25 +00:00
espie
0594474469 if stuff does not resolve, show a better error message, to help people
with broken symlinks
2011-06-02 17:00:14 +00:00
naddy
297ddb4ef7 add --disable-silent-rules for CONFIGURE_STYLE=gnu; ok kili@ 2011-06-02 15:54:10 +00:00
ajacoutot
70b2a8d326 Extended README.template.
ok jasper@ sthen@
2011-06-02 13:44:40 +00:00
espie
7d68d7e282 add stuff to do quick_dump of distinfo eventually 2011-06-02 11:53:55 +00:00
ajacoutot
06abdaec00 Punctuation in the xz WARNING. 2011-06-01 16:04:12 +00:00
espie
be6847e3c2 avoid fetching distfiles where we don't know dependencies yet 2011-06-01 15:39:47 +00:00
espie
72c6360806 optimize heuristics for fetchqueue, as they take too much time 2011-06-01 12:34:29 +00:00
espie
647950c27f typo, duplicate work 2011-06-01 12:34:09 +00:00
espie
e5e8d25a93 initial support of xz, to be polished.
most important part is nagging the user that this WILL not build on
some architectures and be very inconvenient on some others.
2011-06-01 12:04:06 +00:00
espie
1e22893e8e if we -f -a, then scan SUPBDISTFILES too, and use the Distfile cache
to write a list of all known distfiles, that can be used to remove extra
stuff from /usr/ports/distfiles
2011-05-29 11:06:23 +00:00
espie
84266ee8ac if we're running -f, do the checksum part internally, since we already
checksummed stuff we fetched (will allow auto-refetch eventually).
2011-05-29 09:30:13 +00:00
espie
aeae163983 oops, the Builder is one indirection down now 2011-05-28 19:32:59 +00:00
espie
3f2603c2f3 fix unlocking in case of errors 2011-05-28 19:24:15 +00:00
espie
9f989ffafe fix 2011-05-28 08:21:39 +00:00
espie
f4d6937978 nicer lockname 2011-05-27 13:13:43 +00:00
espie
2fd23899dd explain the dump_dependencies/find_best optimization for quick-restarting
dpb.
2011-05-27 11:22:13 +00:00
espie
7ef05495f5 start moving the fetch/build code into separate subengine classes, to make
it more obvious how much is shared (goal is to unify a large part of these).

In particular, the locking code/stuff already active is glaringly the same...

Polish the distfiles measurements. For now, 3 heuristics that kick in
at various stages of the build (a bit of black magic).

Fix pkgpath->{has} to record both "no dependencies" and "several distfiles
missing" to avoid grabbing small patchfiles which don't lead to valid
builds while heuristic#1 is active.
2011-05-27 10:27:50 +00:00
espie
a819e7f3e8 improved fetch: do checksum as a separate process, to avoid freezing
dpb while checksumming huge tarballs.
Use ftp -C in a systematic way, more complicated logic as to when to
remove temp files, when to keep them: if core exited okay, wrong size
is very bad. If checksum failed on a partial fetch, retry same site with
an empty file...
2011-05-23 09:44:05 +00:00
espie
0c1194b39b only check checksum if we just fetched it, for now. 2011-05-22 09:19:08 +00:00
espie
d2a3a0fa83 dyslexia 2011-05-22 09:06:49 +00:00
espie
fbfc4fba47 fix checksum logging, avoid checksumming twice 2011-05-22 09:01:27 +00:00
espie
8cef021866 initial support for fetching distfiles, somewhat experimental yet.
- clean up clock handling, jobs with timer.
- pass more parameters thru state
- tweak the engine to handle distfiles
- lots of new code in Fetch for new jobs.
2011-05-22 08:21:38 +00:00
sthen
62b6eeb220 ...and fix the path :/ 2011-05-17 09:17:44 +00:00
sthen
1df156eb29 add a mysql mirror which carries old versions to the top of the list. 2011-05-17 09:17:02 +00:00
espie
6fc3e924f5 dpb -f will need FETCH_MANUALL to tell people to fetch those 2011-05-16 23:40:24 +00:00
sthen
068886bea6 treat -all-static like -static; fixes sysutils/nut CGI scripts which
should be linked statically as reported by David Talkington. Tested with
all ports showing in bulk build logs as using -all-static.

"that looks ok for our needs" steven@
2011-05-16 20:09:54 +00:00
sthen
8659e4faad Remove code to support FreeBSD emulation, ok espie@ 2011-04-25 23:01:03 +00:00
espie
afdb81839a finish refactoring options.
Deprecate: -t and -T
use -DCONNECTION_TIMEOUT=... -DDISPLAY_TIMEOUT=... instead
New feature: -DSTUCK_TIMEOUT=
kill tasks when they don't show any progress for that long.
2011-04-25 11:58:46 +00:00
espie
cd0ba747ac more option handling refactoring 2011-04-24 09:14:45 +00:00
espie
41d3fc886a move $heuristics into $state 2011-04-24 08:34:05 +00:00
espie
69684267b3 get options to parse 2011-04-24 08:07:02 +00:00
espie
2ad5e5806c refactor options slightly 2011-04-24 08:02:07 +00:00
kili
9862026031 Fix missing quote around $$pkg.
ok espie@
2011-04-23 08:25:50 +00:00
eric
9e4712f0ce reserve 673 for devel/py-buildbot and 674 for devel/py-buildslave 2011-04-21 10:26:15 +00:00
espie
66650886f9 okay, we're dpb and no longer dpb3 2011-04-18 14:00:57 +00:00
espie
e7a4ca8c8a ignore whitespace 2011-04-18 11:40:23 +00:00
espie
bdca4a9a30 prefer the V- version for non-MULTI_PACKAGES vars.
fixes E on libf2c-old on i386.
2011-04-16 12:21:44 +00:00
espie
ab5cd9d6f3 redo the IGNORE dance in a smarter way:
derive IGNORE-sub from IGNORE, and then test IGNORE-sub

Define complete value for IGNORE very late, _MULTI_PACKAGES trimming only
requires subpackage-specific info.

fix bug in describe, correctly differentiate  between empty and !defined
ONLY_FOR_ARCHS.
2011-04-16 10:31:20 +00:00
sthen
b0753d8ede reserve 672 for radicale 2011-04-15 15:45:43 +00:00
sthen
f2384050ef - factor ftp.isc.org MASTER_SITES into a common MASTER_SITE_ISC
- add more mirrors, prefer http
2011-04-14 13:47:59 +00:00
espie
b5b62e9c6b if we don't have rights to write into lockdir, it's generally bad news, avoid
getting stuck.

work with Stefan Rinkes.
2011-04-13 08:37:16 +00:00
sthen
11d3ebd270 switch various sites to http, remove some dead mirrors 2011-04-12 08:20:49 +00:00
sthen
b995a05578 - add backpan.perl.org to MASTER_SITE_PERL_CPAN, allowing many of the
outdated perl modules to be fetched

- list http://ftp.cpan.org before ftp://ftp.cpan.org
2011-04-12 08:19:09 +00:00
jasper
eaf9dad616 remove USE_MOTIF bits
ok aja@ sthen@
2011-04-10 17:55:41 +00:00
espie
953361b9c4 in case we log errors, go to the next iteration correctly.
log the fullpkgpath explicitly when we can.
2011-04-05 08:24:34 +00:00
espie
1c93a7f734 auto-complete build dir with arch and build.log 2011-04-05 08:23:00 +00:00
espie
c37a0a8a83 define IGNORE${SUBPACKAGE} for each SUBPACKAGE.
Prevents dpb from building subpackages that are NOT_FOR_ARCHS or
ONLY_FOR_ARCHS, as tested by quite a few porters.
2011-04-03 07:19:05 +00:00
dcoppa
7a21149796 reserve user 671 for audio/umurmur. 2011-04-01 09:26:33 +00:00
fgsch
9de2e424ca reserve user 670 for mongodb. 2011-03-31 22:57:36 +00:00
ajacoutot
cf60133b72 Reserve uid/gid 669 for the _rsync user.
req. by lazy sthen@ :)
2011-03-29 08:59:40 +00:00
sthen
b8e98d1fc5 whitespace 2011-03-29 08:36:20 +00:00
fgsch
f33f72e660 add repackage to the recursive targets.
with input and ok espie@
2011-03-28 00:16:13 +00:00
ian
f2c970dee9 Reserve userid for jenkins 2011-03-25 19:33:16 +00:00
sthen
2a528a8285 reserve id for forthcoming net/icinga port 2011-03-24 11:10:28 +00:00
espie
c7b6b23044 tweak logic slightly to avoid duplicate error messages which make no sense 2011-03-22 19:56:51 +00:00
espie
d76bdca371 tweak to allow subclasses of cores that get their own separate lists
(such as local fetcher jobs)
2011-03-22 19:49:56 +00:00
espie
cabe19ad60 tidy, minor 2011-03-22 19:48:53 +00:00
espie
fc9fbe61ee add the glue that parses fetch info and build distinfo for future fetching.
also let Vars report stuff it doesn't know about to the logs file.
2011-03-22 19:48:01 +00:00
sthen
f2a4621965 reserve id for _dovenull for a future mail/dovecot update. 2011-03-22 15:21:11 +00:00
sthen
fc8ddee2f7 adjust the BUILD_DEPENDS for USE_GROFF to require 1.21; ok espie@ 2011-03-21 09:38:53 +00:00
espie
e544151d8e allow things to proceed after flavor_fragment in SUBDIR handling.
Also puts the FULLPKGPATH in extra_msg to figure out where bad dependencies
come from
2011-03-20 19:28:07 +00:00
ajacoutot
162c4d100f Simplify: PROJECT FOO -> FOO.
ok jasper@
2011-03-18 12:53:21 +00:00
edd
3886b06cfd add _hgd for audio/hgd
OK ajacoutot@
2011-03-17 14:43:54 +00:00