Commit Graph

2822 Commits

Author SHA1 Message Date
ajacoutot
06abdaec00 Punctuation in the xz WARNING. 2011-06-01 16:04:12 +00:00
espie
be6847e3c2 avoid fetching distfiles where we don't know dependencies yet 2011-06-01 15:39:47 +00:00
espie
72c6360806 optimize heuristics for fetchqueue, as they take too much time 2011-06-01 12:34:29 +00:00
espie
647950c27f typo, duplicate work 2011-06-01 12:34:09 +00:00
espie
e5e8d25a93 initial support of xz, to be polished.
most important part is nagging the user that this WILL not build on
some architectures and be very inconvenient on some others.
2011-06-01 12:04:06 +00:00
espie
1e22893e8e if we -f -a, then scan SUPBDISTFILES too, and use the Distfile cache
to write a list of all known distfiles, that can be used to remove extra
stuff from /usr/ports/distfiles
2011-05-29 11:06:23 +00:00
espie
84266ee8ac if we're running -f, do the checksum part internally, since we already
checksummed stuff we fetched (will allow auto-refetch eventually).
2011-05-29 09:30:13 +00:00
espie
aeae163983 oops, the Builder is one indirection down now 2011-05-28 19:32:59 +00:00
espie
3f2603c2f3 fix unlocking in case of errors 2011-05-28 19:24:15 +00:00
espie
9f989ffafe fix 2011-05-28 08:21:39 +00:00
espie
f4d6937978 nicer lockname 2011-05-27 13:13:43 +00:00
espie
2fd23899dd explain the dump_dependencies/find_best optimization for quick-restarting
dpb.
2011-05-27 11:22:13 +00:00
espie
7ef05495f5 start moving the fetch/build code into separate subengine classes, to make
it more obvious how much is shared (goal is to unify a large part of these).

In particular, the locking code/stuff already active is glaringly the same...

Polish the distfiles measurements. For now, 3 heuristics that kick in
at various stages of the build (a bit of black magic).

Fix pkgpath->{has} to record both "no dependencies" and "several distfiles
missing" to avoid grabbing small patchfiles which don't lead to valid
builds while heuristic#1 is active.
2011-05-27 10:27:50 +00:00
espie
a819e7f3e8 improved fetch: do checksum as a separate process, to avoid freezing
dpb while checksumming huge tarballs.
Use ftp -C in a systematic way, more complicated logic as to when to
remove temp files, when to keep them: if core exited okay, wrong size
is very bad. If checksum failed on a partial fetch, retry same site with
an empty file...
2011-05-23 09:44:05 +00:00
espie
0c1194b39b only check checksum if we just fetched it, for now. 2011-05-22 09:19:08 +00:00
espie
d2a3a0fa83 dyslexia 2011-05-22 09:06:49 +00:00
espie
fbfc4fba47 fix checksum logging, avoid checksumming twice 2011-05-22 09:01:27 +00:00
espie
8cef021866 initial support for fetching distfiles, somewhat experimental yet.
- clean up clock handling, jobs with timer.
- pass more parameters thru state
- tweak the engine to handle distfiles
- lots of new code in Fetch for new jobs.
2011-05-22 08:21:38 +00:00
sthen
62b6eeb220 ...and fix the path :/ 2011-05-17 09:17:44 +00:00
sthen
1df156eb29 add a mysql mirror which carries old versions to the top of the list. 2011-05-17 09:17:02 +00:00
espie
6fc3e924f5 dpb -f will need FETCH_MANUALL to tell people to fetch those 2011-05-16 23:40:24 +00:00
sthen
068886bea6 treat -all-static like -static; fixes sysutils/nut CGI scripts which
should be linked statically as reported by David Talkington. Tested with
all ports showing in bulk build logs as using -all-static.

"that looks ok for our needs" steven@
2011-05-16 20:09:54 +00:00
sthen
8659e4faad Remove code to support FreeBSD emulation, ok espie@ 2011-04-25 23:01:03 +00:00
espie
afdb81839a finish refactoring options.
Deprecate: -t and -T
use -DCONNECTION_TIMEOUT=... -DDISPLAY_TIMEOUT=... instead
New feature: -DSTUCK_TIMEOUT=
kill tasks when they don't show any progress for that long.
2011-04-25 11:58:46 +00:00
espie
cd0ba747ac more option handling refactoring 2011-04-24 09:14:45 +00:00
espie
41d3fc886a move $heuristics into $state 2011-04-24 08:34:05 +00:00
espie
69684267b3 get options to parse 2011-04-24 08:07:02 +00:00
espie
2ad5e5806c refactor options slightly 2011-04-24 08:02:07 +00:00
kili
9862026031 Fix missing quote around $$pkg.
ok espie@
2011-04-23 08:25:50 +00:00
eric
9e4712f0ce reserve 673 for devel/py-buildbot and 674 for devel/py-buildslave 2011-04-21 10:26:15 +00:00
espie
66650886f9 okay, we're dpb and no longer dpb3 2011-04-18 14:00:57 +00:00
espie
e7a4ca8c8a ignore whitespace 2011-04-18 11:40:23 +00:00
espie
bdca4a9a30 prefer the V- version for non-MULTI_PACKAGES vars.
fixes E on libf2c-old on i386.
2011-04-16 12:21:44 +00:00
espie
ab5cd9d6f3 redo the IGNORE dance in a smarter way:
derive IGNORE-sub from IGNORE, and then test IGNORE-sub

Define complete value for IGNORE very late, _MULTI_PACKAGES trimming only
requires subpackage-specific info.

fix bug in describe, correctly differentiate  between empty and !defined
ONLY_FOR_ARCHS.
2011-04-16 10:31:20 +00:00
sthen
b0753d8ede reserve 672 for radicale 2011-04-15 15:45:43 +00:00
sthen
f2384050ef - factor ftp.isc.org MASTER_SITES into a common MASTER_SITE_ISC
- add more mirrors, prefer http
2011-04-14 13:47:59 +00:00
espie
b5b62e9c6b if we don't have rights to write into lockdir, it's generally bad news, avoid
getting stuck.

work with Stefan Rinkes.
2011-04-13 08:37:16 +00:00
sthen
11d3ebd270 switch various sites to http, remove some dead mirrors 2011-04-12 08:20:49 +00:00
sthen
b995a05578 - add backpan.perl.org to MASTER_SITE_PERL_CPAN, allowing many of the
outdated perl modules to be fetched

- list http://ftp.cpan.org before ftp://ftp.cpan.org
2011-04-12 08:19:09 +00:00
jasper
eaf9dad616 remove USE_MOTIF bits
ok aja@ sthen@
2011-04-10 17:55:41 +00:00
espie
953361b9c4 in case we log errors, go to the next iteration correctly.
log the fullpkgpath explicitly when we can.
2011-04-05 08:24:34 +00:00
espie
1c93a7f734 auto-complete build dir with arch and build.log 2011-04-05 08:23:00 +00:00
espie
c37a0a8a83 define IGNORE${SUBPACKAGE} for each SUBPACKAGE.
Prevents dpb from building subpackages that are NOT_FOR_ARCHS or
ONLY_FOR_ARCHS, as tested by quite a few porters.
2011-04-03 07:19:05 +00:00
dcoppa
7a21149796 reserve user 671 for audio/umurmur. 2011-04-01 09:26:33 +00:00
fgsch
9de2e424ca reserve user 670 for mongodb. 2011-03-31 22:57:36 +00:00
ajacoutot
cf60133b72 Reserve uid/gid 669 for the _rsync user.
req. by lazy sthen@ :)
2011-03-29 08:59:40 +00:00
sthen
b8e98d1fc5 whitespace 2011-03-29 08:36:20 +00:00
fgsch
f33f72e660 add repackage to the recursive targets.
with input and ok espie@
2011-03-28 00:16:13 +00:00
ian
f2c970dee9 Reserve userid for jenkins 2011-03-25 19:33:16 +00:00
sthen
2a528a8285 reserve id for forthcoming net/icinga port 2011-03-24 11:10:28 +00:00
espie
c7b6b23044 tweak logic slightly to avoid duplicate error messages which make no sense 2011-03-22 19:56:51 +00:00
espie
d76bdca371 tweak to allow subclasses of cores that get their own separate lists
(such as local fetcher jobs)
2011-03-22 19:49:56 +00:00
espie
cabe19ad60 tidy, minor 2011-03-22 19:48:53 +00:00
espie
fc9fbe61ee add the glue that parses fetch info and build distinfo for future fetching.
also let Vars report stuff it doesn't know about to the logs file.
2011-03-22 19:48:01 +00:00
sthen
f2a4621965 reserve id for _dovenull for a future mail/dovecot update. 2011-03-22 15:21:11 +00:00
sthen
fc8ddee2f7 adjust the BUILD_DEPENDS for USE_GROFF to require 1.21; ok espie@ 2011-03-21 09:38:53 +00:00
espie
e544151d8e allow things to proceed after flavor_fragment in SUBDIR handling.
Also puts the FULLPKGPATH in extra_msg to figure out where bad dependencies
come from
2011-03-20 19:28:07 +00:00
ajacoutot
162c4d100f Simplify: PROJECT FOO -> FOO.
ok jasper@
2011-03-18 12:53:21 +00:00
edd
3886b06cfd add _hgd for audio/hgd
OK ajacoutot@
2011-03-17 14:43:54 +00:00
jasper
2a092c6b1b replace www/tidy with www/tidyp 2011-03-15 19:50:11 +00:00
landry
c55b5b25c5 Reserve uid/gid 664 for user _mdnsd 2011-03-14 20:44:24 +00:00
ajacoutot
784e269dd3 Sync with new defaults. 2011-03-10 13:46:59 +00:00
fgsch
ff8685d55c correct some paths and comment out entries for removed ports.
jasper@ ok
2011-03-10 10:00:40 +00:00
jasper
a2bd9c4335 - upstream is quite alive and kicking, but just moved their repo as pointed
out by brad. so sync.

ok sthen@
2011-03-08 17:50:44 +00:00
jasper
d0915e9b17 - recognize ppu, needed by some upcoming ports.
ok sthen@
2011-03-07 17:46:33 +00:00
jasper
4303ef58be - update config.sub to the most recent version in CVS
ok sthen@
2011-03-07 17:44:28 +00:00
espie
46fd3f5a96 use FindBin if the portsdir was moved.
fix error message
2011-03-07 10:06:36 +00:00
ajacoutot
85c95818f8 Reserve 663 for the transproxy user. 2011-03-07 07:11:52 +00:00
ajacoutot
4cc943807f Mention rc_bg. 2011-03-06 16:50:11 +00:00
ajacoutot
0cfc21efd5 rc.d(8) -> rc.subr(8). 2011-03-03 15:55:43 +00:00
naddy
74932c23e0 4.9 CD packages; databases/pkglocatedb is added by check-plist 2011-03-02 20:48:56 +00:00
jasper
872d49a562 - Use full path to ldconfig
- Adjust error message
      ok steven@
2011-03-02 08:06:33 +00:00
ajacoutot
381f7b5a63 daemon_shell is no more. 2011-03-02 06:32:53 +00:00
ajacoutot
ea4520d4c4 The _cups group is also used in ghostscript. 2011-03-02 06:32:27 +00:00
ajacoutot
223ba194c4 Brought to you by the king of slack!
Manually removing TABs is an exhausting job, so make the analyse
function output compatible for copy/paste into a port Makefile.

"yes yes yes" sthen@
ok landry@ espie@
2011-01-26 12:53:46 +00:00
espie
8865e138dc have check-common-dirs find dependencies not specified on the command line
if it can.
2011-01-17 20:08:08 +00:00
ajacoutot
c604c9ac83 Make clean=plist consistent with the other clean targets, do not error
out if the plistdb directory does not exist.

ok jasper@ espie@
2011-01-16 20:36:49 +00:00
ajacoutot
9d211806ce Add a template rc script.
rc.subr(8)/rc.d(8) is coming soon.

ok robert@
2011-01-15 19:18:48 +00:00
ajacoutot
ba61187a7a Remove colons (also known in Hungary as double dots) from sub-section
title, it looks weird.

ok jasper@
2011-01-15 19:15:21 +00:00
espie
432ae0233a moved 2011-01-11 11:31:59 +00:00
espie
20db63b5ca document 2011-01-11 11:30:47 +00:00
espie
e982ee096f print everything thru $state 2011-01-11 11:25:53 +00:00
espie
26982225cb move this too 2011-01-11 11:24:05 +00:00
espie
ac029da04c pass an extra -q to pkg_info -r... that way, we can have "the human version"
be more verbose...
2011-01-10 12:59:36 +00:00
fgsch
99cff70a54 add a _transmission user.
naddy@ ok to the net/transmission diff.
2011-01-10 08:33:04 +00:00
espie
df8ae14936 allow BUILD_DEPENDS = somepath>=version:patch
THIS REQUIRES A pkg_info WITH THE -r OPTION, e.g., current !
2011-01-09 13:07:53 +00:00
pirofti
86a67da4f9 Add some more ports for plist builds as requested by jasper@ at p2k10.
Other requests are welcomed.
2011-01-06 15:26:12 +00:00
espie
f90f6db6eb totally forgot about PATCHFILES 2011-01-04 21:54:36 +00:00
espie
34f55e5a2e check that the package name itself does not go backwards as well 2010-12-29 12:33:38 +00:00
espie
2d255d213d small hack to make these work even if PORTSDIR is not set and non-standard,
since the lib are supposed to be in the same relative location.
2010-12-29 12:28:23 +00:00
espie
f0e0a9480c pass state around 2010-12-24 10:31:40 +00:00
landry
b49d4efa43 Reserve uid/gid 661 for _aox user/group, will be needed by archiveopteryx. 2010-12-21 13:57:37 +00:00
espie
d876093129 old forgotten PKG_SPEC commit 2010-12-20 16:39:53 +00:00
espie
746282fe00 pass PORTSDIR to pkg_create so that it can check more things 2010-12-20 13:05:40 +00:00
espie
ef56915d0c - pass PORTSDIR for libtool, since people seem to want to stuff their
ports tree in weird places.
- show CHECKSUM_FILES if DPB=fetch or better.
2010-12-14 11:37:38 +00:00
espie
c6ed94f022 not sure why it happens, but log nopkgname... 2010-12-12 21:21:03 +00:00
sebastia
22f3e05d61 add userid for misc/srcpd daemon.
OK jasper@
2010-12-11 11:11:29 +00:00
espie
884b53366c dpb does not need EPOCH + REVISION 2010-12-07 11:26:37 +00:00
espie
97286a5a18 better info rebuild: make Vars responsible for creating info "just in time"
by keeping local state.
That way, when we rescan, we don't have to remove any info, and all affected
infos are replaced at the same time.
2010-12-07 10:56:26 +00:00
espie
b87d7dd53f put stuff in separate modules 2010-12-07 08:46:28 +00:00
espie
9c270c05b6 fix fix
$build_info //= 1  indeed... ;(
2010-12-06 19:35:06 +00:00
espie
ab01800701 tag dependencies discovered as pure dependencies with their parents, allow
finding out non-sensical stuff in an easier way
2010-12-06 13:20:45 +00:00
espie
d317d925fe minor warning fix 2010-12-06 13:19:44 +00:00
espie
9ed0d9cd66 move most of libtool code around. 2010-12-05 16:37:50 +00:00
espie
4d8b6b0032 allow 'dpb archivers' without extra artifacts, e.g., recognize and
handle categories without classifying them as pkgpaths with errors.
2010-12-05 10:06:12 +00:00
ajacoutot
336c24d6ba Add a default HOMEPAGE for cpan ports when none is specified.
All work including upcoming huge bump done by Mikolaj Kucharski, thanks!

ok jasper@
2010-12-03 11:43:05 +00:00
espie
abf72e33c3 SHARED_ONLY is Yes or No 2010-11-26 20:24:36 +00:00
espie
3f9f91390c teach register-plist that pkgspec-version is equivalent to pkgspec-=version 2010-11-26 07:17:10 +00:00
espie
2c0a53e285 show the old-style depend.
fix :configure depends for versions.
move PKGSPEC to !dpb dump-vars
2010-11-25 18:06:37 +00:00
sthen
ef3a3401fe reorder MASTER_SITE_PERL_CPAN; the round-robin server has been refusing
connections for a few days, as noticed by jasper@
2010-11-24 20:18:39 +00:00
sebastia
dfb432e42e reserve userid/groupid 659 for _sogo (www/sogo) 2010-11-24 18:04:38 +00:00
espie
21be510d2b fix quoting (spotted by jeremy@), make old style depends an error 2010-11-23 18:34:20 +00:00
jasper
a9b9525ca0 Add a template for pkg-readmes.
Currently one needs protective glasses to read a random README; so new
READMEs should be in line with the simple "rules" layed out here.

OK aja@ naddy@ sthen@
2010-11-23 15:58:54 +00:00
espie
1d73dd9276 also add older LIB_DEPENDS to WANTLIB 2010-11-22 21:16:42 +00:00
espie
1c9acc51a6 tweak where stem-* is computed, to be documented and used later 2010-11-20 19:57:59 +00:00
espie
811d94d9d6 new depends 2010-11-20 19:56:47 +00:00
espie
e4c6484205 small tweaks:
compute _CHECK_DEPENDS earlier
 set extra_msg to have flavor_fragment show something better than empty
directories
2010-11-16 19:26:18 +00:00
espie
6c85f407d1 missed _print-plist-with-extra-depends, noticed by jasper@ 2010-11-16 09:39:45 +00:00
espie
86a41b10d0 most abreviated format for depends. there's a consensus that it's good,
and it works.
2010-11-16 09:16:26 +00:00
sthen
b700be2512 drop dead savannah mirrors 2010-11-14 12:10:12 +00:00
espie
b1497e737a revamp the way dependencies work
- strip extra : at start of depends (old LIB_DEPENDS are gone, right)
- rely on the fact, :extra is only patch|configure|build for any depends.
- use _parse_pkgspec to do things intelligently.
- _set_stem2default to handle STEM-*.

- switch internal stuff to new style.

This is backwards compatible. But this does require -current dpb, -current
sqlports, and -current pkg_add to work !
2010-11-14 11:17:36 +00:00
espie
1c0a277e2c prepare to deal with new depends 2010-11-14 07:44:53 +00:00
ajacoutot
20e30da573 ftp sucks balls and cubes, so put http mirrors first in MASTER_SITE_GNOME. 2010-11-12 16:30:44 +00:00
espie
199b16a59a all old LIB_DEPENDS=libspec:pkg:path should be gone, so the warning becomes
an error.
2010-11-11 19:03:25 +00:00
espie
e2d1250c4c show everything as WANTLIB for now, this needs more love obviously 2010-11-11 12:43:03 +00:00
espie
e7a2eb26ed "fake" extra @depend lines for LIB_DEPENDS in port-lib-depends-check, so
that they show up even if there's no WANTLIB for them yet
2010-11-11 12:38:51 +00:00
espie
47bc97ea5c fix stupid warnings 2010-11-11 12:17:20 +00:00
espie
c2993506c5 oops. noticed by sthen@/jasper@ 2010-11-09 23:55:28 +00:00
espie
38061a5145 trap does not exit, avoid unlocking twice, even though it's harmless 2010-11-09 11:18:47 +00:00
espie
a4f88880eb - add check-register, that basically does print-plist
- switch motif to WANTLIB
- start warning about old style LIB_DEPENDS. It's time !
2010-11-07 00:03:38 +00:00
espie
c401210b5d allow register-plist to do a quickie on print-plist 2010-11-07 00:01:40 +00:00
sthen
77d56f9516 permit native-ogetdirentries, ok aja 2010-11-03 09:17:57 +00:00
espie
82ae79eeca in case the signature doesn't match, clean ALL packages that will be
rebuilt. Otherwise, you may suffer through 3 or 4 rebuilds of qt3...

ouchie.
2010-11-02 20:32:59 +00:00
espie
ccc087a37a explicit reminder: dpb does NOT do anything intelligent with installed
packages. Beware with -R, start with a clean box, or suffer strange
problems.
2010-11-02 11:34:29 +00:00
steven
8f06d3f7fd make die messages a bit more consistent 2010-11-01 13:40:36 +00:00
steven
63596c6ac2 give Program its own install sub as well 2010-11-01 13:26:41 +00:00
steven
72dd1c9832 zap unused variable 2010-11-01 13:05:57 +00:00
steven
89d04d4736 simplify sequence of events a bit in the install subroutine 2010-11-01 13:05:13 +00:00
steven
c5236210fe factor code to install .la file and associated files into its own sub 2010-11-01 12:48:15 +00:00
espie
a6fdaa4a74 do -d automatically, we don't really need that option 2010-11-01 12:24:47 +00:00
espie
fb3a3c80f7 much better implementation of -R. In case of rebuilds, check does not "see"
pkgfiles, unless they've been registered.
the engine queues everything to build, but normal build is only an
existence/signature check. The actual build tasks only get queued when
the package does not exist, or if its signature does NOT match the ports
tree.

Should make matthieu@ happy.
2010-11-01 10:55:26 +00:00
espie
8a26786deb new file/option: save dependencies and be able to reuse them.
makes for a "quick listing" of the most important ports first (e.g., groff).
document -R, even though it's not perfect yet.
flesh out all the recent parts and update the BUGS AND LIMITATIONS section.
2010-10-31 11:07:20 +00:00
espie
f7f23f3bdd don't cheat, we have to make clean=package to avoid side-effects with
arch-independent packages.
2010-10-30 11:36:07 +00:00
espie
f072ab3a17 proof-of-concept implementation of -R (rebuild when signature changes).
Somewhat inefficient (deep check of package vs port signature).
More proper approach would be to tell the engine to always build, have first
step be a check for signature if the package exist, and abort if it matches:
- here we double check everything
- propagating rebuilds means non-uptodate packages give rise to non uptodate.
2010-10-30 11:19:38 +00:00
espie
86be07b384 simplify parameter passing slightly 2010-10-30 10:35:09 +00:00
espie
03b44c7dac refactor to make most of it reusable to e.g., make print-package-signature 2010-10-29 12:35:00 +00:00
sthen
3ebf10c2f7 Add the http://ftp.cpan.org/ redirector to the top of MASTER_SITE_PERL_CPAN
and drop some 16 of the mirrors, saving a lot of time when a distfile has
been removed. ok espie@ dcoppa@
2010-10-29 12:00:14 +00:00
espie
10e6cc104f engine improvements:
- if several cores are available, recheck errors, so that we're not stuck
waiting for a core to finish to start new shit.
- $logdir/stop-<machine_name> allows you to stop a given machine while
you clean it up and (possibly) restart it (e.g., won't start new jobs)
2010-10-29 11:51:42 +00:00
espie
2f5fa40549 big fucking hack to the FULLPKGNAME\- problem, until I clean it up for real... 2010-10-29 10:22:14 +00:00
steven
f7e4458115 move mkdir out of if block so we avoid an error when it tries to write an
objectlist in there
2010-10-28 23:50:15 +00:00