cpet/openbsd-ports
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
81,273 Commits 1 Branch 0 Tags 554 MiB
a1ccfe7ec7
Commit Graph

3406 Commits

Author SHA1 Message Date
espie
440719fdce fix clean + check for packages interaction 2012-11-18 01:59:31 +00:00
espie
7fafb5c793 allow for -DWAIT_TIMEOUT=0 to propagate correctly 
lower default for junk
 2012-11-18 01:58:36 +00:00
brad
655424c0b1 Sync with git 
ok sthen@
 2012-11-15 08:31:36 +00:00
dcoppa
46f826992d Add "native-sigpending: permit" to avoid warnings from systrace now 
that make(1) uses this function.

ok espie@
 2012-11-12 10:55:17 +00:00
espie
c2ac425fce multiplication doesn't work on undefined values... noticed by naddy@ 
so initialize $job->{waiting} if needed.
 2012-11-09 17:49:17 +00:00
espie
d73a931704 don't mix up wait_timeout and waiting_timeout, as noticed by naddy@. 
re-enable wait_timeout on localhost temporarily (should be done in another
way, most probably by checking whether repo is on nfs, we can steal code
from VStat.pm)

pass umask through ssh. This took us long enough to figure out, and it's
considerably simpler than tweaking every login class once again.
 2012-11-06 08:26:29 +00:00
espie
3d3c336bb7 waive the other xenocara check if we're building it, as noticed by naddy. 2012-11-05 20:29:35 +00:00
espie
35f70aaf08 determine the xenocara makefile name directly, as it is inconvenient 
to do if you're not sure you have the right WRKSRC.
 2012-11-03 09:40:05 +00:00
sthen
9553728031 sort .poison lines, add a couple more 2012-11-02 01:44:19 +00:00
espie
9ce8be5926 fix base/xenocara location 2012-11-01 09:58:53 +00:00
espie
21af771d16 add a bit of experimental scaffolding to build xenocara from ports 
- resurrect USE_X11 in a smart way: auto-determine it correctly from
WANTLIBS (accounts for most ports)
- define a BUILD_XENOCARA knob that builds fake based on mtree for
X11BASE.
- if BUILD_XENOCARA_TOO=Yes, prepare to hook to a xenocara "fake" meta
package.

All of this off by default, the xenocara shadow tree is not in yet
anyways. Zero impact on regular builds.
 2012-10-29 22:27:05 +00:00
espie
b626ac149d thinko 2012-10-28 10:32:23 +00:00
espie
e1f5ebd7f8 be very explicit: running several dpb on the same box is perfectly safe. 
so that nitpicky developers are not deluded into thinking this doesn't work
perfectly (hi matthieu@)
 2012-10-27 11:17:56 +00:00
rpe
92c015487d lock directory -> locks directory 
ok espie@
 2012-10-26 14:43:17 +00:00
sthen
41d0a0310e fileutils has been replaced with coreutils, handle this in the autoconf cache 
fragment which normally handles gmkdir.  ok jasper@
 2012-10-25 12:26:29 +00:00
espie
964fc46d9a document WAITING_TIMEOUT 2012-10-13 09:10:07 +00:00
espie
8553ebea36 disable the waiting period if waiting_timeout is 0. 
and don't do it on localhost
 2012-10-13 09:06:55 +00:00
espie
04618136d2 fix default property handling 2012-10-13 09:00:02 +00:00
espie
3453d11c35 zap warnings 2012-10-13 08:47:32 +00:00
espie
302ada6ac0 tweaks 
- waiting should know when it gets interrupted! so that it doesn't zombify
- add a time limit.
 2012-10-13 08:32:58 +00:00
espie
76fe3e54e3 shrink msg 2012-10-12 22:18:10 +00:00
espie
64fa96209b document ALWAYS_CLEAN 2012-10-12 20:27:16 +00:00
espie
0f91b47f42 -DALWAYS_CLEAN: clean ports even if they errored out (that's a prop, so 
always_clean=1  in hosts file.

refactor task code a bit. And fix a buglet related to the NFS check
(wrong finalize order)
 2012-10-12 20:24:56 +00:00
espie
959b30dd92 oops 2012-10-11 17:35:19 +00:00
jasper
fd16678a62 book a seat for py-carbon. 2012-10-11 17:15:04 +00:00
espie
692f286b94 oh, and explain the why... 2012-10-11 09:03:34 +00:00
espie
1a0fb89393 actually log what's missing that we're waiting upon 2012-10-11 08:38:05 +00:00
espie
36029e80d7 optimize a bit for dpb: remove extra variables we don't ever use 
in "pure dpb mode", only write out variables for BUILD_PACKAGES, not
MULTI. This should reduce the number of pkgpaths generated, among other
things.
 2012-10-11 08:07:10 +00:00
espie
8db885a530 reorganize and comment portinfo 2012-10-11 08:05:03 +00:00
espie
9b37bcd801 change things again to have command line options override host file. 
and provide the possibility of a DEFAULT entry in the host file.
 2012-10-11 07:40:30 +00:00
espie
94c55bc7b4 move to using BUILD_PACKAGES, so we have the actual tidy list. 
Stupid NFS work-around:
during/after cleanup, wait until the packages show up.
Each wait period of ten seconds will show up as waiting#n.
 2012-10-11 07:38:38 +00:00
rpe
8d3efe0bb7 make out-of-date output directly usable for dbp 
- ignore empty lines
- remove comments and whitespaces at the end of lines

ok espie@
 2012-10-10 11:44:11 +00:00
espie
f9ad29c2e9 tweak things a bit... no need for an extra _fullpath variable. 
also, use a broken() function to simplify THAT particular shell fragment.
I've been running with this for ages...
 2012-10-10 10:55:33 +00:00
sthen
6d0101c720 uid 705 for minidlna 2012-10-10 10:43:13 +00:00
espie
22005987a3 restore dropped ), noticed by Amit Kulkarni, thx. 2012-10-09 20:35:57 +00:00
espie
7cdbf3d937 zap last bit of state, showing everything as host/4*2 is bad... 2012-10-08 14:16:36 +00:00
espie
cdc017bcb0 small change for people running multiple hosts: 
options on the command line now define *defaults* that host files can
override (for instance -j, stuck, -p, -J).

Add -p /n to mean "take number of jobs, if >1, divide by n, round up to 2,
and use that for parallel.

Document -p.

Make junk be 'by host' (and it's a prop, so you can tweak it).

concurrent log that records how many jobs are running each time it changes.
tag parallel builds *n in the time record.
 2012-10-08 12:41:03 +00:00
espie
a98e0a8036 our make does ignore further targets with the same name, but it's not 
a reason to misuse that feature.

When invoking bsd.port.mk, be more specific, give us a target that's not
defined.
 2012-10-06 15:38:14 +00:00
espie
929c759b7e remove old compatibility cruft with old register-plist that used to 
say "def" for version number.

check that pkgpath in dependency did not change, in which case the
dependent port should have been bumped.

problem experienced by aja@ on glib2...

patch tested and okay jasper@, sthen@
 2012-09-27 14:46:37 +00:00
sthen
43485060c7 use http://ftpmirror.gnu.org/ first in MASTER_SITE_GNU (http redirector), 
and trim a few of the separate mirrors.
 2012-09-25 20:52:15 +00:00
espie
63d13d7f2d oops, unmark core for swallowing before we free it. Otherwise we may 
still lose jobs.
 2012-09-24 20:41:57 +00:00
espie
8d2a6ea015 fix typo 2012-09-24 15:49:00 +00:00
espie
f8d9ead7d8 new framework to deal with the new ports cluster, to be documented 2012-09-23 18:13:32 +00:00
matthieu
35e488a93f Switch to imake from ports. ok landry@. 2012-09-23 08:03:55 +00:00
espie
26e4cbeb78 some more data for dpb, special for naddy's killer box. 2012-09-22 19:00:04 +00:00
landry
463ce0efbc Reserver uid/gid 704 for net/gophernicus port. 2012-09-22 07:49:24 +00:00
espie
9ab27ec343 unintentional say + "\n" 2012-09-16 08:15:43 +00:00
fgsch
33f7347fc9 Reserve id for _ngircd and comment out kqemu 2012-09-15 13:52:35 +00:00
espie
0e77f83404 BUILD_ONCE documented 2012-08-31 17:27:50 +00:00
espie
5429993fd7 go back partially on SUBST_CMD: keep the SUBST_CMD-sub stuff, but 
have a "default" SUBST_CMD that will substitute the non-subpackage version
of the variables.

SUBST_CMD = ${SUBST_CMD${SUBPACKAGE}}
is a bad idea, because SUBPACKAGE may vary in unexpected ways, like you
get the 'default' value when building manually, and you might get a
different subpackage when building with dpb, leading to weird errors.

So, old users/users during patch/configure/build can use base SUBST_CMD
without much surprise.
 2012-08-31 16:48:26 +00:00
sthen
c1dca8885f add sparc to LLVM_ARCHS, from Brad. (sparc64 is still listed, CLang does not 
work on sparc64 at present, but other parts of LLVM may still be useful).
 2012-08-29 00:41:01 +00:00
jasper
e4cac94d34 zap a bundle-readmes mention 2012-08-27 12:30:20 +00:00
jasper
58df29bb26 remove this script since the old readmes infrastructure has been replaced 
by databases/ports-readmes.

ok espie@
 2012-08-27 12:30:00 +00:00
jasper
5d931b8d90 - use mktemp -t 
from rpe
ok espie@
 2012-08-27 11:24:52 +00:00
jmatthew
2071810bf7 reserve uid for databases/riak 2012-08-24 04:18:02 +00:00
espie
0b523b0598 according to Theo, somebody reported this to me (?) 
in any case, this should "fix" krw's problem, by allowing PkgPath to
actually display the actual program for further debugging.
 2012-08-22 07:49:00 +00:00
sthen
0e9cefc2e8 don't list arm twice in ALL_ARCHS, pointed out by Brad some time ago 2012-08-21 16:32:04 +00:00
ajacoutot
057028b194 RCS id cleanup; also add OpenBSD RCS Id where missing... 2012-08-19 22:30:36 +00:00
espie
3b656100b7 well, another error... 2012-08-19 10:36:35 +00:00
avsm
cb284e6f57 Add ocaml_native and ocaml_native_dynlink properties to the arch defines. 
These will be used shortly by the ocaml-4 port update.
 2012-08-18 21:45:28 +00:00
espie
a6da6e2d7f slow architectures might clean /tmp too eagerly, move the default 
LOCKDIR to a local location that's less susceptible to surreptitious
cleanup, that is under WRKOBJDIR

after discussion with sthen@
 2012-08-18 07:58:20 +00:00
espie
083fc635e8 fix subpackage bugs. 
- correct syntax for variable (Vadim Zhukov)
- both _DO_LOCK and _cache_fragment want to use traps.
Since that's the only place where the problem occurs, simply put the second
trap in a subshell...
 2012-08-17 22:32:29 +00:00
ajacoutot
ae2bb3270f Reserve a _polkitd user/group for upcoming sysutils/polkit update. 2012-08-17 09:00:10 +00:00
espie
649b68855b nits 2012-08-15 09:41:33 +00:00
espie
495759d7a0 bye bye READMES remnants 2012-08-15 09:39:26 +00:00
espie
a2a18547bc have perl module work like it should: define extra TARGET_* variables, 
and have do-install/do-build use them.

Replace pre-configure with folded in shell fragment.
Don't hardcode perl location, we don't hardcode those things but rely
on PATH instead.

check that Makefile.PL actually produced a Makefile, since the way it
errors out does not exit 1, thus leading to configure having failed and
ports thinking it succeeded...

okay sthen@
 2012-08-15 09:38:11 +00:00
espie
64777f79b0 keep state during variable scanning (we see pkgpath in order). 
Reset info for a new path systematically, instead of only creating
new infos.

Part of handling erroring paths better: if a pkgpath errors out, when
we remove the lock, the whole port will be rescanned at once, instead of
doing one subpkgpath only.
 2012-08-15 09:05:05 +00:00
espie
a673636d3f better messages about caching problems, don't abort if sha info is missing 
from distinfo. comment stuff.
(I had this since after the lock, plain forgot to commit it)
 2012-08-15 09:02:52 +00:00
jasper
112dc86963 add config.no-fileutils, tested in a full bulk 
ok sthen@ espie@
 2012-08-12 17:19:00 +00:00
ajacoutot
9fbcc70f18 The _cups group will not be used in ghostscript anymore. 2012-08-04 15:15:00 +00:00
espie
3831fd5d30 - make SUBST_CMD be subpackage dependent, fixes substitution problems in 
README-sub (as noticed by aja@)
- stronger checks for X correctly installed: don't ignore ports if X11
is not there, error out right away. Make sure /usr/local/lib/X11/app-defaults
is a link, and that whatis.db is there (as should be fixed  by release in
xenocara)
 2012-08-04 14:23:30 +00:00
espie
5752c45e75 fix caching issues. 
- during the scanning stage, we can rely on more than sizes. Specifically,
for files with cached sha values: detect problems early, zap the files, so
the new ones do fetch.

- do not allow "negative" caching: if the cached file doesn't match, just
run the checksum again to make sure (manual download would tamper with that).
This should allow builders to forget about the existence of
/usr/ports/distfiles/distinfo again.

- remove bad files so that fetch has a chance to work (todo: log some more
info, yeah landry...)

- zap code from (checksum) proper  that's no longer in-use.

okay jasper@

(gets in because fixing the mirrors for the release is important, and dpb -F
would not do the right thing without manual intervention).
 2012-07-20 11:45:33 +00:00
sthen
a5cfa1000f add _yubiserve to user.list 2012-07-19 08:47:01 +00:00
espie
2da54d1547 delete DIST once we know 2012-07-18 10:31:18 +00:00
espie
f16903c2cc don't delete DIST, prevents checksum from doing its job 2012-07-18 10:30:56 +00:00
landry
48155f33a4 Reserve uid 699 for user _mozsync. 2012-07-17 20:19:27 +00:00
espie
f32dd01cdd fix distant listings with SUBDIRLIST 2012-07-12 20:27:19 +00:00
espie
07aff032b9 avoid barfing if run into a directory whose parent contains a Makefile.inc 2012-07-10 22:59:06 +00:00
espie
7591a8ffa0 missed using "clear-to-eol" actually 2012-07-10 14:28:30 +00:00
naddy
0d7d591395 Remove message digest algorithms other than SHA-256 for checksumming 
distfiles.  MD5 is known to be insecure and RIPEMD-160 and SHA-1
are considered inferior to SHA-256.

Also, the concatenation of different hashes is not more secure than
its strongest component; see Antoine Joux, "Multicollisions in
iterated hash functions. Application to cascased constructions"
http://www.iacr.org/cryptodb/archive/2004/CRYPTO/1472/1472.pdf

Discussed with many, ok sthen@
 2012-07-10 12:04:25 +00:00
espie
171b8a9eee fuck me harder. Separate cases where fullpkgname is allowed not to 
be defined, so that instead of bad stringizations, we get full time errors.

Maybe then I can debug this.
 2012-07-10 09:38:37 +00:00
sthen
1cdff98732 add LLVM_ARCHS, handled like MONO_ARCHS for easier detection of which 
arch can use LLVM.  ok espie@
 2012-07-08 18:35:48 +00:00
jasper
d207555654 - fix obivous typo, resulting in always using only one job per host. 2012-07-08 09:59:31 +00:00
espie
40c06ff3d7 prepare for new pkg_add -i/-I: we want to make sure that's NOT interactive! 2012-07-06 12:01:29 +00:00
espie
a352e9cafe prepare for new pkg_add switch 2012-07-06 12:00:52 +00:00
jsing
3b9b08fe9d The rfork syscall is now obsolete. 
ok sthen@
 2012-07-04 16:02:13 +00:00
sthen
2c88c52787 remove all the individual sourceforge mirrors, just rely on the redirector 
at downloads.sourceforge.net; all the FRS mirrors just redirect us back there
to lookup the file as ports don't have logical folder names in the file paths.

add an XXX comment because we don't _really_ want to be relying on this:
to be revisited.

noticed after no-longer-existent mirrors pointed out by fgs@
 2012-07-04 09:18:42 +00:00
espie
f7ea023751 remove distinction between local and distant running, always create 
a shell object that can chdir, setenv, and exec commands.
(note that this executes stuff after fork, so permanent changes are cheap
and okay)

Also create it from "host" objects, which simplifies parameter passing.
 2012-07-04 08:59:10 +00:00
espie
7373a518c1 somehow, I had forgotten to document this defaults to 250 2012-07-02 10:31:08 +00:00
jasper
c7b20a8d82 zap mac68k references 2012-06-20 21:17:38 +00:00
espie
134ac2cd91 allow users to say MESSAGE-main= 
to have empty messages, useful in a multi-package context
(as noticed by aja@)
 2012-06-20 13:26:17 +00:00
espie
76fbad9f1b those have been moved to base/ 2012-06-19 16:47:06 +00:00
espie
7b5d36d556 switch to libtool from src, since it will now be in the snaps. 2012-06-19 16:43:47 +00:00
espie
5a916fc963 handle the very special case of ports-readmes, after discussion with 
landry, sthen
 2012-06-18 12:15:52 +00:00
espie
6ffbfdc3a9 fix sig for LIB_DEPENDS 2012-06-15 10:31:52 +00:00
espie
f217f9b069 match src/ change. 
*keep ports and src in synch* or out-of-date won't work at all.
 2012-06-14 13:34:24 +00:00
espie
d808116161 Use :Q, it will quote a lot more in a correct way. 2012-06-09 21:14:43 +00:00
sthen
8f529f75b3 quote the permit_cdrom and permit_ftp variables used in the new checksum 
code, as they can contain spaces.  ok espie@
 2012-06-08 23:51:21 +00:00
espie
98a72af47d typo 2012-06-08 15:17:02 +00:00
espie
3294a50c3d add support for sha256 packages as they're built. 
after discussion with aja@
 2012-06-08 14:46:54 +00:00
sebastia
011bac4f6e Fix typo 
ok dcoppa@, aja@
 2012-06-07 20:52:41 +00:00
pascal
769ccfc457 Add BE_ARCHS and LE_ARCHS vars to be able to determine endianness. 
ok espie@
 2012-06-04 18:41:46 +00:00
espie
482f234b05 this is tricky enough to warrant an actual comment 2012-05-28 09:54:18 +00:00
espie
27f4c3dc4f forgot cruft from readmes 2012-05-28 09:43:17 +00:00
espie
b6c9f9baf3 zap old readmes infrastructure, replaced by new age databases/ports-readmes 
which is ways more accurate anyways.
 2012-05-28 09:38:04 +00:00
espie
d19515c7c3 make it possible for print-plist-with-depends to control lib-depends entirely 
(useful for future update-plist)
 2012-05-26 12:04:35 +00:00
espie
ef74243178 adjust interface slightly 2012-05-16 08:22:22 +00:00
jasper
fbebf9fd0d don't append ccache to BUILD_DEPENDS if NO_BUILD is set to Yes 
ok sthen@
 2012-05-16 06:36:56 +00:00
espie
7bc86a3598 whine for pkgpaths with extra / 2012-05-15 11:48:07 +00:00
espie
a3e1fdee35 split the PkgPath component into a base class so that sqlports will be 
able to reuse it
 2012-05-15 10:10:13 +00:00
robert
6217eaa4ca add the _yule user for the samhain port 2012-05-11 09:39:51 +00:00
jasper
ec251be3fa "fix" a line which emacs loudly complains about... 
ok espie@
 2012-05-08 17:38:21 +00:00
halex
1fbdcad4e3 call exit 1 after cleanup in signal traps, or the shell keeps running after 
SIGINT and friends

ok espie@
 2012-05-07 21:11:43 +00:00
espie
5ce8777473 just some nits 2012-05-07 15:57:51 +00:00
jasper
9ce18adad7 add MASTER_SITE_DEBIAN 
ok sthen@
 2012-04-30 19:21:25 +00:00
ajacoutot
9eeb9a1c1b Set localstatedir (i.e. BASELOCALSTATEDIR) to /var by default if 
CONFIGURE_STYLE is gnu.
Works the same way as SYSCONFDIR, one can append a subdirectory to
change the default localstatedir by using the following construct in the
port Makefile:
LOCALSTATEDIR=	${BASELOCALSTATEDIR}/foobar

Note that this variable in not substituted in PLIST.

bulk tested by landry (on a previous diff)
ok jasper@ sthen@
 2012-04-28 10:50:35 +00:00
jasper
1e60eb0d4f bye bye aterm 2012-04-26 19:18:50 +00:00
naddy
1f9f1ae603 5.1 CD packages 2012-04-23 17:54:15 +00:00
espie
c1c992e6a5 dump-vars should show VMEM_WARNING 2012-04-22 10:39:48 +00:00
espie
7fdfa19c5a make sure stuff gets thru ssh correctly 2012-04-21 21:09:07 +00:00
espie
5db27d90a1 fix env name for wrapper program 2012-04-21 14:41:37 +00:00
espie
8dc35a6962 make it possible to use a specialized wrapper to collect rss stats 2012-04-21 11:30:53 +00:00
espie
390cba80df handle modbuild (perl module) stuff similarly to what gnu does. 
there's no actual reason not to do it.
 2012-04-17 09:31:47 +00:00
espie
b411a2917d strip PORTSDIR (or equivalent) from DESCR the same way we compute PKGPATH. 
avoids random changes of INDEX depending on where the ports tree is installed
and configured.
 2012-04-16 09:21:39 +00:00
landry
fd5a44dd70 Oops, unbreak by providing an empty GCC3_ARCHS. 2012-04-12 15:06:05 +00:00
landry
3cd365fcdd Move sh/landisk to GCC4_ARCHS. 
ok phessler@ naddy@
 2012-04-12 11:46:35 +00:00
phessler
4e79f499c5 reserve user for cvsyncd 
OK naddy@
 2012-04-10 19:51:13 +00:00
espie
8cb5363e94 whitespace 2012-04-10 17:06:15 +00:00
espie
ff2903bf59 document -DNO_BUILD_STATS on the off chance someone would ever need it. 2012-04-10 17:00:29 +00:00
espie
b56361e24c always do default stats, unless we explicitly disable them with -DNO_STATS 2012-04-10 16:58:47 +00:00
espie
0deaaa9fa4 avoid spewed warnings in case we don't care. 2012-04-10 16:50:33 +00:00
espie
55635c592a synch documentation 2012-04-08 10:20:42 +00:00
espie
2ecf172edb elide empty L= / E= lines 2012-04-07 12:16:58 +00:00
espie
a01f052d1c on accelerated boxes, one can keep the cursor visible. 
make that the default, keep vis/invis as -DNO_CURSOR.
 2012-04-07 12:13:36 +00:00
sthen
ea3e106e55 reserve uid for sslh port 2012-04-06 09:06:34 +00:00
jeremy
10af9db5ef Add MASTER_SITE_NPM, needed by the www/node module. 
OK sthen@
 2012-04-03 19:00:29 +00:00
espie
9cbe5aecb1 have a look at PORTSDIR_PATH as well, so that we can dpb -P dir/p 
under mystuff.

problem noticed by jeremy@
 2012-04-02 15:51:24 +00:00
espie
b2a184c1df fix landry's error. 
forget was in the wrong class, oops.
 2012-04-02 09:21:18 +00:00
sthen
883f01ba39 SEPARATE_BUILD=simple->Yes 2012-03-29 13:41:58 +00:00
espie
5572ec286f ignore build_stats for logging distinfo (and clean-old-distfiles(1)). 2012-03-22 16:09:37 +00:00
espie
f456512a27 error out if PORTSDIR is not set to the real directory. 
There are at least two or three ports that don't like symlinks. ;/
 2012-03-22 14:08:50 +00:00
sthen
6b28800485 reserve user for maradns deadwood 2012-03-20 22:31:56 +00:00
ajacoutot
92940c6df6 Add the _colord user and group. 2012-03-19 08:21:55 +00:00
espie
4fe1c88e80 quickpath to fullpkgpath, called a lot during adjust. 2012-03-13 16:48:47 +00:00
espie
ca5467b575 there's no longer any need to keep track of build.log manually, as it 
gets taken care off thru %p/build-stats/%a
 2012-03-09 21:18:40 +00:00
espie
11d2036d1a duplicate -m option, resolve conflict by renaming old unused one to -M. 
Document some new stuff
 2012-03-09 15:16:38 +00:00
espie
38db8f2149 tweak weight handling so that fixing weights and scaling weights works. 
add -m option as a reverse to -x, like in pkg_add
 2012-03-09 12:51:38 +00:00
sthen
4c24feea48 .poison SEPERATE_BUILD 2012-03-09 11:38:56 +00:00
espie
d1754a0b78 fix things when we don't have any statistics to start with 2012-03-06 13:41:38 +00:00
espie
bffed54177 create build-stats dir (noticed by Mark Patruck) 2012-03-06 11:22:40 +00:00
espie
5327873dc1 fix -a bug: if you specify -I ..., this shouldn't negate a -a. 
"permanent build log" under %f/build-stats/%a
-J250 by default
 2012-03-05 19:43:09 +00:00
sthen
dc0ad8c2f5 reserve uid for www/trac 2012-03-03 11:40:32 +00:00
espie
a366b51e34 %f for distdir (where fetched distfiles live) 2012-03-02 19:35:09 +00:00
espie
0a05d056a4 keep track of how long a job is stuck, max. 2012-03-02 19:33:43 +00:00
espie
7222a75d55 fix detection of existing dpbs. 2012-03-02 17:14:41 +00:00
espie
243f41a146 better: if old locks, don't warn. 
if no locks to possibly remove, well, don't even run ps !
 2012-02-28 14:23:27 +00:00
espie
4e1e02f27d document recent options 2012-02-27 20:42:39 +00:00
fgsch
428ac64b90 add pypi mirrors from http://pypi.python.org/mirrors. 
rpointel@ ajacoutot@ benoit@ sthen@ ok.
 2012-02-27 18:10:41 +00:00
espie
2cc9bc20ca tweak so that dpb -I misc/screen/ 
will work
 2012-02-27 17:50:14 +00:00
espie
fb2feec6cf let's do error messages differently: get die to reset_cursor and die 
(reverse-override reporter), and get warn to use myprint (and need for
tabs to become spaces in that case...)
 2012-02-27 15:37:36 +00:00
espie
56b1b3241a allow -I/-P/-C and command-line arguments to be lists of pkgpaths, or pkgpath 
(it's easy to distinguish between a file and a directory under ports).

expand sequences for those files and hosts

when restarting dpb, kill locks that don't correspond to errors, but to a dpb
running on the same host that's no longer there.

do __WARN__ like __DIE__

option -DDONT_BUILD_ONCE
option -DDONT_CLEAN_LOCKS

document some
 2012-02-27 14:51:37 +00:00
espie
e7e37de86c hack to avoid stopping midway thru, need to find a better way... ;( 2012-02-23 21:42:23 +00:00
espie
aa4fe831d9 give FULLPKGPATH in warning message. Redundant, but may be useful for multi. 2012-02-23 08:32:17 +00:00
espie
b4dfd43424 also log the fullpkgpath, no need to go look in the lock proper for that. 2012-02-21 10:37:26 +00:00
espie
1a4ddc336c record master dpb pid and hostname 
(will be used for automatic clean-up of locks on startup)
 2012-02-20 21:18:48 +00:00
espie
81064a2b7c make sure distdir exists before writing information in there 2012-02-20 16:38:23 +00:00
ajacoutot
ee22512dc3 Deprecate _avahi-autoipd. 2012-02-19 17:53:38 +00:00
robert
b8015755bb disable the _nginx user here 2012-02-19 15:02:56 +00:00
espie
a6d46ce156 make it more obvious that PLIST_DB uses that. 2012-02-18 18:48:21 +00:00
espie
62b1756e6b cosmetic 2012-02-17 07:42:20 +00:00
espie
25362a8808 prevent top-subdirs from ignoring flavor and subpackage markers 2012-02-17 07:41:22 +00:00
espie
958fa76f4d kill fetch-makefile here too 2012-02-17 07:40:35 +00:00
espie
ac82d6c329 cosmetic: fetches come in, so < 
explain waiting time better.
 2012-02-17 07:36:09 +00:00
espie
9a29fe97e4 allow weights to be scaled 
add longer traceback in case we die
 2012-02-17 07:35:42 +00:00
espie
bf99288338 scrap old fetch targets 
add a warning when LIB_DEPENDS doesn't register (for sthen@)
tweak FLAVOR message for consistency
 2012-02-17 07:33:04 +00:00
espie
c422b5ae52 when you never fetched anything after the cipher change, that directory 
doesn't exist... don't error out...
 2012-01-31 15:45:19 +00:00
espie
10df39f505 missing .P, zap extra parentheses. 2012-01-30 17:11:38 +00:00
ajacoutot
00fa1c45b1 Remove some obsolete syscalls and add one for fpathconf. 
From Brad
ok espie@
 2012-01-30 16:02:24 +00:00
espie
7b9687cb60 document -DHISTORY_ONLY 
nitpick at column width.
 2012-01-30 15:15:24 +00:00
espie
7f2b8805ae finish distfiles history handling: people who don't fetch/build the whole 
tree may want to weed distfiles too, so allow for a full scan of the tree
without building/fetching anything, just to update history:

dpb -DHISTORY_ONLY

(just requires making sure the right engines are created, and a very shortened
loop at end waiting for history to be updated).
 2012-01-30 15:11:04 +00:00
espie
623eb8b2c5 Better name for the task that, duh, is actually updating distfiles history. 2012-01-30 14:19:30 +00:00
espie
e8ba37e682 proper usage diagnostic. 2012-01-29 14:35:40 +00:00
espie
070d4f02a9 allow a list of exceptions, for easier management of distfiles from ports not 
yet linked to the build.
 2012-01-29 13:03:05 +00:00
espie
8ddfdef47f more flexible error path while scanning, accumulate reasons why broken. 
remove a few explicit (and implicit) die from Fetch: missing/out-of-sync
distinfo no longer kill dpb, instead they're properly reported as broken
paths and things still go on (note that even a missing SUPDISTFILE checksum
*will* mark a path as broken, that's totally intentional)
 2012-01-29 12:02:20 +00:00
espie
baeec434e0 PKGFILES, why not ? 2012-01-29 11:29:51 +00:00
espie
16fd5981f1 now that update sees all pkgpaths, we can still remove duplicates. 2012-01-28 08:39:40 +00:00
espie
1a3bfc6597 make new mirroring with dpb feature-complete, provide a small perl script that 
can remove old distfiles in a smart way according to history.
 2012-01-27 19:03:02 +00:00
dcoppa
65090e9b37 Reserve a user for cntlm 2012-01-25 20:55:44 +00:00
espie
cd3220153e remove a bit of noise from the log... we checked already, no need to 
log it again.
 2012-01-23 10:35:38 +00:00
espie
26b5c343e3 remove that check for now, something in pkg_create chain is not sanitizing 
its environment...
 2012-01-21 19:07:20 +00:00
espie
9971f34ba5 prevent some errors I've run into recently 
- add ERRORS framework to bsd.port.subdir.mk
- trying to add a FLAVOR or a SUBPACKAGE to an intermediate SUBDIR is an
error (see editors/vim-spell,af recently)
- re-including bsd.port.mk/bsd.port.subdir.mk after either of them is an
error (can happen when one moves stuff to Makefile.inc without really thinking
about it, ends up with PKG_ARGS holding some contents twice and make package
erroring out with duplicate contents)
 2012-01-21 14:44:40 +00:00
ajacoutot
a47bf72ee0 Update systrace.filter for rthreads syscalls renaming. 
from Brad
ok espie@
 2012-01-20 13:27:20 +00:00
espie
1ec4d51eba repair dpb -f0 
noticed by phessler@
 2012-01-18 15:26:49 +00:00
naddy
237122761a we have stpcpy() now 2012-01-17 16:10:42 +00:00
espie
f0d702b93c also scan by_cipher for old stuff. This requires a bit more logic, as 
the names of files in there are not totally trivial to figure out from the
normal filename + sha.
-> filename will be stripped off DIST_SUBDIR
-> b64 checksums interfere with filesystem semantics, e.g., /u8//ffg
will become u8/ffg
 2012-01-16 18:55:35 +00:00
sthen
baa2ffd218 poison NO_REGRSS, suggested by phessler 2012-01-16 13:18:58 +00:00
espie
0e7a96e0ae flesh out the description of $(DISTDIR)/distinfo and $(DISTDIR)/history 2012-01-14 12:40:35 +00:00
espie
3a6eaf5081 add support to obey PERMIT_DISTFILES* 2012-01-14 12:26:21 +00:00
espie
0739a30939 pass PERMIT_DISTFILES* to dpb fetch 2012-01-14 12:22:07 +00:00
espie
2fe091cc70 recognize pkgpath changes when updating 2012-01-14 12:21:13 +00:00
espie
cb500b33c7 remove files from distinfo when they no longer exist, so when you clean 
up files and history, it won't recreate fantom stuff...
 2012-01-10 19:35:36 +00:00
espie
f8050aba6f run "expire_old" as a separate job, since it may take some time. 
find files under $DISTDIR, anything we don't know about should also
end up in history.
 2012-01-09 17:56:28 +00:00
espie
c0aa7effe3 lock may fail 2012-01-09 11:54:30 +00:00
espie
fa990a1dba give dpb more knowledge about distfiles. 
- keep a stash indexed by checksum, so dpb can identify duplicate files.
- in a full bulk, if the scan has no errors, write to a ${DISTDIR}/history
file  the files encountered in ${DISTDIR}/distinfo that seem to no longer
be needed (with full timestamp and checksum info).

Should be enough info to know when to expire old DISTDIR entries.
 2012-01-08 20:28:37 +00:00
espie
52e58e485e make fetch_manually error directly visible in the lock 2012-01-08 14:40:58 +00:00
espie
3884c2f898 buglet with links and files with a DIST_SUBDIR, as found by naddy@. 
people already running dpb -F: just remove /usr/ports/distfiles/distinfo
and rerun dpb.
(or at least all entries with a subdirectory)
 2012-01-05 21:49:52 +00:00
espie
0d3bc83fef document -F, as naddy noticed it was not yet documented. 
Add more comments to the fact that -R is a hack that doesn't always
work for various reasons, most of which might not ever be fixed...
 2012-01-04 02:08:52 +00:00
ajacoutot
fbb3936550 Add remaining syscalls to allow rthreads to work. 
from Brad
ok espie@
 2012-01-02 12:51:53 +00:00
espie
d9eef11aed prevent dpb from dying if make_link dies (also does not append to global 
distinfo, of course)
 2012-01-01 18:34:35 +00:00
espie
d45d7573cb document new file semantics. 2011-12-31 14:53:17 +00:00
espie
9938b28564 allow the fetcher part to work as a "true" mirror maker: 
- keep a cache of checked checksums as ${DISTDIR}/distinfo
- read existing cache on startup, don't need to recheck those files.
- split checksum_task: update the cache after the checksum is done
- create the by_cipher/sha256/... entries
- in fetch_only mode, do a "long" checksum on existing files not in the cache.

If you ever have doubts on the integrity of already checked files, just
rm ${DISTDIR}/distinfo.
 2011-12-31 11:20:00 +00:00
ajacoutot
3126b354d6 Update systrace.filter to allow rthreads to work. 
from Brad
ok espie@
 2011-12-28 09:39:20 +00:00
sthen
e3b39ca21f reserve 691 for natpmpd 2011-12-23 14:51:21 +00:00
pea
d42d6b3e77 add _pgpool 
ok ajacoutot@
 2011-12-21 15:31:05 +00:00
miod
95cad4b2a7 In MAKE_ENV, quote PICFLAG as it may contain spaces. Other variables might 
require similar quoting in the future, but so far this is enough to repair
port building operation on m68k.
ok espie@
 2011-12-21 05:16:04 +00:00
robert
21e0488094 Add support for MODGCC4_VERSION which can be used to define which gcc 
version to use with the gcc4 module.
It defaults to 4.2, so there is no functional change.
 2011-12-14 18:20:12 +00:00
espie
4cab976e61 zap old junk 2011-12-12 14:52:02 +00:00
jasper
cbd2f0c9f4 add a fragment to prevent picking up gnu awk by accident. 
tested in a bulk build by me

  ok espie@
 2011-12-12 10:33:33 +00:00
espie
1f6bab1e34 filter out lib-deps with the same pkgpath_and_flavors as what we're 
building, like bsd.port.mk does.
won't change anything in the build, but makes pkg_add -a less confusing,
since mp ports won't try to add itself while building.0
 2011-12-11 19:55:37 +00:00
espie
d179751a0f on SIGINFO, dump T/B hashes into info.log (and mark the display for refresh, 
as the shell might muck it with its own information)
 2011-12-10 14:48:40 +00:00
espie
c71b9ad066 expose interface to "refresh" display after some disturbing operation. 2011-12-10 14:47:36 +00:00
espie
0603716dc7 - tweak CONFIG_SITE_LIST to run under infra/db. 
- recognize absence of dependencies on gsed, gtar, ggrep,
and prevent more tests from seeing these.
 2011-12-10 11:15:16 +00:00
espie
949fe672d3 make it possible to assemble a CONFIG_SITE instead of having one 
single file.
approved by aja@, sthen@, jasper@...
 2011-12-09 09:42:44 +00:00
espie
ab6b512da4 move the architecture *constants* to a private arch-defines.mk file 
That way, bsd.port.arch.mk can still make available in a Makefile, but
we can also include them early in bsd.port.mk, so that they will always
be available from modules and Makefile.inc.
 2011-12-08 08:15:36 +00:00
kili
ab869aba97 Reserve uid/gid for hoogle. 2011-12-06 20:35:03 +00:00
sthen
b09a05ec2b reserve uid 688 for dnscrypt-proxy 2011-12-06 19:50:55 +00:00
espie
3081c4ac9a remove "needed" debug log now that things work fine. 2011-12-05 21:27:53 +00:00
espie
c783276075 truly random mode shouldn't peek at most frequent dependencies ! 2011-12-05 21:22:35 +00:00
espie
03c4aa3410 ouch, don't forget to lock at front of prepare (okay, we can avoid it 
if no-depends but that's complicated)

also, two distinct critical sections: we don't need to stay locked at
the end of show-prepare-result.

Even though that's not really important, simplify logic a wee little bit
 2011-12-05 21:18:55 +00:00
espie
b10178048d move uninstall behavior to uninstall, unbreak !-J 
as noticed by fgs@
 2011-12-05 18:29:39 +00:00
espie
abb8ddf57d turn -J into an option taking a number. 
always run show-prepare-results, and always serialize
depends/prepare/show-prepare-results(/junk) on a single host.
 2011-12-05 16:10:00 +00:00
ajacoutot
749308d3d5 Remove MODULE from .poison; it's too generic and breaks at least 
sudoku-solver.

ok espie@
 2011-12-04 16:31:52 +00:00
espie
a38035bd67 clean-up job running a bit: add methods to Grabber and PortBuilder objects 
to access more stuff they need.

Remove distantshell->make, ask state instead.
Provide state with the program we run, and the parameters we pass it.

- same make for distant and local hosts
- pass BUILD_ONCE=Yes if -a.
 2011-12-04 12:05:41 +00:00
espie
ddebaf6da6 not ideal, but will now stop at the end of a -F run. 2011-12-04 11:24:38 +00:00
espie
3858760dd5 cut up big method into smaller parts 2011-12-04 10:57:46 +00:00
espie
69df96b71c properly forget old info when rescanning... 2011-12-04 10:39:52 +00:00
espie
0393f66f06 most important usage of dpb upfront, before the exhaustive description of 
option.

Drop a few heavy hints regarding ssh usage.
 2011-12-03 18:02:39 +00:00
espie
1674edcbbd open needed just once. 2011-12-03 11:10:48 +00:00
espie
c1a46f71e8 faster NFS: if the missing file suddenly reappears, we don't need to rescan 
the path, just put it back in the queue, and forget it ever happened.
 2011-12-03 11:03:07 +00:00
espie
91b04a0eac fix quick-start: the interface to grabber changed in a silent way. 
explicitly move the main_loop near handle_non_waiting_jobs to try to
fix that mess (and finish all the time)
 2011-12-03 11:01:47 +00:00
espie
0037a6f50e little message tweak (to be changed anyways) 2011-12-03 09:29:41 +00:00
espie
4d52ff4e54 new -J option 
- refactor redirect a bit to store multi-line results to a temporary file
- new show-prepare-results stage using that
- prepare and show-prepare-results shouldn't be NoTime, since they're
predictable.
- lock host thru depends -> junk in the junk case.
acquiring the lock is done thru polling in the child, so that it doesn't block
dpb proper.
- new "junk" stage that gathers dependencies and deletes them.
 2011-12-02 22:37:36 +00:00
espie
2cfd4c615d new junk option (to remove packages as they're no longer needed) to pass 
around thru JobBuilder (along with locks since we need to write stuff into
that file)
 2011-12-02 22:33:46 +00:00
espie
b5c447a355 don't buffer printing to locks, to be able to get dependencies early 
gather needed=* lines from locks (may want to cache that info later,
but I don't think it has any actual performance impact)
 2011-12-02 22:32:07 +00:00
espie
770bcd5b5a methods required to be able to lock per-host 2011-12-02 22:29:28 +00:00
espie
1c7aab78c9 sort -u requires one parameter to not hang on stdin... 
allow SUBDIR=archivers/arc make show-prepare-results to work
 2011-12-02 15:14:20 +00:00
espie
18a4d6f4bf remove dangerous optimization: have paths explicitly pass thru the depends 
stages, even if the package is already there.

This could break EXTRA depends where the package would already be there,
and thus its dependency tree not really solved, and thus depends could
easily miss packages...

problem reported by nigel@... and not reported by ajacoutot@ :)
 2011-12-02 11:52:06 +00:00
espie
f44c50300c EXTRA should (partly) be handled like DEPENDS/BDEPENDS 2011-12-02 11:40:25 +00:00
edd
fc6c327b16 reserve a uid/gid for lcdproc 
OK sebastia@
 2011-12-01 18:43:32 +00:00
espie
5a04aafc13 zap old stuff, only read plist from stdin if -i was given 2011-12-01 11:20:19 +00:00