Commit Graph

3445 Commits

Author SHA1 Message Date
espie
1e1cd224d5 don't bother outputting empty but defined variables.
this trims 1/3 of the lines from a dump-vars output...
2013-01-07 17:46:14 +00:00
espie
2a01640dd0 remove todo, affinity now works, and the rest turned out to be completely
not needed in practice
2013-01-07 11:05:17 +00:00
espie
bf5bef5235 document -X 2013-01-07 11:04:25 +00:00
espie
d0f75703ed pass -X paths thru:
- the grabber passes them to PortBuilder
... which builds a hash of pkgnames
... and the port uninstall job excludes these from the list of ports to
junk.

Note this only works with -current pkg_delete, as I had to tell it to
ignore non-existent pkgnames in that context
2013-01-07 10:59:41 +00:00
espie
d8408ea93f fix a long-standing stupid bug. Now I know why weight changes didn't matter,
I wasn't passing them through, sigh.

Add new -X option that sets xpaths, to be used...
2013-01-07 10:57:31 +00:00
espie
6f42ba6110 document asynchrony in engine.log 2013-01-06 18:21:52 +00:00
espie
7906ac8797 if I run into lockfiles that don't contain the requisite dpb property,
just hold on until they're there.

Should happen right away, so easy to spot !
2013-01-06 14:38:14 +00:00
espie
8a23d3ca7e ask the ports tree to clean up stale locks, finally... 2013-01-06 11:59:40 +00:00
espie
3468bf1fd7 allow unlock to be called with SUBDIR= 2013-01-06 11:57:21 +00:00
espie
a8dab3a559 perl's gc doesn't play well with filehandles.
So explicitly close what it will have problems tracking...

problem noticed by sthen@, obviously linked to my previous change to
avoid opening the same log file again and again...
2013-01-05 23:38:08 +00:00
espie
a323bb36ea better 2013-01-05 21:48:50 +00:00
espie
c1c2864b82 give every task a "name". 2013-01-05 21:48:18 +00:00
espie
fe8936deab even if we've got pre-empted, we still have to lock.
otherwise, we're going to unlock something we don't own, which might
be a race.
2013-01-05 20:08:39 +00:00
espie
a5eeeec19c store information about live dependencies in dpb proper, to avoid
synchronization issues with external fs...

the external locks are still used to synchronize with other dpbs running
2013-01-05 20:06:29 +00:00
espie
7184d32670 retrieve the lists of paths locked per-host from the old lock scanner,
to eventually be able to clean them in init.
2013-01-05 19:59:43 +00:00
espie
209b83159b allow independent setup for the locks location. I strongly suggest
using a local fs.
2013-01-05 18:26:31 +00:00
espie
ba6937b81c and put serialize next to the code it protects
(again, no actual code change)
2013-01-05 18:09:30 +00:00
espie
a18e4e7af2 move install out of the way (no code change) 2013-01-05 18:08:06 +00:00
espie
b159503365 log junk lock handling 2013-01-05 17:29:14 +00:00
espie
82fbc0e7fd avoid opening filehandle again and again.
also, close STDERR after the STDOUT stuff was done, so that we get
error messages otherwise!
2013-01-05 17:22:04 +00:00
espie
ed58c56937 move the "running prepare" message up to handle_output, so that *every*
phase gets tagged.
2013-01-05 16:57:31 +00:00
espie
97912f877b thought I had done this already:
don't blindly append to history, but recreate it from scratch.
We need to remove lines corresponding to stuff that vanished at some
point but came back later!
2013-01-05 16:10:18 +00:00
espie
779bfd4ae7 fix typo 2013-01-05 15:13:48 +00:00
espie
96eed0203f crank factors up to 150, so that dpb consumes a bit less cpu yet. 2013-01-05 13:39:36 +00:00
espie
116acde577 change to NO_HISTORY and document (since there are other NO_* thingies) 2013-01-05 13:34:28 +00:00
espie
85b554d119 make it possible to skip "UPDATING DISTFILES" if we're just running dpb
again without any change.
2013-01-05 13:32:28 +00:00
espie
492a2898b1 fix thinko.
as noticed by
Mikolaj Kucharski.
2013-01-05 07:01:44 +00:00
espie
df5a288315 make sure we zap any lingering socket before we restart our master. 2013-01-04 21:19:18 +00:00
espie
a9b8de6833 switch to IO::File and explicit flush for the engine log.
should be slightly faster
2013-01-04 19:34:10 +00:00
espie
d606cc382f another half-baked change 2013-01-04 18:49:39 +00:00
espie
9eb2e2c9df fix typo. Symptom: errors out at end of build
noticed by rpe@
2013-01-04 18:29:13 +00:00
espie
5b5a52a451 synch manpage with reality 2013-01-04 12:56:26 +00:00
espie
7c00e154b6 ... and don't forget to propagate it thru 2013-01-04 12:49:06 +00:00
espie
9a2e664c54 force report display to fire whenever some new ports get built. 2013-01-04 12:46:20 +00:00
espie
9612257de1 tweak limiter output some more. offset display is not really needed,
but knowing about force computes might.
2013-01-04 12:45:44 +00:00
espie
66ec642cc7 remove unneeded scaffold 2013-01-04 12:34:29 +00:00
espie
9d015892e8 document new exhaustive rate-limiting 2013-01-04 12:16:51 +00:00
espie
a1d376fbf6 take the rate-limiting concept used for the engine, and make it available
elsewhere. Also use it for the Reporter, as it makes no sense to spend
THAT much time reporting quick changes, which actually slows the build.
($factor to tweak as needed).
2013-01-04 12:06:25 +00:00
espie
3db19612eb forgot that one commit for nojunk. Oops 2013-01-04 12:03:06 +00:00
espie
5e21b7b72c explain rationale and working of unjunk 2013-01-03 22:52:01 +00:00
espie
d17cfb86a3 tweak the Engine some more: don't bother adjusting distfiles in a loop
while dependencies are missing

Following landry's remark, also take packages to build out of the race
if some RUN_DEPENDS are going to be ignored. Only do it right before we
put the package in the queue, so that the test is run exactly once per
package instead of during every scan.

I was also worried about multi-packages, but this only takes one fullpkgpath
out of the loop, and "make package" is going to fail half-way through anyways.
2013-01-03 15:47:45 +00:00
espie
de678efd4a add support for unjunk property, that will prevent junking from actually
happening while some 'unjunk' ports are building.

this is a work-around for a known problem with cmake and qt4 include
dependency handlers...

Also, cache fullpkgpath while building a job, as this contributes for
a large part to the speed (not) of the display when building lots of
ports.
2013-01-03 15:45:18 +00:00
espie
c39d9434ff fix infamous "doesn't really quit when it's done" stop bug.
also move the report to the main package, and show a prominent
STOPPED in the title bar if you forget you stopped it during a
previous run ('why is my dpb not building anything ?')
2013-01-03 15:43:27 +00:00
espie
59ee0568e8 stats are comparatively cheap, run them even when the engine doesn't run.
Yields more accurate stat output, where we can see a staircase effect on
the queue when the engine is run not that often, and Built actually go
up until it goes back down again.
2013-01-02 11:13:52 +00:00
espie
f86dbb772a allow overriding the start-up script from the command line. 2012-12-31 09:50:55 +00:00
espie
092496c30a following landry's suggestion, add module hooks for post-install
I'm not too happy about stuff that will remove .la automatically though,
seems to me this shouldn't be generated in the first place.

ETOOMUCHMAGIC ?
2012-12-31 09:14:07 +00:00
espie
61c2611d5c document extra log files... 2012-12-31 08:29:31 +00:00
espie
dcf231188f forgot to GC this along with the imake weirdness.
seen by landry@
2012-12-30 20:40:40 +00:00
espie
d985cc05e2 mismatches are more annoying than extra cpu:
if we end up with only mismatches and we didn't run check_buildable last
time around, try a check_buildable first.
2012-12-30 14:33:46 +00:00
espie
45b128b893 fix elusive "jobs don't show up where they should".
duh. put "live" affinity markers while we're building stuff.
We don't re-read the on-disk markers outside of restart (should we ?)
so they HAVE to be in the pkgpath struct proper.
2012-12-30 14:04:17 +00:00
espie
eb77a6071b why not ? track total distsize for each port. might correlate with other
stuff later.
2012-12-30 11:47:24 +00:00
espie
ad8ad1c28f smarter affinity mismatch handling: if we have other cores idle, ask them.
also, officialize the engine-perf log somewhat (and give it a more descriptive
name).
2012-12-29 19:15:37 +00:00
espie
fa169c69ae allow looking for a given core when trying to match affinity 2012-12-29 19:14:51 +00:00
espie
ebb2a2c90a on start-up, log affinity in a more consistent way, with pid of running dpb. 2012-12-29 19:14:28 +00:00
jasper
fb9809c424 cleanup GCC, XCONTRIB, SUNSITE and GNOME mirror lists. 2012-12-29 07:58:03 +00:00
jasper
e60a243cf3 *** empty log message *** 2012-12-29 07:42:37 +00:00
espie
c3a8df2e5f log the markers we retrieve on any restart... I suspect something foul
happening with localhost.
2012-12-28 21:09:45 +00:00
espie
7adbbd9561 remove optimization that no longer makes sense. 2012-12-28 06:40:11 +00:00
espie
d624d61917 since we have a quick path where stuff move from tobuild to install without
adjusting things, stuff that can be built may have BEXTRA which are not
completed...
2012-12-28 06:31:03 +00:00
espie
3ca05b12fe replace next_check = last_check + check_interval
tweak the algorithm slightly (since we forget the old check_interval).
In particular, never keep old times in reserve.

Makes for simpler and clearer reading
2012-12-27 16:23:17 +00:00
espie
e293bae75a remove the need to loop around adjust_tobuild, fudge things a bit:
Most things will move as a result of {install} changes.

Things that move because of EXTRA depends that are satisfied are unlikely to trigger
further changes.

So, stagger changes for "normal" tobuild -> queue first, and extra depends later.
2012-12-27 14:14:19 +00:00
espie
99ac03e94d oops 2012-12-27 12:20:36 +00:00
espie
fc5ee33b62 add timestamp in phases for Job/Port.pm.
may help synchronize events from distinct logs in case this matters.
2012-12-27 12:03:33 +00:00
espie
7614ffa97a remove 'dead' cycles: changes in ToBuild can't trigger new changes in Built. 2012-12-27 11:04:43 +00:00
espie
98849d8242 self-adaptive delay... with a bit of log scaffolding for now. 2012-12-25 20:41:41 +00:00
espie
67de0deb11 if we have a sizeable queue (>50) and we ran check_buildable less than 30s
ago, don't run it again right now.

This prevents the Engine from busy-checking the same data when it's building
lots of small packages very fast.

(50 and 30 may need some fine-tuning)
2012-12-25 16:07:02 +00:00
espie
11cb77656d make "rebuild" behavior a proper subclass of DPB::PortBuilder, instead
of having tests all over the place.

Take advantage of that to not rechecking signatures if already done.
2012-12-25 10:43:36 +00:00
espie
66b2639394 compute dependencies right away in the job: we don't actually have to
fork depends/prepare/prepare-results for ports which don't have any
depends.

This also prevents some lock contention, obviously.
2012-12-25 10:25:04 +00:00
espie
1af810c8d6 on rebuild, mark all existing files as 'uptodate'. Will prevent extra
rebuilds on @option always-update multi-packages when using -R.
2012-12-25 10:00:08 +00:00
espie
3de193b931 also take things off the later list if they were there. Prevents behavior
like the following:

14426@1356424364: B: x11/kde/graphics3
14426@1356424364: B: x11/kde/graphics3,-kpov
14426@1356424364: B: x11/kde/graphics3,-kamera
14426@1356424364: B: x11/kde/graphics3,-sane
14426@1356424364: B: x11/kde/graphics3,-main
14426@1356424364: V: x11/kde/graphics3,-kpov	<--- note put back on queue
14426@1356424364: V: x11/kde/graphics3
14426@1356424364: V: x11/kde/graphics3,-kamera
14426@1356424364: I: x11/kde/graphics3,-sane
14426@1356424364: I: x11/kde/graphics3
14426@1356424364: I: x11/kde/graphics3,-kamera
14426@1356424364: I: x11/kde/graphics3,-main
14426@1356424366: J: graphics/povray echo.home 0
14426@1356424496: B: devel/goffice
14426@1356424496: I: devel/goffice
14426@1356424496: Q: math/gnumeric
14426@1356424498: B: x11/kde/graphics3		<--- so, duh rebuilt...
14426@1356424498: B: x11/kde/graphics3,-main
14426@1356424498: B: x11/kde/graphics3,-kamera
14426@1356424498: B: x11/kde/graphics3,-sane
14426@1356424498: J: graphics/opencv,-docs echo.home 0
14426@1356424675: B: graphics/povray
14426@1356424675: I: x11/kde/graphics3,-sane
14426@1356424675: I: graphics/povray
14426@1356424675: I: x11/kde/graphics3		<-- and installable, again.
14426@1356424675: I: x11/kde/graphics3,-kpov
14426@1356424675: I: x11/kde/graphics3,-kamera
14426@1356424675: I: x11/kde/graphics3,-main
2012-12-25 09:46:24 +00:00
espie
130df9a3bc will work better with a non-reversed test... 2012-12-25 09:31:54 +00:00
espie
e4c671527c add affinity information to restart jobs on the right host preferentially.
- affinity info is similar to locks, but with a completely different
lifetime.
- streamline the main loop of the engine, so that it can do two passes:
first pass shuns paths with the wrong affinity. If no good path is found,
those are considered during the second pass.
- make the Core factory aware of what hosts might be running, so that
affinity info for machines removed from a config file will be ignored.

thanks to landry@ for a few tests.
2012-12-24 17:24:46 +00:00
espie
0ff5bc966a be slightly more aggressive when a pkgpath is done: for multi-packages,
zap all subpackages from the queue.

need to distinguish the normal case (is_done) with a simpler case
(is_done_quick) that's used when scanning the ports tree. Otherwise, we
would check multi-packages loads of time.
2012-12-24 17:22:15 +00:00
espie
c4f1bfc74e reorg the tests slightly, no functional change 2012-12-24 17:19:01 +00:00
espie
027e6592d6 testing option 2012-12-23 13:28:55 +00:00
espie
cdb441ddb5 cutdate is first parameter, not second.
tighten parenthesis.
add -h history for testing.
2012-12-23 13:27:08 +00:00
espie
25bc62ba46 quicker restart: when adding a new_path, directly check whether it
was built already... so things will go straight to B/I instead of
getting through T/Q...
less noise in engine.log, and much more accurate information for choosing
queue items.
2012-12-21 12:26:16 +00:00
naddy
ee869d0426 do not define ac_cv_func_openpty=no since it breaks this idiom:
AC_CHECK_LIB(util, openpty)
AC_CHECK_FUNCS(openpty)
2012-12-08 14:32:29 +00:00
naddy
8ac927d997 we now have the Unix 98 PTY functions; noticed by ajacoutot@ 2012-12-07 15:15:32 +00:00
florian
93a80502d7 +dnsfilter 2012-12-04 16:29:26 +00:00
jasper
6cc72db009 layout of ftp.belnet.be changed; adjust MASTER_SITE_GNOME accordingly 2012-12-02 19:20:46 +00:00
miod
aec30b0bda m88k ports now use gcc 3; ok espie@ 2012-12-01 21:12:28 +00:00
espie
c1c86bf73d be a bit more specific in _SOLVING_DEP, so that ports that regress-depend
on themselves won't clean themselves when BULK=Auto.
problem reported by sthen@, okay sthen@
2012-11-27 11:35:57 +00:00
pascal
efbbb4e0ba Reserve _wesnothd user/group. 2012-11-20 15:05:44 +00:00
sthen
54fe7aeb13 +spiped 2012-11-19 22:14:31 +00:00
espie
40d8555822 fix reverted lock logic. From Vadim Zhukov. 2012-11-19 14:19:35 +00:00
espie
eef2946135 add a new value for BULK and use it as default:
BULK=auto  will invoke bulk behavior on dependencies, but not during
normal build.
(internally, deps have _SOLVING_DEP=yes, so we can distinguish them)

okay ajacoutot@
2012-11-19 12:24:50 +00:00
espie
e009da097e remove some old cruft
checked by naddy@ for no incidence on current builds
2012-11-19 12:19:30 +00:00
espie
ba8f355da8 more descriptive name 2012-11-18 12:37:21 +00:00
espie
440719fdce fix clean + check for packages interaction 2012-11-18 01:59:31 +00:00
espie
7fafb5c793 allow for -DWAIT_TIMEOUT=0 to propagate correctly
lower default for junk
2012-11-18 01:58:36 +00:00
brad
655424c0b1 Sync with git
ok sthen@
2012-11-15 08:31:36 +00:00
dcoppa
46f826992d Add "native-sigpending: permit" to avoid warnings from systrace now
that make(1) uses this function.

ok espie@
2012-11-12 10:55:17 +00:00
espie
c2ac425fce multiplication doesn't work on undefined values... noticed by naddy@
so initialize $job->{waiting} if needed.
2012-11-09 17:49:17 +00:00
espie
d73a931704 don't mix up wait_timeout and waiting_timeout, as noticed by naddy@.
re-enable wait_timeout on localhost temporarily (should be done in another
way, most probably by checking whether repo is on nfs, we can steal code
from VStat.pm)

pass umask through ssh. This took us long enough to figure out, and it's
considerably simpler than tweaking every login class once again.
2012-11-06 08:26:29 +00:00
espie
3d3c336bb7 waive the other xenocara check if we're building it, as noticed by naddy. 2012-11-05 20:29:35 +00:00
espie
35f70aaf08 determine the xenocara makefile name directly, as it is inconvenient
to do if you're not sure you have the right WRKSRC.
2012-11-03 09:40:05 +00:00
sthen
9553728031 sort .poison lines, add a couple more 2012-11-02 01:44:19 +00:00
espie
9ce8be5926 fix base/xenocara location 2012-11-01 09:58:53 +00:00
espie
21af771d16 add a bit of experimental scaffolding to build xenocara from ports
- resurrect USE_X11 in a smart way: auto-determine it correctly from
WANTLIBS (accounts for most ports)
- define a BUILD_XENOCARA knob that builds fake based on mtree for
X11BASE.
- if BUILD_XENOCARA_TOO=Yes, prepare to hook to a xenocara "fake" meta
package.

All of this off by default, the xenocara shadow tree is not in yet
anyways. Zero impact on regular builds.
2012-10-29 22:27:05 +00:00
espie
b626ac149d thinko 2012-10-28 10:32:23 +00:00
espie
e1f5ebd7f8 be very explicit: running several dpb on the same box is perfectly safe.
so that nitpicky developers are not deluded into thinking this doesn't work
perfectly (hi matthieu@)
2012-10-27 11:17:56 +00:00
rpe
92c015487d lock directory -> locks directory
ok espie@
2012-10-26 14:43:17 +00:00
sthen
41d0a0310e fileutils has been replaced with coreutils, handle this in the autoconf cache
fragment which normally handles gmkdir.  ok jasper@
2012-10-25 12:26:29 +00:00
espie
964fc46d9a document WAITING_TIMEOUT 2012-10-13 09:10:07 +00:00
espie
8553ebea36 disable the waiting period if waiting_timeout is 0.
and don't do it on localhost
2012-10-13 09:06:55 +00:00
espie
04618136d2 fix default property handling 2012-10-13 09:00:02 +00:00
espie
3453d11c35 zap warnings 2012-10-13 08:47:32 +00:00
espie
302ada6ac0 tweaks
- waiting should know when it gets interrupted! so that it doesn't zombify
- add a time limit.
2012-10-13 08:32:58 +00:00
espie
76fe3e54e3 shrink msg 2012-10-12 22:18:10 +00:00
espie
64fa96209b document ALWAYS_CLEAN 2012-10-12 20:27:16 +00:00
espie
0f91b47f42 -DALWAYS_CLEAN: clean ports even if they errored out (that's a prop, so
always_clean=1  in hosts file.

refactor task code a bit. And fix a buglet related to the NFS check
(wrong finalize order)
2012-10-12 20:24:56 +00:00
espie
959b30dd92 oops 2012-10-11 17:35:19 +00:00
jasper
fd16678a62 book a seat for py-carbon. 2012-10-11 17:15:04 +00:00
espie
692f286b94 oh, and explain the why... 2012-10-11 09:03:34 +00:00
espie
1a0fb89393 actually log what's missing that we're waiting upon 2012-10-11 08:38:05 +00:00
espie
36029e80d7 optimize a bit for dpb: remove extra variables we don't ever use
in "pure dpb mode", only write out variables for BUILD_PACKAGES, not
MULTI. This should reduce the number of pkgpaths generated, among other
things.
2012-10-11 08:07:10 +00:00
espie
8db885a530 reorganize and comment portinfo 2012-10-11 08:05:03 +00:00
espie
9b37bcd801 change things again to have command line options override host file.
and provide the possibility of a DEFAULT entry in the host file.
2012-10-11 07:40:30 +00:00
espie
94c55bc7b4 move to using BUILD_PACKAGES, so we have the actual tidy list.
Stupid NFS work-around:
during/after cleanup, wait until the packages show up.
Each wait period of ten seconds will show up as waiting#n.
2012-10-11 07:38:38 +00:00
rpe
8d3efe0bb7 make out-of-date output directly usable for dbp
- ignore empty lines
- remove comments and whitespaces at the end of lines

ok espie@
2012-10-10 11:44:11 +00:00
espie
f9ad29c2e9 tweak things a bit... no need for an extra _fullpath variable.
also, use a broken() function to simplify THAT particular shell fragment.
I've been running with this for ages...
2012-10-10 10:55:33 +00:00
sthen
6d0101c720 uid 705 for minidlna 2012-10-10 10:43:13 +00:00
espie
22005987a3 restore dropped ), noticed by Amit Kulkarni, thx. 2012-10-09 20:35:57 +00:00
espie
7cdbf3d937 zap last bit of state, showing everything as host/4*2 is bad... 2012-10-08 14:16:36 +00:00
espie
cdc017bcb0 small change for people running multiple hosts:
options on the command line now define *defaults* that host files can
override (for instance -j, stuck, -p, -J).

Add -p /n to mean "take number of jobs, if >1, divide by n, round up to 2,
and use that for parallel.

Document -p.

Make junk be 'by host' (and it's a prop, so you can tweak it).

concurrent log that records how many jobs are running each time it changes.
tag parallel builds *n in the time record.
2012-10-08 12:41:03 +00:00
espie
a98e0a8036 our make does ignore further targets with the same name, but it's not
a reason to misuse that feature.

When invoking bsd.port.mk, be more specific, give us a target that's not
defined.
2012-10-06 15:38:14 +00:00
espie
929c759b7e remove old compatibility cruft with old register-plist that used to
say "def" for version number.

check that pkgpath in dependency did not change, in which case the
dependent port should have been bumped.

problem experienced by aja@ on glib2...

patch tested and okay jasper@, sthen@
2012-09-27 14:46:37 +00:00
sthen
43485060c7 use http://ftpmirror.gnu.org/ first in MASTER_SITE_GNU (http redirector),
and trim a few of the separate mirrors.
2012-09-25 20:52:15 +00:00
espie
63d13d7f2d oops, unmark core for swallowing before we free it. Otherwise we may
still lose jobs.
2012-09-24 20:41:57 +00:00
espie
8d2a6ea015 fix typo 2012-09-24 15:49:00 +00:00
espie
f8d9ead7d8 new framework to deal with the new ports cluster, to be documented 2012-09-23 18:13:32 +00:00
matthieu
35e488a93f Switch to imake from ports. ok landry@. 2012-09-23 08:03:55 +00:00
espie
26e4cbeb78 some more data for dpb, special for naddy's killer box. 2012-09-22 19:00:04 +00:00
landry
463ce0efbc Reserver uid/gid 704 for net/gophernicus port. 2012-09-22 07:49:24 +00:00
espie
9ab27ec343 unintentional say + "\n" 2012-09-16 08:15:43 +00:00
fgsch
33f7347fc9 Reserve id for _ngircd and comment out kqemu 2012-09-15 13:52:35 +00:00
espie
0e77f83404 BUILD_ONCE documented 2012-08-31 17:27:50 +00:00
espie
5429993fd7 go back partially on SUBST_CMD: keep the SUBST_CMD-sub stuff, but
have a "default" SUBST_CMD that will substitute the non-subpackage version
of the variables.

SUBST_CMD = ${SUBST_CMD${SUBPACKAGE}}
is a bad idea, because SUBPACKAGE may vary in unexpected ways, like you
get the 'default' value when building manually, and you might get a
different subpackage when building with dpb, leading to weird errors.

So, old users/users during patch/configure/build can use base SUBST_CMD
without much surprise.
2012-08-31 16:48:26 +00:00
sthen
c1dca8885f add sparc to LLVM_ARCHS, from Brad. (sparc64 is still listed, CLang does not
work on sparc64 at present, but other parts of LLVM may still be useful).
2012-08-29 00:41:01 +00:00
jasper
e4cac94d34 zap a bundle-readmes mention 2012-08-27 12:30:20 +00:00
jasper
58df29bb26 remove this script since the old readmes infrastructure has been replaced
by databases/ports-readmes.

ok espie@
2012-08-27 12:30:00 +00:00
jasper
5d931b8d90 - use mktemp -t
from rpe
ok espie@
2012-08-27 11:24:52 +00:00
jmatthew
2071810bf7 reserve uid for databases/riak 2012-08-24 04:18:02 +00:00
espie
0b523b0598 according to Theo, somebody reported this to me (?)
in any case, this should "fix" krw's problem, by allowing PkgPath to
actually display the actual program for further debugging.
2012-08-22 07:49:00 +00:00
sthen
0e9cefc2e8 don't list arm twice in ALL_ARCHS, pointed out by Brad some time ago 2012-08-21 16:32:04 +00:00
ajacoutot
057028b194 RCS id cleanup; also add OpenBSD RCS Id where missing... 2012-08-19 22:30:36 +00:00
espie
3b656100b7 well, another error... 2012-08-19 10:36:35 +00:00
avsm
cb284e6f57 Add ocaml_native and ocaml_native_dynlink properties to the arch defines.
These will be used shortly by the ocaml-4 port update.
2012-08-18 21:45:28 +00:00
espie
a6da6e2d7f slow architectures might clean /tmp too eagerly, move the default
LOCKDIR to a local location that's less susceptible to surreptitious
cleanup, that is under WRKOBJDIR

after discussion with sthen@
2012-08-18 07:58:20 +00:00
espie
083fc635e8 fix subpackage bugs.
- correct syntax for variable (Vadim Zhukov)
- both _DO_LOCK and _cache_fragment want to use traps.
Since that's the only place where the problem occurs, simply put the second
trap in a subshell...
2012-08-17 22:32:29 +00:00
ajacoutot
ae2bb3270f Reserve a _polkitd user/group for upcoming sysutils/polkit update. 2012-08-17 09:00:10 +00:00
espie
649b68855b nits 2012-08-15 09:41:33 +00:00
espie
495759d7a0 bye bye READMES remnants 2012-08-15 09:39:26 +00:00
espie
a2a18547bc have perl module work like it should: define extra TARGET_* variables,
and have do-install/do-build use them.

Replace pre-configure with folded in shell fragment.
Don't hardcode perl location, we don't hardcode those things but rely
on PATH instead.

check that Makefile.PL actually produced a Makefile, since the way it
errors out does not exit 1, thus leading to configure having failed and
ports thinking it succeeded...

okay sthen@
2012-08-15 09:38:11 +00:00
espie
64777f79b0 keep state during variable scanning (we see pkgpath in order).
Reset info for a new path systematically, instead of only creating
new infos.

Part of handling erroring paths better: if a pkgpath errors out, when
we remove the lock, the whole port will be rescanned at once, instead of
doing one subpkgpath only.
2012-08-15 09:05:05 +00:00
espie
a673636d3f better messages about caching problems, don't abort if sha info is missing
from distinfo. comment stuff.
(I had this since after the lock, plain forgot to commit it)
2012-08-15 09:02:52 +00:00
jasper
112dc86963 add config.no-fileutils, tested in a full bulk
ok sthen@ espie@
2012-08-12 17:19:00 +00:00
ajacoutot
9fbcc70f18 The _cups group will not be used in ghostscript anymore. 2012-08-04 15:15:00 +00:00
espie
3831fd5d30 - make SUBST_CMD be subpackage dependent, fixes substitution problems in
README-sub (as noticed by aja@)
- stronger checks for X correctly installed: don't ignore ports if X11
is not there, error out right away. Make sure /usr/local/lib/X11/app-defaults
is a link, and that whatis.db is there (as should be fixed  by release in
xenocara)
2012-08-04 14:23:30 +00:00
espie
5752c45e75 fix caching issues.
- during the scanning stage, we can rely on more than sizes. Specifically,
for files with cached sha values: detect problems early, zap the files, so
the new ones do fetch.

- do not allow "negative" caching: if the cached file doesn't match, just
run the checksum again to make sure (manual download would tamper with that).
This should allow builders to forget about the existence of
/usr/ports/distfiles/distinfo again.

- remove bad files so that fetch has a chance to work (todo: log some more
info, yeah landry...)

- zap code from (checksum) proper  that's no longer in-use.

okay jasper@

(gets in because fixing the mirrors for the release is important, and dpb -F
would not do the right thing without manual intervention).
2012-07-20 11:45:33 +00:00
sthen
a5cfa1000f add _yubiserve to user.list 2012-07-19 08:47:01 +00:00
espie
2da54d1547 delete DIST once we know 2012-07-18 10:31:18 +00:00
espie
f16903c2cc don't delete DIST, prevents checksum from doing its job 2012-07-18 10:30:56 +00:00
landry
48155f33a4 Reserve uid 699 for user _mozsync. 2012-07-17 20:19:27 +00:00
espie
f32dd01cdd fix distant listings with SUBDIRLIST 2012-07-12 20:27:19 +00:00
espie
07aff032b9 avoid barfing if run into a directory whose parent contains a Makefile.inc 2012-07-10 22:59:06 +00:00
espie
7591a8ffa0 missed using "clear-to-eol" actually 2012-07-10 14:28:30 +00:00
naddy
0d7d591395 Remove message digest algorithms other than SHA-256 for checksumming
distfiles.  MD5 is known to be insecure and RIPEMD-160 and SHA-1
are considered inferior to SHA-256.

Also, the concatenation of different hashes is not more secure than
its strongest component; see Antoine Joux, "Multicollisions in
iterated hash functions. Application to cascased constructions"
http://www.iacr.org/cryptodb/archive/2004/CRYPTO/1472/1472.pdf

Discussed with many, ok sthen@
2012-07-10 12:04:25 +00:00
espie
171b8a9eee fuck me harder. Separate cases where fullpkgname is allowed not to
be defined, so that instead of bad stringizations, we get full time errors.

Maybe then I can debug this.
2012-07-10 09:38:37 +00:00
sthen
1cdff98732 add LLVM_ARCHS, handled like MONO_ARCHS for easier detection of which
arch can use LLVM.  ok espie@
2012-07-08 18:35:48 +00:00
jasper
d207555654 - fix obivous typo, resulting in always using only one job per host. 2012-07-08 09:59:31 +00:00
espie
40c06ff3d7 prepare for new pkg_add -i/-I: we want to make sure that's NOT interactive! 2012-07-06 12:01:29 +00:00
espie
a352e9cafe prepare for new pkg_add switch 2012-07-06 12:00:52 +00:00
jsing
3b9b08fe9d The rfork syscall is now obsolete.
ok sthen@
2012-07-04 16:02:13 +00:00
sthen
2c88c52787 remove all the individual sourceforge mirrors, just rely on the redirector
at downloads.sourceforge.net; all the FRS mirrors just redirect us back there
to lookup the file as ports don't have logical folder names in the file paths.

add an XXX comment because we don't _really_ want to be relying on this:
to be revisited.

noticed after no-longer-existent mirrors pointed out by fgs@
2012-07-04 09:18:42 +00:00
espie
f7ea023751 remove distinction between local and distant running, always create
a shell object that can chdir, setenv, and exec commands.
(note that this executes stuff after fork, so permanent changes are cheap
and okay)

Also create it from "host" objects, which simplifies parameter passing.
2012-07-04 08:59:10 +00:00
espie
7373a518c1 somehow, I had forgotten to document this defaults to 250 2012-07-02 10:31:08 +00:00
jasper
c7b20a8d82 zap mac68k references 2012-06-20 21:17:38 +00:00
espie
134ac2cd91 allow users to say MESSAGE-main=
to have empty messages, useful in a multi-package context
(as noticed by aja@)
2012-06-20 13:26:17 +00:00
espie
76fbad9f1b those have been moved to base/ 2012-06-19 16:47:06 +00:00
espie
7b5d36d556 switch to libtool from src, since it will now be in the snaps. 2012-06-19 16:43:47 +00:00
espie
5a916fc963 handle the very special case of ports-readmes, after discussion with
landry, sthen
2012-06-18 12:15:52 +00:00
espie
6ffbfdc3a9 fix sig for LIB_DEPENDS 2012-06-15 10:31:52 +00:00
espie
f217f9b069 match src/ change.
*keep ports and src in synch* or out-of-date won't work at all.
2012-06-14 13:34:24 +00:00
espie
d808116161 Use :Q, it will quote a lot more in a correct way. 2012-06-09 21:14:43 +00:00
sthen
8f529f75b3 quote the permit_cdrom and permit_ftp variables used in the new checksum
code, as they can contain spaces.  ok espie@
2012-06-08 23:51:21 +00:00
espie
98a72af47d typo 2012-06-08 15:17:02 +00:00
espie
3294a50c3d add support for sha256 packages as they're built.
after discussion with aja@
2012-06-08 14:46:54 +00:00
sebastia
011bac4f6e Fix typo
ok dcoppa@, aja@
2012-06-07 20:52:41 +00:00
pascal
769ccfc457 Add BE_ARCHS and LE_ARCHS vars to be able to determine endianness.
ok espie@
2012-06-04 18:41:46 +00:00
espie
482f234b05 this is tricky enough to warrant an actual comment 2012-05-28 09:54:18 +00:00
espie
27f4c3dc4f forgot cruft from readmes 2012-05-28 09:43:17 +00:00
espie
b6c9f9baf3 zap old readmes infrastructure, replaced by new age databases/ports-readmes
which is ways more accurate anyways.
2012-05-28 09:38:04 +00:00
espie
d19515c7c3 make it possible for print-plist-with-depends to control lib-depends entirely
(useful for future update-plist)
2012-05-26 12:04:35 +00:00
espie
ef74243178 adjust interface slightly 2012-05-16 08:22:22 +00:00
jasper
fbebf9fd0d don't append ccache to BUILD_DEPENDS if NO_BUILD is set to Yes
ok sthen@
2012-05-16 06:36:56 +00:00
espie
7bc86a3598 whine for pkgpaths with extra / 2012-05-15 11:48:07 +00:00
espie
a3e1fdee35 split the PkgPath component into a base class so that sqlports will be
able to reuse it
2012-05-15 10:10:13 +00:00
robert
6217eaa4ca add the _yule user for the samhain port 2012-05-11 09:39:51 +00:00