3663 Commits

Author SHA1 Message Date
espie
885e9b335f and portbuilder too 2013-10-06 13:25:15 +00:00
espie
27212e543e split some code into separate files, so that it doesn't get
loaded if it's not needed.
2013-10-06 13:22:18 +00:00
espie
5d6d15a31f create a special 'in-between' task that runs (setup only actually)
between checksum and extract: that's when we're truely committed to
building the port there.

create the affinity markers at that point, and not sooner.
since we know whether we're building in memory, we can record that.

if we're building in-memory, always ask for size, since it's very very
fast.

special treatment for tagged ports on error: mark them as "cleaned" so
the host gets untainted eventually.
2013-10-06 12:40:43 +00:00
espie
7ef4b92ee4 rename "special" parameter to what it really is, building in memory.
return actual size for affinity files.

assume affinity files record previous choice and reuse it
2013-10-06 12:38:23 +00:00
espie
61f45b05c9 extend affinity info to also include memory consumption for in-memory ports 2013-10-06 12:37:05 +00:00
espie
22bb96f2a1 Nigel saw dpb burp out because of missing job name...
allow it to continue, no real idea what's wrong yet. :(
2013-10-06 12:36:12 +00:00
espie
71134ea839 well, turns out awaiting-locks can be fairly useful 2013-10-06 10:58:20 +00:00
espie
e75c355759 nits 2013-10-06 10:54:53 +00:00
espie
a9e268d157 better phrasing 2013-10-06 10:54:02 +00:00
espie
615cbd2c64 explain about the kde3/kde4 tag.
Document a few more new things.
(some of these are NOT YET committed)
2013-10-06 10:50:04 +00:00
espie
9a004115bf mark we're cleaned when we enter cleanup, not when we finish,
so that dependencies can be gc'd earlier in the case we of
big ports cleanup, like libreoffice.
2013-10-06 07:08:09 +00:00
espie
cda591d4a3 as tested by landry, fractional squiggles make sense on dual-core boxes.
Note the value is skewed up because squiggles spend little time building
compared to other jobs.
2013-10-05 08:40:55 +00:00
espie
f2a16fdcba really need to store tags in locks, as dependencies in there will kill
me when restarting dpb...
2013-10-04 20:28:41 +00:00
espie
4fa862b34b log whether we're still tainted... 2013-10-04 17:48:24 +00:00
espie
cbdde1ebef make it possible to forcibly junk mismatch tags, so that bulks will work
if junk=0 by forcing junk eventually.
2013-10-04 11:26:15 +00:00
espie
3c05a490af refactor the junk decision code to be able to force junking 2013-10-04 11:17:33 +00:00
espie
828abb69ab actually, this is a more general problem, so just skip cores where
there's no useful job for us.
2013-10-04 07:18:38 +00:00
espie
9fc920cf9b ouch: if junk gets called while LISTING/UPDATING DISTFILES HISTORY is
running, some jobs may not have a v yet.
2013-10-04 07:15:10 +00:00
espie
98b3b14711 okay, junk is sneaky enough this warrants a few comments 2013-10-03 18:21:16 +00:00
espie
8aeef83112 ouch, remove "tainted" property only if junk REALLY occurred 2013-10-03 18:16:53 +00:00
espie
a25d7a7dbf scaffolding for some cool work happening.
NO SERVICEABLE USER PARTS INSIDE! this is a dirty hack to make inroads
on a fairly complicated issue.
2013-10-03 17:42:58 +00:00
espie
509b452b3c move the "Hosts" status line to Core::Init, so that localhost gets an entry.
(will allow us to display extra core status, like tainted and such)
(this also pleases landry's sense of symetry)
2013-10-03 17:34:44 +00:00
espie
bf60a2c001 explain about non-integral squiggles 2013-10-03 16:33:08 +00:00
espie
f45978f175 document dpb-replay, fairly obvious 2013-10-03 16:12:05 +00:00
espie
5a357726a5 rearrange order of functions 2013-10-03 13:12:28 +00:00
espie
f2a006e3f4 code is now specialized enough 2013-10-03 12:55:44 +00:00
espie
5624cc905d disentangle some of the specific "build" code (installation and rebuild info)
from the fetch subengine (in order to make it simpler to track the Fetch issue)
2013-10-03 12:46:51 +00:00
espie
9dc08b3323 The "Engine" code is quite daunting, but in reality there are 3 things in
there.

Finally split them for less confusing files.
2013-10-03 08:03:27 +00:00
espie
279b28193c maybe want less long command lines eventually, push that out to be able
to specialize on each task
2013-10-03 08:02:55 +00:00
espie
43ca285162 gc dead code 2013-10-02 09:16:01 +00:00
espie
c55344661b exec even with !env 2013-10-02 09:14:29 +00:00
espie
ecdd3d280d turn on recorder by default 2013-10-02 09:13:27 +00:00
espie
381a5bce08 fast replay of term log. 2013-10-02 09:09:22 +00:00
espie
bce6d9a4b1 split off most of the term display code to be able to reuse it 2013-10-02 09:02:40 +00:00
espie
4a5c4d7329 clean-up code a bit, move state into its own file 2013-10-02 09:00:34 +00:00
ajacoutot
8fe54d8fcb Missing closing bracket. 2013-10-02 07:34:45 +00:00
espie
ca08cdd7cf oops, fix -x case.
reported by rd@thrush.com and seen on mirror-maker's emails...
2013-09-30 19:08:35 +00:00
espie
53756512bd a few more options to limit forwarding 2013-09-25 08:49:49 +00:00
espie
399887a1bc tweak the squiggles to prefer ports with depends, up to a point 2013-09-25 08:49:07 +00:00
espie
1c7ed2817a let RECORD be subject to expand_path and normal parameters handling 2013-09-25 07:01:35 +00:00
espie
c845b65856 zap an extra shell for most remote/chrooted runs 2013-09-24 10:07:27 +00:00
espie
b1c0f5d29e a few odds and ends 2013-09-24 09:46:44 +00:00
espie
839dbe9437 sigh... if I want probabilistic results, cores MUST unsquiggle on a regular
basis.
2013-09-23 14:50:54 +00:00
espie
72779a9859 option: record terminal display, so that I can watch it later at hispeed... 2013-09-23 14:25:12 +00:00
espie
88aad66bcf very stupid logic error 2013-09-23 14:21:47 +00:00
espie
3fc3e4b5a2 allow non-integral values for wantsquiggles
uses random to devote "part of a core" to running squiggles instead
of normal jobs.

(might be useful for finetuning clusters with lots of dual-core boxen)
2013-09-23 13:00:02 +00:00
espie
44cd165892 make WRAPPER_OUTPUT disappear unless we are using it 2013-09-23 12:32:59 +00:00
espie
2151c24660 simplify a bit: slaves don't need the socket timeout/keepalive options.
It only pertains to the master anyways
2013-09-23 12:26:06 +00:00
espie
f0642c900e trim command-line: TRUST_PACKAGES is on by default these days.
more accurate name: has_depends -> need_depends
2013-09-23 12:25:17 +00:00
espie
1b515059dd show a '+' when we're building in-memory 2013-09-22 06:29:38 +00:00