737 Commits

Author SHA1 Message Date
espie
5afe4fffea my bad, line at end of summary 2017-05-04 23:40:29 +00:00
tsg
2e722bdb86 There's no need for 'make fetch-all' when creating a new port. 2017-05-02 11:30:03 +00:00
espie
b437d12dc7 white line at end of summary isn't very visible.
if we restart the build for whatever reason, stuff gets appended as
usual, but the difference between old summary and new summary should
be more visible.
2017-04-19 15:14:45 +00:00
espie
1c3befe8b9 cosmetic change: report the hostname again in case of failure.
I routinely read thru logs looking for the error, and forget about which
machine it was. Having it conveniently located at the end instead of the
start saves me a few seconds.
2017-04-19 15:13:12 +00:00
espie
22d7bcaa17 have both log watching jobs actually share the timeout code.
If I had done this before, I would have fixed kill just once after privsep
and not inadvertently broken the builder stuck timeout...

problem noticed by naddy@
2017-04-14 16:43:40 +00:00
espie
422ed0448d reorg the logic behind permanent_log so that it *is* the permanent log.
fixes -DNO_BUILD_STATS as reported by naddy@ (predates rewriting buildinfo,
and I plain forgot about it obviously)
2017-04-14 16:39:32 +00:00
afresh1
8e398553b8 Remove fcntl.ph use from DPB::Locks
Replace with a hardcoded constant as Fcntl doesn't provide it.

Fix suggested by espie@ fine with millert@
2016-11-07 21:26:06 +00:00
espie
401c11c155 dpb cleans the permanent logs, always using the same pattern,
so write a method for that.

And don't fail silently when it doesn't work, because that causes
trouble down the line.

(e.g., your log user must be able to write into build-stats!!!)
2016-10-21 00:45:43 +00:00
espie
1e2d2100ea reuse base window detection code and signal handler (requires fairly recent
base code)
2016-06-28 15:28:20 +00:00
espie
726864fa0b keep state around in Reporter, simplifies terminal initialization,
and will be need to access size information
2016-06-24 12:52:12 +00:00
espie
44f3329d90 there is no "equivalence list" if we didn't get any info... 2016-06-13 13:36:36 +00:00
espie
488a60291b scrape another use of PLIST_DB (I don't even remember why I thought
it might have been a good idea to grab it at the time)
2016-06-10 16:10:20 +00:00
nigel
e7abffef2d DPB::FetchDummy needs forget_cache routine.
Ok espie@
2016-05-22 11:41:56 +00:00
espie
41cc111b6a grrrr cvs. thanks krw 2016-05-21 19:38:44 +00:00
espie
cc2f4890f5 keep a global cache of distfile checksum while scanning, allows us to avoid
rescanning the same distfile 50 times...

also display elapsed time at end of build (cosmetic) since that's now trivial
2016-05-21 12:20:10 +00:00
espie
955e97ab1b fix incorrect handling of config info,
repair full signatures (with X11R6 libs too)
2016-05-20 09:09:15 +00:00
espie
f7a06e7e44 ports like firefox-i18n have huge common distinfo located thru ../distinfo.
let read_checksums normalize the path so they get recognize as one file.
-> parse it once instead of 40 times.
also, remove the old `next if md5/sha1' test, it was always just an
optimization, and becomes a pessimization now that these are gone.
2016-05-18 06:35:38 +00:00
espie
b4e5bf6a64 tweaks to heuristics
1/ do subdirs on the command line first
2/ ignore errors from "preferred" dependencies (and don't register anything)
if there are actual errors beyond paths that no longer exist, we'll get them
during the next pass.
2016-05-17 14:50:36 +00:00
espie
3388fc4cfd change drastically the way LISTING starts up: let dependencies be a permanent
log.

Now that we can SKIPDIR, doing a first LISTING for most important dependencies
is not a trade-off for the full listing.

It allows dpb to start building most important stuff right away, so that
your machines start earlier.

Caveat: if that list of dependencies changes (ports renames), then you will
see errors because ports no longer exist.

I figure I have time to make errors in the first listing "not relevant"
before that becomes an actual issue.
2016-05-16 13:47:18 +00:00
espie
2495ed5e36 use skipped dirs for initial build 2016-05-16 10:37:44 +00:00
espie
99f013d34f fix log (missing \n) 2016-05-16 10:37:22 +00:00
espie
84584cc7af add SKIPDIRS semantics: automatically add visited dirs to a passed skip
if it's not empty
2016-05-16 10:28:14 +00:00
espie
68b9904f01 support SKIPDIR internally 2016-05-15 22:24:56 +00:00
espie
b14035b2b1 kill unused code (different users for each build) 2016-05-15 20:08:30 +00:00
espie
45ed265b16 nfs shits on its pants again.
not even having readdir and open work synchronously on one single machine,
that shit is so lame.

noticed by aja@, ahaha.
2016-05-14 20:26:42 +00:00
espie
d4f4359484 just check for xn capability presence, don't try to Tputs it,
that doesn't work.
should fix some display glitches under tmux
2016-05-14 18:14:27 +00:00
espie
77cb45ee8f rely on Term::ReadKey here as well 2016-05-13 08:32:17 +00:00
espie
536b18350d make things work better when chrooted, delay some expansions, and acknowledge
that startup is going to run within the chroot.
2016-05-08 12:52:58 +00:00
espie
36a5b5798b reuse the User code in dpb instead of copying it. 2016-05-08 11:51:40 +00:00
espie
af4f89c46f tweak the heuristics to run the engine:
- don't do anything "smart" when the queue is empty. This mostly triggers
at start, and actually hinders dpb from processing more LISTING efficiently
- lower the threshold for "next" engine computation.  Engine cpu usage still
stays within a few percent, but we avoid slumps in the middle, where the
"first" rescan puts the engine out for a while (I should probably look at
a non-linear function).
2016-05-08 09:34:25 +00:00
espie
b5357fd0d9 these days, I've got starved code at end of builds, while there's
still kde3/kde4 contention. So reuse the affinity tactic to find a
Core with the right tainting if it exists.
2016-05-08 09:31:38 +00:00
espie
8bcbaecabd tweak running-as-root defaults to be _pbuild/_pfetch. It's time. 2016-04-30 09:15:58 +00:00
espie
a47ce11878 well, no reason for STARTUP not to be able to use %p 2016-04-29 11:17:44 +00:00
tsg
0da62ca4c5 Make use of FETCH_CMD if possible.
OK zhuk@
2016-04-28 13:29:04 +00:00
tsg
7805a0f3c1 Add another license string and remove outdated comment while I'm at it.
OK naddy@
2016-04-27 09:58:35 +00:00
tsg
34d99541d6 Get rid of accidental RCS marker.
OK jasper@
2016-04-26 17:24:38 +00:00
espie
73dcda78d3 misleading name: anchor works on any path.
distfiles are actually under the chroot, didn't see that because I usually
have my ports tree directly under the root :(
2016-04-26 17:19:41 +00:00
espie
ec39eac3cf thinko 2016-04-26 16:54:00 +00:00
tsg
2d0548eaa0 Set PKG_ARCH and WANTLIB for perl ports.
OK sthen@ zhuk@
2016-04-25 18:38:40 +00:00
tsg
affd2dee1b Import portgen.
OK many
2016-01-18 18:08:19 +00:00
espie
e35dc3d329 synch "still_tainted" with what happens when trying to junk.
maybe there's some better more sophisticated heuristics, but for now,
if you have a "nojunk" port locked, you cannot junk on that host until
you remove the lock (for good reason, at least you can "finish" that port
undisturbed).

fix for the graphics/mapnik recent burp.
2015-11-20 13:49:08 +00:00
espie
0bbdb0e14b don't blink or you'll miss it (not any more)
display down hosts in a rather more prominent manner.
antoine likes it, landry doesn't give a shit.
2015-10-31 09:39:20 +00:00
espie
71fd1fa6b5 even if the file was already checksummed, add an extra check on the size.
Catches up cases of several dpb trampling each other.

Carefully delete any cached information (and the file itself) in case
things no longer match.
2015-10-30 10:27:50 +00:00
espie
eb76c7fe1e grumble, preserve warning message before the trace proper 2015-10-30 09:46:45 +00:00
espie
9efe11300f add a "summary" log that shows for each non built path, why it was non built.
Makes loops obvious. Probably will come with sorting later on.
2015-10-16 13:04:55 +00:00
espie
fc157c6d82 remove UNPRIV_USER configuration entirely, that's the one part where there's
one sensible choice now (_dpb) and no need for configuration.
2015-08-25 22:40:56 +00:00
espie
bce91e106f a bit of interactive mode. Just hooks into the main loop and can prompt for
commands now, can't do anything serious yet.
2015-08-24 10:16:18 +00:00
espie
2ee3c4a3b9 tweak things so that errors show up everywhere 2015-08-24 09:58:00 +00:00
espie
3c022368f4 Config file handling is still somewhat broken... 2015-08-22 09:24:42 +00:00
espie
7d04694472 it's been long enough, if you don't have user _dpb, you lose. 2015-08-20 16:06:12 +00:00