1059 Commits

Author SHA1 Message Date
espie
0cd41bc4d8 add a "parallel2" property that defaults to the parallel value
chrome is taking so long to build, I want to experiment with giving it
more cores...
2018-09-06 11:31:30 +00:00
sthen
3eb429508f use hw.ncpuonline rather than hw.ncpu for default #/cores in DPB and the
number of parallel "conflict finder" runs of pkglocatedb in update-plist.

ok espie@
2018-09-05 10:31:55 +00:00
espie
ad0ba6e372 prevent infinite recursion 2018-09-05 09:16:19 +00:00
espie
ee2d3810b4 introduce PKGSTEM
intended to fix a problem reported by tb@: pkg-readmes docs used to have
the FULLPKGNAME encoded, which makes for gratuitous differences from version
to version.

- use PKGSTEM inside the README for less variation
- ditch the FULLPKGNAME as the install location, PKGSTEM is enough.

PKGSTEM ?=  is overrideable, because stuff like php branches need to install
several readmes.

Next commit will fix all affected ports: all readmes change location, so lots
of plist tweaks and bumps
2018-09-04 12:41:51 +00:00
espie
ba234ba60b vim swapfiles are not a problem 2018-08-10 09:50:54 +00:00
espie
3403aed295 pass _FAKE_TREE_LIST thru to update-plist (tricky glob/quoting)
this allows removing some special-cases from mtree, as we get the
real directory structure pre-built in fake.
2018-08-06 09:36:32 +00:00
espie
548326f6c5 zap some dirs we don't want 2018-08-04 19:44:31 +00:00
espie
cb653360f4 no idea why I thought using 'chroot' instead of OpenBSD::Paths->chroot
was a good idea.
2018-08-01 15:52:00 +00:00
espie
65e2c67c6c tweak nojunk handling a bit:
- move the logic for choosing junk into add_tasks
- create specific finalize hooks at end of extract and configure
so that nojunk only starts at end of extract, thus gaining a few
(precious) minutes for big nojunk ports
- introduce noconfigurejunk logic, so that a port may configure without
junking opening. This should fix sporadic bugs in automake-based ports
without locking junking for the full build (roughly 200 ports are
affected)
2018-07-23 13:24:47 +00:00
espie
48807c82c1 add timestamp on failure. It's also in engine.log, but redundancy can't
harm us in there
2018-07-22 16:43:42 +00:00
espie
95d45d32e9 likewise 2018-07-21 07:38:46 +00:00
espie
35d5303edb ssh master should run as the user we started dpb as... 2018-07-21 07:36:36 +00:00
espie
b381b8390f get rid of a fatal assertion:
tag mismatches may work if junking occurred AND got rid of a tag,
but in case of nojunk and similar conditions, it's just going to fail
2018-07-18 10:49:05 +00:00
espie
f71ee3cfa0 avoid undefined warnings 2018-07-16 13:23:05 +00:00
espie
3baecffa6a create an intermediate Job::Watched class that includes the common logic to
Job::Port and Job::Fetch, do not kill_on_timeout stuff that's not really stuck
(e.g., waiting for locks and checksumming).

You can now put fairly agressive timeouts on fetch, since checksum is out
of the way.
2018-07-16 12:30:53 +00:00
espie
0e58d6b56a large distfiles take quite a long time checksumming.
stop displaying the 100% message and frozen, you could think it's frozen
"near" 100%. Instead display "cksum..." and get rid of frozen indications
entirely
2018-07-15 14:17:25 +00:00
espie
fcc42b3ee8 SIGNING_PARAMETERS won't come back.
So just get rid of the extra tests, and use TRUSTED_PKG_PATH to make
logs slightly less verbose.
2018-07-15 11:56:43 +00:00
espie
9888eec9ea MASTER_SITE_BACKUP is now independent of the port, so parse it during
general config parsing, don't stash it in individual distfiles, and
add it directly to each fetch job, thus saving memory and time
2018-07-15 09:56:45 +00:00
espie
0e6034768c restrict update-desktop-database to relevant desktop files
discovered by aja@
2018-07-15 07:29:43 +00:00
espie
99ef85dcbc cleaner 2018-07-14 09:49:05 +00:00
espie
3bb65be9e8 be more thorough in handling bak, avoid infinite loop 2018-07-14 09:45:54 +00:00
espie
432397f5f7 remove test that no longer works (MASTER_SITE_BACKUP is independently
defined)

noticed by aja@
2018-07-14 09:34:05 +00:00
espie
41c2caf1b2 make fetch resilient to empty variable errors 2018-07-13 09:11:28 +00:00
espie
b7351daa0c tweak the way we handle backup sites
- they don't makesum
- they fetch the final name in case of renames.

Likewise in dpb:
- grab MASTER_SITE_BACKUP as well
- do a subclass that uses the correct filename

That way, we get stuff from MASTER_SITE_BACKUP correctly
2018-07-13 09:07:00 +00:00
espie
22fe28fa65 protect distinfo and history better against fs overflows 2018-07-11 18:14:25 +00:00
espie
71f53eb2f4 missed commit 2018-07-11 16:10:56 +00:00
espie
df339f3730 darn, opening the file doesn't mean we have room to write to it.
And it could overflow midway thru, so try not to erase existing shitz
2018-07-11 14:43:31 +00:00
espie
7a542a32d6 figure out tags for icon theme directories 2018-07-11 11:34:29 +00:00
espie
3e45c20244 discover update-mime-database tag 2018-07-11 10:43:03 +00:00
espie
38aea405a3 push down the logic for stopped hosts into mark_available.
That way, when we give back swallowed cores, they can get stopped
right away instead of getting ready for another round.
2018-07-09 20:49:22 +00:00
espie
02d5e60dcb scaffold for glib-compile-schemas 2018-07-08 19:39:33 +00:00
espie
901711cdda don't return from each 2018-07-07 23:46:05 +00:00
espie
767d61b960 scaffolding for desktop files 2018-06-28 17:56:53 +00:00
espie
60dee85e8b trust our own built packages 2018-06-27 07:07:57 +00:00
espie
db40f940d7 scaffold for log parsing, this is nowhere near ready (not activated yet) 2018-06-09 09:46:27 +00:00
espie
7f33b62020 add scaffolding to a -L log option, to parse install/chown/chgrp annotations 2018-06-03 10:06:39 +00:00
espie
5a1a7dd5f4 - do not have default ignored variables, less magic in there, more
option usage.
- final tweak to directory names, make sure they end with a /
a double / is not a problem for pkg_create, and it makes things
more readable for puny humans.
2018-05-27 11:56:27 +00:00
espie
8605e5eba3 now that rcscript is no longer special, don't stage it.
Side-effect: this will reorder rscripts, mostly at the start of
packing-lists.

THIS REQUIRES CURRENT pkg_add!
Otherwise you'll get lots of funny @cwd
2018-05-27 09:38:21 +00:00
espie
5bea6bdf8e more partially accurate check... still some stuff to look at wrt keywords 2018-05-23 13:53:39 +00:00
espie
f49ee2b53c prepare for matching directories for new entries.
- add an assertion for unsubst for debugging (commented out)
- chomp the unsubst string so that the assertion works for full matches
- document where to add the new stuff
2018-05-21 06:16:23 +00:00
espie
0a183ab8db manpages version substitution is slightly funnier: we want to allow
for a VERSION followed by a manpage suffix, actually.

(this fixes nethack)
2018-05-20 15:58:32 +00:00
espie
bd30d33a5d be even more specific: only prevent backsubst on dewey if we are a dewey
number ourselves
2018-05-20 07:57:16 +00:00
espie
9d0f07ab47 less aggressive 2018-05-20 07:50:08 +00:00
espie
1e874352a7 small improvements:
- if both PREFIX and LOCALBASE have the same value, prefer PREFIX
- for "version-like" substitution, also handle 5.${VERSION}  to not happen
2018-05-20 07:41:11 +00:00
espie
4b85c796a1 have infodir recognize xemacs dir, which is one line longer than usual
also don't display undefined messages if this is just a random short file
2018-05-15 10:34:16 +00:00
espie
3f6da12d3e unbreak prefix substitution. Checking whether our class has a keyword
is actually invalid (@file does), so do something reliable instead
2018-05-15 08:30:55 +00:00
sthen
d18b3615a7 Restrict @fontdir additions to /usr/local/share/fonts for now,
it might make sense to have this a bit wider, but currently the
marker is added in quite a few places where it doesn't help.
Expand the match to include truetype/opentype collections and
pfa files.  ok espie
2018-05-12 11:21:27 +00:00
espie
4eff1c5c0e some not so small changes
- use context in prefix/suffix substitution
specifically, if we have keywords, explicitly allow for them in prefix
Allow for substitution "anywhere" in actions
And allow for manpage extension for suffixes

- never propose a substitution for TRUEPREFIX, it shouldn't even be there
(still need PREFIX vs LOCALBASE desambiguation)
- create the sorted variables list in finalize, so we can add more meat
- allow for MACHINE_ARCH-openbsd (perl)
- be more specific for new substs, we allow substs if the value just appeared
- do not count variables we don't backsubst as duplicate value, this should
solve DISTNAME vs FULLPKGNAME
2018-05-12 10:46:39 +00:00
espie
0868f762d8 add support for version-like variables 2018-05-12 07:59:00 +00:00
espie
ee4a13b581 add /var/tmp to the list of "known" dirs 2018-05-11 10:25:05 +00:00