Commit Graph

3212 Commits

Author SHA1 Message Date
espie
6ffbfdc3a9 fix sig for LIB_DEPENDS 2012-06-15 10:31:52 +00:00
espie
f217f9b069 match src/ change.
*keep ports and src in synch* or out-of-date won't work at all.
2012-06-14 13:34:24 +00:00
espie
d808116161 Use :Q, it will quote a lot more in a correct way. 2012-06-09 21:14:43 +00:00
sthen
8f529f75b3 quote the permit_cdrom and permit_ftp variables used in the new checksum
code, as they can contain spaces.  ok espie@
2012-06-08 23:51:21 +00:00
espie
98a72af47d typo 2012-06-08 15:17:02 +00:00
espie
3294a50c3d add support for sha256 packages as they're built.
after discussion with aja@
2012-06-08 14:46:54 +00:00
sebastia
011bac4f6e Fix typo
ok dcoppa@, aja@
2012-06-07 20:52:41 +00:00
pascal
769ccfc457 Add BE_ARCHS and LE_ARCHS vars to be able to determine endianness.
ok espie@
2012-06-04 18:41:46 +00:00
espie
482f234b05 this is tricky enough to warrant an actual comment 2012-05-28 09:54:18 +00:00
espie
27f4c3dc4f forgot cruft from readmes 2012-05-28 09:43:17 +00:00
espie
b6c9f9baf3 zap old readmes infrastructure, replaced by new age databases/ports-readmes
which is ways more accurate anyways.
2012-05-28 09:38:04 +00:00
espie
d19515c7c3 make it possible for print-plist-with-depends to control lib-depends entirely
(useful for future update-plist)
2012-05-26 12:04:35 +00:00
espie
ef74243178 adjust interface slightly 2012-05-16 08:22:22 +00:00
jasper
fbebf9fd0d don't append ccache to BUILD_DEPENDS if NO_BUILD is set to Yes
ok sthen@
2012-05-16 06:36:56 +00:00
espie
7bc86a3598 whine for pkgpaths with extra / 2012-05-15 11:48:07 +00:00
espie
a3e1fdee35 split the PkgPath component into a base class so that sqlports will be
able to reuse it
2012-05-15 10:10:13 +00:00
robert
6217eaa4ca add the _yule user for the samhain port 2012-05-11 09:39:51 +00:00
jasper
ec251be3fa "fix" a line which emacs loudly complains about...
ok espie@
2012-05-08 17:38:21 +00:00
halex
1fbdcad4e3 call exit 1 after cleanup in signal traps, or the shell keeps running after
SIGINT and friends

ok espie@
2012-05-07 21:11:43 +00:00
espie
5ce8777473 just some nits 2012-05-07 15:57:51 +00:00
jasper
9ce18adad7 add MASTER_SITE_DEBIAN
ok sthen@
2012-04-30 19:21:25 +00:00
ajacoutot
9eeb9a1c1b Set localstatedir (i.e. BASELOCALSTATEDIR) to /var by default if
CONFIGURE_STYLE is gnu.
Works the same way as SYSCONFDIR, one can append a subdirectory to
change the default localstatedir by using the following construct in the
port Makefile:
LOCALSTATEDIR=	${BASELOCALSTATEDIR}/foobar

Note that this variable in not substituted in PLIST.

bulk tested by landry (on a previous diff)
ok jasper@ sthen@
2012-04-28 10:50:35 +00:00
jasper
1e60eb0d4f bye bye aterm 2012-04-26 19:18:50 +00:00
naddy
1f9f1ae603 5.1 CD packages 2012-04-23 17:54:15 +00:00
espie
c1c992e6a5 dump-vars should show VMEM_WARNING 2012-04-22 10:39:48 +00:00
espie
7fdfa19c5a make sure stuff gets thru ssh correctly 2012-04-21 21:09:07 +00:00
espie
5db27d90a1 fix env name for wrapper program 2012-04-21 14:41:37 +00:00
espie
8dc35a6962 make it possible to use a specialized wrapper to collect rss stats 2012-04-21 11:30:53 +00:00
espie
390cba80df handle modbuild (perl module) stuff similarly to what gnu does.
there's no actual reason not to do it.
2012-04-17 09:31:47 +00:00
espie
b411a2917d strip PORTSDIR (or equivalent) from DESCR the same way we compute PKGPATH.
avoids random changes of INDEX depending on where the ports tree is installed
and configured.
2012-04-16 09:21:39 +00:00
landry
fd5a44dd70 Oops, unbreak by providing an empty GCC3_ARCHS. 2012-04-12 15:06:05 +00:00
landry
3cd365fcdd Move sh/landisk to GCC4_ARCHS.
ok phessler@ naddy@
2012-04-12 11:46:35 +00:00
phessler
4e79f499c5 reserve user for cvsyncd
OK naddy@
2012-04-10 19:51:13 +00:00
espie
8cb5363e94 whitespace 2012-04-10 17:06:15 +00:00
espie
ff2903bf59 document -DNO_BUILD_STATS on the off chance someone would ever need it. 2012-04-10 17:00:29 +00:00
espie
b56361e24c always do default stats, unless we explicitly disable them with -DNO_STATS 2012-04-10 16:58:47 +00:00
espie
0deaaa9fa4 avoid spewed warnings in case we don't care. 2012-04-10 16:50:33 +00:00
espie
55635c592a synch documentation 2012-04-08 10:20:42 +00:00
espie
2ecf172edb elide empty L= / E= lines 2012-04-07 12:16:58 +00:00
espie
a01f052d1c on accelerated boxes, one can keep the cursor visible.
make that the default, keep vis/invis as -DNO_CURSOR.
2012-04-07 12:13:36 +00:00
sthen
ea3e106e55 reserve uid for sslh port 2012-04-06 09:06:34 +00:00
jeremy
10af9db5ef Add MASTER_SITE_NPM, needed by the www/node module.
OK sthen@
2012-04-03 19:00:29 +00:00
espie
9cbe5aecb1 have a look at PORTSDIR_PATH as well, so that we can dpb -P dir/p
under mystuff.

problem noticed by jeremy@
2012-04-02 15:51:24 +00:00
espie
b2a184c1df fix landry's error.
forget was in the wrong class, oops.
2012-04-02 09:21:18 +00:00
sthen
883f01ba39 SEPARATE_BUILD=simple->Yes 2012-03-29 13:41:58 +00:00
espie
5572ec286f ignore build_stats for logging distinfo (and clean-old-distfiles(1)). 2012-03-22 16:09:37 +00:00
espie
f456512a27 error out if PORTSDIR is not set to the real directory.
There are at least two or three ports that don't like symlinks. ;/
2012-03-22 14:08:50 +00:00
sthen
6b28800485 reserve user for maradns deadwood 2012-03-20 22:31:56 +00:00
ajacoutot
92940c6df6 Add the _colord user and group. 2012-03-19 08:21:55 +00:00
espie
4fe1c88e80 quickpath to fullpkgpath, called a lot during adjust. 2012-03-13 16:48:47 +00:00
espie
ca5467b575 there's no longer any need to keep track of build.log manually, as it
gets taken care off thru %p/build-stats/%a
2012-03-09 21:18:40 +00:00
espie
11d2036d1a duplicate -m option, resolve conflict by renaming old unused one to -M.
Document some new stuff
2012-03-09 15:16:38 +00:00
espie
38db8f2149 tweak weight handling so that fixing weights and scaling weights works.
add -m option as a reverse to -x, like in pkg_add
2012-03-09 12:51:38 +00:00
sthen
4c24feea48 .poison SEPERATE_BUILD 2012-03-09 11:38:56 +00:00
espie
d1754a0b78 fix things when we don't have any statistics to start with 2012-03-06 13:41:38 +00:00
espie
bffed54177 create build-stats dir (noticed by Mark Patruck) 2012-03-06 11:22:40 +00:00
espie
5327873dc1 fix -a bug: if you specify -I ..., this shouldn't negate a -a.
"permanent build log" under %f/build-stats/%a
-J250 by default
2012-03-05 19:43:09 +00:00
sthen
dc0ad8c2f5 reserve uid for www/trac 2012-03-03 11:40:32 +00:00
espie
a366b51e34 %f for distdir (where fetched distfiles live) 2012-03-02 19:35:09 +00:00
espie
0a05d056a4 keep track of how long a job is stuck, max. 2012-03-02 19:33:43 +00:00
espie
7222a75d55 fix detection of existing dpbs. 2012-03-02 17:14:41 +00:00
espie
243f41a146 better: if old locks, don't warn.
if no locks to possibly remove, well, don't even run ps !
2012-02-28 14:23:27 +00:00
espie
4e1e02f27d document recent options 2012-02-27 20:42:39 +00:00
fgsch
428ac64b90 add pypi mirrors from http://pypi.python.org/mirrors.
rpointel@ ajacoutot@ benoit@ sthen@ ok.
2012-02-27 18:10:41 +00:00
espie
2cc9bc20ca tweak so that dpb -I misc/screen/
will work
2012-02-27 17:50:14 +00:00
espie
fb2feec6cf let's do error messages differently: get die to reset_cursor and die
(reverse-override reporter), and get warn to use myprint (and need for
tabs to become spaces in that case...)
2012-02-27 15:37:36 +00:00
espie
56b1b3241a allow -I/-P/-C and command-line arguments to be lists of pkgpaths, or pkgpath
(it's easy to distinguish between a file and a directory under ports).

expand sequences for those files and hosts

when restarting dpb, kill locks that don't correspond to errors, but to a dpb
running on the same host that's no longer there.

do __WARN__ like __DIE__

option -DDONT_BUILD_ONCE
option -DDONT_CLEAN_LOCKS

document some
2012-02-27 14:51:37 +00:00
espie
e7e37de86c hack to avoid stopping midway thru, need to find a better way... ;( 2012-02-23 21:42:23 +00:00
espie
aa4fe831d9 give FULLPKGPATH in warning message. Redundant, but may be useful for multi. 2012-02-23 08:32:17 +00:00
espie
b4dfd43424 also log the fullpkgpath, no need to go look in the lock proper for that. 2012-02-21 10:37:26 +00:00
espie
1a4ddc336c record master dpb pid and hostname
(will be used for automatic clean-up of locks on startup)
2012-02-20 21:18:48 +00:00
espie
81064a2b7c make sure distdir exists before writing information in there 2012-02-20 16:38:23 +00:00
ajacoutot
ee22512dc3 Deprecate _avahi-autoipd. 2012-02-19 17:53:38 +00:00
robert
b8015755bb disable the _nginx user here 2012-02-19 15:02:56 +00:00
espie
a6d46ce156 make it more obvious that PLIST_DB uses that. 2012-02-18 18:48:21 +00:00
espie
62b1756e6b cosmetic 2012-02-17 07:42:20 +00:00
espie
25362a8808 prevent top-subdirs from ignoring flavor and subpackage markers 2012-02-17 07:41:22 +00:00
espie
958fa76f4d kill fetch-makefile here too 2012-02-17 07:40:35 +00:00
espie
ac82d6c329 cosmetic: fetches come in, so <
explain waiting time better.
2012-02-17 07:36:09 +00:00
espie
9a29fe97e4 allow weights to be scaled
add longer traceback in case we die
2012-02-17 07:35:42 +00:00
espie
bf99288338 scrap old fetch targets
add a warning when LIB_DEPENDS doesn't register (for sthen@)
tweak FLAVOR message for consistency
2012-02-17 07:33:04 +00:00
espie
c422b5ae52 when you never fetched anything after the cipher change, that directory
doesn't exist... don't error out...
2012-01-31 15:45:19 +00:00
espie
10df39f505 missing .P, zap extra parentheses. 2012-01-30 17:11:38 +00:00
ajacoutot
00fa1c45b1 Remove some obsolete syscalls and add one for fpathconf.
From Brad
ok espie@
2012-01-30 16:02:24 +00:00
espie
7b9687cb60 document -DHISTORY_ONLY
nitpick at column width.
2012-01-30 15:15:24 +00:00
espie
7f2b8805ae finish distfiles history handling: people who don't fetch/build the whole
tree may want to weed distfiles too, so allow for a full scan of the tree
without building/fetching anything, just to update history:

dpb -DHISTORY_ONLY

(just requires making sure the right engines are created, and a very shortened
loop at end waiting for history to be updated).
2012-01-30 15:11:04 +00:00
espie
623eb8b2c5 Better name for the task that, duh, is actually updating distfiles history. 2012-01-30 14:19:30 +00:00
espie
e8ba37e682 proper usage diagnostic. 2012-01-29 14:35:40 +00:00
espie
070d4f02a9 allow a list of exceptions, for easier management of distfiles from ports not
yet linked to the build.
2012-01-29 13:03:05 +00:00
espie
8ddfdef47f more flexible error path while scanning, accumulate reasons why broken.
remove a few explicit (and implicit) die from Fetch: missing/out-of-sync
distinfo no longer kill dpb, instead they're properly reported as broken
paths and things still go on (note that even a missing SUPDISTFILE checksum
*will* mark a path as broken, that's totally intentional)
2012-01-29 12:02:20 +00:00
espie
baeec434e0 PKGFILES, why not ? 2012-01-29 11:29:51 +00:00
espie
16fd5981f1 now that update sees all pkgpaths, we can still remove duplicates. 2012-01-28 08:39:40 +00:00
espie
1a3bfc6597 make new mirroring with dpb feature-complete, provide a small perl script that
can remove old distfiles in a smart way according to history.
2012-01-27 19:03:02 +00:00
dcoppa
65090e9b37 Reserve a user for cntlm 2012-01-25 20:55:44 +00:00
espie
cd3220153e remove a bit of noise from the log... we checked already, no need to
log it again.
2012-01-23 10:35:38 +00:00
espie
26b5c343e3 remove that check for now, something in pkg_create chain is not sanitizing
its environment...
2012-01-21 19:07:20 +00:00
espie
9971f34ba5 prevent some errors I've run into recently
- add ERRORS framework to bsd.port.subdir.mk
- trying to add a FLAVOR or a SUBPACKAGE to an intermediate SUBDIR is an
error (see editors/vim-spell,af recently)
- re-including bsd.port.mk/bsd.port.subdir.mk after either of them is an
error (can happen when one moves stuff to Makefile.inc without really thinking
about it, ends up with PKG_ARGS holding some contents twice and make package
erroring out with duplicate contents)
2012-01-21 14:44:40 +00:00
ajacoutot
a47bf72ee0 Update systrace.filter for rthreads syscalls renaming.
from Brad
ok espie@
2012-01-20 13:27:20 +00:00
espie
1ec4d51eba repair dpb -f0
noticed by phessler@
2012-01-18 15:26:49 +00:00
naddy
237122761a we have stpcpy() now 2012-01-17 16:10:42 +00:00
espie
f0d702b93c also scan by_cipher for old stuff. This requires a bit more logic, as
the names of files in there are not totally trivial to figure out from the
normal filename + sha.
-> filename will be stripped off DIST_SUBDIR
-> b64 checksums interfere with filesystem semantics, e.g., /u8//ffg
will become u8/ffg
2012-01-16 18:55:35 +00:00
sthen
baa2ffd218 poison NO_REGRSS, suggested by phessler 2012-01-16 13:18:58 +00:00
espie
0e7a96e0ae flesh out the description of $(DISTDIR)/distinfo and $(DISTDIR)/history 2012-01-14 12:40:35 +00:00
espie
3a6eaf5081 add support to obey PERMIT_DISTFILES* 2012-01-14 12:26:21 +00:00
espie
0739a30939 pass PERMIT_DISTFILES* to dpb fetch 2012-01-14 12:22:07 +00:00
espie
2fe091cc70 recognize pkgpath changes when updating 2012-01-14 12:21:13 +00:00
espie
cb500b33c7 remove files from distinfo when they no longer exist, so when you clean
up files and history, it won't recreate fantom stuff...
2012-01-10 19:35:36 +00:00
espie
f8050aba6f run "expire_old" as a separate job, since it may take some time.
find files under $DISTDIR, anything we don't know about should also
end up in history.
2012-01-09 17:56:28 +00:00
espie
c0aa7effe3 lock may fail 2012-01-09 11:54:30 +00:00
espie
fa990a1dba give dpb more knowledge about distfiles.
- keep a stash indexed by checksum, so dpb can identify duplicate files.
- in a full bulk, if the scan has no errors, write to a ${DISTDIR}/history
file  the files encountered in ${DISTDIR}/distinfo that seem to no longer
be needed (with full timestamp and checksum info).

Should be enough info to know when to expire old DISTDIR entries.
2012-01-08 20:28:37 +00:00
espie
52e58e485e make fetch_manually error directly visible in the lock 2012-01-08 14:40:58 +00:00
espie
3884c2f898 buglet with links and files with a DIST_SUBDIR, as found by naddy@.
people already running dpb -F: just remove /usr/ports/distfiles/distinfo
and rerun dpb.
(or at least all entries with a subdirectory)
2012-01-05 21:49:52 +00:00
espie
0d3bc83fef document -F, as naddy noticed it was not yet documented.
Add more comments to the fact that -R is a hack that doesn't always
work for various reasons, most of which might not ever be fixed...
2012-01-04 02:08:52 +00:00
ajacoutot
fbb3936550 Add remaining syscalls to allow rthreads to work.
from Brad
ok espie@
2012-01-02 12:51:53 +00:00
espie
d9eef11aed prevent dpb from dying if make_link dies (also does not append to global
distinfo, of course)
2012-01-01 18:34:35 +00:00
espie
d45d7573cb document new file semantics. 2011-12-31 14:53:17 +00:00
espie
9938b28564 allow the fetcher part to work as a "true" mirror maker:
- keep a cache of checked checksums as ${DISTDIR}/distinfo
- read existing cache on startup, don't need to recheck those files.
- split checksum_task: update the cache after the checksum is done
- create the by_cipher/sha256/... entries
- in fetch_only mode, do a "long" checksum on existing files not in the cache.

If you ever have doubts on the integrity of already checked files, just
rm ${DISTDIR}/distinfo.
2011-12-31 11:20:00 +00:00
ajacoutot
3126b354d6 Update systrace.filter to allow rthreads to work.
from Brad
ok espie@
2011-12-28 09:39:20 +00:00
sthen
e3b39ca21f reserve 691 for natpmpd 2011-12-23 14:51:21 +00:00
pea
d42d6b3e77 add _pgpool
ok ajacoutot@
2011-12-21 15:31:05 +00:00
miod
95cad4b2a7 In MAKE_ENV, quote PICFLAG as it may contain spaces. Other variables might
require similar quoting in the future, but so far this is enough to repair
port building operation on m68k.
ok espie@
2011-12-21 05:16:04 +00:00
robert
21e0488094 Add support for MODGCC4_VERSION which can be used to define which gcc
version to use with the gcc4 module.
It defaults to 4.2, so there is no functional change.
2011-12-14 18:20:12 +00:00
espie
4cab976e61 zap old junk 2011-12-12 14:52:02 +00:00
jasper
cbd2f0c9f4 add a fragment to prevent picking up gnu awk by accident.
tested in a bulk build by me

  ok espie@
2011-12-12 10:33:33 +00:00
espie
1f6bab1e34 filter out lib-deps with the same pkgpath_and_flavors as what we're
building, like bsd.port.mk does.
won't change anything in the build, but makes pkg_add -a less confusing,
since mp ports won't try to add itself while building.0
2011-12-11 19:55:37 +00:00
espie
d179751a0f on SIGINFO, dump T/B hashes into info.log (and mark the display for refresh,
as the shell might muck it with its own information)
2011-12-10 14:48:40 +00:00
espie
c71b9ad066 expose interface to "refresh" display after some disturbing operation. 2011-12-10 14:47:36 +00:00
espie
0603716dc7 - tweak CONFIG_SITE_LIST to run under infra/db.
- recognize absence of dependencies on gsed, gtar, ggrep,
and prevent more tests from seeing these.
2011-12-10 11:15:16 +00:00
espie
949fe672d3 make it possible to assemble a CONFIG_SITE instead of having one
single file.
approved by aja@, sthen@, jasper@...
2011-12-09 09:42:44 +00:00
espie
ab6b512da4 move the architecture *constants* to a private arch-defines.mk file
That way, bsd.port.arch.mk can still make available in a Makefile, but
we can also include them early in bsd.port.mk, so that they will always
be available from modules and Makefile.inc.
2011-12-08 08:15:36 +00:00
kili
ab869aba97 Reserve uid/gid for hoogle. 2011-12-06 20:35:03 +00:00
sthen
b09a05ec2b reserve uid 688 for dnscrypt-proxy 2011-12-06 19:50:55 +00:00
espie
3081c4ac9a remove "needed" debug log now that things work fine. 2011-12-05 21:27:53 +00:00
espie
c783276075 truly random mode shouldn't peek at most frequent dependencies ! 2011-12-05 21:22:35 +00:00
espie
03c4aa3410 ouch, don't forget to lock at front of prepare (okay, we can avoid it
if no-depends but that's complicated)

also, two distinct critical sections: we don't need to stay locked at
the end of show-prepare-result.

Even though that's not really important, simplify logic a wee little bit
2011-12-05 21:18:55 +00:00
espie
b10178048d move uninstall behavior to uninstall, unbreak !-J
as noticed by fgs@
2011-12-05 18:29:39 +00:00
espie
abb8ddf57d turn -J into an option taking a number.
always run show-prepare-results, and always serialize
depends/prepare/show-prepare-results(/junk) on a single host.
2011-12-05 16:10:00 +00:00
ajacoutot
749308d3d5 Remove MODULE from .poison; it's too generic and breaks at least
sudoku-solver.

ok espie@
2011-12-04 16:31:52 +00:00
espie
a38035bd67 clean-up job running a bit: add methods to Grabber and PortBuilder objects
to access more stuff they need.

Remove distantshell->make, ask state instead.
Provide state with the program we run, and the parameters we pass it.

- same make for distant and local hosts
- pass BUILD_ONCE=Yes if -a.
2011-12-04 12:05:41 +00:00
espie
ddebaf6da6 not ideal, but will now stop at the end of a -F run. 2011-12-04 11:24:38 +00:00
espie
3858760dd5 cut up big method into smaller parts 2011-12-04 10:57:46 +00:00
espie
69df96b71c properly forget old info when rescanning... 2011-12-04 10:39:52 +00:00
espie
0393f66f06 most important usage of dpb upfront, before the exhaustive description of
option.

Drop a few heavy hints regarding ssh usage.
2011-12-03 18:02:39 +00:00
espie
1674edcbbd open needed just once. 2011-12-03 11:10:48 +00:00
espie
c1a46f71e8 faster NFS: if the missing file suddenly reappears, we don't need to rescan
the path, just put it back in the queue, and forget it ever happened.
2011-12-03 11:03:07 +00:00
espie
91b04a0eac fix quick-start: the interface to grabber changed in a silent way.
explicitly move the main_loop near handle_non_waiting_jobs to try to
fix that mess (and finish all the time)
2011-12-03 11:01:47 +00:00
espie
0037a6f50e little message tweak (to be changed anyways) 2011-12-03 09:29:41 +00:00
espie
4d52ff4e54 new -J option
- refactor redirect a bit to store multi-line results to a temporary file
- new show-prepare-results stage using that
- prepare and show-prepare-results shouldn't be NoTime, since they're
predictable.
- lock host thru depends -> junk in the junk case.
acquiring the lock is done thru polling in the child, so that it doesn't block
dpb proper.
- new "junk" stage that gathers dependencies and deletes them.
2011-12-02 22:37:36 +00:00
espie
2cfd4c615d new junk option (to remove packages as they're no longer needed) to pass
around thru JobBuilder (along with locks since we need to write stuff into
that file)
2011-12-02 22:33:46 +00:00
espie
b5c447a355 don't buffer printing to locks, to be able to get dependencies early
gather needed=* lines from locks (may want to cache that info later,
but I don't think it has any actual performance impact)
2011-12-02 22:32:07 +00:00