Commit Graph

359 Commits

Author SHA1 Message Date
Kris Kennaway
d6e37c8332 Add a -fetch-original switch to dopackages that fetches the distfiles from
the listed MASTER_SITES instead of ftp-master.  Pass the FETCH_ORIGINAL
environment variable to pdispatch and as a command-line switch to
portbuild.
2003-05-18 00:04:28 +00:00
Kris Kennaway
ce395d3474 Only transfer the build distfiles to bento if requested.
Switch back to chroot builds until I can debug the remaining problems with
jail builds.
2003-05-17 00:27:27 +00:00
Kris Kennaway
116e3b3e87 Pass down the request to keep distfiles if appropriate. 2003-05-17 00:25:59 +00:00
Kris Kennaway
a7924a9308 Add a -distfiles flag to specify that we should retain distfiles for later
processing (e.g. transfer to ftp site).  It was taking up too much disk
space to collect distfiles for 14 architecture/version combinations
(including the backup set from the previous run).

Put the cvsdone files in the arch/branch subdirectory, not arch/.
2003-05-17 00:25:14 +00:00
Kris Kennaway
10e3ce1cdc Switch to polling the clients with netcat to collect load stats, instead
of having the clients scp their loads to bento every 10 seconds.  Fix
some indentation and add some sleeps to make sure the startup script
doesn't run too early in the boot process.
2003-05-17 00:20:53 +00:00
Maxim Sobolev
1ddaf006e0 Previous delta was:
Submitted by:	ru
2003-04-18 13:52:50 +00:00
Maxim Sobolev
a346c15b29 Clean up empty dirs. 2003-04-18 13:51:49 +00:00
Maxim Sobolev
d684f40af6 Speed-up a bit when user keeps his working directories in the ports tree
(doesn't use WRKDIRPREFIX).

Submitted by:	ru
2003-04-08 13:36:45 +00:00
Kris Kennaway
393bb456a9 Update sed pattern used to process logs 2003-04-06 05:42:41 +00:00
Kris Kennaway
26bf92a496 Zap some old/non-useful code
Add some new command-line options:
  * -continue : restart the build without rebuilding ports that have
                already failed
  * -nofinish : don't run the post-processing steps when the build finishes
  * -finish : run the post-processing steps only
Reorder some code sections appropriately
2003-04-06 05:40:27 +00:00
Edwin Groothuis
452a17f4c0 This tool parses the output of kdump to generate a list of added
and removed files.

This can be used as the basis of a pkg-plist, or even just for
curiosity about what files something is touching.

Fairly raw at the moment, and doubtless inefficient, but it should
make a useful tool for port creators.

PR:		ports/47424
Submitter:	Daniel O'Connor <doconnor@gsoft.com.au>
2003-04-04 12:20:54 +00:00
Joe Marcus Clarke
bd948000d0 Sort the non-dirrm entries, and reverse sort the dirrm entries.
Reviewed by:	green
2003-03-28 05:08:03 +00:00
Kris Kennaway
e006d25643 - Define __MAKE_CONF to allow per-arch make.conf files in buildworld
- Set the UNAME_* variables to make use of the override support in uname(1)
  This allows us to get rid of the uname shell script in the build chroots
- Collect some variables that are probably old and mouldy, for later GCing
- If FETCH_ORIGINAL is set in the environment, don't fetch from ftp-master
2003-03-23 01:26:42 +00:00
Will Andrews
7ac6ca52e1 Make modulesupdate actually work in light of split. You can't use a
CVSROOT that's readonly.
2003-03-02 17:29:12 +00:00
Peter Wemm
796330dcfb Update for post-repo-split. s/ncvs/pcvs/ so that the default root is
pcvs.freebsd.org:/home/pcvs
2003-02-28 19:49:31 +00:00
Steve Price
c2e4cc1ce9 Do a better job of stating which port we had problems with while
mapping directories to package names.
2003-02-24 16:07:07 +00:00
Mario Sergio Fujikawa Ferreira
2dc2732c98 Another try at fixing the "adding to CVSROOT/modules from remote
hosts (non-freefall)" bug: add '-A' argument to ssh(1) command line
for accessing host cointaining modules file. This should fix the
bug for ssh-agent(1) users. Others can just switch to using
ssh-agent(1).

Approved by:	will (maintainer)
2003-02-23 20:06:06 +00:00
Kris Kennaway
c5150864d9 Instead of pushing the load data to the master with scp every 10 seconds,
just report it via an inetd service.
2003-02-22 22:26:23 +00:00
Kris Kennaway
e0d90467e6 * Allow port builds to be started with a certain niceness ('nice' parameter
in portbuild.conf). [1]

* Build stage 2 builds in a jail instead of a chroot.  This allows us to
  detect ports that attempt IP communication during the build, as well as
  allowing clean termination of the port build (packages built in a chroot
  can leave processes hanging around after the build finishes).  There
  are some caveats with this approach which will be worked around in a
  future commit.

Requested by:	peter [1]
2003-02-22 22:25:12 +00:00
Kris Kennaway
c5c0032536 If ${buildworld}=1 in mkbindist.conf, then use the makeworld script to
build world and populate the chroot.  Otherwise, if ${ftp}=1 then
fetch it from the ftp site as before.
2003-02-22 22:22:12 +00:00
Kris Kennaway
2629774416 Simplify the collection of load statistics for the cluster. Loads
are now collected by polling a small server on the client (using netcat)
instead of having the client scp the load files to the master every 10
seconds (!!!)
2003-02-22 22:21:00 +00:00
Kris Kennaway
6f6a583bc7 Store dates in +%s format 2003-02-22 22:19:03 +00:00
Akinori MUSHA
1520142bc7 Handle '#' and '$' in pkg-comment properly. 2003-02-21 13:12:02 +00:00
Maxim Sobolev
307e2a0837 - pkg-comment is no longer mandatory;
- ignore patchfiles ending with `,v' or '.orig'.
2003-02-21 00:48:19 +00:00
Akinori MUSHA
ce03f12ae5 Add de-pkg-comment. 2003-02-18 12:45:59 +00:00
Akinori MUSHA
a25c270b0e Add de-pkg-comment, a ruby script to convert pkg-comment to COMMENT. 2003-02-18 12:42:44 +00:00
Norikatsu Shigemura
b4b7d18cdf Change how to get CATEGORIES tag from new port for slave port.
Approved by:	will
2003-02-16 15:23:21 +00:00
Kris Kennaway
4e20fd729d Search for a lot of new failure strings to reduce the number of build
failures listed as '???'.

Submitted by:	Mark Linimon <linimon@lonesome.com>
PR:		www/44919
2003-02-14 09:28:42 +00:00
Kris Kennaway
182d4cc46d Work around broken rand() in -current by changing the way we pick a
random build host.
2003-02-14 09:26:20 +00:00
Kris Kennaway
efc1842637 - If ${ftp} = 0 in mkbindist.conf, then use the makeworld script to build
a world instead.
2003-02-14 09:25:47 +00:00
Kris Kennaway
afda0ec7a9 - Correct usage message
- Don't try and use buildenv, it's useless
- Set TARGET_ARCH instead
2003-02-14 09:24:36 +00:00
Kris Kennaway
5ead3c9bf0 Catch up to new semantics of COMMENT variable (contains comment string
itself, instead of pointing to pkg-comment)
2003-02-10 08:56:59 +00:00
Will Andrews
c65c37a41b Attempt to defuse problems from developers who don't have the correct
ssh setup in order for addport to do CVSROOT/modules correctly.
2003-01-30 17:28:34 +00:00
Kris Kennaway
04a23345d0 If the port directory contains a file called .keep, then tar up the
${WRKDIR} after the port build completes and copy it to
${arch}/${branch}/wrkdirs/${pkgname}.tbz.
2003-01-24 11:01:37 +00:00
Kris Kennaway
b60d2dcc1e These scripts have been replaced by .c versions that do not require perl. 2003-01-24 05:05:38 +00:00
Kris Kennaway
dda0014b14 - Use ${arch} and rename html files accordingly
- Call processfail to produce 'new port failures' page
- Comment out the 'comparelogs' calls for now until I make them aware
  of architectures that don't have 4.x support
2003-01-24 05:04:16 +00:00
Kris Kennaway
934f3cece0 First cut at a script to process the logfile maintained by 'buildsuccess'
and 'buildfailure' and produce a HTML output listing ports with the date
they became broken.  The output can surely be made more useful (e.g. it
always links to the ${branch}-latest logs, which may not exist when the
build-in-progress has not yet attempted the build of that port).
2003-01-24 05:03:08 +00:00
Kris Kennaway
df64a01f68 These scripts are run when a build completes (successfully or not). They
keep track of the number of times a port has failed to build, resetting
the counter when it builds successfully.  There are still some bugs to be
worked out, but this will be used as the basis for maintainer notification
of port failures.
2003-01-24 05:01:24 +00:00
Kris Kennaway
220758235c Simple script to check the number of packages built on the various
architectures, for a given branch.
2003-01-24 04:59:03 +00:00
Kris Kennaway
a4ad73ca23 Script to automate the process of cvs updating the build tree, performing
the buildworld, installworld and 'make distribute' necessary for preparing
a bindist.
2003-01-24 04:57:21 +00:00
Kris Kennaway
6d119d605f - Use ${arch} 2003-01-24 04:55:31 +00:00
Kris Kennaway
6ab268ded7 Determine client architecture using /etc/arch 2003-01-24 04:55:15 +00:00
Kris Kennaway
069c3c3e0f - Use ${arch}
- Support builds as non-privileged user
2003-01-24 04:54:45 +00:00
Kris Kennaway
55e6f3bab5 Check status of multiple architecture client machines 2003-01-24 04:54:01 +00:00
Kris Kennaway
b715744cfd - Use ${arch}
- Increase timeout to 2 hours (needs to be arch-specific)
- Mount nfs filesystems with nfsv3,intr (the latter so that clients do
  not hang if bento panics)
- Run pnohang.${arch} on clients instead of pnohang
- Support builds as non-privileged user
2003-01-24 04:52:29 +00:00
Kris Kennaway
b26c9f68bd - Use ${arch}
- Increase timeout to 8 hours (this needs to be made per-arch so it
  doesn't overly pessimize fast client machines)
- Support building as a non-privileged user
2003-01-24 04:49:09 +00:00
Kris Kennaway
225546e3a1 - Use ${arch}
- Mount on ${master} instead of localhost
2003-01-24 04:47:17 +00:00
Kris Kennaway
d80ddb3e6d - Use ${arch} and ${INDEXFILE} 2003-01-24 04:46:41 +00:00
Kris Kennaway
43c5148669 Add the ${arch} argument 2003-01-24 04:46:02 +00:00
Kris Kennaway
e3ceee4e57 - Use the ${arch} subdirectory and pass ${arch} around to other scripts
- Use $INDEXFILE
- Use makeparallel script instead of 'make parallel'
- Support building packages as a non-privileged user (needs root access
  to client machines)
2003-01-24 04:45:18 +00:00