Commit Graph

226 Commits

Author SHA1 Message Date
Kris Kennaway
d6e37c8332 Add a -fetch-original switch to dopackages that fetches the distfiles from
the listed MASTER_SITES instead of ftp-master.  Pass the FETCH_ORIGINAL
environment variable to pdispatch and as a command-line switch to
portbuild.
2003-05-18 00:04:28 +00:00
Kris Kennaway
ce395d3474 Only transfer the build distfiles to bento if requested.
Switch back to chroot builds until I can debug the remaining problems with
jail builds.
2003-05-17 00:27:27 +00:00
Kris Kennaway
116e3b3e87 Pass down the request to keep distfiles if appropriate. 2003-05-17 00:25:59 +00:00
Kris Kennaway
a7924a9308 Add a -distfiles flag to specify that we should retain distfiles for later
processing (e.g. transfer to ftp site).  It was taking up too much disk
space to collect distfiles for 14 architecture/version combinations
(including the backup set from the previous run).

Put the cvsdone files in the arch/branch subdirectory, not arch/.
2003-05-17 00:25:14 +00:00
Kris Kennaway
10e3ce1cdc Switch to polling the clients with netcat to collect load stats, instead
of having the clients scp their loads to bento every 10 seconds.  Fix
some indentation and add some sleeps to make sure the startup script
doesn't run too early in the boot process.
2003-05-17 00:20:53 +00:00
Kris Kennaway
393bb456a9 Update sed pattern used to process logs 2003-04-06 05:42:41 +00:00
Kris Kennaway
26bf92a496 Zap some old/non-useful code
Add some new command-line options:
  * -continue : restart the build without rebuilding ports that have
                already failed
  * -nofinish : don't run the post-processing steps when the build finishes
  * -finish : run the post-processing steps only
Reorder some code sections appropriately
2003-04-06 05:40:27 +00:00
Kris Kennaway
e006d25643 - Define __MAKE_CONF to allow per-arch make.conf files in buildworld
- Set the UNAME_* variables to make use of the override support in uname(1)
  This allows us to get rid of the uname shell script in the build chroots
- Collect some variables that are probably old and mouldy, for later GCing
- If FETCH_ORIGINAL is set in the environment, don't fetch from ftp-master
2003-03-23 01:26:42 +00:00
Kris Kennaway
c5150864d9 Instead of pushing the load data to the master with scp every 10 seconds,
just report it via an inetd service.
2003-02-22 22:26:23 +00:00
Kris Kennaway
e0d90467e6 * Allow port builds to be started with a certain niceness ('nice' parameter
in portbuild.conf). [1]

* Build stage 2 builds in a jail instead of a chroot.  This allows us to
  detect ports that attempt IP communication during the build, as well as
  allowing clean termination of the port build (packages built in a chroot
  can leave processes hanging around after the build finishes).  There
  are some caveats with this approach which will be worked around in a
  future commit.

Requested by:	peter [1]
2003-02-22 22:25:12 +00:00
Kris Kennaway
c5c0032536 If ${buildworld}=1 in mkbindist.conf, then use the makeworld script to
build world and populate the chroot.  Otherwise, if ${ftp}=1 then
fetch it from the ftp site as before.
2003-02-22 22:22:12 +00:00
Kris Kennaway
2629774416 Simplify the collection of load statistics for the cluster. Loads
are now collected by polling a small server on the client (using netcat)
instead of having the client scp the load files to the master every 10
seconds (!!!)
2003-02-22 22:21:00 +00:00
Kris Kennaway
6f6a583bc7 Store dates in +%s format 2003-02-22 22:19:03 +00:00
Kris Kennaway
4e20fd729d Search for a lot of new failure strings to reduce the number of build
failures listed as '???'.

Submitted by:	Mark Linimon <linimon@lonesome.com>
PR:		www/44919
2003-02-14 09:28:42 +00:00
Kris Kennaway
182d4cc46d Work around broken rand() in -current by changing the way we pick a
random build host.
2003-02-14 09:26:20 +00:00
Kris Kennaway
efc1842637 - If ${ftp} = 0 in mkbindist.conf, then use the makeworld script to build
a world instead.
2003-02-14 09:25:47 +00:00
Kris Kennaway
afda0ec7a9 - Correct usage message
- Don't try and use buildenv, it's useless
- Set TARGET_ARCH instead
2003-02-14 09:24:36 +00:00
Kris Kennaway
04a23345d0 If the port directory contains a file called .keep, then tar up the
${WRKDIR} after the port build completes and copy it to
${arch}/${branch}/wrkdirs/${pkgname}.tbz.
2003-01-24 11:01:37 +00:00
Kris Kennaway
b60d2dcc1e These scripts have been replaced by .c versions that do not require perl. 2003-01-24 05:05:38 +00:00
Kris Kennaway
dda0014b14 - Use ${arch} and rename html files accordingly
- Call processfail to produce 'new port failures' page
- Comment out the 'comparelogs' calls for now until I make them aware
  of architectures that don't have 4.x support
2003-01-24 05:04:16 +00:00
Kris Kennaway
934f3cece0 First cut at a script to process the logfile maintained by 'buildsuccess'
and 'buildfailure' and produce a HTML output listing ports with the date
they became broken.  The output can surely be made more useful (e.g. it
always links to the ${branch}-latest logs, which may not exist when the
build-in-progress has not yet attempted the build of that port).
2003-01-24 05:03:08 +00:00
Kris Kennaway
df64a01f68 These scripts are run when a build completes (successfully or not). They
keep track of the number of times a port has failed to build, resetting
the counter when it builds successfully.  There are still some bugs to be
worked out, but this will be used as the basis for maintainer notification
of port failures.
2003-01-24 05:01:24 +00:00
Kris Kennaway
220758235c Simple script to check the number of packages built on the various
architectures, for a given branch.
2003-01-24 04:59:03 +00:00
Kris Kennaway
a4ad73ca23 Script to automate the process of cvs updating the build tree, performing
the buildworld, installworld and 'make distribute' necessary for preparing
a bindist.
2003-01-24 04:57:21 +00:00
Kris Kennaway
6d119d605f - Use ${arch} 2003-01-24 04:55:31 +00:00
Kris Kennaway
6ab268ded7 Determine client architecture using /etc/arch 2003-01-24 04:55:15 +00:00
Kris Kennaway
069c3c3e0f - Use ${arch}
- Support builds as non-privileged user
2003-01-24 04:54:45 +00:00
Kris Kennaway
55e6f3bab5 Check status of multiple architecture client machines 2003-01-24 04:54:01 +00:00
Kris Kennaway
b715744cfd - Use ${arch}
- Increase timeout to 2 hours (needs to be arch-specific)
- Mount nfs filesystems with nfsv3,intr (the latter so that clients do
  not hang if bento panics)
- Run pnohang.${arch} on clients instead of pnohang
- Support builds as non-privileged user
2003-01-24 04:52:29 +00:00
Kris Kennaway
b26c9f68bd - Use ${arch}
- Increase timeout to 8 hours (this needs to be made per-arch so it
  doesn't overly pessimize fast client machines)
- Support building as a non-privileged user
2003-01-24 04:49:09 +00:00
Kris Kennaway
225546e3a1 - Use ${arch}
- Mount on ${master} instead of localhost
2003-01-24 04:47:17 +00:00
Kris Kennaway
d80ddb3e6d - Use ${arch} and ${INDEXFILE} 2003-01-24 04:46:41 +00:00
Kris Kennaway
43c5148669 Add the ${arch} argument 2003-01-24 04:46:02 +00:00
Kris Kennaway
e3ceee4e57 - Use the ${arch} subdirectory and pass ${arch} around to other scripts
- Use $INDEXFILE
- Use makeparallel script instead of 'make parallel'
- Support building packages as a non-privileged user (needs root access
  to client machines)
2003-01-24 04:45:18 +00:00
Kris Kennaway
90bdd0d643 Add makeparallel script, an improved version of the 'parallel' target
in ports/Makefile.  It uses the buildenv framework to obtain the correct
PKGSUFFIX and INDEXFILE variables.
2003-01-24 04:43:42 +00:00
Kris Kennaway
13c6a42331 Use pkg_add instead of pkg_add -f 2003-01-24 04:39:02 +00:00
Kris Kennaway
47e798381c Sync with bento:
- Switch to using ${arch}/${branch} subdirectory instead of ${branch}
- export INDEXFILE, MACHINE_ARCH and ARCH variables
- Add (commented out) FETCH_BEFORE_ARGS setting
- Add MASTER_SITE_OVERRIDE to fetch from ftp://bento
- Zap some mouldy old unused variables
2003-01-24 04:37:29 +00:00
Kris Kennaway
4fbc0185e0 Remove these scripts, which are no longer useful. 2003-01-24 04:32:33 +00:00
Kris Kennaway
520ab052d8 Convert this to buildenv to make it actually work properly. 2002-11-18 10:12:47 +00:00
Kris Kennaway
115bbb55f9 Fix the html output of this script. There was neither a closing
body tag nor a closing html tag.  In general, browsers work without
these, but Konqueror in particular was displaying some artifacts.

Also make sure empty cells have an nbsp directive; eliminate a bogus
case for Aff.; and change Date build to Build date.

Submitted by:	Mark Linimon <linimon@lonesome.com>
PR:		www/45021
2002-11-10 08:55:33 +00:00
Kris Kennaway
78395efc95 Catch up to lots of changes from bento/beta:
* Update list of quickports to include kde3

* Add ability to restart builds (-restart)

* Change default to build packages for non-cdrom use (associated option name
  inverted from -nocdrom to -cdrom)

* Cope with .tgz or .tbz packages

* Use buildenv framework

* Use cvs update -PdA instead of -Pd when updating ports/docs tree

* Always delete restricted packages after a build run, since they are
  published on the website.

* Minor cosmetic changes
2002-11-08 22:20:48 +00:00
Kris Kennaway
a3be6877e5 Revamp this script:
* generate an interim .logs file containing the data to be presented in
  the html files (also useful for other consumers, like fenner's
  per-maintainer error logs)

* Generate 5 different summaries of the error data, sorted by port name,
  maintainer, category, build error, builddate

* Improve the table html code so it renders faster

* Add a few new failure reasons

Submitted by:	edwin (based on)
PR:		ports/43927
2002-11-03 22:41:40 +00:00
Kris Kennaway
7c78297dc2 Add C versions of the pnohang and ptimeout scripts (previously written in
perl).  Thanks to all those who submitted versions of these.

Submitted by:	marcus (based on)
2002-11-03 04:49:39 +00:00
Kris Kennaway
da8d4e6bda Use the correct filename for the FreeBSD version string used by the
uname script.  Mount the docs from the correct location.  Remove the
hack to pkg_add perl into the chroot environment, now that the scripts
no longer rely on it.
2002-11-02 04:04:14 +00:00
Kris Kennaway
78774e2719 Read FTP url from ${ftpurl}. Remove hack to fetch perl package into the
bindist now that it is no longer required.
2002-11-02 04:01:54 +00:00
Kris Kennaway
52918465c1 Support either .tgz or .tbz packages 2002-11-02 04:00:18 +00:00
Kris Kennaway
a76f0d1da4 Add FTP_PASSIVE_MODE. Build tgz packages on 4 and 4-exp, and tbz on 5. 2002-11-02 03:59:45 +00:00
Kris Kennaway
ef6266db84 Correct a message 2002-09-15 22:05:54 +00:00
Kris Kennaway
ce8ff4da93 Conditionalize one more thing on i386 2002-09-15 22:04:05 +00:00
Kris Kennaway
a959b8bdac Optimize the html output by putting multiple missing files in the same
table row, instead of making a new row for every single file.  This
cuts down the generated page size drastically, improving rendering times.

Submitted by:	Edwin Groothuis <edwin@mavetju.org>
PR:		ports/40962
2002-09-15 22:02:20 +00:00