cpet/freebsd-ports
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
c5150864d9
freebsd-ports/Tools/portbuild/scripts/pdispatch

54 lines
1.2 KiB
Plaintext
Raw Normal View History

The scripts to allow parallel package building. See the README file in Tools/portbuild for details. Note that this is still a major work in progress. I probably forgot something but I need to go to sleep. At least it works here (most of the time :).
1998-12-28 08:27:27 -05:00
#!/bin/sh
Document the use and purpose of this script.
2002-02-10 21:43:14 -05:00
#
- Use ${arch} - Increase timeout to 8 hours (this needs to be made per-arch so it doesn't overly pessimize fast client machines) - Support building as a non-privileged user
2003-01-23 23:49:09 -05:00
# pdispatch <arch> <branch> <command> <package.tgz> [<args> ...]
Document the use and purpose of this script.
2002-02-10 21:43:14 -05:00
#
# Choose a random machine from ${buildroot}/ulist and dispatch the
# job to it via the ptimeout script.
Timeout port builds after 4 hours. This will prevent ports that get stuck indefinitely in fetch or configure from hanging up the entire build process.
1999-06-22 06:18:40 -04:00
* Use portbuild.conf for config information. * Shorten timeout period from 12 hours to 4 hours to avoid delaying the builds unnecessarily. * Reverse sense of NOPLISTCHECK -> PLISTCHECK, since it's not an option we want enabled by default (it causes too many build failures). This was too easy to forget when building packages 'by hand' using the parallel makefile.
2002-03-09 18:14:41 -05:00
pb=/var/portbuild
- Use ${arch} - Increase timeout to 8 hours (this needs to be made per-arch so it doesn't overly pessimize fast client machines) - Support building as a non-privileged user
2003-01-23 23:49:09 -05:00
arch=$1
shift
. ${pb}/${arch}/portbuild.conf
Use PKGSUFFIX from buildenv
2002-09-15 17:57:52 -04:00
. ${pb}/scripts/buildenv
- Use ${arch} - Increase timeout to 8 hours (this needs to be made per-arch so it doesn't overly pessimize fast client machines) - Support building as a non-privileged user
2003-01-23 23:49:09 -05:00
# wait 8 hours maximum
timeout=28800
Timeout port builds after 4 hours. This will prevent ports that get stuck indefinitely in fetch or configure from hanging up the entire build process.
1999-06-22 06:18:40 -04:00
Instead of doing a pwd | grep (duh!) to find the branch we are building ports for, pass it as an argument. Pass NO_RESTRICTED, NOPLISTCHECK and NODUMMY to ssh as flags when said environment variables are set.
2000-08-29 04:25:14 -04:00
branch=$1
command=$2
shift 2
The scripts to allow parallel package building. See the README file in Tools/portbuild for details. Note that this is still a major work in progress. I probably forgot something but I need to go to sleep. At least it works here (most of the time :).
1998-12-28 08:27:27 -05:00
- Use ${arch} - Increase timeout to 8 hours (this needs to be made per-arch so it doesn't overly pessimize fast client machines) - Support building as a non-privileged user
2003-01-23 23:49:09 -05:00
buildenv ${pb} ${arch} ${branch}
Use PKGSUFFIX from buildenv
2002-09-15 17:57:52 -04:00
The scripts to allow parallel package building. See the README file in Tools/portbuild for details. Note that this is still a major work in progress. I probably forgot something but I need to go to sleep. At least it works here (most of the time :).
1998-12-28 08:27:27 -05:00
# ssh -x doesn't work on some machines
unset DISPLAY
Use PKGSUFFIX from buildenv
2002-09-15 17:57:52 -04:00
pkgname=$(basename $1 ${PKGSUFFIX})
The scripts to allow parallel package building. See the README file in Tools/portbuild for details. Note that this is still a major work in progress. I probably forgot something but I need to go to sleep. At least it works here (most of the time :).
1998-12-28 08:27:27 -05:00
- Use ${arch} - Increase timeout to 8 hours (this needs to be made per-arch so it doesn't overly pessimize fast client machines) - Support building as a non-privileged user
2003-01-23 23:49:09 -05:00
if grep -qxF $pkgname ${pb}/${arch}/${branch}/duds; then
The scripts to allow parallel package building. See the README file in Tools/portbuild for details. Note that this is still a major work in progress. I probably forgot something but I need to go to sleep. At least it works here (most of the time :).
1998-12-28 08:27:27 -05:00
echo "skipping $pkgname"
exit 1
fi
args=${1+"$@"}
Work around broken rand() in -current by changing the way we pick a random build host.
2003-02-14 04:26:20 -05:00
num=$(wc -w ${pb}/${arch}/ulist | awk '{print $1}')
random=$(jot -r 1 1 ${num})
mach=$(cat ${pb}/${arch}/ulist | cut -f ${random} -d ' ' )
The scripts to allow parallel package building. See the README file in Tools/portbuild for details. Note that this is still a major work in progress. I probably forgot something but I need to go to sleep. At least it works here (most of the time :).
1998-12-28 08:27:27 -05:00
set $mach
Instead of doing a pwd | grep (duh!) to find the branch we are building ports for, pass it as an argument. Pass NO_RESTRICTED, NOPLISTCHECK and NODUMMY to ssh as flags when said environment variables are set.
2000-08-29 04:25:14 -04:00
flags=""
By defining NOCLEAN in the environment, you can have the chroot dir left behind. Useful for debugging. Touch package on master after copying it back. This will avoid synchronization problems when the machines' clocks are wildly skewed. Remove log from master when build is successful. No need to keep around transient error logs.
1999-01-22 05:00:08 -05:00
if [ "x$NOCLEAN" != "x" ]; then
Instead of doing a pwd | grep (duh!) to find the branch we are building ports for, pass it as an argument. Pass NO_RESTRICTED, NOPLISTCHECK and NODUMMY to ssh as flags when said environment variables are set.
2000-08-29 04:25:14 -04:00
flags="${flags} -noclean"
fi
if [ "x$NO_RESTRICTED" != "x" ]; then
flags="${flags} -norestr"
fi
* Use portbuild.conf for config information. * Shorten timeout period from 12 hours to 4 hours to avoid delaying the builds unnecessarily. * Reverse sense of NOPLISTCHECK -> PLISTCHECK, since it's not an option we want enabled by default (it causes too many build failures). This was too easy to forget when building packages 'by hand' using the parallel makefile.
2002-03-09 18:14:41 -05:00
if [ "x$PLISTCHECK" != "x" ]; then
flags="${flags} -plistcheck"
Instead of doing a pwd | grep (duh!) to find the branch we are building ports for, pass it as an argument. Pass NO_RESTRICTED, NOPLISTCHECK and NODUMMY to ssh as flags when said environment variables are set.
2000-08-29 04:25:14 -04:00
fi
if [ "x$NODUMMY" != "x" ]; then
flags="${flags} -nodummy"
By defining NOCLEAN in the environment, you can have the chroot dir left behind. Useful for debugging. Touch package on master after copying it back. This will avoid synchronization problems when the machines' clocks are wildly skewed. Remove log from master when build is successful. No need to keep around transient error logs.
1999-01-22 05:00:08 -05:00
fi
* Use portbuild.conf for config information. * Shorten timeout period from 12 hours to 4 hours to avoid delaying the builds unnecessarily. * Reverse sense of NOPLISTCHECK -> PLISTCHECK, since it's not an option we want enabled by default (it causes too many build failures). This was too easy to forget when building packages 'by hand' using the parallel makefile.
2002-03-09 18:14:41 -05:00
- Use ${arch} - Increase timeout to 8 hours (this needs to be made per-arch so it doesn't overly pessimize fast client machines) - Support building as a non-privileged user
2003-01-23 23:49:09 -05:00
echo "dispatching: ssh -a -t -n root@$1 ${command} ${arch} ${branch} $flags $args at $(date)"
${pb}/scripts/ptimeout.host $timeout ssh -a -t -n root@$1 ${command} ${arch} ${branch} ${flags} $args
Reference in New Issue Copy Permalink