futurile/guix-play
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
757dc108b8
guix-play/guix/download.scm

668 lines
29 KiB
Scheme
Raw Normal View History

Update license headers. Change all license headers, except guix/build/* and ld-wrapper.scm, with this code: (use-modules (guix build utils) (srfi srfi-1)) (fluid-set! %default-port-encoding "UTF-8") (substitute* (remove (lambda (f) (or (string-contains f ".tar.") (string-contains f ".git/") (string-contains f ".so") (string-suffix? ".o" f) (string-suffix? ".a" f) (string-suffix? ".go" f) (string-suffix? ".pdf" f) (string-suffix? ".png" f) (string-suffix? ".info" f) (equal? (basename f) "guix-daemon") (equal? (basename f) "nix-setuid-helper") (string-contains f "nix-upstream/") (string-contains f "distro/packages/bootstrap/"))) (find-files "." "\\.[a-z]+$")) (("^([[:graph:]]+) This file is part of Guix." _ comment-start) (string-append comment-start " This file is part of GNU Guix.")) (("^([[:graph:]]+) Guix --- Nix package management.*" _ comment-start) (string-append comment-start " GNU Guix --- Functional package management for GNU\n")) (("^([[:graph:]]+) Guix is " _ comment-start) (string-append comment-start " GNU Guix is ")) (("^([[:graph:]]+) along with Guix." _ comment-start) (string-append comment-start " along with GNU Guix.")) (("^([[:graph:]]+) Copyright \\(C\\)" _ comment-start) (string-append comment-start " Copyright ©"))) Change headers using C-style comments manually.
2013-01-05 18:47:50 -05:00
;;; GNU Guix --- Functional package management for GNU
download: 'url-fetch/tarbomb' and 'url-fetch/zipbomb' refer to native tools. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Use 'ungexp-native' instead of 'ungexp' when referring to the decompression tools.
2021-03-05 03:41:40 -05:00
;;; Copyright © 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021 Ludovic Courtès <ludo@gnu.org>
download: Reference tls instead of renamed gnutls module. * guix/download.scm (gnutls-package): Use new module name tls instead of gnutls.
2015-07-05 13:11:04 -04:00
;;; Copyright © 2013, 2014, 2015 Andreas Enge <andreas@enge.fr>
download: Add 'url-fetch/tarbomb'. Suggested by Federico Beffa. Fixes <http://bugs.gnu.org/22676>. Reported by Danny Milosavljevic <dannym@scratchpost.org>. * gnu/packages/engineering.scm (broken-tarball-fetch): Remove. (fastcap)[source](method): Use URL-FETCH/TARBOMB instead. * gnu/packages/scheme.scm (broken-tarball-fetch): Remove. (scmutils)[source](method): Use URL-FETCH/TARBOMB instead. * guix/download.scm (url-fetch/tarbomb): New procedure, renamed from 'broken-tarball-fetch'.
2016-02-21 18:29:54 -05:00
;;; Copyright © 2015 Federico Beffa <beffa@fbengineering.ch>
download: Add SourceForge load balancer. * guix/download.scm (%mirrors)[sourceforge]: Add canonical load balancer for sourceforge.net. Signed-off-by: Leo Famulari <leo@famulari.name>
2016-07-22 13:55:47 -04:00
;;; Copyright © 2016 Alex Griffin <a@ajgrf.com>
gnu-maintenance: Add KDE updater. * guix/gnu-maintenance.scm (kde-package?, latest-kde-release): New private functions. (%kde-updater): New public variable. * guix/scripts/refresh.scm (list-updaters): Add %kde-updater. * doc/guix.texi (Invoking guix refresh): Mention the new updater.
2016-08-01 05:05:28 -04:00
;;; Copyright © 2016 David Craven <david@craven.ch>
download: Use https for main KDE source. * guix/download.scm (%mirrors)[kde]: Use https URIs for main KDE mirrors. * tests/lint.scm ("mirror-url: kde suggestion"): New test.
2022-03-28 17:03:03 -04:00
;;; Copyright © 2016, 2017, 2020, 2022 Efraim Flashner <efraim@flashner.co.il>
download: url-fetch/tarball: Make ‘name’ truly optional. * guix/download.scm (url-fetch/tarbomb): Fall back to ‘file-name’ if ‘name’ is #f, like the regular ‘url-fetch’ does. * gnu/packages/bioinformatics.scm (muscle)[source]: Remove ‘file-name’. * gnu/packages/engineering.scm (fastcap)[source]: Likewise. * gnu/packages/scheme.scm (scmutils)[source]: Likewise.
2017-01-27 14:48:37 -05:00
;;; Copyright © 2017 Tobias Geerinckx-Rice <me@tobias.gr>
download: Add MATE mirrors. * guix/download.scm (%mirrors): Add mirrors for the MATE Desktop.
2019-03-15 13:02:51 -04:00
;;; Copyright © 2019 Guy Fleury Iteriteka <hoonandon@gmail.com>
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
;;;
Update license headers. Change all license headers, except guix/build/* and ld-wrapper.scm, with this code: (use-modules (guix build utils) (srfi srfi-1)) (fluid-set! %default-port-encoding "UTF-8") (substitute* (remove (lambda (f) (or (string-contains f ".tar.") (string-contains f ".git/") (string-contains f ".so") (string-suffix? ".o" f) (string-suffix? ".a" f) (string-suffix? ".go" f) (string-suffix? ".pdf" f) (string-suffix? ".png" f) (string-suffix? ".info" f) (equal? (basename f) "guix-daemon") (equal? (basename f) "nix-setuid-helper") (string-contains f "nix-upstream/") (string-contains f "distro/packages/bootstrap/"))) (find-files "." "\\.[a-z]+$")) (("^([[:graph:]]+) This file is part of Guix." _ comment-start) (string-append comment-start " This file is part of GNU Guix.")) (("^([[:graph:]]+) Guix --- Nix package management.*" _ comment-start) (string-append comment-start " GNU Guix --- Functional package management for GNU\n")) (("^([[:graph:]]+) Guix is " _ comment-start) (string-append comment-start " GNU Guix is ")) (("^([[:graph:]]+) along with Guix." _ comment-start) (string-append comment-start " along with GNU Guix.")) (("^([[:graph:]]+) Copyright \\(C\\)" _ comment-start) (string-append comment-start " Copyright ©"))) Change headers using C-style comments manually.
2013-01-05 18:47:50 -05:00
;;; This file is part of GNU Guix.
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
;;;
Update license headers. Change all license headers, except guix/build/* and ld-wrapper.scm, with this code: (use-modules (guix build utils) (srfi srfi-1)) (fluid-set! %default-port-encoding "UTF-8") (substitute* (remove (lambda (f) (or (string-contains f ".tar.") (string-contains f ".git/") (string-contains f ".so") (string-suffix? ".o" f) (string-suffix? ".a" f) (string-suffix? ".go" f) (string-suffix? ".pdf" f) (string-suffix? ".png" f) (string-suffix? ".info" f) (equal? (basename f) "guix-daemon") (equal? (basename f) "nix-setuid-helper") (string-contains f "nix-upstream/") (string-contains f "distro/packages/bootstrap/"))) (find-files "." "\\.[a-z]+$")) (("^([[:graph:]]+) This file is part of Guix." _ comment-start) (string-append comment-start " This file is part of GNU Guix.")) (("^([[:graph:]]+) Guix --- Nix package management.*" _ comment-start) (string-append comment-start " GNU Guix --- Functional package management for GNU\n")) (("^([[:graph:]]+) Guix is " _ comment-start) (string-append comment-start " GNU Guix is ")) (("^([[:graph:]]+) along with Guix." _ comment-start) (string-append comment-start " along with GNU Guix.")) (("^([[:graph:]]+) Copyright \\(C\\)" _ comment-start) (string-append comment-start " Copyright ©"))) Change headers using C-style comments manually.
2013-01-05 18:47:50 -05:00
;;; GNU Guix is free software; you can redistribute it and/or modify it
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
;;; under the terms of the GNU General Public License as published by
;;; the Free Software Foundation; either version 3 of the License, or (at
;;; your option) any later version.
;;;
Update license headers. Change all license headers, except guix/build/* and ld-wrapper.scm, with this code: (use-modules (guix build utils) (srfi srfi-1)) (fluid-set! %default-port-encoding "UTF-8") (substitute* (remove (lambda (f) (or (string-contains f ".tar.") (string-contains f ".git/") (string-contains f ".so") (string-suffix? ".o" f) (string-suffix? ".a" f) (string-suffix? ".go" f) (string-suffix? ".pdf" f) (string-suffix? ".png" f) (string-suffix? ".info" f) (equal? (basename f) "guix-daemon") (equal? (basename f) "nix-setuid-helper") (string-contains f "nix-upstream/") (string-contains f "distro/packages/bootstrap/"))) (find-files "." "\\.[a-z]+$")) (("^([[:graph:]]+) This file is part of Guix." _ comment-start) (string-append comment-start " This file is part of GNU Guix.")) (("^([[:graph:]]+) Guix --- Nix package management.*" _ comment-start) (string-append comment-start " GNU Guix --- Functional package management for GNU\n")) (("^([[:graph:]]+) Guix is " _ comment-start) (string-append comment-start " GNU Guix is ")) (("^([[:graph:]]+) along with Guix." _ comment-start) (string-append comment-start " along with GNU Guix.")) (("^([[:graph:]]+) Copyright \\(C\\)" _ comment-start) (string-append comment-start " Copyright ©"))) Change headers using C-style comments manually.
2013-01-05 18:47:50 -05:00
;;; GNU Guix is distributed in the hope that it will be useful, but
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
;;; WITHOUT ANY WARRANTY; without even the implied warranty of
;;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
;;; GNU General Public License for more details.
;;;
;;; You should have received a copy of the GNU General Public License
Update license headers. Change all license headers, except guix/build/* and ld-wrapper.scm, with this code: (use-modules (guix build utils) (srfi srfi-1)) (fluid-set! %default-port-encoding "UTF-8") (substitute* (remove (lambda (f) (or (string-contains f ".tar.") (string-contains f ".git/") (string-contains f ".so") (string-suffix? ".o" f) (string-suffix? ".a" f) (string-suffix? ".go" f) (string-suffix? ".pdf" f) (string-suffix? ".png" f) (string-suffix? ".info" f) (equal? (basename f) "guix-daemon") (equal? (basename f) "nix-setuid-helper") (string-contains f "nix-upstream/") (string-contains f "distro/packages/bootstrap/"))) (find-files "." "\\.[a-z]+$")) (("^([[:graph:]]+) This file is part of Guix." _ comment-start) (string-append comment-start " This file is part of GNU Guix.")) (("^([[:graph:]]+) Guix --- Nix package management.*" _ comment-start) (string-append comment-start " GNU Guix --- Functional package management for GNU\n")) (("^([[:graph:]]+) Guix is " _ comment-start) (string-append comment-start " GNU Guix is ")) (("^([[:graph:]]+) along with Guix." _ comment-start) (string-append comment-start " along with GNU Guix.")) (("^([[:graph:]]+) Copyright \\(C\\)" _ comment-start) (string-append comment-start " Copyright ©"))) Change headers using C-style comments manually.
2013-01-05 18:47:50 -05:00
;;; along with GNU Guix. If not, see <http://www.gnu.org/licenses/>.
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
(define-module (guix download)
#:use-module (ice-9 match)
#:use-module (guix derivations)
#:use-module (guix packages)
monads: Move '%store-monad' and related procedures where they belong. This turns (guix monads) into a generic module for monads, and moves the store monad and related monadic procedures in their corresponding module. * guix/monads.scm (store-return, store-bind, %store-monad, store-lift, text-file, interned-file, package-file, package->derivation, package->cross-derivation, origin->derivation, imported-modules, compiled, modules, built-derivations, run-with-store): Move to... * guix/store.scm (store-return, store-bind, %store-monad, store-lift, text-file, interned-file): ... here. (%guile-for-build): New variable. (run-with-store): Moved from monads.scm. Remove default value for #:guile-for-build. * guix/packages.scm (default-guile): Export. (set-guile-for-build): New procedure. (package-file, package->derivation, package->cross-derivation, origin->derivation): Moved from monads.scm. * guix/derivations.scm (%guile-for-build): Remove. (imported-modules): Rename to... (%imported-modules): ... this. (compiled-modules): Rename to... (%compiled-modules): ... this. (built-derivations, imported-modules, compiled-modules): New procedures. * gnu/services/avahi.scm, gnu/services/base.scm, gnu/services/dbus.scm, gnu/services/dmd.scm, gnu/services/networking.scm, gnu/services/ssh.scm, gnu/services/xorg.scm, gnu/system/install.scm, gnu/system/linux-initrd.scm, gnu/system/shadow.scm, guix/download.scm, guix/gexp.scm, guix/git-download.scm, guix/profiles.scm, guix/svn-download.scm, tests/monads.scm: Adjust imports accordingly. * guix/monad-repl.scm (default-guile-derivation): New procedure. (store-monad-language, run-in-store): Use it. * build-aux/hydra/gnu-system.scm (qemu-jobs): Add explicit 'set-guile-for-build' call. * guix/scripts/archive.scm (derivation-from-expression): Likewise. * guix/scripts/build.scm (options/resolve-packages): Likewise. * guix/scripts/environment.scm (guix-environment): Likewise. * guix/scripts/system.scm (guix-system): Likewise. * doc/guix.texi (The Store Monad): Adjust module names accordingly.
2015-01-14 07:34:52 -05:00
#:use-module (guix store)
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
#:autoload (guix build download) (url-fetch)
download: Rewrite using gexps. * guix/download.scm (gnutls-derivation): Remove. (gnutls-package): New procedure. (url-fetch): Rewrite using 'gexp->derivation'.
2014-05-01 15:07:52 -04:00
#:use-module (guix monads)
#:use-module (guix gexp)
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
#:use-module (guix utils)
download: Support 'file://' URLs. * guix/download.scm (download-to-store): When URL has a 'file' scheme or no scheme, use 'add-to-store' directly.
2013-10-12 10:39:10 -04:00
#:use-module (web uri)
download: Add HTTPS support. * guix/build/download.scm: Autoload (gnutls). (tls-wrap): New procedure. (open-connection-for-uri): Add support for `https'. Wrap the socket with `tls-wrap' in that case. (url-fetch): Add `https'. * guix/download.scm (gnutls-derivation): New procedure. (url-fetch)[need-gnutls?]: New variable. Call `gnutls-derivation' when NEED-GNUTLS? is true, and add its output to the `GUILE_LOAD_PATH' env. var. in that case.
2013-01-20 16:28:38 -05:00
#:use-module (srfi srfi-1)
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
#:use-module (srfi srfi-26)
guix-download: Use code from (guix build download). * guix-download.in (http-fetch, ftp-fetch): Remove. (fetch-and-store): Replace `uri' parameter with `name', for the output file name. Redirect the output of `fetch' to the error port. (guix-download): Call `url-fetch' for all URI schemes except `file'. Handle PATH equal to #f. * guix/download.scm: Export `%mirrors'. * tests/guix-download.sh: Change erroneous URL, because URLs at example.com are all valid redirections.
2012-11-13 16:57:36 -05:00
#:export (%mirrors
lint: archival: Lookup content in Disarchive database. * guix/lint.scm (lookup-disarchive-spec): New procedure. (check-archival): When 'lookup-content' returns #f, call 'lookup-disarchive-spec'. Call 'lookup-directory' on the result of 'lookup-directory'. * guix/download.scm (%disarchive-mirrors): Make public. * tests/lint.scm ("archival: missing content"): Set '%disarchive-mirrors'. ("archival: content unavailable but disarchive available"): New test.
2021-05-15 06:19:03 -04:00
%disarchive-mirrors
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
%download-fallback-test
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
(url-fetch* . url-fetch)
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
url-fetch/executable
download: Add 'url-fetch/tarbomb'. Suggested by Federico Beffa. Fixes <http://bugs.gnu.org/22676>. Reported by Danny Milosavljevic <dannym@scratchpost.org>. * gnu/packages/engineering.scm (broken-tarball-fetch): Remove. (fastcap)[source](method): Use URL-FETCH/TARBOMB instead. * gnu/packages/scheme.scm (broken-tarball-fetch): Remove. (scmutils)[source](method): Use URL-FETCH/TARBOMB instead. * guix/download.scm (url-fetch/tarbomb): New procedure, renamed from 'broken-tarball-fetch'.
2016-02-21 18:29:54 -05:00
url-fetch/tarbomb
download: Add ‘url-fetch/zipbomb’. From this suggestion by Ludovic Courtès: <http://lists.gnu.org/archive/html/guix-devel/2016-09/msg01983.html> * guix/download.scm (url-fetch/zipbomb): New procedure.
2017-01-25 07:16:00 -05:00
url-fetch/zipbomb
Factorize `download-and-store'. * guix/download.scm (download-to-store): New procedure. * guix/scripts/download.scm (fetch-and-store): Remove. (guix-download): Use `download-to-store' instead. * guix/ui.scm (call-with-temporary-output-file): Move to... * guix/utils.scm (call-with-temporary-output-file): ... here.
2013-04-21 16:40:23 -04:00
download-to-store))
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
;;; Commentary:
;;;
;;; Produce fixed-output derivations with data fetched over HTTP or FTP.
;;;
;;; Code:
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
(define %mirrors
gnu-maintenance: Allow mirror URLs to fallback to the generic HTML updater. * guix/gnu-maintenance.scm (http-url?): Extract from html-updatable-package?, modify to return the HTTP URL, and support the mirror:// scheme. (%disallowed-hosting-sites): New variable, extracted from html-updatable-package. (html-updatable-package?): Rewrite a mirror:// URL to an HTTP or HTTPS one. * guix/download.scm (%mirrors): Update comment.
2023-08-11 11:21:42 -04:00
;; Mirror lists used when `mirror://' URLs are passed. The first mirror
;; entry of each set should ideally be the most authoritative one, as that's
;; what the generic HTML updater will pick to look for updates, with
;; possible exceptions when the authoritative mirror is too slow.
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
(let* ((gnu-mirrors
'(;; This one redirects to a (supposedly) nearby and (supposedly)
;; up-to-date mirror.
download: Adjust main ftp.gnu.org mirror. * guix/download.scm (%mirrors): Add missing "/gnu" in first mirror, although that mirror would work even without it. Use https instead of http.
2017-09-11 05:51:50 -04:00
"https://ftpmirror.gnu.org/gnu/"
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
"ftp://ftp.cs.tu-berlin.de/pub/gnu/"
"ftp://ftp.funet.fi/pub/mirrors/ftp.gnu.org/gnu/"
;; This one is the master repository, and thus it's always
;; up-to-date.
"http://ftp.gnu.org/pub/gnu/")))
`((gnu ,@gnu-mirrors)
(gcc
"ftp://ftp.nluug.nl/mirror/languages/gcc/"
"ftp://ftp.fu-berlin.de/unix/languages/gcc/"
"ftp://ftp.irisa.fr/pub/mirrors/gcc.gnu.org/gcc/"
"ftp://gcc.gnu.org/pub/gcc/"
,@(map (cut string-append <> "/gcc") gnu-mirrors))
(gnupg
download: Add the canonical GnuPG download site. * guix/download.scm (%mirrors)<gnupg>: Add https://gnupg.org.
2017-08-09 15:53:24 -04:00
"http://artfiles.org/gnupg.org"
"http://www.crysys.hu/"
"https://gnupg.org/ftp/gcrypt/"
Update gnupg mirrors. * guix/download.scm (%mirrors): Update mirror list for gnupg.
2014-11-26 13:52:11 -05:00
"ftp://mirrors.dotsrc.org/gcrypt/"
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
"ftp://mirror.cict.fr/gnupg/"
Update gnupg mirrors. * guix/download.scm (%mirrors): Update mirror list for gnupg.
2014-11-26 13:52:11 -05:00
"ftp://ftp.franken.de/pub/crypt/mirror/ftp.gnupg.org/gcrypt/"
"ftp://ftp.freenet.de/pub/ftp.gnupg.org/gcrypt/"
"ftp://ftp.hi.is/pub/mirrors/gnupg/"
"ftp://ftp.heanet.ie/mirrors/ftp.gnupg.org/gcrypt/"
"ftp://ftp.bit.nl/mirror/gnupg/"
"ftp://ftp.surfnet.nl/pub/security/gnupg/"
"ftp://ftp.iasi.roedu.net/pub/mirrors/ftp.gnupg.org/"
"ftp://ftp.sunet.se/pub/security/gnupg/"
"ftp://mirror.switch.ch/mirror/gnupg/"
"ftp://mirror.tje.me.uk/pub/mirrors/ftp.gnupg.org/"
"ftp://ftp.mirrorservice.org/sites/ftp.gnupg.org/gcrypt/"
"ftp://ftp.ring.gr.jp/pub/net/gnupg/"
"ftp://ftp.gnupg.org/gcrypt/")
gnu: Add intltool. * guix/download.scm (%mirrors): Add `gnome' mirrors. * gnu/packages/glib.scm (intltool): New variable.
2013-03-05 04:16:17 -05:00
(gnome
download: Add GNOME mirror. * guix/download.scm (%mirrors): Add "https://download.gnome.org".
2017-02-01 17:41:12 -05:00
"https://download.gnome.org/"
download: Remove stale Yandex GNOME mirror. * guix/download.scm (%mirrors): Remove mirror.yandex.ru from gnome.
2023-07-08 20:00:03 -04:00
"http://ftp.gnome.org/pub/GNOME/")
download: Add Hackage mirrors. * guix/download.scm [%mirrors]: Add Hackage mirrors.
2016-10-29 12:30:58 -04:00
(hackage
guix: Update hackage mirror. * guix/download.scm (%mirrors)[hackage]: Don't use https.
2016-11-01 04:28:24 -04:00
"http://hackage.haskell.org/")
download: Add Savannah mirror. * guix/download.scm (%mirrors): Add nongnu.freemirror.org.
2020-07-20 14:38:51 -04:00
(savannah ; http://download0.savannah.gnu.org/mirmon/savannah/
download: Switch savannah mirrors to HTTPS URLs. The URI scheme used for nongnu.freemirror.org needs to be consistent between (guix download) and (guix gnu-maintenance) to make the simplified savannah-updater (of a later commit) work. While we're at it, switch the other mirrors to https as well. http://download.savannah.gnu.org/releases-noredirect/ is left unmodified because it 404s * download.scm (%mirrors)[savannah]: Switch from http to https where possible. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2022-09-01 05:01:51 -04:00
"https://download.savannah.gnu.org/releases/"
guix: Replace defective freemirror.org. This ‘mirror’ is particularly problematic because it's the only one checked by ‘guix refresh’. * guix/gnu-maintenance.scm (%savannah-base): Substitute freedif.org. * guix/download.scm (%mirrors): Likewise. Reported by sash-kan on #guix.
2022-11-12 19:00:04 -05:00
"https://de.freedif.org/savannah/"
download: Switch savannah mirrors to HTTPS URLs. The URI scheme used for nongnu.freemirror.org needs to be consistent between (guix download) and (guix gnu-maintenance) to make the simplified savannah-updater (of a later commit) work. While we're at it, switch the other mirrors to https as well. http://download.savannah.gnu.org/releases-noredirect/ is left unmodified because it 404s * download.scm (%mirrors)[savannah]: Switch from http to https where possible. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2022-09-01 05:01:51 -04:00
"https://ftp.cc.uoc.gr/mirrors/nongnu.org/"
"http://ftp.twaren.net/Unix/NonGNU/" ; https appears unsupported
"https://mirror.csclub.uwaterloo.ca/nongnu/"
"https://nongnu.askapache.com/"
"https://savannah.c3sl.ufpr.br/"
"https://download-mirror.savannah.gnu.org/releases/"
download: Try FTP servers last. * guix/download.scm (%mirrors)[savannah, kernel.org, apache, xorg, imagemagick]: Re-arrange so that FTP is last.
2017-11-12 17:40:52 -05:00
"ftp://ftp.twaren.net/Unix/NonGNU/"
"ftp://mirror.csclub.uwaterloo.ca/nongnu/"
"ftp://mirror.publicns.net/pub/nongnu/"
"ftp://savannah.c3sl.ufpr.br/")
download: Update Sourceforge mirrors. * guix/download.scm (mirrors)[sourceforge]: Update mirror list.
2016-05-30 04:37:03 -04:00
(sourceforge ; https://sourceforge.net/p/forge/documentation/Mirrors/
download: Add SourceForge load balancer. * guix/download.scm (%mirrors)[sourceforge]: Add canonical load balancer for sourceforge.net. Signed-off-by: Leo Famulari <leo@famulari.name>
2016-07-22 13:55:47 -04:00
"http://downloads.sourceforge.net/project/"
download: Attempt to update SourceForge mirror URLs. * guix/download.scm (%mirrors)[sourceforge]: End in "/project" instead of "/sourceforge". Remove a couple of dangling URLs.
2016-07-12 18:32:36 -04:00
"http://ufpr.dl.sourceforge.net/project/"
"http://freefr.dl.sourceforge.net/project/"
"http://internode.dl.sourceforge.net/project/"
"http://jaist.dl.sourceforge.net/project/"
"http://liquidtelecom.dl.sourceforge.net/project/"
"http://nchc.dl.sourceforge.net/project/"
"http://netcologne.dl.sourceforge.net/project/"
"http://netix.dl.sourceforge.net/project/"
download: Remove dead SourceForge mirrors. * guix/download.scm (%mirrors): Remove dl.sourceforge.net subdomains that no longer resolve.
2023-01-21 19:00:00 -05:00
"http://tenet.dl.sourceforge.net/project/")
download: Add netfilter mirror. * guix/download.scm (%mirrors): Add mirrors for www.netfilter.org.
2017-02-26 19:32:22 -05:00
(netfilter.org ; https://www.netfilter.org/mirrors.html
"http://ftp.netfilter.org/pub/"
"ftp://ftp.es.netfilter.org/mirrors/netfilter/"
"ftp://ftp.hu.netfilter.org/"
"ftp://www.lt.netfilter.org/pub/")
download: Add kernel.org mirrors. * guix/download.scm (%mirrors): Add `kernel.org' mirrors.
2012-11-27 15:55:53 -05:00
(kernel.org
download: Replace faulty kernel mirror URL with canonical upstream. This mirror was providing truncated files. See patch ticket #66923 for more information about this change: <https://issues.guix.gnu.org/issue/66923> * guix/download.scm (%mirrors): Replace kernel mirror <uio.no> with <kernel.org>. Change-Id: I189fc4eaa2bb3fa8b6db028aa837f0d59a460327
2023-11-05 10:27:11 -05:00
"https://cdn.kernel.org/pub/"
download: Add kernel.org mirrors. Fixes <http://bugs.gnu.org/15182>. Reported by Mark H Weaver <mhw@netris.org>. * guix/download.scm (%mirrors)[kernel.org]: Add ftp.be.debian.org and mirror.linux.org.au.
2013-08-25 14:49:03 -04:00
"http://ftp.be.debian.org/pub/"
download: Add a kernel.org mirror. Add the mirror from (guix gnu-maintenance) to make the simplified linux.org updater (of a later commit) work. * download.scm (%mirrors)[kernel.org]: Add mirrors.edge.kernel.org mirror. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2022-09-01 05:01:53 -04:00
"https://mirrors.edge.kernel.org/pub/"
download: Try FTP servers last. * guix/download.scm (%mirrors)[savannah, kernel.org, apache, xorg, imagemagick]: Re-arrange so that FTP is last.
2017-11-12 17:40:52 -05:00
"ftp://ftp.funet.fi/pub/mirrors/ftp.kernel.org/pub/")
download: Update Apache mirror list. * guix/download.scm (%mirrors): Remove several vanished hosts and all FTP URLs. Use HTTPS where supported. Add some new HTTPS mirrors. Change-Id: Ie707e92ae65b8a3287d941e3e6ffb84592417b95
2023-12-16 19:00:00 -05:00
(apache
"https://dlcdn.apache.org/"
"https://downloads.apache.org/"
"https://mirrors.sonic.net/apache/"
"https://apache.osuosl.org/"
"https://mirrors.ircam.fr/pub/apache/"
"https://apache-mirror.rbc.ru/pub/apache/"
"https://mirrors.ibiblio.org/apache/"
;; No HTTPS.
download: Add more apache mirrors. * guix/download.scm (%mirrors): Add more apache mirrors.
2020-06-12 11:28:36 -04:00
"http://apache.mirror.iweb.ca/"
"http://apache.mirrors.ovh.net/ftp.apache.org/dist/"
download: Add archive.apache.org to the Apache mirrors. * guix/download.scm (%mirrors)[apache]: Add archive.apache.org as a last resort.
2014-01-27 17:31:28 -05:00
;; As a last resort, try the archive.
download: Update Apache mirror list. * guix/download.scm (%mirrors): Remove several vanished hosts and all FTP URLs. Use HTTPS where supported. Add some new HTTPS mirrors. Change-Id: Ie707e92ae65b8a3287d941e3e6ffb84592417b95
2023-12-16 19:00:00 -05:00
"https://archive.apache.org/dist/")
download: Add X.org mirrors. * guix/download.scm (%mirrors): Add `xorg'.
2013-02-23 12:59:43 -05:00
(xorg ; from http://www.x.org/wiki/Releases/Download
gnu: xorg: Fix http mirror and uncomment xcb packages. * guix/download.scm (%mirrors): Fix main http mirror address. * gnu/packages/xorg.scm (libpthread-stubs, libxcb, xcb-proto): Uncomment and add licenses.
2013-03-03 13:50:26 -05:00
"http://www.x.org/releases/" ; main mirrors
download: Try FTP servers last. * guix/download.scm (%mirrors)[savannah, kernel.org, apache, xorg, imagemagick]: Re-arrange so that FTP is last.
2017-11-12 17:40:52 -05:00
"http://mirror.csclub.uwaterloo.ca/x.org/" ; North America
download: Add X.org mirrors. * guix/download.scm (%mirrors): Add `xorg'.
2013-02-23 12:59:43 -05:00
"http://xorg.mirrors.pair.com/"
download: Try FTP servers last. * guix/download.scm (%mirrors)[savannah, kernel.org, apache, xorg, imagemagick]: Re-arrange so that FTP is last.
2017-11-12 17:40:52 -05:00
"ftp://mirror.csclub.uwaterloo.ca/x.org/"
"ftp://xorg.mirrors.pair.com/"
download: Add X.org mirrors. * guix/download.scm (%mirrors): Add `xorg'.
2013-02-23 12:59:43 -05:00
"ftp://artfiles.org/x.org/" ; Europe
"ftp://ftp.chg.ru/pub/X11/x.org/"
"ftp://ftp.fu-berlin.de/unix/X11/FTP.X.ORG/"
"ftp://ftp.gwdg.de/pub/x11/x.org/"
"ftp://ftp.mirrorservice.org/sites/ftp.x.org/"
"ftp://ftp.ntua.gr/pub/X11/"
"ftp://ftp.piotrkosoft.net/pub/mirrors/ftp.x.org/"
"ftp://ftp.portal-to-web.de/pub/mirrors/x.org/"
"ftp://ftp.solnet.ch/mirror/x.org/"
"ftp://mi.mirror.garr.it/mirrors/x.org/"
"ftp://mirror.cict.fr/x.org/"
"ftp://mirror.switch.ch/mirror/X11/"
"ftp://mirrors.ircam.fr/pub/x.org/"
"ftp://x.mirrors.skynet.be/pub/ftp.x.org/"
download: Remove broken X.org mirrors. These are still at <https://www.x.org/wiki/Releases/Download>, but then that page hasn't been updated since 2018. * guix/download.scm (%mirrors): Remove mirror.us.leaseweb.net and x.cs.pu.edu.tw.
2023-07-08 20:00:02 -04:00
"ftp://ftp.cs.cuhk.edu.hk/pub/X11" ; East Asia
download: Add X.org mirrors. * guix/download.scm (%mirrors): Add `xorg'.
2013-02-23 12:59:43 -05:00
"ftp://ftp.u-aizu.ac.jp/pub/x11/x.org/"
"ftp://ftp.yz.yamagata-u.ac.jp/pub/X11/x.org/"
"ftp://ftp.kaist.ac.kr/x.org/"
"ftp://mirrors.go-part.com/xorg/"
download: Add CPAN mirrors. * guix/download.scm (%mirrors)[cpan]: New URLs.
2013-03-03 18:46:27 -05:00
"ftp://ftp.is.co.za/pub/x.org") ; South Africa
download: Refresh the cpan.org mirror list. * guix/download.scm (%mirrors)[cpan]: Update the list of CPAN mirrors (of which several are dead) with a more-or-less geographically diverse selection.
2017-10-30 19:49:32 -04:00
(cpan
download: Add CPAN mirrors. * guix/download.scm (%mirrors)[cpan]: New URLs.
2013-03-03 18:46:27 -05:00
"http://www.cpan.org/"
download: Refresh the cpan.org mirror list. * guix/download.scm (%mirrors)[cpan]: Update the list of CPAN mirrors (of which several are dead) with a more-or-less geographically diverse selection.
2017-10-30 19:49:32 -04:00
"http://cpan.metacpan.org/"
;; A selection of HTTP mirrors from http://www.cpan.org/SITES.html.
;; Europe.
"http://ftp.belnet.be/mirror/ftp.cpan.org/"
"http://mirrors.nic.cz/CPAN/"
"http://mirror.ibcp.fr/pub/CPAN/"
"http://ftp.ntua.gr/pub/lang/perl/"
"http://mirror.as43289.net/pub/CPAN/"
"http://cpan.cs.uu.nl/"
"http://cpan.uib.no/"
"http://cpan-mirror.rbc.ru/pub/CPAN/"
"http://mirror.sbb.rs/CPAN/"
"http://cpan.lnx.sk/"
"http://ftp.rediris.es/mirror/CPAN/"
"http://mirror.ox.ac.uk/sites/www.cpan.org/"
;; Africa.
"http://mirror.liquidtelecom.com/CPAN/"
"http://cpan.mirror.ac.za/"
"http://mirror.is.co.za/pub/cpan/"
"http://cpan.saix.net/"
"http://mirror.ucu.ac.ug/cpan/"
;; North America.
"http://mirrors.gossamer-threads.com/CPAN/"
"http://mirror.csclub.uwaterloo.ca/CPAN/"
"http://mirrors.ucr.ac.cr/CPAN/"
"http://www.msg.com.mx/CPAN/"
"http://mirrors.namecheap.com/CPAN/"
"http://mirror.uic.edu/CPAN/"
"http://mirror.datapipe.net/CPAN/"
"http://mirror.cc.columbia.edu/pub/software/cpan/"
"http://mirror.uta.edu/CPAN/"
;; South America.
"http://cpan.mmgdesigns.com.ar/"
"http://mirror.nbtelecom.com.br/CPAN/"
"http://linorg.usp.br/CPAN/"
"http://cpan.dcc.uchile.cl/"
"http://mirror.cedia.org.ec/CPAN/"
;; Oceania.
"http://cpan.mirror.serversaustralia.com.au/"
"http://mirror.waia.asn.au/pub/cpan/"
"http://mirror.as24220.net/pub/cpan/"
"http://cpan.lagoon.nc/pub/CPAN/"
"http://cpan.inspire.net.nz/"
;; Asia.
"http://mirror.dhakacom.com/CPAN/"
"http://mirrors.ustc.edu.cn/CPAN/"
"http://ftp.cuhk.edu.hk/pub/packages/perl/CPAN/"
"http://kambing.ui.ac.id/cpan/"
"http://cpan.hostiran.ir/"
"http://ftp.nara.wide.ad.jp/pub/CPAN/"
"http://mirror.neolabs.kz/CPAN/"
"http://cpan.nctu.edu.tw/"
"http://cpan.ulak.net.tr/"
"http://mirrors.vinahost.vn/CPAN/")
gnu: Add R. * gnu/packages/statistics.scm: New file. * gnu-system.am (GNU_SYSTEM_MODULES): Add it * guix/download.scm (%mirrors): Add CRAN mirrors.
2015-02-12 06:58:11 -05:00
(cran
;; Arbitrary mirrors from http://cran.r-project.org/mirrors.html
;; This one automatically redirects to servers worldwide
Update CRAN mirrors. * guix/download.scm (%mirrors): Update mirror list for CRAN.
2015-09-21 04:34:52 -04:00
"http://cran.r-project.org/"
gnu: Add R. * gnu/packages/statistics.scm: New file. * gnu-system.am (GNU_SYSTEM_MODULES): Add it * guix/download.scm (%mirrors): Add CRAN mirrors.
2015-02-12 06:58:11 -05:00
"http://cran.rstudio.com/"
"http://cran.univ-lyon1.fr/"
"http://cran.ism.ac.jp/"
"http://cran.stat.auckland.ac.nz/"
"http://cran.mirror.ac.za/"
"http://cran.csie.ntu.edu.tw/")
download: Add a mirror for CTAN. * guix/download.scm (%mirrors)[ctan]: New entry.
2022-04-20 21:57:30 -04:00
(ctan
;; This is the CTAN mirror multiplexor service, which automatically
;; redirect to a mirror in or close to the country of the requester
;; (see: https://ctan.org/mirrors/).
"https://mirror.ctan.org/")
guix: download: Update imagemagick mirrors. * guix/download.scm (%mirrors)[imagemagick]: Update and add the legacy subdirectory of the main site as a last resort.
2014-05-22 15:58:08 -04:00
(imagemagick
;; from http://www.imagemagick.org/script/download.php
;; (without mirrors that are unavailable or not up to date)
download: Update ImageMagick mirror list. * guix/download.scm (%mirrors): Remove defunct ImageMagick mirrors, update URLs for directory structure changes (/releases instead of /legacy). Move official site last.
2020-12-12 10:36:26 -05:00
"https://sunsite.icm.edu.pl/packages/ImageMagick/releases"
"http://mirror.checkdomain.de/imagemagick/releases"
"ftp://ftp.u-aizu.ac.jp/pub/graphics/image/ImageMagick/imagemagick.org/releases"
guix: download: Update imagemagick mirrors. * guix/download.scm (%mirrors)[imagemagick]: Update and add the legacy subdirectory of the main site as a last resort.
2014-05-22 15:58:08 -04:00
"ftp://ftp.nluug.nl/pub/ImageMagick/"
download: Update ImageMagick mirror list. * guix/download.scm (%mirrors): Remove defunct ImageMagick mirrors, update URLs for directory structure changes (/releases instead of /legacy). Move official site last.
2020-12-12 10:36:26 -05:00
"http://www.imagemagick.org/download/releases/"
;; Try this if all else fails (normally contains just the latest version).
"http://www.imagemagick.org/download/")
download: Add Debian mirrors. * guix/download.scm (%mirrors)[debian]: New set of mirrors.
2013-10-05 10:45:39 -04:00
(debian
"http://ftp.de.debian.org/debian/"
"http://ftp.fr.debian.org/debian/"
download: Update debian mirrors. * guix/download.scm (mirrors)[debian]: Add Debian's archive to the Debian mirror list.
2016-05-16 05:10:49 -04:00
"http://ftp.debian.org/debian/"
download: Add KDE mirrors. * guix/download.scm (%mirrors)[kde]: Add kde mirrors.
2016-08-01 05:05:01 -04:00
"http://archive.debian.org/debian/")
(kde
download: Use https for main KDE source. * guix/download.scm (%mirrors)[kde]: Use https URIs for main KDE mirrors. * tests/lint.scm ("mirror-url: kde suggestion"): New test.
2022-03-28 17:03:03 -04:00
"https://download.kde.org/"
"https://download.kde.org/Attic/" ; for when it gets archived.
download: Refresh KDE mirror list. * guix/download.scm (%mirrors)[kde]: Update list, using HTTPS wherever possible.
2022-07-23 20:00:00 -04:00
;; I could not find the classic static mirror list anymore. Instead,
;; add ‘.mirrorlist’ to the end of a recent download.kde.org tarball URL.
download: Add KDE mirrors. * guix/download.scm (%mirrors)[kde]: Add kde mirrors.
2016-08-01 05:05:01 -04:00
;; Europe
download: Refresh KDE mirror list. * guix/download.scm (%mirrors)[kde]: Update list, using HTTPS wherever possible.
2022-07-23 20:00:00 -04:00
"https://mirrors.xtom.de/kde/"
"https://mirror.lyrahosting.com/pub/kde/"
"https://mirrors.xtom.nl/kde/"
"https://mirror.hs-esslingen.de/Mirrors/ftp.kde.org/pub/kde/"
"https://mirror.kumi.systems/kde/ftp/"
"https://mirrors.ircam.fr/pub/KDE/"
"https://ftp.gwdg.de/pub/linux/kde/"
"https://fr2.rpmfind.net/linux/KDE/"
"https://mirror.faigner.de/kde/ftp/"
"https://www.mirrorservice.org/sites/download.kde.org/"
"https://mirrors.ukfast.co.uk/sites/kde.org/ftp/"
"https://mirrors.dotsrc.org/kde/"
download: Add KDE mirrors. * guix/download.scm (%mirrors)[kde]: Add kde mirrors.
2016-08-01 05:05:01 -04:00
"http://kde.mirror.anlx.net/"
download: Refresh KDE mirror list. * guix/download.scm (%mirrors)[kde]: Update list, using HTTPS wherever possible.
2022-07-23 20:00:00 -04:00
"https://mirror.karneval.cz/pub/kde/"
"https://ftp.fi.muni.cz/pub/kde/"
"https://www-ftp.lip6.fr/pub/X11/kde/"
"https://ftp.icm.edu.pl/pub/unix/kde/"
"https://kde.mirror.garr.it/kde/ftp/"
"https://ftp.acc.umu.se/mirror/kde.org/ftp/"
"https://mirrors.up.pt/pub/kde/"
"https://mirrors.nav.ro/kde/"
"https://mirrors.xtom.ee/kde/"
"https://ftp.funet.fi/pub/mirrors/ftp.kde.org/pub/kde/"
"https://mirrors.netix.net/kde/"
"https://ftp.cc.uoc.gr/mirrors/kde/"
download: Add KDE mirrors. * guix/download.scm (%mirrors)[kde]: Add kde mirrors.
2016-08-01 05:05:01 -04:00
;; North America
download: Refresh KDE mirror list. * guix/download.scm (%mirrors)[kde]: Update list, using HTTPS wherever possible.
2022-07-23 20:00:00 -04:00
"https://mirror.its.dal.ca/kde/"
"https://nnenix.mm.fcix.net/kdeftp/"
"https://mirrors.mit.edu/kde/"
"https://mirror.csclub.uwaterloo.ca/kde/"
"https://mirror.fcix.net/kdeftp/"
"https://mirrors.ocf.berkeley.edu/kde/"
"https://mirrors.xtom.com/kde/"
;; South America
"https://kde.c3sl.ufpr.br/"
;; Asia
"https://mirrors.bfsu.edu.cn/kde/"
"https://ftp-srv2.kddi-research.jp/pub/X11/kde/"
"https://mirrors.xtom.jp/kde/"
"https://mirrors.xtom.hk/kde/"
;; Africa
download: Update KDE mirror list. * guix/download.scm (%mirrors): Update one mirror URL and remove 2 dead ones. Change-Id: Ibdc03f0b7df94b73bb5be0fda5a6244b017e747e
2023-12-09 19:00:00 -05:00
"https://mirror.dimensiondata.com/mirror/ftp.kde.org/"
download: Add KDE mirrors. * guix/download.scm (%mirrors)[kde]: Add kde mirrors.
2016-08-01 05:05:01 -04:00
;; Oceania
download: Refresh KDE mirror list. * guix/download.scm (%mirrors)[kde]: Update list, using HTTPS wherever possible.
2022-07-23 20:00:00 -04:00
"https://mirrors.xtom.au/kde/")
download: Add OpenBSD mirrors. * guix/download.scm (%mirrors) <openbsd>: Add HTTPS OpenBSD mirrors. * gnu/packages/ntp.scm (openntpd)[source]: Use them. * gnu/packages/ssh.scm (openssh)[source]: Likewise. * gnu/packages/tls.scm (libressl)[source]: Likewise.
2017-07-18 19:42:08 -04:00
(openbsd
"https://ftp.openbsd.org/pub/OpenBSD/"
;; Anycast CDN redirecting to your friendly local mirror.
"https://mirrors.evowise.com/pub/OpenBSD/"
;; Other HTTPS mirrors from https://www.openbsd.org/ftp.html
"https://mirror.aarnet.edu.au/pub/OpenBSD/"
"https://ftp2.eu.openbsd.org/pub/OpenBSD/"
"https://openbsd.c3sl.ufpr.br/pub/OpenBSD/"
"https://openbsd.ipacct.com/pub/OpenBSD/"
"https://ftp.OpenBSD.org/pub/OpenBSD/"
"https://openbsd.cs.toronto.edu/pub/OpenBSD/"
"https://openbsd.delfic.org/pub/OpenBSD/"
"https://openbsd.mirror.netelligent.ca/pub/OpenBSD/"
"https://mirrors.ucr.ac.cr/pub/OpenBSD/"
"https://mirrors.dotsrc.org/pub/OpenBSD/"
"https://mirror.one.com/pub/OpenBSD/"
"https://ftp.fr.openbsd.org/pub/OpenBSD/"
"https://ftp2.fr.openbsd.org/pub/OpenBSD/"
"https://mirrors.ircam.fr/pub/OpenBSD/"
"https://ftp.spline.de/pub/OpenBSD/"
"https://mirror.hs-esslingen.de/pub/OpenBSD/"
"https://ftp.halifax.rwth-aachen.de/openbsd/"
"https://ftp.hostserver.de/pub/OpenBSD/"
"https://ftp.fau.de/pub/OpenBSD/"
"https://ftp.cc.uoc.gr/pub/OpenBSD/"
"https://openbsd.hk/pub/OpenBSD/"
"https://ftp.heanet.ie/pub/OpenBSD/"
"https://openbsd.mirror.garr.it/pub/OpenBSD/"
"https://mirror.litnet.lt/pub/OpenBSD/"
"https://mirror.meerval.net/pub/OpenBSD/"
"https://ftp.nluug.nl/pub/OpenBSD/"
"https://ftp.bit.nl/pub/OpenBSD/"
"https://mirrors.dalenys.com/pub/OpenBSD/"
"https://ftp.icm.edu.pl/pub/OpenBSD/"
"https://ftp.rnl.tecnico.ulisboa.pt/pub/OpenBSD/"
"https://mirrors.pidginhost.com/pub/OpenBSD/"
"https://mirror.yandex.ru/pub/OpenBSD/"
"https://ftp.eu.openbsd.org/pub/OpenBSD/"
"https://ftp.yzu.edu.tw/pub/OpenBSD/"
"https://www.mirrorservice.org/pub/OpenBSD/"
"https://anorien.csc.warwick.ac.uk/pub/OpenBSD/"
"https://mirror.bytemark.co.uk/pub/OpenBSD/"
"https://mirrors.sonic.net/pub/OpenBSD/"
"https://ftp3.usa.openbsd.org/pub/OpenBSD/"
"https://mirrors.syringanetworks.net/pub/OpenBSD/"
"https://openbsd.mirror.constant.com/pub/OpenBSD/"
"https://ftp4.usa.openbsd.org/pub/OpenBSD/"
"https://ftp5.usa.openbsd.org/pub/OpenBSD/"
download: Add MATE mirrors. * guix/download.scm (%mirrors): Add mirrors for the MATE Desktop.
2019-03-15 13:02:51 -04:00
"https://mirror.esc7.net/pub/OpenBSD/")
(mate
"https://pub.mate-desktop.org/releases/"
download: Add mirrors for Qt. * guix/download.scm (%mirrors): Augment with qt mirrors. Series-changes: 2 - Move authoritative mirror last, as it's too slow.
2023-08-09 13:59:14 -04:00
"http://pub.mate-desktop.org/releases/")
(qt
"https://mirrors.ocf.berkeley.edu/qt/official_releases/"
"https://ftp.jaist.ac.jp/pub/qtproject/official_releases/"
"https://ftp.nluug.nl/languages/qt/official_releases/"
"https://mirrors.cloud.tencent.com/qt/official_releases/"
"https://mirrors.sjtug.sjtu.edu.cn/qt/official_releases/"
"https://qtproject.mirror.liquidtelecom.com/official_releases/"
"https://download.qt.io/official_releases/")))) ;slow
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
download: Keep a single copy of the mirror file. This saves ~10% on 'guix build inkscape -Sd'. * guix/download.scm (%mirror-file): New variable. (url-fetch): Remove #:mirrors parameter. Remove 'mirror-file'; refer to '%mirror-file' instead.
2015-08-29 17:47:53 -04:00
(define %mirror-file
;; Copy of the list of mirrors to a file. This allows us to keep a single
;; copy in the store, and computing it here avoids repeated calls to
;; 'object->string'.
(plain-file "mirrors" (object->string %mirrors)))
download: Support content-addressed mirrors. * guix/download.scm (%content-addressed-mirrors) (%content-addressed-mirror-file): New variables. * guix/download.scm (url-fetch)[builder]: Define 'value-from-environment. Pass #:hashes and #:content-addressed-mirrors to 'url-fetch'. Define "guix download hashes" environment variable. * guix/build/download.scm (url-fetch): Add #:content-addressed-mirrors and #:hashes. [content-addressed-urls]: New variable. Use it.
2016-05-14 11:37:47 -04:00
(define %content-addressed-mirrors
;; List of content-addressed mirrors. Each mirror is represented as a
download: Prepare to support the 'guix publish' /file URLs. * guix/download.scm (%content-addressed-mirrors): Add 'file' parameter to the lambda. * guix/build/download.scm (url-fetch)[content-addressed-uris]: Adjust accordingly.
2016-07-20 11:00:50 -04:00
;; procedure that takes a file name, an algorithm (symbol) and a hash
;; (bytevector), and returns a URL or #f.
download: Add Software Heritage as a content-addressed mirror. * guix/download.scm (%content-addressed-mirrors): Add Software Heritage.
2018-11-13 16:26:07 -05:00
'(begin
download: Remove obsolete workaround. * guix/download.scm (%content-addressed-mirrors): Use (guix base16) unconditionally.
2021-09-14 03:54:12 -04:00
(use-modules (guix base16) (guix base32))
download: Make (guix base16) a soft dependency. Fixes <https://bugs.gnu.org/33542>. Reported by Mark H Weaver <mhw@netris.org>. * guix/download.scm (%content-addressed-mirrors): Autoload (guix base16).
2018-11-28 16:17:39 -05:00
download: Add berlin.guixsd.org as a content-addressed mirror. * guix/download.scm (%content-addressed-mirrors)[guix-publish]: New procedure. Use it for "mirror.hydra.gnu.org" and add "berlin.guixsd.org" too.
2018-11-28 16:23:10 -05:00
(define (guix-publish host)
(lambda (file algo hash)
;; Files served by 'guix publish' are accessible under a single
;; hash algorithm.
(string-append "https://" host "/file/"
file "/" (symbol->string algo) "/"
(bytevector->nix-base32-string hash))))
download: Add bordeaux.guix.gnu.org as a content addressed mirror. bordeaux.guix.gnu.org now provides access to some files by hash. This is done through the nar-herder finding a nar produced by a fixed output derivation for the requested content, and then providing the content stored inside that nar. I've put this new entry at the start of the list, as I think it's more likely to have content than the others. Because bordeaux.guix.gnu.org stores nars indefinitely, my suspicion is that it's going to be able to fulfil more requests than ci.guix.gnu.org, which relies on the file requested being in the store (so the now frequent garbage collection is going to limit the files available). * guix/download.scm (%content-addressed-mirrors): Add bordeaux.guix.gnu.org. Signed-off-by: Christopher Baines <mail@cbaines.net>
2023-02-06 10:55:05 -05:00
(list (guix-publish
;; bordeaux.guix.gnu.org uses the nar-herder rather than guix
;; publish, but it supports the same style of requests
"bordeaux.guix.gnu.org")
(guix-publish "ci.guix.gnu.org")
download: Add Software Heritage as a content-addressed mirror. * guix/download.scm (%content-addressed-mirrors): Add Software Heritage.
2018-11-13 16:26:07 -05:00
(lambda (file algo hash)
;; 'tarballs.nixos.org' supports several algorithms.
download: Access content-addressed mirrors over HTTPS. Bug <http://bugs.gnu.org/22774> is no longer relevant now that we use "builtin:download" exclusively. * guix/download.scm (%content-addressed-mirrors): Use "https", not "http".
2018-11-13 16:27:58 -05:00
(string-append "https://tarballs.nixos.org/"
download: Add Software Heritage as a content-addressed mirror. * guix/download.scm (%content-addressed-mirrors): Add Software Heritage.
2018-11-13 16:26:07 -05:00
(symbol->string algo) "/"
(bytevector->nix-base32-string hash)))
(lambda (file algo hash)
;; Software Heritage usually archives VCS history rather than
;; tarballs, but tarballs are sometimes available (and can be
;; explicitly stored there.) For example, see
;; <https://archive.softwareheritage.org/api/1/content/sha256:92d0fa1c311cacefa89853bdb53c62f4110cdfda3820346b59cbd098f40f955e/>.
download: Access content-addressed mirrors over HTTPS. Bug <http://bugs.gnu.org/22774> is no longer relevant now that we use "builtin:download" exclusively. * guix/download.scm (%content-addressed-mirrors): Use "https", not "http".
2018-11-13 16:27:58 -05:00
(string-append "https://archive.softwareheritage.org/api/1/content/"
download: Add Software Heritage as a content-addressed mirror. * guix/download.scm (%content-addressed-mirrors): Add Software Heritage.
2018-11-13 16:26:07 -05:00
(symbol->string algo) ":"
(bytevector->base16-string hash) "/raw/")))))
download: Support content-addressed mirrors. * guix/download.scm (%content-addressed-mirrors) (%content-addressed-mirror-file): New variables. * guix/download.scm (url-fetch)[builder]: Define 'value-from-environment. Pass #:hashes and #:content-addressed-mirrors to 'url-fetch'. Define "guix download hashes" environment variable. * guix/build/download.scm (url-fetch): Add #:content-addressed-mirrors and #:hashes. [content-addressed-urls]: New variable. Use it.
2016-05-14 11:37:47 -04:00
(define %content-addressed-mirror-file
;; Content-addressed mirrors stored in a file.
(plain-file "content-addressed-mirrors"
(object->string %content-addressed-mirrors)))
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
(define %no-mirrors-file
;; File specifying an empty list of mirrors, for fallback tests.
(plain-file "no-content-addressed-mirrors" (object->string ''())))
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
(define %disarchive-mirrors
download: Disarchive mirrors can be URL-returning procedures. As discussed at <https://issues.guix.gnu.org/47336#16>. * guix/build/download.scm (url-fetch)[disarchive-uris]: Accept MIRROR as a procedure. * guix/download.scm (%disarchive-mirrors): Add comment. This change can only be made once a 'guix perform-download' that understands procedures is widely deployed.
2021-09-14 04:11:42 -04:00
;; TODO: Eventually turn into a procedure that takes a hash algorithm
;; (symbol) and hash (bytevector).
download: Add disarchive.guix.gnu.org. * guix/download.scm (%disarchive-mirrors): Add disarchive.guix.gnu.org.
2021-10-14 08:32:58 -04:00
'("https://disarchive.guix.gnu.org/"
"https://disarchive.ngyro.com/"))
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
(define %disarchive-mirror-file
(plain-file "disarchive-mirrors" (object->string %disarchive-mirrors)))
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
(define %no-disarchive-mirrors-file
;; File specifying an empty list of Disarchive mirrors, for fallback tests.
(plain-file "no-disarchive-mirrors" (object->string '())))
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
(define built-in-builders*
store: Memoize 'built-in-builders' call directly in <store-connection>. The caching strategy introduced in 40cc850aebb497faed0a11d867d8fcee729023df was ineffective since we regularly start from an empty object cache. For example, "guix build inkscape -n" would make 241 'built-in-builders' RPCs. * guix/store.scm (<store-connection>)[built-in-builders]: New field. (open-connection): Adjust '%make-store-connection' call accordingly. (port->connection): Likewise. (built-in-builders): Rename to... (%built-in-builders): ... this. (built-in-builders): New procedure. * guix/download.scm (built-in-builders*): Remove 'mcached' call.
2019-04-16 04:26:46 -04:00
(store-lift built-in-builders))
download: Add support for mirror:// URLs. * guix/download.scm (%mirrors): New variable. Mirror lists taken from Nixpkgs. (url-fetch): New `mirrors' keyword parameter. [builder]: Pass it. * guix/build/download.scm (url-fetch): New `mirrors' keyword parameter. [maybe-expand-mirrors]: New procedure. [uri]: Use it.
2012-11-12 17:20:06 -05:00
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
(define* (built-in-download file-name url
#:key system hash-algo hash
mirrors content-addressed-mirrors
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
disarchive-mirrors
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
executable?
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
(guile 'unused))
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
"Download FILE-NAME from URL using the built-in 'download' builder. When
EXECUTABLE? is true, make the downloaded file executable.
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
This is an \"out-of-band\" download in that the returned derivation does not
explicitly depend on Guile, GnuTLS, etc. Instead, the daemon performs the
download by itself using its own dependencies."
(mlet %store-monad ((mirrors (lower-object mirrors))
(content-addressed-mirrors
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
(lower-object content-addressed-mirrors))
(disarchive-mirrors (lower-object disarchive-mirrors)))
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
(raw-derivation file-name "builtin:download" '()
#:system system
#:hash-algo hash-algo
#:hash hash
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
#:recursive? executable?
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
#:sources (list mirrors
content-addressed-mirrors
disarchive-mirrors)
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
;; Honor the user's proxy and locale settings.
#:leaked-env-vars '("http_proxy" "https_proxy"
"LC_ALL" "LC_MESSAGES" "LANG"
"COLUMNS")
#:env-vars `(("url" . ,(object->string url))
("mirrors" . ,mirrors)
("content-addressed-mirrors"
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
. ,content-addressed-mirrors)
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
("disarchive-mirrors" . ,disarchive-mirrors)
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
,@(if executable?
'(("executable" . "1"))
'()))
download: Do not offload 'builtin:download' derivations. * guix/download.scm (built-in-download): Pass #:local-build? #t.
2016-11-18 04:48:31 -05:00
;; Do not offload this derivation because we cannot be
;; sure that the remote daemon supports the 'download'
;; built-in. We may remove this limitation when support
;; for that built-in is widespread.
#:local-build? #t)))
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
(define %download-fallback-test
;; Define whether to test one of the download fallback mechanism. Possible
;; values are:
;;
;; - #f, to use the normal download methods, not trying to exercise the
;; fallback mechanism;
;;
download: "GUIX_DOWNLOAD_FALLBACK_TEST=none" disables fallback mechanisms. * guix/download.scm (url-fetch*): Handle (%download-fallback-test) set to 'none.
2021-10-15 16:21:02 -04:00
;; - 'none, to disable all the fallback mechanisms;
;;
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
;; - 'content-addressed-mirrors, to purposefully attempt to download from
;; a content-addressed mirror;
;;
;; - 'disarchive-mirrors, to download from Disarchive + Software Heritage.
;;
;; This is meant to be used for testing purposes.
(make-parameter (and=> (getenv "GUIX_DOWNLOAD_FALLBACK_TEST")
string->symbol)))
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
(define* (url-fetch* url hash-algo hash
#:optional name
#:key (system (%current-system))
(guile (default-guile))
executable?)
download: Update docstring. * guix/download.scm (url-fetch): Update docstring to match what's in the manual.
2020-10-20 03:32:05 -04:00
"Return a fixed-output derivation that fetches data from URL (a string, or a
list of strings denoting alternate URLs), which is expected to have hash HASH
of type HASH-ALGO (a symbol). By default, the file name is the base name of
URL; optionally, NAME can specify a different file name. When EXECUTABLE? is
true, make the downloaded file executable.
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
When one of the URL starts with mirror://, then its host part is
interpreted as the name of a mirror scheme, taken from %MIRROR-FILE.
download: Update docstring. * guix/download.scm (url-fetch): Update docstring to match what's in the manual.
2020-10-20 03:32:05 -04:00
Alternatively, when URL starts with file://, return the corresponding file
name in the store."
download: Use the built-in 'download' builder when available. Fixes <http://bugs.gnu.org/22774>. Reported by Christopher W Carpenter. * guix/download.scm (built-in-builders*, raw-derivation) (built-in-download): New procedures. (in-band-download): New procedure, with code formerly in 'url-fetch'. (url-fetch): Call 'built-in-builders*' and dispatch between 'built-in-download' and 'in-band-download'.
2016-11-16 11:44:50 -05:00
(define file-name
(match url
((head _ ...)
(basename head))
(_
(basename url))))
download: Allow raw file names or file:// URLs. * guix/download.scm (url-fetch): When URL is a string, if it's not a URI or if it's a URI with 'file' or #f scheme, use 'add-to-store'. * tests/builders.scm ("url-fetch, file", "url-fetch, file URI"): New tests.
2014-10-03 05:02:11 -04:00
(let ((uri (and (string? url) (string->uri url))))
(if (or (and (string? url) (not uri))
(and uri (memq (uri-scheme uri) '(#f file))))
packages: Convert source derivations to monadic style. * guix/packages.scm (origin->derivation): Take body from 'package-source-derivation', and change it to monadic style. Expect METHOD to a monadic procedure. (package-source-derivation): Define in terms of 'origin->derivation'. * guix/download.scm (url-fetch): Remove 'store' argument. Remove 'guile-for-build' variable. Turn into a monadic procedure. * guix/git-download.scm (git-fetch): Likewise. * guix/svn-download.scm (svn-fetch): Likewise. * tests/builders.scm (url-fetch*): New procedure. Change tests to call 'url-fetch*' instead of 'url-fetch'. * tests/packages.scm ("package-source-derivation, snippet"): Remove 'store' parameter of 'fetch' and change it to use 'interned-file' instead of 'add-to-store'. * gnu/packages/bootstrap.scm (bootstrap-origin)[boot]: Remove 'store' parameter.
2015-01-14 08:42:10 -05:00
(interned-file (if uri (uri-path uri) url)
(or name file-name))
download: Assume the "download" built-in builder is available. This is a followup to 05ceb8dcaf480a47cddf94ac979070b76df6556c. * guix/download.scm (in-band-download): Remove. (url-fetch): Call 'error' when BUILTINS lacks "download"; remove call to 'in-band-download'.
2017-07-27 09:09:26 -04:00
(mlet %store-monad ((builtins (built-in-builders*)))
;; The "download" built-in builder was added in guix-daemon in
;; Nov. 2016 and made it in the 0.12.0 release of Dec. 2016. We now
;; require it.
(unless (member "download" builtins)
(error "'guix-daemon' is too old, please upgrade" builtins))
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
(built-in-download (or name file-name)
download: "GUIX_DOWNLOAD_FALLBACK_TEST=none" disables fallback mechanisms. * guix/download.scm (url-fetch*): Handle (%download-fallback-test) set to 'none.
2021-10-15 16:21:02 -04:00
(match (%download-fallback-test)
((or #f 'none) url)
(_ "https://example.org/does-not-exist"))
download: Assume the "download" built-in builder is available. This is a followup to 05ceb8dcaf480a47cddf94ac979070b76df6556c. * guix/download.scm (in-band-download): Remove. (url-fetch): Call 'error' when BUILTINS lacks "download"; remove call to 'in-band-download'.
2017-07-27 09:09:26 -04:00
#:guile guile
#:system system
#:hash-algo hash-algo
#:hash hash
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
#:executable? executable?
download: Assume the "download" built-in builder is available. This is a followup to 05ceb8dcaf480a47cddf94ac979070b76df6556c. * guix/download.scm (in-band-download): Remove. (url-fetch): Call 'error' when BUILTINS lacks "download"; remove call to 'in-band-download'.
2017-07-27 09:09:26 -04:00
#:mirrors %mirror-file
#:content-addressed-mirrors
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
(match (%download-fallback-test)
((or #f 'content-addressed-mirrors)
%content-addressed-mirror-file)
(_ %no-mirrors-file))
download: Use Disarchive as a last resort. This is a fixed version of 66b14dccdd0d83c875ce3a8d50ceab8b6f0a3ce2, which was reverted in e74250c3c535b75dd2225a26df51febb7ed94654. * guix/download.scm (%disarchive-mirrors): New variable. (%disarchive-mirror-file): New variable. (built-in-download): Add 'disarchive-mirrors' keyword argument and pass its value along to the 'builtin:download' derivation. (url-fetch): Pass '%disarchive-mirror-file' to 'built-in-download'. * guix/scripts/perform-download.scm (perform-download): Read Disarchive mirrors from the environment and pass them to 'url-fetch'. * guix/build/download.scm (disarchive-fetch/any): New procedure. (url-fetch): Add 'disarchive-mirrors' keyword argument, use it to make a list of URIs, and use the new procedure to fetch the file if all other methods fail. * build-aux/build-self.scm (build-program)[select?]: Exclude '(guix build download)'. * guix/self.scm (compiled-guix)[*core-modules*]: Add 'guile-json' to the list of extensions.
2021-03-19 23:03:25 -04:00
#:disarchive-mirrors
download: Add parameter to test download fallback mechanisms. This allows you to run, say: GUIX_DOWNLOAD_FALLBACK_TEST=disarchive-mirrors guix build -S r-ebimage --check or: GUIX_DOWNLOAD_FALLBACK_TEST=content-addressed-mirrors ./pre-inst-env guix build -S r-ebimage --check to check whether these fallback mechanisms work as expected. * guix/download.scm (%no-mirrors-file, %no-disarchive-mirrors-file) (%download-fallback-test): New variables. (url-fetch*): Honor (%download-fallback-test).
2021-10-14 09:41:43 -04:00
(match (%download-fallback-test)
((or #f 'disarchive-mirrors)
%disarchive-mirror-file)
(_ %no-disarchive-mirrors-file)))))))
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
(define* (url-fetch/executable url hash-algo hash
#:optional name
#:key (system (%current-system))
(guile (default-guile)))
"Like 'url-fetch', but make the downloaded file executable."
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
(url-fetch* url hash-algo hash name
#:system system
#:guile guile
#:executable? #t))
download: Add 'url-fetch/executable'. * guix/download.scm (built-in-download): Add #:executable? parameter. Pass #:recursive? to 'raw-derivation' and add "executable" to the #:env-vars alist when EXECUTABLE? is true. (url-fetch): Add #:executable? and pass it to 'built-in-download'. (url-fetch/executable): New procedure.
2019-06-14 09:04:09 -04:00
download: Add 'url-fetch/tarbomb'. Suggested by Federico Beffa. Fixes <http://bugs.gnu.org/22676>. Reported by Danny Milosavljevic <dannym@scratchpost.org>. * gnu/packages/engineering.scm (broken-tarball-fetch): Remove. (fastcap)[source](method): Use URL-FETCH/TARBOMB instead. * gnu/packages/scheme.scm (broken-tarball-fetch): Remove. (scmutils)[source](method): Use URL-FETCH/TARBOMB instead. * guix/download.scm (url-fetch/tarbomb): New procedure, renamed from 'broken-tarball-fetch'.
2016-02-21 18:29:54 -05:00
(define* (url-fetch/tarbomb url hash-algo hash
#:optional name
#:key (system (%current-system))
(guile (default-guile)))
"Similar to 'url-fetch' but unpack the file from URL in a directory of its
own. This helper makes it easier to deal with \"tar bombs\"."
download: url-fetch/tarball: Make ‘name’ truly optional. * guix/download.scm (url-fetch/tarbomb): Fall back to ‘file-name’ if ‘name’ is #f, like the regular ‘url-fetch’ does. * gnu/packages/bioinformatics.scm (muscle)[source]: Remove ‘file-name’. * gnu/packages/engineering.scm (fastcap)[source]: Likewise. * gnu/packages/scheme.scm (scmutils)[source]: Likewise.
2017-01-27 14:48:37 -05:00
(define file-name
(match url
((head _ ...)
(basename head))
(_
(basename url))))
download: Add 'url-fetch/tarbomb'. Suggested by Federico Beffa. Fixes <http://bugs.gnu.org/22676>. Reported by Danny Milosavljevic <dannym@scratchpost.org>. * gnu/packages/engineering.scm (broken-tarball-fetch): Remove. (fastcap)[source](method): Use URL-FETCH/TARBOMB instead. * gnu/packages/scheme.scm (broken-tarball-fetch): Remove. (scmutils)[source](method): Use URL-FETCH/TARBOMB instead. * guix/download.scm (url-fetch/tarbomb): New procedure, renamed from 'broken-tarball-fetch'.
2016-02-21 18:29:54 -05:00
(define gzip
(module-ref (resolve-interface '(gnu packages compression)) 'gzip))
(define tar
(module-ref (resolve-interface '(gnu packages base)) 'tar))
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
(mlet %store-monad ((drv (url-fetch* url hash-algo hash
(string-append "tarbomb-"
(or name file-name))
#:system system
#:guile guile))
download: Use correct system and guile in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/40115>. Previously the result of `guix build -s $system $package' would depend on the system Guix was built for if $package or one of its dependencies used 'url-fetch/tarbomb' or 'url-fetch/zipbomb' as the origin method of its source (e.g. `guix build -s i686-linux ffmpeg' on i686-linux would build a different derivation than on x86_64-linux). This patch fixes this by explicitly passing the correct system and guile to 'gexp->derivation'. * guix/download.scm (url-fetch/tarbomb): Pass #:system system and #:guile-for-build guile to 'gexp->derivation', where guile is the derivation of guile for system. (url-fetch/zipbomb): Likewise. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2020-03-16 13:43:20 -04:00
(guile (package->derivation guile system)))
download: Add 'url-fetch/tarbomb'. Suggested by Federico Beffa. Fixes <http://bugs.gnu.org/22676>. Reported by Danny Milosavljevic <dannym@scratchpost.org>. * gnu/packages/engineering.scm (broken-tarball-fetch): Remove. (fastcap)[source](method): Use URL-FETCH/TARBOMB instead. * gnu/packages/scheme.scm (broken-tarball-fetch): Remove. (scmutils)[source](method): Use URL-FETCH/TARBOMB instead. * guix/download.scm (url-fetch/tarbomb): New procedure, renamed from 'broken-tarball-fetch'.
2016-02-21 18:29:54 -05:00
;; Take the tar bomb, and simply unpack it as a directory.
download: Use ungrafted tools in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/31085>. Reported by Diego Nicola Barbato <dnbarbato@posteo.de>. * guix/download.scm (url-fetch/tarbomb): Pass #:graft? #f to 'gexp->derivation'. (url-fetch/zipbomb): Likewise.
2018-04-23 08:33:11 -04:00
;; Use ungrafted tar/gzip so that the resulting tarball doesn't depend on
;; whether grafts are enabled.
download: url-fetch/tarball: Make ‘name’ truly optional. * guix/download.scm (url-fetch/tarbomb): Fall back to ‘file-name’ if ‘name’ is #f, like the regular ‘url-fetch’ does. * gnu/packages/bioinformatics.scm (muscle)[source]: Remove ‘file-name’. * gnu/packages/engineering.scm (fastcap)[source]: Likewise. * gnu/packages/scheme.scm (scmutils)[source]: Likewise.
2017-01-27 14:48:37 -05:00
(gexp->derivation (or name file-name)
download: Fix 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes a regression introduced in 20927c9331b493eaf94211ad9f8a5055e11b4588. Reported by Eric Bavier <ericbavier@centurylink.net>. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Within the gexp, import (guix build utils) for 'invoke'.
2018-04-17 01:43:22 -04:00
(with-imported-modules '((guix build utils))
#~(begin
(use-modules (guix build utils))
(mkdir #$output)
download: 'url-fetch/tarbomb' and 'url-fetch/zipbomb' refer to native tools. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Use 'ungexp-native' instead of 'ungexp' when referring to the decompression tools.
2021-03-05 03:41:40 -05:00
(setenv "PATH" (string-append #+gzip "/bin"))
download: Fix 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes a regression introduced in 20927c9331b493eaf94211ad9f8a5055e11b4588. Reported by Eric Bavier <ericbavier@centurylink.net>. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Within the gexp, import (guix build utils) for 'invoke'.
2018-04-17 01:43:22 -04:00
(chdir #$output)
download: 'url-fetch/tarbomb' and 'url-fetch/zipbomb' refer to native tools. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Use 'ungexp-native' instead of 'ungexp' when referring to the decompression tools.
2021-03-05 03:41:40 -05:00
(invoke (string-append #+tar "/bin/tar")
download: Fix 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes a regression introduced in 20927c9331b493eaf94211ad9f8a5055e11b4588. Reported by Eric Bavier <ericbavier@centurylink.net>. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Within the gexp, import (guix build utils) for 'invoke'.
2018-04-17 01:43:22 -04:00
"xf" #$drv)))
download: Use correct system and guile in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/40115>. Previously the result of `guix build -s $system $package' would depend on the system Guix was built for if $package or one of its dependencies used 'url-fetch/tarbomb' or 'url-fetch/zipbomb' as the origin method of its source (e.g. `guix build -s i686-linux ffmpeg' on i686-linux would build a different derivation than on x86_64-linux). This patch fixes this by explicitly passing the correct system and guile to 'gexp->derivation'. * guix/download.scm (url-fetch/tarbomb): Pass #:system system and #:guile-for-build guile to 'gexp->derivation', where guile is the derivation of guile for system. (url-fetch/zipbomb): Likewise. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2020-03-16 13:43:20 -04:00
#:system system
#:guile-for-build guile
download: Use ungrafted tools in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/31085>. Reported by Diego Nicola Barbato <dnbarbato@posteo.de>. * guix/download.scm (url-fetch/tarbomb): Pass #:graft? #f to 'gexp->derivation'. (url-fetch/zipbomb): Likewise.
2018-04-23 08:33:11 -04:00
#:graft? #f
download: Add 'url-fetch/tarbomb'. Suggested by Federico Beffa. Fixes <http://bugs.gnu.org/22676>. Reported by Danny Milosavljevic <dannym@scratchpost.org>. * gnu/packages/engineering.scm (broken-tarball-fetch): Remove. (fastcap)[source](method): Use URL-FETCH/TARBOMB instead. * gnu/packages/scheme.scm (broken-tarball-fetch): Remove. (scmutils)[source](method): Use URL-FETCH/TARBOMB instead. * guix/download.scm (url-fetch/tarbomb): New procedure, renamed from 'broken-tarball-fetch'.
2016-02-21 18:29:54 -05:00
#:local-build? #t)))
download: Add ‘url-fetch/zipbomb’. From this suggestion by Ludovic Courtès: <http://lists.gnu.org/archive/html/guix-devel/2016-09/msg01983.html> * guix/download.scm (url-fetch/zipbomb): New procedure.
2017-01-25 07:16:00 -05:00
(define* (url-fetch/zipbomb url hash-algo hash
#:optional name
#:key (system (%current-system))
(guile (default-guile)))
"Similar to 'url-fetch' but unpack the zip file at URL in a directory of its
own. This helper makes it easier to deal with \"zip bombs\"."
(define file-name
(match url
((head _ ...)
(basename head))
(_
(basename url))))
(define unzip
gnu: Move contents of zip module into compression module. * gnu/packages/zip.scm (zip, unzip, zziplib, perl-zip): Move to... * gnu/packages/compression.scm: ...here. * gnu/packages/zip.scm: Delete file. * gnu/local.mk (GNU_SYSTEM_MODULES): Unregister deleted file. * po/packages/POTFILES.in: Unregister deleted file. * gnu/packages/{audio, avr, bioinformatics, busybox, cdrom, ci, compression, docbook, documentation, fonts, fpga, game-development, games, gl, gnome, gnuzilla, graphics, guile, haskell, image, java, kodi, ldc, libreoffice, markup, maths, mc, monitoring, music, php, pretty-print, python, scheme, smalltalk, statistics, synergy, tex, textutils, video, web-browsers, xml, zip}.scm, guix/build-system/{ant, font}.scm, guix/{download, packages}.scm: Adapt module import.
2017-06-12 14:40:01 -04:00
(module-ref (resolve-interface '(gnu packages compression)) 'unzip))
download: Add ‘url-fetch/zipbomb’. From this suggestion by Ludovic Courtès: <http://lists.gnu.org/archive/html/guix-devel/2016-09/msg01983.html> * guix/download.scm (url-fetch/zipbomb): New procedure.
2017-01-25 07:16:00 -05:00
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
(mlet %store-monad ((drv (url-fetch* url hash-algo hash
(string-append "zipbomb-"
(or name file-name))
#:system system
#:guile guile))
download: Use correct system and guile in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/40115>. Previously the result of `guix build -s $system $package' would depend on the system Guix was built for if $package or one of its dependencies used 'url-fetch/tarbomb' or 'url-fetch/zipbomb' as the origin method of its source (e.g. `guix build -s i686-linux ffmpeg' on i686-linux would build a different derivation than on x86_64-linux). This patch fixes this by explicitly passing the correct system and guile to 'gexp->derivation'. * guix/download.scm (url-fetch/tarbomb): Pass #:system system and #:guile-for-build guile to 'gexp->derivation', where guile is the derivation of guile for system. (url-fetch/zipbomb): Likewise. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2020-03-16 13:43:20 -04:00
(guile (package->derivation guile system)))
download: Add ‘url-fetch/zipbomb’. From this suggestion by Ludovic Courtès: <http://lists.gnu.org/archive/html/guix-devel/2016-09/msg01983.html> * guix/download.scm (url-fetch/zipbomb): New procedure.
2017-01-25 07:16:00 -05:00
;; Take the zip bomb, and simply unpack it as a directory.
download: Use ungrafted tools in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/31085>. Reported by Diego Nicola Barbato <dnbarbato@posteo.de>. * guix/download.scm (url-fetch/tarbomb): Pass #:graft? #f to 'gexp->derivation'. (url-fetch/zipbomb): Likewise.
2018-04-23 08:33:11 -04:00
;; Use ungrafted unzip so that the resulting tarball doesn't depend on
;; whether grafts are enabled.
download: Add ‘url-fetch/zipbomb’. From this suggestion by Ludovic Courtès: <http://lists.gnu.org/archive/html/guix-devel/2016-09/msg01983.html> * guix/download.scm (url-fetch/zipbomb): New procedure.
2017-01-25 07:16:00 -05:00
(gexp->derivation (or name file-name)
download: Fix 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes a regression introduced in 20927c9331b493eaf94211ad9f8a5055e11b4588. Reported by Eric Bavier <ericbavier@centurylink.net>. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Within the gexp, import (guix build utils) for 'invoke'.
2018-04-17 01:43:22 -04:00
(with-imported-modules '((guix build utils))
#~(begin
(use-modules (guix build utils))
(mkdir #$output)
(chdir #$output)
download: 'url-fetch/tarbomb' and 'url-fetch/zipbomb' refer to native tools. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Use 'ungexp-native' instead of 'ungexp' when referring to the decompression tools.
2021-03-05 03:41:40 -05:00
(invoke (string-append #+unzip "/bin/unzip")
download: Fix 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes a regression introduced in 20927c9331b493eaf94211ad9f8a5055e11b4588. Reported by Eric Bavier <ericbavier@centurylink.net>. * guix/download.scm (url-fetch/tarbomb, url-fetch/zipbomb): Within the gexp, import (guix build utils) for 'invoke'.
2018-04-17 01:43:22 -04:00
#$drv)))
download: Use correct system and guile in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/40115>. Previously the result of `guix build -s $system $package' would depend on the system Guix was built for if $package or one of its dependencies used 'url-fetch/tarbomb' or 'url-fetch/zipbomb' as the origin method of its source (e.g. `guix build -s i686-linux ffmpeg' on i686-linux would build a different derivation than on x86_64-linux). This patch fixes this by explicitly passing the correct system and guile to 'gexp->derivation'. * guix/download.scm (url-fetch/tarbomb): Pass #:system system and #:guile-for-build guile to 'gexp->derivation', where guile is the derivation of guile for system. (url-fetch/zipbomb): Likewise. Signed-off-by: Ludovic Courtès <ludo@gnu.org>
2020-03-16 13:43:20 -04:00
#:system system
#:guile-for-build guile
download: Use ungrafted tools in 'url-fetch/tarbomb' and 'url-fetch/zipbomb'. Fixes <https://bugs.gnu.org/31085>. Reported by Diego Nicola Barbato <dnbarbato@posteo.de>. * guix/download.scm (url-fetch/tarbomb): Pass #:graft? #f to 'gexp->derivation'. (url-fetch/zipbomb): Likewise.
2018-04-23 08:33:11 -04:00
#:graft? #f
download: Add ‘url-fetch/zipbomb’. From this suggestion by Ludovic Courtès: <http://lists.gnu.org/archive/html/guix-devel/2016-09/msg01983.html> * guix/download.scm (url-fetch/zipbomb): New procedure.
2017-01-25 07:16:00 -05:00
#:local-build? #t)))
Factorize `download-and-store'. * guix/download.scm (download-to-store): New procedure. * guix/scripts/download.scm (fetch-and-store): Remove. (guix-download): Use `download-to-store' instead. * guix/ui.scm (call-with-temporary-output-file): Move to... * guix/utils.scm (call-with-temporary-output-file): ... here.
2013-04-21 16:40:23 -04:00
(define* (download-to-store store url #:optional (name (basename url))
guix download: Add '--no-check-certificate' option. * guix/download.scm (download-to-store): Add #:verify-certificate? parameter and honor it. * guix/scripts/download.scm (%default-options): Add 'verify-certificate?' key. (show-help, %options): Add '--no-check-certificate'. (guix-download): Pass #:verify-certificate to 'download-to-store'. * doc/guix.texi (Invoking guix download): Document it.
2016-11-07 17:29:45 -05:00
#:key (log (current-error-port)) recursive?
(verify-certificate? #t))
Factorize `download-and-store'. * guix/download.scm (download-to-store): New procedure. * guix/scripts/download.scm (fetch-and-store): Remove. (guix-download): Use `download-to-store' instead. * guix/ui.scm (call-with-temporary-output-file): Move to... * guix/utils.scm (call-with-temporary-output-file): ... here.
2013-04-21 16:40:23 -04:00
"Download from URL to STORE, either under NAME or URL's basename if
guix build: Allow directories to be passed to --with-source. * guix/scripts/build.scm (package-with-source)[tarball-base-name]: Gracefully handle file names that lack an extension. Pass #:recursive? #t to 'download-to-store'. * guix/download.scm (download-to-store): Add #:recursive? parameter and pass it to 'add-to-store'. * doc/guix.texi (Invoking guix build): Add an example of --with-source with a directory.
2015-06-11 05:19:12 -04:00
omitted. Write progress reports to LOG. RECURSIVE? has the same effect as
guix download: Add '--no-check-certificate' option. * guix/download.scm (download-to-store): Add #:verify-certificate? parameter and honor it. * guix/scripts/download.scm (%default-options): Add 'verify-certificate?' key. (show-help, %options): Add '--no-check-certificate'. (guix-download): Pass #:verify-certificate to 'download-to-store'. * doc/guix.texi (Invoking guix download): Document it.
2016-11-07 17:29:45 -05:00
the same-named parameter of 'add-to-store'. VERIFY-CERTIFICATE? determines
whether or not to validate HTTPS server certificates."
download: Support 'file://' URLs. * guix/download.scm (download-to-store): When URL has a 'file' scheme or no scheme, use 'add-to-store' directly.
2013-10-12 10:39:10 -04:00
(define uri
(string->uri url))
download: 'download-to-store' accepts plain file names. * guix/download.scm (download-to-store): When URI is #f, assume that URL is a file name, and handle it.
2014-03-11 17:09:31 -04:00
(if (or (not uri) (memq (uri-scheme uri) '(file #f)))
guix build: Allow directories to be passed to --with-source. * guix/scripts/build.scm (package-with-source)[tarball-base-name]: Gracefully handle file names that lack an extension. Pass #:recursive? #t to 'download-to-store'. * guix/download.scm (download-to-store): Add #:recursive? parameter and pass it to 'add-to-store'. * doc/guix.texi (Invoking guix build): Add an example of --with-source with a directory.
2015-06-11 05:19:12 -04:00
(add-to-store store name recursive? "sha256"
download: 'download-to-store' accepts plain file names. * guix/download.scm (download-to-store): When URI is #f, assume that URL is a file name, and handle it.
2014-03-11 17:09:31 -04:00
(if uri (uri-path uri) url))
download: Support 'file://' URLs. * guix/download.scm (download-to-store): When URL has a 'file' scheme or no scheme, use 'add-to-store' directly.
2013-10-12 10:39:10 -04:00
(call-with-temporary-output-file
(lambda (temp port)
(let ((result
(parameterize ((current-output-port log))
download: Autoload (guix build download). * guix/download.scm: Autoload (guix build download). (url-fetch): Rename to... (url-fetch*): ... this, locally, to allow for #:autoload. * guix/status.scm: Autoload (guix build download).
2021-03-19 07:02:08 -04:00
(url-fetch url temp
#:mirrors %mirrors
#:verify-certificate? verify-certificate?))))
download: Support 'file://' URLs. * guix/download.scm (download-to-store): When URL has a 'file' scheme or no scheme, use 'add-to-store' directly.
2013-10-12 10:39:10 -04:00
(close port)
(and result
guix build: Allow directories to be passed to --with-source. * guix/scripts/build.scm (package-with-source)[tarball-base-name]: Gracefully handle file names that lack an extension. Pass #:recursive? #t to 'download-to-store'. * guix/download.scm (download-to-store): Add #:recursive? parameter and pass it to 'add-to-store'. * doc/guix.texi (Invoking guix build): Add an example of --with-source with a directory.
2015-06-11 05:19:12 -04:00
(add-to-store store name recursive? "sha256" temp)))))))
Factorize `download-and-store'. * guix/download.scm (download-to-store): New procedure. * guix/scripts/download.scm (fetch-and-store): Remove. (guix-download): Use `download-to-store' instead. * guix/ui.scm (call-with-temporary-output-file): Move to... * guix/utils.scm (call-with-temporary-output-file): ... here.
2013-04-21 16:40:23 -04:00
Add (guix download) and (guix build download). * guix/download.scm, guix/build/download.scm: New files. * Makefile.am (MODULES): Add them. * tests/builders.scm ("url-fetch"): New test. * distro/packages/bootstrap.scm (bootstrap-origin): Support `url-fetch'. * guix/snix.scm (snix-derivation->guix-package): Use `url-fetch' instead of `http-fetch'.
2012-11-12 17:10:26 -05:00
;;; download.scm ends here
Reference in New Issue Copy Permalink