doc: Mention the relation between module names and file names.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
4379c35b 13Copyright @copyright{} 2012, 2013, 2014, 2015 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
7df7a74e
NK
15Copyright @copyright{} 2013 Nikita Karetnikov
16
17Permission is granted to copy, distribute and/or modify this document
18under the terms of the GNU Free Documentation License, Version 1.3 or
19any later version published by the Free Software Foundation; with no
20Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
21copy of the license is included in the section entitled ``GNU Free
22Documentation License''.
23@end copying
568717fd 24
eeaf4427 25@dircategory Package management
568717fd
LC
26@direntry
27* guix: (guix). Guix, the functional package manager.
e49951eb 28* guix package: (guix)Invoking guix package
eeaf4427 29 Managing packages with Guix.
e49951eb 30* guix build: (guix)Invoking guix build
568717fd 31 Building packages with Guix.
054e8576
LC
32* guix system: (guix)Invoking guix system
33 Managing the operating system configuration.
568717fd 34@end direntry
568717fd 35
372c4bbc
DT
36@dircategory Software development
37@direntry
38* guix environment: (guix)Invoking guix environment
39 Building development environments with Guix.
40@end direntry
41
568717fd 42@titlepage
7730d112
LC
43@title GNU Guix Reference Manual
44@subtitle Using the GNU Guix Functional Package Manager
568717fd 45@author Ludovic Courtès
da7cabd4 46@author Andreas Enge
acc08466 47@author Nikita Karetnikov
568717fd
LC
48
49@page
50@vskip 0pt plus 1filll
51Edition @value{EDITION} @*
52@value{UPDATED} @*
53
7df7a74e 54@insertcopying
568717fd
LC
55@end titlepage
56
568717fd
LC
57@contents
58
59@c *********************************************************************
60@node Top
f8348b91 61@top GNU Guix
568717fd 62
f8348b91
LC
63This document describes GNU Guix version @value{VERSION}, a functional
64package management tool written for the GNU system.
568717fd
LC
65
66@menu
67* Introduction:: What is Guix about?
bd5e766b 68* Installation:: Installing Guix.
eeaf4427 69* Package Management:: Package installation, upgrade, etc.
568717fd
LC
70* Programming Interface:: Using Guix in Scheme.
71* Utilities:: Package management commands.
a1ba8475 72* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 73* Contributing:: Your help needed!
568717fd
LC
74
75* Acknowledgments:: Thanks!
76* GNU Free Documentation License:: The license of this manual.
77* Concept Index:: Concepts.
a85b83d2 78* Programming Index:: Data types, functions, and variables.
aaa3eaa9
LC
79
80@detailmenu
81 --- The Detailed Node Listing ---
82
83Installation
84
85* Requirements:: Software needed to build and run Guix.
ec0339cd 86* Running the Test Suite:: Testing Guix.
aaa3eaa9
LC
87* Setting Up the Daemon:: Preparing the build daemon's environment.
88* Invoking guix-daemon:: Running the build daemon.
89
90Setting Up the Daemon
91
92* Build Environment Setup:: Preparing the isolated build environment.
93* Daemon Offload Setup:: Offloading builds to remote machines.
94
95Package Management
96
97* Features:: How Guix will make your life brighter.
98* Invoking guix package:: Package installation, removal, etc.
99* Emacs Interface:: Package management from Emacs.
100* Substitutes:: Downloading pre-built binaries.
101* Packages with Multiple Outputs:: Single source package, multiple outputs.
102* Invoking guix gc:: Running the garbage collector.
103* Invoking guix pull:: Fetching the latest Guix and distribution.
104* Invoking guix archive:: Exporting and importing store files.
105
106Programming Interface
107
108* Defining Packages:: Defining new packages.
109* Build Systems:: Specifying how packages are built.
110* The Store:: Manipulating the package store.
111* Derivations:: Low-level interface to package derivations.
112* The Store Monad:: Purely functional interface to the store.
113* G-Expressions:: Manipulating build expressions.
114
115Utilities
116
117* Invoking guix build:: Building packages from the command line.
118* Invoking guix download:: Downloading a file and printing its hash.
119* Invoking guix hash:: Computing the cryptographic hash of a file.
120* Invoking guix import:: Importing package definitions.
121* Invoking guix refresh:: Updating package definitions.
122* Invoking guix lint:: Finding errors in package definitions.
123* Invoking guix environment:: Setting up development environments.
aff8ce7c 124* Invoking guix publish:: Sharing substitutes.
aaa3eaa9
LC
125
126GNU Distribution
127
128* System Installation:: Installing the whole operating system.
35ed9306 129* System Configuration:: Configuring the operating system.
aaa3eaa9
LC
130* Installing Debugging Files:: Feeding the debugger.
131* Security Updates:: Deploying security fixes quickly.
132* Package Modules:: Packages from the programmer's viewpoint.
133* Packaging Guidelines:: Growing the distribution.
134* Bootstrapping:: GNU/Linux built from scratch.
135* Porting:: Targeting another platform or kernel.
136
137System Configuration
138
139* Using the Configuration System:: Customizing your GNU system.
140* operating-system Reference:: Detail of operating-system declarations.
141* File Systems:: Configuring file system mounts.
142* Mapped Devices:: Block device extra processing.
143* User Accounts:: Specifying user accounts.
598e19dc 144* Locales:: Language and cultural convention settings.
aaa3eaa9
LC
145* Services:: Specifying system services.
146* Setuid Programs:: Programs running with root privileges.
996ed739 147* Name Service Switch:: Configuring libc's name service switch.
aaa3eaa9
LC
148* Initial RAM Disk:: Linux-Libre bootstrapping.
149* GRUB Configuration:: Configuring the boot loader.
150* Invoking guix system:: Instantiating a system configuration.
151* Defining Services:: Adding new service definitions.
152
153Services
154
155* Base Services:: Essential system services.
156* Networking Services:: Network setup, SSH daemon, etc.
157* X Window:: Graphical display.
aa4ed923 158* Various Services:: Other services.
aaa3eaa9
LC
159
160Packaging Guidelines
161
ec0339cd
LC
162* Software Freedom:: What may go into the distribution.
163* Package Naming:: What's in a name?
164* Version Numbers:: When the name is not enough.
165* Python Modules:: Taming the snake.
166* Perl Modules:: Little pearls.
167* Fonts:: Fond of fonts.
aaa3eaa9
LC
168
169@end detailmenu
568717fd
LC
170@end menu
171
172@c *********************************************************************
173@node Introduction
174@chapter Introduction
175
c80e7e55
LC
176GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
177using the international phonetic alphabet (IPA).} is a functional
178package management tool for the GNU system. Package management consists
4bfc4ea3
NK
179of all activities that relate to building packages from sources,
180honoring their build-time and run-time dependencies,
c80e7e55
LC
181installing packages in user environments, upgrading installed packages
182to new versions or rolling back to a previous set, removing unused
183software packages, etc.
568717fd
LC
184
185@cindex functional package management
186The term @dfn{functional} refers to a specific package management
187discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
188as a function, in the mathematical sense. That function takes inputs,
189such as build scripts, a compiler, and libraries, and
190returns an installed package. As a pure function, its result depends
568717fd
LC
191solely on its inputs---for instance, it cannot refer to software or
192scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
193always produces the same result when passed a given set of inputs. It
194cannot alter the system's environment in
568717fd
LC
195any way; for instance, it cannot create, modify, or delete files outside
196of its build and installation directories. This is achieved by running
e900c503 197build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 198explicit inputs are visible.
568717fd 199
e531ac2a 200@cindex store
568717fd 201The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
202system, in a special directory called @dfn{the store} (@pxref{The
203Store}). Each package is installed in a directory of its own, in the
834129e0 204store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
205a hash of all the inputs used to build that package; thus, changing an
206input yields a different directory name.
207
208This approach is the foundation of Guix's salient features: support for
4bfc4ea3 209transactional package upgrade and rollback, per-user installation, and
eeaf4427 210garbage collection of packages (@pxref{Features}).
568717fd 211
4bfc4ea3 212Guix has a command-line interface, which allows users to build, install,
568717fd 213upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 214
3ca2731c
LC
215@cindex Guix System Distribution
216@cindex GSD
a1ba8475 217Last but not least, Guix is used to build a distribution of the GNU
3ca2731c
LC
218system, with many GNU and non-GNU free software packages. The Guix
219System Distribution, or GNU@tie{}GSD, takes advantage of the core
220properties of Guix at the system level. With GNU@tie{}GSD, users
221@emph{declare} all aspects of the operating system configuration, and
222Guix takes care of instantiating that configuration in a reproducible,
223stateless fashion. @xref{GNU Distribution}.
a1ba8475 224
bd5e766b
LC
225@c *********************************************************************
226@node Installation
227@chapter Installation
228
48febeb8
LC
229GNU Guix is available for download from its website at
230@url{http://www.gnu.org/software/guix/}. This section describes the
231software requirements of Guix, as well as how to install it and get
232ready to use it.
bd5e766b 233
5af6de3e
LC
234Note that this section is concerned with the installation of the package
235manager, which can be done on top of a running GNU/Linux system. If,
236instead, you want to install the complete GNU operating system,
6621cdb6 237@pxref{System Installation}.
5af6de3e 238
b22a12fd 239The build procedure for Guix is the same as for other GNU software, and
1da983b9 240is not covered here. Please see the files @file{README} and
b22a12fd
LC
241@file{INSTALL} in the Guix source tree for additional details.
242
bd5e766b
LC
243@menu
244* Requirements:: Software needed to build and run Guix.
ec0339cd 245* Running the Test Suite:: Testing Guix.
bd5e766b
LC
246* Setting Up the Daemon:: Preparing the build daemon's environment.
247* Invoking guix-daemon:: Running the build daemon.
248@end menu
249
250@node Requirements
251@section Requirements
252
253GNU Guix depends on the following packages:
254
255@itemize
4a328f73 256@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.5 or later;
288dca55 257@item @url{http://gnupg.org/, GNU libgcrypt};
8a96bd4b
ID
258@end itemize
259
260The following dependencies are optional:
261
262@itemize
288dca55 263@item
8a96bd4b 264Installing
288dca55 265@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
266allow you to use the @command{guix import pypi} command (@pxref{Invoking
267guix import}). It is of
288dca55 268interest primarily for developers and not for casual users.
8a96bd4b
ID
269@item
270Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
271allow you to access @code{https} URLs with the @command{guix download}
d45dc6da
EB
272command (@pxref{Invoking guix download}), the @command{guix import pypi}
273command, and the @command{guix import cpan} command. This is primarily
274of interest to developers. @xref{Guile Preparations, how to install the
275GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
276@end itemize
277
278Unless @code{--disable-daemon} was passed to @command{configure}, the
279following packages are also needed:
280
281@itemize
282@item @url{http://sqlite.org, SQLite 3}
283@item @url{http://www.bzip.org, libbz2}
284@item @url{http://gcc.gnu.org, GCC's g++}
285@end itemize
286
4bfc4ea3
NK
287When a working installation of @url{http://nixos.org/nix/, the Nix package
288manager} is available, you
bd5e766b 289can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 290Nix replaces the three dependencies above.
bd5e766b 291
b22a12fd
LC
292Guix is compatible with Nix, so it is possible to share the same store
293between both. To do so, you must pass @command{configure} not only the
294same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
295@code{--localstatedir} value. The latter is essential because it
296specifies where the database that stores metadata about the store is
834129e0 297located, among other things. The default values for Nix are
b22a12fd 298@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
299Note that @code{--disable-daemon} is not required if
300your goal is to share the store with Nix.
b22a12fd 301
ec0339cd
LC
302@node Running the Test Suite
303@section Running the Test Suite
304
305After a successful @command{configure} and @code{make} run, it is a good
306idea to run the test suite. It can help catch issues with the setup or
307environment, or bugs in Guix itself---and really, reporting test
308failures is a good way to help improve the software. To run the test
309suite, type:
310
311@example
312make check
313@end example
314
315Test cases can run in parallel: you can use the @code{-j} option of
316GNU@tie{}make to speed things up. The first run may take a few minutes
317on a recent machine; subsequent runs will be faster because the store
318that is created for test purposes will already have various things in
319cache.
320
321Upon failure, please email @email{bug-guix@@gnu.org} and attach the
322@file{test-suite.log} file. When @file{tests/@var{something}.scm}
323fails, please also attach the @file{@var{something}.log} file available
324in the top-level build directory. Please specify the Guix version being
325used as well as version numbers of the dependencies
326(@pxref{Requirements}) in your message.
327
bd5e766b
LC
328@node Setting Up the Daemon
329@section Setting Up the Daemon
330
331@cindex daemon
332Operations such as building a package or running the garbage collector
49e6291a 333are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
334behalf of clients. Only the daemon may access the store and its
335associated database. Thus, any operation that manipulates the store
336goes through the daemon. For instance, command-line tools such as
e49951eb 337@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
338daemon (@i{via} remote procedure calls) to instruct it what to do.
339
49e6291a
LC
340The following sections explain how to prepare the build daemon's
341environment.
342
343@menu
344* Build Environment Setup:: Preparing the isolated build environment.
345* Daemon Offload Setup:: Offloading builds to remote machines.
346@end menu
347
348@node Build Environment Setup
349@subsection Build Environment Setup
350
bd5e766b
LC
351In a standard multi-user setup, Guix and its daemon---the
352@command{guix-daemon} program---are installed by the system
834129e0 353administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
354@command{guix-daemon} runs as @code{root}. Unprivileged users may use
355Guix tools to build packages or otherwise access the store, and the
356daemon will do it on their behalf, ensuring that the store is kept in a
357consistent state, and allowing built packages to be shared among users.
358
359@cindex build users
360When @command{guix-daemon} runs as @code{root}, you may not want package
361build processes themselves to run as @code{root} too, for obvious
362security reasons. To avoid that, a special pool of @dfn{build users}
363should be created for use by build processes started by the daemon.
364These build users need not have a shell and a home directory: they will
365just be used when the daemon drops @code{root} privileges in build
366processes. Having several such users allows the daemon to launch
367distinct build processes under separate UIDs, which guarantees that they
368do not interfere with each other---an essential feature since builds are
369regarded as pure functions (@pxref{Introduction}).
370
371On a GNU/Linux system, a build user pool may be created like this (using
372Bash syntax and the @code{shadow} commands):
373
091196b3
LC
374@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
375@c for why `-G' is needed.
bd5e766b
LC
376@example
377# groupadd guix-builder
378# for i in `seq 1 10`;
379 do
091196b3
LC
380 useradd -g guix-builder -G guix-builder \
381 -d /var/empty -s `which nologin` \
4d1a2b50
LC
382 -c "Guix build user $i" --system \
383 guix-builder$i;
bd5e766b
LC
384 done
385@end example
386
387@noindent
388The @code{guix-daemon} program may then be run as @code{root} with:
389
390@example
391# guix-daemon --build-users-group=guix-builder
392@end example
393
e900c503 394@cindex chroot
b095792f
LC
395@noindent
396This way, the daemon starts build processes in a chroot, under one of
397the @code{guix-builder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
398environment contains nothing but:
399
400@c Keep this list in sync with libstore/build.cc! -----------------------
401@itemize
402@item
4743a4da
LC
403a minimal @code{/dev} directory, created mostly independently from the
404host @code{/dev}@footnote{``Mostly'', because while the set of files
405that appear in the chroot's @code{/dev} is fixed, most of these files
406can only be created if the host has them.};
407
408@item
409the @code{/proc} directory; it only shows the container's processes
410since a separate PID name space is used;
6dc99317
LC
411
412@item
413@file{/etc/passwd} with an entry for the current user and an entry for
414user @file{nobody};
415
416@item
417@file{/etc/group} with an entry for the user's group;
418
419@item
420@file{/etc/hosts} with an entry that maps @code{localhost} to
421@code{127.0.0.1};
422
423@item
424a writable @file{/tmp} directory.
425@end itemize
b095792f 426
d43eb499 427If you are installing Guix as an unprivileged user, it is still
bd5e766b
LC
428possible to run @command{guix-daemon}. However, build processes will
429not be isolated from one another, and not from the rest of the system.
430Thus, build processes may interfere with each other, and may access
431programs, libraries, and other files available on the system---making it
432much harder to view them as @emph{pure} functions.
433
49e6291a
LC
434
435@node Daemon Offload Setup
436@subsection Using the Offload Facility
437
438@cindex offloading
4ec2e92d
LC
439@cindex build hook
440When desired, the build daemon can @dfn{offload}
441derivation builds to other machines
49e6291a
LC
442running Guix, using the @code{offload} @dfn{build hook}. When that
443feature is enabled, a list of user-specified build machines is read from
444@file{/etc/guix/machines.scm}; anytime a build is requested, for
445instance via @code{guix build}, the daemon attempts to offload it to one
446of the machines that satisfies the derivation's constraints, in
447particular its system type---e.g., @file{x86_64-linux}. Missing
448prerequisites for the build are copied over SSH to the target machine,
449which then proceeds with the build; upon success the output(s) of the
450build are copied back to the initial machine.
451
4ec2e92d 452The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
453
454@example
455(list (build-machine
456 (name "eightysix.example.org")
457 (system "x86_64-linux")
458 (user "bob")
459 (speed 2.)) ; incredibly fast!
460
461 (build-machine
462 (name "meeps.example.org")
463 (system "mips64el-linux")
464 (user "alice")
465 (private-key
466 (string-append (getenv "HOME")
467 "/.ssh/id-rsa-for-guix"))))
468@end example
469
470@noindent
471In the example above we specify a list of two build machines, one for
472the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
473architecture.
474
475In fact, this file is---not surprisingly!---a Scheme file that is
476evaluated when the @code{offload} hook is started. Its return value
477must be a list of @code{build-machine} objects. While this example
478shows a fixed list of build machines, one could imagine, say, using
479DNS-SD to return a list of potential build machines discovered in the
480local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
481Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
482detailed below.
4ec2e92d 483
c678a4ee
LC
484@deftp {Data Type} build-machine
485This data type represents build machines the daemon may offload builds
486to. The important fields are:
49e6291a
LC
487
488@table @code
489
490@item name
491The remote machine's host name.
492
493@item system
c678a4ee 494The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
495
496@item user
497The user account to use when connecting to the remote machine over SSH.
498Note that the SSH key pair must @emph{not} be passphrase-protected, to
499allow non-interactive logins.
500
501@end table
502
4ec2e92d 503A number of optional fields may be specified:
49e6291a
LC
504
505@table @code
506
cecd72d5
LC
507@item port
508Port number of the machine's SSH server (default: 22).
509
49e6291a
LC
510@item private-key
511The SSH private key file to use when connecting to the machine.
512
513@item parallel-builds
514The number of builds that may run in parallel on the machine (1 by
515default.)
516
517@item speed
518A ``relative speed factor''. The offload scheduler will tend to prefer
519machines with a higher speed factor.
520
521@item features
522A list of strings denoting specific features supported by the machine.
523An example is @code{"kvm"} for machines that have the KVM Linux modules
524and corresponding hardware support. Derivations can request features by
525name, and they will be scheduled on matching build machines.
526
527@end table
c678a4ee 528@end deftp
49e6291a
LC
529
530The @code{guix} command must be in the search path on the build
531machines, since offloading works by invoking the @code{guix archive} and
532@code{guix build} commands.
533
534There's one last thing to do once @file{machines.scm} is in place. As
535explained above, when offloading, files are transferred back and forth
536between the machine stores. For this to work, you need to generate a
537key pair to allow the daemon to export signed archives of files from the
538store (@pxref{Invoking guix archive}):
539
540@example
541# guix archive --generate-key
542@end example
543
544@noindent
545Thus, when receiving files, a machine's build daemon can make sure they
546are genuine, have not been tampered with, and that they are signed by an
547authorized key.
548
549
bd5e766b
LC
550@node Invoking guix-daemon
551@section Invoking @command{guix-daemon}
552
553The @command{guix-daemon} program implements all the functionality to
554access the store. This includes launching build processes, running the
555garbage collector, querying the availability of a build result, etc. It
556is normally run as @code{root} like this:
557
558@example
559# guix-daemon --build-users-group=guix-builder
560@end example
561
562@noindent
081145cf 563For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 564
e900c503
LC
565@cindex chroot
566@cindex container, build environment
567@cindex build environment
568@cindex reproducible builds
bd5e766b
LC
569By default, @command{guix-daemon} launches build processes under
570different UIDs, taken from the build group specified with
571@code{--build-users-group}. In addition, each build process is run in a
572chroot environment that only contains the subset of the store that the
573build process depends on, as specified by its derivation
574(@pxref{Programming Interface, derivation}), plus a set of specific
575system directories. By default, the latter contains @file{/dev} and
e900c503
LC
576@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
577@dfn{container}: in addition to having its own file system tree, it has
578a separate mount name space, its own PID name space, network name space,
579etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b 580
cbc538fe
LC
581When the daemon performs a build on behalf of the user, it creates a
582build directory under @file{/tmp} or under the directory specified by
583its @code{TMPDIR} environment variable; this directory is shared with
584the container for the duration of the build. Be aware that using a
585directory other than @file{/tmp} can affect build results---for example,
586with a longer directory name, a build process that uses Unix-domain
587sockets might hit the name length limitation for @code{sun_path}, which
588it would otherwise not hit.
589
590The build directory is automatically deleted upon completion, unless the
591build failed and the client specified @option{--keep-failed}
592(@pxref{Invoking guix build, @option{--keep-failed}}).
593
bd5e766b
LC
594The following command-line options are supported:
595
596@table @code
597@item --build-users-group=@var{group}
598Take users from @var{group} to run build processes (@pxref{Setting Up
599the Daemon, build users}).
600
6858f9d1 601@item --no-substitutes
b5385b52 602@cindex substitutes
6858f9d1 603Do not use substitutes for build products. That is, always build things
c4202d60
LC
604locally instead of allowing downloads of pre-built binaries
605(@pxref{Substitutes}).
6858f9d1 606
b5385b52
LC
607By default substitutes are used, unless the client---such as the
608@command{guix package} command---is explicitly invoked with
609@code{--no-substitutes}.
610
611When the daemon runs with @code{--no-substitutes}, clients can still
612explicitly enable substitution @i{via} the @code{set-build-options}
613remote procedure call (@pxref{The Store}).
614
9176607e
LC
615@item --substitute-urls=@var{urls}
616Consider @var{urls} the default whitespace-separated list of substitute
617source URLs. When this option is omitted, @code{http://hydra.gnu.org}
618is used.
619
620This means that substitutes may be downloaded from @var{urls}, as long
621as they are signed by a trusted signature (@pxref{Substitutes}).
622
4ec2e92d
LC
623@cindex build hook
624@item --no-build-hook
625Do not use the @dfn{build hook}.
626
627The build hook is a helper program that the daemon can start and to
628which it submits build requests. This mechanism is used to offload
629builds to other machines (@pxref{Daemon Offload Setup}).
630
bd5e766b
LC
631@item --cache-failures
632Cache build failures. By default, only successful builds are cached.
633
634@item --cores=@var{n}
635@itemx -c @var{n}
636Use @var{n} CPU cores to build each derivation; @code{0} means as many
637as available.
638
6efc160e 639The default value is @code{0}, but it may be overridden by clients, such
e49951eb
MW
640as the @code{--cores} option of @command{guix build} (@pxref{Invoking
641guix build}).
bd5e766b
LC
642
643The effect is to define the @code{NIX_BUILD_CORES} environment variable
644in the build process, which can then use it to exploit internal
645parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
646
647@item --max-jobs=@var{n}
648@itemx -M @var{n}
649Allow at most @var{n} build jobs in parallel. The default value is
f6526eb3
LC
650@code{1}. Setting it to @code{0} means that no builds will be performed
651locally; instead, the daemon will offload builds (@pxref{Daemon Offload
652Setup}), or simply fail.
bd5e766b
LC
653
654@item --debug
655Produce debugging output.
656
657This is useful to debug daemon start-up issues, but then it may be
658overridden by clients, for example the @code{--verbosity} option of
e49951eb 659@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
660
661@item --chroot-directory=@var{dir}
662Add @var{dir} to the build chroot.
663
664Doing this may change the result of build processes---for instance if
665they use optional dependencies found in @var{dir} when it is available,
666and not otherwise. For that reason, it is not recommended to do so.
667Instead, make sure that each derivation declares all the inputs that it
668needs.
669
670@item --disable-chroot
671Disable chroot builds.
672
673Using this option is not recommended since, again, it would allow build
674processes to gain access to undeclared dependencies.
675
676@item --disable-log-compression
677Disable compression of the build logs.
678
1da983b9
LC
679Unless @code{--lose-logs} is used, all the build logs are kept in the
680@var{localstatedir}. To save space, the daemon automatically compresses
681them with bzip2 by default. This option disables that.
682
ab3893d7
LC
683@item --disable-deduplication
684@cindex deduplication
bd5e766b
LC
685Disable automatic file ``deduplication'' in the store.
686
1da983b9 687By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
688if a newly added file is identical to another one found in the store,
689the daemon makes the new file a hard link to the other file. This can
690noticeably reduce disk usage, at the expense of slightly increasde
691input/output load at the end of a build process. This option disables
692this optimization.
1da983b9 693
6e37066e
LC
694@item --gc-keep-outputs[=yes|no]
695Tell whether the garbage collector (GC) must keep outputs of live
696derivations.
697
698When set to ``yes'', the GC will keep the outputs of any live derivation
699available in the store---the @code{.drv} files. The default is ``no'',
700meaning that derivation outputs are kept only if they are GC roots.
701
702@item --gc-keep-derivations[=yes|no]
703Tell whether the garbage collector (GC) must keep derivations
704corresponding to live outputs.
705
706When set to ``yes'', as is the case by default, the GC keeps
707derivations---i.e., @code{.drv} files---as long as at least one of their
708outputs is live. This allows users to keep track of the origins of
709items in their store. Setting it to ``no'' saves a bit of disk space.
710
711Note that when both @code{--gc-keep-derivations} and
712@code{--gc-keep-outputs} are used, the effect is to keep all the build
713prerequisites (the sources, compiler, libraries, and other build-time
714tools) of live objects in the store, regardless of whether these
715prerequisites are live. This is convenient for developers since it
716saves rebuilds or downloads.
717
bd5e766b
LC
718@item --impersonate-linux-2.6
719On Linux-based systems, impersonate Linux 2.6. This means that the
720kernel's @code{uname} system call will report 2.6 as the release number.
721
722This might be helpful to build programs that (usually wrongfully) depend
723on the kernel version number.
724
725@item --lose-logs
726Do not keep build logs. By default they are kept under
ce33631f 727@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
728
729@item --system=@var{system}
730Assume @var{system} as the current system type. By default it is the
731architecture/kernel pair found at configure time, such as
732@code{x86_64-linux}.
b8d2aa26
LC
733
734@item --listen=@var{socket}
735Listen for connections on @var{socket}, the file name of a Unix-domain
736socket. The default socket is
737@file{@var{localstatedir}/daemon-socket/socket}. This option is only
738useful in exceptional circumstances, such as if you need to run several
739daemons on the same machine.
bd5e766b
LC
740@end table
741
742
eeaf4427
LC
743@c *********************************************************************
744@node Package Management
745@chapter Package Management
746
f8348b91 747The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
748remove software packages, without having to know about their build
749procedure or dependencies. Guix also goes beyond this obvious set of
750features.
751
752This chapter describes the main features of Guix, as well as the package
c1941588
LC
753management tools it provides. Two user interfaces are provided for
754routine package management tasks: a command-line interface
755(@pxref{Invoking guix package, @code{guix package}}), and a visual user
756interface in Emacs (@pxref{Emacs Interface}).
eeaf4427
LC
757
758@menu
759* Features:: How Guix will make your life brighter.
e49951eb 760* Invoking guix package:: Package installation, removal, etc.
457f60fa 761* Emacs Interface:: Package management from Emacs.
c4202d60 762* Substitutes:: Downloading pre-built binaries.
760c60d6 763* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 764* Invoking guix gc:: Running the garbage collector.
f651b477 765* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 766* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
767@end menu
768
769@node Features
770@section Features
771
772When using Guix, each package ends up in the @dfn{package store}, in its
773own directory---something that resembles
9a130e19
AK
774@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
775(note that Guix comes with an Emacs extension to shorten those file
081145cf 776names, @pxref{Emacs Prettify}.)
eeaf4427
LC
777
778Instead of referring to these directories, users have their own
779@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
780use. These profiles are stored within each user's home directory, at
781@code{$HOME/.guix-profile}.
eeaf4427 782
821b0015 783For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 784@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 785@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
786@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
787simply continues to point to
834129e0 788@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 789coexist on the same system without any interference.
eeaf4427 790
e49951eb
MW
791The @command{guix package} command is the central tool to manage
792packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 793profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
794
795The command provides the obvious install, remove, and upgrade
796operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 797the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 798@command{guix package} process is terminated during the transaction,
eeaf4427
LC
799or if a power outage occurs during the transaction, then the user's
800profile remains in its previous state, and remains usable.
801
802In addition, any package transaction may be @emph{rolled back}. So, if,
803for example, an upgrade installs a new version of a package that turns
804out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
805of their profile, which was known to work well. Similarly, the global
806system configuration is subject to transactional upgrades and roll-back
807(@pxref{Using the Configuration System}).
eeaf4427
LC
808
809All those packages in the package store may be @emph{garbage-collected}.
810Guix can determine which packages are still referenced by the user
fe8ff028 811profiles, and remove those that are provably no longer referenced
e49951eb 812(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
813generations of their profile so that the packages they refer to can be
814collected.
eeaf4427 815
e900c503
LC
816@cindex reproducibility
817@cindex reproducible builds
eeaf4427
LC
818Finally, Guix takes a @dfn{purely functional} approach to package
819management, as described in the introduction (@pxref{Introduction}).
834129e0 820Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
821inputs that were used to build that package---compiler, libraries, build
822scripts, etc. This direct correspondence allows users to make sure a
823given package installation matches the current state of their
e900c503
LC
824distribution. It also helps maximize @dfn{build reproducibility}:
825thanks to the isolated build environments that are used, a given build
826is likely to yield bit-identical files when performed on different
827machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 828
c4202d60 829@cindex substitutes
eeaf4427 830This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 831deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 832available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
833downloads it and unpacks it;
834otherwise, it builds the package from source, locally
835(@pxref{Substitutes}).
eeaf4427 836
f5fd4fd2
LC
837Control over the build environment is a feature that is also useful for
838developers. The @command{guix environment} command allows developers of
839a package to quickly set up the right development environment for their
840package, without having to manually install the package's dependencies
841in their profile (@pxref{Invoking guix environment}).
842
e49951eb
MW
843@node Invoking guix package
844@section Invoking @command{guix package}
eeaf4427 845
e49951eb 846The @command{guix package} command is the tool that allows users to
eeaf4427
LC
847install, upgrade, and remove packages, as well as rolling back to
848previous configurations. It operates only on the user's own profile,
849and works with normal user privileges (@pxref{Features}). Its syntax
850is:
851
852@example
e49951eb 853guix package @var{options}
eeaf4427
LC
854@end example
855
ba55b1cb 856Primarily, @var{options} specifies the operations to be performed during
eeaf4427
LC
857the transaction. Upon completion, a new profile is created, but
858previous generations of the profile remain available, should the user
859want to roll back.
860
6447738c
MW
861For example, to remove @code{lua} and install @code{guile} and
862@code{guile-cairo} in a single transaction:
863
864@example
865guix package -r lua -i guile guile-cairo
866@end example
867
b9e5c0a9 868For each user, a symlink to the user's default profile is automatically
0ec1af59 869created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
870current generation of the user's default profile. Thus, users can add
871@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
872variable, and so on.
873
4379c35b
LC
874In a multi-user setup, user profiles are stored in a place registered as
875a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
876to (@pxref{Invoking guix gc}). That directory is normally
0ec1af59
LC
877@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
878@var{localstatedir} is the value passed to @code{configure} as
4379c35b
LC
879@code{--localstatedir}, and @var{user} is the user name. The
880@file{per-user} directory is created when @command{guix-daemon} is
881started, and the @var{user} sub-directory is created by @command{guix
882package}.
0ec1af59
LC
883
884The @var{options} can be among the following:
885
eeaf4427
LC
886@table @code
887
6447738c
MW
888@item --install=@var{package} @dots{}
889@itemx -i @var{package} @dots{}
890Install the specified @var{package}s.
eeaf4427 891
6447738c 892Each @var{package} may specify either a simple package name, such as
eeaf4427 893@code{guile}, or a package name followed by a hyphen and version number,
dc5669cd
MW
894such as @code{guile-1.8.8}. If no version number is specified, the
895newest available version will be selected. In addition, @var{package}
896may contain a colon, followed by the name of one of the outputs of the
6e721c4d 897package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
898(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
899name (and optionally version) are searched for among the GNU
900distribution modules (@pxref{Package Modules}).
eeaf4427 901
461572cc
LC
902@cindex propagated inputs
903Sometimes packages have @dfn{propagated inputs}: these are dependencies
904that automatically get installed along with the required package.
905
906An example is the GNU MPC library: its C header files refer to those of
907the GNU MPFR library, which in turn refer to those of the GMP library.
908Thus, when installing MPC, the MPFR and GMP libraries also get installed
909in the profile; removing MPC also removes MPFR and GMP---unless they had
910also been explicitly installed independently.
911
ba7ea5ce 912Besides, packages sometimes rely on the definition of environment
5924080d 913variables for their search paths (see explanation of
ba7ea5ce 914@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
915environment variable definitions are reported here.
916
ef010c0f 917@c XXX: keep me up-to-date
5924080d 918Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
919availability of a newer upstream version. In the future, it may provide
920the option of installing directly from the upstream version, even if
921that version is not yet in the distribution.
922
5d4b411f
LC
923@item --install-from-expression=@var{exp}
924@itemx -e @var{exp}
925Install the package @var{exp} evaluates to.
926
927@var{exp} must be a Scheme expression that evaluates to a
928@code{<package>} object. This option is notably useful to disambiguate
929between same-named variants of a package, with expressions such as
930@code{(@@ (gnu packages base) guile-final)}.
931
932Note that this option installs the first output of the specified
933package, which may be insufficient when needing a specific output of a
934multiple-output package.
935
6447738c
MW
936@item --remove=@var{package} @dots{}
937@itemx -r @var{package} @dots{}
938Remove the specified @var{package}s.
eeaf4427 939
6447738c 940As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
941and/or output name in addition to the package name. For instance,
942@code{-r glibc:debug} would remove the @code{debug} output of
943@code{glibc}.
944
6447738c
MW
945@item --upgrade[=@var{regexp} @dots{}]
946@itemx -u [@var{regexp} @dots{}]
947Upgrade all the installed packages. If one or more @var{regexp}s are
948specified, upgrade only installed packages whose name matches a
949@var{regexp}.
eeaf4427 950
f651b477
LC
951Note that this upgrades package to the latest version of packages found
952in the distribution currently installed. To update your distribution,
953you should regularly run @command{guix pull} (@pxref{Invoking guix
954pull}).
955
24e262f0
LC
956@item --roll-back
957Roll back to the previous @dfn{generation} of the profile---i.e., undo
958the last transaction.
959
960When combined with options such as @code{--install}, roll back occurs
961before any other actions.
962
d9307267 963When rolling back from the first generation that actually contains
4b2bc804
NK
964installed packages, the profile is made to point to the @dfn{zeroth
965generation}, which contains no files apart from its own meta-data.
d9307267 966
82fe08ed
LC
967Installing, removing, or upgrading packages from a generation that has
968been rolled back to overwrites previous future generations. Thus, the
969history of a profile's generations is always linear.
970
b3bb82f1
AK
971@item --switch-generation=@var{pattern}
972@itemx -S @var{pattern}
973Switch to a particular generation defined by @var{pattern}.
974
975@var{pattern} may be either a generation number or a number prefixed
976with ``+'' or ``-''. The latter means: move forward/backward by a
977specified number of generations. For example, if you want to return to
978the latest generation after @code{--roll-back}, use
979@code{--switch-generation=+1}.
980
981The difference between @code{--roll-back} and
982@code{--switch-generation=-1} is that @code{--switch-generation} will
983not make a zeroth generation, so if a specified generation does not
984exist, the current generation will not be changed.
985
5924080d
LC
986@item --search-paths
987@cindex search paths
988Report environment variable definitions, in Bash syntax, that may be
989needed in order to use the set of installed packages. These environment
990variables are used to specify @dfn{search paths} for files used by some
991of the installed packages.
992
993For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
994environment variables to be defined so it can look for headers and
995libraries in the user's profile (@pxref{Environment Variables,,, gcc,
996Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
997library are installed in the profile, then @code{--search-paths} will
998suggest setting these variables to @code{@var{profile}/include} and
999@code{@var{profile}/lib}, respectively.
1000
eeaf4427
LC
1001@item --profile=@var{profile}
1002@itemx -p @var{profile}
1003Use @var{profile} instead of the user's default profile.
1004
70915c1a
LC
1005@item --verbose
1006Produce verbose output. In particular, emit the environment's build log
1007on the standard error port.
1008
eeaf4427
LC
1009@item --bootstrap
1010Use the bootstrap Guile to build the profile. This option is only
1011useful to distribution developers.
1012
1013@end table
1014
e49951eb 1015In addition to these actions @command{guix package} supports the
733b4130
LC
1016following options to query the current state of a profile, or the
1017availability of packages:
eeaf4427 1018
733b4130
LC
1019@table @option
1020
acc08466
NK
1021@item --search=@var{regexp}
1022@itemx -s @var{regexp}
1023List the available packages whose synopsis or description matches
299112d3
LC
1024@var{regexp}. Print all the meta-data of matching packages in
1025@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1026GNU recutils manual}).
acc08466 1027
299112d3
LC
1028This allows specific fields to be extracted using the @command{recsel}
1029command, for instance:
1030
1031@example
e49951eb 1032$ guix package -s malloc | recsel -p name,version
299112d3
LC
1033name: glibc
1034version: 2.17
1035
1036name: libgc
1037version: 7.2alpha6
1038@end example
acc08466 1039
a12d92f5
LC
1040Similarly, to show the name of all the packages available under the
1041terms of the GNU@tie{}LGPL version 3:
1042
1043@example
1044$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1045name: elfutils
1046
1047name: gmp
1048@dots{}
1049@end example
1050
2aa6efb0
CR
1051@item --show=@var{package}
1052Show details about @var{package}, taken from the list of available packages, in
1053@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1054recutils manual}).
1055
1056@example
1057$ guix package --show=python | recsel -p name,version
1058name: python
1059version: 2.7.6
1060
1061name: python
1062version: 3.3.5
1063@end example
1064
1065You may also specify the full name of a package to only get details about a
1066specific version of it:
1067@example
1068$ guix package --show=python-3.3.5 | recsel -p name,version
1069name: python
1070version: 3.3.5
1071@end example
1072
1073
1074
733b4130
LC
1075@item --list-installed[=@var{regexp}]
1076@itemx -I [@var{regexp}]
bd9bde1c
LC
1077List the currently installed packages in the specified profile, with the
1078most recently installed packages shown last. When @var{regexp} is
1079specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
1080
1081For each installed package, print the following items, separated by
1082tabs: the package name, its version string, the part of the package that
1083is installed (for instance, @code{out} for the default output,
1084@code{include} for its headers, etc.), and the path of this package in
1085the store.
1086
64fc89b6
LC
1087@item --list-available[=@var{regexp}]
1088@itemx -A [@var{regexp}]
a1ba8475
LC
1089List packages currently available in the software distribution
1090(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1091installed packages whose name matches @var{regexp}.
64fc89b6
LC
1092
1093For each package, print the following items separated by tabs: its name,
6e721c4d
LC
1094its version string, the parts of the package (@pxref{Packages with
1095Multiple Outputs}), and the source location of its definition.
64fc89b6 1096
f566d765
LC
1097@item --list-generations[=@var{pattern}]
1098@itemx -l [@var{pattern}]
1099Return a list of generations along with their creation dates; for each
1100generation, show the installed packages, with the most recently
4b2bc804
NK
1101installed packages shown last. Note that the zeroth generation is never
1102shown.
f566d765
LC
1103
1104For each installed package, print the following items, separated by
1105tabs: the name of a package, its version string, the part of the package
1106that is installed (@pxref{Packages with Multiple Outputs}), and the
1107location of this package in the store.
1108
1109When @var{pattern} is used, the command returns only matching
1110generations. Valid patterns include:
1111
1112@itemize
1113@item @emph{Integers and comma-separated integers}. Both patterns denote
1114generation numbers. For instance, @code{--list-generations=1} returns
1115the first one.
1116
1117And @code{--list-generations=1,8,2} outputs three generations in the
1118specified order. Neither spaces nor trailing commas are allowed.
1119
1120@item @emph{Ranges}. @code{--list-generations=2..9} prints the
1121specified generations and everything in between. Note that the start of
1122a range must be lesser than its end.
1123
1124It is also possible to omit the endpoint. For example,
1125@code{--list-generations=2..}, returns all generations starting from the
1126second one.
1127
1128@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1129or months by passing an integer along with the first letter of the
d7ddb257
LC
1130duration. For example, @code{--list-generations=20d} lists generations
1131that are up to 20 days old.
f566d765
LC
1132@end itemize
1133
b7884ca3
NK
1134@item --delete-generations[=@var{pattern}]
1135@itemx -d [@var{pattern}]
d7ddb257
LC
1136When @var{pattern} is omitted, delete all generations except the current
1137one.
b7884ca3
NK
1138
1139This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1140When @var{pattern} is specified, delete the matching generations. When
1141@var{pattern} specifies a duration, generations @emph{older} than the
1142specified duration match. For instance, @code{--delete-generations=1m}
1143deletes generations that are more than one month old.
1144
391bdd8f
LC
1145If the current generation matches, it is @emph{not} deleted. Also, the
1146zeroth generation is never deleted.
b7884ca3 1147
1bb9900a
LC
1148Note that deleting generations prevents roll-back to them.
1149Consequently, this command must be used with care.
1150
733b4130 1151@end table
eeaf4427 1152
70ee5642
LC
1153Finally, since @command{guix package} may actually start build
1154processes, it supports all the common build options that @command{guix
1155build} supports (@pxref{Invoking guix build, common build options}).
1156
457f60fa
AK
1157@include emacs.texi
1158
c4202d60
LC
1159@node Substitutes
1160@section Substitutes
1161
1162@cindex substitutes
1163@cindex pre-built binaries
1164Guix supports transparent source/binary deployment, which means that it
1165can either build things locally, or download pre-built items from a
1166server. We call these pre-built items @dfn{substitutes}---they are
1167substitutes for local build results. In many cases, downloading a
1168substitute is much faster than building things locally.
1169
1170Substitutes can be anything resulting from a derivation build
1171(@pxref{Derivations}). Of course, in the common case, they are
1172pre-built package binaries, but source tarballs, for instance, which
1173also result from derivation builds, can be available as substitutes.
1174
1175The @code{hydra.gnu.org} server is a front-end to a build farm that
1176builds packages from the GNU distribution continuously for some
9176607e
LC
1177architectures, and makes them available as substitutes. This is the
1178default source of substitutes; it can be overridden by passing
1179@command{guix-daemon} the @code{--substitute-urls} option
1180(@pxref{Invoking guix-daemon}).
c4202d60
LC
1181
1182@cindex security
1183@cindex digital signatures
1184To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1185must add its public key to the access control list (ACL) of archive
1186imports, using the @command{guix archive} command (@pxref{Invoking guix
1187archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1188be compromised and to serve genuine substitutes.
1189
1190This public key is installed along with Guix, in
1191@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1192the installation prefix of Guix. If you installed Guix from source,
1193make sure you checked the GPG signature of
1194@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1195Then, you can run something like this:
1196
1197@example
1198# guix archive --authorize < hydra.gnu.org.pub
1199@end example
1200
1201Once this is in place, the output of a command like @code{guix build}
1202should change from something like:
1203
1204@example
1205$ guix build emacs --dry-run
1206The following derivations would be built:
1207 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1208 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1209 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1210 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1211@dots{}
1212@end example
1213
1214@noindent
1215to something like:
1216
1217@example
1218$ guix build emacs --dry-run
1219The following files would be downloaded:
1220 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1221 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1222 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1223 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1224@dots{}
1225@end example
1226
1227@noindent
1228This indicates that substitutes from @code{hydra.gnu.org} are usable and
1229will be downloaded, when possible, for future builds.
1230
1231Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1232one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1233when attempting to use a substitute that has been tampered with.
1234
1235The substitute mechanism can be disabled globally by running
1236@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1237guix-daemon}). It can also be disabled temporarily by passing the
1238@code{--no-substitutes} option to @command{guix package}, @command{guix
1239build}, and other command-line tools.
1240
1241
1242Today, each individual's control over their own computing is at the
1243mercy of institutions, corporations, and groups with enough power and
1244determination to subvert the computing infrastructure and exploit its
1245weaknesses. While using @code{hydra.gnu.org} substitutes can be
1246convenient, we encourage users to also build on their own, or even run
1247their own build farm, such that @code{hydra.gnu.org} is less of an
1248interesting target.
1249
1250Guix has the foundations to maximize build reproducibility
1251(@pxref{Features}). In most cases, independent builds of a given
1252package or derivation should yield bit-identical results. Thus, through
1253a diverse set of independent package builds, we can strengthen the
1254integrity of our systems.
1255
1256In the future, we want Guix to have support to publish and retrieve
1257binaries to/from other users, in a peer-to-peer fashion. If you would
1258like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1259
1260
6e721c4d
LC
1261@node Packages with Multiple Outputs
1262@section Packages with Multiple Outputs
1263
1264@cindex multiple-output packages
1265@cindex package outputs
1266
1267Often, packages defined in Guix have a single @dfn{output}---i.e., the
1268source package leads exactly one directory in the store. When running
1269@command{guix package -i glibc}, one installs the default output of the
1270GNU libc package; the default output is called @code{out}, but its name
1271can be omitted as shown in this command. In this particular case, the
1272default output of @code{glibc} contains all the C header files, shared
1273libraries, static libraries, Info documentation, and other supporting
1274files.
1275
1276Sometimes it is more appropriate to separate the various types of files
1277produced from a single source package into separate outputs. For
1278instance, the GLib C library (used by GTK+ and related packages)
1279installs more than 20 MiB of reference documentation as HTML pages.
1280To save space for users who do not need it, the documentation goes to a
1281separate output, called @code{doc}. To install the main GLib output,
1282which contains everything but the documentation, one would run:
1283
1284@example
1285guix package -i glib
1286@end example
1287
1288The command to install its documentation is:
1289
1290@example
1291guix package -i glib:doc
1292@end example
1293
1294Some packages install programs with different ``dependency footprints''.
1295For instance, the WordNet package install both command-line tools and
1296graphical user interfaces (GUIs). The former depend solely on the C
1297library, whereas the latter depend on Tcl/Tk and the underlying X
1298libraries. In this case, we leave the command-line tools in the default
1299output, whereas the GUIs are in a separate output. This allows users
1300who do not need the GUIs to save space.
1301
1302There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1303Other conventional output names include @code{lib} for libraries and
1304possibly header files, @code{bin} for stand-alone programs, and
1305@code{debug} for debugging information (@pxref{Installing Debugging
1306Files}). The outputs of a packages are listed in the third column of
1307the output of @command{guix package --list-available} (@pxref{Invoking
1308guix package}).
6e721c4d 1309
eeaf4427 1310
e49951eb
MW
1311@node Invoking guix gc
1312@section Invoking @command{guix gc}
fe8ff028
LC
1313
1314@cindex garbage collector
1315Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1316The @command{guix gc} command allows users to explicitly run the garbage
c22eb992
LC
1317collector to reclaim space from the @file{/gnu/store} directory. It is
1318the @emph{only} way to remove files from @file{/gnu/store}---removing
1319files or directories manually may break it beyond repair!
fe8ff028
LC
1320
1321The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1322@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1323cannot be deleted; any other file is considered @dfn{dead} and may be
1324deleted. The set of garbage collector roots includes default user
e49951eb
MW
1325profiles, and may be augmented with @command{guix build --root}, for
1326example (@pxref{Invoking guix build}).
fe8ff028 1327
1bb9900a
LC
1328Prior to running @code{guix gc --collect-garbage} to make space, it is
1329often useful to remove old generations from user profiles; that way, old
1330package builds referenced by those generations can be reclaimed. This
1331is achieved by running @code{guix package --delete-generations}
1332(@pxref{Invoking guix package}).
1333
e49951eb 1334The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
1335used to garbage-collect any dead files (the default), to delete specific
1336files (the @code{--delete} option), or to print garbage-collector
1337information. The available options are listed below:
1338
1339@table @code
1340@item --collect-garbage[=@var{min}]
1341@itemx -C [@var{min}]
834129e0 1342Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1343sub-directories. This is the default operation when no option is
1344specified.
1345
1346When @var{min} is given, stop once @var{min} bytes have been collected.
1347@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1348suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1349(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1350
1351When @var{min} is omitted, collect all the garbage.
1352
1353@item --delete
1354@itemx -d
1355Attempt to delete all the store files and directories specified as
1356arguments. This fails if some of the files are not in the store, or if
1357they are still live.
1358
1359@item --list-dead
1360Show the list of dead files and directories still present in the
1361store---i.e., files and directories no longer reachable from any root.
1362
1363@item --list-live
1364Show the list of live store files and directories.
ba8b732d
LC
1365
1366@end table
1367
1368In addition, the references among existing store files can be queried:
1369
1370@table @code
1371
1372@item --references
1373@itemx --referrers
1374List the references (respectively, the referrers) of store files given
1375as arguments.
1376
8e59fdd5
LC
1377@item --requisites
1378@itemx -R
1379List the requisites of the store files passed as arguments. Requisites
1380include the store files themselves, their references, and the references
1381of these, recursively. In other words, the returned list is the
1382@dfn{transitive closure} of the store files.
1383
fe8ff028
LC
1384@end table
1385
eeaf4427 1386
f651b477
LC
1387@node Invoking guix pull
1388@section Invoking @command{guix pull}
1389
1390Packages are installed or upgraded to the latest version available in
1391the distribution currently available on your local machine. To update
1392that distribution, along with the Guix tools, you must run @command{guix
1393pull}: the command downloads the latest Guix source code and package
1394descriptions, and deploys it.
1395
1396On completion, @command{guix package} will use packages and package
1397versions from this just-retrieved copy of Guix. Not only that, but all
1398the Guix commands and Scheme modules will also be taken from that latest
1399version. New @command{guix} sub-commands added by the update also
1400become available.
1401
1402The @command{guix pull} command is usually invoked with no arguments,
1403but it supports the following options:
1404
1405@table @code
1406@item --verbose
1407Produce verbose output, writing build logs to the standard error output.
1408
ab5d72ad
LC
1409@item --url=@var{url}
1410Download the source tarball of Guix from @var{url}.
1411
1412By default, the tarball is taken from its canonical address at
1413@code{gnu.org}, for the stable branch of Guix.
1414
f651b477
LC
1415@item --bootstrap
1416Use the bootstrap Guile to build the latest Guix. This option is only
1417useful to Guix developers.
1418@end table
1419
760c60d6
LC
1420
1421@node Invoking guix archive
1422@section Invoking @command{guix archive}
1423
1424The @command{guix archive} command allows users to @dfn{export} files
1425from the store into a single archive, and to later @dfn{import} them.
1426In particular, it allows store files to be transferred from one machine
1427to another machine's store. For example, to transfer the @code{emacs}
1428package to a machine connected over SSH, one would run:
1429
1430@example
56607088 1431guix archive --export -r emacs | ssh the-machine guix archive --import
760c60d6
LC
1432@end example
1433
87236aed 1434@noindent
56607088
LC
1435Similarly, a complete user profile may be transferred from one machine
1436to another like this:
1437
1438@example
1439guix archive --export -r $(readlink -f ~/.guix-profile) | \
1440 ssh the-machine guix-archive --import
1441@end example
1442
1443@noindent
1444However, note that, in both examples, all of @code{emacs} and the
1445profile as well as all of their dependencies are transferred (due to
1446@code{-r}), regardless of what is already available in the target
1447machine's store. The @code{--missing} option can help figure out which
1448items are missing from the target's store.
87236aed 1449
760c60d6 1450Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1451comparable in spirit to `tar', but with a few noteworthy differences
1452that make it more appropriate for our purposes. First, rather than
1453recording all Unix meta-data for each file, the Nar format only mentions
1454the file type (regular, directory, or symbolic link); Unix permissions
1455and owner/group are dismissed. Second, the order in which directory
1456entries are stored always follows the order of file names according to
1457the C locale collation order. This makes archive production fully
1458deterministic.
1459
1460When exporting, the daemon digitally signs the contents of the archive,
1461and that digital signature is appended. When importing, the daemon
1462verifies the signature and rejects the import in case of an invalid
1463signature or if the signing key is not authorized.
760c60d6
LC
1464@c FIXME: Add xref to daemon doc about signatures.
1465
1466The main options are:
1467
1468@table @code
1469@item --export
1470Export the specified store files or packages (see below.) Write the
1471resulting archive to the standard output.
1472
56607088
LC
1473Dependencies are @emph{not} included in the output, unless
1474@code{--recursive} is passed.
1475
1476@item -r
1477@itemx --recursive
1478When combined with @code{--export}, this instructs @command{guix
1479archive} to include dependencies of the given items in the archive.
1480Thus, the resulting archive is self-contained: it contains the closure
1481of the exported store items.
1482
760c60d6
LC
1483@item --import
1484Read an archive from the standard input, and import the files listed
1485therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1486signature, or if it is signed by a public key not among the authorized
1487keys (see @code{--authorize} below.)
554f26ec 1488
87236aed
LC
1489@item --missing
1490Read a list of store file names from the standard input, one per line,
1491and write on the standard output the subset of these files missing from
1492the store.
1493
554f26ec 1494@item --generate-key[=@var{parameters}]
f82cc5fd 1495@cindex signing, archives
554f26ec
LC
1496Generate a new key pair for the daemons. This is a prerequisite before
1497archives can be exported with @code{--export}. Note that this operation
1498usually takes time, because it needs to gather enough entropy to
1499generate the key pair.
1500
1501The generated key pair is typically stored under @file{/etc/guix}, in
1502@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
867d8473
LC
1503key, which must be kept secret.) When @var{parameters} is omitted,
1504an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
1505versions before 1.6.0, it is a 4096-bit RSA key.
1506Alternately, @var{parameters} can specify
554f26ec
LC
1507@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1508public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1509Libgcrypt Reference Manual}).
f82cc5fd
LC
1510
1511@item --authorize
1512@cindex authorizing, archives
1513Authorize imports signed by the public key passed on standard input.
1514The public key must be in ``s-expression advanced format''---i.e., the
1515same format as the @file{signing-key.pub} file.
1516
1517The list of authorized keys is kept in the human-editable file
1518@file{/etc/guix/acl}. The file contains
1519@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1520s-expressions''} and is structured as an access-control list in the
1521@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1522(SPKI)}.
760c60d6
LC
1523@end table
1524
1525To export store files as an archive to the standard output, run:
1526
1527@example
1528guix archive --export @var{options} @var{specifications}...
1529@end example
1530
1531@var{specifications} may be either store file names or package
1532specifications, as for @command{guix package} (@pxref{Invoking guix
1533package}). For instance, the following command creates an archive
1534containing the @code{gui} output of the @code{git} package and the main
1535output of @code{emacs}:
1536
1537@example
834129e0 1538guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1539@end example
1540
1541If the specified packages are not built yet, @command{guix archive}
1542automatically builds them. The build process may be controlled with the
1543same options that can be passed to the @command{guix build} command
70ee5642 1544(@pxref{Invoking guix build, common build options}).
760c60d6
LC
1545
1546
568717fd
LC
1547@c *********************************************************************
1548@node Programming Interface
1549@chapter Programming Interface
1550
3dc1970d
LC
1551GNU Guix provides several Scheme programming interfaces (APIs) to
1552define, build, and query packages. The first interface allows users to
1553write high-level package definitions. These definitions refer to
1554familiar packaging concepts, such as the name and version of a package,
1555its build system, and its dependencies. These definitions can then be
1556turned into concrete build actions.
1557
ba55b1cb 1558Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1559standard setup, the daemon has write access to the store---the
834129e0 1560@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1561setup also has the daemon perform builds in chroots, under a specific
1562build users, to minimize interference with the rest of the system.
1563
1564@cindex derivation
1565Lower-level APIs are available to interact with the daemon and the
1566store. To instruct the daemon to perform a build action, users actually
1567provide it with a @dfn{derivation}. A derivation is a low-level
1568representation of the build actions to be taken, and the environment in
1569which they should occur---derivations are to package definitions what
49ad317a
LC
1570assembly is to C programs. The term ``derivation'' comes from the fact
1571that build results @emph{derive} from them.
3dc1970d
LC
1572
1573This chapter describes all these APIs in turn, starting from high-level
1574package definitions.
1575
568717fd 1576@menu
b860f382 1577* Defining Packages:: Defining new packages.
7458bd0a 1578* Build Systems:: Specifying how packages are built.
b860f382
LC
1579* The Store:: Manipulating the package store.
1580* Derivations:: Low-level interface to package derivations.
1581* The Store Monad:: Purely functional interface to the store.
21b679f6 1582* G-Expressions:: Manipulating build expressions.
568717fd
LC
1583@end menu
1584
1585@node Defining Packages
1586@section Defining Packages
1587
3dc1970d
LC
1588The high-level interface to package definitions is implemented in the
1589@code{(guix packages)} and @code{(guix build-system)} modules. As an
1590example, the package definition, or @dfn{recipe}, for the GNU Hello
1591package looks like this:
1592
1593@example
e7f34eb0
LC
1594(define-module (gnu packages hello)
1595 #:use-module (guix packages)
1596 #:use-module (guix download)
1597 #:use-module (guix build-system gnu)
1598 #:use-module (guix licenses))
b22a12fd 1599
79f5dd59 1600(define-public hello
3dc1970d
LC
1601 (package
1602 (name "hello")
1603 (version "2.8")
1604 (source (origin
1605 (method url-fetch)
1606 (uri (string-append "mirror://gnu/hello/hello-" version
1607 ".tar.gz"))
1608 (sha256
1609 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1610 (build-system gnu-build-system)
7458bd0a 1611 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1612 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1613 (synopsis "Hello, GNU world: An example GNU package")
1614 (description "Guess what GNU Hello prints!")
3dc1970d 1615 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 1616 (license gpl3+)))
3dc1970d
LC
1617@end example
1618
1619@noindent
1620Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 1621of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
1622to a @code{<package>} object, which is essentially a record
1623(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1624This package object can be inspected using procedures found in the
1625@code{(guix packages)} module; for instance, @code{(package-name hello)}
1626returns---surprise!---@code{"hello"}.
1627
2f7d2d91
LC
1628With luck, you may be able to import part or all of the definition of
1629the package you are interested in from another repository, using the
1630@code{guix import} command (@pxref{Invoking guix import}).
1631
e7f34eb0
LC
1632In the example above, @var{hello} is defined into a module of its own,
1633@code{(gnu packages hello)}. Technically, this is not strictly
1634necessary, but it is convenient to do so: all the packages defined in
1635modules under @code{(gnu packages @dots{})} are automatically known to
1636the command-line tools (@pxref{Package Modules}).
1637
3dc1970d
LC
1638There are a few points worth noting in the above package definition:
1639
1640@itemize
1641@item
1642The @code{source} field of the package is an @code{<origin>} object.
1643Here, the @code{url-fetch} method from @code{(guix download)} is used,
1644meaning that the source is a file to be downloaded over FTP or HTTP.
1645
1646The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1647the GNU mirrors defined in @code{(guix download)}.
1648
1649The @code{sha256} field specifies the expected SHA256 hash of the file
1650being downloaded. It is mandatory, and allows Guix to check the
1651integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 1652base32 representation of the hash. You can obtain this information with
210cc920
LC
1653@code{guix download} (@pxref{Invoking guix download}) and @code{guix
1654hash} (@pxref{Invoking guix hash}).
3dc1970d 1655
f9cc8971
LC
1656@cindex patches
1657When needed, the @code{origin} form can also have a @code{patches} field
1658listing patches to be applied, and a @code{snippet} field giving a
1659Scheme expression to modify the source code.
1660
3dc1970d
LC
1661@item
1662@cindex GNU Build System
7458bd0a
LC
1663The @code{build-system} field specifies the procedure to build the
1664package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1665represents the familiar GNU Build System, where packages may be
1666configured, built, and installed with the usual @code{./configure &&
1667make && make check && make install} command sequence.
1668
1669@item
1670The @code{arguments} field specifies options for the build system
1671(@pxref{Build Systems}). Here it is interpreted by
1672@var{gnu-build-system} as a request run @file{configure} with the
1673@code{--enable-silent-rules} flag.
3dc1970d
LC
1674
1675@item
1676The @code{inputs} field specifies inputs to the build process---i.e.,
1677build-time or run-time dependencies of the package. Here, we define an
1678input called @code{"gawk"} whose value is that of the @var{gawk}
1679variable; @var{gawk} is itself bound to a @code{<package>} object.
1680
1681Note that GCC, Coreutils, Bash, and other essential tools do not need to
1682be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 1683of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
1684
1685However, any other dependencies need to be specified in the
1686@code{inputs} field. Any dependency not specified here will simply be
1687unavailable to the build process, possibly leading to a build failure.
1688@end itemize
1689
2f7d2d91 1690Once a package definition is in place, the
e49951eb 1691package may actually be built using the @code{guix build} command-line
7458bd0a 1692tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
b4f5e0e8
CR
1693more information on how to test package definitions, and
1694@ref{Invoking guix lint}, for information on how to check a definition
1695for style conformance.
1696
7458bd0a
LC
1697Eventually, updating the package definition to a new upstream version
1698can be partly automated by the @command{guix refresh} command
1699(@pxref{Invoking guix refresh}).
3dc1970d
LC
1700
1701Behind the scenes, a derivation corresponding to the @code{<package>}
1702object is first computed by the @code{package-derivation} procedure.
834129e0 1703That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 1704The build actions it prescribes may then be realized by using the
3dc1970d
LC
1705@code{build-derivations} procedure (@pxref{The Store}).
1706
1707@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1708Return the @code{<derivation>} object of @var{package} for @var{system}
1709(@pxref{Derivations}).
3dc1970d
LC
1710
1711@var{package} must be a valid @code{<package>} object, and @var{system}
1712must be a string denoting the target system type---e.g.,
1713@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1714must be a connection to the daemon, which operates on the store
1715(@pxref{The Store}).
1716@end deffn
568717fd 1717
9c1edabd
LC
1718@noindent
1719@cindex cross-compilation
1720Similarly, it is possible to compute a derivation that cross-builds a
1721package for some other system:
1722
1723@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1724 @var{package} @var{target} [@var{system}]
59688fc4
LC
1725Return the @code{<derivation>} object of @var{package} cross-built from
1726@var{system} to @var{target}.
9c1edabd
LC
1727
1728@var{target} must be a valid GNU triplet denoting the target hardware
1729and operating system, such as @code{"mips64el-linux-gnu"}
1730(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1731Configure and Build System}).
1732@end deffn
1733
1734
7458bd0a
LC
1735@node Build Systems
1736@section Build Systems
1737
1738@cindex build system
1739Each package definition specifies a @dfn{build system} and arguments for
1740that build system (@pxref{Defining Packages}). This @code{build-system}
1741field represents the build procedure of the package, as well implicit
1742dependencies of that build procedure.
1743
1744Build systems are @code{<build-system>} objects. The interface to
1745create and manipulate them is provided by the @code{(guix build-system)}
1746module, and actual build systems are exported by specific modules.
1747
f5fd4fd2 1748@cindex bag (low-level package representation)
0d5a559f
LC
1749Under the hood, build systems first compile package objects to
1750@dfn{bags}. A @dfn{bag} is like a package, but with less
1751ornamentation---in other words, a bag is a lower-level representation of
1752a package, which includes all the inputs of that package, including some
1753that were implicitly added by the build system. This intermediate
1754representation is then compiled to a derivation (@pxref{Derivations}).
1755
7458bd0a
LC
1756Build systems accept an optional list of @dfn{arguments}. In package
1757definitions, these are passed @i{via} the @code{arguments} field
1758(@pxref{Defining Packages}). They are typically keyword arguments
1759(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
1760Guile Reference Manual}). The value of these arguments is usually
1761evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
1762by the daemon (@pxref{Derivations}).
1763
1764The main build system is @var{gnu-build-system}, which implements the
1765standard build procedure for GNU packages and many other packages. It
1766is provided by the @code{(guix build-system gnu)} module.
1767
1768@defvr {Scheme Variable} gnu-build-system
1769@var{gnu-build-system} represents the GNU Build System, and variants
1770thereof (@pxref{Configuration, configuration and makefile conventions,,
1771standards, GNU Coding Standards}).
1772
1773@cindex build phases
1774In a nutshell, packages using it configured, built, and installed with
1775the usual @code{./configure && make && make check && make install}
1776command sequence. In practice, a few additional steps are often needed.
1777All these steps are split up in separate @dfn{phases},
1778notably@footnote{Please see the @code{(guix build gnu-build-system)}
1779modules for more details about the build phases.}:
1780
1781@table @code
1782@item unpack
1783Unpack the source tarball, and change the current directory to the
1784extracted source tree. If the source is actually a directory, copy it
1785to the build tree, and enter that directory.
1786
1787@item patch-source-shebangs
1788Patch shebangs encountered in source files so they refer to the right
1789store file names. For instance, this changes @code{#!/bin/sh} to
1790@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
1791
1792@item configure
1793Run the @file{configure} script with a number of default options, such
1794as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
1795by the @code{#:configure-flags} argument.
1796
1797@item build
1798Run @code{make} with the list of flags specified with
1799@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
1800(the default), build with @code{make -j}.
1801
1802@item check
1803Run @code{make check}, or some other target specified with
1804@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
1805@code{#:parallel-tests?} argument is true (the default), run @code{make
1806check -j}.
1807
1808@item install
1809Run @code{make install} with the flags listed in @code{#:make-flags}.
1810
1811@item patch-shebangs
1812Patch shebangs on the installed executable files.
1813
1814@item strip
1815Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
1816is false), copying them to the @code{debug} output when available
1817(@pxref{Installing Debugging Files}).
1818@end table
1819
1820@vindex %standard-phases
1821The build-side module @code{(guix build gnu-build-system)} defines
1822@var{%standard-phases} as the default list of build phases.
1823@var{%standard-phases} is a list of symbol/procedure pairs, where the
1824procedure implements the actual phase.
1825
1826The list of phases used for a particular package can be changed with the
1827@code{#:phases} parameter. For instance, passing:
1828
1829@example
1830#:phases (alist-delete 'configure %standard-phases)
1831@end example
1832
9bf404e9 1833means that all the phases described above will be used, except the
7458bd0a
LC
1834@code{configure} phase.
1835
1836In addition, this build system ensures that the ``standard'' environment
1837for GNU packages is available. This includes tools such as GCC, libc,
1838Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
1839build-system gnu)} module for a complete list.) We call these the
1840@dfn{implicit inputs} of a package, because package definitions don't
1841have to mention them.
1842@end defvr
1843
1844Other @code{<build-system>} objects are defined to support other
1845conventions and tools used by free software packages. They inherit most
1846of @var{gnu-build-system}, and differ mainly in the set of inputs
1847implicitly added to the build process, and in the list of phases
1848executed. Some of these build systems are listed below.
1849
1850@defvr {Scheme Variable} cmake-build-system
1851This variable is exported by @code{(guix build-system cmake)}. It
1852implements the build procedure for packages using the
1853@url{http://www.cmake.org, CMake build tool}.
1854
1855It automatically adds the @code{cmake} package to the set of inputs.
1856Which package is used can be specified with the @code{#:cmake}
1857parameter.
9849cfc1
LC
1858
1859The @code{#:configure-flags} parameter is taken as a list of flags
1860passed to the @command{cmake} command. The @code{#:build-type}
1861parameter specifies in abstract terms the flags passed to the compiler;
1862it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
1863debugging information''), which roughly means that code is compiled with
1864@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
1865@end defvr
1866
3afcf52b
FB
1867@defvr {Scheme Variable} glib-or-gtk-build-system
1868This variable is exported by @code{(guix build-system glib-or-gtk)}. It
1869is intended for use with packages making use of GLib or GTK+.
1870
1871This build system adds the following two phases to the ones defined by
1872@var{gnu-build-system}:
1873
1874@table @code
1875@item glib-or-gtk-wrap
1876The phase @code{glib-or-gtk-wrap} ensures that programs found under
1877@file{bin/} are able to find GLib's ``schemas'' and
1878@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
1879modules}. This is achieved by wrapping the programs in launch scripts
1880that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
1881environment variables.
1882
73aa8ddb
LC
1883It is possible to exclude specific package outputs from that wrapping
1884process by listing their names in the
1885@code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
1886when an output is known not to contain any GLib or GTK+ binaries, and
1887where wrapping would gratuitously add a dependency of that output on
1888GLib and GTK+.
1889
3afcf52b
FB
1890@item glib-or-gtk-compile-schemas
1891The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
1892@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
1893GSettings schemas} are compiled. Compilation is performed by the
1894@command{glib-compile-schemas} program. It is provided by the package
1895@code{glib:bin} which is automatically imported by the build system.
1896The @code{glib} package providing @command{glib-compile-schemas} can be
1897specified with the @code{#:glib} parameter.
1898@end table
1899
1900Both phases are executed after the @code{install} phase.
1901@end defvr
1902
7458bd0a
LC
1903@defvr {Scheme Variable} python-build-system
1904This variable is exported by @code{(guix build-system python)}. It
1905implements the more or less standard build procedure used by Python
1906packages, which consists in running @code{python setup.py build} and
1907then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
1908
1909For packages that install stand-alone Python programs under @code{bin/},
1910it takes care of wrapping these programs so their @code{PYTHONPATH}
1911environment variable points to all the Python libraries they depend on.
1912
1913Which Python package is used can be specified with the @code{#:python}
1914parameter.
1915@end defvr
1916
1917@defvr {Scheme Variable} perl-build-system
1918This variable is exported by @code{(guix build-system perl)}. It
2d2a53fc
EB
1919implements the standard build procedure for Perl packages, which either
1920consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
1921followed by @code{Build} and @code{Build install}; or in running
1922@code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
1923@code{make} and @code{make install}; depending on which of
1924@code{Build.PL} or @code{Makefile.PL} is present in the package
1925distribution. Preference is given to the former if both @code{Build.PL}
1926and @code{Makefile.PL} exist in the package distribution. This
1927preference can be reversed by specifying @code{#t} for the
1928@code{#:make-maker?} parameter.
1929
1930The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
1931passes flags specified by the @code{#:make-maker-flags} or
1932@code{#:module-build-flags} parameter, respectively.
7458bd0a
LC
1933
1934Which Perl package is used can be specified with @code{#:perl}.
1935@end defvr
1936
c08f9818
DT
1937@defvr {Scheme Variable} ruby-build-system
1938This variable is exported by @code{(guix build-system ruby)}. It
1939implements the RubyGems build procedure used by Ruby packages, which
1940involves running @code{gem build} followed by @code{gem install}.
1941
1942Which Ruby package is used can be specified with the @code{#:ruby}
1943parameter.
1944@end defvr
7458bd0a 1945
a677c726
RW
1946@defvr {Scheme Variable} waf-build-system
1947This variable is exported by @code{(guix build-system waf)}. It
1948implements a build procedure around the @code{waf} script. The common
1949phases---@code{configure}, @code{build}, and @code{install}---are
1950implemented by passing their names as arguments to the @code{waf}
1951script.
1952
1953The @code{waf} script is executed by the Python interpreter. Which
1954Python package is used to run the script can be specified with the
1955@code{#:python} parameter.
1956@end defvr
1957
14dfdf2e
FB
1958@defvr {Scheme Variable} haskell-build-system
1959This variable is exported by @code{(guix build-system haskell)}. It
1960implements the Cabal build procedure used by Haskell packages, which
1961involves running @code{runhaskell Setup.hs configure
1962--prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
1963Instead of installing the package by running @code{runhaskell Setup.hs
1964install}, to avoid trying to register libraries in the read-only
1965compiler store directory, the build system uses @code{runhaskell
1966Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
1967addition, the build system generates the package documentation by
1968running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
1969is passed. Optional Haddock parameters can be passed with the help of
1970the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
1971not found, the build system looks for @code{Setup.lhs} instead.
1972
1973Which Haskell compiler is used can be specified with the @code{#:haskell}
1974parameter which defaults to @code{ghc}.
1975@end defvr
1976
7458bd0a
LC
1977Lastly, for packages that do not need anything as sophisticated, a
1978``trivial'' build system is provided. It is trivial in the sense that
1979it provides basically no support: it does not pull any implicit inputs,
1980and does not have a notion of build phases.
1981
1982@defvr {Scheme Variable} trivial-build-system
1983This variable is exported by @code{(guix build-system trivial)}.
1984
1985This build system requires a @code{#:builder} argument. This argument
1986must be a Scheme expression that builds the package's output(s)---as
1987with @code{build-expression->derivation} (@pxref{Derivations,
1988@code{build-expression->derivation}}).
1989@end defvr
1990
568717fd
LC
1991@node The Store
1992@section The Store
1993
e531ac2a
LC
1994@cindex store
1995@cindex store paths
1996
1997Conceptually, the @dfn{store} is where derivations that have been
834129e0 1998successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a
LC
1999Sub-directories in the store are referred to as @dfn{store paths}. The
2000store has an associated database that contains information such has the
2001store paths referred to by each store path, and the list of @emph{valid}
2002store paths---paths that result from a successful build.
2003
2004The store is always accessed by the daemon on behalf of its clients
2005(@pxref{Invoking guix-daemon}). To manipulate the store, clients
2006connect to the daemon over a Unix-domain socket, send it requests, and
2007read the result---these are remote procedure calls, or RPCs.
2008
2009The @code{(guix store)} module provides procedures to connect to the
2010daemon, and to perform RPCs. These are described below.
2011
2012@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
2013Connect to the daemon over the Unix-domain socket at @var{file}. When
2014@var{reserve-space?} is true, instruct it to reserve a little bit of
2015extra space on the file system so that the garbage collector can still
2016operate, should the disk become full. Return a server object.
2017
2018@var{file} defaults to @var{%default-socket-path}, which is the normal
2019location given the options that were passed to @command{configure}.
2020@end deffn
2021
2022@deffn {Scheme Procedure} close-connection @var{server}
2023Close the connection to @var{server}.
2024@end deffn
2025
2026@defvr {Scheme Variable} current-build-output-port
2027This variable is bound to a SRFI-39 parameter, which refers to the port
2028where build and error logs sent by the daemon should be written.
2029@end defvr
2030
2031Procedures that make RPCs all take a server object as their first
2032argument.
2033
2034@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
2035Return @code{#t} when @var{path} is a valid store path.
2036@end deffn
2037
cfbf9160 2038@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
2039Add @var{text} under file @var{name} in the store, and return its store
2040path. @var{references} is the list of store paths referred to by the
2041resulting store path.
2042@end deffn
2043
874e6874 2044@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
2045Build @var{derivations} (a list of @code{<derivation>} objects or
2046derivation paths), and return when the worker is done building them.
2047Return @code{#t} on success.
874e6874
LC
2048@end deffn
2049
b860f382
LC
2050Note that the @code{(guix monads)} module provides a monad as well as
2051monadic versions of the above procedures, with the goal of making it
2052more convenient to work with code that accesses the store (@pxref{The
2053Store Monad}).
2054
e531ac2a
LC
2055@c FIXME
2056@i{This section is currently incomplete.}
568717fd
LC
2057
2058@node Derivations
2059@section Derivations
2060
874e6874
LC
2061@cindex derivations
2062Low-level build actions and the environment in which they are performed
2063are represented by @dfn{derivations}. A derivation contain the
2064following pieces of information:
2065
2066@itemize
2067@item
2068The outputs of the derivation---derivations produce at least one file or
2069directory in the store, but may produce more.
2070
2071@item
2072The inputs of the derivations, which may be other derivations or plain
2073files in the store (patches, build scripts, etc.)
2074
2075@item
2076The system type targeted by the derivation---e.g., @code{x86_64-linux}.
2077
2078@item
2079The file name of a build script in the store, along with the arguments
2080to be passed.
2081
2082@item
2083A list of environment variables to be defined.
2084
2085@end itemize
2086
2087@cindex derivation path
2088Derivations allow clients of the daemon to communicate build actions to
2089the store. They exist in two forms: as an in-memory representation,
2090both on the client- and daemon-side, and as files in the store whose
2091name end in @code{.drv}---these files are referred to as @dfn{derivation
2092paths}. Derivations paths can be passed to the @code{build-derivations}
2093procedure to perform the build actions they prescribe (@pxref{The
2094Store}).
2095
2096The @code{(guix derivations)} module provides a representation of
2097derivations as Scheme objects, along with procedures to create and
2098otherwise manipulate derivations. The lowest-level primitive to create
2099a derivation is the @code{derivation} procedure:
2100
1909431c
LC
2101@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
2102 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 2103 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 2104 [#:system (%current-system)] [#:references-graphs #f] @
b53be755 2105 [#:allowed-references #f] [#:local-build? #f]
59688fc4
LC
2106Build a derivation with the given arguments, and return the resulting
2107@code{<derivation>} object.
874e6874 2108
2096ef47 2109When @var{hash} and @var{hash-algo} are given, a
874e6874 2110@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
2111known in advance, such as a file download. If, in addition,
2112@var{recursive?} is true, then that fixed output may be an executable
2113file or a directory and @var{hash} must be the hash of an archive
2114containing this output.
5b0c9d16 2115
858e9282 2116When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
2117name/store path pairs. In that case, the reference graph of each store
2118path is exported in the build environment in the corresponding file, in
2119a simple text format.
1909431c 2120
b53be755
LC
2121When @var{allowed-references} is true, it must be a list of store items
2122or outputs that the derivation's output may refer to.
2123
1909431c
LC
2124When @var{local-build?} is true, declare that the derivation is not a
2125good candidate for offloading and should rather be built locally
2126(@pxref{Daemon Offload Setup}). This is the case for small derivations
2127where the costs of data transfers would outweigh the benefits.
874e6874
LC
2128@end deffn
2129
2130@noindent
2131Here's an example with a shell script as its builder, assuming
2132@var{store} is an open connection to the daemon, and @var{bash} points
2133to a Bash executable in the store:
2134
2135@lisp
2136(use-modules (guix utils)
2137 (guix store)
2138 (guix derivations))
2139
59688fc4
LC
2140(let ((builder ; add the Bash script to the store
2141 (add-text-to-store store "my-builder.sh"
2142 "echo hello world > $out\n" '())))
2143 (derivation store "foo"
2144 bash `("-e" ,builder)
21b679f6 2145 #:inputs `((,bash) (,builder))
59688fc4 2146 #:env-vars '(("HOME" . "/homeless"))))
834129e0 2147@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
2148@end lisp
2149
21b679f6
LC
2150As can be guessed, this primitive is cumbersome to use directly. A
2151better approach is to write build scripts in Scheme, of course! The
2152best course of action for that is to write the build code as a
2153``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 2154information, @pxref{G-Expressions}.
21b679f6
LC
2155
2156Once upon a time, @code{gexp->derivation} did not exist and constructing
2157derivations with build code written in Scheme was achieved with
2158@code{build-expression->derivation}, documented below. This procedure
2159is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 2160
dd1a5a15
LC
2161@deffn {Scheme Procedure} build-expression->derivation @var{store} @
2162 @var{name} @var{exp} @
2163 [#:system (%current-system)] [#:inputs '()] @
2164 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 2165 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824
LC
2166 [#:references-graphs #f] [#:allowed-references #f] @
2167 [#:local-build? #f] [#:guile-for-build #f]
874e6874
LC
2168Return a derivation that executes Scheme expression @var{exp} as a
2169builder for derivation @var{name}. @var{inputs} must be a list of
2170@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
2171@code{"out"} is assumed. @var{modules} is a list of names of Guile
2172modules from the current search path to be copied in the store,
2173compiled, and made available in the load path during the execution of
2174@var{exp}---e.g., @code{((guix build utils) (guix build
2175gnu-build-system))}.
2176
2177@var{exp} is evaluated in an environment where @code{%outputs} is bound
2178to a list of output/path pairs, and where @code{%build-inputs} is bound
2179to a list of string/output-path pairs made from @var{inputs}.
2180Optionally, @var{env-vars} is a list of string pairs specifying the name
2181and value of environment variables visible to the builder. The builder
2182terminates by passing the result of @var{exp} to @code{exit}; thus, when
2183@var{exp} returns @code{#f}, the build is considered to have failed.
2184
2185@var{exp} is built using @var{guile-for-build} (a derivation). When
2186@var{guile-for-build} is omitted or is @code{#f}, the value of the
2187@code{%guile-for-build} fluid is used instead.
9c629a27 2188
63a42824
LC
2189See the @code{derivation} procedure for the meaning of
2190@var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
874e6874
LC
2191@end deffn
2192
2193@noindent
2194Here's an example of a single-output derivation that creates a directory
2195containing one file:
2196
2197@lisp
2198(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 2199 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
2200 (call-with-output-file (string-append out "/test")
2201 (lambda (p)
2202 (display '(hello guix) p))))))
dd1a5a15 2203 (build-expression->derivation store "goo" builder))
874e6874 2204
834129e0 2205@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
2206@end lisp
2207
568717fd 2208
b860f382
LC
2209@node The Store Monad
2210@section The Store Monad
2211
2212@cindex monad
2213
2214The procedures that operate on the store described in the previous
2215sections all take an open connection to the build daemon as their first
2216argument. Although the underlying model is functional, they either have
2217side effects or depend on the current state of the store.
2218
2219The former is inconvenient: the connection to the build daemon has to be
2220carried around in all those functions, making it impossible to compose
2221functions that do not take that parameter with functions that do. The
2222latter can be problematic: since store operations have side effects
2223and/or depend on external state, they have to be properly sequenced.
2224
2225@cindex monadic values
2226@cindex monadic functions
2227This is where the @code{(guix monads)} module comes in. This module
2228provides a framework for working with @dfn{monads}, and a particularly
2229useful monad for our uses, the @dfn{store monad}. Monads are a
2230construct that allows two things: associating ``context'' with values
2231(in our case, the context is the store), and building sequences of
561fb6c3 2232computations (here computations include accesses to the store.) Values
b860f382
LC
2233in a monad---values that carry this additional context---are called
2234@dfn{monadic values}; procedures that return such values are called
2235@dfn{monadic procedures}.
2236
2237Consider this ``normal'' procedure:
2238
2239@example
45adbd62
LC
2240(define (sh-symlink store)
2241 ;; Return a derivation that symlinks the 'bash' executable.
2242 (let* ((drv (package-derivation store bash))
2243 (out (derivation->output-path drv))
2244 (sh (string-append out "/bin/bash")))
2245 (build-expression->derivation store "sh"
2246 `(symlink ,sh %output))))
b860f382
LC
2247@end example
2248
2249Using @code{(guix monads)}, it may be rewritten as a monadic function:
2250
ada3df03 2251@c FIXME: Find a better example, one that uses 'mlet'.
b860f382 2252@example
45adbd62 2253(define (sh-symlink)
b860f382 2254 ;; Same, but return a monadic value.
ada3df03
LC
2255 (gexp->derivation "sh"
2256 #~(symlink (string-append #$bash "/bin/bash") #$output)))
b860f382
LC
2257@end example
2258
2259There are two things to note in the second version: the @code{store}
2260parameter is now implicit, and the monadic value returned by
2261@code{package-file}---a wrapper around @code{package-derivation} and
2262@code{derivation->output-path}---is @dfn{bound} using @code{mlet}
2263instead of plain @code{let}.
2264
2265Calling the monadic @code{profile.sh} has no effect. To get the desired
2266effect, one must use @code{run-with-store}:
2267
2268@example
2269(run-with-store (open-connection) (profile.sh))
834129e0 2270@result{} /gnu/store/...-profile.sh
b860f382
LC
2271@end example
2272
b9b86078
LC
2273Note that the @code{(guix monad-repl)} module extends Guile's REPL with
2274new ``meta-commands'' to make it easier to deal with monadic procedures:
2275@code{run-in-store}, and @code{enter-store-monad}. The former, is used
2276to ``run'' a single monadic value through the store:
2277
2278@example
2279scheme@@(guile-user)> ,run-in-store (package->derivation hello)
2280$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2281@end example
2282
2283The latter enters a recursive REPL, where all the return values are
2284automatically run through the store:
2285
2286@example
2287scheme@@(guile-user)> ,enter-store-monad
2288store-monad@@(guile-user) [1]> (package->derivation hello)
2289$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2290store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
2291$3 = "/gnu/store/@dots{}-foo"
2292store-monad@@(guile-user) [1]> ,q
2293scheme@@(guile-user)>
2294@end example
2295
2296@noindent
2297Note that non-monadic values cannot be returned in the
2298@code{store-monad} REPL.
2299
e87f0591
LC
2300The main syntactic forms to deal with monads in general are provided by
2301the @code{(guix monads)} module and are described below.
b860f382
LC
2302
2303@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
2304Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
2305in @var{monad}.
2306@end deffn
2307
2308@deffn {Scheme Syntax} return @var{val}
2309Return a monadic value that encapsulates @var{val}.
2310@end deffn
2311
2312@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
2313@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
2314procedure @var{mproc}@footnote{This operation is commonly referred to as
2315``bind'', but that name denotes an unrelated procedure in Guile. Thus
2316we use this somewhat cryptic symbol inherited from the Haskell
2317language.}.
2318@end deffn
2319
2320@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
2321 @var{body} ...
2322@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
2323 @var{body} ...
2324Bind the variables @var{var} to the monadic values @var{mval} in
2325@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2326``normal'' value @var{val}, as per @code{let}.
2327
2328@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2329(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2330@end deffn
2331
405a9d4e
LC
2332@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
2333Bind @var{mexp} and the following monadic expressions in sequence,
2334returning the result of the last expression.
2335
2336This is akin to @code{mlet}, except that the return values of the
2337monadic expressions are ignored. In that sense, it is analogous to
2338@code{begin}, but applied to monadic expressions.
2339@end deffn
2340
561fb6c3
LC
2341@cindex state monad
2342The @code{(guix monads)} module provides the @dfn{state monad}, which
2343allows an additional value---the state---to be @emph{threaded} through
2344monadic procedure calls.
2345
2346@defvr {Scheme Variable} %state-monad
2347The state monad. Procedures in the state monad can access and change
2348the state that is threaded.
2349
2350Consider the example below. The @code{square} procedure returns a value
2351in the state monad. It returns the square of its argument, but also
2352increments the current state value:
2353
2354@example
2355(define (square x)
2356 (mlet %state-monad ((count (current-state)))
2357 (mbegin %state-monad
2358 (set-current-state (+ 1 count))
2359 (return (* x x)))))
2360
2361(run-with-state (sequence %state-monad (map square (iota 3))) 0)
2362@result{} (0 1 4)
2363@result{} 3
2364@end example
2365
2366When ``run'' through @var{%state-monad}, we obtain that additional state
2367value, which is the number of @code{square} calls.
2368@end defvr
2369
2370@deffn {Monadic Procedure} current-state
2371Return the current state as a monadic value.
2372@end deffn
2373
2374@deffn {Monadic Procedure} set-current-state @var{value}
2375Set the current state to @var{value} and return the previous state as a
2376monadic value.
2377@end deffn
2378
2379@deffn {Monadic Procedure} state-push @var{value}
2380Push @var{value} to the current state, which is assumed to be a list,
2381and return the previous state as a monadic value.
2382@end deffn
2383
2384@deffn {Monadic Procedure} state-pop
2385Pop a value from the current state and return it as a monadic value.
2386The state is assumed to be a list.
2387@end deffn
2388
2389@deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
2390Run monadic value @var{mval} starting with @var{state} as the initial
2391state. Return two values: the resulting value, and the resulting state.
2392@end deffn
2393
e87f0591
LC
2394The main interface to the store monad, provided by the @code{(guix
2395store)} module, is as follows.
b860f382
LC
2396
2397@defvr {Scheme Variable} %store-monad
561fb6c3
LC
2398The store monad---an alias for @var{%state-monad}.
2399
2400Values in the store monad encapsulate accesses to the store. When its
2401effect is needed, a value of the store monad must be ``evaluated'' by
2402passing it to the @code{run-with-store} procedure (see below.)
b860f382
LC
2403@end defvr
2404
2405@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2406Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2407open store connection.
2408@end deffn
2409
ad372953 2410@deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
b860f382 2411Return as a monadic value the absolute file name in the store of the file
ad372953
LC
2412containing @var{text}, a string. @var{references} is a list of store items that the
2413resulting text file refers to; it defaults to the empty list.
45adbd62
LC
2414@end deffn
2415
0a90af15
LC
2416@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2417 [#:recursive? #t]
2418Return the name of @var{file} once interned in the store. Use
2419@var{name} as its store name, or the basename of @var{file} if
2420@var{name} is omitted.
2421
2422When @var{recursive?} is true, the contents of @var{file} are added
2423recursively; if @var{file} designates a flat file and @var{recursive?}
2424is true, its contents are added, and its permission bits are kept.
2425
2426The example below adds a file to the store, under two different names:
2427
2428@example
2429(run-with-store (open-connection)
2430 (mlet %store-monad ((a (interned-file "README"))
2431 (b (interned-file "README" "LEGU-MIN")))
2432 (return (list a b))))
2433
2434@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2435@end example
2436
2437@end deffn
2438
e87f0591
LC
2439The @code{(guix packages)} module exports the following package-related
2440monadic procedures:
2441
b860f382 2442@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
2443 [#:system (%current-system)] [#:target #f] @
2444 [#:output "out"] Return as a monadic
b860f382
LC
2445value in the absolute file name of @var{file} within the @var{output}
2446directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
2447of the @var{output} directory of @var{package}. When @var{target} is
2448true, use it as a cross-compilation target triplet.
b860f382
LC
2449@end deffn
2450
b860f382 2451@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
2452@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2453 @var{target} [@var{system}]
2454Monadic version of @code{package-derivation} and
2455@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
2456@end deffn
2457
2458
21b679f6
LC
2459@node G-Expressions
2460@section G-Expressions
2461
2462@cindex G-expression
2463@cindex build code quoting
2464So we have ``derivations'', which represent a sequence of build actions
2465to be performed to produce an item in the store (@pxref{Derivations}).
2466Those build actions are performed when asking the daemon to actually
2467build the derivations; they are run by the daemon in a container
2468(@pxref{Invoking guix-daemon}).
2469
2470@cindex strata of code
2471It should come as no surprise that we like to write those build actions
2472in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2473code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
2474Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2475Kiselyov, who has written insightful
2476@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2477on this topic}, refers to this kind of code generation as
2478@dfn{staging}.}: the ``host code''---code that defines packages, talks
2479to the daemon, etc.---and the ``build code''---code that actually
2480performs build actions, such as making directories, invoking
2481@command{make}, etc.
21b679f6
LC
2482
2483To describe a derivation and its build actions, one typically needs to
2484embed build code inside host code. It boils down to manipulating build
2485code as data, and Scheme's homoiconicity---code has a direct
2486representation as data---comes in handy for that. But we need more than
2487Scheme's normal @code{quasiquote} mechanism to construct build
2488expressions.
2489
2490The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2491S-expressions adapted to build expressions. G-expressions, or
2492@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2493@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2494@code{#$}, and @code{#$@@}), which are comparable respectively to
2495@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2496(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2497Reference Manual}). However, there are major differences:
2498
2499@itemize
2500@item
2501Gexps are meant to be written to a file and run or manipulated by other
2502processes.
2503
2504@item
b39fc6f7
LC
2505When a high-level object such as a package or derivation is unquoted
2506inside a gexp, the result is as if its output file name had been
2507introduced.
ff40e9b7 2508
21b679f6
LC
2509@item
2510Gexps carry information about the packages or derivations they refer to,
2511and these dependencies are automatically added as inputs to the build
2512processes that use them.
2513@end itemize
2514
b39fc6f7
LC
2515Actually this mechanism is not limited to package and derivation
2516objects; @dfn{compilers} able to ``lower'' other high-level objects to
2517derivations can be defined, such that these objects can also be inserted
d9ae938f
LC
2518into gexps. Another useful type of high-level object that can be
2519inserted in a gexp is @dfn{local files}, which allows files from the
2520local file system to be added to the store and referred to by
2521derivations and such (see @code{local-file} below.)
b39fc6f7 2522
21b679f6
LC
2523To illustrate the idea, here is an example of a gexp:
2524
2525@example
2526(define build-exp
2527 #~(begin
2528 (mkdir #$output)
2529 (chdir #$output)
aff8ce7c 2530 (symlink (string-append #$coreutils "/bin/ls")
21b679f6
LC
2531 "list-files")))
2532@end example
2533
2534This gexp can be passed to @code{gexp->derivation}; we obtain a
2535derivation that builds a directory containing exactly one symlink to
2536@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2537
2538@example
2539(gexp->derivation "the-thing" build-exp)
2540@end example
2541
e20fd1bf 2542As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
2543substituted to the reference to the @var{coreutils} package in the
2544actual build code, and @var{coreutils} is automatically made an input to
2545the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2546output)}) is replaced by a string containing the derivation's output
667b2508
LC
2547directory name.
2548
2549@cindex cross compilation
2550In a cross-compilation context, it is useful to distinguish between
2551references to the @emph{native} build of a package---that can run on the
2552host---versus references to cross builds of a package. To that end, the
2553@code{#+} plays the same role as @code{#$}, but is a reference to a
2554native package build:
2555
2556@example
2557(gexp->derivation "vi"
2558 #~(begin
2559 (mkdir #$output)
2560 (system* (string-append #+coreutils "/bin/ln")
2561 "-s"
2562 (string-append #$emacs "/bin/emacs")
2563 (string-append #$output "/bin/vi")))
2564 #:target "mips64el-linux")
2565@end example
2566
2567@noindent
2568In the example above, the native build of @var{coreutils} is used, so
2569that @command{ln} can actually run on the host; but then the
2570cross-compiled build of @var{emacs} is referenced.
2571
2572The syntactic form to construct gexps is summarized below.
21b679f6
LC
2573
2574@deffn {Scheme Syntax} #~@var{exp}
2575@deffnx {Scheme Syntax} (gexp @var{exp})
2576Return a G-expression containing @var{exp}. @var{exp} may contain one
2577or more of the following forms:
2578
2579@table @code
2580@item #$@var{obj}
2581@itemx (ungexp @var{obj})
b39fc6f7
LC
2582Introduce a reference to @var{obj}. @var{obj} may have one of the
2583supported types, for example a package or a
21b679f6
LC
2584derivation, in which case the @code{ungexp} form is replaced by its
2585output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2586
b39fc6f7
LC
2587If @var{obj} is a list, it is traversed and references to supported
2588objects are substituted similarly.
21b679f6
LC
2589
2590If @var{obj} is another gexp, its contents are inserted and its
2591dependencies are added to those of the containing gexp.
2592
2593If @var{obj} is another kind of object, it is inserted as is.
2594
b39fc6f7
LC
2595@item #$@var{obj}:@var{output}
2596@itemx (ungexp @var{obj} @var{output})
21b679f6 2597This is like the form above, but referring explicitly to the
b39fc6f7
LC
2598@var{output} of @var{obj}---this is useful when @var{obj} produces
2599multiple outputs (@pxref{Packages with Multiple Outputs}).
21b679f6 2600
667b2508
LC
2601@item #+@var{obj}
2602@itemx #+@var{obj}:output
2603@itemx (ungexp-native @var{obj})
2604@itemx (ungexp-native @var{obj} @var{output})
2605Same as @code{ungexp}, but produces a reference to the @emph{native}
2606build of @var{obj} when used in a cross compilation context.
2607
21b679f6
LC
2608@item #$output[:@var{output}]
2609@itemx (ungexp output [@var{output}])
2610Insert a reference to derivation output @var{output}, or to the main
2611output when @var{output} is omitted.
2612
2613This only makes sense for gexps passed to @code{gexp->derivation}.
2614
2615@item #$@@@var{lst}
2616@itemx (ungexp-splicing @var{lst})
2617Like the above, but splices the contents of @var{lst} inside the
2618containing list.
2619
667b2508
LC
2620@item #+@@@var{lst}
2621@itemx (ungexp-native-splicing @var{lst})
2622Like the above, but refers to native builds of the objects listed in
2623@var{lst}.
2624
21b679f6
LC
2625@end table
2626
2627G-expressions created by @code{gexp} or @code{#~} are run-time objects
2628of the @code{gexp?} type (see below.)
2629@end deffn
2630
2631@deffn {Scheme Procedure} gexp? @var{obj}
2632Return @code{#t} if @var{obj} is a G-expression.
2633@end deffn
2634
2635G-expressions are meant to be written to disk, either as code building
2636some derivation, or as plain files in the store. The monadic procedures
2637below allow you to do that (@pxref{The Store Monad}, for more
2638information about monads.)
2639
2640@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
ce45eb4c 2641 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
21b679f6
LC
2642 [#:hash #f] [#:hash-algo #f] @
2643 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 2644 [#:module-path @var{%load-path}] @
c8351d9a
LC
2645 [#:references-graphs #f] [#:allowed-references #f] @
2646 [#:local-build? #f] [#:guile-for-build #f]
21b679f6 2647Return a derivation @var{name} that runs @var{exp} (a gexp) with
68a61e9f
LC
2648@var{guile-for-build} (a derivation) on @var{system}. When @var{target}
2649is true, it is used as the cross-compilation target triplet for packages
2650referred to by @var{exp}.
21b679f6 2651
ce45eb4c
LC
2652Make @var{modules} available in the evaluation context of @var{exp};
2653@var{modules} is a list of names of Guile modules searched in
2654@var{module-path} to be copied in the store, compiled, and made available in
21b679f6
LC
2655the load path during the execution of @var{exp}---e.g., @code{((guix
2656build utils) (guix build gnu-build-system))}.
2657
ce45eb4c
LC
2658@var{graft?} determines whether packages referred to by @var{exp} should be grafted when
2659applicable.
2660
b53833b2
LC
2661When @var{references-graphs} is true, it must be a list of tuples of one of the
2662following forms:
2663
2664@example
2665(@var{file-name} @var{package})
2666(@var{file-name} @var{package} @var{output})
2667(@var{file-name} @var{derivation})
2668(@var{file-name} @var{derivation} @var{output})
2669(@var{file-name} @var{store-item})
2670@end example
2671
2672The right-hand-side of each element of @var{references-graphs} is automatically made
2673an input of the build process of @var{exp}. In the build environment, each
2674@var{file-name} contains the reference graph of the corresponding item, in a simple
2675text format.
2676
c8351d9a
LC
2677@var{allowed-references} must be either @code{#f} or a list of output names and packages.
2678In the latter case, the list denotes store items that the result is allowed to
2679refer to. Any reference to another store item will lead to a build error.
2680
e20fd1bf 2681The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
2682@end deffn
2683
d9ae938f
LC
2684@deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
2685 [#:recursive? #t]
2686Return an object representing local file @var{file} to add to the store; this
2687object can be used in a gexp. @var{file} will be added to the store under @var{name}--by
2688default the base name of @var{file}.
2689
2690When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
2691designates a flat file and @var{recursive?} is true, its contents are added, and its
2692permission bits are kept.
2693
2694This is the declarative counterpart of the @code{interned-file} monadic
2695procedure (@pxref{The Store Monad, @code{interned-file}}).
2696@end deffn
2697
21b679f6
LC
2698@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
2699Return an executable script @var{name} that runs @var{exp} using
2700@var{guile} with @var{modules} in its search path.
2701
2702The example below builds a script that simply invokes the @command{ls}
2703command:
2704
2705@example
2706(use-modules (guix gexp) (gnu packages base))
2707
2708(gexp->script "list-files"
2709 #~(execl (string-append #$coreutils "/bin/ls")
2710 "ls"))
2711@end example
2712
2713When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 2714@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
2715executable file @file{/gnu/store/@dots{}-list-files} along these lines:
2716
2717@example
2718#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
2719!#
2720(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
2721 "ls")
2722@end example
2723@end deffn
2724
2725@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
2726Return a derivation that builds a file @var{name} containing @var{exp}.
2727
2728The resulting file holds references to all the dependencies of @var{exp}
2729or a subset thereof.
2730@end deffn
1ed19464
LC
2731
2732@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
2733Return as a monadic value a derivation that builds a text file
2734containing all of @var{text}. @var{text} may list, in addition to
d9ae938f
LC
2735strings, objects of any type that can be used in a gexp: packages,
2736derivations, local file objects, etc. The resulting store file holds
2737references to all these.
1ed19464
LC
2738
2739This variant should be preferred over @code{text-file} anytime the file
2740to create will reference items from the store. This is typically the
2741case when building a configuration file that embeds store file names,
2742like this:
2743
2744@example
2745(define (profile.sh)
2746 ;; Return the name of a shell script in the store that
2747 ;; initializes the 'PATH' environment variable.
2748 (text-file* "profile.sh"
2749 "export PATH=" coreutils "/bin:"
2750 grep "/bin:" sed "/bin\n"))
2751@end example
2752
2753In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
2754will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
2755preventing them from being garbage-collected during its lifetime.
2756@end deffn
21b679f6
LC
2757
2758Of course, in addition to gexps embedded in ``host'' code, there are
2759also modules containing build tools. To make it clear that they are
2760meant to be used in the build stratum, these modules are kept in the
2761@code{(guix build @dots{})} name space.
2762
2763
568717fd
LC
2764@c *********************************************************************
2765@node Utilities
2766@chapter Utilities
2767
210cc920
LC
2768This section describes tools primarily targeted at developers and users
2769who write new package definitions. They complement the Scheme
2770programming interface of Guix in a convenient way.
2771
568717fd 2772@menu
37166310 2773* Invoking guix build:: Building packages from the command line.
210cc920 2774* Invoking guix download:: Downloading a file and printing its hash.
37166310 2775* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 2776* Invoking guix import:: Importing package definitions.
37166310 2777* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 2778* Invoking guix lint:: Finding errors in package definitions.
372c4bbc 2779* Invoking guix environment:: Setting up development environments.
aff8ce7c 2780* Invoking guix publish:: Sharing substitutes.
568717fd
LC
2781@end menu
2782
e49951eb
MW
2783@node Invoking guix build
2784@section Invoking @command{guix build}
568717fd 2785
e49951eb 2786The @command{guix build} command builds packages or derivations and
6798a8e4
LC
2787their dependencies, and prints the resulting store paths. Note that it
2788does not modify the user's profile---this is the job of the
e49951eb 2789@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
2790it is mainly useful for distribution developers.
2791
2792The general syntax is:
c78bd12b
LC
2793
2794@example
e49951eb 2795guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
2796@end example
2797
2798@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
2799the software distribution such as @code{coreutils} or
2800@code{coreutils-8.20}, or a derivation such as
834129e0 2801@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
2802package with the corresponding name (and optionally version) is searched
2803for among the GNU distribution modules (@pxref{Package Modules}).
2804
2805Alternatively, the @code{--expression} option may be used to specify a
2806Scheme expression that evaluates to a package; this is useful when
2807disambiguation among several same-named packages or package variants is
2808needed.
c78bd12b
LC
2809
2810The @var{options} may be zero or more of the following:
2811
2812@table @code
2813
2814@item --expression=@var{expr}
2815@itemx -e @var{expr}
ac5de156 2816Build the package or derivation @var{expr} evaluates to.
c78bd12b 2817
5401dd75 2818For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
2819guile-1.8)}, which unambiguously designates this specific variant of
2820version 1.8 of Guile.
2821
56b82106
LC
2822Alternately, @var{expr} may be a G-expression, in which case it is used
2823as a build program passed to @code{gexp->derivation}
2824(@pxref{G-Expressions}).
2825
2826Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
2827(@pxref{The Store Monad}). The procedure must return a derivation as a
2828monadic value, which is then passed through @code{run-with-store}.
2829
c78bd12b
LC
2830@item --source
2831@itemx -S
2832Build the packages' source derivations, rather than the packages
2833themselves.
2834
e49951eb 2835For instance, @code{guix build -S gcc} returns something like
834129e0 2836@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 2837
f9cc8971
LC
2838The returned source tarball is the result of applying any patches and
2839code snippets specified in the package's @code{origin} (@pxref{Defining
2840Packages}).
2841
c78bd12b
LC
2842@item --system=@var{system}
2843@itemx -s @var{system}
2844Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
2845the host's system type.
2846
2847An example use of this is on Linux-based systems, which can emulate
2848different personalities. For instance, passing
2849@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
2850to build packages in a complete 32-bit environment.
2851
e55ec43d
LC
2852@item --target=@var{triplet}
2853@cindex cross-compilation
2854Cross-build for @var{triplet}, which must be a valid GNU triplet, such
2855as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
2856configuration triplets,, configure, GNU Configure and Build System}).
2857
7f3673f2
LC
2858@item --with-source=@var{source}
2859Use @var{source} as the source of the corresponding package.
2860@var{source} must be a file name or a URL, as for @command{guix
2861download} (@pxref{Invoking guix download}).
2862
2863The ``corresponding package'' is taken to be one specified on the
2864command line whose name matches the base of @var{source}---e.g., if
2865@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
2866package is @code{guile}. Likewise, the version string is inferred from
2867@var{source}; in the previous example, it's @code{2.0.10}.
2868
2869This option allows users to try out versions of packages other than the
2870one provided by the distribution. The example below downloads
2871@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
2872the @code{ed} package:
2873
2874@example
2875guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
2876@end example
2877
2878As a developer, @code{--with-source} makes it easy to test release
2879candidates:
2880
2881@example
2882guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
2883@end example
2884
05962f29
LC
2885@item --no-grafts
2886Do not ``graft'' packages. In practice, this means that package updates
2887available as grafts are not applied. @xref{Security Updates}, for more
2888information on grafts.
7f3673f2 2889
c78bd12b
LC
2890@item --derivations
2891@itemx -d
2892Return the derivation paths, not the output paths, of the given
2893packages.
2894
70ee5642
LC
2895@item --root=@var{file}
2896@itemx -r @var{file}
2897Make @var{file} a symlink to the result, and register it as a garbage
2898collector root.
2899
2900@item --log-file
2901Return the build log file names for the given
2902@var{package-or-derivation}s, or raise an error if build logs are
2903missing.
2904
2905This works regardless of how packages or derivations are specified. For
2906instance, the following invocations are equivalent:
2907
2908@example
2909guix build --log-file `guix build -d guile`
2910guix build --log-file `guix build guile`
2911guix build --log-file guile
2912guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
2913@end example
2914
2915
2916@end table
2917
2918@cindex common build options
2919In addition, a number of options that control the build process are
2920common to @command{guix build} and other commands that can spawn builds,
2921such as @command{guix package} or @command{guix archive}. These are the
2922following:
2923
2924@table @code
2925
300868ba
LC
2926@item --load-path=@var{directory}
2927@itemx -L @var{directory}
2928Add @var{directory} to the front of the package module search path
2929(@pxref{Package Modules}).
2930
2931This allows users to define their own packages and make them visible to
2932the command-line tools.
2933
c78bd12b
LC
2934@item --keep-failed
2935@itemx -K
2936Keep the build tree of failed builds. Thus, if a build fail, its build
2937tree is kept under @file{/tmp}, in a directory whose name is shown at
2938the end of the build log. This is useful when debugging build issues.
2939
2940@item --dry-run
2941@itemx -n
2942Do not build the derivations.
2943
56b1f4b7
LC
2944@item --fallback
2945When substituting a pre-built binary fails, fall back to building
2946packages locally.
2947
c78bd12b 2948@item --no-substitutes
b5385b52 2949Do not use substitutes for build products. That is, always build things
c4202d60
LC
2950locally instead of allowing downloads of pre-built binaries
2951(@pxref{Substitutes}).
c78bd12b 2952
425b0bfc 2953@item --no-build-hook
4ec2e92d
LC
2954Do not attempt to offload builds @i{via} the daemon's ``build hook''
2955(@pxref{Daemon Offload Setup}). That is, always build things locally
2956instead of offloading builds to remote machines.
425b0bfc 2957
969e678e
LC
2958@item --max-silent-time=@var{seconds}
2959When the build or substitution process remains silent for more than
2960@var{seconds}, terminate it and report a build failure.
2961
002622b6
LC
2962@item --timeout=@var{seconds}
2963Likewise, when the build or substitution process lasts for more than
2964@var{seconds}, terminate it and report a build failure.
2965
2966By default there is no timeout. This behavior can be restored with
2967@code{--timeout=0}.
2968
07ab4bf1
LC
2969@item --verbosity=@var{level}
2970Use the given verbosity level. @var{level} must be an integer between 0
2971and 5; higher means more verbose output. Setting a level of 4 or more
2972may be helpful when debugging setup issues with the build daemon.
2973
70ee5642
LC
2974@item --cores=@var{n}
2975@itemx -c @var{n}
2976Allow the use of up to @var{n} CPU cores for the build. The special
2977value @code{0} means to use as many CPU cores as available.
bf421152 2978
f6526eb3
LC
2979@item --max-jobs=@var{n}
2980@itemx -M @var{n}
2981Allow at most @var{n} build jobs in parallel. @xref{Invoking
2982guix-daemon, @code{--max-jobs}}, for details about this option and the
2983equivalent @command{guix-daemon} option.
2984
c78bd12b
LC
2985@end table
2986
e49951eb 2987Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
2988the @code{package-derivation} procedure of the @code{(guix packages)}
2989module, and to the @code{build-derivations} procedure of the @code{(guix
01d8ac64 2990derivations)} module.
c78bd12b 2991
16eb115e
DP
2992In addition to options explicitly passed on the command line,
2993@command{guix build} and other @command{guix} commands that support
2994building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
2995
2996@defvr {Environment Variable} GUIX_BUILD_OPTIONS
2997Users can define this variable to a list of command line options that
2998will automatically be used by @command{guix build} and other
2999@command{guix} commands that can perform builds, as in the example
3000below:
3001
3002@example
3003$ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
3004@end example
3005
847391fe
DP
3006These options are parsed independently, and the result is appended to
3007the parsed command-line options.
16eb115e
DP
3008@end defvr
3009
3010
210cc920
LC
3011@node Invoking guix download
3012@section Invoking @command{guix download}
3013
3014When writing a package definition, developers typically need to download
3015the package's source tarball, compute its SHA256 hash, and write that
3016hash in the package definition (@pxref{Defining Packages}). The
3017@command{guix download} tool helps with this task: it downloads a file
3018from the given URI, adds it to the store, and prints both its file name
3019in the store and its SHA256 hash.
3020
3021The fact that the downloaded file is added to the store saves bandwidth:
3022when the developer eventually tries to build the newly defined package
3023with @command{guix build}, the source tarball will not have to be
3024downloaded again because it is already in the store. It is also a
3025convenient way to temporarily stash files, which may be deleted
3026eventually (@pxref{Invoking guix gc}).
3027
3028The @command{guix download} command supports the same URIs as used in
3029package definitions. In particular, it supports @code{mirror://} URIs.
3030@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
3031Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
3032they are not available, an error is raised. @xref{Guile Preparations,
3033how to install the GnuTLS bindings for Guile,, gnutls-guile,
3034GnuTLS-Guile}, for more information.
210cc920
LC
3035
3036The following option is available:
3037
3038@table @code
3039@item --format=@var{fmt}
3040@itemx -f @var{fmt}
3041Write the hash in the format specified by @var{fmt}. For more
081145cf 3042information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
3043@end table
3044
6c365eca
NK
3045@node Invoking guix hash
3046@section Invoking @command{guix hash}
3047
210cc920 3048The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
3049It is primarily a convenience tool for anyone contributing to the
3050distribution: it computes the cryptographic hash of a file, which can be
3051used in the definition of a package (@pxref{Defining Packages}).
3052
3053The general syntax is:
3054
3055@example
3056guix hash @var{option} @var{file}
3057@end example
3058
3059@command{guix hash} has the following option:
3060
3061@table @code
3062
3063@item --format=@var{fmt}
3064@itemx -f @var{fmt}
210cc920 3065Write the hash in the format specified by @var{fmt}.
6c365eca
NK
3066
3067Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
3068(@code{hex} and @code{hexadecimal} can be used as well).
3069
3070If the @option{--format} option is not specified, @command{guix hash}
3071will output the hash in @code{nix-base32}. This representation is used
3072in the definitions of packages.
3073
3140f2df
LC
3074@item --recursive
3075@itemx -r
3076Compute the hash on @var{file} recursively.
3077
3078In this case, the hash is computed on an archive containing @var{file},
3079including its children if it is a directory. Some of @var{file}'s
3080meta-data is part of the archive; for instance, when @var{file} is a
3081regular file, the hash is different depending on whether @var{file} is
3082executable or not. Meta-data such as time stamps has no impact on the
3083hash (@pxref{Invoking guix archive}).
3084@c FIXME: Replace xref above with xref to an ``Archive'' section when
3085@c it exists.
3086
6c365eca
NK
3087@end table
3088
2f7d2d91
LC
3089@node Invoking guix import
3090@section Invoking @command{guix import}
3091
3092@cindex importing packages
3093@cindex package import
3094@cindex package conversion
3095The @command{guix import} command is useful for people willing to add a
3096package to the distribution but who'd rather do as little work as
3097possible to get there---a legitimate demand. The command knows of a few
3098repositories from which it can ``import'' package meta-data. The result
3099is a package definition, or a template thereof, in the format we know
3100(@pxref{Defining Packages}).
3101
3102The general syntax is:
3103
3104@example
3105guix import @var{importer} @var{options}@dots{}
3106@end example
3107
3108@var{importer} specifies the source from which to import package
3109meta-data, and @var{options} specifies a package identifier and other
3110options specific to @var{importer}. Currently, the available
3111``importers'' are:
3112
3113@table @code
3114@item gnu
3115Import meta-data for the given GNU package. This provides a template
3116for the latest version of that GNU package, including the hash of its
3117source tarball, and its canonical synopsis and description.
3118
3119Additional information such as the package's dependencies and its
3120license needs to be figured out manually.
3121
3122For example, the following command returns a package definition for
3123GNU@tie{}Hello:
3124
3125@example
3126guix import gnu hello
3127@end example
3128
3129Specific command-line options are:
3130
3131@table @code
3132@item --key-download=@var{policy}
3133As for @code{guix refresh}, specify the policy to handle missing OpenPGP
3134keys when verifying the package's signature. @xref{Invoking guix
3135refresh, @code{--key-download}}.
3136@end table
3137
3138@item pypi
3139@cindex pypi
3140Import meta-data from the @uref{https://pypi.python.org/, Python Package
3141Index}@footnote{This functionality requires Guile-JSON to be installed.
3142@xref{Requirements}.}. Information is taken from the JSON-formatted
3143description available at @code{pypi.python.org} and usually includes all
3144the relevant information, including package dependencies.
3145
3146The command below imports meta-data for the @code{itsdangerous} Python
3147package:
3148
3149@example
3150guix import pypi itsdangerous
3151@end example
3152
d45dc6da
EB
3153@item cpan
3154@cindex CPAN
3155Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}.
3156Information is taken from the JSON-formatted meta-data provided through
3157@uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
66392e47
EB
3158relevant information, such as module dependencies. License information
3159should be checked closely. If Perl is available in the store, then the
3160@code{corelist} utility will be used to filter core modules out of the
3161list of dependencies.
d45dc6da
EB
3162
3163The command command below imports meta-data for the @code{Acme::Boolean}
3164Perl module:
3165
3166@example
3167guix import cpan Acme::Boolean
3168@end example
3169
2f7d2d91
LC
3170@item nix
3171Import meta-data from a local copy of the source of the
3172@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
3173relies on the @command{nix-instantiate} command of
3174@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
3175typically written in a mixture of Nix-language and Bash code. This
3176command only imports the high-level package structure that is written in
3177the Nix language. It normally includes all the basic fields of a
3178package definition.
3179
3180When importing a GNU package, the synopsis and descriptions are replaced
3181by their canonical upstream variant.
3182
3183As an example, the command below imports the package definition of
3184LibreOffice (more precisely, it imports the definition of the package
3185bound to the @code{libreoffice} top-level attribute):
3186
3187@example
3188guix import nix ~/path/to/nixpkgs libreoffice
3189@end example
3190@end table
3191
3192The structure of the @command{guix import} code is modular. It would be
3193useful to have more importers for other package formats, and your help
3194is welcome here (@pxref{Contributing}).
3195
37166310
LC
3196@node Invoking guix refresh
3197@section Invoking @command{guix refresh}
3198
3199The primary audience of the @command{guix refresh} command is developers
3200of the GNU software distribution. By default, it reports any packages
3201provided by the distribution that are outdated compared to the latest
3202upstream version, like this:
3203
3204@example
3205$ guix refresh
3206gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
3207gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
3208@end example
3209
3210It does so by browsing each package's FTP directory and determining the
3211highest version number of the source tarballs
3212therein@footnote{Currently, this only works for GNU packages.}.
3213
3214When passed @code{--update}, it modifies distribution source files to
3215update the version numbers and source tarball hashes of those packages'
3216recipes (@pxref{Defining Packages}). This is achieved by downloading
3217each package's latest source tarball and its associated OpenPGP
3218signature, authenticating the downloaded tarball against its signature
3219using @command{gpg}, and finally computing its hash. When the public
3220key used to sign the tarball is missing from the user's keyring, an
3221attempt is made to automatically retrieve it from a public key server;
3222when it's successful, the key is added to the user's keyring; otherwise,
3223@command{guix refresh} reports an error.
3224
3225The following options are supported:
3226
3227@table @code
3228
3229@item --update
3230@itemx -u
3231Update distribution source files (package recipes) in place.
081145cf 3232@xref{Defining Packages}, for more information on package definitions.
37166310
LC
3233
3234@item --select=[@var{subset}]
3235@itemx -s @var{subset}
3236Select all the packages in @var{subset}, one of @code{core} or
3237@code{non-core}.
3238
3239The @code{core} subset refers to all the packages at the core of the
3240distribution---i.e., packages that are used to build ``everything
3241else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
3242changing one of these packages in the distribution entails a rebuild of
3243all the others. Thus, such updates are an inconvenience to users in
3244terms of build time or bandwidth used to achieve the upgrade.
3245
3246The @code{non-core} subset refers to the remaining packages. It is
3247typically useful in cases where an update of the core packages would be
3248inconvenient.
3249
3250@end table
3251
3252In addition, @command{guix refresh} can be passed one or more package
3253names, as in this example:
3254
3255@example
3256guix refresh -u emacs idutils
3257@end example
3258
3259@noindent
3260The command above specifically updates the @code{emacs} and
3261@code{idutils} packages. The @code{--select} option would have no
3262effect in this case.
3263
7d193ec3
EB
3264When considering whether to upgrade a package, it is sometimes
3265convenient to know which packages would be affected by the upgrade and
3266should be checked for compatibility. For this the following option may
3267be used when passing @command{guix refresh} one or more package names:
3268
3269@table @code
3270
3271@item --list-dependent
3272@itemx -l
3273List top-level dependent packages that would need to be rebuilt as a
3274result of upgrading one or more packages.
3275
3276@end table
3277
3278Be aware that the @code{--list-dependent} option only
3279@emph{approximates} the rebuilds that would be required as a result of
3280an upgrade. More rebuilds might be required under some circumstances.
3281
3282@example
7779ab61
LC
3283$ guix refresh --list-dependent flex
3284Building the following 120 packages would ensure 213 dependent packages are rebuilt:
3285hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
3286@end example
3287
3288The command above lists a set of packages that could be built to check
3289for compatibility with an upgraded @code{flex} package.
3290
f9230085
LC
3291The following options can be used to customize GnuPG operation:
3292
3293@table @code
3294
f9230085
LC
3295@item --gpg=@var{command}
3296Use @var{command} as the GnuPG 2.x command. @var{command} is searched
3297for in @code{$PATH}.
3298
2bc53ba9
LC
3299@item --key-download=@var{policy}
3300Handle missing OpenPGP keys according to @var{policy}, which may be one
3301of:
3302
3303@table @code
3304@item always
3305Always download missing OpenPGP keys from the key server, and add them
3306to the user's GnuPG keyring.
3307
3308@item never
3309Never try to download missing OpenPGP keys. Instead just bail out.
3310
3311@item interactive
3312When a package signed with an unknown OpenPGP key is encountered, ask
3313the user whether to download it or not. This is the default behavior.
3314@end table
3315
3316@item --key-server=@var{host}
3317Use @var{host} as the OpenPGP key server when importing a public key.
3318
f9230085
LC
3319@end table
3320
b4f5e0e8
CR
3321@node Invoking guix lint
3322@section Invoking @command{guix lint}
3323The @command{guix lint} is meant to help package developers avoid common
873c4085
LC
3324errors and use a consistent style. It runs a number of checks on a
3325given set of packages in order to find common mistakes in their
3326definitions. Available @dfn{checkers} include (see
3327@code{--list-checkers} for a complete list):
3328
3329@table @code
3330@item synopsis
3331@itemx description
3332Validate certain typographical and stylistic rules about package
3333descriptions and synopses.
3334
3335@item inputs-should-be-native
3336Identify inputs that should most likely be native inputs.
3337
3338@item source
3339@itemx home-page
3340Probe @code{home-page} and @code{source} URLs and report those that are
3341invalid.
3342@end table
b4f5e0e8
CR
3343
3344The general syntax is:
3345
3346@example
3347guix lint @var{options} @var{package}@dots{}
3348@end example
3349
3350If no package is given on the command line, then all packages are checked.
3351The @var{options} may be zero or more of the following:
3352
3353@table @code
3354
dd7c013d
CR
3355@item --checkers
3356@itemx -c
3357Only enable the checkers specified in a comma-separated list using the
3358names returned by @code{--list-checkers}.
3359
b4f5e0e8
CR
3360@item --list-checkers
3361@itemx -l
3362List and describe all the available checkers that will be run on packages
3363and exit.
3364
3365@end table
37166310 3366
372c4bbc
DT
3367@node Invoking guix environment
3368@section Invoking @command{guix environment}
3369
f5fd4fd2 3370@cindex reproducible build environments
372c4bbc
DT
3371The purpose of @command{guix environment} is to assist hackers in
3372creating reproducible development environments without polluting their
3373package profile. The @command{guix environment} tool takes one or more
3374packages, builds all of the necessary inputs, and creates a shell
3375environment to use them.
3376
3377The general syntax is:
3378
3379@example
3380guix environment @var{options} @var{package}@dots{}
3381@end example
3382
3383The following examples spawns a new shell that is capable of building
3384the GNU Guile source code:
3385
3386@example
3387guix environment guile
3388@end example
3389
3390If the specified packages are not built yet, @command{guix environment}
3391automatically builds them. The new shell's environment is an augmented
3392version of the environment that @command{guix environment} was run in.
3393It contains the necessary search paths for building the given package
3394added to the existing environment variables. To create a ``pure''
3395environment in which the original environment variables have been unset,
3396use the @code{--pure} option.
3397
3398Additionally, more than one package may be specified, in which case the
3399union of the inputs for the given packages are used. For example, the
3400command below spawns a shell where all of the dependencies of both Guile
3401and Emacs are available:
3402
3403@example
3404guix environment guile emacs
3405@end example
3406
3407Sometimes an interactive shell session is not desired. The
3408@code{--exec} option can be used to specify the command to run instead.
3409
3410@example
3411guix environment guile --exec=make
3412@end example
3413
3414The following options are available:
3415
3416@table @code
3417@item --expression=@var{expr}
3418@itemx -e @var{expr}
3419Create an environment for the package that @var{expr} evaluates to.
3420
3421@item --load=@var{file}
3422@itemx -l @var{file}
3423Create an environment for the package that the code within @var{file}
3424evaluates to.
3425
3426@item --exec=@var{command}
3427@item -E @var{command}
3428Execute @var{command} in the new environment.
3429
3430@item --pure
3431Unset existing environment variables when building the new environment.
3432This has the effect of creating an environment in which search paths
3433only contain package inputs.
3434
3435@item --search-paths
3436Display the environment variable definitions that make up the
3437environment.
3438@end table
3439
3440It also supports all of the common build options that @command{guix
3441build} supports (@pxref{Invoking guix build, common build options}).
3442
aff8ce7c
DT
3443@node Invoking guix publish
3444@section Invoking @command{guix publish}
3445
3446The purpose of @command{guix publish} is to enable users to easily share
3447their store with others. When @command{guix publish} runs, it spawns an
3448HTTP server which allows anyone with network access to obtain
3449substitutes from it. This means that any machine running Guix can also
3450act as if it were a build farm, since the HTTP interface is
3451Hydra-compatible.
3452
3453For security, each substitute is signed, allowing recipients to check
3454their authenticity and integrity (@pxref{Substitutes}). Because
3455@command{guix publish} uses the system's signing key, which is only
3456readable by the system administrator, it must run as root.
3457
3458The general syntax is:
3459
3460@example
3461guix publish @var{options}@dots{}
3462@end example
3463
3464Running @command{guix publish} without any additional arguments will
3465spawn an HTTP server on port 8080:
3466
3467@example
3468guix publish
3469@end example
3470
3471Once a publishing server has been authorized (@pxref{Invoking guix
3472archive}), the daemon may download substitutes from it:
3473
3474@example
3475guix-daemon --substitute-urls=http://example.org:8080
3476@end example
3477
3478The following options are available:
3479
3480@table @code
3481@item --port=@var{port}
3482@itemx -p @var{port}
3483Listen for HTTP requests on @var{port}.
3484
3485@item --repl[=@var{port}]
3486@itemx -r [@var{port}]
3487Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
3488Reference Manual}) on @var{port} (37146 by default).
3489@end table
3490
a1ba8475
LC
3491@c *********************************************************************
3492@node GNU Distribution
3493@chapter GNU Distribution
3494
3ca2731c
LC
3495@cindex Guix System Distribution
3496@cindex GSD
3497Guix comes with a distribution of the GNU system consisting entirely of
3498free software@footnote{The term ``free'' here refers to the
a1ba8475 3499@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
3ca2731c 3500users of that software}.}. The
35ed9306
LC
3501distribution can be installed on its own (@pxref{System Installation}),
3502but it is also possible to install Guix as a package manager on top of
3503an installed GNU/Linux system (@pxref{Installation}). To distinguish
3ca2731c
LC
3504between the two, we refer to the standalone distribution as the Guix
3505System Distribution, or GNU@tie{}GSD.
35ed9306
LC
3506
3507The distribution provides core GNU packages such as GNU libc, GCC, and
3508Binutils, as well as many GNU and non-GNU applications. The complete
3509list of available packages can be browsed
d03bb653
LC
3510@url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
3511running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
3512
3513@example
e49951eb 3514guix package --list-available
a1ba8475
LC
3515@end example
3516
35ed9306 3517Our goal has been to provide a practical 100% free software distribution of
401c53c4
LC
3518Linux-based and other variants of GNU, with a focus on the promotion and
3519tight integration of GNU components, and an emphasis on programs and
3520tools that help users exert that freedom.
3521
3ca2731c 3522Packages are currently available on the following platforms:
c320011d
LC
3523
3524@table @code
3525
3526@item x86_64-linux
3527Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
3528
3529@item i686-linux
3530Intel 32-bit architecture (IA32), Linux-Libre kernel;
3531
aa1e1947
MW
3532@item armhf-linux
3533ARMv7-A architecture with hard float, Thumb-2 and VFP3D16 coprocessor,
3534using the EABI hard-float ABI, and Linux-Libre kernel.
3535
c320011d
LC
3536@item mips64el-linux
3537little-endian 64-bit MIPS processors, specifically the Loongson series,
3538n32 application binary interface (ABI), and Linux-Libre kernel.
3539
3540@end table
3541
3ca2731c
LC
3542GSD itself is currently only available on @code{i686} and @code{x86_64}.
3543
c320011d
LC
3544@noindent
3545For information on porting to other architectures or kernels,
3546@xref{Porting}.
3547
401c53c4 3548@menu
5af6de3e 3549* System Installation:: Installing the whole operating system.
35ed9306 3550* System Configuration:: Configuring the operating system.
91ef73d4 3551* Installing Debugging Files:: Feeding the debugger.
05962f29 3552* Security Updates:: Deploying security fixes quickly.
401c53c4 3553* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 3554* Packaging Guidelines:: Growing the distribution.
401c53c4 3555* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 3556* Porting:: Targeting another platform or kernel.
401c53c4
LC
3557@end menu
3558
3559Building this distribution is a cooperative effort, and you are invited
081145cf 3560to join! @xref{Contributing}, for information about how you can help.
401c53c4 3561
5af6de3e
LC
3562@node System Installation
3563@section System Installation
3564
3ca2731c
LC
3565@cindex Guix System Distribution
3566This section explains how to install the Guix System Distribution
3567on a machine. The Guix package manager can
35ed9306
LC
3568also be installed on top of a running GNU/Linux system,
3569@pxref{Installation}.
5af6de3e
LC
3570
3571@ifinfo
3572@c This paragraph is for people reading this from tty2 of the
3573@c installation image.
3574You're reading this documentation with an Info reader. For details on
3575how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 3576link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
3577@kbd{l} afterwards to come back here.
3578@end ifinfo
3579
8aaaae38
LC
3580@subsection Limitations
3581
3ca2731c
LC
3582As of version @value{VERSION}, the Guix System Distribution (GSD) is
3583not production-ready. It may contain bugs and lack important
8aaaae38
LC
3584features. Thus, if you are looking for a stable production system that
3585respects your freedom as a computer user, a good solution at this point
3586is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
3587more established GNU/Linux distributions}. We hope you can soon switch
3ca2731c 3588to the GSD without fear, of course. In the meantime, you can
8aaaae38
LC
3589also keep using your distribution and try out the package manager on top
3590of it (@pxref{Installation}).
3591
3592Before you proceed with the installation, be aware of the following
3593noteworthy limitations applicable to version @value{VERSION}:
3594
3595@itemize
3596@item
3597The installation process does not include a graphical user interface and
3598requires familiarity with GNU/Linux (see the following subsections to
3599get a feel of what that means.)
3600
3601@item
b1e95eca
LC
3602The system does not yet provide GNOME and KDE; it provides Xfce, though,
3603if graphical desktop environments are your thing.
8aaaae38
LC
3604
3605@item
dbcb0ab1 3606Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
3607
3608@item
3609Few system services are currently supported out-of-the-box
3610(@pxref{Services}).
3611
3612@item
b1e95eca 3613On the order of 1,200 packages are available, which means that you may
8aaaae38
LC
3614occasionally find that a useful package is missing.
3615@end itemize
3616
3617You've been warned. But more than a disclaimer, this is an invitation
3618to report issues (and success stories!), and join us in improving it.
3619@xref{Contributing}, for more info.
5af6de3e
LC
3620
3621@subsection USB Stick Installation
3622
3623An installation image for USB sticks can be downloaded from
ab3872de 3624@code{ftp://alpha.gnu.org/gnu/guix/gsd-usb-install-@value{VERSION}.@var{system}.xz},
5af6de3e
LC
3625where @var{system} is one of:
3626
3627@table @code
3628@item x86_64-linux
3629for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
3630
3631@item i686-linux
3632for a 32-bit GNU/Linux system on Intel-compatible CPUs.
3633@end table
3634
3635This image contains a single partition with the tools necessary for an
3636installation. It is meant to be copied @emph{as is} to a large-enough
3637USB stick.
3638
3639To copy the image to a USB stick, follow these steps:
3640
3641@enumerate
3642@item
3643Decompress the image using the @command{xz} command:
3644
3645@example
3a5d914b 3646xz -d gsd-usb-install-@value{VERSION}.@var{system}.xz
5af6de3e
LC
3647@end example
3648
3649@item
3650Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
3651its device name. Assuming that USB stick is known as @file{/dev/sdX},
3652copy the image with:
3653
3654@example
3a5d914b 3655dd if=gsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
3656@end example
3657
3658Access to @file{/dev/sdX} usually requires root privileges.
3659@end enumerate
3660
3661Once this is done, you should be able to reboot the system and boot from
3662the USB stick. The latter usually requires you to get in the BIOS' boot
3663menu, where you can choose to boot from the USB stick.
3664
3665@subsection Preparing for Installation
3666
3667Once you have successfully booted the image on the USB stick, you should
3668end up with a root prompt. Several console TTYs are configured and can
3669be used to run commands as root. TTY2 shows this documentation,
3670browsable using the Info reader commands (@pxref{Help,,, info, Info: An
3671Introduction}).
3672
3673To install the system, you would:
3674
3675@enumerate
3676
3677@item
95c559c1 3678Configure the network, by running @command{dhclient eno1} (to get an
5af6de3e 3679automatically assigned IP address from the wired network interface
95c559c1
LC
3680controller@footnote{
3681@c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
3682The name @code{eno1} is for the first on-board Ethernet controller. The
3683interface name for an Ethernet controller that is in the first slot of
3684the first PCI bus, for instance, would be @code{enp1s0}. Use
3685@command{ifconfig -a} to list all the available network interfaces.}),
3686or using the @command{ifconfig} command.
5af6de3e
LC
3687
3688The system automatically loads drivers for your network interface
3689controllers.
3690
3691Setting up network access is almost always a requirement because the
3692image does not contain all the software and tools that may be needed.
3693
3694@item
3695Unless this has already been done, you must partition and format the
3696target partitions.
3697
7ab44369
LC
3698Preferably, assign partitions a label so that you can easily and
3699reliably refer to them in @code{file-system} declarations (@pxref{File
3700Systems}). This is typically done using the @code{-L} option of
3701@command{mkfs.ext4} and related commands.
3702
5af6de3e 3703The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
3704Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
3705encryption, and e2fsprogs, the suite of tools to manipulate
3706ext2/ext3/ext4 file systems.
5af6de3e 3707
83a17b62
LC
3708@item
3709Once that is done, mount the target root partition under @file{/mnt}.
3710
3711@item
3712Lastly, run @code{deco start cow-store /mnt}.
3713
3714This will make @file{/gnu/store} copy-on-write, such that packages added
3715to it during the installation phase will be written to the target disk
3716rather than kept in memory.
3717
5af6de3e
LC
3718@end enumerate
3719
5af6de3e
LC
3720
3721@subsection Proceeding with the Installation
3722
3723With the target partitions ready, you now have to edit a file and
3724provide the declaration of the operating system to be installed. To
3725that end, the installation system comes with two text editors: GNU nano
3726(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
3727It is better to store that file on the target root file system, say, as
3728@file{/mnt/etc/config.scm}.
3729
3730A minimal operating system configuration, with just the bare minimum and
1dac8566
LC
3731only a root account would look like this (on the installation system,
3732this example is available as @file{/etc/configuration-template.scm}):
5af6de3e
LC
3733
3734@example
931c132a 3735@include os-config.texi
5af6de3e
LC
3736@end example
3737
3738@noindent
3739For more information on @code{operating-system} declarations,
6621cdb6 3740@pxref{Using the Configuration System}.
5af6de3e
LC
3741
3742Once that is done, the new system must be initialized (remember that the
3743target root file system is mounted under @file{/mnt}):
3744
3745@example
3746guix system init /mnt/etc/config.scm /mnt
3747@end example
3748
3749@noindent
3750This will copy all the necessary files, and install GRUB on
3751@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 3752more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
3753downloads or builds of missing packages, which can take some time.
3754
3755Once that command has completed---and hopefully succeeded!---you can
ad14d9e7 3756run @command{reboot} and boot into the new system. Cross fingers, and
5af6de3e
LC
3757join us on @code{#guix} on the Freenode IRC network or on
3758@file{guix-devel@@gnu.org} to share your experience---good or not so
3759good.
3760
3761@subsection Building the Installation Image
3762
3763The installation image described above was built using the @command{guix
3764system} command, specifically:
3765
3766@example
8a225c66 3767guix system disk-image --image-size=850MiB gnu/system/install.scm
5af6de3e
LC
3768@end example
3769
3770@xref{Invoking guix system}, for more information. See
3771@file{gnu/system/install.scm} in the source tree for more information
3772about the installation image.
3773
cf4a9129
LC
3774@node System Configuration
3775@section System Configuration
b208a005 3776
cf4a9129 3777@cindex system configuration
3ca2731c 3778The Guix System Distribution supports a consistent whole-system configuration
cf4a9129
LC
3779mechanism. By that we mean that all aspects of the global system
3780configuration---such as the available system services, timezone and
3781locale settings, user accounts---are declared in a single place. Such
3782a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 3783
cf4a9129
LC
3784One of the advantages of putting all the system configuration under the
3785control of Guix is that it supports transactional system upgrades, and
3786makes it possible to roll-back to a previous system instantiation,
3787should something go wrong with the new one (@pxref{Features}). Another
3788one is that it makes it easy to replicate the exact same configuration
3789across different machines, or at different points in time, without
3790having to resort to additional administration tools layered on top of
3791the system's own tools.
3792@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 3793
cf4a9129
LC
3794This section describes this mechanism. First we focus on the system
3795administrator's viewpoint---explaining how the system is configured and
3796instantiated. Then we show how this mechanism can be extended, for
3797instance to support new system services.
91ef73d4 3798
cf4a9129
LC
3799@menu
3800* Using the Configuration System:: Customizing your GNU system.
7313a52e 3801* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 3802* File Systems:: Configuring file system mounts.
510f9d86 3803* Mapped Devices:: Block device extra processing.
cf4a9129 3804* User Accounts:: Specifying user accounts.
598e19dc 3805* Locales:: Language and cultural convention settings.
cf4a9129 3806* Services:: Specifying system services.
0ae8c15a 3807* Setuid Programs:: Programs running with root privileges.
996ed739 3808* Name Service Switch:: Configuring libc's name service switch.
fd1b1fa2 3809* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 3810* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
3811* Invoking guix system:: Instantiating a system configuration.
3812* Defining Services:: Adding new service definitions.
3813@end menu
91ef73d4 3814
cf4a9129
LC
3815@node Using the Configuration System
3816@subsection Using the Configuration System
64d76fa6 3817
cf4a9129
LC
3818The operating system is configured by providing an
3819@code{operating-system} declaration in a file that can then be passed to
3820the @command{guix system} command (@pxref{Invoking guix system}). A
3821simple setup, with the default system services, the default Linux-Libre
3822kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 3823
cf4a9129
LC
3824@findex operating-system
3825@lisp
3826(use-modules (gnu) ; for 'user-account', '%base-services', etc.
3827 (gnu packages emacs) ; for 'emacs'
3828 (gnu services ssh)) ; for 'lsh-service'
91ef73d4 3829
cf4a9129
LC
3830(operating-system
3831 (host-name "komputilo")
3832 (timezone "Europe/Paris")
598e19dc 3833 (locale "fr_FR.utf8")
cf4a9129
LC
3834 (bootloader (grub-configuration
3835 (device "/dev/sda")))
a69576ea 3836 (file-systems (cons (file-system
cf4a9129
LC
3837 (device "/dev/sda1") ; or partition label
3838 (mount-point "/")
a69576ea
LC
3839 (type "ext3"))
3840 %base-file-systems))
cf4a9129
LC
3841 (users (list (user-account
3842 (name "alice")
bc73aa43 3843 (group "users")
cf4a9129
LC
3844 (comment "Bob's sister")
3845 (home-directory "/home/alice"))))
3846 (packages (cons emacs %base-packages))
21cc905a 3847 (services (cons (lsh-service #:port 2222 #:root-login? #t)
cf4a9129
LC
3848 %base-services)))
3849@end lisp
401c53c4 3850
cf4a9129
LC
3851This example should be self-describing. Some of the fields defined
3852above, such as @code{host-name} and @code{bootloader}, are mandatory.
3853Others, such as @code{packages} and @code{services}, can be omitted, in
3854which case they get a default value.
e7f34eb0 3855
cf4a9129
LC
3856@vindex %base-packages
3857The @code{packages} field lists
3858packages that will be globally visible on the system, for all user
3859accounts---i.e., in every user's @code{PATH} environment variable---in
3860addition to the per-user profiles (@pxref{Invoking guix package}). The
3861@var{%base-packages} variable provides all the tools one would expect
3862for basic user and administrator tasks---including the GNU Core
3863Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
3864editor, @command{find}, @command{grep}, etc. The example above adds
3865Emacs to those, taken from the @code{(gnu packages emacs)} module
3866(@pxref{Package Modules}).
e7f34eb0 3867
cf4a9129
LC
3868@vindex %base-services
3869The @code{services} field lists @dfn{system services} to be made
3870available when the system starts (@pxref{Services}).
3871The @code{operating-system} declaration above specifies that, in
3872addition to the basic services, we want the @command{lshd} secure shell
3873daemon listening on port 2222, and allowing remote @code{root} logins
3874(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
3875@code{lsh-service} arranges so that @code{lshd} is started with the
3876right command-line options, possibly with supporting configuration files
7313a52e
LC
3877generated as needed (@pxref{Defining Services}). @xref{operating-system
3878Reference}, for details about the available @code{operating-system}
3879fields.
a1ba8475 3880
cf4a9129
LC
3881Assuming the above snippet is stored in the @file{my-system-config.scm}
3882file, the @command{guix system reconfigure my-system-config.scm} command
3883instantiates that configuration, and makes it the default GRUB boot
3884entry (@pxref{Invoking guix system}). The normal way to change the
3885system's configuration is by updating this file and re-running the
3886@command{guix system} command.
b81e1947 3887
cf4a9129
LC
3888At the Scheme level, the bulk of an @code{operating-system} declaration
3889is instantiated with the following monadic procedure (@pxref{The Store
3890Monad}):
b81e1947 3891
cf4a9129
LC
3892@deffn {Monadic Procedure} operating-system-derivation os
3893Return a derivation that builds @var{os}, an @code{operating-system}
3894object (@pxref{Derivations}).
b81e1947 3895
cf4a9129
LC
3896The output of the derivation is a single directory that refers to all
3897the packages, configuration files, and other supporting files needed to
3898instantiate @var{os}.
3899@end deffn
b81e1947 3900
7313a52e
LC
3901@node operating-system Reference
3902@subsection @code{operating-system} Reference
3903
3904This section summarizes all the options available in
3905@code{operating-system} declarations (@pxref{Using the Configuration
3906System}).
3907
3908@deftp {Data Type} operating-system
3909This is the data type representing an operating system configuration.
3910By that, we mean all the global system configuration, not per-user
3911configuration (@pxref{Using the Configuration System}).
3912
3913@table @asis
3914@item @code{kernel} (default: @var{linux-libre})
3915The package object of the operating system to use@footnote{Currently
3916only the Linux-libre kernel is supported. In the future, it will be
3917possible to use the GNU@tie{}Hurd.}.
3918
3919@item @code{bootloader}
88faf933 3920The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
3921
3922@item @code{initrd} (default: @code{base-initrd})
3923A two-argument monadic procedure that returns an initial RAM disk for
3924the Linux kernel. @xref{Initial RAM Disk}.
3925
f34c56be
LC
3926@item @code{firmware} (default: @var{%base-firmware})
3927@cindex firmware
3928List of firmware packages loadable by the operating system kernel.
3929
3930The default includes firmware needed for Atheros-based WiFi devices
3931(Linux-libre module @code{ath9k}.)
3932
7313a52e
LC
3933@item @code{host-name}
3934The host name.
3935
3936@item @code{hosts-file}
3937@cindex hosts file
3938A zero-argument monadic procedure that returns a text file for use as
3939@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
3940Reference Manual}). The default is to produce a file with entries for
3941@code{localhost} and @var{host-name}.
3942
3943@item @code{mapped-devices} (default: @code{'()})
3944A list of mapped devices. @xref{Mapped Devices}.
3945
3946@item @code{file-systems}
3947A list of file systems. @xref{File Systems}.
3948
3949@item @code{swap-devices} (default: @code{'()})
3950@cindex swap devices
3951A list of strings identifying devices to be used for ``swap space''
3952(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
3953For example, @code{'("/dev/sda3")}.
3954
3955@item @code{users} (default: @code{'()})
3956@itemx @code{groups} (default: @var{%base-groups})
3957List of user accounts and groups. @xref{User Accounts}.
3958
3959@item @code{skeletons} (default: @code{(default-skeletons)})
3960A monadic list of pairs of target file name and files. These are the
3961files that will be used as skeletons as new accounts are created.
3962
3963For instance, a valid value may look like this:
3964
3965@example
3966(mlet %store-monad ((bashrc (text-file "bashrc" "\
3967 export PATH=$HOME/.guix-profile/bin")))
3968 (return `((".bashrc" ,bashrc))))
3969@end example
3970
3971@item @code{issue} (default: @var{%default-issue})
3972A string denoting the contents of the @file{/etc/issue} file, which is
3973what displayed when users log in on a text console.
3974
3975@item @code{packages} (default: @var{%base-packages})
3976The set of packages installed in the global profile, which is accessible
3977at @file{/run/current-system/profile}.
3978
3979The default set includes core utilities, but it is good practice to
3980install non-core utilities in user profiles (@pxref{Invoking guix
3981package}).
3982
3983@item @code{timezone}
3984A timezone identifying string---e.g., @code{"Europe/Paris"}.
3985
598e19dc
LC
3986@item @code{locale} (default: @code{"en_US.utf8"})
3987The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
3988Library Reference Manual}). @xref{Locales}, for more information.
3989
3990@item @code{locale-definitions} (default: @var{%default-locale-definitions})
3991The list of locale definitions to be compiled and that may be used at
3992run time. @xref{Locales}.
7313a52e 3993
996ed739
LC
3994@item @code{name-service-switch} (default: @var{%default-nss})
3995Configuration of libc's name service switch (NSS)---a
3996@code{<name-service-switch>} object. @xref{Name Service Switch}, for
3997details.
3998
7313a52e
LC
3999@item @code{services} (default: @var{%base-services})
4000A list of monadic values denoting system services. @xref{Services}.
4001
4002@item @code{pam-services} (default: @code{(base-pam-services)})
4003@cindex PAM
4004@cindex pluggable authentication modules
4005Linux @dfn{pluggable authentication module} (PAM) services.
4006@c FIXME: Add xref to PAM services section.
4007
4008@item @code{setuid-programs} (default: @var{%setuid-programs})
4009List of string-valued G-expressions denoting setuid programs.
4010@xref{Setuid Programs}.
4011
4012@item @code{sudoers} (default: @var{%sudoers-specification})
4013@cindex sudoers
4014The contents of the @file{/etc/sudoers} file as a string.
4015
4016This file specifies which users can use the @command{sudo} command, what
4017they are allowed to do, and what privileges they may gain. The default
4018is that only @code{root} and members of the @code{wheel} group may use
4019@code{sudo}.
4020
4021@end table
4022@end deftp
4023
cf4a9129
LC
4024@node File Systems
4025@subsection File Systems
b81e1947 4026
cf4a9129
LC
4027The list of file systems to be mounted is specified in the
4028@code{file-systems} field of the operating system's declaration
4029(@pxref{Using the Configuration System}). Each file system is declared
4030using the @code{file-system} form, like this:
b81e1947
LC
4031
4032@example
cf4a9129
LC
4033(file-system
4034 (mount-point "/home")
4035 (device "/dev/sda3")
4036 (type "ext4"))
b81e1947
LC
4037@end example
4038
cf4a9129
LC
4039As usual, some of the fields are mandatory---those shown in the example
4040above---while others can be omitted. These are described below.
b81e1947 4041
cf4a9129
LC
4042@deftp {Data Type} file-system
4043Objects of this type represent file systems to be mounted. They
4044contain the following members:
5ff3c4b8 4045
cf4a9129
LC
4046@table @asis
4047@item @code{type}
4048This is a string specifying the type of the file system---e.g.,
4049@code{"ext4"}.
5ff3c4b8 4050
cf4a9129
LC
4051@item @code{mount-point}
4052This designates the place where the file system is to be mounted.
b81e1947 4053
cf4a9129
LC
4054@item @code{device}
4055This names the ``source'' of the file system. By default it is the name
4056of a node under @file{/dev}, but its meaning depends on the @code{title}
4057field described below.
401c53c4 4058
cf4a9129
LC
4059@item @code{title} (default: @code{'device})
4060This is a symbol that specifies how the @code{device} field is to be
4061interpreted.
401c53c4 4062
cf4a9129
LC
4063When it is the symbol @code{device}, then the @code{device} field is
4064interpreted as a file name; when it is @code{label}, then @code{device}
4065is interpreted as a partition label name; when it is @code{uuid},
4066@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 4067
cf4a9129
LC
4068The @code{label} and @code{uuid} options offer a way to refer to disk
4069partitions without having to hard-code their actual device name.
da7cabd4 4070
5f86a66e
LC
4071However, when a file system's source is a mapped device (@pxref{Mapped
4072Devices}), its @code{device} field @emph{must} refer to the mapped
4073device name---e.g., @file{/dev/mapper/root-partition}---and consequently
4074@code{title} must be set to @code{'device}. This is required so that
4075the system knows that mounting the file system depends on having the
4076corresponding device mapping established.
4077
cf4a9129
LC
4078@item @code{flags} (default: @code{'()})
4079This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
4080include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
4081access to special files), @code{no-suid} (ignore setuid and setgid
4082bits), and @code{no-exec} (disallow program execution.)
da7cabd4 4083
cf4a9129
LC
4084@item @code{options} (default: @code{#f})
4085This is either @code{#f}, or a string denoting mount options.
da7cabd4 4086
cf4a9129
LC
4087@item @code{needed-for-boot?} (default: @code{#f})
4088This Boolean value indicates whether the file system is needed when
4089booting. If that is true, then the file system is mounted when the
4090initial RAM disk (initrd) is loaded. This is always the case, for
4091instance, for the root file system.
da7cabd4 4092
cf4a9129
LC
4093@item @code{check?} (default: @code{#t})
4094This Boolean indicates whether the file system needs to be checked for
4095errors before being mounted.
f9cc8971 4096
4e469051
LC
4097@item @code{create-mount-point?} (default: @code{#f})
4098When true, the mount point is created if it does not exist yet.
4099
cf4a9129
LC
4100@end table
4101@end deftp
da7cabd4 4102
a69576ea
LC
4103The @code{(gnu system file-systems)} exports the following useful
4104variables.
4105
4106@defvr {Scheme Variable} %base-file-systems
4107These are essential file systems that are required on normal systems,
4108such as @var{%devtmpfs-file-system} (see below.) Operating system
4109declarations should always contain at least these.
4110@end defvr
4111
4112@defvr {Scheme Variable} %devtmpfs-file-system
4113The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
4114requirement for udev (@pxref{Base Services, @code{udev-service}}).
4115@end defvr
4116
7f239fd3
LC
4117@defvr {Scheme Variable} %pseudo-terminal-file-system
4118This is the file system to be mounted as @file{/dev/pts}. It supports
4119@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
4120functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
4121Manual}). Pseudo-terminals are used by terminal emulators such as
4122@command{xterm}.
4123@end defvr
4124
db17ae5c
LC
4125@defvr {Scheme Variable} %shared-memory-file-system
4126This file system is mounted as @file{/dev/shm} and is used to support
4127memory sharing across processes (@pxref{Memory-mapped I/O,
4128@code{shm_open},, libc, The GNU C Library Reference Manual}).
4129@end defvr
4130
a69576ea
LC
4131@defvr {Scheme Variable} %binary-format-file-system
4132The @code{binfmt_misc} file system, which allows handling of arbitrary
4133executable file types to be delegated to user space. This requires the
4134@code{binfmt.ko} kernel module to be loaded.
4135@end defvr
4136
4137@defvr {Scheme Variable} %fuse-control-file-system
4138The @code{fusectl} file system, which allows unprivileged users to mount
4139and unmount user-space FUSE file systems. This requires the
4140@code{fuse.ko} kernel module to be loaded.
4141@end defvr
4142
510f9d86
LC
4143@node Mapped Devices
4144@subsection Mapped Devices
4145
4146@cindex device mapping
4147@cindex mapped devices
4148The Linux kernel has a notion of @dfn{device mapping}: a block device,
4149such as a hard disk partition, can be @dfn{mapped} into another device,
4150with additional processing over the data that flows through
4151it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
4152concept of a ``mapped device'' and that of a file system: both boil down
4153to @emph{translating} input/output operations made on a file to
4154operations on its backing store. Thus, the Hurd implements mapped
4155devices, like file systems, using the generic @dfn{translator} mechanism
4156(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
4157typical example is encryption device mapping: all writes to the mapped
4158device are encrypted, and all reads are deciphered, transparently.
4159
4160Mapped devices are declared using the @code{mapped-device} form:
4161
4162@example
4163(mapped-device
4164 (source "/dev/sda3")
4165 (target "home")
4166 (type luks-device-mapping))
4167@end example
4168
4169@noindent
4170@cindex disk encryption
4171@cindex LUKS
4172This example specifies a mapping from @file{/dev/sda3} to
4173@file{/dev/mapper/home} using LUKS---the
4174@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
4175standard mechanism for disk encryption. The @file{/dev/mapper/home}
4176device can then be used as the @code{device} of a @code{file-system}
4177declaration (@pxref{File Systems}). The @code{mapped-device} form is
4178detailed below.
4179
4180@deftp {Data Type} mapped-device
4181Objects of this type represent device mappings that will be made when
4182the system boots up.
4183
9cb426b8
LC
4184@table @code
4185@item source
510f9d86
LC
4186This string specifies the name of the block device to be mapped, such as
4187@code{"/dev/sda3"}.
4188
9cb426b8 4189@item target
510f9d86
LC
4190This string specifies the name of the mapping to be established. For
4191example, specifying @code{"my-partition"} will lead to the creation of
4192the @code{"/dev/mapper/my-partition"} device.
4193
9cb426b8 4194@item type
510f9d86
LC
4195This must be a @code{mapped-device-kind} object, which specifies how
4196@var{source} is mapped to @var{target}.
4197@end table
4198@end deftp
4199
4200@defvr {Scheme Variable} luks-device-mapping
4201This defines LUKS block device encryption using the @command{cryptsetup}
4202command, from the same-named package. This relies on the
4203@code{dm-crypt} Linux kernel module.
4204@end defvr
4205
cf4a9129
LC
4206@node User Accounts
4207@subsection User Accounts
ee85f3db 4208
cf4a9129 4209User accounts are specified with the @code{user-account} form:
ee85f3db 4210
cf4a9129
LC
4211@example
4212(user-account
4213 (name "alice")
4214 (group "users")
24e752c0
LC
4215 (supplementary-groups '("wheel" ;allow use of sudo, etc.
4216 "audio" ;sound card
4217 "video" ;video devices such as webcams
4218 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
4219 (comment "Bob's sister")
4220 (home-directory "/home/alice"))
4221@end example
25083588 4222
cf4a9129
LC
4223@deftp {Data Type} user-account
4224Objects of this type represent user accounts. The following members may
4225be specified:
ee85f3db 4226
cf4a9129
LC
4227@table @asis
4228@item @code{name}
4229The name of the user account.
ee85f3db 4230
cf4a9129
LC
4231@item @code{group}
4232This is the name (a string) or identifier (a number) of the user group
4233this account belongs to.
ee85f3db 4234
cf4a9129
LC
4235@item @code{supplementary-groups} (default: @code{'()})
4236Optionally, this can be defined as a list of group names that this
4237account belongs to.
ee85f3db 4238
cf4a9129
LC
4239@item @code{uid} (default: @code{#f})
4240This is the user ID for this account (a number), or @code{#f}. In the
4241latter case, a number is automatically chosen by the system when the
4242account is created.
ee85f3db 4243
cf4a9129
LC
4244@item @code{comment} (default: @code{""})
4245A comment about the account, such as the account's owner full name.
c8c871d1 4246
cf4a9129
LC
4247@item @code{home-directory}
4248This is the name of the home directory for the account.
ee85f3db 4249
cf4a9129
LC
4250@item @code{shell} (default: Bash)
4251This is a G-expression denoting the file name of a program to be used as
4252the shell (@pxref{G-Expressions}).
ee85f3db 4253
cf4a9129
LC
4254@item @code{system?} (default: @code{#f})
4255This Boolean value indicates whether the account is a ``system''
4256account. System accounts are sometimes treated specially; for instance,
4257graphical login managers do not list them.
ee85f3db 4258
cf4a9129 4259@item @code{password} (default: @code{#f})
eb59595c
LC
4260You would normally leave this field to @code{#f}, initialize user
4261passwords as @code{root} with the @command{passwd} command, and then let
4262users change it with @command{passwd}.
4263
4264If you @emph{do} want to have a preset password for an account, then
4265this field must contain the encrypted password, as a string.
5d1f1177
LC
4266@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
4267on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 4268Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 4269
cf4a9129
LC
4270@end table
4271@end deftp
ee85f3db 4272
cf4a9129 4273User group declarations are even simpler:
ee85f3db 4274
cf4a9129
LC
4275@example
4276(user-group (name "students"))
4277@end example
ee85f3db 4278
cf4a9129
LC
4279@deftp {Data Type} user-group
4280This type is for, well, user groups. There are just a few fields:
af8a56b8 4281
cf4a9129
LC
4282@table @asis
4283@item @code{name}
4284The group's name.
ee85f3db 4285
cf4a9129
LC
4286@item @code{id} (default: @code{#f})
4287The group identifier (a number). If @code{#f}, a new number is
4288automatically allocated when the group is created.
ee85f3db 4289
c8fa3426
LC
4290@item @code{system?} (default: @code{#f})
4291This Boolean value indicates whether the group is a ``system'' group.
4292System groups have low numerical IDs.
4293
cf4a9129
LC
4294@item @code{password} (default: @code{#f})
4295What, user groups can have a password? Well, apparently yes. Unless
4296@code{#f}, this field specifies the group's password.
ee85f3db 4297
cf4a9129
LC
4298@end table
4299@end deftp
401c53c4 4300
cf4a9129
LC
4301For convenience, a variable lists all the basic user groups one may
4302expect:
401c53c4 4303
cf4a9129
LC
4304@defvr {Scheme Variable} %base-groups
4305This is the list of basic user groups that users and/or packages expect
4306to be present on the system. This includes groups such as ``root'',
4307``wheel'', and ``users'', as well as groups used to control access to
4308specific devices such as ``audio'', ``disk'', and ``cdrom''.
4309@end defvr
401c53c4 4310
598e19dc
LC
4311@node Locales
4312@subsection Locales
4313
4314@cindex locale
4315A @dfn{locale} defines cultural conventions for a particular language
4316and region of the world (@pxref{Locales,,, libc, The GNU C Library
4317Reference Manual}). Each locale has a name that typically has the form
4318@code{@var{language}_@var{territory}.@var{charset}}---e.g.,
4319@code{fr_LU.utf8} designates the locale for the French language, with
4320cultural conventions from Luxembourg, and using the UTF-8 encoding.
4321
4322@cindex locale definition
4323Usually, you will want to specify the default locale for the machine
4324using the @code{locale} field of the @code{operating-system} declaration
4325(@pxref{operating-system Reference, @code{locale}}).
4326
4327That locale must be among the @dfn{locale definitions} that are known to
4328the system---and these are specified in the @code{locale-definitions}
4329slot of @code{operating-system}. The default value includes locale
4330definition for some widely used locales, but not for all the available
4331locales, in order to save space.
4332
4333If the locale specified in the @code{locale} field is not among the
4334definitions listed in @code{locale-definitions}, @command{guix system}
4335raises an error. In that case, you should add the locale definition to
4336the @code{locale-definitions} field. For instance, to add the North
4337Frisian locale for Germany, the value of that field may be:
4338
4339@example
4340(cons (locale-definition
4341 (name "fy_DE.utf8") (source "fy_DE"))
4342 %default-locale-definitions)
4343@end example
4344
4345Likewise, to save space, one might want @code{locale-definitions} to
4346list only the locales that are actually used, as in:
4347
4348@example
4349(list (locale-definition
4350 (name "ja_JP.eucjp") (source "ja_JP")
4351 (charset "EUC-JP")))
4352@end example
4353
4354The @code{locale-definition} form is provided by the @code{(gnu system
4355locale)} module. Details are given below.
4356
4357@deftp {Data Type} locale-definition
4358This is the data type of a locale definition.
4359
4360@table @asis
4361
4362@item @code{name}
4363The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
4364Reference Manual}, for more information on locale names.
4365
4366@item @code{source}
4367The name of the source for that locale. This is typically the
4368@code{@var{language}_@var{territory}} part of the locale name.
4369
4370@item @code{charset} (default: @code{"UTF-8"})
4371The ``character set'' or ``code set'' for that locale,
4372@uref{http://www.iana.org/assignments/character-sets, as defined by
4373IANA}.
4374
4375@end table
4376@end deftp
4377
4378@defvr {Scheme Variable} %default-locale-definitions
4379An arbitrary list of commonly used locales, used as the default value of
4380the @code{locale-definitions} field of @code{operating-system}
4381declarations.
4382@end defvr
401c53c4 4383
cf4a9129
LC
4384@node Services
4385@subsection Services
401c53c4 4386
cf4a9129
LC
4387@cindex system services
4388An important part of preparing an @code{operating-system} declaration is
4389listing @dfn{system services} and their configuration (@pxref{Using the
4390Configuration System}). System services are typically daemons launched
4391when the system boots, or other actions needed at that time---e.g.,
d8b94dbd
LC
4392configuring network access.
4393
4394Services are managed by GNU@tie{}dmd (@pxref{Introduction,,, dmd, GNU
4395dmd Manual}). On a running system, the @command{deco} command allows
4396you to list the available services, show their status, start and stop
4397them, or do other specific operations (@pxref{Jump Start,,, dmd, GNU dmd
4398Manual}). For example:
4399
4400@example
4401# deco status dmd
4402@end example
4403
4404The above command, run as @code{root}, lists the currently defined
4405services. The @command{deco doc} command shows a synopsis of the given
4406service:
4407
4408@example
4409# deco doc nscd
4410Run libc's name service cache daemon (nscd).
4411@end example
4412
4413The @command{start}, @command{stop}, and @command{restart} sub-commands
4414have the effect you would expect. For instance, the commands below stop
4415the nscd service and restart the Xorg display server:
4416
4417@example
4418# deco stop nscd
4419Service nscd has been stopped.
4420# deco restart xorg-server
4421Service xorg-server has been stopped.
4422Service xorg-server has been started.
4423@end example
401c53c4 4424
cf4a9129 4425The following sections document the available services, starting with
d8b94dbd
LC
4426the core services, that may be used in an @code{operating-system}
4427declaration.
401c53c4 4428
cf4a9129
LC
4429@menu
4430* Base Services:: Essential system services.
4431* Networking Services:: Network setup, SSH daemon, etc.
4432* X Window:: Graphical display.
aa4ed923 4433* Various Services:: Other services.
cf4a9129 4434@end menu
401c53c4 4435
cf4a9129
LC
4436@node Base Services
4437@subsubsection Base Services
a1ba8475 4438
cf4a9129
LC
4439The @code{(gnu services base)} module provides definitions for the basic
4440services that one expects from the system. The services exported by
4441this module are listed below.
401c53c4 4442
cf4a9129
LC
4443@defvr {Scheme Variable} %base-services
4444This variable contains a list of basic services@footnote{Technically,
4445this is a list of monadic services. @xref{The Store Monad}.} one would
4446expect from the system: a login service (mingetty) on each tty, syslogd,
4447libc's name service cache daemon (nscd), the udev device manager, and
4448more.
401c53c4 4449
cf4a9129
LC
4450This is the default value of the @code{services} field of
4451@code{operating-system} declarations. Usually, when customizing a
4452system, you will want to append services to @var{%base-services}, like
4453this:
401c53c4 4454
cf4a9129 4455@example
fa1e31b8 4456(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
4457@end example
4458@end defvr
401c53c4 4459
cf4a9129
LC
4460@deffn {Monadic Procedure} host-name-service @var{name}
4461Return a service that sets the host name to @var{name}.
4462@end deffn
401c53c4 4463
cf4a9129
LC
4464@deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
4465 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
4466 [#:allow-empty-passwords? #f]
4467Return a service to run mingetty on @var{tty}.
401c53c4 4468
cf4a9129
LC
4469When @var{allow-empty-passwords?} is true, allow empty log-in password. When
4470@var{auto-login} is true, it must be a user name under which to log-in
4471automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
4472@var{auto-login}, in which case the user will have to press a key before the
4473login shell is launched.
401c53c4 4474
cf4a9129
LC
4475When true, @var{login-program} is a gexp or a monadic gexp denoting the name
4476of the log-in program (the default is the @code{login} program from the Shadow
4477tool suite.)
401c53c4 4478
cf4a9129
LC
4479@var{motd} is a monadic value containing a text file to use as
4480the ``message of the day''.
4481@end deffn
401c53c4 4482
6454b333
LC
4483@cindex name service cache daemon
4484@cindex nscd
4aee6e60
LC
4485@deffn {Monadic Procedure} nscd-service [@var{config}] [#:glibc glibc] @
4486 [#:name-services '()]
4487Return a service that runs libc's name service cache daemon (nscd) with
4488the given @var{config}---an @code{<nscd-configuration>} object.
4489Optionally, @code{#:name-services} is a list of packages that provide
4490name service switch (NSS) modules needed by nscd.
cf4a9129 4491@end deffn
401c53c4 4492
6454b333
LC
4493@defvr {Scheme Variable} %nscd-default-configuration
4494This is the default @code{<nscd-configuration>} value (see below) used
4495by @code{nscd-service}. This uses the caches defined by
4496@var{%nscd-default-caches}; see below.
4497@end defvr
4498
4499@deftp {Data Type} nscd-configuration
4500This is the type representing the name service cache daemon (nscd)
4501configuration.
4502
4503@table @asis
4504
4505@item @code{log-file} (default: @code{"/var/log/nscd.log"})
4506Name of nscd's log file. This is where debugging output goes when
4507@code{debug-level} is strictly positive.
4508
4509@item @code{debug-level} (default: @code{0})
4510Integer denoting the debugging levels. Higher numbers mean more
4511debugging output is logged.
4512
4513@item @code{caches} (default: @var{%nscd-default-caches})
4514List of @code{<nscd-cache>} objects denoting things to be cached; see
4515below.
4516
4517@end table
4518@end deftp
4519
4520@deftp {Data Type} nscd-cache
4521Data type representing a cache database of nscd and its parameters.
4522
4523@table @asis
4524
4525@item @code{database}
4526This is a symbol representing the name of the database to be cached.
4527Valid values are @code{passwd}, @code{group}, @code{hosts}, and
4528@code{services}, which designate the corresponding NSS database
4529(@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
4530
4531@item @code{positive-time-to-live}
4532@itemx @code{negative-time-to-live} (default: @code{20})
4533A number representing the number of seconds during which a positive or
4534negative lookup result remains in cache.
4535
4536@item @code{check-files?} (default: @code{#t})
4537Whether to check for updates of the files corresponding to
4538@var{database}.
4539
4540For instance, when @var{database} is @code{hosts}, setting this flag
4541instructs nscd to check for updates in @file{/etc/hosts} and to take
4542them into account.
4543
4544@item @code{persistent?} (default: @code{#t})
4545Whether the cache should be stored persistently on disk.
4546
4547@item @code{shared?} (default: @code{#t})
4548Whether the cache should be shared among users.
4549
4550@item @code{max-database-size} (default: 32@tie{}MiB)
4551Maximum size in bytes of the database cache.
4552
4553@c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
4554@c settings, so leave them out.
4555
4556@end table
4557@end deftp
4558
4559@defvr {Scheme Variable} %nscd-default-caches
4560List of @code{<nscd-cache>} objects used by default by
4561@code{nscd-configuration} (see above.)
4562
4563It enables persistent and aggressive caching of service and host name
4564lookups. The latter provides better host name lookup performance,
4565resilience in the face of unreliable name servers, and also better
4566privacy---often the result of host name lookups is in local cache, so
4567external name servers do not even need to be queried.
4568@end defvr
4569
4570
1bb76f75
AK
4571@deffn {Monadic Procedure} syslog-service [#:config-file #f]
4572Return a service that runs @code{syslogd}. If configuration file name
4573@var{config-file} is not specified, use some reasonable default
cf4a9129
LC
4574settings.
4575@end deffn
401c53c4 4576
cf4a9129
LC
4577@deffn {Monadic Procedure} guix-service [#:guix guix] @
4578 [#:builder-group "guixbuild"] [#:build-accounts 10] @
02bb6b45 4579 [#:authorize-hydra-key? #t] [#:use-substitutes? #t] @
cf4a9129
LC
4580 [#:extra-options '()]
4581Return a service that runs the build daemon from @var{guix}, and has
4582@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 4583
cf4a9129
LC
4584When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
4585provided by @var{guix} is authorized upon activation, meaning that substitutes
4586from @code{hydra.gnu.org} are used by default.
401c53c4 4587
cf4a9129
LC
4588If @var{use-substitutes?} is false, the daemon is run with
4589@option{--no-substitutes} (@pxref{Invoking guix-daemon,
4590@option{--no-substitutes}}).
401c53c4 4591
cf4a9129
LC
4592Finally, @var{extra-options} is a list of additional command-line options
4593passed to @command{guix-daemon}.
4594@end deffn
a1ba8475 4595
cf4a9129
LC
4596@deffn {Monadic Procedure} udev-service [#:udev udev]
4597Run @var{udev}, which populates the @file{/dev} directory dynamically.
4598@end deffn
401c53c4 4599
a69576ea 4600
cf4a9129
LC
4601@node Networking Services
4602@subsubsection Networking Services
401c53c4 4603
fa1e31b8 4604The @code{(gnu services networking)} module provides services to configure
cf4a9129 4605the network interface.
a1ba8475 4606
a023cca8
LC
4607@cindex DHCP, networking service
4608@deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
4609Return a service that runs @var{dhcp}, a Dynamic Host Configuration
4610Protocol (DHCP) client, on all the non-loopback network interfaces.
4611@end deffn
4612
cf4a9129
LC
4613@deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
4614 [#:gateway #f] [#:name-services @code{'()}]
4615Return a service that starts @var{interface} with address @var{ip}. If
4616@var{gateway} is true, it must be a string specifying the default network
4617gateway.
4618@end deffn
8b315a6d 4619
b7d0c494
MW
4620@cindex wicd
4621@deffn {Monadic Procedure} wicd-service [#:wicd @var{wicd}]
4622Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a
4623network manager that aims to simplify wired and wireless networking.
4624@end deffn
4625
63854bcb
LC
4626@deffn {Monadic Procedure} ntp-service [#:ntp @var{ntp}] @
4627 [#:name-service @var{%ntp-servers}]
4628Return a service that runs the daemon from @var{ntp}, the
4629@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
4630keep the system clock synchronized with that of @var{servers}.
4631@end deffn
4632
4633@defvr {Scheme Variable} %ntp-servers
4634List of host names used as the default NTP servers.
4635@end defvr
4636
cf4a9129
LC
4637@deffn {Monadic Procedure} tor-service [#:tor tor]
4638Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 4639
cf4a9129
LC
4640The daemon runs with the default settings (in particular the default exit
4641policy) as the @code{tor} unprivileged user.
4642@end deffn
8b315a6d 4643
4627a464
LC
4644@deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
4645 [#:interface "127.0.0.1"] [#:port 6667] @
4646 [#:extra-settings ""]
4647Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
4648acts as a gateway between IRC and chat networks.
4649
4650The daemon will listen to the interface corresponding to the IP address
4651specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
4652local clients can connect, whereas @code{0.0.0.0} means that connections can
4653come from any networking interface.
4654
4655In addition, @var{extra-settings} specifies a string to append to the
4656configuration file.
4657@end deffn
4658
f4391bec 4659Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 4660
cf4a9129 4661@deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
5833bf33 4662 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
cf4a9129
LC
4663 [#:allow-empty-passwords? #f] [#:root-login? #f] @
4664 [#:syslog-output? #t] [#:x11-forwarding? #t] @
4665 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
21cc905a 4666 [#:public-key-authentication? #t] [#:initialize? #t]
cf4a9129
LC
4667Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
4668@var{host-key} must designate a file containing the host key, and readable
4669only by root.
72e25e35 4670
5833bf33
DP
4671When @var{daemonic?} is true, @command{lshd} will detach from the
4672controlling terminal and log its output to syslogd, unless one sets
4673@var{syslog-output?} to false. Obviously, it also makes lsh-service
4674depend on existence of syslogd service. When @var{pid-file?} is true,
4675@command{lshd} writes its PID to the file called @var{pid-file}.
4676
cf4a9129
LC
4677When @var{initialize?} is true, automatically create the seed and host key
4678upon service activation if they do not exist yet. This may take long and
4679require interaction.
8b315a6d 4680
20dd519c
LC
4681When @var{initialize?} is false, it is up to the user to initialize the
4682randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
4683a key pair with the private key stored in file @var{host-key} (@pxref{lshd
4684basics,,, lsh, LSH Manual}).
4685
cf4a9129
LC
4686When @var{interfaces} is empty, lshd listens for connections on all the
4687network interfaces; otherwise, @var{interfaces} must be a list of host names
4688or addresses.
9bf3c1a7 4689
20dd519c
LC
4690@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
4691passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 4692root.
4af2447e 4693
cf4a9129
LC
4694The other options should be self-descriptive.
4695@end deffn
4af2447e 4696
fa0c1d61
LC
4697@defvr {Scheme Variable} %facebook-host-aliases
4698This variable contains a string for use in @file{/etc/hosts}
4699(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
4700line contains a entry that maps a known server name of the Facebook
4701on-line service---e.g., @code{www.facebook.com}---to the local
4702host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
4703
4704This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
4705@code{operating-system} declaration (@pxref{operating-system Reference,
4706@file{/etc/hosts}}):
fa0c1d61
LC
4707
4708@example
4709(use-modules (gnu) (guix))
4710
4711(operating-system
4712 (host-name "mymachine")
4713 ;; ...
4714 (hosts-file
4715 ;; Create a /etc/hosts file with aliases for "localhost"
4716 ;; and "mymachine", as well as for Facebook servers.
4717 (text-file "hosts"
4718 (string-append (local-host-aliases host-name)
4719 %facebook-host-aliases))))
4720@end example
4721
4722This mechanism can prevent programs running locally, such as Web
4723browsers, from accessing Facebook.
4724@end defvr
4725
cf4a9129
LC
4726@node X Window
4727@subsubsection X Window
68ad877c 4728
cf4a9129
LC
4729Support for the X Window graphical display system---specifically
4730Xorg---is provided by the @code{(gnu services xorg)} module. Note that
4731there is no @code{xorg-service} procedure. Instead, the X server is
4732started by the @dfn{login manager}, currently SLiM.
4af2447e 4733
cf4a9129 4734@deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
4735 [#:auto-login? #f] [#:default-user ""] [#:startx] @
4736 [#:theme @var{%default-slim-theme}] @
4bd43bbe 4737 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
4738Return a service that spawns the SLiM graphical login manager, which in
4739turn starts the X display server with @var{startx}, a command as returned by
4740@code{xorg-start-command}.
4af2447e 4741
cf4a9129
LC
4742When @var{allow-empty-passwords?} is true, allow logins with an empty
4743password. When @var{auto-login?} is true, log in automatically as
4744@var{default-user}.
0ecc3bf3
LC
4745
4746If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
4747@var{theme} must be a gexp denoting the name of a directory containing the
4748theme to use. In that case, @var{theme-name} specifies the name of the
4749theme.
cf4a9129 4750@end deffn
4af2447e 4751
0ecc3bf3
LC
4752@defvr {Scheme Variable} %default-theme
4753@defvrx {Scheme Variable} %default-theme-name
4754The G-Expression denoting the default SLiM theme and its name.
4755@end defvr
4756
f703413e 4757@deffn {Monadic Procedure} xorg-start-command [#:guile] @
d2e59637 4758 [#:drivers '()] [#:resolutions '()] [#:xorg-server @var{xorg-server}]
f703413e
LC
4759Return a derivation that builds a @var{guile} script to start the X server
4760from @var{xorg-server}. Usually the X server is started by a login manager.
4761
4762@var{drivers} must be either the empty list, in which case Xorg chooses a
4763graphics driver automatically, or a list of driver names that will be tried in
4764this order---e.g., @code{("modesetting" "vesa")}.
d2e59637
LC
4765
4766Likewise, when @var{resolutions} is the empty list, Xorg chooses an
4767appropriate screen resolution; otherwise, it must be a list of
4768resolutions---e.g., @code{((1024 768) (640 480))}.
f703413e 4769@end deffn
4af2447e 4770
aa4ed923
AK
4771@node Various Services
4772@subsubsection Various Services
4773
4774The @code{(gnu services lirc)} module provides the following service.
4775
4776@deffn {Monadic Procedure} lirc-service [#:lirc lirc] @
4777 [#:device #f] [#:driver #f] [#:config-file #f] @
4778 [#:extra-options '()]
4779Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
4780decodes infrared signals from remote controls.
4781
4782Optionally, @var{device}, @var{driver} and @var{config-file}
4783(configuration file name) may be specified. See @command{lircd} manual
4784for details.
4785
4786Finally, @var{extra-options} is a list of additional command-line options
4787passed to @command{lircd}.
4788@end deffn
4789
0ae8c15a
LC
4790@node Setuid Programs
4791@subsection Setuid Programs
4792
4793@cindex setuid programs
4794Some programs need to run with ``root'' privileges, even when they are
4795launched by unprivileged users. A notorious example is the
4796@command{passwd} programs, which can users can run to change their
4797password, and which requires write access to the @file{/etc/passwd} and
4798@file{/etc/shadow} files---something normally restricted to root, for
4799obvious security reasons. To address that, these executables are
4800@dfn{setuid-root}, meaning that they always run with root privileges
4801(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
4802for more info about the setuid mechanisms.)
4803
4804The store itself @emph{cannot} contain setuid programs: that would be a
4805security issue since any user on the system can write derivations that
4806populate the store (@pxref{The Store}). Thus, a different mechanism is
4807used: instead of changing the setuid bit directly on files that are in
4808the store, we let the system administrator @emph{declare} which programs
4809should be setuid root.
4810
4811The @code{setuid-programs} field of an @code{operating-system}
4812declaration contains a list of G-expressions denoting the names of
4813programs to be setuid-root (@pxref{Using the Configuration System}).
4814For instance, the @command{passwd} program, which is part of the Shadow
4815package, can be designated by this G-expression (@pxref{G-Expressions}):
4816
4817@example
4818#~(string-append #$shadow "/bin/passwd")
4819@end example
4820
4821A default set of setuid programs is defined by the
4822@code{%setuid-programs} variable of the @code{(gnu system)} module.
4823
4824@defvr {Scheme Variable} %setuid-programs
4825A list of G-expressions denoting common programs that are setuid-root.
4826
4827The list includes commands such as @command{passwd}, @command{ping},
4828@command{su}, and @command{sudo}.
4829@end defvr
4830
4831Under the hood, the actual setuid programs are created in the
4832@file{/run/setuid-programs} directory at system activation time. The
4833files in this directory refer to the ``real'' binaries, which are in the
4834store.
4835
996ed739
LC
4836@node Name Service Switch
4837@subsection Name Service Switch
4838
4839@cindex name service switch
4840@cindex NSS
4841The @code{(gnu system nss)} module provides bindings to the
4842configuration file of libc's @dfn{name service switch} or @dfn{NSS}
4843(@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
4844Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
4845extended with new ``name'' lookup methods for system databases, which
4846includes host names, service names, user accounts, and more (@pxref{Name
4847Service Switch, System Databases and Name Service Switch,, libc, The GNU
4848C Library Reference Manual}).
4849
4850The NSS configuration specifies, for each system database, which lookup
4851method is to be used, and how the various methods are chained
4852together---for instance, under which circumstances NSS should try the
4853next method in the list. The NSS configuration is given in the
4854@code{name-service-switch} field of @code{operating-system} declarations
4855(@pxref{operating-system Reference, @code{name-service-switch}}).
4856
4857@c See <http://0pointer.de/lennart/projects/nss-mdns/>.
4858As an example, the declaration below configures the NSS to use the
4859@code{nss-mdns} back-end for host name lookups:
4860
4861@example
4862(name-service-switch
4863 (hosts (list %files ;first, check /etc/hosts
4864
4865 ;; If the above did not succeed, try
4866 ;; with 'mdns_minimal'.
4867 (name-service
4868 (name "mdns_minimal")
4869
4870 ;; 'mdns_minimal' is authoritative for
4871 ;; '.local'. When it returns "not found",
4872 ;; no need to try the next methods.
4873 (reaction (lookup-specification
4874 (not-found => return))))
4875
4876 ;; Then fall back to DNS.
4877 (name-service
4878 (name "dns"))
4879
4880 ;; Finally, try with the "full" 'mdns'.
4881 (name-service
4882 (name "mdns")))))
4883@end example
4884
4885The reference for name service switch configuration is given below. It
4886is a direct mapping of the C library's configuration file format, so
4887please refer to the C library manual for more information (@pxref{NSS
4888Configuration File,,, libc, The GNU C Library Reference Manual}).
4889Compared to libc's NSS configuration file format, it has the advantage
4890not only of adding this warm parenthetic feel that we like, but also
4891static checks: you'll know about syntax errors and typos as soon as you
4892run @command{guix system}.
4893
4894@defvr {Scheme Variable} %default-nss
4895This is the default name service switch configuration, a
4896@code{name-service-switch} object.
4897@end defvr
4898
4899@deftp {Data Type} name-service-switch
4900
4901This is the data type representation the configuration of libc's name
4902service switch (NSS). Each field below represents one of the supported
4903system databases.
4904
4905@table @code
4906@item aliases
4907@itemx ethers
4908@itemx group
4909@itemx gshadow
4910@itemx hosts
4911@itemx initgroups
4912@itemx netgroup
4913@itemx networks
4914@itemx password
4915@itemx public-key
4916@itemx rpc
4917@itemx services
4918@itemx shadow
4919The system databases handled by the NSS. Each of these fields must be a
4920list of @code{<name-service>} objects (see below.)
4921@end table
4922@end deftp
4923
4924@deftp {Data Type} name-service
4925
4926This is the data type representing an actual name service and the
4927associated lookup action.
4928
4929@table @code
4930@item name
4931A string denoting the name service (@pxref{Services in the NSS
4932configuration,,, libc, The GNU C Library Reference Manual}).
4933
4aee6e60
LC
4934Note that name services listed here must be visible to nscd. This is
4935achieved by passing the @code{#:name-services} argument to
4936@code{nscd-service} the list of packages providing the needed name
4937services (@pxref{Base Services, @code{nscd-service}}).
4938
996ed739
LC
4939@item reaction
4940An action specified using the @code{lookup-specification} macro
4941(@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
4942Reference Manual}). For example:
4943
4944@example
4945(lookup-specification (unavailable => continue)
4946 (success => return))
4947@end example
4948@end table
4949@end deftp
0ae8c15a 4950
fd1b1fa2
LC
4951@node Initial RAM Disk
4952@subsection Initial RAM Disk
4953
4954@cindex initial RAM disk (initrd)
4955@cindex initrd (initial RAM disk)
4956For bootstrapping purposes, the Linux-Libre kernel is passed an
4957@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
4958root file system, as well as an initialization script. The latter is
4959responsible for mounting the real root file system, and for loading any
4960kernel modules that may be needed to achieve that.
4961
4962The @code{initrd} field of an @code{operating-system} declaration allows
4963you to specify which initrd you would like to use. The @code{(gnu
4964system linux-initrd)} module provides two ways to build an initrd: the
4965high-level @code{base-initrd} procedure, and the low-level
4966@code{expression->initrd} procedure.
4967
4968The @code{base-initrd} procedure is intended to cover most common uses.
4969For example, if you want to add a bunch of kernel modules to be loaded
4970at boot time, you can define the @code{initrd} field of the operating
4971system declaration like this:
4972
4973@example
52ac153e 4974(initrd (lambda (file-systems . rest)
027981d6
LC
4975 ;; Create a standard initrd that has modules "foo.ko"
4976 ;; and "bar.ko", as well as their dependencies, in
4977 ;; addition to the modules available by default.
52ac153e 4978 (apply base-initrd file-systems
027981d6 4979 #:extra-modules '("foo" "bar")
52ac153e 4980 rest)))
fd1b1fa2
LC
4981@end example
4982
52ac153e
LC
4983The @code{base-initrd} procedure also handles common use cases that
4984involves using the system as a QEMU guest, or as a ``live'' system whose
4985root file system is volatile.
fd1b1fa2
LC
4986
4987@deffn {Monadic Procedure} base-initrd @var{file-systems} @
4988 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 4989 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
4990Return a monadic derivation that builds a generic initrd. @var{file-systems} is
4991a list of file-systems to be mounted by the initrd, possibly in addition to
4992the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
4993@var{mapped-devices} is a list of device mappings to realize before
4994@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
4995
4996When @var{qemu-networking?} is true, set up networking with the standard QEMU
4997parameters. When @var{virtio?} is true, load additional modules so the initrd can
4998be used as a QEMU guest with para-virtualized I/O drivers.
4999
5000When @var{volatile-root?} is true, the root file system is writable but any changes
5001to it are lost.
5002
5003The initrd is automatically populated with all the kernel modules necessary
5004for @var{file-systems} and for the given options. However, additional kernel
5005modules can be listed in @var{extra-modules}. They will be added to the initrd, and
5006loaded at boot time in the order in which they appear.
5007@end deffn
5008
5009Needless to say, the initrds we produce and use embed a
5010statically-linked Guile, and the initialization program is a Guile
5011program. That gives a lot of flexibility. The
5012@code{expression->initrd} procedure builds such an initrd, given the
5013program to run in that initrd.
5014
5015@deffn {Monadic Procedure} expression->initrd @var{exp} @
5016 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 5017 [#:modules '()]
fd1b1fa2
LC
5018Return a derivation that builds a Linux initrd (a gzipped cpio archive)
5019containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
5020upon booting. All the derivations referenced by @var{exp} are
5021automatically copied to the initrd.
fd1b1fa2 5022
42d10464
LC
5023@var{modules} is a list of Guile module names to be embedded in the
5024initrd.
fd1b1fa2
LC
5025@end deffn
5026
88faf933
LC
5027@node GRUB Configuration
5028@subsection GRUB Configuration
5029
5030@cindex GRUB
5031@cindex boot loader
5032
5033The operating system uses GNU@tie{}GRUB as its boot loader
5034(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
5035configured using @code{grub-configuration} declarations. This data type
5036is exported by the @code{(gnu system grub)} module, and described below.
5037
5038@deftp {Data Type} grub-configuration
5039The type of a GRUB configuration declaration.
5040
5041@table @asis
5042
5043@item @code{device}
5044This is a string denoting the boot device. It must be a device name
5045understood by the @command{grub-install} command, such as
5046@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
5047GNU GRUB Manual}).
5048
5049@item @code{menu-entries} (default: @code{()})
5050A possibly empty list of @code{menu-entry} objects (see below), denoting
5051entries to appear in the GRUB boot menu, in addition to the current
5052system entry and the entry pointing to previous system generations.
5053
5054@item @code{default-entry} (default: @code{0})
5055The index of the default boot menu entry. Index 0 is for the current
5056system's entry.
5057
5058@item @code{timeout} (default: @code{5})
5059The number of seconds to wait for keyboard input before booting. Set to
50600 to boot immediately, and to -1 to wait indefinitely.
5061
5062@item @code{theme} (default: @var{%default-theme})
5063The @code{grub-theme} object describing the theme to use.
5064@end table
5065
5066@end deftp
5067
5068Should you want to list additional boot menu entries @i{via} the
5069@code{menu-entries} field above, you will need to create them with the
5070@code{menu-entry} form:
5071
5072@deftp {Data Type} menu-entry
5073The type of an entry in the GRUB boot menu.
5074
5075@table @asis
5076
5077@item @code{label}
35ed9306 5078The label to show in the menu---e.g., @code{"GNU"}.
88faf933
LC
5079
5080@item @code{linux}
5081The Linux kernel to boot.
5082
5083@item @code{linux-arguments} (default: @code{()})
5084The list of extra Linux kernel command-line arguments---e.g.,
5085@code{("console=ttyS0")}.
5086
5087@item @code{initrd}
5088A G-Expression or string denoting the file name of the initial RAM disk
5089to use (@pxref{G-Expressions}).
5090
5091@end table
5092@end deftp
5093
5094@c FIXME: Write documentation once it's stable.
5095Themes are created using the @code{grub-theme} form, which is not
5096documented yet.
5097
5098@defvr {Scheme Variable} %default-theme
5099This is the default GRUB theme used by the operating system, with a
5100fancy background image displaying the GNU and Guix logos.
5101@end defvr
5102
5103
cf4a9129
LC
5104@node Invoking guix system
5105@subsection Invoking @code{guix system}
0918e64a 5106
cf4a9129
LC
5107Once you have written an operating system declaration, as seen in the
5108previous section, it can be @dfn{instantiated} using the @command{guix
5109system} command. The synopsis is:
4af2447e 5110
cf4a9129
LC
5111@example
5112guix system @var{options}@dots{} @var{action} @var{file}
5113@end example
4af2447e 5114
cf4a9129
LC
5115@var{file} must be the name of a file containing an
5116@code{operating-system} declaration. @var{action} specifies how the
5117operating system is instantiate. Currently the following values are
5118supported:
4af2447e 5119
cf4a9129
LC
5120@table @code
5121@item reconfigure
5122Build the operating system described in @var{file}, activate it, and
5123switch to it@footnote{This action is usable only on systems already
5124running GNU.}.
4af2447e 5125
cf4a9129
LC
5126This effects all the configuration specified in @var{file}: user
5127accounts, system services, global package list, setuid programs, etc.
4af2447e 5128
cf4a9129
LC
5129It also adds a GRUB menu entry for the new OS configuration, and moves
5130entries for older configurations to a submenu---unless
5131@option{--no-grub} is passed.
4af2447e 5132
bf2479c7
LC
5133@c The paragraph below refers to the problem discussed at
5134@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
5135It is highly recommended to run @command{guix pull} once before you run
5136@command{guix system reconfigure} for the first time (@pxref{Invoking
5137guix pull}). Failing to do that you would see an older version of Guix
5138once @command{reconfigure} has completed.
5139
cf4a9129
LC
5140@item build
5141Build the operating system's derivation, which includes all the
5142configuration files and programs needed to boot and run the system.
5143This action does not actually install anything.
113daf62 5144
cf4a9129
LC
5145@item init
5146Populate the given directory with all the files necessary to run the
5147operating system specified in @var{file}. This is useful for first-time
3ca2731c 5148installations of GSD. For instance:
113daf62
LC
5149
5150@example
cf4a9129 5151guix system init my-os-config.scm /mnt
113daf62
LC
5152@end example
5153
cf4a9129
LC
5154copies to @file{/mnt} all the store items required by the configuration
5155specified in @file{my-os-config.scm}. This includes configuration
5156files, packages, and so on. It also creates other essential files
5157needed for the system to operate correctly---e.g., the @file{/etc},
5158@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 5159
cf4a9129
LC
5160This command also installs GRUB on the device specified in
5161@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 5162
cf4a9129
LC
5163@item vm
5164@cindex virtual machine
0276f697 5165@cindex VM
cf4a9129
LC
5166Build a virtual machine that contain the operating system declared in
5167@var{file}, and return a script to run that virtual machine (VM).
810568b3 5168Arguments given to the script are passed as is to QEMU.
113daf62 5169
cf4a9129 5170The VM shares its store with the host system.
113daf62 5171
0276f697
LC
5172Additional file systems can be shared between the host and the VM using
5173the @code{--share} and @code{--expose} command-line options: the former
5174specifies a directory to be shared with write access, while the latter
5175provides read-only access to the shared directory.
5176
5177The example below creates a VM in which the user's home directory is
5178accessible read-only, and where the @file{/exchange} directory is a
5179read-write mapping of the host's @file{$HOME/tmp}:
5180
5181@example
5182guix system vm my-config.scm \
5183 --expose=$HOME --share=$HOME/tmp=/exchange
5184@end example
5185
6aa260af
LC
5186On GNU/Linux, the default is to boot directly to the kernel; this has
5187the advantage of requiring only a very tiny root disk image since the
5188host's store can then be mounted.
5189
5190The @code{--full-boot} option forces a complete boot sequence, starting
5191with the bootloader. This requires more disk space since a root image
5192containing at least the kernel, initrd, and bootloader data files must
5193be created. The @code{--image-size} option can be used to specify the
5194image's size.
ab11f0be 5195
cf4a9129
LC
5196@item vm-image
5197@itemx disk-image
5198Return a virtual machine or disk image of the operating system declared
5199in @var{file} that stands alone. Use the @option{--image-size} option
5200to specify the size of the image.
113daf62 5201
cf4a9129
LC
5202When using @code{vm-image}, the returned image is in qcow2 format, which
5203the QEMU emulator can efficiently use.
113daf62 5204
cf4a9129
LC
5205When using @code{disk-image}, a raw disk image is produced; it can be
5206copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
5207the device corresponding to a USB stick, one can copy the image on it
5208using the following command:
113daf62 5209
cf4a9129
LC
5210@example
5211# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
5212@end example
113daf62 5213
cf4a9129 5214@end table
113daf62 5215
cf4a9129
LC
5216@var{options} can contain any of the common build options provided by
5217@command{guix build} (@pxref{Invoking guix build}). In addition,
5218@var{options} can contain one of the following:
113daf62 5219
cf4a9129
LC
5220@table @option
5221@item --system=@var{system}
5222@itemx -s @var{system}
5223Attempt to build for @var{system} instead of the host's system type.
5224This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 5225
cf4a9129
LC
5226@item --image-size=@var{size}
5227For the @code{vm-image} and @code{disk-image} actions, create an image
5228of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
5229include a unit as a suffix (@pxref{Block size, size specifications,,
5230coreutils, GNU Coreutils}).
113daf62 5231@end table
113daf62 5232
cf4a9129
LC
5233Note that all the actions above, except @code{build} and @code{init},
5234rely on KVM support in the Linux-Libre kernel. Specifically, the
5235machine should have hardware virtualization support, the corresponding
5236KVM kernel module should be loaded, and the @file{/dev/kvm} device node
5237must exist and be readable and writable by the user and by the daemon's
5238build users.
8451a568 5239
cf4a9129
LC
5240@node Defining Services
5241@subsection Defining Services
8451a568 5242
cf4a9129
LC
5243The @code{(gnu services @dots{})} modules define several procedures that allow
5244users to declare the operating system's services (@pxref{Using the
5245Configuration System}). These procedures are @emph{monadic
5246procedures}---i.e., procedures that return a monadic value in the store
5247monad (@pxref{The Store Monad}). For examples of such procedures,
5248@xref{Services}.
8451a568 5249
cf4a9129
LC
5250@cindex service definition
5251The monadic value returned by those procedures is a @dfn{service
5252definition}---a structure as returned by the @code{service} form.
5253Service definitions specifies the inputs the service depends on, and an
5254expression to start and stop the service. Behind the scenes, service
5255definitions are ``translated'' into the form suitable for the
5256configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
5257dmd Manual}).
8451a568 5258
cf4a9129
LC
5259As an example, here is what the @code{nscd-service} procedure looks
5260like:
8451a568 5261
cf4a9129
LC
5262@lisp
5263(define (nscd-service)
5264 (with-monad %store-monad
5265 (return (service
5266 (documentation "Run libc's name service cache daemon.")
5267 (provision '(nscd))
5268 (activate #~(begin
5269 (use-modules (guix build utils))
5270 (mkdir-p "/var/run/nscd")))
5271 (start #~(make-forkexec-constructor
5272 (string-append #$glibc "/sbin/nscd")
5273 "-f" "/dev/null" "--foreground"))
5274 (stop #~(make-kill-destructor))
5275 (respawn? #f)))))
5276@end lisp
8451a568 5277
cf4a9129
LC
5278@noindent
5279The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
5280(@pxref{G-Expressions}). The @code{activate} field contains a script to
5281run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
5282directory exists before @command{nscd} is started.
8451a568 5283
cf4a9129
LC
5284The @code{start} and @code{stop} fields refer to dmd's facilities to
5285start and stop processes (@pxref{Service De- and Constructors,,, dmd,
5286GNU dmd Manual}). The @code{provision} field specifies the name under
5287which this service is known to dmd, and @code{documentation} specifies
5288on-line documentation. Thus, the commands @command{deco start ncsd},
5289@command{deco stop nscd}, and @command{deco doc nscd} will do what you
5290would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 5291
8451a568 5292
cf4a9129
LC
5293@node Installing Debugging Files
5294@section Installing Debugging Files
8451a568 5295
cf4a9129
LC
5296@cindex debugging files
5297Program binaries, as produced by the GCC compilers for instance, are
5298typically written in the ELF format, with a section containing
5299@dfn{debugging information}. Debugging information is what allows the
5300debugger, GDB, to map binary code to source code; it is required to
5301debug a compiled program in good conditions.
8451a568 5302
cf4a9129
LC
5303The problem with debugging information is that is takes up a fair amount
5304of disk space. For example, debugging information for the GNU C Library
5305weighs in at more than 60 MiB. Thus, as a user, keeping all the
5306debugging info of all the installed programs is usually not an option.
5307Yet, space savings should not come at the cost of an impediment to
5308debugging---especially in the GNU system, which should make it easier
5309for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 5310
cf4a9129
LC
5311Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
5312mechanism that allows users to get the best of both worlds: debugging
5313information can be stripped from the binaries and stored in separate
5314files. GDB is then able to load debugging information from those files,
5315when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
5316with GDB}).
8451a568 5317
cf4a9129
LC
5318The GNU distribution takes advantage of this by storing debugging
5319information in the @code{lib/debug} sub-directory of a separate package
5320output unimaginatively called @code{debug} (@pxref{Packages with
5321Multiple Outputs}). Users can choose to install the @code{debug} output
5322of a package when they need it. For instance, the following command
5323installs the debugging information for the GNU C Library and for GNU
5324Guile:
8451a568
LC
5325
5326@example
cf4a9129 5327guix package -i glibc:debug guile:debug
8451a568
LC
5328@end example
5329
cf4a9129
LC
5330GDB must then be told to look for debug files in the user's profile, by
5331setting the @code{debug-file-directory} variable (consider setting it
5332from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
5333GDB}):
8451a568 5334
cf4a9129
LC
5335@example
5336(gdb) set debug-file-directory ~/.guix-profile/lib/debug
5337@end example
8451a568 5338
cf4a9129
LC
5339From there on, GDB will pick up debugging information from the
5340@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 5341
cf4a9129
LC
5342In addition, you will most likely want GDB to be able to show the source
5343code being debugged. To do that, you will have to unpack the source
5344code of the package of interest (obtained with @code{guix build
5345--source}, @pxref{Invoking guix build}), and to point GDB to that source
5346directory using the @code{directory} command (@pxref{Source Path,
5347@code{directory},, gdb, Debugging with GDB}).
8451a568 5348
cf4a9129
LC
5349@c XXX: keep me up-to-date
5350The @code{debug} output mechanism in Guix is implemented by the
5351@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
5352opt-in---debugging information is available only for those packages
5353whose definition explicitly declares a @code{debug} output. This may be
5354changed to opt-out in the future, if our build farm servers can handle
5355the load. To check whether a package has a @code{debug} output, use
5356@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 5357
8451a568 5358
05962f29
LC
5359@node Security Updates
5360@section Security Updates
5361
843858b8
LC
5362@quotation Note
5363As of version @value{VERSION}, the feature described in this section is
5364experimental.
5365@end quotation
05962f29
LC
5366
5367@cindex security updates
5368Occasionally, important security vulnerabilities are discovered in core
5369software packages and must be patched. Guix follows a functional
5370package management discipline (@pxref{Introduction}), which implies
5371that, when a package is changed, @emph{every package that depends on it}
5372must be rebuilt. This can significantly slow down the deployment of
5373fixes in core packages such as libc or Bash, since basically the whole
5374distribution would need to be rebuilt. Using pre-built binaries helps
5375(@pxref{Substitutes}), but deployment may still take more time than
5376desired.
5377
5378@cindex grafts
5379To address that, Guix implements @dfn{grafts}, a mechanism that allows
5380for fast deployment of critical updates without the costs associated
5381with a whole-distribution rebuild. The idea is to rebuild only the
5382package that needs to be patched, and then to ``graft'' it onto packages
5383explicitly installed by the user and that were previously referring to
5384the original package. The cost of grafting is typically very low, and
5385order of magnitudes lower than a full rebuild of the dependency chain.
5386
5387@cindex replacements of packages, for grafts
5388For instance, suppose a security update needs to be applied to Bash.
5389Guix developers will provide a package definition for the ``fixed''
5390Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
5391Packages}). Then, the original package definition is augmented with a
5392@code{replacement} field pointing to the package containing the bug fix:
5393
5394@example
5395(define bash
5396 (package
5397 (name "bash")
5398 ;; @dots{}
5399 (replacement bash-fixed)))
5400@end example
5401
5402From there on, any package depending directly or indirectly on Bash that
5403is installed will automatically be ``rewritten'' to refer to
5404@var{bash-fixed} instead of @var{bash}. This grafting process takes
5405time proportional to the size of the package, but expect less than a
5406minute for an ``average'' package on a recent machine.
5407
5408Currently, the graft and the package it replaces (@var{bash-fixed} and
5409@var{bash} in the example above) must have the exact same @code{name}
5410and @code{version} fields. This restriction mostly comes from the fact
5411that grafting works by patching files, including binary files, directly.
5412Other restrictions may apply: for instance, when adding a graft to a
5413package providing a shared library, the original shared library and its
5414replacement must have the same @code{SONAME} and be binary-compatible.
5415
5416
cf4a9129
LC
5417@node Package Modules
5418@section Package Modules
8451a568 5419
cf4a9129
LC
5420From a programming viewpoint, the package definitions of the
5421GNU distribution are provided by Guile modules in the @code{(gnu packages
5422@dots{})} name space@footnote{Note that packages under the @code{(gnu
5423packages @dots{})} module name space are not necessarily ``GNU
5424packages''. This module naming scheme follows the usual Guile module
5425naming convention: @code{gnu} means that these modules are distributed
5426as part of the GNU system, and @code{packages} identifies modules that
5427define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
5428Reference Manual}). For instance, the @code{(gnu packages emacs)}
5429module exports a variable named @code{emacs}, which is bound to a
5430@code{<package>} object (@pxref{Defining Packages}).
113daf62 5431
300868ba 5432The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
5433automatically scanned for packages by the command-line tools. For
5434instance, when running @code{guix package -i emacs}, all the @code{(gnu
5435packages @dots{})} modules are scanned until one that exports a package
5436object whose name is @code{emacs} is found. This package search
5437facility is implemented in the @code{(gnu packages)} module.
113daf62 5438
300868ba 5439@cindex customization, of packages
8689901f 5440@cindex package module search path
cf4a9129 5441Users can store package definitions in modules with different
60142854
LC
5442names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
5443name and module name must match. @xref{Modules and the File System,,,
5444guile, GNU Guile Reference Manual}, for details.} These package definitions
300868ba
LC
5445will not be visible by default. Thus, users can invoke commands such as
5446@command{guix package} and @command{guix build} have to be used with the
5447@code{-e} option so that they know where to find the package, or use the
5448@code{-L} option of these commands to make those modules visible
8689901f
LC
5449(@pxref{Invoking guix build, @code{--load-path}}), or define the
5450@code{GUIX_PACKAGE_PATH} environment variable. This environment
5451variable makes it easy to extend or customize the distribution and is
5452honored by all the user interfaces.
5453
5454@defvr {Environment Variable} GUIX_PACKAGE_PATH
5455This is a colon-separated list of directories to search for package
5456modules. Directories listed in this variable take precedence over the
5457distribution's own modules.
5458@end defvr
ef5dd60a 5459
cf4a9129
LC
5460The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
5461each package is built based solely on other packages in the
5462distribution. The root of this dependency graph is a small set of
5463@dfn{bootstrap binaries}, provided by the @code{(gnu packages
5464bootstrap)} module. For more information on bootstrapping,
081145cf 5465@pxref{Bootstrapping}.
ef5dd60a 5466
cf4a9129
LC
5467@node Packaging Guidelines
5468@section Packaging Guidelines
ef5dd60a 5469
cf4a9129
LC
5470The GNU distribution is nascent and may well lack some of your favorite
5471packages. This section describes how you can help make the distribution
5472grow. @xref{Contributing}, for additional information on how you can
5473help.
ef5dd60a 5474
cf4a9129
LC
5475Free software packages are usually distributed in the form of
5476@dfn{source code tarballs}---typically @file{tar.gz} files that contain
5477all the source files. Adding a package to the distribution means
5478essentially two things: adding a @dfn{recipe} that describes how to
5479build the package, including a list of other packages required to build
5480it, and adding @dfn{package meta-data} along with that recipe, such as a
5481description and licensing information.
ef5dd60a 5482
cf4a9129
LC
5483In Guix all this information is embodied in @dfn{package definitions}.
5484Package definitions provide a high-level view of the package. They are
5485written using the syntax of the Scheme programming language; in fact,
5486for each package we define a variable bound to the package definition,
5487and export that variable from a module (@pxref{Package Modules}).
5488However, in-depth Scheme knowledge is @emph{not} a prerequisite for
5489creating packages. For more information on package definitions,
081145cf 5490@pxref{Defining Packages}.
ef5dd60a 5491
cf4a9129
LC
5492Once a package definition is in place, stored in a file in the Guix
5493source tree, it can be tested using the @command{guix build} command
5494(@pxref{Invoking guix build}). For example, assuming the new package is
5495called @code{gnew}, you may run this command from the Guix build tree:
ef5dd60a
LC
5496
5497@example
cf4a9129 5498./pre-inst-env guix build gnew --keep-failed
ef5dd60a 5499@end example
ef5dd60a 5500
cf4a9129
LC
5501Using @code{--keep-failed} makes it easier to debug build failures since
5502it provides access to the failed build tree. Another useful
5503command-line option when debugging is @code{--log-file}, to access the
5504build log.
ef5dd60a 5505
cf4a9129
LC
5506If the package is unknown to the @command{guix} command, it may be that
5507the source file contains a syntax error, or lacks a @code{define-public}
5508clause to export the package variable. To figure it out, you may load
5509the module from Guile to get more information about the actual error:
ef5dd60a 5510
cf4a9129
LC
5511@example
5512./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
5513@end example
ef5dd60a 5514
cf4a9129
LC
5515Once your package builds correctly, please send us a patch
5516(@pxref{Contributing}). Well, if you need help, we will be happy to
5517help you too. Once the patch is committed in the Guix repository, the
5518new package automatically gets built on the supported platforms by
2b1cee21 5519@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 5520system}.
ef5dd60a 5521
cf4a9129
LC
5522@cindex substituter
5523Users can obtain the new package definition simply by running
5524@command{guix pull} (@pxref{Invoking guix pull}). When
5525@code{hydra.gnu.org} is done building the package, installing the
5526package automatically downloads binaries from there
5527(@pxref{Substitutes}). The only place where human intervention is
5528needed is to review and apply the patch.
ef5dd60a 5529
ef5dd60a 5530
cf4a9129 5531@menu
ec0339cd
LC
5532* Software Freedom:: What may go into the distribution.
5533* Package Naming:: What's in a name?
5534* Version Numbers:: When the name is not enough.
5535* Python Modules:: Taming the snake.
5536* Perl Modules:: Little pearls.
5537* Fonts:: Fond of fonts.
cf4a9129 5538@end menu
ef5dd60a 5539
cf4a9129
LC
5540@node Software Freedom
5541@subsection Software Freedom
ef5dd60a 5542
cf4a9129 5543@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 5544
cf4a9129
LC
5545The GNU operating system has been developed so that users can have
5546freedom in their computing. GNU is @dfn{free software}, meaning that
5547users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
5548essential freedoms}: to run the program, to study and change the program
5549in source code form, to redistribute exact copies, and to distribute
5550modified versions. Packages found in the GNU distribution provide only
5551software that conveys these four freedoms.
c11a6eb1 5552
cf4a9129
LC
5553In addition, the GNU distribution follow the
5554@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
5555software distribution guidelines}. Among other things, these guidelines
5556reject non-free firmware, recommendations of non-free software, and
5557discuss ways to deal with trademarks and patents.
ef5dd60a 5558
cf4a9129
LC
5559Some packages contain a small and optional subset that violates the
5560above guidelines, for instance because this subset is itself non-free
5561code. When that happens, the offending items are removed with
5562appropriate patches or code snippets in the package definition's
5563@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
5564build --source} returns the ``freed'' source rather than the unmodified
5565upstream source.
ef5dd60a 5566
ef5dd60a 5567
cf4a9129
LC
5568@node Package Naming
5569@subsection Package Naming
ef5dd60a 5570
cf4a9129
LC
5571A package has actually two names associated with it:
5572First, there is the name of the @emph{Scheme variable}, the one following
5573@code{define-public}. By this name, the package can be made known in the
5574Scheme code, for instance as input to another package. Second, there is
5575the string in the @code{name} field of a package definition. This name
5576is used by package management commands such as
5577@command{guix package} and @command{guix build}.
ef5dd60a 5578
cf4a9129
LC
5579Both are usually the same and correspond to the lowercase conversion of
5580the project name chosen upstream, with underscores replaced with
5581hyphens. For instance, GNUnet is available as @code{gnunet}, and
5582SDL_net as @code{sdl-net}.
927097ef 5583
cf4a9129 5584We do not add @code{lib} prefixes for library packages, unless these are
081145cf 5585already part of the official project name. But @pxref{Python
cf4a9129
LC
5586Modules} and @ref{Perl Modules} for special rules concerning modules for
5587the Python and Perl languages.
927097ef 5588
1b366ee4 5589Font package names are handled differently, @pxref{Fonts}.
7fec52b7 5590
ef5dd60a 5591
cf4a9129
LC
5592@node Version Numbers
5593@subsection Version Numbers
ef5dd60a 5594
cf4a9129
LC
5595We usually package only the latest version of a given free software
5596project. But sometimes, for instance for incompatible library versions,
5597two (or more) versions of the same package are needed. These require
5598different Scheme variable names. We use the name as defined
5599in @ref{Package Naming}
5600for the most recent version; previous versions use the same name, suffixed
5601by @code{-} and the smallest prefix of the version number that may
5602distinguish the two versions.
ef5dd60a 5603
cf4a9129
LC
5604The name inside the package definition is the same for all versions of a
5605package and does not contain any version number.
ef5dd60a 5606
cf4a9129 5607For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 5608
cf4a9129
LC
5609@example
5610(define-public gtk+
5611 (package
5612 (name "gtk+")
5613 (version "3.9.12")
5614 ...))
5615(define-public gtk+-2
5616 (package
5617 (name "gtk+")
5618 (version "2.24.20")
5619 ...))
5620@end example
5621If we also wanted GTK+ 3.8.2, this would be packaged as
5622@example
5623(define-public gtk+-3.8
5624 (package
5625 (name "gtk+")
5626 (version "3.8.2")
5627 ...))
5628@end example
ef5dd60a 5629
ef5dd60a 5630
cf4a9129
LC
5631@node Python Modules
5632@subsection Python Modules
ef5dd60a 5633
cf4a9129
LC
5634We currently package Python 2 and Python 3, under the Scheme variable names
5635@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
5636To avoid confusion and naming clashes with other programming languages, it
5637seems desirable that the name of a package for a Python module contains
5638the word @code{python}.
ef5dd60a 5639
cf4a9129
LC
5640Some modules are compatible with only one version of Python, others with both.
5641If the package Foo compiles only with Python 3, we name it
5642@code{python-foo}; if it compiles only with Python 2, we name it
5643@code{python2-foo}. If it is compatible with both versions, we create two
5644packages with the corresponding names.
ef5dd60a 5645
cf4a9129
LC
5646If a project already contains the word @code{python}, we drop this;
5647for instance, the module python-dateutil is packaged under the names
5648@code{python-dateutil} and @code{python2-dateutil}.
113daf62 5649
523e4896 5650
cf4a9129
LC
5651@node Perl Modules
5652@subsection Perl Modules
523e4896 5653
cf4a9129
LC
5654Perl programs standing for themselves are named as any other package,
5655using the lowercase upstream name.
5656For Perl packages containing a single class, we use the lowercase class name,
5657replace all occurrences of @code{::} by dashes and prepend the prefix
5658@code{perl-}.
5659So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
5660Modules containing several classes keep their lowercase upstream name and
5661are also prepended by @code{perl-}. Such modules tend to have the word
5662@code{perl} somewhere in their name, which gets dropped in favor of the
5663prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 5664
523e4896 5665
7fec52b7
AE
5666@node Fonts
5667@subsection Fonts
5668
5669For fonts that are in general not installed by a user for typesetting
5670purposes, or that are distributed as part of a larger software package,
5671we rely on the general packaging rules for software; for instance, this
5672applies to the fonts delivered as part of the X.Org system or fonts that
5673are part of TeX Live.
5674
5675To make it easier for a user to search for fonts, names for other packages
5676containing only fonts are constructed as follows, independently of the
5677upstream package name.
5678
5679The name of a package containing only one font family starts with
5680@code{font-}; it is followed by the foundry name and a dash @code{-}
5681if the foundry is known, and the font family name, in which spaces are
5682replaced by dashes (and as usual, all upper case letters are transformed
5683to lower case).
5684For example, the Gentium font family by SIL is packaged under the name
5685@code{font-sil-gentium}.
5686
5687For a package containing several font families, the name of the collection
5688is used in the place of the font family name.
5689For instance, the Liberation fonts consist of three families,
5690Liberation Sans, Liberation Serif and Liberation Mono.
5691These could be packaged separately under the names
5692@code{font-liberation-sans} and so on; but as they are distributed together
5693under a common name, we prefer to package them together as
5694@code{font-liberation}.
5695
5696In the case where several formats of the same font family or font collection
5697are packaged separately, a short form of the format, prepended by a dash,
5698is added to the package name. We use @code{-ttf} for TrueType fonts,
1b366ee4 5699@code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
7fec52b7
AE
5700fonts.
5701
5702
b25937e3 5703
cf4a9129
LC
5704@node Bootstrapping
5705@section Bootstrapping
b25937e3 5706
cf4a9129 5707@c Adapted from the ELS 2013 paper.
b25937e3 5708
cf4a9129 5709@cindex bootstrapping
7889394e 5710
cf4a9129
LC
5711Bootstrapping in our context refers to how the distribution gets built
5712``from nothing''. Remember that the build environment of a derivation
5713contains nothing but its declared inputs (@pxref{Introduction}). So
5714there's an obvious chicken-and-egg problem: how does the first package
5715get built? How does the first compiler get compiled? Note that this is
5716a question of interest only to the curious hacker, not to the regular
5717user, so you can shamelessly skip this section if you consider yourself
5718a ``regular user''.
72b9d60d 5719
cf4a9129
LC
5720@cindex bootstrap binaries
5721The GNU system is primarily made of C code, with libc at its core. The
5722GNU build system itself assumes the availability of a Bourne shell and
5723command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
5724`grep'. Furthermore, build programs---programs that run
5725@code{./configure}, @code{make}, etc.---are written in Guile Scheme
5726(@pxref{Derivations}). Consequently, to be able to build anything at
5727all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
5728Binutils, libc, and the other packages mentioned above---the
5729@dfn{bootstrap binaries}.
72b9d60d 5730
cf4a9129
LC
5731These bootstrap binaries are ``taken for granted'', though we can also
5732re-create them if needed (more on that later).
72b9d60d 5733
cf4a9129 5734@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 5735
cf4a9129
LC
5736@c As of Emacs 24.3, Info-mode displays the image, but since it's a
5737@c large image, it's hard to scroll. Oh well.
5738@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 5739
cf4a9129
LC
5740The figure above shows the very beginning of the dependency graph of the
5741distribution, corresponding to the package definitions of the @code{(gnu
5742packages bootstrap)} module. At this level of detail, things are
5743slightly complex. First, Guile itself consists of an ELF executable,
5744along with many source and compiled Scheme files that are dynamically
5745loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
5746tarball shown in this graph. This tarball is part of Guix's ``source''
5747distribution, and gets inserted into the store with @code{add-to-store}
5748(@pxref{The Store}).
2e7b5cea 5749
cf4a9129
LC
5750But how do we write a derivation that unpacks this tarball and adds it
5751to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
5752derivation---the first one that gets built---uses @code{bash} as its
5753builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
5754@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
5755@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
5756the Guix source distribution, whose sole purpose is to allow the Guile
5757tarball to be unpacked.
fb729425 5758
cf4a9129
LC
5759Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
5760Guile that can be used to run subsequent build programs. Its first task
5761is to download tarballs containing the other pre-built binaries---this
5762is what the @code{.tar.xz.drv} derivations do. Guix modules such as
5763@code{ftp-client.scm} are used for this purpose. The
5764@code{module-import.drv} derivations import those modules in a directory
5765in the store, using the original layout. The
5766@code{module-import-compiled.drv} derivations compile those modules, and
5767write them in an output directory with the right layout. This
5768corresponds to the @code{#:modules} argument of
5769@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 5770
cf4a9129
LC
5771Finally, the various tarballs are unpacked by the
5772derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
5773etc., at which point we have a working C tool chain.
fb729425 5774
fb729425 5775
cf4a9129 5776@unnumberedsubsec Building the Build Tools
523e4896 5777
cf4a9129
LC
5778@c TODO: Add a package-level dependency graph generated from (gnu
5779@c packages base).
df2ce343 5780
cf4a9129
LC
5781Bootstrapping is complete when we have a full tool chain that does not
5782depend on the pre-built bootstrap tools discussed above. This
5783no-dependency requirement is verified by checking whether the files of
5784the final tool chain contain references to the @file{/gnu/store}
5785directories of the bootstrap inputs. The process that leads to this
5786``final'' tool chain is described by the package definitions found in
1f6f57df 5787the @code{(gnu packages commencement)} module.
df2ce343 5788
cf4a9129
LC
5789@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
5790The first tool that gets built with the bootstrap binaries is
5791GNU Make, which is a prerequisite for all the following packages.
5792From there Findutils and Diffutils get built.
523e4896 5793
cf4a9129
LC
5794Then come the first-stage Binutils and GCC, built as pseudo cross
5795tools---i.e., with @code{--target} equal to @code{--host}. They are
5796used to build libc. Thanks to this cross-build trick, this libc is
5797guaranteed not to hold any reference to the initial tool chain.
4af2447e 5798
cf4a9129
LC
5799From there the final Binutils and GCC are built. GCC uses @code{ld}
5800from the final Binutils, and links programs against the just-built libc.
5801This tool chain is used to build the other packages used by Guix and by
5802the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 5803
cf4a9129
LC
5804And voilà! At this point we have the complete set of build tools that
5805the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
5806variable of the @code{(gnu packages commencement)} module, and are
5807implicitly used by any package that uses @code{gnu-build-system}
1f6f57df 5808(@pxref{Build Systems, @code{gnu-build-system}}).
4af2447e 5809
4af2447e 5810
cf4a9129 5811@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 5812
cf4a9129
LC
5813Because the final tool chain does not depend on the bootstrap binaries,
5814those rarely need to be updated. Nevertheless, it is useful to have an
5815automated way to produce them, should an update occur, and this is what
5816the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 5817
cf4a9129
LC
5818The following command builds the tarballs containing the bootstrap
5819binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
5820of Coreutils and other basic command-line tools):
4b2615e1 5821
cf4a9129
LC
5822@example
5823guix build bootstrap-tarballs
5824@end example
5825
5826The generated tarballs are those that should be referred to in the
5827@code{(gnu packages bootstrap)} module mentioned at the beginning of
5828this section.
5829
5830Still here? Then perhaps by now you've started to wonder: when do we
5831reach a fixed point? That is an interesting question! The answer is
5832unknown, but if you would like to investigate further (and have
5833significant computational and storage resources to do so), then let us
5834know.
5835
5836@node Porting
5837@section Porting to a New Platform
5838
5839As discussed above, the GNU distribution is self-contained, and
5840self-containment is achieved by relying on pre-built ``bootstrap
5841binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
5842operating system kernel, CPU architecture, and application binary
5843interface (ABI). Thus, to port the distribution to a platform that is
5844not yet supported, one must build those bootstrap binaries, and update
5845the @code{(gnu packages bootstrap)} module to use them on that platform.
5846
5847Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
5848When everything goes well, and assuming the GNU tool chain supports the
5849target platform, this can be as simple as running a command like this
5850one:
5851
5852@example
5853guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
5854@end example
5855
1c0c417d
LC
5856For this to work, the @code{glibc-dynamic-linker} procedure in
5857@code{(gnu packages bootstrap)} must be augmented to return the right
5858file name for libc's dynamic linker on that platform; likewise,
5859@code{system->linux-architecture} in @code{(gnu packages linux)} must be
5860taught about the new platform.
5861
cf4a9129 5862Once these are built, the @code{(gnu packages bootstrap)} module needs
1c0c417d
LC
5863to be updated to refer to these binaries on the target platform. That
5864is, the hashes and URLs of the bootstrap tarballs for the new platform
5865must be added alongside those of the currently supported platforms. The
5866bootstrap Guile tarball is treated specially: it is expected to be
5867available locally, and @file{gnu-system.am} has rules do download it for
5868the supported architectures; a rule for the new platform must be added
5869as well.
cf4a9129
LC
5870
5871In practice, there may be some complications. First, it may be that the
5872extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
5873above) is not recognized by all the GNU tools. Typically, glibc
5874recognizes some of these, whereas GCC uses an extra @code{--with-abi}
5875configure flag (see @code{gcc.scm} for examples of how to handle this).
5876Second, some of the required packages could fail to build for that
5877platform. Lastly, the generated binaries could be broken for some
5878reason.
4af2447e
LC
5879
5880
9bf3c1a7
LC
5881@c *********************************************************************
5882@node Contributing
5883@chapter Contributing
5884
5885This project is a cooperative effort, and we need your help to make it
5ff3c4b8
PAR
5886grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
5887@code{#guix} on the Freenode IRC network. We welcome ideas, bug
5888reports, patches, and anything that may be helpful to the project. We
5889particularly welcome help on packaging (@pxref{Packaging Guidelines}).
a1ba8475 5890
9bf3c1a7
LC
5891Please see the
5892@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
5893@file{HACKING} file} that comes with the Guix source code for practical
5894details about contributions.
5895
c78bd12b 5896
568717fd
LC
5897@c *********************************************************************
5898@node Acknowledgments
5899@chapter Acknowledgments
5900
5901Guix is based on the Nix package manager, which was designed and
4c7ac9aa
LC
5902implemented by Eelco Dolstra, with contributions from other people (see
5903the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
5904management, and promoted unprecedented features, such as transactional
5905package upgrades and rollbacks, per-user profiles, and referentially
5906transparent build processes. Without this work, Guix would not exist.
5907
5908The Nix-based software distributions, Nixpkgs and NixOS, have also been
5909an inspiration for Guix.
5910
4c7ac9aa
LC
5911GNU@tie{}Guix itself is a collective work with contributions from a
5912number of people. See the @file{AUTHORS} file in Guix for more
5913information on these fine people. The @file{THANKS} file lists people
5914who have helped by reporting bugs, taking care of the infrastructure,
5915providing artwork and themes, making suggestions, and more---thank you!
5916
5917
568717fd
LC
5918@c *********************************************************************
5919@node GNU Free Documentation License
5920@appendix GNU Free Documentation License
5921
5922@include fdl-1.3.texi
5923
5924@c *********************************************************************
5925@node Concept Index
5926@unnumbered Concept Index
5927@printindex cp
5928
a85b83d2
LC
5929@node Programming Index
5930@unnumbered Programming Index
5931@syncodeindex tp fn
5932@syncodeindex vr fn
568717fd
LC
5933@printindex fn
5934
5935@bye
5936
5937@c Local Variables:
5938@c ispell-local-dictionary: "american";
5939@c End: