system: Account skeleton API is non-monadic.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
4379c35b 13Copyright @copyright{} 2012, 2013, 2014, 2015 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
87eafdbd 15Copyright @copyright{} 2013 Nikita Karetnikov@*
8c01b9d0
ML
16Copyright @copyright{} 2015 Mathieu Lirzin@*
17Copyright @copyright{} 2014 Pierre-Antoine Rault@*
87eafdbd 18Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer
7df7a74e
NK
19
20Permission is granted to copy, distribute and/or modify this document
21under the terms of the GNU Free Documentation License, Version 1.3 or
22any later version published by the Free Software Foundation; with no
23Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
24copy of the license is included in the section entitled ``GNU Free
25Documentation License''.
26@end copying
568717fd 27
eeaf4427 28@dircategory Package management
568717fd
LC
29@direntry
30* guix: (guix). Guix, the functional package manager.
e49951eb 31* guix package: (guix)Invoking guix package
eeaf4427 32 Managing packages with Guix.
e49951eb 33* guix build: (guix)Invoking guix build
568717fd 34 Building packages with Guix.
054e8576
LC
35* guix system: (guix)Invoking guix system
36 Managing the operating system configuration.
568717fd 37@end direntry
568717fd 38
372c4bbc
DT
39@dircategory Software development
40@direntry
41* guix environment: (guix)Invoking guix environment
42 Building development environments with Guix.
43@end direntry
44
568717fd 45@titlepage
7730d112
LC
46@title GNU Guix Reference Manual
47@subtitle Using the GNU Guix Functional Package Manager
2cbed07e 48@author The GNU Guix Developers
568717fd
LC
49
50@page
51@vskip 0pt plus 1filll
52Edition @value{EDITION} @*
53@value{UPDATED} @*
54
7df7a74e 55@insertcopying
568717fd
LC
56@end titlepage
57
568717fd
LC
58@contents
59
60@c *********************************************************************
61@node Top
f8348b91 62@top GNU Guix
568717fd 63
f8348b91
LC
64This document describes GNU Guix version @value{VERSION}, a functional
65package management tool written for the GNU system.
568717fd
LC
66
67@menu
68* Introduction:: What is Guix about?
bd5e766b 69* Installation:: Installing Guix.
eeaf4427 70* Package Management:: Package installation, upgrade, etc.
c554de89 71* Emacs Interface:: Using Guix from Emacs.
568717fd
LC
72* Programming Interface:: Using Guix in Scheme.
73* Utilities:: Package management commands.
a1ba8475 74* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 75* Contributing:: Your help needed!
568717fd
LC
76
77* Acknowledgments:: Thanks!
78* GNU Free Documentation License:: The license of this manual.
79* Concept Index:: Concepts.
a85b83d2 80* Programming Index:: Data types, functions, and variables.
aaa3eaa9
LC
81
82@detailmenu
83 --- The Detailed Node Listing ---
84
85Installation
86
1b2b8177 87* Binary Installation:: Getting Guix running in no time!
aaa3eaa9 88* Requirements:: Software needed to build and run Guix.
ec0339cd 89* Running the Test Suite:: Testing Guix.
aaa3eaa9
LC
90* Setting Up the Daemon:: Preparing the build daemon's environment.
91* Invoking guix-daemon:: Running the build daemon.
0e2d0213 92* Application Setup:: Application-specific setup.
aaa3eaa9
LC
93
94Setting Up the Daemon
95
96* Build Environment Setup:: Preparing the isolated build environment.
97* Daemon Offload Setup:: Offloading builds to remote machines.
98
99Package Management
100
101* Features:: How Guix will make your life brighter.
102* Invoking guix package:: Package installation, removal, etc.
aaa3eaa9
LC
103* Substitutes:: Downloading pre-built binaries.
104* Packages with Multiple Outputs:: Single source package, multiple outputs.
105* Invoking guix gc:: Running the garbage collector.
106* Invoking guix pull:: Fetching the latest Guix and distribution.
107* Invoking guix archive:: Exporting and importing store files.
108
c554de89
AK
109Emacs Interface
110
111* Initial Setup: Emacs Initial Setup. Preparing @file{~/.emacs}.
112* Package Management: Emacs Package Management. Managing packages and generations.
9b0afb0d 113* Popup Interface: Emacs Popup Interface. Magit-like interface for guix commands.
c554de89 114* Prettify Mode: Emacs Prettify. Abbreviating @file{/gnu/store/@dots{}} file names.
34850cd5 115* Build Log Mode: Emacs Build Log. Highlighting Guix build logs.
187f80c6
AK
116* Completions: Emacs Completions. Completing @command{guix} shell command.
117* Development: Emacs Development. Tools for Guix developers.
c554de89 118
aaa3eaa9
LC
119Programming Interface
120
121* Defining Packages:: Defining new packages.
122* Build Systems:: Specifying how packages are built.
123* The Store:: Manipulating the package store.
124* Derivations:: Low-level interface to package derivations.
125* The Store Monad:: Purely functional interface to the store.
126* G-Expressions:: Manipulating build expressions.
127
92492b23
LC
128Defining Packages
129
130* package Reference:: The package data type.
131* origin Reference:: The origin data type.
132
aaa3eaa9
LC
133Utilities
134
135* Invoking guix build:: Building packages from the command line.
fcc58db6 136* Invoking guix edit:: Editing package definitions.
aaa3eaa9
LC
137* Invoking guix download:: Downloading a file and printing its hash.
138* Invoking guix hash:: Computing the cryptographic hash of a file.
139* Invoking guix import:: Importing package definitions.
140* Invoking guix refresh:: Updating package definitions.
141* Invoking guix lint:: Finding errors in package definitions.
fcc58db6 142* Invoking guix size:: Profiling disk usage.
88856916 143* Invoking guix graph:: Visualizing the graph of packages.
aaa3eaa9 144* Invoking guix environment:: Setting up development environments.
aff8ce7c 145* Invoking guix publish:: Sharing substitutes.
aaa3eaa9
LC
146
147GNU Distribution
148
149* System Installation:: Installing the whole operating system.
35ed9306 150* System Configuration:: Configuring the operating system.
aaa3eaa9
LC
151* Installing Debugging Files:: Feeding the debugger.
152* Security Updates:: Deploying security fixes quickly.
153* Package Modules:: Packages from the programmer's viewpoint.
154* Packaging Guidelines:: Growing the distribution.
155* Bootstrapping:: GNU/Linux built from scratch.
156* Porting:: Targeting another platform or kernel.
157
158System Configuration
159
160* Using the Configuration System:: Customizing your GNU system.
161* operating-system Reference:: Detail of operating-system declarations.
162* File Systems:: Configuring file system mounts.
163* Mapped Devices:: Block device extra processing.
164* User Accounts:: Specifying user accounts.
598e19dc 165* Locales:: Language and cultural convention settings.
aaa3eaa9
LC
166* Services:: Specifying system services.
167* Setuid Programs:: Programs running with root privileges.
1b2b8177 168* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 169* Name Service Switch:: Configuring libc's name service switch.
aaa3eaa9
LC
170* Initial RAM Disk:: Linux-Libre bootstrapping.
171* GRUB Configuration:: Configuring the boot loader.
172* Invoking guix system:: Instantiating a system configuration.
173* Defining Services:: Adding new service definitions.
174
175Services
176
177* Base Services:: Essential system services.
178* Networking Services:: Network setup, SSH daemon, etc.
179* X Window:: Graphical display.
1b2b8177
LC
180* Desktop Services:: D-Bus and desktop services.
181* Database Services:: SQL databases.
cbd02397 182* Web Services:: Web servers.
aa4ed923 183* Various Services:: Other services.
aaa3eaa9
LC
184
185Packaging Guidelines
186
ec0339cd
LC
187* Software Freedom:: What may go into the distribution.
188* Package Naming:: What's in a name?
189* Version Numbers:: When the name is not enough.
cbd02397 190* Synopses and Descriptions:: Helping users find the right package.
ec0339cd
LC
191* Python Modules:: Taming the snake.
192* Perl Modules:: Little pearls.
193* Fonts:: Fond of fonts.
aaa3eaa9 194
8c01b9d0
ML
195Contributing
196
197* Building from Git:: The latest and greatest.
198* Running Guix Before It Is Installed:: Hacker tricks.
199* The Perfect Setup:: The right tools.
200* Coding Style:: Hygiene of the contributor.
201* Submitting Patches:: Share your work.
202
203Coding Style
204
205* Programming Paradigm:: How to compose your elements.
206* Modules:: Where to store your code?
207* Data Types and Pattern Matching:: Implementing data structures.
208* Formatting Code:: Writing conventions.
209
aaa3eaa9 210@end detailmenu
568717fd
LC
211@end menu
212
213@c *********************************************************************
214@node Introduction
215@chapter Introduction
216
c80e7e55
LC
217GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
218using the international phonetic alphabet (IPA).} is a functional
219package management tool for the GNU system. Package management consists
4bfc4ea3
NK
220of all activities that relate to building packages from sources,
221honoring their build-time and run-time dependencies,
c80e7e55
LC
222installing packages in user environments, upgrading installed packages
223to new versions or rolling back to a previous set, removing unused
224software packages, etc.
568717fd
LC
225
226@cindex functional package management
227The term @dfn{functional} refers to a specific package management
228discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
229as a function, in the mathematical sense. That function takes inputs,
230such as build scripts, a compiler, and libraries, and
231returns an installed package. As a pure function, its result depends
568717fd
LC
232solely on its inputs---for instance, it cannot refer to software or
233scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
234always produces the same result when passed a given set of inputs. It
235cannot alter the system's environment in
568717fd
LC
236any way; for instance, it cannot create, modify, or delete files outside
237of its build and installation directories. This is achieved by running
e900c503 238build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 239explicit inputs are visible.
568717fd 240
e531ac2a 241@cindex store
568717fd 242The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
243system, in a special directory called @dfn{the store} (@pxref{The
244Store}). Each package is installed in a directory of its own, in the
834129e0 245store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
246a hash of all the inputs used to build that package; thus, changing an
247input yields a different directory name.
248
249This approach is the foundation of Guix's salient features: support for
4bfc4ea3 250transactional package upgrade and rollback, per-user installation, and
eeaf4427 251garbage collection of packages (@pxref{Features}).
568717fd 252
4bfc4ea3 253Guix has a command-line interface, which allows users to build, install,
568717fd 254upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 255
3ca2731c 256@cindex Guix System Distribution
4705641f 257@cindex GuixSD
a1ba8475 258Last but not least, Guix is used to build a distribution of the GNU
3ca2731c 259system, with many GNU and non-GNU free software packages. The Guix
4705641f
LC
260System Distribution, or GNU@tie{}GuixSD, takes advantage of the core
261properties of Guix at the system level. With GuixSD, users
3ca2731c
LC
262@emph{declare} all aspects of the operating system configuration, and
263Guix takes care of instantiating that configuration in a reproducible,
264stateless fashion. @xref{GNU Distribution}.
a1ba8475 265
bd5e766b
LC
266@c *********************************************************************
267@node Installation
268@chapter Installation
269
48febeb8
LC
270GNU Guix is available for download from its website at
271@url{http://www.gnu.org/software/guix/}. This section describes the
272software requirements of Guix, as well as how to install it and get
273ready to use it.
bd5e766b 274
5af6de3e
LC
275Note that this section is concerned with the installation of the package
276manager, which can be done on top of a running GNU/Linux system. If,
277instead, you want to install the complete GNU operating system,
6621cdb6 278@pxref{System Installation}.
5af6de3e 279
bd5e766b 280@menu
09722b11 281* Binary Installation:: Getting Guix running in no time!
bd5e766b 282* Requirements:: Software needed to build and run Guix.
ec0339cd 283* Running the Test Suite:: Testing Guix.
bd5e766b
LC
284* Setting Up the Daemon:: Preparing the build daemon's environment.
285* Invoking guix-daemon:: Running the build daemon.
0e2d0213 286* Application Setup:: Application-specific setup.
bd5e766b
LC
287@end menu
288
09722b11
LC
289@node Binary Installation
290@section Binary Installation
291
292This section describes how to install Guix on an arbitrary system from a
293self-contained tarball providing binaries for Guix and for all its
294dependencies. This is often quicker than installing from source, which
295is described in the next sections. The only requirement is to have
296GNU@tie{}tar and Xz.
297
298Installing goes along these lines:
299
300@enumerate
301@item
302Download the binary tarball from
ae806096 303@indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz}@footnote{As
09722b11
LC
304usual, make sure to download the associated @file{.sig} file and to
305verify the authenticity of the tarball against it!}, where @var{system}
306is @code{x86_64-linux} for an @code{x86_64} machine already running the
307kernel Linux, and so on.
308
309@item
310As @code{root}, run:
311
312@example
5dc42964 313# cd /tmp
254b1c2e
LC
314# tar --warning=no-timestamp -xf \
315 guix-binary-@value{VERSION}.@var{system}.tar.xz
5dc42964 316# mv var/guix /var/ && mv gnu /
09722b11
LC
317@end example
318
7acd3439
LC
319This creates @file{/gnu/store} (@pxref{The Store}) and @file{/var/guix}.
320The latter contains a ready-to-use profile for @code{root} (see next
321step.)
09722b11 322
5dc3ce5f
LC
323Do @emph{not} unpack the tarball on a working Guix system since that
324would overwrite its own essential files.
325
254b1c2e 326The @code{--warning=no-timestamp} option makes sure GNU@tie{}tar does
e9ba6357
LC
327not emit warnings about ``implausibly old time stamps'' (such
328warnings were triggered by GNU@tie{}tar 1.26 and older; recent
329versions are fine.)
330They stem from the fact that all the
254b1c2e
LC
331files in the archive have their modification time set to zero (which
332means January 1st, 1970.) This is done on purpose to make sure the
333archive content is independent of its creation time, thus making it
334reproducible.
335
7acd3439
LC
336@item
337Make @code{root}'s profile available under @file{~/.guix-profile}:
338
339@example
340# ln -sf /var/guix/profiles/per-user/root/guix-profile \
341 ~root/.guix-profile
342@end example
343
43c33047
LC
344@item
345Create the group and user accounts for build users as explained below
346(@pxref{Build Environment Setup}).
347
09722b11 348@item
175ced41 349Run the daemon:
09722b11
LC
350
351@example
7acd3439 352# ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
09722b11
LC
353@end example
354
d2825c96
LC
355On hosts using the systemd init system, drop
356@file{~root/.guix-profile/lib/systemd/system/guix-daemon.service} in
357@file{/etc/systemd/system}.
358
09722b11
LC
359@item
360Make the @command{guix} command available to other users on the machine,
361for instance with:
362
363@example
364# mkdir -p /usr/local/bin
365# cd /usr/local/bin
d72d05f9 366# ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
09722b11 367@end example
39f8ed14
LC
368
369@item
370To use substitutes from @code{hydra.gnu.org} (@pxref{Substitutes}),
371authorize them:
372
373@example
7acd3439 374# guix archive --authorize < ~root/.guix-profile/share/guix/hydra.gnu.org.pub
39f8ed14 375@end example
09722b11
LC
376@end enumerate
377
53de532f
LC
378And that's it! For additional tips and tricks, @pxref{Application
379Setup}.
09722b11 380
5dc3ce5f 381The @code{guix} package must remain available in @code{root}'s
09722b11
LC
382profile, or it would become subject to garbage collection---in which
383case you would find yourself badly handicapped by the lack of the
384@command{guix} command.
385
39f8ed14
LC
386The tarball in question can be (re)produced and verified simply by
387running the following command in the Guix source tree:
09722b11
LC
388
389@example
390make guix-binary.@var{system}.tar.xz
391@end example
392
393
bd5e766b
LC
394@node Requirements
395@section Requirements
396
09722b11
LC
397This section lists requirements when building Guix from source. The
398build procedure for Guix is the same as for other GNU software, and is
399not covered here. Please see the files @file{README} and @file{INSTALL}
400in the Guix source tree for additional details.
401
bd5e766b
LC
402GNU Guix depends on the following packages:
403
404@itemize
47c66da0 405@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
288dca55 406@item @url{http://gnupg.org/, GNU libgcrypt};
f0b98b84 407@item @url{http://www.gnu.org/software/make/, GNU Make}.
8a96bd4b
ID
408@end itemize
409
410The following dependencies are optional:
411
412@itemize
288dca55 413@item
8a96bd4b 414Installing
288dca55 415@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
416allow you to use the @command{guix import pypi} command (@pxref{Invoking
417guix import}). It is of
288dca55 418interest primarily for developers and not for casual users.
8a96bd4b
ID
419@item
420Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
421allow you to access @code{https} URLs with the @command{guix download}
d45dc6da
EB
422command (@pxref{Invoking guix download}), the @command{guix import pypi}
423command, and the @command{guix import cpan} command. This is primarily
424of interest to developers. @xref{Guile Preparations, how to install the
425GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
426@end itemize
427
428Unless @code{--disable-daemon} was passed to @command{configure}, the
429following packages are also needed:
430
431@itemize
368d08f7
LC
432@item @url{http://sqlite.org, SQLite 3};
433@item @url{http://www.bzip.org, libbz2};
434@item @url{http://gcc.gnu.org, GCC's g++}, with support for the
435C++11 standard.
bd5e766b
LC
436@end itemize
437
4bfc4ea3
NK
438When a working installation of @url{http://nixos.org/nix/, the Nix package
439manager} is available, you
bd5e766b 440can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 441Nix replaces the three dependencies above.
bd5e766b 442
b22a12fd
LC
443Guix is compatible with Nix, so it is possible to share the same store
444between both. To do so, you must pass @command{configure} not only the
445same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
446@code{--localstatedir} value. The latter is essential because it
447specifies where the database that stores metadata about the store is
834129e0 448located, among other things. The default values for Nix are
b22a12fd 449@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
450Note that @code{--disable-daemon} is not required if
451your goal is to share the store with Nix.
b22a12fd 452
ec0339cd
LC
453@node Running the Test Suite
454@section Running the Test Suite
455
456After a successful @command{configure} and @code{make} run, it is a good
457idea to run the test suite. It can help catch issues with the setup or
458environment, or bugs in Guix itself---and really, reporting test
459failures is a good way to help improve the software. To run the test
460suite, type:
461
462@example
463make check
464@end example
465
466Test cases can run in parallel: you can use the @code{-j} option of
467GNU@tie{}make to speed things up. The first run may take a few minutes
468on a recent machine; subsequent runs will be faster because the store
469that is created for test purposes will already have various things in
470cache.
471
472Upon failure, please email @email{bug-guix@@gnu.org} and attach the
473@file{test-suite.log} file. When @file{tests/@var{something}.scm}
474fails, please also attach the @file{@var{something}.log} file available
475in the top-level build directory. Please specify the Guix version being
476used as well as version numbers of the dependencies
477(@pxref{Requirements}) in your message.
478
bd5e766b
LC
479@node Setting Up the Daemon
480@section Setting Up the Daemon
481
482@cindex daemon
483Operations such as building a package or running the garbage collector
49e6291a 484are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
485behalf of clients. Only the daemon may access the store and its
486associated database. Thus, any operation that manipulates the store
487goes through the daemon. For instance, command-line tools such as
e49951eb 488@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
489daemon (@i{via} remote procedure calls) to instruct it what to do.
490
49e6291a 491The following sections explain how to prepare the build daemon's
225dafde
LC
492environment. Also @ref{Substitutes}, for information on how to allow
493the daemon to download pre-built binaries.
49e6291a
LC
494
495@menu
496* Build Environment Setup:: Preparing the isolated build environment.
497* Daemon Offload Setup:: Offloading builds to remote machines.
498@end menu
499
500@node Build Environment Setup
501@subsection Build Environment Setup
502
bd5e766b
LC
503In a standard multi-user setup, Guix and its daemon---the
504@command{guix-daemon} program---are installed by the system
834129e0 505administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
506@command{guix-daemon} runs as @code{root}. Unprivileged users may use
507Guix tools to build packages or otherwise access the store, and the
508daemon will do it on their behalf, ensuring that the store is kept in a
509consistent state, and allowing built packages to be shared among users.
510
511@cindex build users
512When @command{guix-daemon} runs as @code{root}, you may not want package
513build processes themselves to run as @code{root} too, for obvious
514security reasons. To avoid that, a special pool of @dfn{build users}
515should be created for use by build processes started by the daemon.
516These build users need not have a shell and a home directory: they will
517just be used when the daemon drops @code{root} privileges in build
518processes. Having several such users allows the daemon to launch
519distinct build processes under separate UIDs, which guarantees that they
520do not interfere with each other---an essential feature since builds are
521regarded as pure functions (@pxref{Introduction}).
522
523On a GNU/Linux system, a build user pool may be created like this (using
524Bash syntax and the @code{shadow} commands):
525
091196b3
LC
526@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
527@c for why `-G' is needed.
bd5e766b 528@example
cfc149dc
LC
529# groupadd --system guixbuild
530# for i in `seq -w 1 10`;
bd5e766b 531 do
cfc149dc
LC
532 useradd -g guixbuild -G guixbuild \
533 -d /var/empty -s `which nologin` \
534 -c "Guix build user $i" --system \
535 guixbuilder$i;
bd5e766b
LC
536 done
537@end example
538
539@noindent
54eb03ab
LC
540The number of build users determines how many build jobs may run in
541parallel, as specified by the @option{--max-jobs} option
d2825c96
LC
542(@pxref{Invoking guix-daemon, @option{--max-jobs}}). The
543@code{guix-daemon} program may then be run as @code{root} with the
544following command@footnote{If your machine uses the systemd init system,
545dropping the @file{@var{prefix}/lib/systemd/system/guix-daemon.service}
546file in @file{/etc/systemd/system} will ensure that
547@command{guix-daemon} is automatically started.}:
bd5e766b
LC
548
549@example
cfc149dc 550# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
551@end example
552
e900c503 553@cindex chroot
b095792f
LC
554@noindent
555This way, the daemon starts build processes in a chroot, under one of
cfc149dc 556the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
557environment contains nothing but:
558
559@c Keep this list in sync with libstore/build.cc! -----------------------
560@itemize
561@item
4743a4da
LC
562a minimal @code{/dev} directory, created mostly independently from the
563host @code{/dev}@footnote{``Mostly'', because while the set of files
564that appear in the chroot's @code{/dev} is fixed, most of these files
565can only be created if the host has them.};
566
567@item
568the @code{/proc} directory; it only shows the container's processes
569since a separate PID name space is used;
6dc99317
LC
570
571@item
572@file{/etc/passwd} with an entry for the current user and an entry for
573user @file{nobody};
574
575@item
576@file{/etc/group} with an entry for the user's group;
577
578@item
579@file{/etc/hosts} with an entry that maps @code{localhost} to
580@code{127.0.0.1};
581
582@item
583a writable @file{/tmp} directory.
584@end itemize
b095792f 585
1e2644bb
LC
586If you are installing Guix as an unprivileged user, it is still possible
587to run @command{guix-daemon} provided you pass @code{--disable-chroot}.
588However, build processes will not be isolated from one another, and not
589from the rest of the system. Thus, build processes may interfere with
590each other, and may access programs, libraries, and other files
591available on the system---making it much harder to view them as
592@emph{pure} functions.
bd5e766b 593
49e6291a
LC
594
595@node Daemon Offload Setup
596@subsection Using the Offload Facility
597
598@cindex offloading
4ec2e92d
LC
599@cindex build hook
600When desired, the build daemon can @dfn{offload}
601derivation builds to other machines
49e6291a
LC
602running Guix, using the @code{offload} @dfn{build hook}. When that
603feature is enabled, a list of user-specified build machines is read from
604@file{/etc/guix/machines.scm}; anytime a build is requested, for
605instance via @code{guix build}, the daemon attempts to offload it to one
606of the machines that satisfies the derivation's constraints, in
607particular its system type---e.g., @file{x86_64-linux}. Missing
608prerequisites for the build are copied over SSH to the target machine,
609which then proceeds with the build; upon success the output(s) of the
610build are copied back to the initial machine.
611
4ec2e92d 612The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
613
614@example
615(list (build-machine
616 (name "eightysix.example.org")
617 (system "x86_64-linux")
618 (user "bob")
619 (speed 2.)) ; incredibly fast!
620
621 (build-machine
622 (name "meeps.example.org")
623 (system "mips64el-linux")
624 (user "alice")
625 (private-key
626 (string-append (getenv "HOME")
c4fdfd6f 627 "/.lsh/identity-for-guix"))))
49e6291a
LC
628@end example
629
630@noindent
631In the example above we specify a list of two build machines, one for
632the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
633architecture.
634
635In fact, this file is---not surprisingly!---a Scheme file that is
636evaluated when the @code{offload} hook is started. Its return value
637must be a list of @code{build-machine} objects. While this example
638shows a fixed list of build machines, one could imagine, say, using
639DNS-SD to return a list of potential build machines discovered in the
640local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
641Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
642detailed below.
4ec2e92d 643
c678a4ee
LC
644@deftp {Data Type} build-machine
645This data type represents build machines the daemon may offload builds
646to. The important fields are:
49e6291a
LC
647
648@table @code
649
650@item name
651The remote machine's host name.
652
653@item system
c678a4ee 654The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
655
656@item user
657The user account to use when connecting to the remote machine over SSH.
658Note that the SSH key pair must @emph{not} be passphrase-protected, to
659allow non-interactive logins.
660
661@end table
662
4ec2e92d 663A number of optional fields may be specified:
49e6291a
LC
664
665@table @code
666
cecd72d5
LC
667@item port
668Port number of the machine's SSH server (default: 22).
669
49e6291a
LC
670@item private-key
671The SSH private key file to use when connecting to the machine.
672
c4fdfd6f
LC
673Currently offloading uses GNU@tie{}lsh as its SSH client
674(@pxref{Invoking lsh,,, GNU lsh Manual}). Thus, the key file here must
675be an lsh key file. This may change in the future, though.
676
49e6291a
LC
677@item parallel-builds
678The number of builds that may run in parallel on the machine (1 by
679default.)
680
681@item speed
682A ``relative speed factor''. The offload scheduler will tend to prefer
683machines with a higher speed factor.
684
685@item features
686A list of strings denoting specific features supported by the machine.
687An example is @code{"kvm"} for machines that have the KVM Linux modules
688and corresponding hardware support. Derivations can request features by
689name, and they will be scheduled on matching build machines.
690
691@end table
c678a4ee 692@end deftp
49e6291a
LC
693
694The @code{guix} command must be in the search path on the build
695machines, since offloading works by invoking the @code{guix archive} and
c4fdfd6f
LC
696@code{guix build} commands. In addition, the Guix modules must be in
697@code{$GUILE_LOAD_PATH} on the build machine---you can check whether
698this is the case by running:
699
700@example
701lsh build-machine guile -c '(use-modules (guix config))'
702@end example
49e6291a
LC
703
704There's one last thing to do once @file{machines.scm} is in place. As
705explained above, when offloading, files are transferred back and forth
c4fdfd6f
LC
706between the machine stores. For this to work, you first need to
707generate a key pair on each machine to allow the daemon to export signed
708archives of files from the store (@pxref{Invoking guix archive}):
49e6291a
LC
709
710@example
711# guix archive --generate-key
712@end example
713
714@noindent
c4fdfd6f
LC
715Each build machine must authorize the key of the master machine so that
716it accepts store items it receives from the master:
717
718@example
719# guix archive --authorize < master-public-key.txt
720@end example
721
722@noindent
723Likewise, the master machine must authorize the key of each build machine.
724
725All the fuss with keys is here to express pairwise mutual trust
726relations between the master and the build machines. Concretely, when
727the master receives files from a build machine (and @i{vice versa}), its
728build daemon can make sure they are genuine, have not been tampered
729with, and that they are signed by an authorized key.
49e6291a
LC
730
731
bd5e766b
LC
732@node Invoking guix-daemon
733@section Invoking @command{guix-daemon}
734
735The @command{guix-daemon} program implements all the functionality to
736access the store. This includes launching build processes, running the
737garbage collector, querying the availability of a build result, etc. It
738is normally run as @code{root} like this:
739
740@example
cfc149dc 741# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
742@end example
743
744@noindent
081145cf 745For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 746
e900c503
LC
747@cindex chroot
748@cindex container, build environment
749@cindex build environment
750@cindex reproducible builds
bd5e766b
LC
751By default, @command{guix-daemon} launches build processes under
752different UIDs, taken from the build group specified with
753@code{--build-users-group}. In addition, each build process is run in a
754chroot environment that only contains the subset of the store that the
755build process depends on, as specified by its derivation
756(@pxref{Programming Interface, derivation}), plus a set of specific
757system directories. By default, the latter contains @file{/dev} and
e900c503
LC
758@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
759@dfn{container}: in addition to having its own file system tree, it has
760a separate mount name space, its own PID name space, network name space,
761etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b 762
cbc538fe
LC
763When the daemon performs a build on behalf of the user, it creates a
764build directory under @file{/tmp} or under the directory specified by
765its @code{TMPDIR} environment variable; this directory is shared with
766the container for the duration of the build. Be aware that using a
767directory other than @file{/tmp} can affect build results---for example,
768with a longer directory name, a build process that uses Unix-domain
769sockets might hit the name length limitation for @code{sun_path}, which
770it would otherwise not hit.
771
772The build directory is automatically deleted upon completion, unless the
773build failed and the client specified @option{--keep-failed}
774(@pxref{Invoking guix build, @option{--keep-failed}}).
775
bd5e766b
LC
776The following command-line options are supported:
777
778@table @code
779@item --build-users-group=@var{group}
780Take users from @var{group} to run build processes (@pxref{Setting Up
781the Daemon, build users}).
782
6858f9d1 783@item --no-substitutes
b5385b52 784@cindex substitutes
6858f9d1 785Do not use substitutes for build products. That is, always build things
c4202d60
LC
786locally instead of allowing downloads of pre-built binaries
787(@pxref{Substitutes}).
6858f9d1 788
b5385b52
LC
789By default substitutes are used, unless the client---such as the
790@command{guix package} command---is explicitly invoked with
791@code{--no-substitutes}.
792
793When the daemon runs with @code{--no-substitutes}, clients can still
794explicitly enable substitution @i{via} the @code{set-build-options}
795remote procedure call (@pxref{The Store}).
796
9176607e 797@item --substitute-urls=@var{urls}
f8a8e0fe 798@anchor{daemon-substitute-urls}
9176607e 799Consider @var{urls} the default whitespace-separated list of substitute
ae806096 800source URLs. When this option is omitted, @indicateurl{http://hydra.gnu.org}
9176607e
LC
801is used.
802
803This means that substitutes may be downloaded from @var{urls}, as long
804as they are signed by a trusted signature (@pxref{Substitutes}).
805
4ec2e92d
LC
806@cindex build hook
807@item --no-build-hook
808Do not use the @dfn{build hook}.
809
810The build hook is a helper program that the daemon can start and to
811which it submits build requests. This mechanism is used to offload
812builds to other machines (@pxref{Daemon Offload Setup}).
813
bd5e766b
LC
814@item --cache-failures
815Cache build failures. By default, only successful builds are cached.
816
30d9aa54
LC
817When this option is used, @command{guix gc --list-failures} can be used
818to query the set of store items marked as failed; @command{guix gc
819--clear-failures} removes store items from the set of cached failures.
820@xref{Invoking guix gc}.
821
bd5e766b
LC
822@item --cores=@var{n}
823@itemx -c @var{n}
824Use @var{n} CPU cores to build each derivation; @code{0} means as many
825as available.
826
6efc160e 827The default value is @code{0}, but it may be overridden by clients, such
e49951eb
MW
828as the @code{--cores} option of @command{guix build} (@pxref{Invoking
829guix build}).
bd5e766b
LC
830
831The effect is to define the @code{NIX_BUILD_CORES} environment variable
832in the build process, which can then use it to exploit internal
833parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
834
835@item --max-jobs=@var{n}
836@itemx -M @var{n}
837Allow at most @var{n} build jobs in parallel. The default value is
f6526eb3
LC
838@code{1}. Setting it to @code{0} means that no builds will be performed
839locally; instead, the daemon will offload builds (@pxref{Daemon Offload
840Setup}), or simply fail.
bd5e766b
LC
841
842@item --debug
843Produce debugging output.
844
845This is useful to debug daemon start-up issues, but then it may be
846overridden by clients, for example the @code{--verbosity} option of
e49951eb 847@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
848
849@item --chroot-directory=@var{dir}
850Add @var{dir} to the build chroot.
851
852Doing this may change the result of build processes---for instance if
853they use optional dependencies found in @var{dir} when it is available,
854and not otherwise. For that reason, it is not recommended to do so.
855Instead, make sure that each derivation declares all the inputs that it
856needs.
857
858@item --disable-chroot
859Disable chroot builds.
860
861Using this option is not recommended since, again, it would allow build
1e2644bb
LC
862processes to gain access to undeclared dependencies. It is necessary,
863though, when @command{guix-daemon} is running under an unprivileged user
864account.
bd5e766b
LC
865
866@item --disable-log-compression
867Disable compression of the build logs.
868
1da983b9
LC
869Unless @code{--lose-logs} is used, all the build logs are kept in the
870@var{localstatedir}. To save space, the daemon automatically compresses
871them with bzip2 by default. This option disables that.
872
ab3893d7
LC
873@item --disable-deduplication
874@cindex deduplication
bd5e766b
LC
875Disable automatic file ``deduplication'' in the store.
876
1da983b9 877By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
878if a newly added file is identical to another one found in the store,
879the daemon makes the new file a hard link to the other file. This can
4988dd40 880noticeably reduce disk usage, at the expense of slightly increased
ab3893d7
LC
881input/output load at the end of a build process. This option disables
882this optimization.
1da983b9 883
6e37066e
LC
884@item --gc-keep-outputs[=yes|no]
885Tell whether the garbage collector (GC) must keep outputs of live
886derivations.
887
888When set to ``yes'', the GC will keep the outputs of any live derivation
889available in the store---the @code{.drv} files. The default is ``no'',
890meaning that derivation outputs are kept only if they are GC roots.
891
892@item --gc-keep-derivations[=yes|no]
893Tell whether the garbage collector (GC) must keep derivations
894corresponding to live outputs.
895
896When set to ``yes'', as is the case by default, the GC keeps
897derivations---i.e., @code{.drv} files---as long as at least one of their
898outputs is live. This allows users to keep track of the origins of
899items in their store. Setting it to ``no'' saves a bit of disk space.
900
901Note that when both @code{--gc-keep-derivations} and
902@code{--gc-keep-outputs} are used, the effect is to keep all the build
903prerequisites (the sources, compiler, libraries, and other build-time
904tools) of live objects in the store, regardless of whether these
905prerequisites are live. This is convenient for developers since it
906saves rebuilds or downloads.
907
bd5e766b
LC
908@item --impersonate-linux-2.6
909On Linux-based systems, impersonate Linux 2.6. This means that the
910kernel's @code{uname} system call will report 2.6 as the release number.
911
912This might be helpful to build programs that (usually wrongfully) depend
913on the kernel version number.
914
915@item --lose-logs
916Do not keep build logs. By default they are kept under
ce33631f 917@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
918
919@item --system=@var{system}
920Assume @var{system} as the current system type. By default it is the
921architecture/kernel pair found at configure time, such as
922@code{x86_64-linux}.
b8d2aa26
LC
923
924@item --listen=@var{socket}
925Listen for connections on @var{socket}, the file name of a Unix-domain
926socket. The default socket is
927@file{@var{localstatedir}/daemon-socket/socket}. This option is only
928useful in exceptional circumstances, such as if you need to run several
929daemons on the same machine.
bd5e766b
LC
930@end table
931
932
0e2d0213
LC
933@node Application Setup
934@section Application Setup
935
936When using Guix on top of GNU/Linux distribution other than GuixSD, a
937few additional steps are needed to get everything in place. Here are
938some of them.
939
940@subsection Locales
941
5c3c1427 942@anchor{locales-and-locpath}
0e2d0213 943@cindex locales, when not on GuixSD
5c3c1427 944@vindex LOCPATH
0e2d0213
LC
945Packages installed @i{via} Guix will not use the host system's locale
946data. Instead, you must first install one of the locale packages
947available with Guix and then define the @code{LOCPATH} environment
948variable (@pxref{Locale Names, @code{LOCPATH},, libc, The GNU C Library
949Reference Manual}):
950
951@example
952$ guix package -i glibc-locales
953$ export LOCPATH=$HOME/.guix-profile/lib/locale
954@end example
955
956Note that the @code{glibc-locales} package contains data for all the
957locales supported by the GNU@tie{}libc and weighs in at around
958110@tie{}MiB. Alternately, the @code{glibc-utf8-locales} is smaller but
959limited to a few UTF-8 locales.
960
961@subsection X11 Fonts
962
4988dd40 963The majority of graphical applications use Fontconfig to locate and
0e2d0213
LC
964load fonts and perform X11-client-side rendering. Guix's
965@code{fontconfig} package looks for fonts in @file{$HOME/.guix-profile}
966by default. Thus, to allow graphical applications installed with Guix
967to display fonts, you will have to install fonts with Guix as well.
968Essential font packages include @code{gs-fonts}, @code{font-dejavu}, and
8fe5b1d1 969@code{font-gnu-freefont-ttf}.
0e2d0213
LC
970
971@c TODO What else?
972
eeaf4427
LC
973@c *********************************************************************
974@node Package Management
975@chapter Package Management
976
f8348b91 977The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
978remove software packages, without having to know about their build
979procedure or dependencies. Guix also goes beyond this obvious set of
980features.
981
982This chapter describes the main features of Guix, as well as the package
c1941588 983management tools it provides. Two user interfaces are provided for
c554de89
AK
984routine package management tasks: A command-line interface described below
985(@pxref{Invoking guix package, @code{guix package}}), as well as a visual user
986interface in Emacs described in a subsequent chapter (@pxref{Emacs Interface}).
eeaf4427
LC
987
988@menu
989* Features:: How Guix will make your life brighter.
e49951eb 990* Invoking guix package:: Package installation, removal, etc.
c4202d60 991* Substitutes:: Downloading pre-built binaries.
760c60d6 992* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 993* Invoking guix gc:: Running the garbage collector.
f651b477 994* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 995* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
996@end menu
997
998@node Features
999@section Features
1000
1001When using Guix, each package ends up in the @dfn{package store}, in its
1002own directory---something that resembles
9a130e19
AK
1003@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
1004(note that Guix comes with an Emacs extension to shorten those file
081145cf 1005names, @pxref{Emacs Prettify}.)
eeaf4427
LC
1006
1007Instead of referring to these directories, users have their own
1008@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
1009use. These profiles are stored within each user's home directory, at
1010@code{$HOME/.guix-profile}.
eeaf4427 1011
821b0015 1012For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 1013@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 1014@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
1015@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
1016simply continues to point to
834129e0 1017@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 1018coexist on the same system without any interference.
eeaf4427 1019
e49951eb
MW
1020The @command{guix package} command is the central tool to manage
1021packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 1022profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
1023
1024The command provides the obvious install, remove, and upgrade
1025operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 1026the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 1027@command{guix package} process is terminated during the transaction,
eeaf4427
LC
1028or if a power outage occurs during the transaction, then the user's
1029profile remains in its previous state, and remains usable.
1030
1031In addition, any package transaction may be @emph{rolled back}. So, if,
1032for example, an upgrade installs a new version of a package that turns
1033out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
1034of their profile, which was known to work well. Similarly, the global
1035system configuration is subject to transactional upgrades and roll-back
1036(@pxref{Using the Configuration System}).
eeaf4427
LC
1037
1038All those packages in the package store may be @emph{garbage-collected}.
1039Guix can determine which packages are still referenced by the user
fe8ff028 1040profiles, and remove those that are provably no longer referenced
e49951eb 1041(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
1042generations of their profile so that the packages they refer to can be
1043collected.
eeaf4427 1044
e900c503
LC
1045@cindex reproducibility
1046@cindex reproducible builds
eeaf4427
LC
1047Finally, Guix takes a @dfn{purely functional} approach to package
1048management, as described in the introduction (@pxref{Introduction}).
834129e0 1049Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
1050inputs that were used to build that package---compiler, libraries, build
1051scripts, etc. This direct correspondence allows users to make sure a
1052given package installation matches the current state of their
e900c503
LC
1053distribution. It also helps maximize @dfn{build reproducibility}:
1054thanks to the isolated build environments that are used, a given build
1055is likely to yield bit-identical files when performed on different
1056machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 1057
c4202d60 1058@cindex substitutes
eeaf4427 1059This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 1060deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 1061available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
1062downloads it and unpacks it;
1063otherwise, it builds the package from source, locally
1064(@pxref{Substitutes}).
eeaf4427 1065
f5fd4fd2
LC
1066Control over the build environment is a feature that is also useful for
1067developers. The @command{guix environment} command allows developers of
1068a package to quickly set up the right development environment for their
1069package, without having to manually install the package's dependencies
1070in their profile (@pxref{Invoking guix environment}).
1071
e49951eb
MW
1072@node Invoking guix package
1073@section Invoking @command{guix package}
eeaf4427 1074
e49951eb 1075The @command{guix package} command is the tool that allows users to
eeaf4427
LC
1076install, upgrade, and remove packages, as well as rolling back to
1077previous configurations. It operates only on the user's own profile,
1078and works with normal user privileges (@pxref{Features}). Its syntax
1079is:
1080
1081@example
e49951eb 1082guix package @var{options}
eeaf4427
LC
1083@end example
1084
ba55b1cb 1085Primarily, @var{options} specifies the operations to be performed during
eeaf4427 1086the transaction. Upon completion, a new profile is created, but
99bd74d5 1087previous @dfn{generations} of the profile remain available, should the user
eeaf4427
LC
1088want to roll back.
1089
6447738c
MW
1090For example, to remove @code{lua} and install @code{guile} and
1091@code{guile-cairo} in a single transaction:
1092
1093@example
1094guix package -r lua -i guile guile-cairo
1095@end example
1096
99bd74d5
LC
1097@command{guix package} also supports a @dfn{declarative approach}
1098whereby the user specifies the exact set of packages to be available and
1099passes it @i{via} the @option{--manifest} option
1100(@pxref{profile-manifest, @option{--manifest}}).
1101
b9e5c0a9 1102For each user, a symlink to the user's default profile is automatically
0ec1af59 1103created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
1104current generation of the user's default profile. Thus, users can add
1105@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
1106variable, and so on.
d664f1b4
LC
1107@cindex search paths
1108If you are not using the Guix System Distribution, consider adding the
1109following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
1110Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
1111shells get all the right environment variable definitions:
1112
1113@example
1114GUIX_PROFILE="$HOME/.guix-profile" \
1115source "$HOME/.guix-profile/etc/profile"
1116@end example
b9e5c0a9 1117
4379c35b
LC
1118In a multi-user setup, user profiles are stored in a place registered as
1119a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
1120to (@pxref{Invoking guix gc}). That directory is normally
0ec1af59
LC
1121@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
1122@var{localstatedir} is the value passed to @code{configure} as
4379c35b
LC
1123@code{--localstatedir}, and @var{user} is the user name. The
1124@file{per-user} directory is created when @command{guix-daemon} is
1125started, and the @var{user} sub-directory is created by @command{guix
1126package}.
0ec1af59
LC
1127
1128The @var{options} can be among the following:
1129
eeaf4427
LC
1130@table @code
1131
6447738c
MW
1132@item --install=@var{package} @dots{}
1133@itemx -i @var{package} @dots{}
1134Install the specified @var{package}s.
eeaf4427 1135
6447738c 1136Each @var{package} may specify either a simple package name, such as
eeaf4427 1137@code{guile}, or a package name followed by a hyphen and version number,
724311a2
LC
1138such as @code{guile-1.8.8} or simply @code{guile-1.8} (in the latter
1139case, the newest version prefixed by @code{1.8} is selected.)
1140
1141If no version number is specified, the
dc5669cd
MW
1142newest available version will be selected. In addition, @var{package}
1143may contain a colon, followed by the name of one of the outputs of the
6e721c4d 1144package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
1145(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
1146name (and optionally version) are searched for among the GNU
1147distribution modules (@pxref{Package Modules}).
eeaf4427 1148
461572cc
LC
1149@cindex propagated inputs
1150Sometimes packages have @dfn{propagated inputs}: these are dependencies
21461f27
LC
1151that automatically get installed along with the required package
1152(@pxref{package-propagated-inputs, @code{propagated-inputs} in
1153@code{package} objects}, for information about propagated inputs in
1154package definitions).
461572cc 1155
21461f27 1156@anchor{package-cmd-propagated-inputs}
461572cc
LC
1157An example is the GNU MPC library: its C header files refer to those of
1158the GNU MPFR library, which in turn refer to those of the GMP library.
1159Thus, when installing MPC, the MPFR and GMP libraries also get installed
1160in the profile; removing MPC also removes MPFR and GMP---unless they had
1161also been explicitly installed independently.
1162
ba7ea5ce 1163Besides, packages sometimes rely on the definition of environment
5924080d 1164variables for their search paths (see explanation of
ba7ea5ce 1165@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
1166environment variable definitions are reported here.
1167
ef010c0f 1168@c XXX: keep me up-to-date
5924080d 1169Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
1170availability of a newer upstream version. In the future, it may provide
1171the option of installing directly from the upstream version, even if
1172that version is not yet in the distribution.
1173
5d4b411f
LC
1174@item --install-from-expression=@var{exp}
1175@itemx -e @var{exp}
1176Install the package @var{exp} evaluates to.
1177
1178@var{exp} must be a Scheme expression that evaluates to a
1179@code{<package>} object. This option is notably useful to disambiguate
1180between same-named variants of a package, with expressions such as
1181@code{(@@ (gnu packages base) guile-final)}.
1182
1183Note that this option installs the first output of the specified
1184package, which may be insufficient when needing a specific output of a
1185multiple-output package.
1186
0d279400
DT
1187@item --install-from-file=@var{file}
1188@itemx -f @var{file}
1189Install the package that the code within @var{file} evaluates to.
1190
1191As an example, @var{file} might contain a definition like this
1192(@pxref{Defining Packages}):
1193
1194@example
1195@verbatiminclude package-hello.scm
1196@end example
1197
1198Developers may find it useful to include such a @file{package.scm} file
1199in the root of their project's source tree that can be used to test
1200development snapshots and create reproducible development environments
1201(@pxref{Invoking guix environment}).
1202
6447738c
MW
1203@item --remove=@var{package} @dots{}
1204@itemx -r @var{package} @dots{}
1205Remove the specified @var{package}s.
eeaf4427 1206
6447738c 1207As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
1208and/or output name in addition to the package name. For instance,
1209@code{-r glibc:debug} would remove the @code{debug} output of
1210@code{glibc}.
1211
6447738c
MW
1212@item --upgrade[=@var{regexp} @dots{}]
1213@itemx -u [@var{regexp} @dots{}]
1214Upgrade all the installed packages. If one or more @var{regexp}s are
1215specified, upgrade only installed packages whose name matches a
d5f01e48 1216@var{regexp}. Also see the @code{--do-not-upgrade} option below.
eeaf4427 1217
f651b477
LC
1218Note that this upgrades package to the latest version of packages found
1219in the distribution currently installed. To update your distribution,
1220you should regularly run @command{guix pull} (@pxref{Invoking guix
1221pull}).
1222
d5f01e48
MW
1223@item --do-not-upgrade[=@var{regexp} @dots{}]
1224When used together with the @code{--upgrade} option, do @emph{not}
1225upgrade any packages whose name matches a @var{regexp}. For example, to
1226upgrade all packages in the current profile except those containing the
1227substring ``emacs'':
1228
1229@example
1230$ guix package --upgrade . --do-not-upgrade emacs
1231@end example
1232
99bd74d5 1233@item @anchor{profile-manifest}--manifest=@var{file}
1b676447 1234@itemx -m @var{file}
99bd74d5
LC
1235@cindex profile declaration
1236@cindex profile manifest
1237Create a new generation of the profile from the manifest object
1b676447
DT
1238returned by the Scheme code in @var{file}.
1239
99bd74d5
LC
1240This allows you to @emph{declare} the profile's contents rather than
1241constructing it through a sequence of @code{--install} and similar
1242commands. The advantage is that @var{file} can be put under version
1243control, copied to different machines to reproduce the same profile, and
1244so on.
1245
1246@c FIXME: Add reference to (guix profile) documentation when available.
1247@var{file} must return a @dfn{manifest} object, which is roughly a list
1248of packages:
1b676447 1249
99bd74d5 1250@findex packages->manifest
1b676447 1251@example
99bd74d5 1252(use-package-modules guile emacs)
1b676447
DT
1253
1254(packages->manifest
99bd74d5
LC
1255 (list emacs
1256 guile-2.0
1b676447 1257 ;; Use a specific package output.
99bd74d5 1258 (list guile-2.0 "debug")))
1b676447
DT
1259@end example
1260
24e262f0
LC
1261@item --roll-back
1262Roll back to the previous @dfn{generation} of the profile---i.e., undo
1263the last transaction.
1264
1265When combined with options such as @code{--install}, roll back occurs
1266before any other actions.
1267
d9307267 1268When rolling back from the first generation that actually contains
4b2bc804
NK
1269installed packages, the profile is made to point to the @dfn{zeroth
1270generation}, which contains no files apart from its own meta-data.
d9307267 1271
82fe08ed
LC
1272Installing, removing, or upgrading packages from a generation that has
1273been rolled back to overwrites previous future generations. Thus, the
1274history of a profile's generations is always linear.
1275
b3bb82f1
AK
1276@item --switch-generation=@var{pattern}
1277@itemx -S @var{pattern}
1278Switch to a particular generation defined by @var{pattern}.
1279
1280@var{pattern} may be either a generation number or a number prefixed
1281with ``+'' or ``-''. The latter means: move forward/backward by a
1282specified number of generations. For example, if you want to return to
1283the latest generation after @code{--roll-back}, use
1284@code{--switch-generation=+1}.
1285
1286The difference between @code{--roll-back} and
1287@code{--switch-generation=-1} is that @code{--switch-generation} will
1288not make a zeroth generation, so if a specified generation does not
1289exist, the current generation will not be changed.
1290
dbc31ab2 1291@item --search-paths[=@var{kind}]
5924080d
LC
1292@cindex search paths
1293Report environment variable definitions, in Bash syntax, that may be
1294needed in order to use the set of installed packages. These environment
1295variables are used to specify @dfn{search paths} for files used by some
1296of the installed packages.
1297
1298For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1299environment variables to be defined so it can look for headers and
1300libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1301Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1302library are installed in the profile, then @code{--search-paths} will
1303suggest setting these variables to @code{@var{profile}/include} and
1304@code{@var{profile}/lib}, respectively.
1305
dbc31ab2
LC
1306The typical use case is to define these environment variables in the
1307shell:
1308
1309@example
1310$ eval `guix package --search-paths`
1311@end example
1312
1313@var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1314meaning that the returned environment variable definitions will either
1315be exact settings, or prefixes or suffixes of the current value of these
1316variables. When omitted, @var{kind} defaults to @code{exact}.
1317
eeaf4427
LC
1318@item --profile=@var{profile}
1319@itemx -p @var{profile}
1320Use @var{profile} instead of the user's default profile.
1321
70915c1a
LC
1322@item --verbose
1323Produce verbose output. In particular, emit the environment's build log
1324on the standard error port.
1325
eeaf4427
LC
1326@item --bootstrap
1327Use the bootstrap Guile to build the profile. This option is only
1328useful to distribution developers.
1329
1330@end table
1331
e49951eb 1332In addition to these actions @command{guix package} supports the
733b4130
LC
1333following options to query the current state of a profile, or the
1334availability of packages:
eeaf4427 1335
733b4130
LC
1336@table @option
1337
acc08466
NK
1338@item --search=@var{regexp}
1339@itemx -s @var{regexp}
5763ad92 1340List the available packages whose name, synopsis, or description matches
299112d3
LC
1341@var{regexp}. Print all the meta-data of matching packages in
1342@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1343GNU recutils manual}).
acc08466 1344
299112d3
LC
1345This allows specific fields to be extracted using the @command{recsel}
1346command, for instance:
1347
1348@example
e49951eb 1349$ guix package -s malloc | recsel -p name,version
299112d3
LC
1350name: glibc
1351version: 2.17
1352
1353name: libgc
1354version: 7.2alpha6
1355@end example
acc08466 1356
a12d92f5
LC
1357Similarly, to show the name of all the packages available under the
1358terms of the GNU@tie{}LGPL version 3:
1359
1360@example
1361$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1362name: elfutils
1363
1364name: gmp
1365@dots{}
1366@end example
1367
2aa6efb0
CR
1368@item --show=@var{package}
1369Show details about @var{package}, taken from the list of available packages, in
1370@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1371recutils manual}).
1372
1373@example
1374$ guix package --show=python | recsel -p name,version
1375name: python
1376version: 2.7.6
1377
1378name: python
1379version: 3.3.5
1380@end example
1381
1382You may also specify the full name of a package to only get details about a
1383specific version of it:
1384@example
1385$ guix package --show=python-3.3.5 | recsel -p name,version
1386name: python
1387version: 3.3.5
1388@end example
1389
1390
1391
733b4130
LC
1392@item --list-installed[=@var{regexp}]
1393@itemx -I [@var{regexp}]
bd9bde1c
LC
1394List the currently installed packages in the specified profile, with the
1395most recently installed packages shown last. When @var{regexp} is
1396specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
1397
1398For each installed package, print the following items, separated by
1399tabs: the package name, its version string, the part of the package that
1400is installed (for instance, @code{out} for the default output,
1401@code{include} for its headers, etc.), and the path of this package in
1402the store.
1403
64fc89b6
LC
1404@item --list-available[=@var{regexp}]
1405@itemx -A [@var{regexp}]
5763ad92 1406List packages currently available in the distribution for this system
a1ba8475
LC
1407(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1408installed packages whose name matches @var{regexp}.
64fc89b6
LC
1409
1410For each package, print the following items separated by tabs: its name,
6e721c4d
LC
1411its version string, the parts of the package (@pxref{Packages with
1412Multiple Outputs}), and the source location of its definition.
64fc89b6 1413
f566d765
LC
1414@item --list-generations[=@var{pattern}]
1415@itemx -l [@var{pattern}]
1416Return a list of generations along with their creation dates; for each
1417generation, show the installed packages, with the most recently
4b2bc804
NK
1418installed packages shown last. Note that the zeroth generation is never
1419shown.
f566d765
LC
1420
1421For each installed package, print the following items, separated by
1422tabs: the name of a package, its version string, the part of the package
1423that is installed (@pxref{Packages with Multiple Outputs}), and the
1424location of this package in the store.
1425
1426When @var{pattern} is used, the command returns only matching
1427generations. Valid patterns include:
1428
1429@itemize
1430@item @emph{Integers and comma-separated integers}. Both patterns denote
1431generation numbers. For instance, @code{--list-generations=1} returns
1432the first one.
1433
1434And @code{--list-generations=1,8,2} outputs three generations in the
1435specified order. Neither spaces nor trailing commas are allowed.
1436
1437@item @emph{Ranges}. @code{--list-generations=2..9} prints the
1438specified generations and everything in between. Note that the start of
1439a range must be lesser than its end.
1440
1441It is also possible to omit the endpoint. For example,
1442@code{--list-generations=2..}, returns all generations starting from the
1443second one.
1444
1445@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1446or months by passing an integer along with the first letter of the
d7ddb257
LC
1447duration. For example, @code{--list-generations=20d} lists generations
1448that are up to 20 days old.
f566d765
LC
1449@end itemize
1450
b7884ca3
NK
1451@item --delete-generations[=@var{pattern}]
1452@itemx -d [@var{pattern}]
d7ddb257
LC
1453When @var{pattern} is omitted, delete all generations except the current
1454one.
b7884ca3
NK
1455
1456This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1457When @var{pattern} is specified, delete the matching generations. When
1458@var{pattern} specifies a duration, generations @emph{older} than the
1459specified duration match. For instance, @code{--delete-generations=1m}
1460deletes generations that are more than one month old.
1461
391bdd8f
LC
1462If the current generation matches, it is @emph{not} deleted. Also, the
1463zeroth generation is never deleted.
b7884ca3 1464
1bb9900a
LC
1465Note that deleting generations prevents roll-back to them.
1466Consequently, this command must be used with care.
1467
733b4130 1468@end table
eeaf4427 1469
70ee5642
LC
1470Finally, since @command{guix package} may actually start build
1471processes, it supports all the common build options that @command{guix
1472build} supports (@pxref{Invoking guix build, common build options}).
1473
c4202d60
LC
1474@node Substitutes
1475@section Substitutes
1476
1477@cindex substitutes
1478@cindex pre-built binaries
1479Guix supports transparent source/binary deployment, which means that it
1480can either build things locally, or download pre-built items from a
1481server. We call these pre-built items @dfn{substitutes}---they are
1482substitutes for local build results. In many cases, downloading a
1483substitute is much faster than building things locally.
1484
1485Substitutes can be anything resulting from a derivation build
1486(@pxref{Derivations}). Of course, in the common case, they are
1487pre-built package binaries, but source tarballs, for instance, which
1488also result from derivation builds, can be available as substitutes.
1489
1490The @code{hydra.gnu.org} server is a front-end to a build farm that
1491builds packages from the GNU distribution continuously for some
9176607e 1492architectures, and makes them available as substitutes. This is the
f8a8e0fe
LC
1493default source of substitutes; it can be overridden by passing the
1494@option{--substitute-urls} option either to @command{guix-daemon}
1495(@pxref{daemon-substitute-urls,, @code{guix-daemon --substitute-urls}})
1496or to client tools such as @command{guix package}
1497(@pxref{client-substitute-urls,, client @option{--substitute-urls}
1498option}).
c4202d60
LC
1499
1500@cindex security
1501@cindex digital signatures
1502To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1503must add its public key to the access control list (ACL) of archive
1504imports, using the @command{guix archive} command (@pxref{Invoking guix
1505archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1506be compromised and to serve genuine substitutes.
1507
1508This public key is installed along with Guix, in
1509@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1510the installation prefix of Guix. If you installed Guix from source,
1511make sure you checked the GPG signature of
1512@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1513Then, you can run something like this:
1514
1515@example
1516# guix archive --authorize < hydra.gnu.org.pub
1517@end example
1518
1519Once this is in place, the output of a command like @code{guix build}
1520should change from something like:
1521
1522@example
1523$ guix build emacs --dry-run
1524The following derivations would be built:
1525 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1526 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1527 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1528 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1529@dots{}
1530@end example
1531
1532@noindent
1533to something like:
1534
1535@example
1536$ guix build emacs --dry-run
1537The following files would be downloaded:
1538 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1539 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1540 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1541 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1542@dots{}
1543@end example
1544
1545@noindent
1546This indicates that substitutes from @code{hydra.gnu.org} are usable and
1547will be downloaded, when possible, for future builds.
1548
1549Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1550one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1551when attempting to use a substitute that has been tampered with.
1552
1553The substitute mechanism can be disabled globally by running
1554@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1555guix-daemon}). It can also be disabled temporarily by passing the
1556@code{--no-substitutes} option to @command{guix package}, @command{guix
1557build}, and other command-line tools.
1558
1559
1560Today, each individual's control over their own computing is at the
1561mercy of institutions, corporations, and groups with enough power and
1562determination to subvert the computing infrastructure and exploit its
1563weaknesses. While using @code{hydra.gnu.org} substitutes can be
1564convenient, we encourage users to also build on their own, or even run
1565their own build farm, such that @code{hydra.gnu.org} is less of an
8ce229fc
LC
1566interesting target. One way to help is by publishing the software you
1567build using @command{guix publish} so that others have one more choice
1568of server to download substitutes from (@pxref{Invoking guix publish}).
c4202d60
LC
1569
1570Guix has the foundations to maximize build reproducibility
1571(@pxref{Features}). In most cases, independent builds of a given
1572package or derivation should yield bit-identical results. Thus, through
1573a diverse set of independent package builds, we can strengthen the
1574integrity of our systems.
1575
1576In the future, we want Guix to have support to publish and retrieve
1577binaries to/from other users, in a peer-to-peer fashion. If you would
1578like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1579
1580
6e721c4d
LC
1581@node Packages with Multiple Outputs
1582@section Packages with Multiple Outputs
1583
1584@cindex multiple-output packages
1585@cindex package outputs
1586
1587Often, packages defined in Guix have a single @dfn{output}---i.e., the
1588source package leads exactly one directory in the store. When running
1589@command{guix package -i glibc}, one installs the default output of the
1590GNU libc package; the default output is called @code{out}, but its name
1591can be omitted as shown in this command. In this particular case, the
1592default output of @code{glibc} contains all the C header files, shared
1593libraries, static libraries, Info documentation, and other supporting
1594files.
1595
1596Sometimes it is more appropriate to separate the various types of files
1597produced from a single source package into separate outputs. For
1598instance, the GLib C library (used by GTK+ and related packages)
1599installs more than 20 MiB of reference documentation as HTML pages.
1600To save space for users who do not need it, the documentation goes to a
1601separate output, called @code{doc}. To install the main GLib output,
1602which contains everything but the documentation, one would run:
1603
1604@example
1605guix package -i glib
1606@end example
1607
1608The command to install its documentation is:
1609
1610@example
1611guix package -i glib:doc
1612@end example
1613
1614Some packages install programs with different ``dependency footprints''.
1615For instance, the WordNet package install both command-line tools and
1616graphical user interfaces (GUIs). The former depend solely on the C
1617library, whereas the latter depend on Tcl/Tk and the underlying X
1618libraries. In this case, we leave the command-line tools in the default
1619output, whereas the GUIs are in a separate output. This allows users
fcc58db6
LC
1620who do not need the GUIs to save space. The @command{guix size} command
1621can help find out about such situations (@pxref{Invoking guix size}).
88856916 1622@command{guix graph} can also be helpful (@pxref{Invoking guix graph}).
6e721c4d
LC
1623
1624There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1625Other conventional output names include @code{lib} for libraries and
1626possibly header files, @code{bin} for stand-alone programs, and
1627@code{debug} for debugging information (@pxref{Installing Debugging
1628Files}). The outputs of a packages are listed in the third column of
1629the output of @command{guix package --list-available} (@pxref{Invoking
1630guix package}).
6e721c4d 1631
eeaf4427 1632
e49951eb
MW
1633@node Invoking guix gc
1634@section Invoking @command{guix gc}
fe8ff028
LC
1635
1636@cindex garbage collector
1637Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1638The @command{guix gc} command allows users to explicitly run the garbage
c22eb992
LC
1639collector to reclaim space from the @file{/gnu/store} directory. It is
1640the @emph{only} way to remove files from @file{/gnu/store}---removing
1641files or directories manually may break it beyond repair!
fe8ff028
LC
1642
1643The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1644@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1645cannot be deleted; any other file is considered @dfn{dead} and may be
1646deleted. The set of garbage collector roots includes default user
e49951eb
MW
1647profiles, and may be augmented with @command{guix build --root}, for
1648example (@pxref{Invoking guix build}).
fe8ff028 1649
1bb9900a
LC
1650Prior to running @code{guix gc --collect-garbage} to make space, it is
1651often useful to remove old generations from user profiles; that way, old
1652package builds referenced by those generations can be reclaimed. This
1653is achieved by running @code{guix package --delete-generations}
1654(@pxref{Invoking guix package}).
1655
e49951eb 1656The @command{guix gc} command has three modes of operation: it can be
fe8ff028 1657used to garbage-collect any dead files (the default), to delete specific
7770aafc
LC
1658files (the @code{--delete} option), to print garbage-collector
1659information, or for more advanced queries. The garbage collection
1660options are as follows:
fe8ff028
LC
1661
1662@table @code
1663@item --collect-garbage[=@var{min}]
1664@itemx -C [@var{min}]
834129e0 1665Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1666sub-directories. This is the default operation when no option is
1667specified.
1668
1669When @var{min} is given, stop once @var{min} bytes have been collected.
1670@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1671suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1672(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1673
1674When @var{min} is omitted, collect all the garbage.
1675
1676@item --delete
1677@itemx -d
1678Attempt to delete all the store files and directories specified as
1679arguments. This fails if some of the files are not in the store, or if
1680they are still live.
1681
30d9aa54
LC
1682@item --list-failures
1683List store items corresponding to cached build failures.
1684
1685This prints nothing unless the daemon was started with
1686@option{--cache-failures} (@pxref{Invoking guix-daemon,
1687@option{--cache-failures}}).
1688
1689@item --clear-failures
1690Remove the specified store items from the failed-build cache.
1691
1692Again, this option only makes sense when the daemon is started with
1693@option{--cache-failures}. Otherwise, it does nothing.
1694
fe8ff028
LC
1695@item --list-dead
1696Show the list of dead files and directories still present in the
1697store---i.e., files and directories no longer reachable from any root.
1698
1699@item --list-live
1700Show the list of live store files and directories.
ba8b732d
LC
1701
1702@end table
1703
1704In addition, the references among existing store files can be queried:
1705
1706@table @code
1707
1708@item --references
1709@itemx --referrers
1710List the references (respectively, the referrers) of store files given
1711as arguments.
1712
8e59fdd5
LC
1713@item --requisites
1714@itemx -R
fcc58db6 1715@cindex closure
8e59fdd5
LC
1716List the requisites of the store files passed as arguments. Requisites
1717include the store files themselves, their references, and the references
1718of these, recursively. In other words, the returned list is the
1719@dfn{transitive closure} of the store files.
1720
fcc58db6 1721@xref{Invoking guix size}, for a tool to profile the size of an
88856916
LC
1722element's closure. @xref{Invoking guix graph}, for a tool to visualize
1723the graph of references.
fcc58db6 1724
fe8ff028
LC
1725@end table
1726
7770aafc
LC
1727Lastly, the following options allow you to check the integrity of the
1728store and to control disk usage.
1729
1730@table @option
1731
1732@item --verify[=@var{options}]
1733@cindex integrity, of the store
1734@cindex integrity checking
1735Verify the integrity of the store.
1736
1737By default, make sure that all the store items marked as valid in the
1738daemon's database actually exist in @file{/gnu/store}.
1739
1740When provided, @var{options} must a comma-separated list containing one
1741or more of @code{contents} and @code{repair}.
1742
1743When passing @option{--verify=contents}, the daemon will compute the
1744content hash of each store item and compare it against its hash in the
1745database. Hash mismatches are reported as data corruptions. Because it
1746traverses @emph{all the files in the store}, this command can take a
1747long time, especially on systems with a slow disk drive.
1748
1749@cindex repairing the store
1750Using @option{--verify=repair} or @option{--verify=contents,repair}
1751causes the daemon to try to repair corrupt store items by fetching
1752substitutes for them (@pxref{Substitutes}). Because repairing is not
1753atomic, and thus potentially dangerous, it is available only to the
1754system administrator.
1755
1756@item --optimize
1757@cindex deduplication
1758Optimize the store by hard-linking identical files---this is
1759@dfn{deduplication}.
1760
1761The daemon performs deduplication after each successful build or archive
1762import, unless it was started with @code{--disable-deduplication}
1763(@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
1764this option is primarily useful when the daemon was running with
1765@code{--disable-deduplication}.
1766
1767@end table
eeaf4427 1768
f651b477
LC
1769@node Invoking guix pull
1770@section Invoking @command{guix pull}
1771
1772Packages are installed or upgraded to the latest version available in
1773the distribution currently available on your local machine. To update
1774that distribution, along with the Guix tools, you must run @command{guix
1775pull}: the command downloads the latest Guix source code and package
1776descriptions, and deploys it.
1777
1778On completion, @command{guix package} will use packages and package
1779versions from this just-retrieved copy of Guix. Not only that, but all
1780the Guix commands and Scheme modules will also be taken from that latest
1781version. New @command{guix} sub-commands added by the update also
1782become available.
1783
1784The @command{guix pull} command is usually invoked with no arguments,
1785but it supports the following options:
1786
1787@table @code
1788@item --verbose
1789Produce verbose output, writing build logs to the standard error output.
1790
ab5d72ad
LC
1791@item --url=@var{url}
1792Download the source tarball of Guix from @var{url}.
1793
1794By default, the tarball is taken from its canonical address at
1795@code{gnu.org}, for the stable branch of Guix.
1796
f651b477
LC
1797@item --bootstrap
1798Use the bootstrap Guile to build the latest Guix. This option is only
1799useful to Guix developers.
1800@end table
1801
760c60d6
LC
1802
1803@node Invoking guix archive
1804@section Invoking @command{guix archive}
1805
1806The @command{guix archive} command allows users to @dfn{export} files
1807from the store into a single archive, and to later @dfn{import} them.
1808In particular, it allows store files to be transferred from one machine
1809to another machine's store. For example, to transfer the @code{emacs}
1810package to a machine connected over SSH, one would run:
1811
1812@example
56607088 1813guix archive --export -r emacs | ssh the-machine guix archive --import
760c60d6
LC
1814@end example
1815
87236aed 1816@noindent
56607088
LC
1817Similarly, a complete user profile may be transferred from one machine
1818to another like this:
1819
1820@example
1821guix archive --export -r $(readlink -f ~/.guix-profile) | \
1822 ssh the-machine guix-archive --import
1823@end example
1824
1825@noindent
1826However, note that, in both examples, all of @code{emacs} and the
1827profile as well as all of their dependencies are transferred (due to
1828@code{-r}), regardless of what is already available in the target
1829machine's store. The @code{--missing} option can help figure out which
1830items are missing from the target's store.
87236aed 1831
760c60d6 1832Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1833comparable in spirit to `tar', but with a few noteworthy differences
1834that make it more appropriate for our purposes. First, rather than
1835recording all Unix meta-data for each file, the Nar format only mentions
1836the file type (regular, directory, or symbolic link); Unix permissions
1837and owner/group are dismissed. Second, the order in which directory
1838entries are stored always follows the order of file names according to
1839the C locale collation order. This makes archive production fully
1840deterministic.
1841
1842When exporting, the daemon digitally signs the contents of the archive,
1843and that digital signature is appended. When importing, the daemon
1844verifies the signature and rejects the import in case of an invalid
1845signature or if the signing key is not authorized.
760c60d6
LC
1846@c FIXME: Add xref to daemon doc about signatures.
1847
1848The main options are:
1849
1850@table @code
1851@item --export
1852Export the specified store files or packages (see below.) Write the
1853resulting archive to the standard output.
1854
56607088
LC
1855Dependencies are @emph{not} included in the output, unless
1856@code{--recursive} is passed.
1857
1858@item -r
1859@itemx --recursive
1860When combined with @code{--export}, this instructs @command{guix
1861archive} to include dependencies of the given items in the archive.
1862Thus, the resulting archive is self-contained: it contains the closure
1863of the exported store items.
1864
760c60d6
LC
1865@item --import
1866Read an archive from the standard input, and import the files listed
1867therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1868signature, or if it is signed by a public key not among the authorized
1869keys (see @code{--authorize} below.)
554f26ec 1870
87236aed
LC
1871@item --missing
1872Read a list of store file names from the standard input, one per line,
1873and write on the standard output the subset of these files missing from
1874the store.
1875
554f26ec 1876@item --generate-key[=@var{parameters}]
f82cc5fd 1877@cindex signing, archives
554f26ec
LC
1878Generate a new key pair for the daemons. This is a prerequisite before
1879archives can be exported with @code{--export}. Note that this operation
1880usually takes time, because it needs to gather enough entropy to
1881generate the key pair.
1882
1883The generated key pair is typically stored under @file{/etc/guix}, in
1884@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
867d8473
LC
1885key, which must be kept secret.) When @var{parameters} is omitted,
1886an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
1887versions before 1.6.0, it is a 4096-bit RSA key.
1888Alternately, @var{parameters} can specify
554f26ec
LC
1889@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1890public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1891Libgcrypt Reference Manual}).
f82cc5fd
LC
1892
1893@item --authorize
1894@cindex authorizing, archives
1895Authorize imports signed by the public key passed on standard input.
1896The public key must be in ``s-expression advanced format''---i.e., the
1897same format as the @file{signing-key.pub} file.
1898
1899The list of authorized keys is kept in the human-editable file
1900@file{/etc/guix/acl}. The file contains
1901@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1902s-expressions''} and is structured as an access-control list in the
1903@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1904(SPKI)}.
760c60d6
LC
1905@end table
1906
1907To export store files as an archive to the standard output, run:
1908
1909@example
1910guix archive --export @var{options} @var{specifications}...
1911@end example
1912
1913@var{specifications} may be either store file names or package
1914specifications, as for @command{guix package} (@pxref{Invoking guix
1915package}). For instance, the following command creates an archive
1916containing the @code{gui} output of the @code{git} package and the main
1917output of @code{emacs}:
1918
1919@example
834129e0 1920guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1921@end example
1922
1923If the specified packages are not built yet, @command{guix archive}
1924automatically builds them. The build process may be controlled with the
1925same options that can be passed to the @command{guix build} command
70ee5642 1926(@pxref{Invoking guix build, common build options}).
760c60d6 1927
c554de89
AK
1928@c *********************************************************************
1929@include emacs.texi
760c60d6 1930
568717fd
LC
1931@c *********************************************************************
1932@node Programming Interface
1933@chapter Programming Interface
1934
3dc1970d
LC
1935GNU Guix provides several Scheme programming interfaces (APIs) to
1936define, build, and query packages. The first interface allows users to
1937write high-level package definitions. These definitions refer to
1938familiar packaging concepts, such as the name and version of a package,
1939its build system, and its dependencies. These definitions can then be
1940turned into concrete build actions.
1941
ba55b1cb 1942Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1943standard setup, the daemon has write access to the store---the
834129e0 1944@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1945setup also has the daemon perform builds in chroots, under a specific
1946build users, to minimize interference with the rest of the system.
1947
1948@cindex derivation
1949Lower-level APIs are available to interact with the daemon and the
1950store. To instruct the daemon to perform a build action, users actually
1951provide it with a @dfn{derivation}. A derivation is a low-level
1952representation of the build actions to be taken, and the environment in
1953which they should occur---derivations are to package definitions what
49ad317a
LC
1954assembly is to C programs. The term ``derivation'' comes from the fact
1955that build results @emph{derive} from them.
3dc1970d
LC
1956
1957This chapter describes all these APIs in turn, starting from high-level
1958package definitions.
1959
568717fd 1960@menu
b860f382 1961* Defining Packages:: Defining new packages.
7458bd0a 1962* Build Systems:: Specifying how packages are built.
b860f382
LC
1963* The Store:: Manipulating the package store.
1964* Derivations:: Low-level interface to package derivations.
1965* The Store Monad:: Purely functional interface to the store.
21b679f6 1966* G-Expressions:: Manipulating build expressions.
568717fd
LC
1967@end menu
1968
1969@node Defining Packages
1970@section Defining Packages
1971
3dc1970d
LC
1972The high-level interface to package definitions is implemented in the
1973@code{(guix packages)} and @code{(guix build-system)} modules. As an
1974example, the package definition, or @dfn{recipe}, for the GNU Hello
1975package looks like this:
1976
1977@example
e7f34eb0
LC
1978(define-module (gnu packages hello)
1979 #:use-module (guix packages)
1980 #:use-module (guix download)
1981 #:use-module (guix build-system gnu)
a6dcdcac
SB
1982 #:use-module (guix licenses)
1983 #:use-module (gnu packages gawk))
b22a12fd 1984
79f5dd59 1985(define-public hello
3dc1970d
LC
1986 (package
1987 (name "hello")
17d8e33f 1988 (version "2.10")
3dc1970d 1989 (source (origin
17d8e33f
ML
1990 (method url-fetch)
1991 (uri (string-append "mirror://gnu/hello/hello-" version
1992 ".tar.gz"))
1993 (sha256
1994 (base32
1995 "0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i"))))
3dc1970d 1996 (build-system gnu-build-system)
7458bd0a 1997 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1998 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1999 (synopsis "Hello, GNU world: An example GNU package")
2000 (description "Guess what GNU Hello prints!")
3dc1970d 2001 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 2002 (license gpl3+)))
3dc1970d
LC
2003@end example
2004
2005@noindent
2006Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 2007of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
2008to a @code{<package>} object, which is essentially a record
2009(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
2010This package object can be inspected using procedures found in the
2011@code{(guix packages)} module; for instance, @code{(package-name hello)}
2012returns---surprise!---@code{"hello"}.
2013
2f7d2d91
LC
2014With luck, you may be able to import part or all of the definition of
2015the package you are interested in from another repository, using the
2016@code{guix import} command (@pxref{Invoking guix import}).
2017
e7f34eb0
LC
2018In the example above, @var{hello} is defined into a module of its own,
2019@code{(gnu packages hello)}. Technically, this is not strictly
2020necessary, but it is convenient to do so: all the packages defined in
2021modules under @code{(gnu packages @dots{})} are automatically known to
2022the command-line tools (@pxref{Package Modules}).
2023
3dc1970d
LC
2024There are a few points worth noting in the above package definition:
2025
2026@itemize
2027@item
a2bf4907
LC
2028The @code{source} field of the package is an @code{<origin>} object
2029(@pxref{origin Reference}, for the complete reference).
3dc1970d
LC
2030Here, the @code{url-fetch} method from @code{(guix download)} is used,
2031meaning that the source is a file to be downloaded over FTP or HTTP.
2032
2033The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
2034the GNU mirrors defined in @code{(guix download)}.
2035
2036The @code{sha256} field specifies the expected SHA256 hash of the file
2037being downloaded. It is mandatory, and allows Guix to check the
2038integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 2039base32 representation of the hash. You can obtain this information with
210cc920
LC
2040@code{guix download} (@pxref{Invoking guix download}) and @code{guix
2041hash} (@pxref{Invoking guix hash}).
3dc1970d 2042
f9cc8971
LC
2043@cindex patches
2044When needed, the @code{origin} form can also have a @code{patches} field
2045listing patches to be applied, and a @code{snippet} field giving a
2046Scheme expression to modify the source code.
2047
3dc1970d
LC
2048@item
2049@cindex GNU Build System
7458bd0a
LC
2050The @code{build-system} field specifies the procedure to build the
2051package (@pxref{Build Systems}). Here, @var{gnu-build-system}
2052represents the familiar GNU Build System, where packages may be
2053configured, built, and installed with the usual @code{./configure &&
2054make && make check && make install} command sequence.
2055
2056@item
2057The @code{arguments} field specifies options for the build system
2058(@pxref{Build Systems}). Here it is interpreted by
2059@var{gnu-build-system} as a request run @file{configure} with the
2060@code{--enable-silent-rules} flag.
3dc1970d
LC
2061
2062@item
2063The @code{inputs} field specifies inputs to the build process---i.e.,
2064build-time or run-time dependencies of the package. Here, we define an
2065input called @code{"gawk"} whose value is that of the @var{gawk}
2066variable; @var{gawk} is itself bound to a @code{<package>} object.
2067
2068Note that GCC, Coreutils, Bash, and other essential tools do not need to
2069be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 2070of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
2071
2072However, any other dependencies need to be specified in the
2073@code{inputs} field. Any dependency not specified here will simply be
2074unavailable to the build process, possibly leading to a build failure.
2075@end itemize
2076
87eafdbd
TUBK
2077@xref{package Reference}, for a full description of possible fields.
2078
2f7d2d91 2079Once a package definition is in place, the
e49951eb 2080package may actually be built using the @code{guix build} command-line
39bee8a2
LC
2081tool (@pxref{Invoking guix build}). You can easily jump back to the
2082package definition using the @command{guix edit} command
2083(@pxref{Invoking guix edit}).
2084@xref{Packaging Guidelines}, for
b4f5e0e8
CR
2085more information on how to test package definitions, and
2086@ref{Invoking guix lint}, for information on how to check a definition
2087for style conformance.
2088
7458bd0a
LC
2089Eventually, updating the package definition to a new upstream version
2090can be partly automated by the @command{guix refresh} command
2091(@pxref{Invoking guix refresh}).
3dc1970d
LC
2092
2093Behind the scenes, a derivation corresponding to the @code{<package>}
2094object is first computed by the @code{package-derivation} procedure.
834129e0 2095That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 2096The build actions it prescribes may then be realized by using the
3dc1970d
LC
2097@code{build-derivations} procedure (@pxref{The Store}).
2098
2099@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
2100Return the @code{<derivation>} object of @var{package} for @var{system}
2101(@pxref{Derivations}).
3dc1970d
LC
2102
2103@var{package} must be a valid @code{<package>} object, and @var{system}
2104must be a string denoting the target system type---e.g.,
2105@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
2106must be a connection to the daemon, which operates on the store
2107(@pxref{The Store}).
2108@end deffn
568717fd 2109
9c1edabd
LC
2110@noindent
2111@cindex cross-compilation
2112Similarly, it is possible to compute a derivation that cross-builds a
2113package for some other system:
2114
2115@deffn {Scheme Procedure} package-cross-derivation @var{store} @
2116 @var{package} @var{target} [@var{system}]
59688fc4
LC
2117Return the @code{<derivation>} object of @var{package} cross-built from
2118@var{system} to @var{target}.
9c1edabd
LC
2119
2120@var{target} must be a valid GNU triplet denoting the target hardware
2121and operating system, such as @code{"mips64el-linux-gnu"}
2122(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
2123Configure and Build System}).
2124@end deffn
2125
87eafdbd
TUBK
2126@menu
2127* package Reference :: The package data type.
2128* origin Reference:: The origin data type.
2129@end menu
2130
2131
2132@node package Reference
2133@subsection @code{package} Reference
2134
2135This section summarizes all the options available in @code{package}
2136declarations (@pxref{Defining Packages}).
2137
2138@deftp {Data Type} package
2139This is the data type representing a package recipe.
2140
2141@table @asis
2142@item @code{name}
2143The name of the package, as a string.
2144
2145@item @code{version}
2146The version of the package, as a string.
2147
2148@item @code{source}
2149An origin object telling how the source code for the package should be
2150acquired (@pxref{origin Reference}).
2151
2152@item @code{build-system}
2153The build system that should be used to build the package (@pxref{Build
2154Systems}).
2155
2156@item @code{arguments} (default: @code{'()})
2157The arguments that should be passed to the build system. This is a
2158list, typically containing sequential keyword-value pairs.
2159
2160@item @code{inputs} (default: @code{'()})
2161Package or derivation inputs to the build. This is a list of lists,
2162where each list has the name of the input (a string) as its first
2163element, a package or derivation object as its second element, and
2164optionally the name of the output of the package or derivation that
2165should be used, which defaults to @code{"out"}.
2166
21461f27
LC
2167@item @anchor{package-propagated-inputs}@code{propagated-inputs} (default: @code{'()})
2168@cindex propagated inputs
87eafdbd 2169This field is like @code{inputs}, but the specified packages will be
21461f27
LC
2170force-installed alongside the package they belong to
2171(@pxref{package-cmd-propagated-inputs, @command{guix package}}, for
2172information on how @command{guix package} deals with propagated inputs.)
2173
2174For example this is necessary when a library needs headers of another
2175library to compile, or needs another shared library to be linked
2176alongside itself when a program wants to link to it.
87eafdbd
TUBK
2177
2178@item @code{native-inputs} (default: @code{'()})
2179This field is like @code{inputs}, but in case of a cross-compilation it
2180will be ensured that packages for the architecture of the build machine
2181are present, such that executables from them can be used during the
21461f27
LC
2182build.
2183
2184This is typically where you would list tools needed at build time but
2185not at run time, such as Autoconf, Automake, pkg-config, Gettext, or
2186Bison. @command{guix lint} can report likely mistakes in this area
2187(@pxref{Invoking guix lint}).
87eafdbd
TUBK
2188
2189@item @code{self-native-input?} (default: @code{#f})
2190This is a Boolean field telling whether the package should use itself as
2191a native input when cross-compiling.
2192
2193@item @code{outputs} (default: @code{'("out")})
2194The list of output names of the package. @xref{Packages with Multiple
2195Outputs}, for typical uses of additional outputs.
2196
2197@item @code{native-search-paths} (default: @code{'()})
2198@itemx @code{search-paths} (default: @code{'()})
2199A list of @code{search-path-specification} objects describing
2200search-path environment variables honored by the package.
2201
2202@item @code{replacement} (default: @code{#f})
2203This must either @code{#f} or a package object that will be used as a
2204@dfn{replacement} for this package. @xref{Security Updates, grafts},
2205for details.
2206
2207@item @code{synopsis}
2208A one-line description of the package.
2209
2210@item @code{description}
2211A more elaborate description of the package.
2212
2213@item @code{license}
2214The license of the package; a value from @code{(guix licenses)}.
2215
2216@item @code{home-page}
2217The URL to the home-page of the package, as a string.
2218
2219@item @code{supported-systems} (default: @var{%supported-systems})
2220The list of systems supported by the package, as strings of the form
2221@code{architecture-kernel}, for example @code{"x86_64-linux"}.
2222
2223@item @code{maintainers} (default: @code{'()})
2224The list of maintainers of the package, as @code{maintainer} objects.
2225
2226@item @code{location} (default: source location of the @code{package} form)
2227The source location of the package. It's useful to override this when
2228inheriting from another package, in which case this field is not
2229automatically corrected.
2230@end table
2231@end deftp
2232
2233
2234@node origin Reference
2235@subsection @code{origin} Reference
2236
2237This section summarizes all the options available in @code{origin}
2238declarations (@pxref{Defining Packages}).
2239
2240@deftp {Data Type} origin
2241This is the data type representing a source code origin.
2242
2243@table @asis
2244@item @code{uri}
2245An object containing the URI of the source. The object type depends on
2246the @code{method} (see below). For example, when using the
2247@var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
2248values are: a URL represented as a string, or a list thereof.
2249
2250@item @code{method}
2251A procedure that will handle the URI.
2252
2253Examples include:
2254
2255@table @asis
2256@item @var{url-fetch} from @code{(guix download)}
2257download a file the HTTP, HTTPS, or FTP URL specified in the
2258@code{uri} field;
2259
2260@item @var{git-fetch} from @code{(guix git-download)}
2261clone the Git version control repository, and check out the revision
2262specified in the @code{uri} field as a @code{git-reference} object; a
2263@code{git-reference} looks like this:
2264
2265@example
2266(git-reference
2267 (url "git://git.debian.org/git/pkg-shadow/shadow")
2268 (commit "v4.1.5.1"))
2269@end example
2270@end table
2271
2272@item @code{sha256}
2273A bytevector containing the SHA-256 hash of the source. Typically the
2274@code{base32} form is used here to generate the bytevector from a
2275base-32 string.
2276
2277@item @code{file-name} (default: @code{#f})
2278The file name under which the source code should be saved. When this is
2279@code{#f}, a sensible default value will be used in most cases. In case
2280the source is fetched from a URL, the file name from the URL will be
2281used. For version control checkouts, it's recommended to provide the
2282file name explicitly because the default is not very descriptive.
2283
2284@item @code{patches} (default: @code{'()})
2285A list of file names containing patches to be applied to the source.
2286
2287@item @code{snippet} (default: @code{#f})
2288A quoted piece of code that will be run in the source directory to make
2289any modifications, which is sometimes more convenient than a patch.
2290
2291@item @code{patch-flags} (default: @code{'("-p1")})
2292A list of command-line flags that should be passed to the @code{patch}
2293command.
2294
2295@item @code{patch-inputs} (default: @code{#f})
2296Input packages or derivations to the patching process. When this is
2297@code{#f}, the usual set of inputs necessary for patching are provided,
2298such as GNU@tie{}Patch.
2299
2300@item @code{modules} (default: @code{'()})
2301A list of Guile modules that should be loaded during the patching
2302process and while running the code in the @code{snippet} field.
2303
2304@item @code{imported-modules} (default: @code{'()})
2305The list of Guile modules to import in the patch derivation, for use by
2306the @code{snippet}.
2307
2308@item @code{patch-guile} (default: @code{#f})
2309The Guile package that should be used in the patching process. When
2310this is @code{#f}, a sensible default is used.
2311@end table
2312@end deftp
2313
9c1edabd 2314
7458bd0a
LC
2315@node Build Systems
2316@section Build Systems
2317
2318@cindex build system
2319Each package definition specifies a @dfn{build system} and arguments for
2320that build system (@pxref{Defining Packages}). This @code{build-system}
2321field represents the build procedure of the package, as well implicit
2322dependencies of that build procedure.
2323
2324Build systems are @code{<build-system>} objects. The interface to
2325create and manipulate them is provided by the @code{(guix build-system)}
2326module, and actual build systems are exported by specific modules.
2327
f5fd4fd2 2328@cindex bag (low-level package representation)
0d5a559f
LC
2329Under the hood, build systems first compile package objects to
2330@dfn{bags}. A @dfn{bag} is like a package, but with less
2331ornamentation---in other words, a bag is a lower-level representation of
2332a package, which includes all the inputs of that package, including some
2333that were implicitly added by the build system. This intermediate
2334representation is then compiled to a derivation (@pxref{Derivations}).
2335
7458bd0a
LC
2336Build systems accept an optional list of @dfn{arguments}. In package
2337definitions, these are passed @i{via} the @code{arguments} field
2338(@pxref{Defining Packages}). They are typically keyword arguments
2339(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2340Guile Reference Manual}). The value of these arguments is usually
2341evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2342by the daemon (@pxref{Derivations}).
2343
2344The main build system is @var{gnu-build-system}, which implements the
2345standard build procedure for GNU packages and many other packages. It
2346is provided by the @code{(guix build-system gnu)} module.
2347
2348@defvr {Scheme Variable} gnu-build-system
2349@var{gnu-build-system} represents the GNU Build System, and variants
2350thereof (@pxref{Configuration, configuration and makefile conventions,,
2351standards, GNU Coding Standards}).
2352
2353@cindex build phases
2354In a nutshell, packages using it configured, built, and installed with
2355the usual @code{./configure && make && make check && make install}
2356command sequence. In practice, a few additional steps are often needed.
2357All these steps are split up in separate @dfn{phases},
2358notably@footnote{Please see the @code{(guix build gnu-build-system)}
2359modules for more details about the build phases.}:
2360
2361@table @code
2362@item unpack
2363Unpack the source tarball, and change the current directory to the
2364extracted source tree. If the source is actually a directory, copy it
2365to the build tree, and enter that directory.
2366
2367@item patch-source-shebangs
2368Patch shebangs encountered in source files so they refer to the right
2369store file names. For instance, this changes @code{#!/bin/sh} to
2370@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2371
2372@item configure
2373Run the @file{configure} script with a number of default options, such
2374as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2375by the @code{#:configure-flags} argument.
2376
2377@item build
2378Run @code{make} with the list of flags specified with
2379@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
2380(the default), build with @code{make -j}.
2381
2382@item check
2383Run @code{make check}, or some other target specified with
2384@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2385@code{#:parallel-tests?} argument is true (the default), run @code{make
2386check -j}.
2387
2388@item install
2389Run @code{make install} with the flags listed in @code{#:make-flags}.
2390
2391@item patch-shebangs
2392Patch shebangs on the installed executable files.
2393
2394@item strip
2395Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2396is false), copying them to the @code{debug} output when available
2397(@pxref{Installing Debugging Files}).
2398@end table
2399
2400@vindex %standard-phases
2401The build-side module @code{(guix build gnu-build-system)} defines
2402@var{%standard-phases} as the default list of build phases.
2403@var{%standard-phases} is a list of symbol/procedure pairs, where the
2404procedure implements the actual phase.
2405
2406The list of phases used for a particular package can be changed with the
2407@code{#:phases} parameter. For instance, passing:
2408
2409@example
2410#:phases (alist-delete 'configure %standard-phases)
2411@end example
2412
9bf404e9 2413means that all the phases described above will be used, except the
7458bd0a
LC
2414@code{configure} phase.
2415
2416In addition, this build system ensures that the ``standard'' environment
2417for GNU packages is available. This includes tools such as GCC, libc,
2418Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2419build-system gnu)} module for a complete list.) We call these the
2420@dfn{implicit inputs} of a package, because package definitions don't
2421have to mention them.
2422@end defvr
2423
2424Other @code{<build-system>} objects are defined to support other
2425conventions and tools used by free software packages. They inherit most
2426of @var{gnu-build-system}, and differ mainly in the set of inputs
2427implicitly added to the build process, and in the list of phases
2428executed. Some of these build systems are listed below.
2429
2430@defvr {Scheme Variable} cmake-build-system
2431This variable is exported by @code{(guix build-system cmake)}. It
2432implements the build procedure for packages using the
2433@url{http://www.cmake.org, CMake build tool}.
2434
2435It automatically adds the @code{cmake} package to the set of inputs.
2436Which package is used can be specified with the @code{#:cmake}
2437parameter.
9849cfc1
LC
2438
2439The @code{#:configure-flags} parameter is taken as a list of flags
2440passed to the @command{cmake} command. The @code{#:build-type}
2441parameter specifies in abstract terms the flags passed to the compiler;
2442it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2443debugging information''), which roughly means that code is compiled with
2444@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
2445@end defvr
2446
3afcf52b
FB
2447@defvr {Scheme Variable} glib-or-gtk-build-system
2448This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2449is intended for use with packages making use of GLib or GTK+.
2450
2451This build system adds the following two phases to the ones defined by
2452@var{gnu-build-system}:
2453
2454@table @code
2455@item glib-or-gtk-wrap
2456The phase @code{glib-or-gtk-wrap} ensures that programs found under
2457@file{bin/} are able to find GLib's ``schemas'' and
2458@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2459modules}. This is achieved by wrapping the programs in launch scripts
2460that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2461environment variables.
2462
73aa8ddb
LC
2463It is possible to exclude specific package outputs from that wrapping
2464process by listing their names in the
2465@code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
2466when an output is known not to contain any GLib or GTK+ binaries, and
2467where wrapping would gratuitously add a dependency of that output on
2468GLib and GTK+.
2469
3afcf52b
FB
2470@item glib-or-gtk-compile-schemas
2471The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
2472@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
2473GSettings schemas} are compiled. Compilation is performed by the
2474@command{glib-compile-schemas} program. It is provided by the package
2475@code{glib:bin} which is automatically imported by the build system.
2476The @code{glib} package providing @command{glib-compile-schemas} can be
2477specified with the @code{#:glib} parameter.
2478@end table
2479
2480Both phases are executed after the @code{install} phase.
2481@end defvr
2482
7458bd0a
LC
2483@defvr {Scheme Variable} python-build-system
2484This variable is exported by @code{(guix build-system python)}. It
2485implements the more or less standard build procedure used by Python
2486packages, which consists in running @code{python setup.py build} and
2487then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
2488
2489For packages that install stand-alone Python programs under @code{bin/},
2490it takes care of wrapping these programs so their @code{PYTHONPATH}
2491environment variable points to all the Python libraries they depend on.
2492
2493Which Python package is used can be specified with the @code{#:python}
2494parameter.
2495@end defvr
2496
2497@defvr {Scheme Variable} perl-build-system
2498This variable is exported by @code{(guix build-system perl)}. It
2d2a53fc
EB
2499implements the standard build procedure for Perl packages, which either
2500consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
2501followed by @code{Build} and @code{Build install}; or in running
2502@code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
2503@code{make} and @code{make install}; depending on which of
2504@code{Build.PL} or @code{Makefile.PL} is present in the package
2505distribution. Preference is given to the former if both @code{Build.PL}
2506and @code{Makefile.PL} exist in the package distribution. This
2507preference can be reversed by specifying @code{#t} for the
2508@code{#:make-maker?} parameter.
2509
2510The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
2511passes flags specified by the @code{#:make-maker-flags} or
2512@code{#:module-build-flags} parameter, respectively.
7458bd0a
LC
2513
2514Which Perl package is used can be specified with @code{#:perl}.
2515@end defvr
2516
f8f3bef6
RW
2517@defvr {Scheme Variable} r-build-system
2518This variable is exported by @code{(guix build-system r)}. It
2519implements the build procedure used by @uref{http://r-project.org, R}
2520packages, which essentially is little more than running @code{R CMD
2521INSTALL --library=/gnu/store/@dots{}} in an environment where
2522@code{R_LIBS_SITE} contains the paths to all R package inputs. Tests
2523are run after installation using the R function
2524@code{tools::testInstalledPackage}.
2525@end defvr
2526
c08f9818
DT
2527@defvr {Scheme Variable} ruby-build-system
2528This variable is exported by @code{(guix build-system ruby)}. It
2529implements the RubyGems build procedure used by Ruby packages, which
2530involves running @code{gem build} followed by @code{gem install}.
2531
5dc87623
DT
2532The @code{source} field of a package that uses this build system
2533typically references a gem archive, since this is the format that Ruby
2534developers use when releasing their software. The build system unpacks
2535the gem archive, potentially patches the source, runs the test suite,
2536repackages the gem, and installs it. Additionally, directories and
2537tarballs may be referenced to allow building unreleased gems from Git or
2538a traditional source release tarball.
e83c6d00 2539
c08f9818 2540Which Ruby package is used can be specified with the @code{#:ruby}
6e9f2913
PP
2541parameter. A list of additional flags to be passed to the @command{gem}
2542command can be specified with the @code{#:gem-flags} parameter.
c08f9818 2543@end defvr
7458bd0a 2544
a677c726
RW
2545@defvr {Scheme Variable} waf-build-system
2546This variable is exported by @code{(guix build-system waf)}. It
2547implements a build procedure around the @code{waf} script. The common
2548phases---@code{configure}, @code{build}, and @code{install}---are
2549implemented by passing their names as arguments to the @code{waf}
2550script.
2551
2552The @code{waf} script is executed by the Python interpreter. Which
2553Python package is used to run the script can be specified with the
2554@code{#:python} parameter.
2555@end defvr
2556
14dfdf2e
FB
2557@defvr {Scheme Variable} haskell-build-system
2558This variable is exported by @code{(guix build-system haskell)}. It
2559implements the Cabal build procedure used by Haskell packages, which
2560involves running @code{runhaskell Setup.hs configure
2561--prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
2562Instead of installing the package by running @code{runhaskell Setup.hs
2563install}, to avoid trying to register libraries in the read-only
2564compiler store directory, the build system uses @code{runhaskell
2565Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
2566addition, the build system generates the package documentation by
2567running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
2568is passed. Optional Haddock parameters can be passed with the help of
2569the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
2570not found, the build system looks for @code{Setup.lhs} instead.
2571
2572Which Haskell compiler is used can be specified with the @code{#:haskell}
a54bd6d7 2573parameter which defaults to @code{ghc}.
14dfdf2e
FB
2574@end defvr
2575
e9137a53
FB
2576@defvr {Scheme Variable} emacs-build-system
2577This variable is exported by @code{(guix build-system emacs)}. It
2578implements an installation procedure similar to the one of Emacs' own
2579packaging system (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
2580
2581It first creates the @code{@var{package}-autoloads.el} file, then it
2582byte compiles all Emacs Lisp files. Differently from the Emacs
2583packaging system, the Info documentation files are moved to the standard
2584documentation directory and the @file{dir} file is deleted. Each
2585package is installed in its own directory under
2586@file{share/emacs/site-lisp/guix.d}.
2587@end defvr
2588
7458bd0a
LC
2589Lastly, for packages that do not need anything as sophisticated, a
2590``trivial'' build system is provided. It is trivial in the sense that
2591it provides basically no support: it does not pull any implicit inputs,
2592and does not have a notion of build phases.
2593
2594@defvr {Scheme Variable} trivial-build-system
2595This variable is exported by @code{(guix build-system trivial)}.
2596
2597This build system requires a @code{#:builder} argument. This argument
2598must be a Scheme expression that builds the package's output(s)---as
2599with @code{build-expression->derivation} (@pxref{Derivations,
2600@code{build-expression->derivation}}).
2601@end defvr
2602
568717fd
LC
2603@node The Store
2604@section The Store
2605
e531ac2a
LC
2606@cindex store
2607@cindex store paths
2608
2609Conceptually, the @dfn{store} is where derivations that have been
834129e0 2610successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a 2611Sub-directories in the store are referred to as @dfn{store paths}. The
4988dd40 2612store has an associated database that contains information such as the
e531ac2a
LC
2613store paths referred to by each store path, and the list of @emph{valid}
2614store paths---paths that result from a successful build.
2615
2616The store is always accessed by the daemon on behalf of its clients
2617(@pxref{Invoking guix-daemon}). To manipulate the store, clients
2618connect to the daemon over a Unix-domain socket, send it requests, and
2619read the result---these are remote procedure calls, or RPCs.
2620
2621The @code{(guix store)} module provides procedures to connect to the
2622daemon, and to perform RPCs. These are described below.
2623
2624@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
2625Connect to the daemon over the Unix-domain socket at @var{file}. When
2626@var{reserve-space?} is true, instruct it to reserve a little bit of
2627extra space on the file system so that the garbage collector can still
2628operate, should the disk become full. Return a server object.
2629
2630@var{file} defaults to @var{%default-socket-path}, which is the normal
2631location given the options that were passed to @command{configure}.
2632@end deffn
2633
2634@deffn {Scheme Procedure} close-connection @var{server}
2635Close the connection to @var{server}.
2636@end deffn
2637
2638@defvr {Scheme Variable} current-build-output-port
2639This variable is bound to a SRFI-39 parameter, which refers to the port
2640where build and error logs sent by the daemon should be written.
2641@end defvr
2642
2643Procedures that make RPCs all take a server object as their first
2644argument.
2645
2646@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
2647Return @code{#t} when @var{path} is a valid store path.
2648@end deffn
2649
cfbf9160 2650@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
2651Add @var{text} under file @var{name} in the store, and return its store
2652path. @var{references} is the list of store paths referred to by the
2653resulting store path.
2654@end deffn
2655
874e6874 2656@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
2657Build @var{derivations} (a list of @code{<derivation>} objects or
2658derivation paths), and return when the worker is done building them.
2659Return @code{#t} on success.
874e6874
LC
2660@end deffn
2661
b860f382
LC
2662Note that the @code{(guix monads)} module provides a monad as well as
2663monadic versions of the above procedures, with the goal of making it
2664more convenient to work with code that accesses the store (@pxref{The
2665Store Monad}).
2666
e531ac2a
LC
2667@c FIXME
2668@i{This section is currently incomplete.}
568717fd
LC
2669
2670@node Derivations
2671@section Derivations
2672
874e6874
LC
2673@cindex derivations
2674Low-level build actions and the environment in which they are performed
2675are represented by @dfn{derivations}. A derivation contain the
2676following pieces of information:
2677
2678@itemize
2679@item
2680The outputs of the derivation---derivations produce at least one file or
2681directory in the store, but may produce more.
2682
2683@item
2684The inputs of the derivations, which may be other derivations or plain
2685files in the store (patches, build scripts, etc.)
2686
2687@item
2688The system type targeted by the derivation---e.g., @code{x86_64-linux}.
2689
2690@item
2691The file name of a build script in the store, along with the arguments
2692to be passed.
2693
2694@item
2695A list of environment variables to be defined.
2696
2697@end itemize
2698
2699@cindex derivation path
2700Derivations allow clients of the daemon to communicate build actions to
2701the store. They exist in two forms: as an in-memory representation,
2702both on the client- and daemon-side, and as files in the store whose
2703name end in @code{.drv}---these files are referred to as @dfn{derivation
2704paths}. Derivations paths can be passed to the @code{build-derivations}
2705procedure to perform the build actions they prescribe (@pxref{The
2706Store}).
2707
2708The @code{(guix derivations)} module provides a representation of
2709derivations as Scheme objects, along with procedures to create and
2710otherwise manipulate derivations. The lowest-level primitive to create
2711a derivation is the @code{derivation} procedure:
2712
1909431c
LC
2713@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
2714 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 2715 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 2716 [#:system (%current-system)] [#:references-graphs #f] @
4a6aeb67
LC
2717 [#:allowed-references #f] [#:leaked-env-vars #f] [#:local-build? #f] @
2718 [#:substitutable? #t]
59688fc4
LC
2719Build a derivation with the given arguments, and return the resulting
2720@code{<derivation>} object.
874e6874 2721
2096ef47 2722When @var{hash} and @var{hash-algo} are given, a
874e6874 2723@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
2724known in advance, such as a file download. If, in addition,
2725@var{recursive?} is true, then that fixed output may be an executable
2726file or a directory and @var{hash} must be the hash of an archive
2727containing this output.
5b0c9d16 2728
858e9282 2729When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
2730name/store path pairs. In that case, the reference graph of each store
2731path is exported in the build environment in the corresponding file, in
2732a simple text format.
1909431c 2733
b53be755
LC
2734When @var{allowed-references} is true, it must be a list of store items
2735or outputs that the derivation's output may refer to.
2736
c0468155
LC
2737When @var{leaked-env-vars} is true, it must be a list of strings
2738denoting environment variables that are allowed to ``leak'' from the
2739daemon's environment to the build environment. This is only applicable
2740to fixed-output derivations---i.e., when @var{hash} is true. The main
2741use is to allow variables such as @code{http_proxy} to be passed to
2742derivations that download files.
2743
1909431c
LC
2744When @var{local-build?} is true, declare that the derivation is not a
2745good candidate for offloading and should rather be built locally
2746(@pxref{Daemon Offload Setup}). This is the case for small derivations
2747where the costs of data transfers would outweigh the benefits.
4a6aeb67
LC
2748
2749When @var{substitutable?} is false, declare that substitutes of the
2750derivation's output should not be used (@pxref{Substitutes}). This is
2751useful, for instance, when building packages that capture details of the
2752host CPU instruction set.
874e6874
LC
2753@end deffn
2754
2755@noindent
2756Here's an example with a shell script as its builder, assuming
2757@var{store} is an open connection to the daemon, and @var{bash} points
2758to a Bash executable in the store:
2759
2760@lisp
2761(use-modules (guix utils)
2762 (guix store)
2763 (guix derivations))
2764
59688fc4
LC
2765(let ((builder ; add the Bash script to the store
2766 (add-text-to-store store "my-builder.sh"
2767 "echo hello world > $out\n" '())))
2768 (derivation store "foo"
2769 bash `("-e" ,builder)
21b679f6 2770 #:inputs `((,bash) (,builder))
59688fc4 2771 #:env-vars '(("HOME" . "/homeless"))))
834129e0 2772@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
2773@end lisp
2774
21b679f6
LC
2775As can be guessed, this primitive is cumbersome to use directly. A
2776better approach is to write build scripts in Scheme, of course! The
2777best course of action for that is to write the build code as a
2778``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 2779information, @pxref{G-Expressions}.
21b679f6
LC
2780
2781Once upon a time, @code{gexp->derivation} did not exist and constructing
2782derivations with build code written in Scheme was achieved with
2783@code{build-expression->derivation}, documented below. This procedure
2784is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 2785
dd1a5a15
LC
2786@deffn {Scheme Procedure} build-expression->derivation @var{store} @
2787 @var{name} @var{exp} @
2788 [#:system (%current-system)] [#:inputs '()] @
2789 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 2790 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824 2791 [#:references-graphs #f] [#:allowed-references #f] @
4a6aeb67 2792 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
874e6874
LC
2793Return a derivation that executes Scheme expression @var{exp} as a
2794builder for derivation @var{name}. @var{inputs} must be a list of
2795@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
2796@code{"out"} is assumed. @var{modules} is a list of names of Guile
2797modules from the current search path to be copied in the store,
2798compiled, and made available in the load path during the execution of
2799@var{exp}---e.g., @code{((guix build utils) (guix build
2800gnu-build-system))}.
2801
2802@var{exp} is evaluated in an environment where @code{%outputs} is bound
2803to a list of output/path pairs, and where @code{%build-inputs} is bound
2804to a list of string/output-path pairs made from @var{inputs}.
2805Optionally, @var{env-vars} is a list of string pairs specifying the name
2806and value of environment variables visible to the builder. The builder
2807terminates by passing the result of @var{exp} to @code{exit}; thus, when
2808@var{exp} returns @code{#f}, the build is considered to have failed.
2809
2810@var{exp} is built using @var{guile-for-build} (a derivation). When
2811@var{guile-for-build} is omitted or is @code{#f}, the value of the
2812@code{%guile-for-build} fluid is used instead.
9c629a27 2813
63a42824 2814See the @code{derivation} procedure for the meaning of
4a6aeb67
LC
2815@var{references-graphs}, @var{allowed-references}, @var{local-build?},
2816and @var{substitutable?}.
874e6874
LC
2817@end deffn
2818
2819@noindent
2820Here's an example of a single-output derivation that creates a directory
2821containing one file:
2822
2823@lisp
2824(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 2825 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
2826 (call-with-output-file (string-append out "/test")
2827 (lambda (p)
2828 (display '(hello guix) p))))))
dd1a5a15 2829 (build-expression->derivation store "goo" builder))
874e6874 2830
834129e0 2831@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
2832@end lisp
2833
568717fd 2834
b860f382
LC
2835@node The Store Monad
2836@section The Store Monad
2837
2838@cindex monad
2839
2840The procedures that operate on the store described in the previous
2841sections all take an open connection to the build daemon as their first
2842argument. Although the underlying model is functional, they either have
2843side effects or depend on the current state of the store.
2844
2845The former is inconvenient: the connection to the build daemon has to be
2846carried around in all those functions, making it impossible to compose
2847functions that do not take that parameter with functions that do. The
2848latter can be problematic: since store operations have side effects
2849and/or depend on external state, they have to be properly sequenced.
2850
2851@cindex monadic values
2852@cindex monadic functions
2853This is where the @code{(guix monads)} module comes in. This module
2854provides a framework for working with @dfn{monads}, and a particularly
2855useful monad for our uses, the @dfn{store monad}. Monads are a
2856construct that allows two things: associating ``context'' with values
2857(in our case, the context is the store), and building sequences of
561fb6c3 2858computations (here computations include accesses to the store.) Values
b860f382
LC
2859in a monad---values that carry this additional context---are called
2860@dfn{monadic values}; procedures that return such values are called
2861@dfn{monadic procedures}.
2862
2863Consider this ``normal'' procedure:
2864
2865@example
45adbd62
LC
2866(define (sh-symlink store)
2867 ;; Return a derivation that symlinks the 'bash' executable.
2868 (let* ((drv (package-derivation store bash))
2869 (out (derivation->output-path drv))
2870 (sh (string-append out "/bin/bash")))
2871 (build-expression->derivation store "sh"
2872 `(symlink ,sh %output))))
b860f382
LC
2873@end example
2874
c6f30b81
LC
2875Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
2876as a monadic function:
b860f382
LC
2877
2878@example
45adbd62 2879(define (sh-symlink)
b860f382 2880 ;; Same, but return a monadic value.
c6f30b81
LC
2881 (mlet %store-monad ((drv (package->derivation bash)))
2882 (gexp->derivation "sh"
2883 #~(symlink (string-append #$drv "/bin/bash")
2884 #$output))))
b860f382
LC
2885@end example
2886
c6f30b81
LC
2887There several things to note in the second version: the @code{store}
2888parameter is now implicit and is ``threaded'' in the calls to the
2889@code{package->derivation} and @code{gexp->derivation} monadic
2890procedures, and the monadic value returned by @code{package->derivation}
2891is @dfn{bound} using @code{mlet} instead of plain @code{let}.
2892
2893As it turns out, the call to @code{package->derivation} can even be
2894omitted since it will take place implicitly, as we will see later
2895(@pxref{G-Expressions}):
2896
2897@example
2898(define (sh-symlink)
2899 (gexp->derivation "sh"
2900 #~(symlink (string-append #$bash "/bin/bash")
2901 #$output)))
2902@end example
b860f382 2903
7ce21611
LC
2904@c See
2905@c <https://syntaxexclamation.wordpress.com/2014/06/26/escaping-continuations/>
2906@c for the funny quote.
2907Calling the monadic @code{sh-symlink} has no effect. As someone once
2908said, ``you exit a monad like you exit a building on fire: by running''.
2909So, to exit the monad and get the desired effect, one must use
2910@code{run-with-store}:
b860f382
LC
2911
2912@example
8e9aa37f
CAW
2913(run-with-store (open-connection) (sh-symlink))
2914@result{} /gnu/store/...-sh-symlink
b860f382
LC
2915@end example
2916
b9b86078
LC
2917Note that the @code{(guix monad-repl)} module extends Guile's REPL with
2918new ``meta-commands'' to make it easier to deal with monadic procedures:
2919@code{run-in-store}, and @code{enter-store-monad}. The former, is used
2920to ``run'' a single monadic value through the store:
2921
2922@example
2923scheme@@(guile-user)> ,run-in-store (package->derivation hello)
2924$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2925@end example
2926
2927The latter enters a recursive REPL, where all the return values are
2928automatically run through the store:
2929
2930@example
2931scheme@@(guile-user)> ,enter-store-monad
2932store-monad@@(guile-user) [1]> (package->derivation hello)
2933$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2934store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
2935$3 = "/gnu/store/@dots{}-foo"
2936store-monad@@(guile-user) [1]> ,q
2937scheme@@(guile-user)>
2938@end example
2939
2940@noindent
2941Note that non-monadic values cannot be returned in the
2942@code{store-monad} REPL.
2943
e87f0591
LC
2944The main syntactic forms to deal with monads in general are provided by
2945the @code{(guix monads)} module and are described below.
b860f382
LC
2946
2947@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
2948Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
2949in @var{monad}.
2950@end deffn
2951
2952@deffn {Scheme Syntax} return @var{val}
2953Return a monadic value that encapsulates @var{val}.
2954@end deffn
2955
751630c9 2956@deffn {Scheme Syntax} >>= @var{mval} @var{mproc} ...
b860f382 2957@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
751630c9
LC
2958procedures @var{mproc}@dots{}@footnote{This operation is commonly
2959referred to as ``bind'', but that name denotes an unrelated procedure in
2960Guile. Thus we use this somewhat cryptic symbol inherited from the
2961Haskell language.}. There can be one @var{mproc} or several of them, as
2962in this example:
2963
2964@example
2965(run-with-state
2966 (with-monad %state-monad
2967 (>>= (return 1)
2968 (lambda (x) (return (+ 1 x)))
2969 (lambda (x) (return (* 2 x)))))
2970 'some-state)
2971
2972@result{} 4
2973@result{} some-state
2974@end example
b860f382
LC
2975@end deffn
2976
2977@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
2978 @var{body} ...
2979@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
2980 @var{body} ...
2981Bind the variables @var{var} to the monadic values @var{mval} in
2982@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2983``normal'' value @var{val}, as per @code{let}.
2984
2985@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2986(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2987@end deffn
2988
405a9d4e
LC
2989@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
2990Bind @var{mexp} and the following monadic expressions in sequence,
2991returning the result of the last expression.
2992
2993This is akin to @code{mlet}, except that the return values of the
2994monadic expressions are ignored. In that sense, it is analogous to
2995@code{begin}, but applied to monadic expressions.
2996@end deffn
2997
561fb6c3
LC
2998@cindex state monad
2999The @code{(guix monads)} module provides the @dfn{state monad}, which
3000allows an additional value---the state---to be @emph{threaded} through
3001monadic procedure calls.
3002
3003@defvr {Scheme Variable} %state-monad
3004The state monad. Procedures in the state monad can access and change
3005the state that is threaded.
3006
3007Consider the example below. The @code{square} procedure returns a value
3008in the state monad. It returns the square of its argument, but also
3009increments the current state value:
3010
3011@example
3012(define (square x)
3013 (mlet %state-monad ((count (current-state)))
3014 (mbegin %state-monad
3015 (set-current-state (+ 1 count))
3016 (return (* x x)))))
3017
3018(run-with-state (sequence %state-monad (map square (iota 3))) 0)
3019@result{} (0 1 4)
3020@result{} 3
3021@end example
3022
3023When ``run'' through @var{%state-monad}, we obtain that additional state
3024value, which is the number of @code{square} calls.
3025@end defvr
3026
3027@deffn {Monadic Procedure} current-state
3028Return the current state as a monadic value.
3029@end deffn
3030
3031@deffn {Monadic Procedure} set-current-state @var{value}
3032Set the current state to @var{value} and return the previous state as a
3033monadic value.
3034@end deffn
3035
3036@deffn {Monadic Procedure} state-push @var{value}
3037Push @var{value} to the current state, which is assumed to be a list,
3038and return the previous state as a monadic value.
3039@end deffn
3040
3041@deffn {Monadic Procedure} state-pop
3042Pop a value from the current state and return it as a monadic value.
3043The state is assumed to be a list.
3044@end deffn
3045
3046@deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
3047Run monadic value @var{mval} starting with @var{state} as the initial
3048state. Return two values: the resulting value, and the resulting state.
3049@end deffn
3050
e87f0591
LC
3051The main interface to the store monad, provided by the @code{(guix
3052store)} module, is as follows.
b860f382
LC
3053
3054@defvr {Scheme Variable} %store-monad
561fb6c3
LC
3055The store monad---an alias for @var{%state-monad}.
3056
3057Values in the store monad encapsulate accesses to the store. When its
3058effect is needed, a value of the store monad must be ``evaluated'' by
3059passing it to the @code{run-with-store} procedure (see below.)
b860f382
LC
3060@end defvr
3061
3062@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
3063Run @var{mval}, a monadic value in the store monad, in @var{store}, an
3064open store connection.
3065@end deffn
3066
ad372953 3067@deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
b860f382 3068Return as a monadic value the absolute file name in the store of the file
ad372953
LC
3069containing @var{text}, a string. @var{references} is a list of store items that the
3070resulting text file refers to; it defaults to the empty list.
45adbd62
LC
3071@end deffn
3072
0a90af15
LC
3073@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
3074 [#:recursive? #t]
3075Return the name of @var{file} once interned in the store. Use
3076@var{name} as its store name, or the basename of @var{file} if
3077@var{name} is omitted.
3078
3079When @var{recursive?} is true, the contents of @var{file} are added
3080recursively; if @var{file} designates a flat file and @var{recursive?}
3081is true, its contents are added, and its permission bits are kept.
3082
3083The example below adds a file to the store, under two different names:
3084
3085@example
3086(run-with-store (open-connection)
3087 (mlet %store-monad ((a (interned-file "README"))
3088 (b (interned-file "README" "LEGU-MIN")))
3089 (return (list a b))))
3090
3091@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
3092@end example
3093
3094@end deffn
3095
e87f0591
LC
3096The @code{(guix packages)} module exports the following package-related
3097monadic procedures:
3098
b860f382 3099@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
3100 [#:system (%current-system)] [#:target #f] @
3101 [#:output "out"] Return as a monadic
b860f382
LC
3102value in the absolute file name of @var{file} within the @var{output}
3103directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
3104of the @var{output} directory of @var{package}. When @var{target} is
3105true, use it as a cross-compilation target triplet.
b860f382
LC
3106@end deffn
3107
b860f382 3108@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
3109@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
3110 @var{target} [@var{system}]
3111Monadic version of @code{package-derivation} and
3112@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
3113@end deffn
3114
3115
21b679f6
LC
3116@node G-Expressions
3117@section G-Expressions
3118
3119@cindex G-expression
3120@cindex build code quoting
3121So we have ``derivations'', which represent a sequence of build actions
3122to be performed to produce an item in the store (@pxref{Derivations}).
3123Those build actions are performed when asking the daemon to actually
3124build the derivations; they are run by the daemon in a container
3125(@pxref{Invoking guix-daemon}).
3126
3127@cindex strata of code
3128It should come as no surprise that we like to write those build actions
3129in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
3130code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
3131Manuel Serrano et al.@: in the context of their work on Hop. Oleg
3132Kiselyov, who has written insightful
3133@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
3134on this topic}, refers to this kind of code generation as
3135@dfn{staging}.}: the ``host code''---code that defines packages, talks
3136to the daemon, etc.---and the ``build code''---code that actually
3137performs build actions, such as making directories, invoking
3138@command{make}, etc.
21b679f6
LC
3139
3140To describe a derivation and its build actions, one typically needs to
3141embed build code inside host code. It boils down to manipulating build
3142code as data, and Scheme's homoiconicity---code has a direct
3143representation as data---comes in handy for that. But we need more than
3144Scheme's normal @code{quasiquote} mechanism to construct build
3145expressions.
3146
3147The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
3148S-expressions adapted to build expressions. G-expressions, or
3149@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
3150@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
3151@code{#$}, and @code{#$@@}), which are comparable respectively to
3152@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
3153(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
3154Reference Manual}). However, there are major differences:
3155
3156@itemize
3157@item
3158Gexps are meant to be written to a file and run or manipulated by other
3159processes.
3160
3161@item
b39fc6f7
LC
3162When a high-level object such as a package or derivation is unquoted
3163inside a gexp, the result is as if its output file name had been
3164introduced.
ff40e9b7 3165
21b679f6
LC
3166@item
3167Gexps carry information about the packages or derivations they refer to,
3168and these dependencies are automatically added as inputs to the build
3169processes that use them.
3170@end itemize
3171
c2b84676 3172@cindex lowering, of high-level objects in gexps
343eacbe
LC
3173This mechanism is not limited to package and derivation
3174objects: @dfn{compilers} able to ``lower'' other high-level objects to
c2b84676
LC
3175derivations or files in the store can be defined,
3176such that these objects can also be inserted
343eacbe
LC
3177into gexps. For example, a useful type of high-level object that can be
3178inserted in a gexp is ``file-like objects'', which make it easy to
3179add files to the store and refer to them in
558e8b11
LC
3180derivations and such (see @code{local-file} and @code{plain-file}
3181below.)
b39fc6f7 3182
21b679f6
LC
3183To illustrate the idea, here is an example of a gexp:
3184
3185@example
3186(define build-exp
3187 #~(begin
3188 (mkdir #$output)
3189 (chdir #$output)
aff8ce7c 3190 (symlink (string-append #$coreutils "/bin/ls")
21b679f6
LC
3191 "list-files")))
3192@end example
3193
3194This gexp can be passed to @code{gexp->derivation}; we obtain a
3195derivation that builds a directory containing exactly one symlink to
3196@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
3197
3198@example
3199(gexp->derivation "the-thing" build-exp)
3200@end example
3201
e20fd1bf 3202As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
3203substituted to the reference to the @var{coreutils} package in the
3204actual build code, and @var{coreutils} is automatically made an input to
3205the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
3206output)}) is replaced by a string containing the derivation's output
667b2508
LC
3207directory name.
3208
3209@cindex cross compilation
3210In a cross-compilation context, it is useful to distinguish between
3211references to the @emph{native} build of a package---that can run on the
3212host---versus references to cross builds of a package. To that end, the
3213@code{#+} plays the same role as @code{#$}, but is a reference to a
3214native package build:
3215
3216@example
3217(gexp->derivation "vi"
3218 #~(begin
3219 (mkdir #$output)
3220 (system* (string-append #+coreutils "/bin/ln")
3221 "-s"
3222 (string-append #$emacs "/bin/emacs")
3223 (string-append #$output "/bin/vi")))
3224 #:target "mips64el-linux")
3225@end example
3226
3227@noindent
3228In the example above, the native build of @var{coreutils} is used, so
3229that @command{ln} can actually run on the host; but then the
3230cross-compiled build of @var{emacs} is referenced.
3231
3232The syntactic form to construct gexps is summarized below.
21b679f6
LC
3233
3234@deffn {Scheme Syntax} #~@var{exp}
3235@deffnx {Scheme Syntax} (gexp @var{exp})
3236Return a G-expression containing @var{exp}. @var{exp} may contain one
3237or more of the following forms:
3238
3239@table @code
3240@item #$@var{obj}
3241@itemx (ungexp @var{obj})
b39fc6f7
LC
3242Introduce a reference to @var{obj}. @var{obj} may have one of the
3243supported types, for example a package or a
21b679f6
LC
3244derivation, in which case the @code{ungexp} form is replaced by its
3245output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
3246
b39fc6f7
LC
3247If @var{obj} is a list, it is traversed and references to supported
3248objects are substituted similarly.
21b679f6
LC
3249
3250If @var{obj} is another gexp, its contents are inserted and its
3251dependencies are added to those of the containing gexp.
3252
3253If @var{obj} is another kind of object, it is inserted as is.
3254
b39fc6f7
LC
3255@item #$@var{obj}:@var{output}
3256@itemx (ungexp @var{obj} @var{output})
21b679f6 3257This is like the form above, but referring explicitly to the
b39fc6f7
LC
3258@var{output} of @var{obj}---this is useful when @var{obj} produces
3259multiple outputs (@pxref{Packages with Multiple Outputs}).
21b679f6 3260
667b2508
LC
3261@item #+@var{obj}
3262@itemx #+@var{obj}:output
3263@itemx (ungexp-native @var{obj})
3264@itemx (ungexp-native @var{obj} @var{output})
3265Same as @code{ungexp}, but produces a reference to the @emph{native}
3266build of @var{obj} when used in a cross compilation context.
3267
21b679f6
LC
3268@item #$output[:@var{output}]
3269@itemx (ungexp output [@var{output}])
3270Insert a reference to derivation output @var{output}, or to the main
3271output when @var{output} is omitted.
3272
3273This only makes sense for gexps passed to @code{gexp->derivation}.
3274
3275@item #$@@@var{lst}
3276@itemx (ungexp-splicing @var{lst})
3277Like the above, but splices the contents of @var{lst} inside the
3278containing list.
3279
667b2508
LC
3280@item #+@@@var{lst}
3281@itemx (ungexp-native-splicing @var{lst})
3282Like the above, but refers to native builds of the objects listed in
3283@var{lst}.
3284
21b679f6
LC
3285@end table
3286
3287G-expressions created by @code{gexp} or @code{#~} are run-time objects
3288of the @code{gexp?} type (see below.)
3289@end deffn
3290
3291@deffn {Scheme Procedure} gexp? @var{obj}
3292Return @code{#t} if @var{obj} is a G-expression.
3293@end deffn
3294
3295G-expressions are meant to be written to disk, either as code building
3296some derivation, or as plain files in the store. The monadic procedures
3297below allow you to do that (@pxref{The Store Monad}, for more
3298information about monads.)
3299
3300@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
ce45eb4c 3301 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
21b679f6
LC
3302 [#:hash #f] [#:hash-algo #f] @
3303 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 3304 [#:module-path @var{%load-path}] @
c8351d9a 3305 [#:references-graphs #f] [#:allowed-references #f] @
c0468155 3306 [#:leaked-env-vars #f] @
0309e1b0 3307 [#:script-name (string-append @var{name} "-builder")] @
4a6aeb67 3308 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
21b679f6 3309Return a derivation @var{name} that runs @var{exp} (a gexp) with
0309e1b0
LC
3310@var{guile-for-build} (a derivation) on @var{system}; @var{exp} is
3311stored in a file called @var{script-name}. When @var{target} is true,
3312it is used as the cross-compilation target triplet for packages referred
3313to by @var{exp}.
21b679f6 3314
ce45eb4c
LC
3315Make @var{modules} available in the evaluation context of @var{exp};
3316@var{modules} is a list of names of Guile modules searched in
3317@var{module-path} to be copied in the store, compiled, and made available in
21b679f6
LC
3318the load path during the execution of @var{exp}---e.g., @code{((guix
3319build utils) (guix build gnu-build-system))}.
3320
ce45eb4c
LC
3321@var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3322applicable.
3323
b53833b2
LC
3324When @var{references-graphs} is true, it must be a list of tuples of one of the
3325following forms:
3326
3327@example
3328(@var{file-name} @var{package})
3329(@var{file-name} @var{package} @var{output})
3330(@var{file-name} @var{derivation})
3331(@var{file-name} @var{derivation} @var{output})
3332(@var{file-name} @var{store-item})
3333@end example
3334
3335The right-hand-side of each element of @var{references-graphs} is automatically made
3336an input of the build process of @var{exp}. In the build environment, each
3337@var{file-name} contains the reference graph of the corresponding item, in a simple
3338text format.
3339
c8351d9a
LC
3340@var{allowed-references} must be either @code{#f} or a list of output names and packages.
3341In the latter case, the list denotes store items that the result is allowed to
3342refer to. Any reference to another store item will lead to a build error.
3343
e20fd1bf 3344The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
3345@end deffn
3346
343eacbe 3347@cindex file-like objects
e1c153e0
LC
3348The @code{local-file}, @code{plain-file}, @code{computed-file},
3349@code{program-file}, and @code{scheme-file} procedures below return
3350@dfn{file-like objects}. That is, when unquoted in a G-expression,
3351these objects lead to a file in the store. Consider this G-expression:
343eacbe
LC
3352
3353@example
3354#~(system* (string-append #$glibc "/sbin/nscd") "-f"
3355 #$(local-file "/tmp/my-nscd.conf"))
3356@end example
3357
3358The effect here is to ``intern'' @file{/tmp/my-nscd.conf} by copying it
3359to the store. Once expanded, for instance @i{via}
3360@code{gexp->derivation}, the G-expression refers to that copy under
3361@file{/gnu/store}; thus, modifying or removing the file in @file{/tmp}
3362does not have any effect on what the G-expression does.
3363@code{plain-file} can be used similarly; it differs in that the file
3364content is directly passed as a string.
3365
d9ae938f
LC
3366@deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
3367 [#:recursive? #t]
3368Return an object representing local file @var{file} to add to the store; this
3369object can be used in a gexp. @var{file} will be added to the store under @var{name}--by
3370default the base name of @var{file}.
3371
3372When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
3373designates a flat file and @var{recursive?} is true, its contents are added, and its
3374permission bits are kept.
3375
3376This is the declarative counterpart of the @code{interned-file} monadic
3377procedure (@pxref{The Store Monad, @code{interned-file}}).
3378@end deffn
3379
558e8b11
LC
3380@deffn {Scheme Procedure} plain-file @var{name} @var{content}
3381Return an object representing a text file called @var{name} with the given
3382@var{content} (a string) to be added to the store.
3383
3384This is the declarative counterpart of @code{text-file}.
3385@end deffn
3386
91937029
LC
3387@deffn {Scheme Procedure} computed-file @var{name} @var{gexp} @
3388 [#:modules '()] [#:options '(#:local-build? #t)]
3389Return an object representing the store item @var{name}, a file or
3390directory computed by @var{gexp}. @var{modules} specifies the set of
3391modules visible in the execution context of @var{gexp}. @var{options}
3392is a list of additional arguments to pass to @code{gexp->derivation}.
3393
3394This is the declarative counterpart of @code{gexp->derivation}.
3395@end deffn
3396
21b679f6
LC
3397@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
3398Return an executable script @var{name} that runs @var{exp} using
3399@var{guile} with @var{modules} in its search path.
3400
3401The example below builds a script that simply invokes the @command{ls}
3402command:
3403
3404@example
3405(use-modules (guix gexp) (gnu packages base))
3406
3407(gexp->script "list-files"
3408 #~(execl (string-append #$coreutils "/bin/ls")
3409 "ls"))
3410@end example
3411
3412When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 3413@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
3414executable file @file{/gnu/store/@dots{}-list-files} along these lines:
3415
3416@example
3417#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
3418!#
3419(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
3420 "ls")
3421@end example
3422@end deffn
3423
15a01c72
LC
3424@deffn {Scheme Procedure} program-file @var{name} @var{exp} @
3425 [#:modules '()] [#:guile #f]
3426Return an object representing the executable store item @var{name} that
3427runs @var{gexp}. @var{guile} is the Guile package used to execute that
3428script, and @var{modules} is the list of modules visible to that script.
3429
3430This is the declarative counterpart of @code{gexp->script}.
3431@end deffn
3432
21b679f6
LC
3433@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
3434Return a derivation that builds a file @var{name} containing @var{exp}.
3435
3436The resulting file holds references to all the dependencies of @var{exp}
3437or a subset thereof.
3438@end deffn
1ed19464 3439
e1c153e0
LC
3440@deffn {Scheme Procedure} scheme-file @var{name} @var{exp}
3441Return an object representing the Scheme file @var{name} that contains
3442@var{exp}.
3443
3444This is the declarative counterpart of @code{gexp->file}.
3445@end deffn
3446
1ed19464
LC
3447@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
3448Return as a monadic value a derivation that builds a text file
3449containing all of @var{text}. @var{text} may list, in addition to
d9ae938f
LC
3450strings, objects of any type that can be used in a gexp: packages,
3451derivations, local file objects, etc. The resulting store file holds
3452references to all these.
1ed19464
LC
3453
3454This variant should be preferred over @code{text-file} anytime the file
3455to create will reference items from the store. This is typically the
3456case when building a configuration file that embeds store file names,
3457like this:
3458
3459@example
3460(define (profile.sh)
3461 ;; Return the name of a shell script in the store that
3462 ;; initializes the 'PATH' environment variable.
3463 (text-file* "profile.sh"
3464 "export PATH=" coreutils "/bin:"
3465 grep "/bin:" sed "/bin\n"))
3466@end example
3467
3468In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
3469will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
3470preventing them from being garbage-collected during its lifetime.
3471@end deffn
21b679f6 3472
b751cde3
LC
3473@deffn {Scheme Procedure} mixed-text-file @var{name} @var{text} @dots{}
3474Return an object representing store file @var{name} containing
3475@var{text}. @var{text} is a sequence of strings and file-like objects,
3476as in:
3477
3478@example
3479(mixed-text-file "profile"
3480 "export PATH=" coreutils "/bin:" grep "/bin")
3481@end example
3482
3483This is the declarative counterpart of @code{text-file*}.
3484@end deffn
3485
21b679f6
LC
3486Of course, in addition to gexps embedded in ``host'' code, there are
3487also modules containing build tools. To make it clear that they are
3488meant to be used in the build stratum, these modules are kept in the
3489@code{(guix build @dots{})} name space.
3490
c2b84676
LC
3491@cindex lowering, of high-level objects in gexps
3492Internally, high-level objects are @dfn{lowered}, using their compiler,
3493to either derivations or store items. For instance, lowering a package
3494yields a derivation, and lowering a @code{plain-file} yields a store
3495item. This is achieved using the @code{lower-object} monadic procedure.
3496
3497@deffn {Monadic Procedure} lower-object @var{obj} [@var{system}] @
3498 [#:target #f]
3499Return as a value in @var{%store-monad} the derivation or store item
3500corresponding to @var{obj} for @var{system}, cross-compiling for
3501@var{target} if @var{target} is true. @var{obj} must be an object that
3502has an associated gexp compiler, such as a @code{<package>}.
3503@end deffn
3504
21b679f6 3505
568717fd
LC
3506@c *********************************************************************
3507@node Utilities
3508@chapter Utilities
3509
210cc920
LC
3510This section describes tools primarily targeted at developers and users
3511who write new package definitions. They complement the Scheme
3512programming interface of Guix in a convenient way.
3513
568717fd 3514@menu
37166310 3515* Invoking guix build:: Building packages from the command line.
39bee8a2 3516* Invoking guix edit:: Editing package definitions.
210cc920 3517* Invoking guix download:: Downloading a file and printing its hash.
37166310 3518* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 3519* Invoking guix import:: Importing package definitions.
37166310 3520* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 3521* Invoking guix lint:: Finding errors in package definitions.
fcc58db6 3522* Invoking guix size:: Profiling disk usage.
88856916 3523* Invoking guix graph:: Visualizing the graph of packages.
372c4bbc 3524* Invoking guix environment:: Setting up development environments.
aff8ce7c 3525* Invoking guix publish:: Sharing substitutes.
568717fd
LC
3526@end menu
3527
e49951eb
MW
3528@node Invoking guix build
3529@section Invoking @command{guix build}
568717fd 3530
e49951eb 3531The @command{guix build} command builds packages or derivations and
6798a8e4
LC
3532their dependencies, and prints the resulting store paths. Note that it
3533does not modify the user's profile---this is the job of the
e49951eb 3534@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
3535it is mainly useful for distribution developers.
3536
3537The general syntax is:
c78bd12b
LC
3538
3539@example
e49951eb 3540guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
3541@end example
3542
3543@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
3544the software distribution such as @code{coreutils} or
3545@code{coreutils-8.20}, or a derivation such as
834129e0 3546@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
3547package with the corresponding name (and optionally version) is searched
3548for among the GNU distribution modules (@pxref{Package Modules}).
3549
3550Alternatively, the @code{--expression} option may be used to specify a
3551Scheme expression that evaluates to a package; this is useful when
3552disambiguation among several same-named packages or package variants is
3553needed.
c78bd12b
LC
3554
3555The @var{options} may be zero or more of the following:
3556
3557@table @code
3558
3559@item --expression=@var{expr}
3560@itemx -e @var{expr}
ac5de156 3561Build the package or derivation @var{expr} evaluates to.
c78bd12b 3562
5401dd75 3563For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
3564guile-1.8)}, which unambiguously designates this specific variant of
3565version 1.8 of Guile.
3566
56b82106
LC
3567Alternately, @var{expr} may be a G-expression, in which case it is used
3568as a build program passed to @code{gexp->derivation}
3569(@pxref{G-Expressions}).
3570
3571Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
3572(@pxref{The Store Monad}). The procedure must return a derivation as a
3573monadic value, which is then passed through @code{run-with-store}.
3574
c78bd12b
LC
3575@item --source
3576@itemx -S
3577Build the packages' source derivations, rather than the packages
3578themselves.
3579
e49951eb 3580For instance, @code{guix build -S gcc} returns something like
834129e0 3581@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 3582
f9cc8971
LC
3583The returned source tarball is the result of applying any patches and
3584code snippets specified in the package's @code{origin} (@pxref{Defining
3585Packages}).
3586
2cdfe13d
EB
3587@item --sources
3588Fetch and return the source of @var{package-or-derivation} and all their
3589dependencies, recursively. This is a handy way to obtain a local copy
3590of all the source code needed to build @var{packages}, allowing you to
3591eventually build them even without network access. It is an extension
3592of the @code{--source} option and can accept one of the following
3593optional argument values:
3594
3595@table @code
3596@item package
3597This value causes the @code{--sources} option to behave in the same way
3598as the @code{--source} option.
3599
3600@item all
3601Build all packages' source derivations, including any source that might
3602be listed as @code{inputs}. This is the default value.
3603
3604@example
3605$ guix build --sources tzdata
3606The following derivations will be built:
3607 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
3608 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3609@end example
3610
3611@item transitive
3612Build all packages' source derivations, as well as all source
3613derivations for packages' transitive inputs. This can be used e.g. to
3614prefetch package source for later offline building.
3615
3616@example
3617$ guix build --sources=transitive tzdata
3618The following derivations will be built:
3619 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3620 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
3621 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
3622 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
3623 /gnu/store/@dots{}-make-4.1.tar.xz.drv
3624 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
3625@dots{}
3626@end example
3627
3628@end table
3629
c78bd12b
LC
3630@item --system=@var{system}
3631@itemx -s @var{system}
3632Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
3633the host's system type.
3634
3635An example use of this is on Linux-based systems, which can emulate
3636different personalities. For instance, passing
3637@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
3638to build packages in a complete 32-bit environment.
3639
e55ec43d
LC
3640@item --target=@var{triplet}
3641@cindex cross-compilation
3642Cross-build for @var{triplet}, which must be a valid GNU triplet, such
3643as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
3644configuration triplets,, configure, GNU Configure and Build System}).
3645
7f3673f2
LC
3646@item --with-source=@var{source}
3647Use @var{source} as the source of the corresponding package.
3648@var{source} must be a file name or a URL, as for @command{guix
3649download} (@pxref{Invoking guix download}).
3650
3651The ``corresponding package'' is taken to be one specified on the
3652command line whose name matches the base of @var{source}---e.g., if
3653@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
3654package is @code{guile}. Likewise, the version string is inferred from
3655@var{source}; in the previous example, it's @code{2.0.10}.
3656
3657This option allows users to try out versions of packages other than the
3658one provided by the distribution. The example below downloads
3659@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
3660the @code{ed} package:
3661
3662@example
3663guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
3664@end example
3665
3666As a developer, @code{--with-source} makes it easy to test release
3667candidates:
3668
3669@example
3670guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
3671@end example
3672
a43b55f1
LC
3673@dots{} or to build from a checkout in a pristine environment:
3674
3675@example
3676$ git clone git://git.sv.gnu.org/guix.git
3677$ guix build guix --with-source=./guix
3678@end example
3679
05962f29
LC
3680@item --no-grafts
3681Do not ``graft'' packages. In practice, this means that package updates
3682available as grafts are not applied. @xref{Security Updates}, for more
3683information on grafts.
7f3673f2 3684
c78bd12b
LC
3685@item --derivations
3686@itemx -d
3687Return the derivation paths, not the output paths, of the given
3688packages.
3689
70ee5642
LC
3690@item --root=@var{file}
3691@itemx -r @var{file}
3692Make @var{file} a symlink to the result, and register it as a garbage
3693collector root.
3694
3695@item --log-file
3f208ad7 3696Return the build log file names or URLs for the given
70ee5642
LC
3697@var{package-or-derivation}s, or raise an error if build logs are
3698missing.
3699
3700This works regardless of how packages or derivations are specified. For
3701instance, the following invocations are equivalent:
3702
3703@example
3704guix build --log-file `guix build -d guile`
3705guix build --log-file `guix build guile`
3706guix build --log-file guile
3707guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
3708@end example
3709
3f208ad7
LC
3710If a log is unavailable locally, and unless @code{--no-substitutes} is
3711passed, the command looks for a corresponding log on one of the
3712substitute servers (as specified with @code{--substitute-urls}.)
70ee5642 3713
3f208ad7
LC
3714So for instance, let's say you want to see the build log of GDB on MIPS
3715but you're actually on an @code{x86_64} machine:
3716
3717@example
3718$ guix build --log-file gdb -s mips64el-linux
3719http://hydra.gnu.org/log/@dots{}-gdb-7.10
3720@end example
3721
3722You can freely access a huge library of build logs!
70ee5642
LC
3723@end table
3724
3725@cindex common build options
3726In addition, a number of options that control the build process are
3727common to @command{guix build} and other commands that can spawn builds,
3728such as @command{guix package} or @command{guix archive}. These are the
3729following:
3730
3731@table @code
3732
300868ba
LC
3733@item --load-path=@var{directory}
3734@itemx -L @var{directory}
3735Add @var{directory} to the front of the package module search path
3736(@pxref{Package Modules}).
3737
3738This allows users to define their own packages and make them visible to
3739the command-line tools.
3740
c78bd12b
LC
3741@item --keep-failed
3742@itemx -K
3743Keep the build tree of failed builds. Thus, if a build fail, its build
3744tree is kept under @file{/tmp}, in a directory whose name is shown at
3745the end of the build log. This is useful when debugging build issues.
3746
3747@item --dry-run
3748@itemx -n
3749Do not build the derivations.
3750
56b1f4b7
LC
3751@item --fallback
3752When substituting a pre-built binary fails, fall back to building
3753packages locally.
3754
f8a8e0fe
LC
3755@item --substitute-urls=@var{urls}
3756@anchor{client-substitute-urls}
3757Consider @var{urls} the whitespace-separated list of substitute source
3758URLs, overriding the default list of URLs of @command{guix-daemon}
3759(@pxref{daemon-substitute-urls,, @command{guix-daemon} URLs}).
3760
3761This means that substitutes may be downloaded from @var{urls}, provided
3762they are signed by a key authorized by the system administrator
3763(@pxref{Substitutes}).
3764
c78bd12b 3765@item --no-substitutes
b5385b52 3766Do not use substitutes for build products. That is, always build things
c4202d60
LC
3767locally instead of allowing downloads of pre-built binaries
3768(@pxref{Substitutes}).
c78bd12b 3769
425b0bfc 3770@item --no-build-hook
4ec2e92d
LC
3771Do not attempt to offload builds @i{via} the daemon's ``build hook''
3772(@pxref{Daemon Offload Setup}). That is, always build things locally
3773instead of offloading builds to remote machines.
425b0bfc 3774
969e678e
LC
3775@item --max-silent-time=@var{seconds}
3776When the build or substitution process remains silent for more than
3777@var{seconds}, terminate it and report a build failure.
3778
002622b6
LC
3779@item --timeout=@var{seconds}
3780Likewise, when the build or substitution process lasts for more than
3781@var{seconds}, terminate it and report a build failure.
3782
3783By default there is no timeout. This behavior can be restored with
3784@code{--timeout=0}.
3785
07ab4bf1
LC
3786@item --verbosity=@var{level}
3787Use the given verbosity level. @var{level} must be an integer between 0
3788and 5; higher means more verbose output. Setting a level of 4 or more
3789may be helpful when debugging setup issues with the build daemon.
3790
70ee5642
LC
3791@item --cores=@var{n}
3792@itemx -c @var{n}
3793Allow the use of up to @var{n} CPU cores for the build. The special
3794value @code{0} means to use as many CPU cores as available.
bf421152 3795
f6526eb3
LC
3796@item --max-jobs=@var{n}
3797@itemx -M @var{n}
3798Allow at most @var{n} build jobs in parallel. @xref{Invoking
3799guix-daemon, @code{--max-jobs}}, for details about this option and the
3800equivalent @command{guix-daemon} option.
3801
c78bd12b
LC
3802@end table
3803
e49951eb 3804Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
3805the @code{package-derivation} procedure of the @code{(guix packages)}
3806module, and to the @code{build-derivations} procedure of the @code{(guix
01d8ac64 3807derivations)} module.
c78bd12b 3808
16eb115e
DP
3809In addition to options explicitly passed on the command line,
3810@command{guix build} and other @command{guix} commands that support
3811building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
3812
3813@defvr {Environment Variable} GUIX_BUILD_OPTIONS
3814Users can define this variable to a list of command line options that
3815will automatically be used by @command{guix build} and other
3816@command{guix} commands that can perform builds, as in the example
3817below:
3818
3819@example
3820$ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
3821@end example
3822
847391fe
DP
3823These options are parsed independently, and the result is appended to
3824the parsed command-line options.
16eb115e
DP
3825@end defvr
3826
3827
39bee8a2
LC
3828@node Invoking guix edit
3829@section Invoking @command{guix edit}
3830
3831@cindex package definition, editing
3832So many packages, so many source files! The @command{guix edit} command
3833facilitates the life of packagers by pointing their editor at the source
3834file containing the definition of the specified packages. For instance:
3835
3836@example
3837guix edit gcc-4.8 vim
3838@end example
3839
3840@noindent
3841launches the program specified in the @code{EDITOR} environment variable
3842to edit the recipe of GCC@tie{}4.8.4 and that of Vim.
3843
3844If you are using Emacs, note that the Emacs user interface provides
6248e326
AK
3845similar functionality in the ``package info'' and ``package list''
3846buffers created by @kbd{M-x guix-search-by-name} and similar commands
3847(@pxref{Emacs Commands}).
39bee8a2
LC
3848
3849
210cc920
LC
3850@node Invoking guix download
3851@section Invoking @command{guix download}
3852
3853When writing a package definition, developers typically need to download
3854the package's source tarball, compute its SHA256 hash, and write that
3855hash in the package definition (@pxref{Defining Packages}). The
3856@command{guix download} tool helps with this task: it downloads a file
3857from the given URI, adds it to the store, and prints both its file name
3858in the store and its SHA256 hash.
3859
3860The fact that the downloaded file is added to the store saves bandwidth:
3861when the developer eventually tries to build the newly defined package
3862with @command{guix build}, the source tarball will not have to be
3863downloaded again because it is already in the store. It is also a
3864convenient way to temporarily stash files, which may be deleted
3865eventually (@pxref{Invoking guix gc}).
3866
3867The @command{guix download} command supports the same URIs as used in
3868package definitions. In particular, it supports @code{mirror://} URIs.
3869@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
3870Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
3871they are not available, an error is raised. @xref{Guile Preparations,
3872how to install the GnuTLS bindings for Guile,, gnutls-guile,
3873GnuTLS-Guile}, for more information.
210cc920
LC
3874
3875The following option is available:
3876
3877@table @code
3878@item --format=@var{fmt}
3879@itemx -f @var{fmt}
3880Write the hash in the format specified by @var{fmt}. For more
081145cf 3881information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
3882@end table
3883
6c365eca
NK
3884@node Invoking guix hash
3885@section Invoking @command{guix hash}
3886
210cc920 3887The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
3888It is primarily a convenience tool for anyone contributing to the
3889distribution: it computes the cryptographic hash of a file, which can be
3890used in the definition of a package (@pxref{Defining Packages}).
3891
3892The general syntax is:
3893
3894@example
3895guix hash @var{option} @var{file}
3896@end example
3897
3898@command{guix hash} has the following option:
3899
3900@table @code
3901
3902@item --format=@var{fmt}
3903@itemx -f @var{fmt}
210cc920 3904Write the hash in the format specified by @var{fmt}.
6c365eca
NK
3905
3906Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
3907(@code{hex} and @code{hexadecimal} can be used as well).
3908
3909If the @option{--format} option is not specified, @command{guix hash}
3910will output the hash in @code{nix-base32}. This representation is used
3911in the definitions of packages.
3912
3140f2df
LC
3913@item --recursive
3914@itemx -r
3915Compute the hash on @var{file} recursively.
3916
3917In this case, the hash is computed on an archive containing @var{file},
3918including its children if it is a directory. Some of @var{file}'s
3919meta-data is part of the archive; for instance, when @var{file} is a
3920regular file, the hash is different depending on whether @var{file} is
3921executable or not. Meta-data such as time stamps has no impact on the
3922hash (@pxref{Invoking guix archive}).
3923@c FIXME: Replace xref above with xref to an ``Archive'' section when
3924@c it exists.
3925
6c365eca
NK
3926@end table
3927
2f7d2d91
LC
3928@node Invoking guix import
3929@section Invoking @command{guix import}
3930
3931@cindex importing packages
3932@cindex package import
3933@cindex package conversion
3934The @command{guix import} command is useful for people willing to add a
3935package to the distribution but who'd rather do as little work as
3936possible to get there---a legitimate demand. The command knows of a few
3937repositories from which it can ``import'' package meta-data. The result
3938is a package definition, or a template thereof, in the format we know
3939(@pxref{Defining Packages}).
3940
3941The general syntax is:
3942
3943@example
3944guix import @var{importer} @var{options}@dots{}
3945@end example
3946
3947@var{importer} specifies the source from which to import package
3948meta-data, and @var{options} specifies a package identifier and other
3949options specific to @var{importer}. Currently, the available
3950``importers'' are:
3951
3952@table @code
3953@item gnu
3954Import meta-data for the given GNU package. This provides a template
3955for the latest version of that GNU package, including the hash of its
3956source tarball, and its canonical synopsis and description.
3957
3958Additional information such as the package's dependencies and its
3959license needs to be figured out manually.
3960
3961For example, the following command returns a package definition for
3962GNU@tie{}Hello:
3963
3964@example
3965guix import gnu hello
3966@end example
3967
3968Specific command-line options are:
3969
3970@table @code
3971@item --key-download=@var{policy}
3972As for @code{guix refresh}, specify the policy to handle missing OpenPGP
3973keys when verifying the package's signature. @xref{Invoking guix
3974refresh, @code{--key-download}}.
3975@end table
3976
3977@item pypi
3978@cindex pypi
3979Import meta-data from the @uref{https://pypi.python.org/, Python Package
3980Index}@footnote{This functionality requires Guile-JSON to be installed.
3981@xref{Requirements}.}. Information is taken from the JSON-formatted
3982description available at @code{pypi.python.org} and usually includes all
3983the relevant information, including package dependencies.
3984
3985The command below imports meta-data for the @code{itsdangerous} Python
3986package:
3987
3988@example
3989guix import pypi itsdangerous
3990@end example
3991
3aae8145
DT
3992@item gem
3993@cindex gem
3994Import meta-data from @uref{https://rubygems.org/,
3995RubyGems}@footnote{This functionality requires Guile-JSON to be
3996installed. @xref{Requirements}.}. Information is taken from the
3997JSON-formatted description available at @code{rubygems.org} and includes
3998most relevant information, including runtime dependencies. There are
3999some caveats, however. The meta-data doesn't distinguish between
4000synopses and descriptions, so the same string is used for both fields.
4001Additionally, the details of non-Ruby dependencies required to build
4002native extensions is unavailable and left as an exercise to the
4003packager.
4004
4005The command below imports meta-data for the @code{rails} Ruby package:
4006
4007@example
4008guix import gem rails
4009@end example
4010
d45dc6da
EB
4011@item cpan
4012@cindex CPAN
4013Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}.
4014Information is taken from the JSON-formatted meta-data provided through
4015@uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
66392e47
EB
4016relevant information, such as module dependencies. License information
4017should be checked closely. If Perl is available in the store, then the
4018@code{corelist} utility will be used to filter core modules out of the
4019list of dependencies.
d45dc6da
EB
4020
4021The command command below imports meta-data for the @code{Acme::Boolean}
4022Perl module:
4023
4024@example
4025guix import cpan Acme::Boolean
4026@end example
4027
e1248602
RW
4028@item cran
4029@cindex CRAN
4030Import meta-data from @uref{http://cran.r-project.org/, CRAN}, the
4031central repository for the @uref{http://r-project.org, GNU@tie{}R
4032statistical and graphical environment}.
4033
4034Information is extracted from the HTML package description.
4035
4036The command command below imports meta-data for the @code{Cairo}
4037R package:
4038
4039@example
4040guix import cran Cairo
4041@end example
4042
2f7d2d91
LC
4043@item nix
4044Import meta-data from a local copy of the source of the
4045@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
4046relies on the @command{nix-instantiate} command of
4047@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
4048typically written in a mixture of Nix-language and Bash code. This
4049command only imports the high-level package structure that is written in
4050the Nix language. It normally includes all the basic fields of a
4051package definition.
4052
4053When importing a GNU package, the synopsis and descriptions are replaced
4054by their canonical upstream variant.
4055
4056As an example, the command below imports the package definition of
4057LibreOffice (more precisely, it imports the definition of the package
4058bound to the @code{libreoffice} top-level attribute):
4059
4060@example
4061guix import nix ~/path/to/nixpkgs libreoffice
4062@end example
863af4e1
FB
4063
4064@item hackage
4065@cindex hackage
4066Import meta-data from Haskell community's central package archive
4067@uref{https://hackage.haskell.org/, Hackage}. Information is taken from
4068Cabal files and includes all the relevant information, including package
4069dependencies.
4070
4071Specific command-line options are:
4072
4073@table @code
a4154748
FB
4074@item --stdin
4075@itemx -s
4076Read a Cabal file from the standard input.
863af4e1
FB
4077@item --no-test-dependencies
4078@itemx -t
a4154748
FB
4079Do not include dependencies required by the test suites only.
4080@item --cabal-environment=@var{alist}
4081@itemx -e @var{alist}
4082@var{alist} is a Scheme alist defining the environment in which the
4083Cabal conditionals are evaluated. The accepted keys are: @code{os},
4084@code{arch}, @code{impl} and a string representing the name of a flag.
4085The value associated with a flag has to be either the symbol
4086@code{true} or @code{false}. The value associated with other keys
4087has to conform to the Cabal file format definition. The default value
4088associated with the keys @code{os}, @code{arch} and @code{impl} is
4089@samp{linux}, @samp{x86_64} and @samp{ghc} respectively.
863af4e1
FB
4090@end table
4091
4092The command below imports meta-data for the latest version of the
a4154748
FB
4093@code{HTTP} Haskell package without including test dependencies and
4094specifying the value of the flag @samp{network-uri} as @code{false}:
863af4e1
FB
4095
4096@example
a4154748 4097guix import hackage -t -e "'((\"network-uri\" . false))" HTTP
863af4e1
FB
4098@end example
4099
4100A specific package version may optionally be specified by following the
4101package name by a hyphen and a version number as in the following example:
4102
4103@example
4104guix import hackage mtl-2.1.3.1
4105@end example
7f74a931
FB
4106
4107@item elpa
4108@cindex elpa
4109Import meta-data from an Emacs Lisp Package Archive (ELPA) package
4110repository (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
4111
4112Specific command-line options are:
4113
4114@table @code
4115@item --archive=@var{repo}
4116@itemx -a @var{repo}
4117@var{repo} identifies the archive repository from which to retrieve the
4118information. Currently the supported repositories and their identifiers
4119are:
4120@itemize -
4121@item
840bd1d3 4122@uref{http://elpa.gnu.org/packages, GNU}, selected by the @code{gnu}
7f74a931
FB
4123identifier. This is the default.
4124
4125@item
840bd1d3 4126@uref{http://stable.melpa.org/packages, MELPA-Stable}, selected by the
7f74a931
FB
4127@code{melpa-stable} identifier.
4128
4129@item
840bd1d3 4130@uref{http://melpa.org/packages, MELPA}, selected by the @code{melpa}
7f74a931
FB
4131identifier.
4132@end itemize
4133@end table
2f7d2d91
LC
4134@end table
4135
4136The structure of the @command{guix import} code is modular. It would be
4137useful to have more importers for other package formats, and your help
4138is welcome here (@pxref{Contributing}).
4139
37166310
LC
4140@node Invoking guix refresh
4141@section Invoking @command{guix refresh}
4142
4143The primary audience of the @command{guix refresh} command is developers
4144of the GNU software distribution. By default, it reports any packages
4145provided by the distribution that are outdated compared to the latest
4146upstream version, like this:
4147
4148@example
4149$ guix refresh
4150gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
4151gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
4152@end example
4153
4154It does so by browsing each package's FTP directory and determining the
4155highest version number of the source tarballs
4156therein@footnote{Currently, this only works for GNU packages.}.
4157
4158When passed @code{--update}, it modifies distribution source files to
4159update the version numbers and source tarball hashes of those packages'
4160recipes (@pxref{Defining Packages}). This is achieved by downloading
4161each package's latest source tarball and its associated OpenPGP
4162signature, authenticating the downloaded tarball against its signature
4163using @command{gpg}, and finally computing its hash. When the public
4164key used to sign the tarball is missing from the user's keyring, an
4165attempt is made to automatically retrieve it from a public key server;
4166when it's successful, the key is added to the user's keyring; otherwise,
4167@command{guix refresh} reports an error.
4168
4169The following options are supported:
4170
4171@table @code
4172
4173@item --update
4174@itemx -u
38e16b49
LC
4175Update distribution source files (package recipes) in place. This is
4176usually run from a checkout of the Guix source tree (@pxref{Running
4177Guix Before It Is Installed}):
4178
4179@example
4180$ ./pre-inst-env guix refresh -s non-core
4181@end example
4182
081145cf 4183@xref{Defining Packages}, for more information on package definitions.
37166310
LC
4184
4185@item --select=[@var{subset}]
4186@itemx -s @var{subset}
4187Select all the packages in @var{subset}, one of @code{core} or
4188@code{non-core}.
4189
4190The @code{core} subset refers to all the packages at the core of the
4191distribution---i.e., packages that are used to build ``everything
4192else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
4193changing one of these packages in the distribution entails a rebuild of
4194all the others. Thus, such updates are an inconvenience to users in
4195terms of build time or bandwidth used to achieve the upgrade.
4196
4197The @code{non-core} subset refers to the remaining packages. It is
4198typically useful in cases where an update of the core packages would be
4199inconvenient.
4200
4201@end table
4202
4203In addition, @command{guix refresh} can be passed one or more package
4204names, as in this example:
4205
4206@example
38e16b49 4207$ ./pre-inst-env guix refresh -u emacs idutils gcc-4.8.4
37166310
LC
4208@end example
4209
4210@noindent
4211The command above specifically updates the @code{emacs} and
4212@code{idutils} packages. The @code{--select} option would have no
4213effect in this case.
4214
7d193ec3
EB
4215When considering whether to upgrade a package, it is sometimes
4216convenient to know which packages would be affected by the upgrade and
4217should be checked for compatibility. For this the following option may
4218be used when passing @command{guix refresh} one or more package names:
4219
4220@table @code
4221
4222@item --list-dependent
4223@itemx -l
4224List top-level dependent packages that would need to be rebuilt as a
4225result of upgrading one or more packages.
4226
4227@end table
4228
4229Be aware that the @code{--list-dependent} option only
4230@emph{approximates} the rebuilds that would be required as a result of
4231an upgrade. More rebuilds might be required under some circumstances.
4232
4233@example
7779ab61
LC
4234$ guix refresh --list-dependent flex
4235Building the following 120 packages would ensure 213 dependent packages are rebuilt:
4236hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
4237@end example
4238
4239The command above lists a set of packages that could be built to check
4240for compatibility with an upgraded @code{flex} package.
4241
f9230085
LC
4242The following options can be used to customize GnuPG operation:
4243
4244@table @code
4245
f9230085
LC
4246@item --gpg=@var{command}
4247Use @var{command} as the GnuPG 2.x command. @var{command} is searched
4248for in @code{$PATH}.
4249
2bc53ba9
LC
4250@item --key-download=@var{policy}
4251Handle missing OpenPGP keys according to @var{policy}, which may be one
4252of:
4253
4254@table @code
4255@item always
4256Always download missing OpenPGP keys from the key server, and add them
4257to the user's GnuPG keyring.
4258
4259@item never
4260Never try to download missing OpenPGP keys. Instead just bail out.
4261
4262@item interactive
4263When a package signed with an unknown OpenPGP key is encountered, ask
4264the user whether to download it or not. This is the default behavior.
4265@end table
4266
4267@item --key-server=@var{host}
4268Use @var{host} as the OpenPGP key server when importing a public key.
4269
f9230085
LC
4270@end table
4271
b4f5e0e8
CR
4272@node Invoking guix lint
4273@section Invoking @command{guix lint}
4274The @command{guix lint} is meant to help package developers avoid common
873c4085
LC
4275errors and use a consistent style. It runs a number of checks on a
4276given set of packages in order to find common mistakes in their
4277definitions. Available @dfn{checkers} include (see
4278@code{--list-checkers} for a complete list):
4279
4280@table @code
4281@item synopsis
4282@itemx description
4283Validate certain typographical and stylistic rules about package
4284descriptions and synopses.
4285
4286@item inputs-should-be-native
4287Identify inputs that should most likely be native inputs.
4288
4289@item source
4290@itemx home-page
50f5c46d 4291@itemx source-file-name
873c4085 4292Probe @code{home-page} and @code{source} URLs and report those that are
50f5c46d
EB
4293invalid. Check that the source file name is meaningful, e.g. is not
4294just a version number or ``git-checkout'', and should not have a
4295@code{file-name} declared (@pxref{origin Reference}).
40a7d4e5
LC
4296
4297@item formatting
4298Warn about obvious source code formatting issues: trailing white space,
4299use of tabulations, etc.
873c4085 4300@end table
b4f5e0e8
CR
4301
4302The general syntax is:
4303
4304@example
4305guix lint @var{options} @var{package}@dots{}
4306@end example
4307
4308If no package is given on the command line, then all packages are checked.
4309The @var{options} may be zero or more of the following:
4310
4311@table @code
4312
dd7c013d
CR
4313@item --checkers
4314@itemx -c
4315Only enable the checkers specified in a comma-separated list using the
4316names returned by @code{--list-checkers}.
4317
b4f5e0e8
CR
4318@item --list-checkers
4319@itemx -l
4320List and describe all the available checkers that will be run on packages
4321and exit.
4322
4323@end table
37166310 4324
fcc58db6
LC
4325@node Invoking guix size
4326@section Invoking @command{guix size}
4327
4328The @command{guix size} command helps package developers profile the
4329disk usage of packages. It is easy to overlook the impact of an
4330additional dependency added to a package, or the impact of using a
4331single output for a package that could easily be split (@pxref{Packages
4332with Multiple Outputs}). These are the typical issues that
4333@command{guix size} can highlight.
4334
4335The command can be passed a package specification such as @code{gcc-4.8}
4336or @code{guile:debug}, or a file name in the store. Consider this
4337example:
4338
4339@example
4340$ guix size coreutils
4341store item total self
4342/gnu/store/@dots{}-coreutils-8.23 70.0 13.9 19.8%
4343/gnu/store/@dots{}-gmp-6.0.0a 55.3 2.5 3.6%
4344/gnu/store/@dots{}-acl-2.2.52 53.7 0.5 0.7%
4345/gnu/store/@dots{}-attr-2.4.46 53.2 0.3 0.5%
4346/gnu/store/@dots{}-gcc-4.8.4-lib 52.9 15.7 22.4%
4347/gnu/store/@dots{}-glibc-2.21 37.2 37.2 53.1%
4348@end example
4349
4350@cindex closure
4351The store items listed here constitute the @dfn{transitive closure} of
4352Coreutils---i.e., Coreutils and all its dependencies, recursively---as
4353would be returned by:
4354
4355@example
4356$ guix gc -R /gnu/store/@dots{}-coreutils-8.23
4357@end example
4358
4359Here the output shows 3 columns next to store items. The first column,
4360labeled ``total'', shows the size in mebibytes (MiB) of the closure of
4361the store item---that is, its own size plus the size of all its
4362dependencies. The next column, labeled ``self'', shows the size of the
4363item itself. The last column shows the ratio of the item's size to the
4364space occupied by all the items listed here.
4365
4366In this example, we see that the closure of Coreutils weighs in at
436770@tie{}MiB, half of which is taken by libc. (That libc represents a
4368large fraction of the closure is not a problem @i{per se} because it is
4369always available on the system anyway.)
4370
4371When the package passed to @command{guix size} is available in the
4372store, @command{guix size} queries the daemon to determine its
4373dependencies, and measures its size in the store, similar to @command{du
4374-ms --apparent-size} (@pxref{du invocation,,, coreutils, GNU
4375Coreutils}).
4376
4377When the given package is @emph{not} in the store, @command{guix size}
4378reports information based on information about the available substitutes
4379(@pxref{Substitutes}). This allows it to profile disk usage of store
4380items that are not even on disk, only available remotely.
4381
a8f996c6 4382The available options are:
fcc58db6
LC
4383
4384@table @option
4385
d490d06e
LC
4386@item --substitute-urls=@var{urls}
4387Use substitute information from @var{urls}.
4388@xref{client-substitute-urls, the same option for @code{guix build}}.
4389
a8f996c6
LC
4390@item --map-file=@var{file}
4391Write to @var{file} a graphical map of disk usage as a PNG file.
4392
4393For the example above, the map looks like this:
4394
4395@image{images/coreutils-size-map,5in,, map of Coreutils disk usage
4396produced by @command{guix size}}
4397
4398This option requires that
4399@uref{http://wingolog.org/software/guile-charting/, Guile-Charting} be
4400installed and visible in Guile's module search path. When that is not
4401the case, @command{guix size} fails as it tries to load it.
4402
fcc58db6
LC
4403@item --system=@var{system}
4404@itemx -s @var{system}
4405Consider packages for @var{system}---e.g., @code{x86_64-linux}.
4406
4407@end table
4408
88856916
LC
4409@node Invoking guix graph
4410@section Invoking @command{guix graph}
4411
4412@cindex DAG
4413Packages and their dependencies form a @dfn{graph}, specifically a
4414directed acyclic graph (DAG). It can quickly become difficult to have a
4415mental model of the package DAG, so the @command{guix graph} command is
4416here to provide a visual representation of the DAG. @command{guix
4417graph} emits a DAG representation in the input format of
4418@uref{http://www.graphviz.org/, Graphviz}, so its output can be passed
4419directly to Graphviz's @command{dot} command, for instance. The general
4420syntax is:
4421
4422@example
4423guix graph @var{options} @var{package}@dots{}
4424@end example
4425
4426For example, the following command generates a PDF file representing the
4427package DAG for the GNU@tie{}Core Utilities, showing its build-time
4428dependencies:
4429
4430@example
4431guix graph coreutils | dot -Tpdf > dag.pdf
4432@end example
4433
4434The output looks like this:
4435
4436@image{images/coreutils-graph,2in,,Dependency graph of the GNU Coreutils}
4437
4438Nice little graph, no?
4439
4440But there's more than one graph! The one above is concise: it's the
4441graph of package objects, omitting implicit inputs such as GCC, libc,
4442grep, etc. It's often useful to have such a concise graph, but
4443sometimes you want to see more details. @command{guix graph} supports
4444several types of graphs, allowing you to choose the level of details:
4445
4446@table @code
4447@item package
4448This is the default type, the one we used above. It shows the DAG of
4449package objects, excluding implicit dependencies. It is concise, but
4450filters out many details.
4451
4452@item bag-emerged
4453This is the package DAG, @emph{including} implicit inputs.
4454
4455For instance, the following command:
4456
4457@example
4458guix graph --type=bag-emerged coreutils | dot -Tpdf > dag.pdf
4459@end example
4460
4461... yields this bigger graph:
4462
4463@image{images/coreutils-bag-graph,,5in,Detailed dependency graph of the GNU Coreutils}
4464
4465At the bottom of the graph, we see all the implicit inputs of
4466@var{gnu-build-system} (@pxref{Build Systems, @code{gnu-build-system}}).
4467
4468Now, note that the dependencies of those implicit inputs---that is, the
4469@dfn{bootstrap dependencies} (@pxref{Bootstrapping})---are not shown
4470here, for conciseness.
4471
4472@item bag
4473Similar to @code{bag-emerged}, but this time including all the bootstrap
4474dependencies.
4475
4476@item derivations
4477This is the most detailed representation: It shows the DAG of
4478derivations (@pxref{Derivations}) and plain store items. Compared to
4479the above representation, many additional nodes are visible, including
4480builds scripts, patches, Guile modules, etc.
4481
4482@end table
4483
4484All the above types correspond to @emph{build-time dependencies}. The
4485following graph type represents the @emph{run-time dependencies}:
4486
4487@table @code
4488@item references
4489This is the graph of @dfn{references} of a package output, as returned
4490by @command{guix gc --references} (@pxref{Invoking guix gc}).
4491
4492If the given package output is not available in the store, @command{guix
4493graph} attempts to obtain dependency information from substitutes.
4494@end table
4495
4496The available options are the following:
4497
4498@table @option
4499@item --type=@var{type}
4500@itemx -t @var{type}
4501Produce a graph output of @var{type}, where @var{type} must be one of
4502the values listed above.
4503
4504@item --list-types
4505List the supported graph types.
4c8f997a
LC
4506
4507@item --expression=@var{expr}
4508@itemx -e @var{expr}
4509Consider the package @var{expr} evaluates to.
4510
4511This is useful to precisely refer to a package, as in this example:
4512
4513@example
4514guix graph -e '(@@@@ (gnu packages commencement) gnu-make-final)'
4515@end example
88856916
LC
4516@end table
4517
4518
372c4bbc
DT
4519@node Invoking guix environment
4520@section Invoking @command{guix environment}
4521
f5fd4fd2 4522@cindex reproducible build environments
fe36d84e 4523@cindex development environments
372c4bbc
DT
4524The purpose of @command{guix environment} is to assist hackers in
4525creating reproducible development environments without polluting their
4526package profile. The @command{guix environment} tool takes one or more
4527packages, builds all of the necessary inputs, and creates a shell
4528environment to use them.
4529
4530The general syntax is:
4531
4532@example
4533guix environment @var{options} @var{package}@dots{}
4534@end example
4535
fe36d84e
LC
4536The following example spawns a new shell set up for the development of
4537GNU@tie{}Guile:
372c4bbc
DT
4538
4539@example
4540guix environment guile
4541@end example
4542
4543If the specified packages are not built yet, @command{guix environment}
4544automatically builds them. The new shell's environment is an augmented
4545version of the environment that @command{guix environment} was run in.
4546It contains the necessary search paths for building the given package
4547added to the existing environment variables. To create a ``pure''
4548environment in which the original environment variables have been unset,
50500f7c
LC
4549use the @code{--pure} option@footnote{Users sometimes wrongfully augment
4550environment variables such as @code{PATH} in their @file{~/.bashrc}
4551file. As a consequence, when @code{guix environment} launches it, Bash
4552may read @file{~/.bashrc}, thereby introducing ``impurities'' in these
4553environment variables. It is an error to define such environment
4554variables in @file{.bashrc}; instead, they should be defined in
4555@file{.bash_profile}, which is sourced only by log-in shells.
4556@xref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}, for
4557details on Bash start-up files.}.
372c4bbc 4558
28de8d25
LC
4559@vindex GUIX_ENVIRONMENT
4560@command{guix environment} defines the @code{GUIX_ENVIRONMENT}
4561variable in the shell it spaws. This allows users to, say, define a
4562specific prompt for development environments in their @file{.bashrc}
4563(@pxref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}):
4564
4565@example
4566if [ -n "$GUIX_ENVIRONMENT" ]
4567then
4568 export PS1="\u@@\h \w [dev]\$ "
4569fi
4570@end example
4571
372c4bbc
DT
4572Additionally, more than one package may be specified, in which case the
4573union of the inputs for the given packages are used. For example, the
4574command below spawns a shell where all of the dependencies of both Guile
4575and Emacs are available:
4576
4577@example
4578guix environment guile emacs
4579@end example
4580
1de2fe95
DT
4581Sometimes an interactive shell session is not desired. An arbitrary
4582command may be invoked by placing the @code{--} token to separate the
4583command from the rest of the arguments:
372c4bbc
DT
4584
4585@example
1de2fe95 4586guix environment guile -- make -j4
372c4bbc
DT
4587@end example
4588
fe36d84e
LC
4589In other situations, it is more convenient to specify the list of
4590packages needed in the environment. For example, the following command
4591runs @command{python} from an environment containing Python@tie{}2.7 and
4592NumPy:
4593
4594@example
1de2fe95 4595guix environment --ad-hoc python2-numpy python-2.7 -- python
fe36d84e
LC
4596@end example
4597
4598The available options are summarized below.
372c4bbc
DT
4599
4600@table @code
4601@item --expression=@var{expr}
4602@itemx -e @var{expr}
4603Create an environment for the package that @var{expr} evaluates to.
4604
fe36d84e
LC
4605For example, running:
4606
4607@example
4608guix environment -e '(@@ (gnu packages maths) petsc-openmpi)'
4609@end example
4610
4611starts a shell with the environment for this specific variant of the
4612PETSc package.
4613
372c4bbc
DT
4614@item --load=@var{file}
4615@itemx -l @var{file}
4616Create an environment for the package that the code within @var{file}
4617evaluates to.
4618
fe36d84e
LC
4619As an example, @var{file} might contain a definition like this
4620(@pxref{Defining Packages}):
4621
4622@example
4623@verbatiminclude environment-gdb.scm
4624@end example
4625
a54bd6d7
DT
4626@item --ad-hoc
4627Include all specified packages in the resulting environment, as if an
4628@i{ad hoc} package were defined with them as inputs. This option is
4629useful for quickly creating an environment without having to write a
4630package expression to contain the desired inputs.
4631
4632For instance, the command:
4633
4634@example
1de2fe95 4635guix environment --ad-hoc guile guile-sdl -- guile
a54bd6d7
DT
4636@end example
4637
4638runs @command{guile} in an environment where Guile and Guile-SDL are
4639available.
4640
417c39f1
LC
4641Note that this example implicitly asks for the default output of
4642@code{guile} and @code{guile-sdl} but it is possible to ask for a
4643specific output---e.g., @code{glib:bin} asks for the @code{bin} output
4644of @code{glib} (@pxref{Packages with Multiple Outputs}).
4645
372c4bbc
DT
4646@item --pure
4647Unset existing environment variables when building the new environment.
4648This has the effect of creating an environment in which search paths
4649only contain package inputs.
4650
4651@item --search-paths
4652Display the environment variable definitions that make up the
4653environment.
ce367ef3
LC
4654
4655@item --system=@var{system}
4656@itemx -s @var{system}
4657Attempt to build for @var{system}---e.g., @code{i686-linux}.
372c4bbc
DT
4658@end table
4659
4660It also supports all of the common build options that @command{guix
4661build} supports (@pxref{Invoking guix build, common build options}).
4662
aff8ce7c
DT
4663@node Invoking guix publish
4664@section Invoking @command{guix publish}
4665
4666The purpose of @command{guix publish} is to enable users to easily share
8ce229fc
LC
4667their store with others, which can then use it as a substitute server
4668(@pxref{Substitutes}).
4669
4670When @command{guix publish} runs, it spawns an HTTP server which allows
4671anyone with network access to obtain substitutes from it. This means
4672that any machine running Guix can also act as if it were a build farm,
4673since the HTTP interface is compatible with Hydra, the software behind
4674the @code{hydra.gnu.org} build farm.
aff8ce7c
DT
4675
4676For security, each substitute is signed, allowing recipients to check
4677their authenticity and integrity (@pxref{Substitutes}). Because
4678@command{guix publish} uses the system's signing key, which is only
5463fe51
LC
4679readable by the system administrator, it must be started as root; the
4680@code{--user} option makes it drop root privileges early on.
aff8ce7c
DT
4681
4682The general syntax is:
4683
4684@example
4685guix publish @var{options}@dots{}
4686@end example
4687
4688Running @command{guix publish} without any additional arguments will
4689spawn an HTTP server on port 8080:
4690
4691@example
4692guix publish
4693@end example
4694
4695Once a publishing server has been authorized (@pxref{Invoking guix
4696archive}), the daemon may download substitutes from it:
4697
4698@example
4699guix-daemon --substitute-urls=http://example.org:8080
4700@end example
4701
4702The following options are available:
4703
4704@table @code
4705@item --port=@var{port}
4706@itemx -p @var{port}
4707Listen for HTTP requests on @var{port}.
4708
9e2292ef
LC
4709@item --listen=@var{host}
4710Listen on the network interface for @var{host}. The default is to
4711accept connections from any interface.
4712
5463fe51
LC
4713@item --user=@var{user}
4714@itemx -u @var{user}
4715Change privileges to @var{user} as soon as possible---i.e., once the
4716server socket is open and the signing key has been read.
4717
aff8ce7c
DT
4718@item --repl[=@var{port}]
4719@itemx -r [@var{port}]
4720Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
8ce229fc
LC
4721Reference Manual}) on @var{port} (37146 by default). This is used
4722primarily for debugging a running @command{guix publish} server.
aff8ce7c
DT
4723@end table
4724
a1ba8475
LC
4725@c *********************************************************************
4726@node GNU Distribution
4727@chapter GNU Distribution
4728
3ca2731c 4729@cindex Guix System Distribution
4705641f 4730@cindex GuixSD
3ca2731c
LC
4731Guix comes with a distribution of the GNU system consisting entirely of
4732free software@footnote{The term ``free'' here refers to the
a1ba8475 4733@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
3ca2731c 4734users of that software}.}. The
35ed9306
LC
4735distribution can be installed on its own (@pxref{System Installation}),
4736but it is also possible to install Guix as a package manager on top of
4737an installed GNU/Linux system (@pxref{Installation}). To distinguish
3ca2731c 4738between the two, we refer to the standalone distribution as the Guix
4705641f 4739System Distribution, or GuixSD.
35ed9306
LC
4740
4741The distribution provides core GNU packages such as GNU libc, GCC, and
4742Binutils, as well as many GNU and non-GNU applications. The complete
4743list of available packages can be browsed
093ae1be 4744@url{http://www.gnu.org/software/guix/packages,on-line} or by
d03bb653 4745running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
4746
4747@example
e49951eb 4748guix package --list-available
a1ba8475
LC
4749@end example
4750
35ed9306 4751Our goal has been to provide a practical 100% free software distribution of
401c53c4
LC
4752Linux-based and other variants of GNU, with a focus on the promotion and
4753tight integration of GNU components, and an emphasis on programs and
4754tools that help users exert that freedom.
4755
3ca2731c 4756Packages are currently available on the following platforms:
c320011d
LC
4757
4758@table @code
4759
4760@item x86_64-linux
4761Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
4762
4763@item i686-linux
4764Intel 32-bit architecture (IA32), Linux-Libre kernel;
4765
aa1e1947 4766@item armhf-linux
aa725117 4767ARMv7-A architecture with hard float, Thumb-2 and NEON,
aa1e1947
MW
4768using the EABI hard-float ABI, and Linux-Libre kernel.
4769
c320011d
LC
4770@item mips64el-linux
4771little-endian 64-bit MIPS processors, specifically the Loongson series,
4772n32 application binary interface (ABI), and Linux-Libre kernel.
4773
4774@end table
4775
4705641f 4776GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
3ca2731c 4777
c320011d
LC
4778@noindent
4779For information on porting to other architectures or kernels,
4780@xref{Porting}.
4781
401c53c4 4782@menu
5af6de3e 4783* System Installation:: Installing the whole operating system.
35ed9306 4784* System Configuration:: Configuring the operating system.
91ef73d4 4785* Installing Debugging Files:: Feeding the debugger.
05962f29 4786* Security Updates:: Deploying security fixes quickly.
401c53c4 4787* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 4788* Packaging Guidelines:: Growing the distribution.
401c53c4 4789* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 4790* Porting:: Targeting another platform or kernel.
401c53c4
LC
4791@end menu
4792
4793Building this distribution is a cooperative effort, and you are invited
081145cf 4794to join! @xref{Contributing}, for information about how you can help.
401c53c4 4795
5af6de3e
LC
4796@node System Installation
4797@section System Installation
4798
3ca2731c
LC
4799@cindex Guix System Distribution
4800This section explains how to install the Guix System Distribution
4801on a machine. The Guix package manager can
35ed9306
LC
4802also be installed on top of a running GNU/Linux system,
4803@pxref{Installation}.
5af6de3e
LC
4804
4805@ifinfo
4806@c This paragraph is for people reading this from tty2 of the
4807@c installation image.
4808You're reading this documentation with an Info reader. For details on
4809how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 4810link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
4811@kbd{l} afterwards to come back here.
4812@end ifinfo
4813
8aaaae38
LC
4814@subsection Limitations
4815
4705641f 4816As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
3ca2731c 4817not production-ready. It may contain bugs and lack important
8aaaae38
LC
4818features. Thus, if you are looking for a stable production system that
4819respects your freedom as a computer user, a good solution at this point
4820is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
4821more established GNU/Linux distributions}. We hope you can soon switch
4705641f 4822to the GuixSD without fear, of course. In the meantime, you can
8aaaae38
LC
4823also keep using your distribution and try out the package manager on top
4824of it (@pxref{Installation}).
4825
4826Before you proceed with the installation, be aware of the following
4827noteworthy limitations applicable to version @value{VERSION}:
4828
4829@itemize
4830@item
4831The installation process does not include a graphical user interface and
4832requires familiarity with GNU/Linux (see the following subsections to
4833get a feel of what that means.)
4834
4835@item
093ae1be
LC
4836The system does not yet provide full GNOME and KDE desktops. Xfce and
4837Enlightenment are available though, if graphical desktop environments
4838are your thing, as well as a number of X11 window managers.
8aaaae38
LC
4839
4840@item
dbcb0ab1 4841Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
4842
4843@item
4844Few system services are currently supported out-of-the-box
4845(@pxref{Services}).
4846
4847@item
093ae1be 4848More than 2,000 packages are available, but you may
8aaaae38
LC
4849occasionally find that a useful package is missing.
4850@end itemize
4851
4852You've been warned. But more than a disclaimer, this is an invitation
4853to report issues (and success stories!), and join us in improving it.
4854@xref{Contributing}, for more info.
5af6de3e
LC
4855
4856@subsection USB Stick Installation
4857
4858An installation image for USB sticks can be downloaded from
4705641f 4859@indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
5af6de3e
LC
4860where @var{system} is one of:
4861
4862@table @code
4863@item x86_64-linux
4864for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
4865
4866@item i686-linux
4867for a 32-bit GNU/Linux system on Intel-compatible CPUs.
4868@end table
4869
4870This image contains a single partition with the tools necessary for an
4871installation. It is meant to be copied @emph{as is} to a large-enough
4872USB stick.
4873
4874To copy the image to a USB stick, follow these steps:
4875
4876@enumerate
4877@item
4878Decompress the image using the @command{xz} command:
4879
4880@example
4705641f 4881xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
5af6de3e
LC
4882@end example
4883
4884@item
4885Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
4886its device name. Assuming that USB stick is known as @file{/dev/sdX},
4887copy the image with:
4888
4889@example
4705641f 4890dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
4891@end example
4892
4893Access to @file{/dev/sdX} usually requires root privileges.
4894@end enumerate
4895
4896Once this is done, you should be able to reboot the system and boot from
4897the USB stick. The latter usually requires you to get in the BIOS' boot
4898menu, where you can choose to boot from the USB stick.
4899
4900@subsection Preparing for Installation
4901
4902Once you have successfully booted the image on the USB stick, you should
4903end up with a root prompt. Several console TTYs are configured and can
4904be used to run commands as root. TTY2 shows this documentation,
4905browsable using the Info reader commands (@pxref{Help,,, info, Info: An
4906Introduction}).
4907
4908To install the system, you would:
4909
4910@enumerate
4911
4912@item
152dd61c
LC
4913Configure the network, by running @command{ifconfig eno1 up && dhclient
4914eno1} (to get an automatically assigned IP address from the wired
4915network interface controller@footnote{
95c559c1
LC
4916@c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
4917The name @code{eno1} is for the first on-board Ethernet controller. The
4918interface name for an Ethernet controller that is in the first slot of
4919the first PCI bus, for instance, would be @code{enp1s0}. Use
4920@command{ifconfig -a} to list all the available network interfaces.}),
4921or using the @command{ifconfig} command.
5af6de3e
LC
4922
4923The system automatically loads drivers for your network interface
4924controllers.
4925
4926Setting up network access is almost always a requirement because the
4927image does not contain all the software and tools that may be needed.
4928
4929@item
4930Unless this has already been done, you must partition and format the
4931target partitions.
4932
7ab44369
LC
4933Preferably, assign partitions a label so that you can easily and
4934reliably refer to them in @code{file-system} declarations (@pxref{File
4935Systems}). This is typically done using the @code{-L} option of
4936@command{mkfs.ext4} and related commands.
4937
5af6de3e 4938The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
4939Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
4940encryption, and e2fsprogs, the suite of tools to manipulate
4941ext2/ext3/ext4 file systems.
5af6de3e 4942
83a17b62
LC
4943@item
4944Once that is done, mount the target root partition under @file{/mnt}.
4945
4946@item
4947Lastly, run @code{deco start cow-store /mnt}.
4948
4949This will make @file{/gnu/store} copy-on-write, such that packages added
4950to it during the installation phase will be written to the target disk
4951rather than kept in memory.
4952
5af6de3e
LC
4953@end enumerate
4954
5af6de3e
LC
4955
4956@subsection Proceeding with the Installation
4957
4958With the target partitions ready, you now have to edit a file and
4959provide the declaration of the operating system to be installed. To
4960that end, the installation system comes with two text editors: GNU nano
4961(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
4962It is better to store that file on the target root file system, say, as
4963@file{/mnt/etc/config.scm}.
4964
dd51caac
LC
4965@xref{Using the Configuration System}, for examples of operating system
4966configurations. These examples are available under
4967@file{/etc/configuration} in the installation image, so you can copy
4968them and use them as a starting point for your own configuration.
5af6de3e 4969
dd51caac
LC
4970Once you are done preparing the configuration file, the new system must
4971be initialized (remember that the target root file system is mounted
4972under @file{/mnt}):
5af6de3e
LC
4973
4974@example
4975guix system init /mnt/etc/config.scm /mnt
4976@end example
4977
4978@noindent
4979This will copy all the necessary files, and install GRUB on
4980@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 4981more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
4982downloads or builds of missing packages, which can take some time.
4983
1bd4e6db
LC
4984Once that command has completed---and hopefully succeeded!---you can run
4985@command{reboot} and boot into the new system. The @code{root} password
4986in the new system is initially empty; other users' passwords need to be
4987initialized by running the @command{passwd} command as @code{root},
4988unless your configuration specifies otherwise
4989(@pxref{user-account-password, user account passwords}).
4990
4991Join us on @code{#guix} on the Freenode IRC network or on
5af6de3e
LC
4992@file{guix-devel@@gnu.org} to share your experience---good or not so
4993good.
4994
4995@subsection Building the Installation Image
4996
4997The installation image described above was built using the @command{guix
4998system} command, specifically:
4999
5000@example
8a225c66 5001guix system disk-image --image-size=850MiB gnu/system/install.scm
5af6de3e
LC
5002@end example
5003
5004@xref{Invoking guix system}, for more information. See
5005@file{gnu/system/install.scm} in the source tree for more information
5006about the installation image.
5007
cf4a9129
LC
5008@node System Configuration
5009@section System Configuration
b208a005 5010
cf4a9129 5011@cindex system configuration
3ca2731c 5012The Guix System Distribution supports a consistent whole-system configuration
cf4a9129
LC
5013mechanism. By that we mean that all aspects of the global system
5014configuration---such as the available system services, timezone and
5015locale settings, user accounts---are declared in a single place. Such
5016a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 5017
cf4a9129
LC
5018One of the advantages of putting all the system configuration under the
5019control of Guix is that it supports transactional system upgrades, and
5020makes it possible to roll-back to a previous system instantiation,
5021should something go wrong with the new one (@pxref{Features}). Another
5022one is that it makes it easy to replicate the exact same configuration
5023across different machines, or at different points in time, without
5024having to resort to additional administration tools layered on top of
5025the system's own tools.
5026@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 5027
cf4a9129
LC
5028This section describes this mechanism. First we focus on the system
5029administrator's viewpoint---explaining how the system is configured and
5030instantiated. Then we show how this mechanism can be extended, for
5031instance to support new system services.
91ef73d4 5032
cf4a9129
LC
5033@menu
5034* Using the Configuration System:: Customizing your GNU system.
7313a52e 5035* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 5036* File Systems:: Configuring file system mounts.
510f9d86 5037* Mapped Devices:: Block device extra processing.
cf4a9129 5038* User Accounts:: Specifying user accounts.
598e19dc 5039* Locales:: Language and cultural convention settings.
cf4a9129 5040* Services:: Specifying system services.
0ae8c15a 5041* Setuid Programs:: Programs running with root privileges.
efb5e833 5042* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 5043* Name Service Switch:: Configuring libc's name service switch.
fd1b1fa2 5044* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 5045* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
5046* Invoking guix system:: Instantiating a system configuration.
5047* Defining Services:: Adding new service definitions.
5048@end menu
91ef73d4 5049
cf4a9129
LC
5050@node Using the Configuration System
5051@subsection Using the Configuration System
64d76fa6 5052
cf4a9129
LC
5053The operating system is configured by providing an
5054@code{operating-system} declaration in a file that can then be passed to
5055the @command{guix system} command (@pxref{Invoking guix system}). A
5056simple setup, with the default system services, the default Linux-Libre
5057kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 5058
cf4a9129
LC
5059@findex operating-system
5060@lisp
dd51caac 5061@include os-config-bare-bones.texi
cf4a9129 5062@end lisp
401c53c4 5063
cf4a9129
LC
5064This example should be self-describing. Some of the fields defined
5065above, such as @code{host-name} and @code{bootloader}, are mandatory.
5066Others, such as @code{packages} and @code{services}, can be omitted, in
5067which case they get a default value.
e7f34eb0 5068
cf4a9129
LC
5069@vindex %base-packages
5070The @code{packages} field lists
5071packages that will be globally visible on the system, for all user
5072accounts---i.e., in every user's @code{PATH} environment variable---in
5073addition to the per-user profiles (@pxref{Invoking guix package}). The
5074@var{%base-packages} variable provides all the tools one would expect
5075for basic user and administrator tasks---including the GNU Core
5076Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
5077editor, @command{find}, @command{grep}, etc. The example above adds
5078Emacs to those, taken from the @code{(gnu packages emacs)} module
5079(@pxref{Package Modules}).
e7f34eb0 5080
cf4a9129
LC
5081@vindex %base-services
5082The @code{services} field lists @dfn{system services} to be made
5083available when the system starts (@pxref{Services}).
5084The @code{operating-system} declaration above specifies that, in
5085addition to the basic services, we want the @command{lshd} secure shell
5086daemon listening on port 2222, and allowing remote @code{root} logins
5087(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
5088@code{lsh-service} arranges so that @code{lshd} is started with the
5089right command-line options, possibly with supporting configuration files
7313a52e
LC
5090generated as needed (@pxref{Defining Services}). @xref{operating-system
5091Reference}, for details about the available @code{operating-system}
5092fields.
a1ba8475 5093
dd51caac
LC
5094The configuration for a typical ``desktop'' usage, with the X11 display
5095server, a desktop environment, network management, an SSH server, and
5096more, would look like this:
5097
5098@lisp
5099@include os-config-desktop.texi
5100@end lisp
5101
5102@xref{Desktop Services}, for the exact list of services provided by
efb5e833
LC
5103@var{%desktop-services}. @xref{X.509 Certificates}, for background
5104information about the @code{nss-certs} package that is used here.
dd51caac 5105
cf4a9129
LC
5106Assuming the above snippet is stored in the @file{my-system-config.scm}
5107file, the @command{guix system reconfigure my-system-config.scm} command
5108instantiates that configuration, and makes it the default GRUB boot
5109entry (@pxref{Invoking guix system}). The normal way to change the
5110system's configuration is by updating this file and re-running the
5111@command{guix system} command.
b81e1947 5112
cf4a9129
LC
5113At the Scheme level, the bulk of an @code{operating-system} declaration
5114is instantiated with the following monadic procedure (@pxref{The Store
5115Monad}):
b81e1947 5116
cf4a9129
LC
5117@deffn {Monadic Procedure} operating-system-derivation os
5118Return a derivation that builds @var{os}, an @code{operating-system}
5119object (@pxref{Derivations}).
b81e1947 5120
cf4a9129
LC
5121The output of the derivation is a single directory that refers to all
5122the packages, configuration files, and other supporting files needed to
5123instantiate @var{os}.
5124@end deffn
b81e1947 5125
7313a52e
LC
5126@node operating-system Reference
5127@subsection @code{operating-system} Reference
5128
5129This section summarizes all the options available in
5130@code{operating-system} declarations (@pxref{Using the Configuration
5131System}).
5132
5133@deftp {Data Type} operating-system
5134This is the data type representing an operating system configuration.
5135By that, we mean all the global system configuration, not per-user
5136configuration (@pxref{Using the Configuration System}).
5137
5138@table @asis
5139@item @code{kernel} (default: @var{linux-libre})
fbb25e56 5140The package object of the operating system kernel to use@footnote{Currently
7313a52e
LC
5141only the Linux-libre kernel is supported. In the future, it will be
5142possible to use the GNU@tie{}Hurd.}.
5143
ee2a6304
LC
5144@item @code{kernel-arguments} (default: @code{'()})
5145List of strings or gexps representing additional arguments to pass on
5146the kernel's command-line---e.g., @code{("console=ttyS0")}.
5147
7313a52e 5148@item @code{bootloader}
88faf933 5149The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
5150
5151@item @code{initrd} (default: @code{base-initrd})
5152A two-argument monadic procedure that returns an initial RAM disk for
5153the Linux kernel. @xref{Initial RAM Disk}.
5154
f34c56be
LC
5155@item @code{firmware} (default: @var{%base-firmware})
5156@cindex firmware
5157List of firmware packages loadable by the operating system kernel.
5158
5159The default includes firmware needed for Atheros-based WiFi devices
5160(Linux-libre module @code{ath9k}.)
5161
7313a52e
LC
5162@item @code{host-name}
5163The host name.
5164
5165@item @code{hosts-file}
5166@cindex hosts file
24e02c28 5167A file-like object (@pxref{G-Expressions, file-like objects}) for use as
7313a52e 5168@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
24e02c28 5169Reference Manual}). The default is a file with entries for
7313a52e
LC
5170@code{localhost} and @var{host-name}.
5171
5172@item @code{mapped-devices} (default: @code{'()})
5173A list of mapped devices. @xref{Mapped Devices}.
5174
5175@item @code{file-systems}
5176A list of file systems. @xref{File Systems}.
5177
5178@item @code{swap-devices} (default: @code{'()})
5179@cindex swap devices
5180A list of strings identifying devices to be used for ``swap space''
5181(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
5182For example, @code{'("/dev/sda3")}.
5183
bf87f38a 5184@item @code{users} (default: @code{%base-user-accounts})
7313a52e
LC
5185@itemx @code{groups} (default: @var{%base-groups})
5186List of user accounts and groups. @xref{User Accounts}.
5187
5188@item @code{skeletons} (default: @code{(default-skeletons)})
5189A monadic list of pairs of target file name and files. These are the
5190files that will be used as skeletons as new accounts are created.
5191
5192For instance, a valid value may look like this:
5193
5194@example
5195(mlet %store-monad ((bashrc (text-file "bashrc" "\
5196 export PATH=$HOME/.guix-profile/bin")))
5197 (return `((".bashrc" ,bashrc))))
5198@end example
5199
5200@item @code{issue} (default: @var{%default-issue})
5201A string denoting the contents of the @file{/etc/issue} file, which is
5202what displayed when users log in on a text console.
5203
5204@item @code{packages} (default: @var{%base-packages})
5205The set of packages installed in the global profile, which is accessible
5206at @file{/run/current-system/profile}.
5207
5208The default set includes core utilities, but it is good practice to
5209install non-core utilities in user profiles (@pxref{Invoking guix
5210package}).
5211
5212@item @code{timezone}
5213A timezone identifying string---e.g., @code{"Europe/Paris"}.
5214
598e19dc
LC
5215@item @code{locale} (default: @code{"en_US.utf8"})
5216The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
5217Library Reference Manual}). @xref{Locales}, for more information.
5218
5219@item @code{locale-definitions} (default: @var{%default-locale-definitions})
5220The list of locale definitions to be compiled and that may be used at
5221run time. @xref{Locales}.
7313a52e 5222
996ed739
LC
5223@item @code{name-service-switch} (default: @var{%default-nss})
5224Configuration of libc's name service switch (NSS)---a
5225@code{<name-service-switch>} object. @xref{Name Service Switch}, for
5226details.
5227
7313a52e
LC
5228@item @code{services} (default: @var{%base-services})
5229A list of monadic values denoting system services. @xref{Services}.
5230
5231@item @code{pam-services} (default: @code{(base-pam-services)})
5232@cindex PAM
5233@cindex pluggable authentication modules
5234Linux @dfn{pluggable authentication module} (PAM) services.
5235@c FIXME: Add xref to PAM services section.
5236
5237@item @code{setuid-programs} (default: @var{%setuid-programs})
5238List of string-valued G-expressions denoting setuid programs.
5239@xref{Setuid Programs}.
5240
f5a9ffa0
AK
5241@item @code{sudoers-file} (default: @var{%sudoers-specification})
5242@cindex sudoers file
84765839
LC
5243The contents of the @file{/etc/sudoers} file as a file-like object
5244(@pxref{G-Expressions, @code{local-file} and @code{plain-file}}).
7313a52e
LC
5245
5246This file specifies which users can use the @command{sudo} command, what
5247they are allowed to do, and what privileges they may gain. The default
5248is that only @code{root} and members of the @code{wheel} group may use
5249@code{sudo}.
5250
5251@end table
5252@end deftp
5253
cf4a9129
LC
5254@node File Systems
5255@subsection File Systems
b81e1947 5256
cf4a9129
LC
5257The list of file systems to be mounted is specified in the
5258@code{file-systems} field of the operating system's declaration
5259(@pxref{Using the Configuration System}). Each file system is declared
5260using the @code{file-system} form, like this:
b81e1947
LC
5261
5262@example
cf4a9129
LC
5263(file-system
5264 (mount-point "/home")
5265 (device "/dev/sda3")
5266 (type "ext4"))
b81e1947
LC
5267@end example
5268
cf4a9129
LC
5269As usual, some of the fields are mandatory---those shown in the example
5270above---while others can be omitted. These are described below.
b81e1947 5271
cf4a9129
LC
5272@deftp {Data Type} file-system
5273Objects of this type represent file systems to be mounted. They
5274contain the following members:
5ff3c4b8 5275
cf4a9129
LC
5276@table @asis
5277@item @code{type}
5278This is a string specifying the type of the file system---e.g.,
5279@code{"ext4"}.
5ff3c4b8 5280
cf4a9129
LC
5281@item @code{mount-point}
5282This designates the place where the file system is to be mounted.
b81e1947 5283
cf4a9129
LC
5284@item @code{device}
5285This names the ``source'' of the file system. By default it is the name
5286of a node under @file{/dev}, but its meaning depends on the @code{title}
5287field described below.
401c53c4 5288
cf4a9129
LC
5289@item @code{title} (default: @code{'device})
5290This is a symbol that specifies how the @code{device} field is to be
5291interpreted.
401c53c4 5292
cf4a9129
LC
5293When it is the symbol @code{device}, then the @code{device} field is
5294interpreted as a file name; when it is @code{label}, then @code{device}
5295is interpreted as a partition label name; when it is @code{uuid},
5296@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 5297
661a1d79
LC
5298UUIDs may be converted from their string representation (as shown by the
5299@command{tune2fs -l} command) using the @code{uuid} form, like this:
5300
5301@example
5302(file-system
5303 (mount-point "/home")
5304 (type "ext4")
5305 (title 'uuid)
5306 (device (uuid "4dab5feb-d176-45de-b287-9b0a6e4c01cb")))
5307@end example
5308
cf4a9129 5309The @code{label} and @code{uuid} options offer a way to refer to disk
661a1d79
LC
5310partitions without having to hard-code their actual device
5311name@footnote{Note that, while it is tempting to use
5312@file{/dev/disk/by-uuid} and similar device names to achieve the same
5313result, this is not recommended: These special device nodes are created
5314by the udev daemon and may be unavailable at the time the device is
5315mounted.}.
da7cabd4 5316
5f86a66e
LC
5317However, when a file system's source is a mapped device (@pxref{Mapped
5318Devices}), its @code{device} field @emph{must} refer to the mapped
5319device name---e.g., @file{/dev/mapper/root-partition}---and consequently
5320@code{title} must be set to @code{'device}. This is required so that
5321the system knows that mounting the file system depends on having the
5322corresponding device mapping established.
5323
cf4a9129
LC
5324@item @code{flags} (default: @code{'()})
5325This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
5326include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
5327access to special files), @code{no-suid} (ignore setuid and setgid
5328bits), and @code{no-exec} (disallow program execution.)
da7cabd4 5329
cf4a9129
LC
5330@item @code{options} (default: @code{#f})
5331This is either @code{#f}, or a string denoting mount options.
da7cabd4 5332
cf4a9129
LC
5333@item @code{needed-for-boot?} (default: @code{#f})
5334This Boolean value indicates whether the file system is needed when
5335booting. If that is true, then the file system is mounted when the
5336initial RAM disk (initrd) is loaded. This is always the case, for
5337instance, for the root file system.
da7cabd4 5338
cf4a9129
LC
5339@item @code{check?} (default: @code{#t})
5340This Boolean indicates whether the file system needs to be checked for
5341errors before being mounted.
f9cc8971 5342
4e469051
LC
5343@item @code{create-mount-point?} (default: @code{#f})
5344When true, the mount point is created if it does not exist yet.
5345
e51710d1
LC
5346@item @code{dependencies} (default: @code{'()})
5347This is a list of @code{<file-system>} objects representing file systems
5348that must be mounted before (and unmounted after) this one.
5349
5350As an example, consider a hierarchy of mounts: @file{/sys/fs/cgroup} is
5351a dependency of @file{/sys/fs/cgroup/cpu} and
5352@file{/sys/fs/cgroup/memory}.
5353
cf4a9129
LC
5354@end table
5355@end deftp
da7cabd4 5356
a69576ea
LC
5357The @code{(gnu system file-systems)} exports the following useful
5358variables.
5359
5360@defvr {Scheme Variable} %base-file-systems
5361These are essential file systems that are required on normal systems,
cc0e575a 5362such as @var{%pseudo-terminal-file-system} and @var{%immutable-store} (see
3392ce5d
LC
5363below.) Operating system declarations should always contain at least
5364these.
a69576ea
LC
5365@end defvr
5366
7f239fd3
LC
5367@defvr {Scheme Variable} %pseudo-terminal-file-system
5368This is the file system to be mounted as @file{/dev/pts}. It supports
5369@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
5370functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
5371Manual}). Pseudo-terminals are used by terminal emulators such as
5372@command{xterm}.
5373@end defvr
5374
db17ae5c
LC
5375@defvr {Scheme Variable} %shared-memory-file-system
5376This file system is mounted as @file{/dev/shm} and is used to support
5377memory sharing across processes (@pxref{Memory-mapped I/O,
5378@code{shm_open},, libc, The GNU C Library Reference Manual}).
5379@end defvr
5380
3392ce5d
LC
5381@defvr {Scheme Variable} %immutable-store
5382This file system performs a read-only ``bind mount'' of
5383@file{/gnu/store}, making it read-only for all the users including
5384@code{root}. This prevents against accidental modification by software
5385running as @code{root} or by system administrators.
5386
5387The daemon itself is still able to write to the store: it remounts it
5388read-write in its own ``name space.''
5389@end defvr
5390
a69576ea
LC
5391@defvr {Scheme Variable} %binary-format-file-system
5392The @code{binfmt_misc} file system, which allows handling of arbitrary
5393executable file types to be delegated to user space. This requires the
5394@code{binfmt.ko} kernel module to be loaded.
5395@end defvr
5396
5397@defvr {Scheme Variable} %fuse-control-file-system
5398The @code{fusectl} file system, which allows unprivileged users to mount
5399and unmount user-space FUSE file systems. This requires the
5400@code{fuse.ko} kernel module to be loaded.
5401@end defvr
5402
510f9d86
LC
5403@node Mapped Devices
5404@subsection Mapped Devices
5405
5406@cindex device mapping
5407@cindex mapped devices
5408The Linux kernel has a notion of @dfn{device mapping}: a block device,
5409such as a hard disk partition, can be @dfn{mapped} into another device,
5410with additional processing over the data that flows through
5411it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
5412concept of a ``mapped device'' and that of a file system: both boil down
5413to @emph{translating} input/output operations made on a file to
5414operations on its backing store. Thus, the Hurd implements mapped
5415devices, like file systems, using the generic @dfn{translator} mechanism
5416(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
5417typical example is encryption device mapping: all writes to the mapped
5418device are encrypted, and all reads are deciphered, transparently.
5419
5420Mapped devices are declared using the @code{mapped-device} form:
5421
5422@example
5423(mapped-device
5424 (source "/dev/sda3")
5425 (target "home")
5426 (type luks-device-mapping))
5427@end example
5428
5429@noindent
5430@cindex disk encryption
5431@cindex LUKS
5432This example specifies a mapping from @file{/dev/sda3} to
5433@file{/dev/mapper/home} using LUKS---the
5434@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
5435standard mechanism for disk encryption. The @file{/dev/mapper/home}
5436device can then be used as the @code{device} of a @code{file-system}
5437declaration (@pxref{File Systems}). The @code{mapped-device} form is
5438detailed below.
5439
5440@deftp {Data Type} mapped-device
5441Objects of this type represent device mappings that will be made when
5442the system boots up.
5443
9cb426b8
LC
5444@table @code
5445@item source
510f9d86
LC
5446This string specifies the name of the block device to be mapped, such as
5447@code{"/dev/sda3"}.
5448
9cb426b8 5449@item target
510f9d86
LC
5450This string specifies the name of the mapping to be established. For
5451example, specifying @code{"my-partition"} will lead to the creation of
5452the @code{"/dev/mapper/my-partition"} device.
5453
9cb426b8 5454@item type
510f9d86
LC
5455This must be a @code{mapped-device-kind} object, which specifies how
5456@var{source} is mapped to @var{target}.
5457@end table
5458@end deftp
5459
5460@defvr {Scheme Variable} luks-device-mapping
5461This defines LUKS block device encryption using the @command{cryptsetup}
5462command, from the same-named package. This relies on the
5463@code{dm-crypt} Linux kernel module.
5464@end defvr
5465
cf4a9129
LC
5466@node User Accounts
5467@subsection User Accounts
ee85f3db 5468
9bea87a5
LC
5469User accounts and groups are entirely managed through the
5470@code{operating-system} declaration. They are specified with the
5471@code{user-account} and @code{user-group} forms:
ee85f3db 5472
cf4a9129
LC
5473@example
5474(user-account
5475 (name "alice")
5476 (group "users")
24e752c0
LC
5477 (supplementary-groups '("wheel" ;allow use of sudo, etc.
5478 "audio" ;sound card
5479 "video" ;video devices such as webcams
5480 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
5481 (comment "Bob's sister")
5482 (home-directory "/home/alice"))
5483@end example
25083588 5484
9bea87a5
LC
5485When booting or upon completion of @command{guix system reconfigure},
5486the system ensures that only the user accounts and groups specified in
5487the @code{operating-system} declaration exist, and with the specified
5488properties. Thus, account or group creations or modifications made by
5489directly invoking commands such as @command{useradd} are lost upon
5490reconfiguration or reboot. This ensures that the system remains exactly
5491as declared.
5492
cf4a9129
LC
5493@deftp {Data Type} user-account
5494Objects of this type represent user accounts. The following members may
5495be specified:
ee85f3db 5496
cf4a9129
LC
5497@table @asis
5498@item @code{name}
5499The name of the user account.
ee85f3db 5500
cf4a9129
LC
5501@item @code{group}
5502This is the name (a string) or identifier (a number) of the user group
5503this account belongs to.
ee85f3db 5504
cf4a9129
LC
5505@item @code{supplementary-groups} (default: @code{'()})
5506Optionally, this can be defined as a list of group names that this
5507account belongs to.
ee85f3db 5508
cf4a9129
LC
5509@item @code{uid} (default: @code{#f})
5510This is the user ID for this account (a number), or @code{#f}. In the
5511latter case, a number is automatically chosen by the system when the
5512account is created.
ee85f3db 5513
cf4a9129
LC
5514@item @code{comment} (default: @code{""})
5515A comment about the account, such as the account's owner full name.
c8c871d1 5516
cf4a9129
LC
5517@item @code{home-directory}
5518This is the name of the home directory for the account.
ee85f3db 5519
cf4a9129
LC
5520@item @code{shell} (default: Bash)
5521This is a G-expression denoting the file name of a program to be used as
5522the shell (@pxref{G-Expressions}).
ee85f3db 5523
cf4a9129
LC
5524@item @code{system?} (default: @code{#f})
5525This Boolean value indicates whether the account is a ``system''
5526account. System accounts are sometimes treated specially; for instance,
5527graphical login managers do not list them.
ee85f3db 5528
1bd4e6db 5529@anchor{user-account-password}
cf4a9129 5530@item @code{password} (default: @code{#f})
eb59595c
LC
5531You would normally leave this field to @code{#f}, initialize user
5532passwords as @code{root} with the @command{passwd} command, and then let
9bea87a5
LC
5533users change it with @command{passwd}. Passwords set with
5534@command{passwd} are of course preserved across reboot and
5535reconfiguration.
eb59595c
LC
5536
5537If you @emph{do} want to have a preset password for an account, then
5538this field must contain the encrypted password, as a string.
5d1f1177
LC
5539@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
5540on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 5541Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 5542
cf4a9129
LC
5543@end table
5544@end deftp
ee85f3db 5545
cf4a9129 5546User group declarations are even simpler:
ee85f3db 5547
cf4a9129
LC
5548@example
5549(user-group (name "students"))
5550@end example
ee85f3db 5551
cf4a9129
LC
5552@deftp {Data Type} user-group
5553This type is for, well, user groups. There are just a few fields:
af8a56b8 5554
cf4a9129
LC
5555@table @asis
5556@item @code{name}
5557The group's name.
ee85f3db 5558
cf4a9129
LC
5559@item @code{id} (default: @code{#f})
5560The group identifier (a number). If @code{#f}, a new number is
5561automatically allocated when the group is created.
ee85f3db 5562
c8fa3426
LC
5563@item @code{system?} (default: @code{#f})
5564This Boolean value indicates whether the group is a ``system'' group.
5565System groups have low numerical IDs.
5566
cf4a9129
LC
5567@item @code{password} (default: @code{#f})
5568What, user groups can have a password? Well, apparently yes. Unless
5569@code{#f}, this field specifies the group's password.
ee85f3db 5570
cf4a9129
LC
5571@end table
5572@end deftp
401c53c4 5573
cf4a9129
LC
5574For convenience, a variable lists all the basic user groups one may
5575expect:
401c53c4 5576
cf4a9129
LC
5577@defvr {Scheme Variable} %base-groups
5578This is the list of basic user groups that users and/or packages expect
5579to be present on the system. This includes groups such as ``root'',
5580``wheel'', and ``users'', as well as groups used to control access to
5581specific devices such as ``audio'', ``disk'', and ``cdrom''.
5582@end defvr
401c53c4 5583
bf87f38a
LC
5584@defvr {Scheme Variable} %base-user-accounts
5585This is the list of basic system accounts that programs may expect to
5586find on a GNU/Linux system, such as the ``nobody'' account.
5587
5588Note that the ``root'' account is not included here. It is a
5589special-case and is automatically added whether or not it is specified.
5590@end defvr
5591
598e19dc
LC
5592@node Locales
5593@subsection Locales
5594
5595@cindex locale
5596A @dfn{locale} defines cultural conventions for a particular language
5597and region of the world (@pxref{Locales,,, libc, The GNU C Library
5598Reference Manual}). Each locale has a name that typically has the form
b2636518 5599@code{@var{language}_@var{territory}.@var{codeset}}---e.g.,
598e19dc
LC
5600@code{fr_LU.utf8} designates the locale for the French language, with
5601cultural conventions from Luxembourg, and using the UTF-8 encoding.
5602
5603@cindex locale definition
5604Usually, you will want to specify the default locale for the machine
5605using the @code{locale} field of the @code{operating-system} declaration
5606(@pxref{operating-system Reference, @code{locale}}).
5607
5608That locale must be among the @dfn{locale definitions} that are known to
5609the system---and these are specified in the @code{locale-definitions}
5610slot of @code{operating-system}. The default value includes locale
5611definition for some widely used locales, but not for all the available
5612locales, in order to save space.
5613
5614If the locale specified in the @code{locale} field is not among the
5615definitions listed in @code{locale-definitions}, @command{guix system}
5616raises an error. In that case, you should add the locale definition to
5617the @code{locale-definitions} field. For instance, to add the North
5618Frisian locale for Germany, the value of that field may be:
5619
5620@example
5621(cons (locale-definition
5622 (name "fy_DE.utf8") (source "fy_DE"))
5623 %default-locale-definitions)
5624@end example
5625
5626Likewise, to save space, one might want @code{locale-definitions} to
5627list only the locales that are actually used, as in:
5628
5629@example
5630(list (locale-definition
5631 (name "ja_JP.eucjp") (source "ja_JP")
5632 (charset "EUC-JP")))
5633@end example
5634
5c3c1427
LC
5635@vindex LOCPATH
5636The compiled locale definitions are available at
5637@file{/run/current-system/locale}, which is the default location where
5638the GNU@tie{}libc looks for locale data. This can be overridden using
5639the @code{LOCPATH} environment variable (@pxref{locales-and-locpath,
5640@code{LOCPATH} and locale packages}).
5641
598e19dc
LC
5642The @code{locale-definition} form is provided by the @code{(gnu system
5643locale)} module. Details are given below.
5644
5645@deftp {Data Type} locale-definition
5646This is the data type of a locale definition.
5647
5648@table @asis
5649
5650@item @code{name}
5651The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
5652Reference Manual}, for more information on locale names.
5653
5654@item @code{source}
5655The name of the source for that locale. This is typically the
5656@code{@var{language}_@var{territory}} part of the locale name.
5657
5658@item @code{charset} (default: @code{"UTF-8"})
5659The ``character set'' or ``code set'' for that locale,
5660@uref{http://www.iana.org/assignments/character-sets, as defined by
5661IANA}.
5662
5663@end table
5664@end deftp
5665
5666@defvr {Scheme Variable} %default-locale-definitions
b2636518
LC
5667An arbitrary list of commonly used UTF-8 locales, used as the default
5668value of the @code{locale-definitions} field of @code{operating-system}
598e19dc 5669declarations.
b2636518
LC
5670
5671@cindex locale name
5672@cindex normalized codeset in locale names
5673These locale definitions use the @dfn{normalized codeset} for the part
5674that follows the dot in the name (@pxref{Using gettextized software,
5675normalized codeset,, libc, The GNU C Library Reference Manual}). So for
5676instance it has @code{uk_UA.utf8} but @emph{not}, say,
5677@code{uk_UA.UTF-8}.
598e19dc 5678@end defvr
401c53c4 5679
cf4a9129
LC
5680@node Services
5681@subsection Services
401c53c4 5682
cf4a9129
LC
5683@cindex system services
5684An important part of preparing an @code{operating-system} declaration is
5685listing @dfn{system services} and their configuration (@pxref{Using the
5686Configuration System}). System services are typically daemons launched
5687when the system boots, or other actions needed at that time---e.g.,
d8b94dbd
LC
5688configuring network access.
5689
5690Services are managed by GNU@tie{}dmd (@pxref{Introduction,,, dmd, GNU
5691dmd Manual}). On a running system, the @command{deco} command allows
5692you to list the available services, show their status, start and stop
5693them, or do other specific operations (@pxref{Jump Start,,, dmd, GNU dmd
5694Manual}). For example:
5695
5696@example
5697# deco status dmd
5698@end example
5699
5700The above command, run as @code{root}, lists the currently defined
5701services. The @command{deco doc} command shows a synopsis of the given
5702service:
5703
5704@example
5705# deco doc nscd
5706Run libc's name service cache daemon (nscd).
5707@end example
5708
5709The @command{start}, @command{stop}, and @command{restart} sub-commands
5710have the effect you would expect. For instance, the commands below stop
5711the nscd service and restart the Xorg display server:
5712
5713@example
5714# deco stop nscd
5715Service nscd has been stopped.
5716# deco restart xorg-server
5717Service xorg-server has been stopped.
5718Service xorg-server has been started.
5719@end example
401c53c4 5720
cf4a9129 5721The following sections document the available services, starting with
d8b94dbd
LC
5722the core services, that may be used in an @code{operating-system}
5723declaration.
401c53c4 5724
cf4a9129
LC
5725@menu
5726* Base Services:: Essential system services.
5727* Networking Services:: Network setup, SSH daemon, etc.
5728* X Window:: Graphical display.
fe1a39d3 5729* Desktop Services:: D-Bus and desktop services.
105369a4 5730* Database Services:: SQL databases.
58724c48 5731* Web Services:: Web servers.
aa4ed923 5732* Various Services:: Other services.
cf4a9129 5733@end menu
401c53c4 5734
cf4a9129
LC
5735@node Base Services
5736@subsubsection Base Services
a1ba8475 5737
cf4a9129
LC
5738The @code{(gnu services base)} module provides definitions for the basic
5739services that one expects from the system. The services exported by
5740this module are listed below.
401c53c4 5741
cf4a9129
LC
5742@defvr {Scheme Variable} %base-services
5743This variable contains a list of basic services@footnote{Technically,
5744this is a list of monadic services. @xref{The Store Monad}.} one would
5745expect from the system: a login service (mingetty) on each tty, syslogd,
5746libc's name service cache daemon (nscd), the udev device manager, and
5747more.
401c53c4 5748
cf4a9129
LC
5749This is the default value of the @code{services} field of
5750@code{operating-system} declarations. Usually, when customizing a
5751system, you will want to append services to @var{%base-services}, like
5752this:
401c53c4 5753
cf4a9129 5754@example
fa1e31b8 5755(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
5756@end example
5757@end defvr
401c53c4 5758
be1c2c54 5759@deffn {Scheme Procedure} host-name-service @var{name}
cf4a9129
LC
5760Return a service that sets the host name to @var{name}.
5761@end deffn
401c53c4 5762
66e4f01c
LC
5763@deffn {Scheme Procedure} mingetty-service @var{config}
5764Return a service to run mingetty according to @var{config}, a
5765@code{<mingetty-configuration>} object, which specifies the tty to run, among
5766other things.
cf4a9129 5767@end deffn
401c53c4 5768
66e4f01c
LC
5769@deftp {Data Type} mingetty-configuration
5770This is the data type representing the configuration of Mingetty, which
5771implements console log-in.
5772
5773@table @asis
5774
5775@item @code{tty}
5776The name of the console this Mingetty runs on---e.g., @code{"tty1"}.
5777
5778@item @code{motd}
5779A file-like object containing the ``message of the day''.
5780
5781@item @code{auto-login} (default: @code{#f})
5782When true, this field must be a string denoting the user name under
5783which the the system automatically logs in. When it is @code{#f}, a
5784user name and password must be entered to log in.
5785
5786@item @code{login-program} (default: @code{#f})
5787This must be either @code{#f}, in which case the default log-in program
5788is used (@command{login} from the Shadow tool suite), or a gexp denoting
5789the name of the log-in program.
5790
5791@item @code{login-pause?} (default: @code{#f})
5792When set to @code{#t} in conjunction with @var{auto-login}, the user
5793will have to press a key before the log-in shell is launched.
5794
5795@item @code{mingetty} (default: @var{mingetty})
5796The Mingetty package to use.
5797
5798@end table
5799@end deftp
5800
6454b333
LC
5801@cindex name service cache daemon
5802@cindex nscd
be1c2c54 5803@deffn {Scheme Procedure} nscd-service [@var{config}] [#:glibc glibc] @
4aee6e60 5804 [#:name-services '()]
b893f1ae
LC
5805Return a service that runs libc's name service cache daemon (nscd) with the
5806given @var{config}---an @code{<nscd-configuration>} object. @xref{Name
5807Service Switch}, for an example.
cf4a9129 5808@end deffn
401c53c4 5809
6454b333
LC
5810@defvr {Scheme Variable} %nscd-default-configuration
5811This is the default @code{<nscd-configuration>} value (see below) used
5812by @code{nscd-service}. This uses the caches defined by
5813@var{%nscd-default-caches}; see below.
5814@end defvr
5815
5816@deftp {Data Type} nscd-configuration
5817This is the type representing the name service cache daemon (nscd)
5818configuration.
5819
5820@table @asis
5821
b893f1ae
LC
5822@item @code{name-services} (default: @code{'()})
5823List of packages denoting @dfn{name services} that must be visible to
5824the nscd---e.g., @code{(list @var{nss-mdns})}.
5825
5826@item @code{glibc} (default: @var{glibc})
5827Package object denoting the GNU C Library providing the @command{nscd}
5828command.
5829
6454b333
LC
5830@item @code{log-file} (default: @code{"/var/log/nscd.log"})
5831Name of nscd's log file. This is where debugging output goes when
5832@code{debug-level} is strictly positive.
5833
5834@item @code{debug-level} (default: @code{0})
5835Integer denoting the debugging levels. Higher numbers mean more
5836debugging output is logged.
5837
5838@item @code{caches} (default: @var{%nscd-default-caches})
5839List of @code{<nscd-cache>} objects denoting things to be cached; see
5840below.
5841
5842@end table
5843@end deftp
5844
5845@deftp {Data Type} nscd-cache
5846Data type representing a cache database of nscd and its parameters.
5847
5848@table @asis
5849
5850@item @code{database}
5851This is a symbol representing the name of the database to be cached.
5852Valid values are @code{passwd}, @code{group}, @code{hosts}, and
5853@code{services}, which designate the corresponding NSS database
5854(@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
5855
5856@item @code{positive-time-to-live}
5857@itemx @code{negative-time-to-live} (default: @code{20})
5858A number representing the number of seconds during which a positive or
5859negative lookup result remains in cache.
5860
5861@item @code{check-files?} (default: @code{#t})
5862Whether to check for updates of the files corresponding to
5863@var{database}.
5864
5865For instance, when @var{database} is @code{hosts}, setting this flag
5866instructs nscd to check for updates in @file{/etc/hosts} and to take
5867them into account.
5868
5869@item @code{persistent?} (default: @code{#t})
5870Whether the cache should be stored persistently on disk.
5871
5872@item @code{shared?} (default: @code{#t})
5873Whether the cache should be shared among users.
5874
5875@item @code{max-database-size} (default: 32@tie{}MiB)
5876Maximum size in bytes of the database cache.
5877
5878@c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
5879@c settings, so leave them out.
5880
5881@end table
5882@end deftp
5883
5884@defvr {Scheme Variable} %nscd-default-caches
5885List of @code{<nscd-cache>} objects used by default by
5886@code{nscd-configuration} (see above.)
5887
5888It enables persistent and aggressive caching of service and host name
5889lookups. The latter provides better host name lookup performance,
5890resilience in the face of unreliable name servers, and also better
5891privacy---often the result of host name lookups is in local cache, so
5892external name servers do not even need to be queried.
5893@end defvr
5894
5895
be1c2c54 5896@deffn {Scheme Procedure} syslog-service [#:config-file #f]
1bb76f75
AK
5897Return a service that runs @code{syslogd}. If configuration file name
5898@var{config-file} is not specified, use some reasonable default
cf4a9129
LC
5899settings.
5900@end deffn
401c53c4 5901
be1c2c54 5902@deffn {Scheme Procedure} guix-service [#:guix guix] @
cf4a9129 5903 [#:builder-group "guixbuild"] [#:build-accounts 10] @
02bb6b45 5904 [#:authorize-hydra-key? #t] [#:use-substitutes? #t] @
cf4a9129
LC
5905 [#:extra-options '()]
5906Return a service that runs the build daemon from @var{guix}, and has
5907@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 5908
cf4a9129
LC
5909When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
5910provided by @var{guix} is authorized upon activation, meaning that substitutes
5911from @code{hydra.gnu.org} are used by default.
401c53c4 5912
cf4a9129
LC
5913If @var{use-substitutes?} is false, the daemon is run with
5914@option{--no-substitutes} (@pxref{Invoking guix-daemon,
5915@option{--no-substitutes}}).
401c53c4 5916
cf4a9129
LC
5917Finally, @var{extra-options} is a list of additional command-line options
5918passed to @command{guix-daemon}.
5919@end deffn
a1ba8475 5920
be1c2c54 5921@deffn {Scheme Procedure} udev-service [#:udev udev]
cf4a9129
LC
5922Run @var{udev}, which populates the @file{/dev} directory dynamically.
5923@end deffn
401c53c4 5924
be1c2c54 5925@deffn {Scheme Procedure} console-keymap-service @var{file}
5eca9459
AK
5926Return a service to load console keymap from @var{file} using
5927@command{loadkeys} command.
5928@end deffn
5929
a69576ea 5930
cf4a9129
LC
5931@node Networking Services
5932@subsubsection Networking Services
401c53c4 5933
fa1e31b8 5934The @code{(gnu services networking)} module provides services to configure
cf4a9129 5935the network interface.
a1ba8475 5936
a023cca8 5937@cindex DHCP, networking service
be1c2c54 5938@deffn {Scheme Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
a023cca8
LC
5939Return a service that runs @var{dhcp}, a Dynamic Host Configuration
5940Protocol (DHCP) client, on all the non-loopback network interfaces.
5941@end deffn
5942
be1c2c54 5943@deffn {Scheme Procedure} static-networking-service @var{interface} @var{ip} @
cf4a9129
LC
5944 [#:gateway #f] [#:name-services @code{'()}]
5945Return a service that starts @var{interface} with address @var{ip}. If
5946@var{gateway} is true, it must be a string specifying the default network
5947gateway.
5948@end deffn
8b315a6d 5949
b7d0c494 5950@cindex wicd
be1c2c54 5951@deffn {Scheme Procedure} wicd-service [#:wicd @var{wicd}]
b7d0c494
MW
5952Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a
5953network manager that aims to simplify wired and wireless networking.
5954@end deffn
5955
be1c2c54 5956@deffn {Scheme Procedure} ntp-service [#:ntp @var{ntp}] @
63854bcb
LC
5957 [#:name-service @var{%ntp-servers}]
5958Return a service that runs the daemon from @var{ntp}, the
5959@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
5960keep the system clock synchronized with that of @var{servers}.
5961@end deffn
5962
5963@defvr {Scheme Variable} %ntp-servers
5964List of host names used as the default NTP servers.
5965@end defvr
5966
be1c2c54 5967@deffn {Scheme Procedure} tor-service [#:tor tor]
cf4a9129 5968Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 5969
cf4a9129
LC
5970The daemon runs with the default settings (in particular the default exit
5971policy) as the @code{tor} unprivileged user.
5972@end deffn
8b315a6d 5973
be1c2c54 5974@deffn {Scheme Procedure} bitlbee-service [#:bitlbee bitlbee] @
4627a464
LC
5975 [#:interface "127.0.0.1"] [#:port 6667] @
5976 [#:extra-settings ""]
5977Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
5978acts as a gateway between IRC and chat networks.
5979
5980The daemon will listen to the interface corresponding to the IP address
5981specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
5982local clients can connect, whereas @code{0.0.0.0} means that connections can
5983come from any networking interface.
5984
5985In addition, @var{extra-settings} specifies a string to append to the
5986configuration file.
5987@end deffn
5988
f4391bec 5989Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 5990
be1c2c54 5991@deffn {Scheme Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
5833bf33 5992 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
cf4a9129
LC
5993 [#:allow-empty-passwords? #f] [#:root-login? #f] @
5994 [#:syslog-output? #t] [#:x11-forwarding? #t] @
5995 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
21cc905a 5996 [#:public-key-authentication? #t] [#:initialize? #t]
cf4a9129
LC
5997Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
5998@var{host-key} must designate a file containing the host key, and readable
5999only by root.
72e25e35 6000
5833bf33
DP
6001When @var{daemonic?} is true, @command{lshd} will detach from the
6002controlling terminal and log its output to syslogd, unless one sets
6003@var{syslog-output?} to false. Obviously, it also makes lsh-service
6004depend on existence of syslogd service. When @var{pid-file?} is true,
6005@command{lshd} writes its PID to the file called @var{pid-file}.
6006
cf4a9129
LC
6007When @var{initialize?} is true, automatically create the seed and host key
6008upon service activation if they do not exist yet. This may take long and
6009require interaction.
8b315a6d 6010
20dd519c
LC
6011When @var{initialize?} is false, it is up to the user to initialize the
6012randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
6013a key pair with the private key stored in file @var{host-key} (@pxref{lshd
6014basics,,, lsh, LSH Manual}).
6015
cf4a9129
LC
6016When @var{interfaces} is empty, lshd listens for connections on all the
6017network interfaces; otherwise, @var{interfaces} must be a list of host names
6018or addresses.
9bf3c1a7 6019
20dd519c
LC
6020@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
6021passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 6022root.
4af2447e 6023
cf4a9129
LC
6024The other options should be self-descriptive.
6025@end deffn
4af2447e 6026
fa0c1d61
LC
6027@defvr {Scheme Variable} %facebook-host-aliases
6028This variable contains a string for use in @file{/etc/hosts}
6029(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
6030line contains a entry that maps a known server name of the Facebook
6031on-line service---e.g., @code{www.facebook.com}---to the local
6032host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
6033
6034This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
6035@code{operating-system} declaration (@pxref{operating-system Reference,
6036@file{/etc/hosts}}):
fa0c1d61
LC
6037
6038@example
6039(use-modules (gnu) (guix))
6040
6041(operating-system
6042 (host-name "mymachine")
6043 ;; ...
6044 (hosts-file
6045 ;; Create a /etc/hosts file with aliases for "localhost"
6046 ;; and "mymachine", as well as for Facebook servers.
24e02c28
LC
6047 (plain-file "hosts"
6048 (string-append (local-host-aliases host-name)
6049 %facebook-host-aliases))))
fa0c1d61
LC
6050@end example
6051
6052This mechanism can prevent programs running locally, such as Web
6053browsers, from accessing Facebook.
6054@end defvr
6055
965a7332
LC
6056The @code{(gnu services avahi)} provides the following definition.
6057
be1c2c54 6058@deffn {Scheme Procedure} avahi-service [#:avahi @var{avahi}] @
965a7332
LC
6059 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
6060 [#:ipv6? #t] [#:wide-area? #f] @
6061 [#:domains-to-browse '()]
6062Return a service that runs @command{avahi-daemon}, a system-wide
6063mDNS/DNS-SD responder that allows for service discovery and
6064"zero-configuration" host name lookups (see @uref{http://avahi.org/}).
6065
6066If @var{host-name} is different from @code{#f}, use that as the host name to
6067publish for this machine; otherwise, use the machine's actual host name.
6068
6069When @var{publish?} is true, publishing of host names and services is allowed;
6070in particular, avahi-daemon will publish the machine's host name and IP
6071address via mDNS on the local network.
6072
6073When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
6074
6075Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
6076sockets.
6077@end deffn
6078
6079
cf4a9129
LC
6080@node X Window
6081@subsubsection X Window
68ad877c 6082
cf4a9129
LC
6083Support for the X Window graphical display system---specifically
6084Xorg---is provided by the @code{(gnu services xorg)} module. Note that
6085there is no @code{xorg-service} procedure. Instead, the X server is
6086started by the @dfn{login manager}, currently SLiM.
4af2447e 6087
be1c2c54 6088@deffn {Scheme Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
6089 [#:auto-login? #f] [#:default-user ""] [#:startx] @
6090 [#:theme @var{%default-slim-theme}] @
4bd43bbe 6091 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
6092Return a service that spawns the SLiM graphical login manager, which in
6093turn starts the X display server with @var{startx}, a command as returned by
6094@code{xorg-start-command}.
4af2447e 6095
04e4e6ab
LC
6096@cindex X session
6097
6098SLiM automatically looks for session types described by the @file{.desktop}
6099files in @file{/run/current-system/profile/share/xsessions} and allows users
6100to choose a session from the log-in screen using @kbd{F1}. Packages such as
6101@var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
6102adding them to the system-wide set of packages automatically makes them
6103available at the log-in screen.
6104
6105In addition, @file{~/.xsession} files are honored. When available,
6106@file{~/.xsession} must be an executable that starts a window manager
6107and/or other X clients.
6108
cf4a9129
LC
6109When @var{allow-empty-passwords?} is true, allow logins with an empty
6110password. When @var{auto-login?} is true, log in automatically as
6111@var{default-user}.
0ecc3bf3
LC
6112
6113If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
6114@var{theme} must be a gexp denoting the name of a directory containing the
6115theme to use. In that case, @var{theme-name} specifies the name of the
6116theme.
cf4a9129 6117@end deffn
4af2447e 6118
0ecc3bf3
LC
6119@defvr {Scheme Variable} %default-theme
6120@defvrx {Scheme Variable} %default-theme-name
6121The G-Expression denoting the default SLiM theme and its name.
6122@end defvr
6123
be1c2c54 6124@deffn {Scheme Procedure} xorg-start-command [#:guile] @
d1cdd7ba 6125 [#:configuration-file #f] [#:xorg-server @var{xorg-server}]
f703413e 6126Return a derivation that builds a @var{guile} script to start the X server
d1cdd7ba
LC
6127from @var{xorg-server}. @var{configuration-file} is the server configuration
6128file or a derivation that builds it; when omitted, the result of
6129@code{xorg-configuration-file} is used.
6130
6131Usually the X server is started by a login manager.
6132@end deffn
6133
be1c2c54 6134@deffn {Scheme Procedure} xorg-configuration-file @
12422c9d 6135 [#:drivers '()] [#:resolutions '()] [#:extra-config '()]
d1cdd7ba
LC
6136Return a configuration file for the Xorg server containing search paths for
6137all the common drivers.
f703413e
LC
6138
6139@var{drivers} must be either the empty list, in which case Xorg chooses a
6140graphics driver automatically, or a list of driver names that will be tried in
d1cdd7ba 6141this order---e.g., @code{(\"modesetting\" \"vesa\")}.
d2e59637
LC
6142
6143Likewise, when @var{resolutions} is the empty list, Xorg chooses an
6144appropriate screen resolution; otherwise, it must be a list of
6145resolutions---e.g., @code{((1024 768) (640 480))}.
12422c9d
LC
6146
6147Last, @var{extra-config} is a list of strings or objects appended to the
6148@code{text-file*} argument list. It is used to pass extra text to be added
6149verbatim to the configuration file.
f703413e 6150@end deffn
4af2447e 6151
fe1a39d3
LC
6152@node Desktop Services
6153@subsubsection Desktop Services
aa4ed923 6154
fe1a39d3
LC
6155The @code{(gnu services desktop)} module provides services that are
6156usually useful in the context of a ``desktop'' setup---that is, on a
6157machine running a graphical display server, possibly with graphical user
6158interfaces, etc.
aa4ed923 6159
4467be21
LC
6160To simplify things, the module defines a variable containing the set of
6161services that users typically expect on a machine with a graphical
6162environment and networking:
6163
6164@defvr {Scheme Variable} %desktop-services
6165This is a list of services that builds upon @var{%base-services} and
6166adds or adjust services for a typical ``desktop'' setup.
6167
6168In particular, it adds a graphical login manager (@pxref{X Window,
6169@code{slim-service}}), a network management tool (@pxref{Networking
6170Services, @code{wicd-service}}), energy and color management services,
4650a77e 6171the @code{elogind} login and seat manager, the Polkit privilege service,
cee32ee4
AW
6172the GeoClue location service, an NTP client (@pxref{Networking
6173Services}), the Avahi daemon, and has the name service switch service
6174configured to be able to use @code{nss-mdns} (@pxref{Name Service
6175Switch, mDNS}).
4467be21
LC
6176@end defvr
6177
6178The @var{%desktop-services} variable can be used as the @code{services}
6179field of an @code{operating-system} declaration (@pxref{operating-system
6180Reference, @code{services}}).
6181
6182The actual service definitions provided by @code{(gnu services desktop)}
6183are described below.
6184
be1c2c54 6185@deffn {Scheme Procedure} dbus-service @var{services} @
fe1a39d3
LC
6186 [#:dbus @var{dbus}]
6187Return a service that runs the ``system bus'', using @var{dbus}, with
6188support for @var{services}.
aa4ed923 6189
fe1a39d3
LC
6190@uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
6191facility. Its system bus is used to allow system services to communicate
6192and be notified of system-wide events.
aa4ed923 6193
fe1a39d3
LC
6194@var{services} must be a list of packages that provide an
6195@file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
6196and policy files. For example, to allow avahi-daemon to use the system bus,
6197@var{services} must be equal to @code{(list avahi)}.
aa4ed923
AK
6198@end deffn
6199
be1c2c54 6200@deffn {Scheme Procedure} elogind-service @
4650a77e
AW
6201 [#:elogind @var{elogind}] [#:config @var{config}]
6202Return a service that runs the @code{elogind} login and
6203seat management daemon. @uref{https://github.com/andywingo/elogind,
6204Elogind} exposes a D-Bus interface that can be used to know which users
6205are logged in, know what kind of sessions they have open, suspend the
6206system, inhibit system suspend, reboot the system, and other tasks.
6207
6208Elogind handles most system-level power events for a computer, for
6209example suspending the system when a lid is closed, or shutting it down
6210when the power button is pressed.
6211
6212The @var{config} keyword argument specifies the configuration for
6213elogind, and should be the result of a @code{(elogind-configuration
6214(@var{parameter} @var{value})...)} invocation. Available parameters and
6215their default values are:
6216
6217@table @code
6218@item kill-user-processes?
6219@code{#f}
6220@item kill-only-users
6221@code{()}
6222@item kill-exclude-users
6223@code{("root")}
6224@item inhibit-delay-max-seconds
6225@code{5}
6226@item handle-power-key
6227@code{poweroff}
6228@item handle-suspend-key
6229@code{suspend}
6230@item handle-hibernate-key
6231@code{hibernate}
6232@item handle-lid-switch
6233@code{suspend}
6234@item handle-lid-switch-docked
6235@code{ignore}
6236@item power-key-ignore-inhibited?
6237@code{#f}
6238@item suspend-key-ignore-inhibited?
6239@code{#f}
6240@item hibernate-key-ignore-inhibited?
6241@code{#f}
6242@item lid-switch-ignore-inhibited?
6243@code{#t}
6244@item holdoff-timeout-seconds
6245@code{30}
6246@item idle-action
6247@code{ignore}
6248@item idle-action-seconds
6249@code{(* 30 60)}
6250@item runtime-directory-size-percent
6251@code{10}
6252@item runtime-directory-size
6253@code{#f}
6254@item remove-ipc?
6255@code{#t}
6256@item suspend-state
6257@code{("mem" "standby" "freeze")}
6258@item suspend-mode
6259@code{()}
6260@item hibernate-state
6261@code{("disk")}
6262@item hibernate-mode
6263@code{("platform" "shutdown")}
6264@item hybrid-sleep-state
6265@code{("disk")}
6266@item hybrid-sleep-mode
6267@code{("suspend" "platform" "shutdown")}
6268@end table
6269@end deffn
6270
be1c2c54 6271@deffn {Scheme Procedure} polkit-service @
4650a77e
AW
6272 [#:polkit @var{polkit}]
6273Return a service that runs the Polkit privilege manager.
6274@uref{http://www.freedesktop.org/wiki/Software/polkit/, Polkit} allows
6275system administrators to grant access to privileged operations in a
6276structured way. For example, polkit rules can allow a logged-in user
6277whose session is active to shut down the machine, if there are no other
6278users active.
6279@end deffn
6280
be1c2c54 6281@deffn {Scheme Procedure} upower-service [#:upower @var{upower}] @
be234128
AW
6282 [#:watts-up-pro? #f] @
6283 [#:poll-batteries? #t] @
6284 [#:ignore-lid? #f] @
6285 [#:use-percentage-for-policy? #f] @
6286 [#:percentage-low 10] @
6287 [#:percentage-critical 3] @
6288 [#:percentage-action 2] @
6289 [#:time-low 1200] @
6290 [#:time-critical 300] @
6291 [#:time-action 120] @
6292 [#:critical-power-action 'hybrid-sleep]
6293Return a service that runs @uref{http://upower.freedesktop.org/,
6294@command{upowerd}}, a system-wide monitor for power consumption and battery
6295levels, with the given configuration settings. It implements the
6296@code{org.freedesktop.UPower} D-Bus interface, and is notably used by
6297GNOME.
6298@end deffn
6299
be1c2c54 6300@deffn {Scheme Procedure} colord-service [#:colord @var{colord}]
7ce597ff
AW
6301Return a service that runs @command{colord}, a system service with a D-Bus
6302interface to manage the color profiles of input and output devices such as
6303screens and scanners. It is notably used by the GNOME Color Manager graphical
6304tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
6305site} for more information.
6306@end deffn
6307
cee32ee4
AW
6308@deffn {Scheme Procedure} geoclue-application name [#:allowed? #t] [#:system? #f] [#:users '()]
6309Return an configuration allowing an application to access GeoClue
6310location data. @var{name} is the Desktop ID of the application, without
6311the @code{.desktop} part. If @var{allowed?} is true, the application
6312will have access to location information by default. The boolean
6313@var{system?} value indicates that an application is a system component
6314or not. Finally @var{users} is a list of UIDs of all users for which
6315this application is allowed location info access. An empty users list
6316means that all users are allowed.
6317@end deffn
6318
6319@defvr {Scheme Variable} %standard-geoclue-applications
6320The standard list of well-known GeoClue application configurations,
6321granting authority to GNOME's date-and-time utility to ask for the
6322current location in order to set the time zone, and allowing the Firefox
6323(IceCat) and Epiphany web browsers to request location information.
6324Firefox and Epiphany both query the user before allowing a web page to
6325know the user's location.
6326@end defvr
6327
be1c2c54 6328@deffn {Scheme Procedure} geoclue-service [#:colord @var{colord}] @
cee32ee4
AW
6329 [#:whitelist '()] @
6330 [#:wifi-geolocation-url "https://location.services.mozilla.com/v1/geolocate?key=geoclue"] @
6331 [#:submit-data? #f]
6332 [#:wifi-submission-url "https://location.services.mozilla.com/v1/submit?key=geoclue"] @
6333 [#:submission-nick "geoclue"] @
6334 [#:applications %standard-geoclue-applications]
6335Return a service that runs the GeoClue location service. This service
6336provides a D-Bus interface to allow applications to request access to a
6337user's physical location, and optionally to add information to online
6338location databases. See
6339@uref{https://wiki.freedesktop.org/www/Software/GeoClue/, the GeoClue
6340web site} for more information.
6341@end deffn
6342
105369a4
DT
6343@node Database Services
6344@subsubsection Database Services
6345
6346The @code{(gnu services databases)} module provides the following service.
6347
be1c2c54 6348@deffn {Scheme Procedure} postgresql-service [#:postgresql postgresql] @
105369a4
DT
6349 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
6350Return a service that runs @var{postgresql}, the PostgreSQL database
6351server.
6352
6353The PostgreSQL daemon loads its runtime configuration from
6354@var{config-file} and stores the database cluster in
6355@var{data-directory}.
6356@end deffn
fe1a39d3 6357
58724c48
DT
6358@node Web Services
6359@subsubsection Web Services
6360
6361The @code{(gnu services web)} module provides the following service:
6362
be1c2c54 6363@deffn {Scheme Procedure} nginx-service [#:nginx nginx] @
58724c48
DT
6364 [#:log-directory ``/var/log/nginx''] @
6365 [#:run-directory ``/var/run/nginx''] @
6366 [#:config-file]
6367
6368Return a service that runs @var{nginx}, the nginx web server.
6369
6370The nginx daemon loads its runtime configuration from @var{config-file}.
6371Log files are written to @var{log-directory} and temporary runtime data
6372files are written to @var{run-directory}. For proper operation, these
6373arguments should match what is in @var{config-file} to ensure that the
6374directories are created when the service is activated.
6375
6376@end deffn
6377
fe1a39d3
LC
6378@node Various Services
6379@subsubsection Various Services
6380
6381The @code{(gnu services lirc)} module provides the following service.
6382
be1c2c54 6383@deffn {Scheme Procedure} lirc-service [#:lirc lirc] @
fe1a39d3
LC
6384 [#:device #f] [#:driver #f] [#:config-file #f] @
6385 [#:extra-options '()]
6386Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
6387decodes infrared signals from remote controls.
6388
6389Optionally, @var{device}, @var{driver} and @var{config-file}
6390(configuration file name) may be specified. See @command{lircd} manual
6391for details.
6392
6393Finally, @var{extra-options} is a list of additional command-line options
6394passed to @command{lircd}.
6395@end deffn
6396
6397
0ae8c15a
LC
6398@node Setuid Programs
6399@subsection Setuid Programs
6400
6401@cindex setuid programs
6402Some programs need to run with ``root'' privileges, even when they are
6403launched by unprivileged users. A notorious example is the
4d40227c
LC
6404@command{passwd} program, which users can run to change their
6405password, and which needs to access the @file{/etc/passwd} and
0ae8c15a
LC
6406@file{/etc/shadow} files---something normally restricted to root, for
6407obvious security reasons. To address that, these executables are
6408@dfn{setuid-root}, meaning that they always run with root privileges
6409(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
6410for more info about the setuid mechanisms.)
6411
6412The store itself @emph{cannot} contain setuid programs: that would be a
6413security issue since any user on the system can write derivations that
6414populate the store (@pxref{The Store}). Thus, a different mechanism is
6415used: instead of changing the setuid bit directly on files that are in
6416the store, we let the system administrator @emph{declare} which programs
6417should be setuid root.
6418
6419The @code{setuid-programs} field of an @code{operating-system}
6420declaration contains a list of G-expressions denoting the names of
6421programs to be setuid-root (@pxref{Using the Configuration System}).
6422For instance, the @command{passwd} program, which is part of the Shadow
6423package, can be designated by this G-expression (@pxref{G-Expressions}):
6424
6425@example
6426#~(string-append #$shadow "/bin/passwd")
6427@end example
6428
6429A default set of setuid programs is defined by the
6430@code{%setuid-programs} variable of the @code{(gnu system)} module.
6431
6432@defvr {Scheme Variable} %setuid-programs
6433A list of G-expressions denoting common programs that are setuid-root.
6434
6435The list includes commands such as @command{passwd}, @command{ping},
6436@command{su}, and @command{sudo}.
6437@end defvr
6438
6439Under the hood, the actual setuid programs are created in the
6440@file{/run/setuid-programs} directory at system activation time. The
6441files in this directory refer to the ``real'' binaries, which are in the
6442store.
6443
efb5e833
LC
6444@node X.509 Certificates
6445@subsection X.509 Certificates
6446
6447@cindex HTTPS, certificates
6448@cindex X.509 certificates
6449@cindex TLS
6450Web servers available over HTTPS (that is, HTTP over the transport-layer
6451security mechanism, TLS) send client programs an @dfn{X.509 certificate}
6452that the client can then use to @emph{authenticate} the server. To do
6453that, clients verify that the server's certificate is signed by a
6454so-called @dfn{certificate authority} (CA). But to verify the CA's
6455signature, clients must have first acquired the CA's certificate.
6456
6457Web browsers such as GNU@tie{}IceCat include their own set of CA
6458certificates, such that they are able to verify CA signatures
6459out-of-the-box.
6460
6461However, most other programs that can talk HTTPS---@command{wget},
6462@command{git}, @command{w3m}, etc.---need to be told where CA
6463certificates can be found.
6464
6465@cindex @code{nss-certs}
6466In GuixSD, this is done by adding a package that provides certificates
6467to the @code{packages} field of the @code{operating-system} declaration
6468(@pxref{operating-system Reference}). GuixSD includes one such package,
6469@code{nss-certs}, which is a set of CA certificates provided as part of
6470Mozilla's Network Security Services.
6471
6472Note that it is @emph{not} part of @var{%base-packages}, so you need to
6473explicitly add it. The @file{/etc/ssl/certs} directory, which is where
6474most applications and libraries look for certificates by default, points
6475to the certificates installed globally.
6476
6477Unprivileged users can also install their own certificate package in
6478their profile. A number of environment variables need to be defined so
6479that applications and libraries know where to find them. Namely, the
6480OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
6481variables. Some applications add their own environment variables; for
6482instance, the Git version control system honors the certificate bundle
6483pointed to by the @code{GIT_SSL_CAINFO} environment variable.
6484
6485
996ed739
LC
6486@node Name Service Switch
6487@subsection Name Service Switch
6488
6489@cindex name service switch
6490@cindex NSS
6491The @code{(gnu system nss)} module provides bindings to the
6492configuration file of libc's @dfn{name service switch} or @dfn{NSS}
6493(@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
6494Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
6495extended with new ``name'' lookup methods for system databases, which
6496includes host names, service names, user accounts, and more (@pxref{Name
6497Service Switch, System Databases and Name Service Switch,, libc, The GNU
6498C Library Reference Manual}).
6499
6500The NSS configuration specifies, for each system database, which lookup
6501method is to be used, and how the various methods are chained
6502together---for instance, under which circumstances NSS should try the
6503next method in the list. The NSS configuration is given in the
6504@code{name-service-switch} field of @code{operating-system} declarations
6505(@pxref{operating-system Reference, @code{name-service-switch}}).
6506
4c9050c6
LC
6507@cindex nss-mdns
6508@cindex .local, host name lookup
996ed739 6509As an example, the declaration below configures the NSS to use the
4c9050c6
LC
6510@uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
6511back-end}, which supports host name lookups over multicast DNS (mDNS)
6512for host names ending in @code{.local}:
996ed739
LC
6513
6514@example
6515(name-service-switch
6516 (hosts (list %files ;first, check /etc/hosts
6517
6518 ;; If the above did not succeed, try
6519 ;; with 'mdns_minimal'.
6520 (name-service
6521 (name "mdns_minimal")
6522
6523 ;; 'mdns_minimal' is authoritative for
6524 ;; '.local'. When it returns "not found",
6525 ;; no need to try the next methods.
6526 (reaction (lookup-specification
6527 (not-found => return))))
6528
6529 ;; Then fall back to DNS.
6530 (name-service
6531 (name "dns"))
6532
6533 ;; Finally, try with the "full" 'mdns'.
6534 (name-service
6535 (name "mdns")))))
6536@end example
6537
15137a29
LC
6538Don't worry: the @code{%mdns-host-lookup-nss} variable (see below)
6539contains this configuration, so you won't have to type it if all you
6540want is to have @code{.local} host lookup working.
6541
4c9050c6
LC
6542Note that, in this case, in addition to setting the
6543@code{name-service-switch} of the @code{operating-system} declaration,
6544@code{nscd-service} must be told where to find the @code{nss-mdns}
6545shared library (@pxref{Base Services, @code{nscd-service}}). Since the
6546@code{nscd} service is part of @var{%base-services}, you may want to
6547customize it by adding this snippet in the operating system
6548configuration file:
6549
6550@example
6551(use-modules (guix) (gnu))
6552
6553(define %my-base-services
6554 ;; Replace the default nscd service with one that knows
6555 ;; about nss-mdns.
be1c2c54
LC
6556 (map (lambda (service)
6557 (if (member 'nscd (service-provision service))
b893f1ae
LC
6558 (nscd-service (nscd-configuration
6559 (name-services (list nss-mdns))))
be1c2c54 6560 service))
4c9050c6
LC
6561 %base-services))
6562@end example
6563
6564@noindent
6565@dots{} and then refer to @var{%my-base-services} instead of
6566@var{%base-services} in the @code{operating-system} declaration.
15137a29 6567Lastly, this relies on the availability of the Avahi service
965a7332 6568(@pxref{Networking Services, @code{avahi-service}}).
15137a29
LC
6569
6570For convenience, the following variables provide typical NSS
6571configurations.
6572
6573@defvr {Scheme Variable} %default-nss
6574This is the default name service switch configuration, a
6575@code{name-service-switch} object.
6576@end defvr
6577
6578@defvr {Scheme Variable} %mdns-host-lookup-nss
6579This is the name service switch configuration with support for host name
6580lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
6581@end defvr
4c9050c6 6582
996ed739
LC
6583The reference for name service switch configuration is given below. It
6584is a direct mapping of the C library's configuration file format, so
6585please refer to the C library manual for more information (@pxref{NSS
6586Configuration File,,, libc, The GNU C Library Reference Manual}).
6587Compared to libc's NSS configuration file format, it has the advantage
6588not only of adding this warm parenthetic feel that we like, but also
6589static checks: you'll know about syntax errors and typos as soon as you
6590run @command{guix system}.
6591
996ed739
LC
6592@deftp {Data Type} name-service-switch
6593
6594This is the data type representation the configuration of libc's name
6595service switch (NSS). Each field below represents one of the supported
6596system databases.
6597
6598@table @code
6599@item aliases
6600@itemx ethers
6601@itemx group
6602@itemx gshadow
6603@itemx hosts
6604@itemx initgroups
6605@itemx netgroup
6606@itemx networks
6607@itemx password
6608@itemx public-key
6609@itemx rpc
6610@itemx services
6611@itemx shadow
6612The system databases handled by the NSS. Each of these fields must be a
6613list of @code{<name-service>} objects (see below.)
6614@end table
6615@end deftp
6616
6617@deftp {Data Type} name-service
6618
6619This is the data type representing an actual name service and the
6620associated lookup action.
6621
6622@table @code
6623@item name
6624A string denoting the name service (@pxref{Services in the NSS
6625configuration,,, libc, The GNU C Library Reference Manual}).
6626
4aee6e60
LC
6627Note that name services listed here must be visible to nscd. This is
6628achieved by passing the @code{#:name-services} argument to
6629@code{nscd-service} the list of packages providing the needed name
6630services (@pxref{Base Services, @code{nscd-service}}).
6631
996ed739
LC
6632@item reaction
6633An action specified using the @code{lookup-specification} macro
6634(@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
6635Reference Manual}). For example:
6636
6637@example
6638(lookup-specification (unavailable => continue)
6639 (success => return))
6640@end example
6641@end table
6642@end deftp
0ae8c15a 6643
fd1b1fa2
LC
6644@node Initial RAM Disk
6645@subsection Initial RAM Disk
6646
6647@cindex initial RAM disk (initrd)
6648@cindex initrd (initial RAM disk)
6649For bootstrapping purposes, the Linux-Libre kernel is passed an
6650@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
6651root file system, as well as an initialization script. The latter is
6652responsible for mounting the real root file system, and for loading any
6653kernel modules that may be needed to achieve that.
6654
6655The @code{initrd} field of an @code{operating-system} declaration allows
6656you to specify which initrd you would like to use. The @code{(gnu
6657system linux-initrd)} module provides two ways to build an initrd: the
6658high-level @code{base-initrd} procedure, and the low-level
6659@code{expression->initrd} procedure.
6660
6661The @code{base-initrd} procedure is intended to cover most common uses.
6662For example, if you want to add a bunch of kernel modules to be loaded
6663at boot time, you can define the @code{initrd} field of the operating
6664system declaration like this:
6665
6666@example
52ac153e 6667(initrd (lambda (file-systems . rest)
027981d6
LC
6668 ;; Create a standard initrd that has modules "foo.ko"
6669 ;; and "bar.ko", as well as their dependencies, in
6670 ;; addition to the modules available by default.
52ac153e 6671 (apply base-initrd file-systems
027981d6 6672 #:extra-modules '("foo" "bar")
52ac153e 6673 rest)))
fd1b1fa2
LC
6674@end example
6675
52ac153e
LC
6676The @code{base-initrd} procedure also handles common use cases that
6677involves using the system as a QEMU guest, or as a ``live'' system whose
6678root file system is volatile.
fd1b1fa2
LC
6679
6680@deffn {Monadic Procedure} base-initrd @var{file-systems} @
6681 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 6682 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
6683Return a monadic derivation that builds a generic initrd. @var{file-systems} is
6684a list of file-systems to be mounted by the initrd, possibly in addition to
6685the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
6686@var{mapped-devices} is a list of device mappings to realize before
6687@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
6688
6689When @var{qemu-networking?} is true, set up networking with the standard QEMU
6690parameters. When @var{virtio?} is true, load additional modules so the initrd can
6691be used as a QEMU guest with para-virtualized I/O drivers.
6692
6693When @var{volatile-root?} is true, the root file system is writable but any changes
6694to it are lost.
6695
6696The initrd is automatically populated with all the kernel modules necessary
6697for @var{file-systems} and for the given options. However, additional kernel
6698modules can be listed in @var{extra-modules}. They will be added to the initrd, and
6699loaded at boot time in the order in which they appear.
6700@end deffn
6701
6702Needless to say, the initrds we produce and use embed a
6703statically-linked Guile, and the initialization program is a Guile
6704program. That gives a lot of flexibility. The
6705@code{expression->initrd} procedure builds such an initrd, given the
6706program to run in that initrd.
6707
6708@deffn {Monadic Procedure} expression->initrd @var{exp} @
6709 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 6710 [#:modules '()]
fd1b1fa2
LC
6711Return a derivation that builds a Linux initrd (a gzipped cpio archive)
6712containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
6713upon booting. All the derivations referenced by @var{exp} are
6714automatically copied to the initrd.
fd1b1fa2 6715
42d10464
LC
6716@var{modules} is a list of Guile module names to be embedded in the
6717initrd.
fd1b1fa2
LC
6718@end deffn
6719
88faf933
LC
6720@node GRUB Configuration
6721@subsection GRUB Configuration
6722
6723@cindex GRUB
6724@cindex boot loader
6725
6726The operating system uses GNU@tie{}GRUB as its boot loader
6727(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
6728configured using @code{grub-configuration} declarations. This data type
6729is exported by the @code{(gnu system grub)} module, and described below.
6730
6731@deftp {Data Type} grub-configuration
6732The type of a GRUB configuration declaration.
6733
6734@table @asis
6735
6736@item @code{device}
6737This is a string denoting the boot device. It must be a device name
6738understood by the @command{grub-install} command, such as
6739@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
6740GNU GRUB Manual}).
6741
6742@item @code{menu-entries} (default: @code{()})
6743A possibly empty list of @code{menu-entry} objects (see below), denoting
6744entries to appear in the GRUB boot menu, in addition to the current
6745system entry and the entry pointing to previous system generations.
6746
6747@item @code{default-entry} (default: @code{0})
6748The index of the default boot menu entry. Index 0 is for the current
6749system's entry.
6750
6751@item @code{timeout} (default: @code{5})
6752The number of seconds to wait for keyboard input before booting. Set to
67530 to boot immediately, and to -1 to wait indefinitely.
6754
6755@item @code{theme} (default: @var{%default-theme})
6756The @code{grub-theme} object describing the theme to use.
6757@end table
6758
6759@end deftp
6760
6761Should you want to list additional boot menu entries @i{via} the
6762@code{menu-entries} field above, you will need to create them with the
6763@code{menu-entry} form:
6764
6765@deftp {Data Type} menu-entry
6766The type of an entry in the GRUB boot menu.
6767
6768@table @asis
6769
6770@item @code{label}
35ed9306 6771The label to show in the menu---e.g., @code{"GNU"}.
88faf933
LC
6772
6773@item @code{linux}
6774The Linux kernel to boot.
6775
6776@item @code{linux-arguments} (default: @code{()})
6777The list of extra Linux kernel command-line arguments---e.g.,
6778@code{("console=ttyS0")}.
6779
6780@item @code{initrd}
6781A G-Expression or string denoting the file name of the initial RAM disk
6782to use (@pxref{G-Expressions}).
6783
6784@end table
6785@end deftp
6786
6787@c FIXME: Write documentation once it's stable.
6788Themes are created using the @code{grub-theme} form, which is not
6789documented yet.
6790
6791@defvr {Scheme Variable} %default-theme
6792This is the default GRUB theme used by the operating system, with a
6793fancy background image displaying the GNU and Guix logos.
6794@end defvr
6795
6796
cf4a9129
LC
6797@node Invoking guix system
6798@subsection Invoking @code{guix system}
0918e64a 6799
cf4a9129
LC
6800Once you have written an operating system declaration, as seen in the
6801previous section, it can be @dfn{instantiated} using the @command{guix
6802system} command. The synopsis is:
4af2447e 6803
cf4a9129
LC
6804@example
6805guix system @var{options}@dots{} @var{action} @var{file}
6806@end example
4af2447e 6807
cf4a9129
LC
6808@var{file} must be the name of a file containing an
6809@code{operating-system} declaration. @var{action} specifies how the
6810operating system is instantiate. Currently the following values are
6811supported:
4af2447e 6812
cf4a9129
LC
6813@table @code
6814@item reconfigure
6815Build the operating system described in @var{file}, activate it, and
6816switch to it@footnote{This action is usable only on systems already
6817running GNU.}.
4af2447e 6818
cf4a9129
LC
6819This effects all the configuration specified in @var{file}: user
6820accounts, system services, global package list, setuid programs, etc.
4af2447e 6821
cf4a9129
LC
6822It also adds a GRUB menu entry for the new OS configuration, and moves
6823entries for older configurations to a submenu---unless
6824@option{--no-grub} is passed.
4af2447e 6825
bf2479c7
LC
6826@c The paragraph below refers to the problem discussed at
6827@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
6828It is highly recommended to run @command{guix pull} once before you run
6829@command{guix system reconfigure} for the first time (@pxref{Invoking
6830guix pull}). Failing to do that you would see an older version of Guix
6831once @command{reconfigure} has completed.
6832
cf4a9129
LC
6833@item build
6834Build the operating system's derivation, which includes all the
6835configuration files and programs needed to boot and run the system.
6836This action does not actually install anything.
113daf62 6837
cf4a9129
LC
6838@item init
6839Populate the given directory with all the files necessary to run the
6840operating system specified in @var{file}. This is useful for first-time
4705641f 6841installations of GuixSD. For instance:
113daf62
LC
6842
6843@example
cf4a9129 6844guix system init my-os-config.scm /mnt
113daf62
LC
6845@end example
6846
cf4a9129
LC
6847copies to @file{/mnt} all the store items required by the configuration
6848specified in @file{my-os-config.scm}. This includes configuration
6849files, packages, and so on. It also creates other essential files
6850needed for the system to operate correctly---e.g., the @file{/etc},
6851@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 6852
cf4a9129
LC
6853This command also installs GRUB on the device specified in
6854@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 6855
cf4a9129
LC
6856@item vm
6857@cindex virtual machine
0276f697 6858@cindex VM
cf4a9129
LC
6859Build a virtual machine that contain the operating system declared in
6860@var{file}, and return a script to run that virtual machine (VM).
810568b3 6861Arguments given to the script are passed as is to QEMU.
113daf62 6862
cf4a9129 6863The VM shares its store with the host system.
113daf62 6864
0276f697
LC
6865Additional file systems can be shared between the host and the VM using
6866the @code{--share} and @code{--expose} command-line options: the former
6867specifies a directory to be shared with write access, while the latter
6868provides read-only access to the shared directory.
6869
6870The example below creates a VM in which the user's home directory is
6871accessible read-only, and where the @file{/exchange} directory is a
6872read-write mapping of the host's @file{$HOME/tmp}:
6873
6874@example
6875guix system vm my-config.scm \
6876 --expose=$HOME --share=$HOME/tmp=/exchange
6877@end example
6878
6aa260af
LC
6879On GNU/Linux, the default is to boot directly to the kernel; this has
6880the advantage of requiring only a very tiny root disk image since the
6881host's store can then be mounted.
6882
6883The @code{--full-boot} option forces a complete boot sequence, starting
6884with the bootloader. This requires more disk space since a root image
6885containing at least the kernel, initrd, and bootloader data files must
6886be created. The @code{--image-size} option can be used to specify the
6887image's size.
ab11f0be 6888
cf4a9129
LC
6889@item vm-image
6890@itemx disk-image
6891Return a virtual machine or disk image of the operating system declared
6892in @var{file} that stands alone. Use the @option{--image-size} option
6893to specify the size of the image.
113daf62 6894
cf4a9129
LC
6895When using @code{vm-image}, the returned image is in qcow2 format, which
6896the QEMU emulator can efficiently use.
113daf62 6897
cf4a9129
LC
6898When using @code{disk-image}, a raw disk image is produced; it can be
6899copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
6900the device corresponding to a USB stick, one can copy the image on it
6901using the following command:
113daf62 6902
cf4a9129
LC
6903@example
6904# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
6905@end example
113daf62 6906
cf4a9129 6907@end table
113daf62 6908
cf4a9129
LC
6909@var{options} can contain any of the common build options provided by
6910@command{guix build} (@pxref{Invoking guix build}). In addition,
6911@var{options} can contain one of the following:
113daf62 6912
cf4a9129
LC
6913@table @option
6914@item --system=@var{system}
6915@itemx -s @var{system}
6916Attempt to build for @var{system} instead of the host's system type.
6917This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 6918
f3f427c2
LC
6919@item --derivation
6920@itemx -d
6921Return the derivation file name of the given operating system without
6922building anything.
6923
cf4a9129
LC
6924@item --image-size=@var{size}
6925For the @code{vm-image} and @code{disk-image} actions, create an image
6926of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
6927include a unit as a suffix (@pxref{Block size, size specifications,,
6928coreutils, GNU Coreutils}).
db030303
LC
6929
6930@item --on-error=@var{strategy}
6931Apply @var{strategy} when an error occurs when reading @var{file}.
6932@var{strategy} may be one of the following:
6933
6934@table @code
6935@item nothing-special
6936Report the error concisely and exit. This is the default strategy.
6937
6938@item backtrace
6939Likewise, but also display a backtrace.
6940
6941@item debug
6942Report the error and enter Guile's debugger. From there, you can run
6943commands such as @code{,bt} to get a backtrace, @code{,locals} to
6944display local variable values, and more generally inspect the program's
6945state. @xref{Debug Commands,,, guile, GNU Guile Reference Manual}, for
6946a list of available debugging commands.
6947@end table
113daf62 6948@end table
113daf62 6949
cf4a9129
LC
6950Note that all the actions above, except @code{build} and @code{init},
6951rely on KVM support in the Linux-Libre kernel. Specifically, the
6952machine should have hardware virtualization support, the corresponding
6953KVM kernel module should be loaded, and the @file{/dev/kvm} device node
6954must exist and be readable and writable by the user and by the daemon's
6955build users.
8451a568 6956
cf4a9129
LC
6957@node Defining Services
6958@subsection Defining Services
8451a568 6959
cf4a9129
LC
6960The @code{(gnu services @dots{})} modules define several procedures that allow
6961users to declare the operating system's services (@pxref{Using the
6962Configuration System}). These procedures are @emph{monadic
6963procedures}---i.e., procedures that return a monadic value in the store
6964monad (@pxref{The Store Monad}). For examples of such procedures,
6965@xref{Services}.
8451a568 6966
cf4a9129
LC
6967@cindex service definition
6968The monadic value returned by those procedures is a @dfn{service
6969definition}---a structure as returned by the @code{service} form.
6970Service definitions specifies the inputs the service depends on, and an
6971expression to start and stop the service. Behind the scenes, service
6972definitions are ``translated'' into the form suitable for the
6973configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
6974dmd Manual}).
8451a568 6975
cf4a9129
LC
6976As an example, here is what the @code{nscd-service} procedure looks
6977like:
8451a568 6978
cf4a9129
LC
6979@lisp
6980(define (nscd-service)
6981 (with-monad %store-monad
6982 (return (service
6983 (documentation "Run libc's name service cache daemon.")
6984 (provision '(nscd))
6985 (activate #~(begin
6986 (use-modules (guix build utils))
6987 (mkdir-p "/var/run/nscd")))
6988 (start #~(make-forkexec-constructor
6989 (string-append #$glibc "/sbin/nscd")
6990 "-f" "/dev/null" "--foreground"))
6991 (stop #~(make-kill-destructor))
6992 (respawn? #f)))))
6993@end lisp
8451a568 6994
cf4a9129
LC
6995@noindent
6996The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
6997(@pxref{G-Expressions}). The @code{activate} field contains a script to
6998run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
6999directory exists before @command{nscd} is started.
8451a568 7000
cf4a9129
LC
7001The @code{start} and @code{stop} fields refer to dmd's facilities to
7002start and stop processes (@pxref{Service De- and Constructors,,, dmd,
7003GNU dmd Manual}). The @code{provision} field specifies the name under
7004which this service is known to dmd, and @code{documentation} specifies
7005on-line documentation. Thus, the commands @command{deco start ncsd},
7006@command{deco stop nscd}, and @command{deco doc nscd} will do what you
7007would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 7008
8451a568 7009
cf4a9129
LC
7010@node Installing Debugging Files
7011@section Installing Debugging Files
8451a568 7012
cf4a9129
LC
7013@cindex debugging files
7014Program binaries, as produced by the GCC compilers for instance, are
7015typically written in the ELF format, with a section containing
7016@dfn{debugging information}. Debugging information is what allows the
7017debugger, GDB, to map binary code to source code; it is required to
7018debug a compiled program in good conditions.
8451a568 7019
cf4a9129
LC
7020The problem with debugging information is that is takes up a fair amount
7021of disk space. For example, debugging information for the GNU C Library
7022weighs in at more than 60 MiB. Thus, as a user, keeping all the
7023debugging info of all the installed programs is usually not an option.
7024Yet, space savings should not come at the cost of an impediment to
7025debugging---especially in the GNU system, which should make it easier
7026for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 7027
cf4a9129
LC
7028Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
7029mechanism that allows users to get the best of both worlds: debugging
7030information can be stripped from the binaries and stored in separate
7031files. GDB is then able to load debugging information from those files,
7032when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
7033with GDB}).
8451a568 7034
cf4a9129
LC
7035The GNU distribution takes advantage of this by storing debugging
7036information in the @code{lib/debug} sub-directory of a separate package
7037output unimaginatively called @code{debug} (@pxref{Packages with
7038Multiple Outputs}). Users can choose to install the @code{debug} output
7039of a package when they need it. For instance, the following command
7040installs the debugging information for the GNU C Library and for GNU
7041Guile:
8451a568
LC
7042
7043@example
cf4a9129 7044guix package -i glibc:debug guile:debug
8451a568
LC
7045@end example
7046
cf4a9129
LC
7047GDB must then be told to look for debug files in the user's profile, by
7048setting the @code{debug-file-directory} variable (consider setting it
7049from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
7050GDB}):
8451a568 7051
cf4a9129
LC
7052@example
7053(gdb) set debug-file-directory ~/.guix-profile/lib/debug
7054@end example
8451a568 7055
cf4a9129
LC
7056From there on, GDB will pick up debugging information from the
7057@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 7058
cf4a9129
LC
7059In addition, you will most likely want GDB to be able to show the source
7060code being debugged. To do that, you will have to unpack the source
7061code of the package of interest (obtained with @code{guix build
7062--source}, @pxref{Invoking guix build}), and to point GDB to that source
7063directory using the @code{directory} command (@pxref{Source Path,
7064@code{directory},, gdb, Debugging with GDB}).
8451a568 7065
cf4a9129
LC
7066@c XXX: keep me up-to-date
7067The @code{debug} output mechanism in Guix is implemented by the
7068@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
7069opt-in---debugging information is available only for those packages
7070whose definition explicitly declares a @code{debug} output. This may be
7071changed to opt-out in the future, if our build farm servers can handle
7072the load. To check whether a package has a @code{debug} output, use
7073@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 7074
8451a568 7075
05962f29
LC
7076@node Security Updates
7077@section Security Updates
7078
843858b8
LC
7079@quotation Note
7080As of version @value{VERSION}, the feature described in this section is
7081experimental.
7082@end quotation
05962f29
LC
7083
7084@cindex security updates
7085Occasionally, important security vulnerabilities are discovered in core
7086software packages and must be patched. Guix follows a functional
7087package management discipline (@pxref{Introduction}), which implies
7088that, when a package is changed, @emph{every package that depends on it}
7089must be rebuilt. This can significantly slow down the deployment of
7090fixes in core packages such as libc or Bash, since basically the whole
7091distribution would need to be rebuilt. Using pre-built binaries helps
7092(@pxref{Substitutes}), but deployment may still take more time than
7093desired.
7094
7095@cindex grafts
7096To address that, Guix implements @dfn{grafts}, a mechanism that allows
7097for fast deployment of critical updates without the costs associated
7098with a whole-distribution rebuild. The idea is to rebuild only the
7099package that needs to be patched, and then to ``graft'' it onto packages
7100explicitly installed by the user and that were previously referring to
7101the original package. The cost of grafting is typically very low, and
7102order of magnitudes lower than a full rebuild of the dependency chain.
7103
7104@cindex replacements of packages, for grafts
7105For instance, suppose a security update needs to be applied to Bash.
7106Guix developers will provide a package definition for the ``fixed''
7107Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
7108Packages}). Then, the original package definition is augmented with a
7109@code{replacement} field pointing to the package containing the bug fix:
7110
7111@example
7112(define bash
7113 (package
7114 (name "bash")
7115 ;; @dots{}
7116 (replacement bash-fixed)))
7117@end example
7118
7119From there on, any package depending directly or indirectly on Bash that
7120is installed will automatically be ``rewritten'' to refer to
7121@var{bash-fixed} instead of @var{bash}. This grafting process takes
7122time proportional to the size of the package, but expect less than a
7123minute for an ``average'' package on a recent machine.
7124
7125Currently, the graft and the package it replaces (@var{bash-fixed} and
7126@var{bash} in the example above) must have the exact same @code{name}
7127and @code{version} fields. This restriction mostly comes from the fact
7128that grafting works by patching files, including binary files, directly.
7129Other restrictions may apply: for instance, when adding a graft to a
7130package providing a shared library, the original shared library and its
7131replacement must have the same @code{SONAME} and be binary-compatible.
7132
7133
cf4a9129
LC
7134@node Package Modules
7135@section Package Modules
8451a568 7136
cf4a9129
LC
7137From a programming viewpoint, the package definitions of the
7138GNU distribution are provided by Guile modules in the @code{(gnu packages
7139@dots{})} name space@footnote{Note that packages under the @code{(gnu
7140packages @dots{})} module name space are not necessarily ``GNU
7141packages''. This module naming scheme follows the usual Guile module
7142naming convention: @code{gnu} means that these modules are distributed
7143as part of the GNU system, and @code{packages} identifies modules that
7144define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
7145Reference Manual}). For instance, the @code{(gnu packages emacs)}
7146module exports a variable named @code{emacs}, which is bound to a
7147@code{<package>} object (@pxref{Defining Packages}).
113daf62 7148
300868ba 7149The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
7150automatically scanned for packages by the command-line tools. For
7151instance, when running @code{guix package -i emacs}, all the @code{(gnu
7152packages @dots{})} modules are scanned until one that exports a package
7153object whose name is @code{emacs} is found. This package search
7154facility is implemented in the @code{(gnu packages)} module.
113daf62 7155
300868ba 7156@cindex customization, of packages
8689901f 7157@cindex package module search path
cf4a9129 7158Users can store package definitions in modules with different
60142854 7159names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
c95ded7e
LC
7160name and module name must match. For instance, the @code{(my-packages
7161emacs)} module must be stored in a @file{my-packages/emacs.scm} file
7162relative to the load path specified with @option{--load-path} or
7163@code{GUIX_PACKAGE_PATH}. @xref{Modules and the File System,,,
7164guile, GNU Guile Reference Manual}, for details.}. These package definitions
300868ba
LC
7165will not be visible by default. Thus, users can invoke commands such as
7166@command{guix package} and @command{guix build} have to be used with the
c95ded7e
LC
7167@code{-e} option so that they know where to find the package. Better
7168yet, they can use the
300868ba 7169@code{-L} option of these commands to make those modules visible
8689901f
LC
7170(@pxref{Invoking guix build, @code{--load-path}}), or define the
7171@code{GUIX_PACKAGE_PATH} environment variable. This environment
7172variable makes it easy to extend or customize the distribution and is
7173honored by all the user interfaces.
7174
7175@defvr {Environment Variable} GUIX_PACKAGE_PATH
7176This is a colon-separated list of directories to search for package
7177modules. Directories listed in this variable take precedence over the
7178distribution's own modules.
7179@end defvr
ef5dd60a 7180
cf4a9129
LC
7181The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
7182each package is built based solely on other packages in the
7183distribution. The root of this dependency graph is a small set of
7184@dfn{bootstrap binaries}, provided by the @code{(gnu packages
7185bootstrap)} module. For more information on bootstrapping,
081145cf 7186@pxref{Bootstrapping}.
ef5dd60a 7187
cf4a9129
LC
7188@node Packaging Guidelines
7189@section Packaging Guidelines
ef5dd60a 7190
cf4a9129
LC
7191The GNU distribution is nascent and may well lack some of your favorite
7192packages. This section describes how you can help make the distribution
7193grow. @xref{Contributing}, for additional information on how you can
7194help.
ef5dd60a 7195
cf4a9129
LC
7196Free software packages are usually distributed in the form of
7197@dfn{source code tarballs}---typically @file{tar.gz} files that contain
7198all the source files. Adding a package to the distribution means
7199essentially two things: adding a @dfn{recipe} that describes how to
7200build the package, including a list of other packages required to build
7201it, and adding @dfn{package meta-data} along with that recipe, such as a
7202description and licensing information.
ef5dd60a 7203
cf4a9129
LC
7204In Guix all this information is embodied in @dfn{package definitions}.
7205Package definitions provide a high-level view of the package. They are
7206written using the syntax of the Scheme programming language; in fact,
7207for each package we define a variable bound to the package definition,
7208and export that variable from a module (@pxref{Package Modules}).
7209However, in-depth Scheme knowledge is @emph{not} a prerequisite for
7210creating packages. For more information on package definitions,
081145cf 7211@pxref{Defining Packages}.
ef5dd60a 7212
cf4a9129
LC
7213Once a package definition is in place, stored in a file in the Guix
7214source tree, it can be tested using the @command{guix build} command
7215(@pxref{Invoking guix build}). For example, assuming the new package is
c71979f4
LC
7216called @code{gnew}, you may run this command from the Guix build tree
7217(@pxref{Running Guix Before It Is Installed}):
ef5dd60a
LC
7218
7219@example
cf4a9129 7220./pre-inst-env guix build gnew --keep-failed
ef5dd60a 7221@end example
ef5dd60a 7222
cf4a9129
LC
7223Using @code{--keep-failed} makes it easier to debug build failures since
7224it provides access to the failed build tree. Another useful
7225command-line option when debugging is @code{--log-file}, to access the
7226build log.
ef5dd60a 7227
cf4a9129
LC
7228If the package is unknown to the @command{guix} command, it may be that
7229the source file contains a syntax error, or lacks a @code{define-public}
7230clause to export the package variable. To figure it out, you may load
7231the module from Guile to get more information about the actual error:
ef5dd60a 7232
cf4a9129
LC
7233@example
7234./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
7235@end example
ef5dd60a 7236
cf4a9129
LC
7237Once your package builds correctly, please send us a patch
7238(@pxref{Contributing}). Well, if you need help, we will be happy to
7239help you too. Once the patch is committed in the Guix repository, the
7240new package automatically gets built on the supported platforms by
2b1cee21 7241@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 7242system}.
ef5dd60a 7243
cf4a9129
LC
7244@cindex substituter
7245Users can obtain the new package definition simply by running
7246@command{guix pull} (@pxref{Invoking guix pull}). When
7247@code{hydra.gnu.org} is done building the package, installing the
7248package automatically downloads binaries from there
7249(@pxref{Substitutes}). The only place where human intervention is
7250needed is to review and apply the patch.
ef5dd60a 7251
ef5dd60a 7252
cf4a9129 7253@menu
ec0339cd
LC
7254* Software Freedom:: What may go into the distribution.
7255* Package Naming:: What's in a name?
7256* Version Numbers:: When the name is not enough.
cbd02397 7257* Synopses and Descriptions:: Helping users find the right package.
ec0339cd
LC
7258* Python Modules:: Taming the snake.
7259* Perl Modules:: Little pearls.
7260* Fonts:: Fond of fonts.
cf4a9129 7261@end menu
ef5dd60a 7262
cf4a9129
LC
7263@node Software Freedom
7264@subsection Software Freedom
ef5dd60a 7265
cf4a9129 7266@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 7267
cf4a9129
LC
7268The GNU operating system has been developed so that users can have
7269freedom in their computing. GNU is @dfn{free software}, meaning that
7270users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
7271essential freedoms}: to run the program, to study and change the program
7272in source code form, to redistribute exact copies, and to distribute
7273modified versions. Packages found in the GNU distribution provide only
7274software that conveys these four freedoms.
c11a6eb1 7275
cf4a9129
LC
7276In addition, the GNU distribution follow the
7277@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
7278software distribution guidelines}. Among other things, these guidelines
7279reject non-free firmware, recommendations of non-free software, and
7280discuss ways to deal with trademarks and patents.
ef5dd60a 7281
cf4a9129
LC
7282Some packages contain a small and optional subset that violates the
7283above guidelines, for instance because this subset is itself non-free
7284code. When that happens, the offending items are removed with
7285appropriate patches or code snippets in the package definition's
7286@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
7287build --source} returns the ``freed'' source rather than the unmodified
7288upstream source.
ef5dd60a 7289
ef5dd60a 7290
cf4a9129
LC
7291@node Package Naming
7292@subsection Package Naming
ef5dd60a 7293
cf4a9129
LC
7294A package has actually two names associated with it:
7295First, there is the name of the @emph{Scheme variable}, the one following
7296@code{define-public}. By this name, the package can be made known in the
7297Scheme code, for instance as input to another package. Second, there is
7298the string in the @code{name} field of a package definition. This name
7299is used by package management commands such as
7300@command{guix package} and @command{guix build}.
ef5dd60a 7301
cf4a9129
LC
7302Both are usually the same and correspond to the lowercase conversion of
7303the project name chosen upstream, with underscores replaced with
7304hyphens. For instance, GNUnet is available as @code{gnunet}, and
7305SDL_net as @code{sdl-net}.
927097ef 7306
cf4a9129 7307We do not add @code{lib} prefixes for library packages, unless these are
081145cf 7308already part of the official project name. But @pxref{Python
cf4a9129
LC
7309Modules} and @ref{Perl Modules} for special rules concerning modules for
7310the Python and Perl languages.
927097ef 7311
1b366ee4 7312Font package names are handled differently, @pxref{Fonts}.
7fec52b7 7313
ef5dd60a 7314
cf4a9129
LC
7315@node Version Numbers
7316@subsection Version Numbers
ef5dd60a 7317
cf4a9129
LC
7318We usually package only the latest version of a given free software
7319project. But sometimes, for instance for incompatible library versions,
7320two (or more) versions of the same package are needed. These require
7321different Scheme variable names. We use the name as defined
7322in @ref{Package Naming}
7323for the most recent version; previous versions use the same name, suffixed
7324by @code{-} and the smallest prefix of the version number that may
7325distinguish the two versions.
ef5dd60a 7326
cf4a9129
LC
7327The name inside the package definition is the same for all versions of a
7328package and does not contain any version number.
ef5dd60a 7329
cf4a9129 7330For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 7331
cf4a9129
LC
7332@example
7333(define-public gtk+
7334 (package
17d8e33f
ML
7335 (name "gtk+")
7336 (version "3.9.12")
7337 ...))
cf4a9129
LC
7338(define-public gtk+-2
7339 (package
17d8e33f
ML
7340 (name "gtk+")
7341 (version "2.24.20")
7342 ...))
cf4a9129
LC
7343@end example
7344If we also wanted GTK+ 3.8.2, this would be packaged as
7345@example
7346(define-public gtk+-3.8
7347 (package
17d8e33f
ML
7348 (name "gtk+")
7349 (version "3.8.2")
7350 ...))
cf4a9129 7351@end example
ef5dd60a 7352
cbd02397
LC
7353@node Synopses and Descriptions
7354@subsection Synopses and Descriptions
7355
7356As we have seen before, each package in GNU@tie{}Guix includes a
7357synopsis and a description (@pxref{Defining Packages}). Synopses and
7358descriptions are important: They are what @command{guix package
7359--search} searches, and a crucial piece of information to help users
7360determine whether a given package suits their needs. Consequently,
7361packagers should pay attention to what goes into them.
7362
7363Synopses must start with a capital letter and must not end with a
7364period. They must not start with ``a'' or ``the'', which usually does
7365not bring anything; for instance, prefer ``File-frobbing tool'' over ``A
7366tool that frobs files''. The synopsis should say what the package
7367is---e.g., ``Core GNU utilities (file, text, shell)''---or what it is
7368used for---e.g., the synopsis for GNU@tie{}grep is ``Print lines
7369matching a pattern''.
7370
7371Keep in mind that the synopsis must be meaningful for a very wide
7372audience. For example, ``Manipulate alignments in the SAM format''
7373might make sense for a seasoned bioinformatics researcher, but might be
7374fairly unhelpful or even misleading to a non-specialized audience. It
7375is a good idea to come up with a synopsis that gives an idea of the
7376application domain of the package. In this example, this might give
7377something like ``Manipulate nucleotide sequence alignments'', which
7378hopefully gives the user a better idea of whether this is what they are
7379looking for.
7380
7381@cindex Texinfo markup, in package descriptions
7382Descriptions should take between five and ten lines. Use full
7383sentences, and avoid using acronyms without first introducing them.
7384Descriptions can include Texinfo markup, which is useful to introduce
7385ornaments such as @code{@@code} or @code{@@dfn}, bullet lists, or
ba7d6c76
ML
7386hyperlinks (@pxref{Overview,,, texinfo, GNU Texinfo}). However you
7387should be careful when using some characters for example @samp{@@} and
7388curly braces which are the basic special characters in Texinfo
7389(@pxref{Special Characters,,, texinfo, GNU Texinfo}). User interfaces
7390such as @command{guix package --show} take care of rendering it
7391appropriately.
cbd02397
LC
7392
7393Synopses and descriptions are translated by volunteers
7394@uref{http://translationproject.org/domain/guix-packages.html, at the
7395Translation Project} so that as many users as possible can read them in
7396their native language. User interfaces search them and display them in
7397the language specified by the current locale.
7398
7399Translation is a lot of work so, as a packager, please pay even more
7400attention to your synopses and descriptions as every change may entail
ba7d6c76 7401additional work for translators. In order to help them, it is possible
36743e71 7402to make recommendations or instructions visible to them by inserting
ba7d6c76
ML
7403special comments like this (@pxref{xgettext Invocation,,, gettext, GNU
7404Gettext}):
7405
7406@example
7407;; TRANSLATORS: "X11 resize-and-rotate" should not be translated.
7408(description "ARandR is designed to provide a simple visual front end
7409for the X11 resize-and-rotate (RandR) extension. @dots{}")
7410@end example
cbd02397 7411
ef5dd60a 7412
cf4a9129
LC
7413@node Python Modules
7414@subsection Python Modules
ef5dd60a 7415
cf4a9129
LC
7416We currently package Python 2 and Python 3, under the Scheme variable names
7417@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
7418To avoid confusion and naming clashes with other programming languages, it
7419seems desirable that the name of a package for a Python module contains
7420the word @code{python}.
ef5dd60a 7421
cf4a9129
LC
7422Some modules are compatible with only one version of Python, others with both.
7423If the package Foo compiles only with Python 3, we name it
7424@code{python-foo}; if it compiles only with Python 2, we name it
7425@code{python2-foo}. If it is compatible with both versions, we create two
7426packages with the corresponding names.
ef5dd60a 7427
cf4a9129
LC
7428If a project already contains the word @code{python}, we drop this;
7429for instance, the module python-dateutil is packaged under the names
7430@code{python-dateutil} and @code{python2-dateutil}.
113daf62 7431
523e4896 7432
cf4a9129
LC
7433@node Perl Modules
7434@subsection Perl Modules
523e4896 7435
cf4a9129
LC
7436Perl programs standing for themselves are named as any other package,
7437using the lowercase upstream name.
7438For Perl packages containing a single class, we use the lowercase class name,
7439replace all occurrences of @code{::} by dashes and prepend the prefix
7440@code{perl-}.
7441So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
7442Modules containing several classes keep their lowercase upstream name and
7443are also prepended by @code{perl-}. Such modules tend to have the word
7444@code{perl} somewhere in their name, which gets dropped in favor of the
7445prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 7446
523e4896 7447
7fec52b7
AE
7448@node Fonts
7449@subsection Fonts
7450
7451For fonts that are in general not installed by a user for typesetting
7452purposes, or that are distributed as part of a larger software package,
7453we rely on the general packaging rules for software; for instance, this
7454applies to the fonts delivered as part of the X.Org system or fonts that
7455are part of TeX Live.
7456
7457To make it easier for a user to search for fonts, names for other packages
7458containing only fonts are constructed as follows, independently of the
7459upstream package name.
7460
7461The name of a package containing only one font family starts with
7462@code{font-}; it is followed by the foundry name and a dash @code{-}
7463if the foundry is known, and the font family name, in which spaces are
7464replaced by dashes (and as usual, all upper case letters are transformed
7465to lower case).
7466For example, the Gentium font family by SIL is packaged under the name
7467@code{font-sil-gentium}.
7468
7469For a package containing several font families, the name of the collection
7470is used in the place of the font family name.
7471For instance, the Liberation fonts consist of three families,
7472Liberation Sans, Liberation Serif and Liberation Mono.
7473These could be packaged separately under the names
7474@code{font-liberation-sans} and so on; but as they are distributed together
7475under a common name, we prefer to package them together as
7476@code{font-liberation}.
7477
7478In the case where several formats of the same font family or font collection
7479are packaged separately, a short form of the format, prepended by a dash,
7480is added to the package name. We use @code{-ttf} for TrueType fonts,
1b366ee4 7481@code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
7fec52b7
AE
7482fonts.
7483
7484
b25937e3 7485
cf4a9129
LC
7486@node Bootstrapping
7487@section Bootstrapping
b25937e3 7488
cf4a9129 7489@c Adapted from the ELS 2013 paper.
b25937e3 7490
cf4a9129 7491@cindex bootstrapping
7889394e 7492
cf4a9129
LC
7493Bootstrapping in our context refers to how the distribution gets built
7494``from nothing''. Remember that the build environment of a derivation
7495contains nothing but its declared inputs (@pxref{Introduction}). So
7496there's an obvious chicken-and-egg problem: how does the first package
7497get built? How does the first compiler get compiled? Note that this is
7498a question of interest only to the curious hacker, not to the regular
7499user, so you can shamelessly skip this section if you consider yourself
7500a ``regular user''.
72b9d60d 7501
cf4a9129
LC
7502@cindex bootstrap binaries
7503The GNU system is primarily made of C code, with libc at its core. The
7504GNU build system itself assumes the availability of a Bourne shell and
7505command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
7506`grep'. Furthermore, build programs---programs that run
7507@code{./configure}, @code{make}, etc.---are written in Guile Scheme
7508(@pxref{Derivations}). Consequently, to be able to build anything at
7509all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
7510Binutils, libc, and the other packages mentioned above---the
7511@dfn{bootstrap binaries}.
72b9d60d 7512
cf4a9129
LC
7513These bootstrap binaries are ``taken for granted'', though we can also
7514re-create them if needed (more on that later).
72b9d60d 7515
cf4a9129 7516@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 7517
cf4a9129
LC
7518@c As of Emacs 24.3, Info-mode displays the image, but since it's a
7519@c large image, it's hard to scroll. Oh well.
7520@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 7521
cf4a9129
LC
7522The figure above shows the very beginning of the dependency graph of the
7523distribution, corresponding to the package definitions of the @code{(gnu
7524packages bootstrap)} module. At this level of detail, things are
7525slightly complex. First, Guile itself consists of an ELF executable,
7526along with many source and compiled Scheme files that are dynamically
7527loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
7528tarball shown in this graph. This tarball is part of Guix's ``source''
7529distribution, and gets inserted into the store with @code{add-to-store}
7530(@pxref{The Store}).
2e7b5cea 7531
cf4a9129
LC
7532But how do we write a derivation that unpacks this tarball and adds it
7533to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
7534derivation---the first one that gets built---uses @code{bash} as its
7535builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
7536@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
7537@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
7538the Guix source distribution, whose sole purpose is to allow the Guile
7539tarball to be unpacked.
fb729425 7540
cf4a9129
LC
7541Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
7542Guile that can be used to run subsequent build programs. Its first task
7543is to download tarballs containing the other pre-built binaries---this
7544is what the @code{.tar.xz.drv} derivations do. Guix modules such as
7545@code{ftp-client.scm} are used for this purpose. The
7546@code{module-import.drv} derivations import those modules in a directory
7547in the store, using the original layout. The
7548@code{module-import-compiled.drv} derivations compile those modules, and
7549write them in an output directory with the right layout. This
7550corresponds to the @code{#:modules} argument of
7551@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 7552
cf4a9129
LC
7553Finally, the various tarballs are unpacked by the
7554derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
7555etc., at which point we have a working C tool chain.
fb729425 7556
fb729425 7557
cf4a9129 7558@unnumberedsubsec Building the Build Tools
523e4896 7559
cf4a9129
LC
7560@c TODO: Add a package-level dependency graph generated from (gnu
7561@c packages base).
df2ce343 7562
cf4a9129
LC
7563Bootstrapping is complete when we have a full tool chain that does not
7564depend on the pre-built bootstrap tools discussed above. This
7565no-dependency requirement is verified by checking whether the files of
7566the final tool chain contain references to the @file{/gnu/store}
7567directories of the bootstrap inputs. The process that leads to this
7568``final'' tool chain is described by the package definitions found in
1f6f57df 7569the @code{(gnu packages commencement)} module.
df2ce343 7570
cf4a9129
LC
7571@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
7572The first tool that gets built with the bootstrap binaries is
7573GNU Make, which is a prerequisite for all the following packages.
7574From there Findutils and Diffutils get built.
523e4896 7575
cf4a9129
LC
7576Then come the first-stage Binutils and GCC, built as pseudo cross
7577tools---i.e., with @code{--target} equal to @code{--host}. They are
7578used to build libc. Thanks to this cross-build trick, this libc is
7579guaranteed not to hold any reference to the initial tool chain.
4af2447e 7580
cf4a9129
LC
7581From there the final Binutils and GCC are built. GCC uses @code{ld}
7582from the final Binutils, and links programs against the just-built libc.
7583This tool chain is used to build the other packages used by Guix and by
7584the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 7585
cf4a9129
LC
7586And voilà! At this point we have the complete set of build tools that
7587the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
7588variable of the @code{(gnu packages commencement)} module, and are
7589implicitly used by any package that uses @code{gnu-build-system}
1f6f57df 7590(@pxref{Build Systems, @code{gnu-build-system}}).
4af2447e 7591
4af2447e 7592
cf4a9129 7593@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 7594
cf4a9129
LC
7595Because the final tool chain does not depend on the bootstrap binaries,
7596those rarely need to be updated. Nevertheless, it is useful to have an
7597automated way to produce them, should an update occur, and this is what
7598the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 7599
cf4a9129
LC
7600The following command builds the tarballs containing the bootstrap
7601binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
7602of Coreutils and other basic command-line tools):
4b2615e1 7603
cf4a9129
LC
7604@example
7605guix build bootstrap-tarballs
7606@end example
7607
7608The generated tarballs are those that should be referred to in the
7609@code{(gnu packages bootstrap)} module mentioned at the beginning of
7610this section.
7611
7612Still here? Then perhaps by now you've started to wonder: when do we
7613reach a fixed point? That is an interesting question! The answer is
7614unknown, but if you would like to investigate further (and have
7615significant computational and storage resources to do so), then let us
7616know.
7617
7618@node Porting
7619@section Porting to a New Platform
7620
7621As discussed above, the GNU distribution is self-contained, and
7622self-containment is achieved by relying on pre-built ``bootstrap
7623binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
7624operating system kernel, CPU architecture, and application binary
7625interface (ABI). Thus, to port the distribution to a platform that is
7626not yet supported, one must build those bootstrap binaries, and update
7627the @code{(gnu packages bootstrap)} module to use them on that platform.
7628
7629Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
7630When everything goes well, and assuming the GNU tool chain supports the
7631target platform, this can be as simple as running a command like this
7632one:
7633
7634@example
7635guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
7636@end example
7637
1c0c417d
LC
7638For this to work, the @code{glibc-dynamic-linker} procedure in
7639@code{(gnu packages bootstrap)} must be augmented to return the right
7640file name for libc's dynamic linker on that platform; likewise,
7641@code{system->linux-architecture} in @code{(gnu packages linux)} must be
7642taught about the new platform.
7643
cf4a9129 7644Once these are built, the @code{(gnu packages bootstrap)} module needs
1c0c417d
LC
7645to be updated to refer to these binaries on the target platform. That
7646is, the hashes and URLs of the bootstrap tarballs for the new platform
7647must be added alongside those of the currently supported platforms. The
7648bootstrap Guile tarball is treated specially: it is expected to be
7649available locally, and @file{gnu-system.am} has rules do download it for
7650the supported architectures; a rule for the new platform must be added
7651as well.
cf4a9129
LC
7652
7653In practice, there may be some complications. First, it may be that the
7654extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
7655above) is not recognized by all the GNU tools. Typically, glibc
7656recognizes some of these, whereas GCC uses an extra @code{--with-abi}
7657configure flag (see @code{gcc.scm} for examples of how to handle this).
7658Second, some of the required packages could fail to build for that
7659platform. Lastly, the generated binaries could be broken for some
7660reason.
4af2447e 7661
9bf3c1a7 7662@c *********************************************************************
8c01b9d0 7663@include contributing.texi
c78bd12b 7664
568717fd
LC
7665@c *********************************************************************
7666@node Acknowledgments
7667@chapter Acknowledgments
7668
7669Guix is based on the Nix package manager, which was designed and
4c7ac9aa
LC
7670implemented by Eelco Dolstra, with contributions from other people (see
7671the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
7672management, and promoted unprecedented features, such as transactional
7673package upgrades and rollbacks, per-user profiles, and referentially
7674transparent build processes. Without this work, Guix would not exist.
7675
7676The Nix-based software distributions, Nixpkgs and NixOS, have also been
7677an inspiration for Guix.
7678
4c7ac9aa
LC
7679GNU@tie{}Guix itself is a collective work with contributions from a
7680number of people. See the @file{AUTHORS} file in Guix for more
7681information on these fine people. The @file{THANKS} file lists people
7682who have helped by reporting bugs, taking care of the infrastructure,
7683providing artwork and themes, making suggestions, and more---thank you!
7684
7685
568717fd
LC
7686@c *********************************************************************
7687@node GNU Free Documentation License
7688@appendix GNU Free Documentation License
7689
7690@include fdl-1.3.texi
7691
7692@c *********************************************************************
7693@node Concept Index
7694@unnumbered Concept Index
7695@printindex cp
7696
a85b83d2
LC
7697@node Programming Index
7698@unnumbered Programming Index
7699@syncodeindex tp fn
7700@syncodeindex vr fn
568717fd
LC
7701@printindex fn
7702
7703@bye
7704
7705@c Local Variables:
7706@c ispell-local-dictionary: "american";
7707@c End: