lint: Add "cve" checker.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
4379c35b 13Copyright @copyright{} 2012, 2013, 2014, 2015 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
87eafdbd 15Copyright @copyright{} 2013 Nikita Karetnikov@*
8c01b9d0
ML
16Copyright @copyright{} 2015 Mathieu Lirzin@*
17Copyright @copyright{} 2014 Pierre-Antoine Rault@*
87eafdbd 18Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer
7df7a74e
NK
19
20Permission is granted to copy, distribute and/or modify this document
21under the terms of the GNU Free Documentation License, Version 1.3 or
22any later version published by the Free Software Foundation; with no
23Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
24copy of the license is included in the section entitled ``GNU Free
25Documentation License''.
26@end copying
568717fd 27
eeaf4427 28@dircategory Package management
568717fd
LC
29@direntry
30* guix: (guix). Guix, the functional package manager.
e49951eb 31* guix package: (guix)Invoking guix package
eeaf4427 32 Managing packages with Guix.
e49951eb 33* guix build: (guix)Invoking guix build
568717fd 34 Building packages with Guix.
054e8576
LC
35* guix system: (guix)Invoking guix system
36 Managing the operating system configuration.
568717fd 37@end direntry
568717fd 38
372c4bbc
DT
39@dircategory Software development
40@direntry
41* guix environment: (guix)Invoking guix environment
42 Building development environments with Guix.
43@end direntry
44
568717fd 45@titlepage
7730d112
LC
46@title GNU Guix Reference Manual
47@subtitle Using the GNU Guix Functional Package Manager
2cbed07e 48@author The GNU Guix Developers
568717fd
LC
49
50@page
51@vskip 0pt plus 1filll
52Edition @value{EDITION} @*
53@value{UPDATED} @*
54
7df7a74e 55@insertcopying
568717fd
LC
56@end titlepage
57
568717fd
LC
58@contents
59
60@c *********************************************************************
61@node Top
f8348b91 62@top GNU Guix
568717fd 63
f8348b91
LC
64This document describes GNU Guix version @value{VERSION}, a functional
65package management tool written for the GNU system.
568717fd
LC
66
67@menu
68* Introduction:: What is Guix about?
bd5e766b 69* Installation:: Installing Guix.
eeaf4427 70* Package Management:: Package installation, upgrade, etc.
c554de89 71* Emacs Interface:: Using Guix from Emacs.
568717fd
LC
72* Programming Interface:: Using Guix in Scheme.
73* Utilities:: Package management commands.
a1ba8475 74* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 75* Contributing:: Your help needed!
568717fd
LC
76
77* Acknowledgments:: Thanks!
78* GNU Free Documentation License:: The license of this manual.
79* Concept Index:: Concepts.
a85b83d2 80* Programming Index:: Data types, functions, and variables.
aaa3eaa9
LC
81
82@detailmenu
83 --- The Detailed Node Listing ---
84
85Installation
86
1b2b8177 87* Binary Installation:: Getting Guix running in no time!
aaa3eaa9 88* Requirements:: Software needed to build and run Guix.
ec0339cd 89* Running the Test Suite:: Testing Guix.
aaa3eaa9
LC
90* Setting Up the Daemon:: Preparing the build daemon's environment.
91* Invoking guix-daemon:: Running the build daemon.
0e2d0213 92* Application Setup:: Application-specific setup.
aaa3eaa9
LC
93
94Setting Up the Daemon
95
96* Build Environment Setup:: Preparing the isolated build environment.
97* Daemon Offload Setup:: Offloading builds to remote machines.
98
99Package Management
100
101* Features:: How Guix will make your life brighter.
102* Invoking guix package:: Package installation, removal, etc.
aaa3eaa9
LC
103* Substitutes:: Downloading pre-built binaries.
104* Packages with Multiple Outputs:: Single source package, multiple outputs.
105* Invoking guix gc:: Running the garbage collector.
106* Invoking guix pull:: Fetching the latest Guix and distribution.
107* Invoking guix archive:: Exporting and importing store files.
108
c554de89
AK
109Emacs Interface
110
111* Initial Setup: Emacs Initial Setup. Preparing @file{~/.emacs}.
112* Package Management: Emacs Package Management. Managing packages and generations.
9b0afb0d 113* Popup Interface: Emacs Popup Interface. Magit-like interface for guix commands.
c554de89 114* Prettify Mode: Emacs Prettify. Abbreviating @file{/gnu/store/@dots{}} file names.
34850cd5 115* Build Log Mode: Emacs Build Log. Highlighting Guix build logs.
187f80c6
AK
116* Completions: Emacs Completions. Completing @command{guix} shell command.
117* Development: Emacs Development. Tools for Guix developers.
c554de89 118
aaa3eaa9
LC
119Programming Interface
120
121* Defining Packages:: Defining new packages.
122* Build Systems:: Specifying how packages are built.
123* The Store:: Manipulating the package store.
124* Derivations:: Low-level interface to package derivations.
125* The Store Monad:: Purely functional interface to the store.
126* G-Expressions:: Manipulating build expressions.
127
92492b23
LC
128Defining Packages
129
130* package Reference:: The package data type.
131* origin Reference:: The origin data type.
132
aaa3eaa9
LC
133Utilities
134
135* Invoking guix build:: Building packages from the command line.
fcc58db6 136* Invoking guix edit:: Editing package definitions.
aaa3eaa9
LC
137* Invoking guix download:: Downloading a file and printing its hash.
138* Invoking guix hash:: Computing the cryptographic hash of a file.
139* Invoking guix import:: Importing package definitions.
140* Invoking guix refresh:: Updating package definitions.
141* Invoking guix lint:: Finding errors in package definitions.
fcc58db6 142* Invoking guix size:: Profiling disk usage.
88856916 143* Invoking guix graph:: Visualizing the graph of packages.
aaa3eaa9 144* Invoking guix environment:: Setting up development environments.
aff8ce7c 145* Invoking guix publish:: Sharing substitutes.
d23c20f1 146* Invoking guix challenge:: Challenging substitute servers.
32efa254 147* Invoking guix container:: Process isolation.
aaa3eaa9
LC
148
149GNU Distribution
150
151* System Installation:: Installing the whole operating system.
35ed9306 152* System Configuration:: Configuring the operating system.
aaa3eaa9
LC
153* Installing Debugging Files:: Feeding the debugger.
154* Security Updates:: Deploying security fixes quickly.
155* Package Modules:: Packages from the programmer's viewpoint.
156* Packaging Guidelines:: Growing the distribution.
157* Bootstrapping:: GNU/Linux built from scratch.
158* Porting:: Targeting another platform or kernel.
159
160System Configuration
161
162* Using the Configuration System:: Customizing your GNU system.
163* operating-system Reference:: Detail of operating-system declarations.
164* File Systems:: Configuring file system mounts.
165* Mapped Devices:: Block device extra processing.
166* User Accounts:: Specifying user accounts.
598e19dc 167* Locales:: Language and cultural convention settings.
aaa3eaa9
LC
168* Services:: Specifying system services.
169* Setuid Programs:: Programs running with root privileges.
1b2b8177 170* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 171* Name Service Switch:: Configuring libc's name service switch.
aaa3eaa9
LC
172* Initial RAM Disk:: Linux-Libre bootstrapping.
173* GRUB Configuration:: Configuring the boot loader.
174* Invoking guix system:: Instantiating a system configuration.
175* Defining Services:: Adding new service definitions.
176
177Services
178
179* Base Services:: Essential system services.
180* Networking Services:: Network setup, SSH daemon, etc.
181* X Window:: Graphical display.
1b2b8177
LC
182* Desktop Services:: D-Bus and desktop services.
183* Database Services:: SQL databases.
cbd02397 184* Web Services:: Web servers.
aa4ed923 185* Various Services:: Other services.
aaa3eaa9 186
0adfe95a
LC
187Defining Services
188
189* Service Composition:: The model for composing services.
190* Service Types and Services:: Types and services.
191* Service Reference:: API reference.
192* dmd Services:: A particular type of service.
193
aaa3eaa9
LC
194Packaging Guidelines
195
ec0339cd
LC
196* Software Freedom:: What may go into the distribution.
197* Package Naming:: What's in a name?
198* Version Numbers:: When the name is not enough.
cbd02397 199* Synopses and Descriptions:: Helping users find the right package.
ec0339cd
LC
200* Python Modules:: Taming the snake.
201* Perl Modules:: Little pearls.
202* Fonts:: Fond of fonts.
aaa3eaa9 203
8c01b9d0
ML
204Contributing
205
206* Building from Git:: The latest and greatest.
207* Running Guix Before It Is Installed:: Hacker tricks.
208* The Perfect Setup:: The right tools.
209* Coding Style:: Hygiene of the contributor.
210* Submitting Patches:: Share your work.
211
212Coding Style
213
214* Programming Paradigm:: How to compose your elements.
215* Modules:: Where to store your code?
216* Data Types and Pattern Matching:: Implementing data structures.
217* Formatting Code:: Writing conventions.
218
aaa3eaa9 219@end detailmenu
568717fd
LC
220@end menu
221
222@c *********************************************************************
223@node Introduction
224@chapter Introduction
225
c80e7e55
LC
226GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
227using the international phonetic alphabet (IPA).} is a functional
228package management tool for the GNU system. Package management consists
4bfc4ea3
NK
229of all activities that relate to building packages from sources,
230honoring their build-time and run-time dependencies,
c80e7e55
LC
231installing packages in user environments, upgrading installed packages
232to new versions or rolling back to a previous set, removing unused
233software packages, etc.
568717fd
LC
234
235@cindex functional package management
236The term @dfn{functional} refers to a specific package management
136787cb
LC
237discipline pioneered by Nix (@pxref{Acknowledgments}).
238In Guix, the package build and installation process is seen
4bfc4ea3
NK
239as a function, in the mathematical sense. That function takes inputs,
240such as build scripts, a compiler, and libraries, and
241returns an installed package. As a pure function, its result depends
568717fd
LC
242solely on its inputs---for instance, it cannot refer to software or
243scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
244always produces the same result when passed a given set of inputs. It
245cannot alter the system's environment in
568717fd
LC
246any way; for instance, it cannot create, modify, or delete files outside
247of its build and installation directories. This is achieved by running
e900c503 248build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 249explicit inputs are visible.
568717fd 250
e531ac2a 251@cindex store
568717fd 252The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
253system, in a special directory called @dfn{the store} (@pxref{The
254Store}). Each package is installed in a directory of its own, in the
834129e0 255store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
256a hash of all the inputs used to build that package; thus, changing an
257input yields a different directory name.
258
259This approach is the foundation of Guix's salient features: support for
4bfc4ea3 260transactional package upgrade and rollback, per-user installation, and
eeaf4427 261garbage collection of packages (@pxref{Features}).
568717fd 262
4bfc4ea3 263Guix has a command-line interface, which allows users to build, install,
568717fd 264upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 265
3ca2731c 266@cindex Guix System Distribution
4705641f 267@cindex GuixSD
a1ba8475 268Last but not least, Guix is used to build a distribution of the GNU
3ca2731c 269system, with many GNU and non-GNU free software packages. The Guix
4705641f
LC
270System Distribution, or GNU@tie{}GuixSD, takes advantage of the core
271properties of Guix at the system level. With GuixSD, users
3ca2731c
LC
272@emph{declare} all aspects of the operating system configuration, and
273Guix takes care of instantiating that configuration in a reproducible,
274stateless fashion. @xref{GNU Distribution}.
a1ba8475 275
bd5e766b
LC
276@c *********************************************************************
277@node Installation
278@chapter Installation
279
48febeb8
LC
280GNU Guix is available for download from its website at
281@url{http://www.gnu.org/software/guix/}. This section describes the
282software requirements of Guix, as well as how to install it and get
283ready to use it.
bd5e766b 284
5af6de3e
LC
285Note that this section is concerned with the installation of the package
286manager, which can be done on top of a running GNU/Linux system. If,
287instead, you want to install the complete GNU operating system,
6621cdb6 288@pxref{System Installation}.
5af6de3e 289
bd5e766b 290@menu
09722b11 291* Binary Installation:: Getting Guix running in no time!
bd5e766b 292* Requirements:: Software needed to build and run Guix.
ec0339cd 293* Running the Test Suite:: Testing Guix.
bd5e766b
LC
294* Setting Up the Daemon:: Preparing the build daemon's environment.
295* Invoking guix-daemon:: Running the build daemon.
0e2d0213 296* Application Setup:: Application-specific setup.
bd5e766b
LC
297@end menu
298
09722b11
LC
299@node Binary Installation
300@section Binary Installation
301
302This section describes how to install Guix on an arbitrary system from a
303self-contained tarball providing binaries for Guix and for all its
304dependencies. This is often quicker than installing from source, which
305is described in the next sections. The only requirement is to have
306GNU@tie{}tar and Xz.
307
308Installing goes along these lines:
309
310@enumerate
311@item
312Download the binary tarball from
ae806096 313@indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz}@footnote{As
09722b11
LC
314usual, make sure to download the associated @file{.sig} file and to
315verify the authenticity of the tarball against it!}, where @var{system}
316is @code{x86_64-linux} for an @code{x86_64} machine already running the
317kernel Linux, and so on.
318
319@item
320As @code{root}, run:
321
322@example
5dc42964 323# cd /tmp
254b1c2e
LC
324# tar --warning=no-timestamp -xf \
325 guix-binary-@value{VERSION}.@var{system}.tar.xz
5dc42964 326# mv var/guix /var/ && mv gnu /
09722b11
LC
327@end example
328
7acd3439
LC
329This creates @file{/gnu/store} (@pxref{The Store}) and @file{/var/guix}.
330The latter contains a ready-to-use profile for @code{root} (see next
331step.)
09722b11 332
5dc3ce5f
LC
333Do @emph{not} unpack the tarball on a working Guix system since that
334would overwrite its own essential files.
335
254b1c2e 336The @code{--warning=no-timestamp} option makes sure GNU@tie{}tar does
e9ba6357
LC
337not emit warnings about ``implausibly old time stamps'' (such
338warnings were triggered by GNU@tie{}tar 1.26 and older; recent
339versions are fine.)
340They stem from the fact that all the
254b1c2e
LC
341files in the archive have their modification time set to zero (which
342means January 1st, 1970.) This is done on purpose to make sure the
343archive content is independent of its creation time, thus making it
344reproducible.
345
7acd3439
LC
346@item
347Make @code{root}'s profile available under @file{~/.guix-profile}:
348
349@example
350# ln -sf /var/guix/profiles/per-user/root/guix-profile \
351 ~root/.guix-profile
352@end example
353
43c33047
LC
354@item
355Create the group and user accounts for build users as explained below
356(@pxref{Build Environment Setup}).
357
09722b11 358@item
175ced41 359Run the daemon:
09722b11
LC
360
361@example
7acd3439 362# ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
09722b11
LC
363@end example
364
d2825c96
LC
365On hosts using the systemd init system, drop
366@file{~root/.guix-profile/lib/systemd/system/guix-daemon.service} in
367@file{/etc/systemd/system}.
368
09722b11
LC
369@item
370Make the @command{guix} command available to other users on the machine,
371for instance with:
372
373@example
374# mkdir -p /usr/local/bin
375# cd /usr/local/bin
d72d05f9 376# ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
09722b11 377@end example
39f8ed14
LC
378
379@item
380To use substitutes from @code{hydra.gnu.org} (@pxref{Substitutes}),
381authorize them:
382
383@example
7acd3439 384# guix archive --authorize < ~root/.guix-profile/share/guix/hydra.gnu.org.pub
39f8ed14 385@end example
09722b11
LC
386@end enumerate
387
53de532f
LC
388And that's it! For additional tips and tricks, @pxref{Application
389Setup}.
09722b11 390
5dc3ce5f 391The @code{guix} package must remain available in @code{root}'s
09722b11
LC
392profile, or it would become subject to garbage collection---in which
393case you would find yourself badly handicapped by the lack of the
394@command{guix} command.
395
39f8ed14
LC
396The tarball in question can be (re)produced and verified simply by
397running the following command in the Guix source tree:
09722b11
LC
398
399@example
400make guix-binary.@var{system}.tar.xz
401@end example
402
403
bd5e766b
LC
404@node Requirements
405@section Requirements
406
09722b11
LC
407This section lists requirements when building Guix from source. The
408build procedure for Guix is the same as for other GNU software, and is
409not covered here. Please see the files @file{README} and @file{INSTALL}
410in the Guix source tree for additional details.
411
bd5e766b
LC
412GNU Guix depends on the following packages:
413
414@itemize
47c66da0 415@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
288dca55 416@item @url{http://gnupg.org/, GNU libgcrypt};
f0b98b84 417@item @url{http://www.gnu.org/software/make/, GNU Make}.
8a96bd4b
ID
418@end itemize
419
420The following dependencies are optional:
421
422@itemize
288dca55 423@item
8a96bd4b 424Installing
288dca55 425@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
426allow you to use the @command{guix import pypi} command (@pxref{Invoking
427guix import}). It is of
288dca55 428interest primarily for developers and not for casual users.
8a96bd4b
ID
429@item
430Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
431allow you to access @code{https} URLs with the @command{guix download}
d45dc6da
EB
432command (@pxref{Invoking guix download}), the @command{guix import pypi}
433command, and the @command{guix import cpan} command. This is primarily
434of interest to developers. @xref{Guile Preparations, how to install the
435GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
436@end itemize
437
438Unless @code{--disable-daemon} was passed to @command{configure}, the
439following packages are also needed:
440
441@itemize
368d08f7
LC
442@item @url{http://sqlite.org, SQLite 3};
443@item @url{http://www.bzip.org, libbz2};
444@item @url{http://gcc.gnu.org, GCC's g++}, with support for the
445C++11 standard.
bd5e766b
LC
446@end itemize
447
4bfc4ea3
NK
448When a working installation of @url{http://nixos.org/nix/, the Nix package
449manager} is available, you
bd5e766b 450can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 451Nix replaces the three dependencies above.
bd5e766b 452
b22a12fd
LC
453Guix is compatible with Nix, so it is possible to share the same store
454between both. To do so, you must pass @command{configure} not only the
455same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
456@code{--localstatedir} value. The latter is essential because it
457specifies where the database that stores metadata about the store is
834129e0 458located, among other things. The default values for Nix are
b22a12fd 459@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
460Note that @code{--disable-daemon} is not required if
461your goal is to share the store with Nix.
b22a12fd 462
ec0339cd
LC
463@node Running the Test Suite
464@section Running the Test Suite
465
466After a successful @command{configure} and @code{make} run, it is a good
467idea to run the test suite. It can help catch issues with the setup or
468environment, or bugs in Guix itself---and really, reporting test
469failures is a good way to help improve the software. To run the test
470suite, type:
471
472@example
473make check
474@end example
475
476Test cases can run in parallel: you can use the @code{-j} option of
477GNU@tie{}make to speed things up. The first run may take a few minutes
478on a recent machine; subsequent runs will be faster because the store
479that is created for test purposes will already have various things in
480cache.
481
482Upon failure, please email @email{bug-guix@@gnu.org} and attach the
483@file{test-suite.log} file. When @file{tests/@var{something}.scm}
484fails, please also attach the @file{@var{something}.log} file available
485in the top-level build directory. Please specify the Guix version being
486used as well as version numbers of the dependencies
487(@pxref{Requirements}) in your message.
488
bd5e766b
LC
489@node Setting Up the Daemon
490@section Setting Up the Daemon
491
492@cindex daemon
493Operations such as building a package or running the garbage collector
49e6291a 494are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
495behalf of clients. Only the daemon may access the store and its
496associated database. Thus, any operation that manipulates the store
497goes through the daemon. For instance, command-line tools such as
e49951eb 498@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
499daemon (@i{via} remote procedure calls) to instruct it what to do.
500
49e6291a 501The following sections explain how to prepare the build daemon's
225dafde
LC
502environment. Also @ref{Substitutes}, for information on how to allow
503the daemon to download pre-built binaries.
49e6291a
LC
504
505@menu
506* Build Environment Setup:: Preparing the isolated build environment.
507* Daemon Offload Setup:: Offloading builds to remote machines.
508@end menu
509
510@node Build Environment Setup
511@subsection Build Environment Setup
512
bd5e766b
LC
513In a standard multi-user setup, Guix and its daemon---the
514@command{guix-daemon} program---are installed by the system
834129e0 515administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
516@command{guix-daemon} runs as @code{root}. Unprivileged users may use
517Guix tools to build packages or otherwise access the store, and the
518daemon will do it on their behalf, ensuring that the store is kept in a
519consistent state, and allowing built packages to be shared among users.
520
521@cindex build users
522When @command{guix-daemon} runs as @code{root}, you may not want package
523build processes themselves to run as @code{root} too, for obvious
524security reasons. To avoid that, a special pool of @dfn{build users}
525should be created for use by build processes started by the daemon.
526These build users need not have a shell and a home directory: they will
527just be used when the daemon drops @code{root} privileges in build
528processes. Having several such users allows the daemon to launch
529distinct build processes under separate UIDs, which guarantees that they
530do not interfere with each other---an essential feature since builds are
531regarded as pure functions (@pxref{Introduction}).
532
533On a GNU/Linux system, a build user pool may be created like this (using
534Bash syntax and the @code{shadow} commands):
535
091196b3
LC
536@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
537@c for why `-G' is needed.
bd5e766b 538@example
cfc149dc
LC
539# groupadd --system guixbuild
540# for i in `seq -w 1 10`;
bd5e766b 541 do
cfc149dc
LC
542 useradd -g guixbuild -G guixbuild \
543 -d /var/empty -s `which nologin` \
544 -c "Guix build user $i" --system \
545 guixbuilder$i;
bd5e766b
LC
546 done
547@end example
548
549@noindent
54eb03ab
LC
550The number of build users determines how many build jobs may run in
551parallel, as specified by the @option{--max-jobs} option
d2825c96
LC
552(@pxref{Invoking guix-daemon, @option{--max-jobs}}). The
553@code{guix-daemon} program may then be run as @code{root} with the
554following command@footnote{If your machine uses the systemd init system,
555dropping the @file{@var{prefix}/lib/systemd/system/guix-daemon.service}
556file in @file{/etc/systemd/system} will ensure that
557@command{guix-daemon} is automatically started.}:
bd5e766b
LC
558
559@example
cfc149dc 560# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
561@end example
562
e900c503 563@cindex chroot
b095792f
LC
564@noindent
565This way, the daemon starts build processes in a chroot, under one of
cfc149dc 566the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
567environment contains nothing but:
568
569@c Keep this list in sync with libstore/build.cc! -----------------------
570@itemize
571@item
4743a4da
LC
572a minimal @code{/dev} directory, created mostly independently from the
573host @code{/dev}@footnote{``Mostly'', because while the set of files
574that appear in the chroot's @code{/dev} is fixed, most of these files
575can only be created if the host has them.};
576
577@item
578the @code{/proc} directory; it only shows the container's processes
579since a separate PID name space is used;
6dc99317
LC
580
581@item
582@file{/etc/passwd} with an entry for the current user and an entry for
583user @file{nobody};
584
585@item
586@file{/etc/group} with an entry for the user's group;
587
588@item
589@file{/etc/hosts} with an entry that maps @code{localhost} to
590@code{127.0.0.1};
591
592@item
593a writable @file{/tmp} directory.
594@end itemize
b095792f 595
1e2644bb
LC
596If you are installing Guix as an unprivileged user, it is still possible
597to run @command{guix-daemon} provided you pass @code{--disable-chroot}.
598However, build processes will not be isolated from one another, and not
599from the rest of the system. Thus, build processes may interfere with
600each other, and may access programs, libraries, and other files
601available on the system---making it much harder to view them as
602@emph{pure} functions.
bd5e766b 603
49e6291a
LC
604
605@node Daemon Offload Setup
606@subsection Using the Offload Facility
607
608@cindex offloading
4ec2e92d
LC
609@cindex build hook
610When desired, the build daemon can @dfn{offload}
611derivation builds to other machines
49e6291a
LC
612running Guix, using the @code{offload} @dfn{build hook}. When that
613feature is enabled, a list of user-specified build machines is read from
614@file{/etc/guix/machines.scm}; anytime a build is requested, for
615instance via @code{guix build}, the daemon attempts to offload it to one
616of the machines that satisfies the derivation's constraints, in
617particular its system type---e.g., @file{x86_64-linux}. Missing
618prerequisites for the build are copied over SSH to the target machine,
619which then proceeds with the build; upon success the output(s) of the
620build are copied back to the initial machine.
621
4ec2e92d 622The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
623
624@example
625(list (build-machine
626 (name "eightysix.example.org")
627 (system "x86_64-linux")
628 (user "bob")
629 (speed 2.)) ; incredibly fast!
630
631 (build-machine
632 (name "meeps.example.org")
633 (system "mips64el-linux")
634 (user "alice")
635 (private-key
636 (string-append (getenv "HOME")
c4fdfd6f 637 "/.lsh/identity-for-guix"))))
49e6291a
LC
638@end example
639
640@noindent
641In the example above we specify a list of two build machines, one for
642the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
643architecture.
644
645In fact, this file is---not surprisingly!---a Scheme file that is
646evaluated when the @code{offload} hook is started. Its return value
647must be a list of @code{build-machine} objects. While this example
648shows a fixed list of build machines, one could imagine, say, using
649DNS-SD to return a list of potential build machines discovered in the
650local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
651Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
652detailed below.
4ec2e92d 653
c678a4ee
LC
654@deftp {Data Type} build-machine
655This data type represents build machines the daemon may offload builds
656to. The important fields are:
49e6291a
LC
657
658@table @code
659
660@item name
661The remote machine's host name.
662
663@item system
c678a4ee 664The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
665
666@item user
667The user account to use when connecting to the remote machine over SSH.
668Note that the SSH key pair must @emph{not} be passphrase-protected, to
669allow non-interactive logins.
670
671@end table
672
4ec2e92d 673A number of optional fields may be specified:
49e6291a
LC
674
675@table @code
676
cecd72d5
LC
677@item port
678Port number of the machine's SSH server (default: 22).
679
49e6291a
LC
680@item private-key
681The SSH private key file to use when connecting to the machine.
682
c4fdfd6f
LC
683Currently offloading uses GNU@tie{}lsh as its SSH client
684(@pxref{Invoking lsh,,, GNU lsh Manual}). Thus, the key file here must
685be an lsh key file. This may change in the future, though.
686
49e6291a
LC
687@item parallel-builds
688The number of builds that may run in parallel on the machine (1 by
689default.)
690
691@item speed
692A ``relative speed factor''. The offload scheduler will tend to prefer
693machines with a higher speed factor.
694
695@item features
696A list of strings denoting specific features supported by the machine.
697An example is @code{"kvm"} for machines that have the KVM Linux modules
698and corresponding hardware support. Derivations can request features by
699name, and they will be scheduled on matching build machines.
700
701@end table
c678a4ee 702@end deftp
49e6291a
LC
703
704The @code{guix} command must be in the search path on the build
705machines, since offloading works by invoking the @code{guix archive} and
c4fdfd6f
LC
706@code{guix build} commands. In addition, the Guix modules must be in
707@code{$GUILE_LOAD_PATH} on the build machine---you can check whether
708this is the case by running:
709
710@example
711lsh build-machine guile -c '(use-modules (guix config))'
712@end example
49e6291a
LC
713
714There's one last thing to do once @file{machines.scm} is in place. As
715explained above, when offloading, files are transferred back and forth
c4fdfd6f
LC
716between the machine stores. For this to work, you first need to
717generate a key pair on each machine to allow the daemon to export signed
718archives of files from the store (@pxref{Invoking guix archive}):
49e6291a
LC
719
720@example
721# guix archive --generate-key
722@end example
723
724@noindent
c4fdfd6f
LC
725Each build machine must authorize the key of the master machine so that
726it accepts store items it receives from the master:
727
728@example
729# guix archive --authorize < master-public-key.txt
730@end example
731
732@noindent
733Likewise, the master machine must authorize the key of each build machine.
734
735All the fuss with keys is here to express pairwise mutual trust
736relations between the master and the build machines. Concretely, when
737the master receives files from a build machine (and @i{vice versa}), its
738build daemon can make sure they are genuine, have not been tampered
739with, and that they are signed by an authorized key.
49e6291a
LC
740
741
bd5e766b
LC
742@node Invoking guix-daemon
743@section Invoking @command{guix-daemon}
744
745The @command{guix-daemon} program implements all the functionality to
746access the store. This includes launching build processes, running the
747garbage collector, querying the availability of a build result, etc. It
748is normally run as @code{root} like this:
749
750@example
cfc149dc 751# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
752@end example
753
754@noindent
081145cf 755For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 756
e900c503
LC
757@cindex chroot
758@cindex container, build environment
759@cindex build environment
760@cindex reproducible builds
bd5e766b
LC
761By default, @command{guix-daemon} launches build processes under
762different UIDs, taken from the build group specified with
763@code{--build-users-group}. In addition, each build process is run in a
764chroot environment that only contains the subset of the store that the
765build process depends on, as specified by its derivation
766(@pxref{Programming Interface, derivation}), plus a set of specific
767system directories. By default, the latter contains @file{/dev} and
e900c503
LC
768@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
769@dfn{container}: in addition to having its own file system tree, it has
770a separate mount name space, its own PID name space, network name space,
771etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b 772
cbc538fe
LC
773When the daemon performs a build on behalf of the user, it creates a
774build directory under @file{/tmp} or under the directory specified by
775its @code{TMPDIR} environment variable; this directory is shared with
776the container for the duration of the build. Be aware that using a
777directory other than @file{/tmp} can affect build results---for example,
778with a longer directory name, a build process that uses Unix-domain
779sockets might hit the name length limitation for @code{sun_path}, which
780it would otherwise not hit.
781
782The build directory is automatically deleted upon completion, unless the
783build failed and the client specified @option{--keep-failed}
784(@pxref{Invoking guix build, @option{--keep-failed}}).
785
bd5e766b
LC
786The following command-line options are supported:
787
788@table @code
789@item --build-users-group=@var{group}
790Take users from @var{group} to run build processes (@pxref{Setting Up
791the Daemon, build users}).
792
6858f9d1 793@item --no-substitutes
b5385b52 794@cindex substitutes
6858f9d1 795Do not use substitutes for build products. That is, always build things
c4202d60
LC
796locally instead of allowing downloads of pre-built binaries
797(@pxref{Substitutes}).
6858f9d1 798
b5385b52
LC
799By default substitutes are used, unless the client---such as the
800@command{guix package} command---is explicitly invoked with
801@code{--no-substitutes}.
802
803When the daemon runs with @code{--no-substitutes}, clients can still
804explicitly enable substitution @i{via} the @code{set-build-options}
805remote procedure call (@pxref{The Store}).
806
9176607e 807@item --substitute-urls=@var{urls}
f8a8e0fe 808@anchor{daemon-substitute-urls}
9176607e 809Consider @var{urls} the default whitespace-separated list of substitute
ae806096 810source URLs. When this option is omitted, @indicateurl{http://hydra.gnu.org}
9176607e
LC
811is used.
812
813This means that substitutes may be downloaded from @var{urls}, as long
814as they are signed by a trusted signature (@pxref{Substitutes}).
815
4ec2e92d
LC
816@cindex build hook
817@item --no-build-hook
818Do not use the @dfn{build hook}.
819
820The build hook is a helper program that the daemon can start and to
821which it submits build requests. This mechanism is used to offload
822builds to other machines (@pxref{Daemon Offload Setup}).
823
bd5e766b
LC
824@item --cache-failures
825Cache build failures. By default, only successful builds are cached.
826
30d9aa54
LC
827When this option is used, @command{guix gc --list-failures} can be used
828to query the set of store items marked as failed; @command{guix gc
829--clear-failures} removes store items from the set of cached failures.
830@xref{Invoking guix gc}.
831
bd5e766b
LC
832@item --cores=@var{n}
833@itemx -c @var{n}
834Use @var{n} CPU cores to build each derivation; @code{0} means as many
835as available.
836
6efc160e 837The default value is @code{0}, but it may be overridden by clients, such
e49951eb
MW
838as the @code{--cores} option of @command{guix build} (@pxref{Invoking
839guix build}).
bd5e766b
LC
840
841The effect is to define the @code{NIX_BUILD_CORES} environment variable
842in the build process, which can then use it to exploit internal
843parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
844
845@item --max-jobs=@var{n}
846@itemx -M @var{n}
847Allow at most @var{n} build jobs in parallel. The default value is
f6526eb3
LC
848@code{1}. Setting it to @code{0} means that no builds will be performed
849locally; instead, the daemon will offload builds (@pxref{Daemon Offload
850Setup}), or simply fail.
bd5e766b
LC
851
852@item --debug
853Produce debugging output.
854
855This is useful to debug daemon start-up issues, but then it may be
856overridden by clients, for example the @code{--verbosity} option of
e49951eb 857@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
858
859@item --chroot-directory=@var{dir}
860Add @var{dir} to the build chroot.
861
862Doing this may change the result of build processes---for instance if
863they use optional dependencies found in @var{dir} when it is available,
864and not otherwise. For that reason, it is not recommended to do so.
865Instead, make sure that each derivation declares all the inputs that it
866needs.
867
868@item --disable-chroot
869Disable chroot builds.
870
871Using this option is not recommended since, again, it would allow build
1e2644bb
LC
872processes to gain access to undeclared dependencies. It is necessary,
873though, when @command{guix-daemon} is running under an unprivileged user
874account.
bd5e766b
LC
875
876@item --disable-log-compression
877Disable compression of the build logs.
878
1da983b9
LC
879Unless @code{--lose-logs} is used, all the build logs are kept in the
880@var{localstatedir}. To save space, the daemon automatically compresses
881them with bzip2 by default. This option disables that.
882
ab3893d7
LC
883@item --disable-deduplication
884@cindex deduplication
bd5e766b
LC
885Disable automatic file ``deduplication'' in the store.
886
1da983b9 887By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
888if a newly added file is identical to another one found in the store,
889the daemon makes the new file a hard link to the other file. This can
4988dd40 890noticeably reduce disk usage, at the expense of slightly increased
ab3893d7
LC
891input/output load at the end of a build process. This option disables
892this optimization.
1da983b9 893
6e37066e
LC
894@item --gc-keep-outputs[=yes|no]
895Tell whether the garbage collector (GC) must keep outputs of live
896derivations.
897
898When set to ``yes'', the GC will keep the outputs of any live derivation
899available in the store---the @code{.drv} files. The default is ``no'',
900meaning that derivation outputs are kept only if they are GC roots.
901
902@item --gc-keep-derivations[=yes|no]
903Tell whether the garbage collector (GC) must keep derivations
904corresponding to live outputs.
905
906When set to ``yes'', as is the case by default, the GC keeps
907derivations---i.e., @code{.drv} files---as long as at least one of their
908outputs is live. This allows users to keep track of the origins of
909items in their store. Setting it to ``no'' saves a bit of disk space.
910
911Note that when both @code{--gc-keep-derivations} and
912@code{--gc-keep-outputs} are used, the effect is to keep all the build
913prerequisites (the sources, compiler, libraries, and other build-time
914tools) of live objects in the store, regardless of whether these
915prerequisites are live. This is convenient for developers since it
916saves rebuilds or downloads.
917
bd5e766b
LC
918@item --impersonate-linux-2.6
919On Linux-based systems, impersonate Linux 2.6. This means that the
920kernel's @code{uname} system call will report 2.6 as the release number.
921
922This might be helpful to build programs that (usually wrongfully) depend
923on the kernel version number.
924
925@item --lose-logs
926Do not keep build logs. By default they are kept under
ce33631f 927@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
928
929@item --system=@var{system}
930Assume @var{system} as the current system type. By default it is the
931architecture/kernel pair found at configure time, such as
932@code{x86_64-linux}.
b8d2aa26
LC
933
934@item --listen=@var{socket}
935Listen for connections on @var{socket}, the file name of a Unix-domain
936socket. The default socket is
937@file{@var{localstatedir}/daemon-socket/socket}. This option is only
938useful in exceptional circumstances, such as if you need to run several
939daemons on the same machine.
bd5e766b
LC
940@end table
941
942
0e2d0213
LC
943@node Application Setup
944@section Application Setup
945
85e57214
LC
946When using Guix on top of GNU/Linux distribution other than GuixSD---a
947so-called @dfn{foreign distro}---a few additional steps are needed to
948get everything in place. Here are some of them.
0e2d0213
LC
949
950@subsection Locales
951
5c3c1427 952@anchor{locales-and-locpath}
0e2d0213 953@cindex locales, when not on GuixSD
5c3c1427 954@vindex LOCPATH
85e57214 955@vindex GUIX_LOCPATH
0e2d0213
LC
956Packages installed @i{via} Guix will not use the host system's locale
957data. Instead, you must first install one of the locale packages
85e57214
LC
958available with Guix and then define the @code{GUIX_LOCPATH} environment
959variable:
0e2d0213
LC
960
961@example
962$ guix package -i glibc-locales
85e57214 963$ export GUIX_LOCPATH=$HOME/.guix-profile/lib/locale
0e2d0213
LC
964@end example
965
966Note that the @code{glibc-locales} package contains data for all the
967locales supported by the GNU@tie{}libc and weighs in at around
968110@tie{}MiB. Alternately, the @code{glibc-utf8-locales} is smaller but
969limited to a few UTF-8 locales.
970
85e57214
LC
971The @code{GUIX_LOCPATH} variable plays a role similar to @code{LOCPATH}
972(@pxref{Locale Names, @code{LOCPATH},, libc, The GNU C Library Reference
973Manual}). There are two important differences though:
974
975@enumerate
976@item
977@code{GUIX_LOCPATH} is honored only by Guix's libc, and not by the libc
978provided by foreign distros. Thus, using @code{GUIX_LOCPATH} allows you
979to make sure the the foreign distro's programs will not end up loading
980incompatible locale data.
981
982@item
983libc suffixes each entry of @code{GUIX_LOCPATH} with @code{/X.Y}, where
984@code{X.Y} is the libc version---e.g., @code{2.22}. This means that,
985should your Guix profile contain a mixture of programs linked against
986different libc version, each libc version will only try to load locale
987data in the right format.
988@end enumerate
989
990This is important because the locale data format used by different libc
991versions may be incompatible.
992
0e2d0213
LC
993@subsection X11 Fonts
994
4988dd40 995The majority of graphical applications use Fontconfig to locate and
0e2d0213
LC
996load fonts and perform X11-client-side rendering. Guix's
997@code{fontconfig} package looks for fonts in @file{$HOME/.guix-profile}
998by default. Thus, to allow graphical applications installed with Guix
999to display fonts, you will have to install fonts with Guix as well.
1000Essential font packages include @code{gs-fonts}, @code{font-dejavu}, and
8fe5b1d1 1001@code{font-gnu-freefont-ttf}.
0e2d0213 1002
5c36edc8
LC
1003To display text written in Chinese languages, Japanese, or Korean in
1004graphical applications, consider installing
1005@code{font-adobe-source-han-sans} or @code{font-wqy-zenhei}. The former
1006has multiple outputs, one per language family (@pxref{Packages with
1007Multiple Outputs}). For instance, the following command installs fonts
1008for Chinese languages:
1009
1010@example
1011guix package -i font-adobe-source-han-sans:cn
1012@end example
1013
0e2d0213
LC
1014@c TODO What else?
1015
eeaf4427
LC
1016@c *********************************************************************
1017@node Package Management
1018@chapter Package Management
1019
f8348b91 1020The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
1021remove software packages, without having to know about their build
1022procedure or dependencies. Guix also goes beyond this obvious set of
1023features.
1024
1025This chapter describes the main features of Guix, as well as the package
c1941588 1026management tools it provides. Two user interfaces are provided for
c554de89
AK
1027routine package management tasks: A command-line interface described below
1028(@pxref{Invoking guix package, @code{guix package}}), as well as a visual user
1029interface in Emacs described in a subsequent chapter (@pxref{Emacs Interface}).
eeaf4427
LC
1030
1031@menu
1032* Features:: How Guix will make your life brighter.
e49951eb 1033* Invoking guix package:: Package installation, removal, etc.
c4202d60 1034* Substitutes:: Downloading pre-built binaries.
760c60d6 1035* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 1036* Invoking guix gc:: Running the garbage collector.
f651b477 1037* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 1038* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
1039@end menu
1040
1041@node Features
1042@section Features
1043
1044When using Guix, each package ends up in the @dfn{package store}, in its
1045own directory---something that resembles
9a130e19
AK
1046@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
1047(note that Guix comes with an Emacs extension to shorten those file
081145cf 1048names, @pxref{Emacs Prettify}.)
eeaf4427
LC
1049
1050Instead of referring to these directories, users have their own
1051@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
1052use. These profiles are stored within each user's home directory, at
1053@code{$HOME/.guix-profile}.
eeaf4427 1054
821b0015 1055For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 1056@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 1057@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
1058@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
1059simply continues to point to
834129e0 1060@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 1061coexist on the same system without any interference.
eeaf4427 1062
e49951eb
MW
1063The @command{guix package} command is the central tool to manage
1064packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 1065profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
1066
1067The command provides the obvious install, remove, and upgrade
1068operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 1069the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 1070@command{guix package} process is terminated during the transaction,
eeaf4427
LC
1071or if a power outage occurs during the transaction, then the user's
1072profile remains in its previous state, and remains usable.
1073
1074In addition, any package transaction may be @emph{rolled back}. So, if,
1075for example, an upgrade installs a new version of a package that turns
1076out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
1077of their profile, which was known to work well. Similarly, the global
1078system configuration is subject to transactional upgrades and roll-back
1079(@pxref{Using the Configuration System}).
eeaf4427
LC
1080
1081All those packages in the package store may be @emph{garbage-collected}.
1082Guix can determine which packages are still referenced by the user
fe8ff028 1083profiles, and remove those that are provably no longer referenced
e49951eb 1084(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
1085generations of their profile so that the packages they refer to can be
1086collected.
eeaf4427 1087
e900c503
LC
1088@cindex reproducibility
1089@cindex reproducible builds
eeaf4427
LC
1090Finally, Guix takes a @dfn{purely functional} approach to package
1091management, as described in the introduction (@pxref{Introduction}).
834129e0 1092Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
1093inputs that were used to build that package---compiler, libraries, build
1094scripts, etc. This direct correspondence allows users to make sure a
1095given package installation matches the current state of their
e900c503
LC
1096distribution. It also helps maximize @dfn{build reproducibility}:
1097thanks to the isolated build environments that are used, a given build
1098is likely to yield bit-identical files when performed on different
1099machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 1100
c4202d60 1101@cindex substitutes
eeaf4427 1102This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 1103deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 1104available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
1105downloads it and unpacks it;
1106otherwise, it builds the package from source, locally
1107(@pxref{Substitutes}).
eeaf4427 1108
f5fd4fd2
LC
1109Control over the build environment is a feature that is also useful for
1110developers. The @command{guix environment} command allows developers of
1111a package to quickly set up the right development environment for their
1112package, without having to manually install the package's dependencies
1113in their profile (@pxref{Invoking guix environment}).
1114
e49951eb
MW
1115@node Invoking guix package
1116@section Invoking @command{guix package}
eeaf4427 1117
e49951eb 1118The @command{guix package} command is the tool that allows users to
eeaf4427
LC
1119install, upgrade, and remove packages, as well as rolling back to
1120previous configurations. It operates only on the user's own profile,
1121and works with normal user privileges (@pxref{Features}). Its syntax
1122is:
1123
1124@example
e49951eb 1125guix package @var{options}
eeaf4427
LC
1126@end example
1127
ba55b1cb 1128Primarily, @var{options} specifies the operations to be performed during
eeaf4427 1129the transaction. Upon completion, a new profile is created, but
99bd74d5 1130previous @dfn{generations} of the profile remain available, should the user
eeaf4427
LC
1131want to roll back.
1132
6447738c
MW
1133For example, to remove @code{lua} and install @code{guile} and
1134@code{guile-cairo} in a single transaction:
1135
1136@example
1137guix package -r lua -i guile guile-cairo
1138@end example
1139
99bd74d5
LC
1140@command{guix package} also supports a @dfn{declarative approach}
1141whereby the user specifies the exact set of packages to be available and
1142passes it @i{via} the @option{--manifest} option
1143(@pxref{profile-manifest, @option{--manifest}}).
1144
b9e5c0a9 1145For each user, a symlink to the user's default profile is automatically
0ec1af59 1146created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
1147current generation of the user's default profile. Thus, users can add
1148@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
1149variable, and so on.
d664f1b4
LC
1150@cindex search paths
1151If you are not using the Guix System Distribution, consider adding the
1152following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
1153Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
1154shells get all the right environment variable definitions:
1155
1156@example
1157GUIX_PROFILE="$HOME/.guix-profile" \
1158source "$HOME/.guix-profile/etc/profile"
1159@end example
b9e5c0a9 1160
4379c35b
LC
1161In a multi-user setup, user profiles are stored in a place registered as
1162a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
1163to (@pxref{Invoking guix gc}). That directory is normally
0ec1af59
LC
1164@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
1165@var{localstatedir} is the value passed to @code{configure} as
4379c35b
LC
1166@code{--localstatedir}, and @var{user} is the user name. The
1167@file{per-user} directory is created when @command{guix-daemon} is
1168started, and the @var{user} sub-directory is created by @command{guix
1169package}.
0ec1af59
LC
1170
1171The @var{options} can be among the following:
1172
eeaf4427
LC
1173@table @code
1174
6447738c
MW
1175@item --install=@var{package} @dots{}
1176@itemx -i @var{package} @dots{}
1177Install the specified @var{package}s.
eeaf4427 1178
6447738c 1179Each @var{package} may specify either a simple package name, such as
eeaf4427 1180@code{guile}, or a package name followed by a hyphen and version number,
724311a2
LC
1181such as @code{guile-1.8.8} or simply @code{guile-1.8} (in the latter
1182case, the newest version prefixed by @code{1.8} is selected.)
1183
1184If no version number is specified, the
dc5669cd
MW
1185newest available version will be selected. In addition, @var{package}
1186may contain a colon, followed by the name of one of the outputs of the
6e721c4d 1187package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
1188(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
1189name (and optionally version) are searched for among the GNU
1190distribution modules (@pxref{Package Modules}).
eeaf4427 1191
461572cc
LC
1192@cindex propagated inputs
1193Sometimes packages have @dfn{propagated inputs}: these are dependencies
21461f27
LC
1194that automatically get installed along with the required package
1195(@pxref{package-propagated-inputs, @code{propagated-inputs} in
1196@code{package} objects}, for information about propagated inputs in
1197package definitions).
461572cc 1198
21461f27 1199@anchor{package-cmd-propagated-inputs}
461572cc
LC
1200An example is the GNU MPC library: its C header files refer to those of
1201the GNU MPFR library, which in turn refer to those of the GMP library.
1202Thus, when installing MPC, the MPFR and GMP libraries also get installed
1203in the profile; removing MPC also removes MPFR and GMP---unless they had
1204also been explicitly installed independently.
1205
ba7ea5ce 1206Besides, packages sometimes rely on the definition of environment
5924080d 1207variables for their search paths (see explanation of
ba7ea5ce 1208@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
1209environment variable definitions are reported here.
1210
ef010c0f 1211@c XXX: keep me up-to-date
5924080d 1212Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
1213availability of a newer upstream version. In the future, it may provide
1214the option of installing directly from the upstream version, even if
1215that version is not yet in the distribution.
1216
5d4b411f
LC
1217@item --install-from-expression=@var{exp}
1218@itemx -e @var{exp}
1219Install the package @var{exp} evaluates to.
1220
1221@var{exp} must be a Scheme expression that evaluates to a
1222@code{<package>} object. This option is notably useful to disambiguate
1223between same-named variants of a package, with expressions such as
1224@code{(@@ (gnu packages base) guile-final)}.
1225
1226Note that this option installs the first output of the specified
1227package, which may be insufficient when needing a specific output of a
1228multiple-output package.
1229
0d279400
DT
1230@item --install-from-file=@var{file}
1231@itemx -f @var{file}
1232Install the package that the code within @var{file} evaluates to.
1233
1234As an example, @var{file} might contain a definition like this
1235(@pxref{Defining Packages}):
1236
1237@example
1238@verbatiminclude package-hello.scm
1239@end example
1240
1241Developers may find it useful to include such a @file{package.scm} file
1242in the root of their project's source tree that can be used to test
1243development snapshots and create reproducible development environments
1244(@pxref{Invoking guix environment}).
1245
6447738c
MW
1246@item --remove=@var{package} @dots{}
1247@itemx -r @var{package} @dots{}
1248Remove the specified @var{package}s.
eeaf4427 1249
6447738c 1250As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
1251and/or output name in addition to the package name. For instance,
1252@code{-r glibc:debug} would remove the @code{debug} output of
1253@code{glibc}.
1254
6447738c
MW
1255@item --upgrade[=@var{regexp} @dots{}]
1256@itemx -u [@var{regexp} @dots{}]
1257Upgrade all the installed packages. If one or more @var{regexp}s are
1258specified, upgrade only installed packages whose name matches a
d5f01e48 1259@var{regexp}. Also see the @code{--do-not-upgrade} option below.
eeaf4427 1260
f651b477
LC
1261Note that this upgrades package to the latest version of packages found
1262in the distribution currently installed. To update your distribution,
1263you should regularly run @command{guix pull} (@pxref{Invoking guix
1264pull}).
1265
d5f01e48
MW
1266@item --do-not-upgrade[=@var{regexp} @dots{}]
1267When used together with the @code{--upgrade} option, do @emph{not}
1268upgrade any packages whose name matches a @var{regexp}. For example, to
1269upgrade all packages in the current profile except those containing the
1270substring ``emacs'':
1271
1272@example
1273$ guix package --upgrade . --do-not-upgrade emacs
1274@end example
1275
99bd74d5 1276@item @anchor{profile-manifest}--manifest=@var{file}
1b676447 1277@itemx -m @var{file}
99bd74d5
LC
1278@cindex profile declaration
1279@cindex profile manifest
1280Create a new generation of the profile from the manifest object
1b676447
DT
1281returned by the Scheme code in @var{file}.
1282
99bd74d5
LC
1283This allows you to @emph{declare} the profile's contents rather than
1284constructing it through a sequence of @code{--install} and similar
1285commands. The advantage is that @var{file} can be put under version
1286control, copied to different machines to reproduce the same profile, and
1287so on.
1288
1289@c FIXME: Add reference to (guix profile) documentation when available.
1290@var{file} must return a @dfn{manifest} object, which is roughly a list
1291of packages:
1b676447 1292
99bd74d5 1293@findex packages->manifest
1b676447 1294@example
99bd74d5 1295(use-package-modules guile emacs)
1b676447
DT
1296
1297(packages->manifest
99bd74d5
LC
1298 (list emacs
1299 guile-2.0
1b676447 1300 ;; Use a specific package output.
99bd74d5 1301 (list guile-2.0 "debug")))
1b676447
DT
1302@end example
1303
24e262f0
LC
1304@item --roll-back
1305Roll back to the previous @dfn{generation} of the profile---i.e., undo
1306the last transaction.
1307
1308When combined with options such as @code{--install}, roll back occurs
1309before any other actions.
1310
d9307267 1311When rolling back from the first generation that actually contains
4b2bc804
NK
1312installed packages, the profile is made to point to the @dfn{zeroth
1313generation}, which contains no files apart from its own meta-data.
d9307267 1314
82fe08ed
LC
1315Installing, removing, or upgrading packages from a generation that has
1316been rolled back to overwrites previous future generations. Thus, the
1317history of a profile's generations is always linear.
1318
b3bb82f1
AK
1319@item --switch-generation=@var{pattern}
1320@itemx -S @var{pattern}
1321Switch to a particular generation defined by @var{pattern}.
1322
1323@var{pattern} may be either a generation number or a number prefixed
1324with ``+'' or ``-''. The latter means: move forward/backward by a
1325specified number of generations. For example, if you want to return to
1326the latest generation after @code{--roll-back}, use
1327@code{--switch-generation=+1}.
1328
1329The difference between @code{--roll-back} and
1330@code{--switch-generation=-1} is that @code{--switch-generation} will
1331not make a zeroth generation, so if a specified generation does not
1332exist, the current generation will not be changed.
1333
dbc31ab2 1334@item --search-paths[=@var{kind}]
5924080d
LC
1335@cindex search paths
1336Report environment variable definitions, in Bash syntax, that may be
1337needed in order to use the set of installed packages. These environment
1338variables are used to specify @dfn{search paths} for files used by some
1339of the installed packages.
1340
1341For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1342environment variables to be defined so it can look for headers and
1343libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1344Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1345library are installed in the profile, then @code{--search-paths} will
1346suggest setting these variables to @code{@var{profile}/include} and
1347@code{@var{profile}/lib}, respectively.
1348
dbc31ab2
LC
1349The typical use case is to define these environment variables in the
1350shell:
1351
1352@example
1353$ eval `guix package --search-paths`
1354@end example
1355
1356@var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1357meaning that the returned environment variable definitions will either
1358be exact settings, or prefixes or suffixes of the current value of these
1359variables. When omitted, @var{kind} defaults to @code{exact}.
1360
fc2d2339
LC
1361This option can also be used to compute the @emph{combined} search paths
1362of several profiles. Consider this example:
1363
1364@example
1365$ guix package -p foo -i guile
1366$ guix package -p bar -i guile-json
1367$ guix package -p foo -p bar --search-paths
1368@end example
1369
1370The last command above reports about the @code{GUILE_LOAD_PATH}
1371variable, even though, taken individually, neither @file{foo} nor
1372@file{bar} would lead to that recommendation.
1373
1374
eeaf4427
LC
1375@item --profile=@var{profile}
1376@itemx -p @var{profile}
1377Use @var{profile} instead of the user's default profile.
1378
70915c1a
LC
1379@item --verbose
1380Produce verbose output. In particular, emit the environment's build log
1381on the standard error port.
1382
eeaf4427
LC
1383@item --bootstrap
1384Use the bootstrap Guile to build the profile. This option is only
1385useful to distribution developers.
1386
1387@end table
1388
e49951eb 1389In addition to these actions @command{guix package} supports the
733b4130
LC
1390following options to query the current state of a profile, or the
1391availability of packages:
eeaf4427 1392
733b4130
LC
1393@table @option
1394
acc08466
NK
1395@item --search=@var{regexp}
1396@itemx -s @var{regexp}
5763ad92 1397List the available packages whose name, synopsis, or description matches
299112d3
LC
1398@var{regexp}. Print all the meta-data of matching packages in
1399@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1400GNU recutils manual}).
acc08466 1401
299112d3
LC
1402This allows specific fields to be extracted using the @command{recsel}
1403command, for instance:
1404
1405@example
e49951eb 1406$ guix package -s malloc | recsel -p name,version
299112d3
LC
1407name: glibc
1408version: 2.17
1409
1410name: libgc
1411version: 7.2alpha6
1412@end example
acc08466 1413
a12d92f5
LC
1414Similarly, to show the name of all the packages available under the
1415terms of the GNU@tie{}LGPL version 3:
1416
1417@example
1418$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1419name: elfutils
1420
1421name: gmp
1422@dots{}
1423@end example
1424
2aa6efb0
CR
1425@item --show=@var{package}
1426Show details about @var{package}, taken from the list of available packages, in
1427@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1428recutils manual}).
1429
1430@example
1431$ guix package --show=python | recsel -p name,version
1432name: python
1433version: 2.7.6
1434
1435name: python
1436version: 3.3.5
1437@end example
1438
1439You may also specify the full name of a package to only get details about a
1440specific version of it:
1441@example
1442$ guix package --show=python-3.3.5 | recsel -p name,version
1443name: python
1444version: 3.3.5
1445@end example
1446
1447
1448
733b4130
LC
1449@item --list-installed[=@var{regexp}]
1450@itemx -I [@var{regexp}]
bd9bde1c
LC
1451List the currently installed packages in the specified profile, with the
1452most recently installed packages shown last. When @var{regexp} is
1453specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
1454
1455For each installed package, print the following items, separated by
1456tabs: the package name, its version string, the part of the package that
1457is installed (for instance, @code{out} for the default output,
1458@code{include} for its headers, etc.), and the path of this package in
1459the store.
1460
64fc89b6
LC
1461@item --list-available[=@var{regexp}]
1462@itemx -A [@var{regexp}]
5763ad92 1463List packages currently available in the distribution for this system
a1ba8475
LC
1464(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1465installed packages whose name matches @var{regexp}.
64fc89b6
LC
1466
1467For each package, print the following items separated by tabs: its name,
6e721c4d
LC
1468its version string, the parts of the package (@pxref{Packages with
1469Multiple Outputs}), and the source location of its definition.
64fc89b6 1470
f566d765
LC
1471@item --list-generations[=@var{pattern}]
1472@itemx -l [@var{pattern}]
1473Return a list of generations along with their creation dates; for each
1474generation, show the installed packages, with the most recently
4b2bc804
NK
1475installed packages shown last. Note that the zeroth generation is never
1476shown.
f566d765
LC
1477
1478For each installed package, print the following items, separated by
1479tabs: the name of a package, its version string, the part of the package
1480that is installed (@pxref{Packages with Multiple Outputs}), and the
1481location of this package in the store.
1482
1483When @var{pattern} is used, the command returns only matching
1484generations. Valid patterns include:
1485
1486@itemize
1487@item @emph{Integers and comma-separated integers}. Both patterns denote
1488generation numbers. For instance, @code{--list-generations=1} returns
1489the first one.
1490
1491And @code{--list-generations=1,8,2} outputs three generations in the
1492specified order. Neither spaces nor trailing commas are allowed.
1493
1494@item @emph{Ranges}. @code{--list-generations=2..9} prints the
1495specified generations and everything in between. Note that the start of
1496a range must be lesser than its end.
1497
1498It is also possible to omit the endpoint. For example,
1499@code{--list-generations=2..}, returns all generations starting from the
1500second one.
1501
1502@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1503or months by passing an integer along with the first letter of the
d7ddb257
LC
1504duration. For example, @code{--list-generations=20d} lists generations
1505that are up to 20 days old.
f566d765
LC
1506@end itemize
1507
b7884ca3
NK
1508@item --delete-generations[=@var{pattern}]
1509@itemx -d [@var{pattern}]
d7ddb257
LC
1510When @var{pattern} is omitted, delete all generations except the current
1511one.
b7884ca3
NK
1512
1513This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1514When @var{pattern} is specified, delete the matching generations. When
1515@var{pattern} specifies a duration, generations @emph{older} than the
1516specified duration match. For instance, @code{--delete-generations=1m}
1517deletes generations that are more than one month old.
1518
391bdd8f
LC
1519If the current generation matches, it is @emph{not} deleted. Also, the
1520zeroth generation is never deleted.
b7884ca3 1521
1bb9900a
LC
1522Note that deleting generations prevents roll-back to them.
1523Consequently, this command must be used with care.
1524
733b4130 1525@end table
eeaf4427 1526
70ee5642
LC
1527Finally, since @command{guix package} may actually start build
1528processes, it supports all the common build options that @command{guix
1529build} supports (@pxref{Invoking guix build, common build options}).
1530
c4202d60
LC
1531@node Substitutes
1532@section Substitutes
1533
1534@cindex substitutes
1535@cindex pre-built binaries
1536Guix supports transparent source/binary deployment, which means that it
1537can either build things locally, or download pre-built items from a
1538server. We call these pre-built items @dfn{substitutes}---they are
1539substitutes for local build results. In many cases, downloading a
1540substitute is much faster than building things locally.
1541
1542Substitutes can be anything resulting from a derivation build
1543(@pxref{Derivations}). Of course, in the common case, they are
1544pre-built package binaries, but source tarballs, for instance, which
1545also result from derivation builds, can be available as substitutes.
1546
1547The @code{hydra.gnu.org} server is a front-end to a build farm that
1548builds packages from the GNU distribution continuously for some
9176607e 1549architectures, and makes them available as substitutes. This is the
f8a8e0fe
LC
1550default source of substitutes; it can be overridden by passing the
1551@option{--substitute-urls} option either to @command{guix-daemon}
1552(@pxref{daemon-substitute-urls,, @code{guix-daemon --substitute-urls}})
1553or to client tools such as @command{guix package}
1554(@pxref{client-substitute-urls,, client @option{--substitute-urls}
1555option}).
c4202d60
LC
1556
1557@cindex security
1558@cindex digital signatures
1559To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1560must add its public key to the access control list (ACL) of archive
1561imports, using the @command{guix archive} command (@pxref{Invoking guix
1562archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1563be compromised and to serve genuine substitutes.
1564
1565This public key is installed along with Guix, in
1566@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1567the installation prefix of Guix. If you installed Guix from source,
1568make sure you checked the GPG signature of
1569@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1570Then, you can run something like this:
1571
1572@example
1573# guix archive --authorize < hydra.gnu.org.pub
1574@end example
1575
1576Once this is in place, the output of a command like @code{guix build}
1577should change from something like:
1578
1579@example
1580$ guix build emacs --dry-run
1581The following derivations would be built:
1582 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1583 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1584 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1585 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1586@dots{}
1587@end example
1588
1589@noindent
1590to something like:
1591
1592@example
1593$ guix build emacs --dry-run
1594The following files would be downloaded:
1595 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1596 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1597 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1598 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1599@dots{}
1600@end example
1601
1602@noindent
1603This indicates that substitutes from @code{hydra.gnu.org} are usable and
1604will be downloaded, when possible, for future builds.
1605
1606Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1607one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1608when attempting to use a substitute that has been tampered with.
1609
1610The substitute mechanism can be disabled globally by running
1611@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1612guix-daemon}). It can also be disabled temporarily by passing the
1613@code{--no-substitutes} option to @command{guix package}, @command{guix
1614build}, and other command-line tools.
1615
1616
1617Today, each individual's control over their own computing is at the
1618mercy of institutions, corporations, and groups with enough power and
1619determination to subvert the computing infrastructure and exploit its
1620weaknesses. While using @code{hydra.gnu.org} substitutes can be
1621convenient, we encourage users to also build on their own, or even run
1622their own build farm, such that @code{hydra.gnu.org} is less of an
8ce229fc
LC
1623interesting target. One way to help is by publishing the software you
1624build using @command{guix publish} so that others have one more choice
1625of server to download substitutes from (@pxref{Invoking guix publish}).
c4202d60
LC
1626
1627Guix has the foundations to maximize build reproducibility
1628(@pxref{Features}). In most cases, independent builds of a given
1629package or derivation should yield bit-identical results. Thus, through
1630a diverse set of independent package builds, we can strengthen the
d23c20f1
LC
1631integrity of our systems. The @command{guix challenge} command aims to
1632help users assess substitute servers, and to assist developers in
1633finding out about non-deterministic package builds (@pxref{Invoking guix
1634challenge}).
c4202d60
LC
1635
1636In the future, we want Guix to have support to publish and retrieve
1637binaries to/from other users, in a peer-to-peer fashion. If you would
1638like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1639
1640
6e721c4d
LC
1641@node Packages with Multiple Outputs
1642@section Packages with Multiple Outputs
1643
1644@cindex multiple-output packages
1645@cindex package outputs
1646
1647Often, packages defined in Guix have a single @dfn{output}---i.e., the
1648source package leads exactly one directory in the store. When running
1649@command{guix package -i glibc}, one installs the default output of the
1650GNU libc package; the default output is called @code{out}, but its name
1651can be omitted as shown in this command. In this particular case, the
1652default output of @code{glibc} contains all the C header files, shared
1653libraries, static libraries, Info documentation, and other supporting
1654files.
1655
1656Sometimes it is more appropriate to separate the various types of files
1657produced from a single source package into separate outputs. For
1658instance, the GLib C library (used by GTK+ and related packages)
1659installs more than 20 MiB of reference documentation as HTML pages.
1660To save space for users who do not need it, the documentation goes to a
1661separate output, called @code{doc}. To install the main GLib output,
1662which contains everything but the documentation, one would run:
1663
1664@example
1665guix package -i glib
1666@end example
1667
1668The command to install its documentation is:
1669
1670@example
1671guix package -i glib:doc
1672@end example
1673
1674Some packages install programs with different ``dependency footprints''.
1675For instance, the WordNet package install both command-line tools and
1676graphical user interfaces (GUIs). The former depend solely on the C
1677library, whereas the latter depend on Tcl/Tk and the underlying X
1678libraries. In this case, we leave the command-line tools in the default
1679output, whereas the GUIs are in a separate output. This allows users
fcc58db6
LC
1680who do not need the GUIs to save space. The @command{guix size} command
1681can help find out about such situations (@pxref{Invoking guix size}).
88856916 1682@command{guix graph} can also be helpful (@pxref{Invoking guix graph}).
6e721c4d
LC
1683
1684There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1685Other conventional output names include @code{lib} for libraries and
1686possibly header files, @code{bin} for stand-alone programs, and
1687@code{debug} for debugging information (@pxref{Installing Debugging
1688Files}). The outputs of a packages are listed in the third column of
1689the output of @command{guix package --list-available} (@pxref{Invoking
1690guix package}).
6e721c4d 1691
eeaf4427 1692
e49951eb
MW
1693@node Invoking guix gc
1694@section Invoking @command{guix gc}
fe8ff028
LC
1695
1696@cindex garbage collector
1697Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1698The @command{guix gc} command allows users to explicitly run the garbage
c22eb992
LC
1699collector to reclaim space from the @file{/gnu/store} directory. It is
1700the @emph{only} way to remove files from @file{/gnu/store}---removing
1701files or directories manually may break it beyond repair!
fe8ff028
LC
1702
1703The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1704@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1705cannot be deleted; any other file is considered @dfn{dead} and may be
1706deleted. The set of garbage collector roots includes default user
e49951eb
MW
1707profiles, and may be augmented with @command{guix build --root}, for
1708example (@pxref{Invoking guix build}).
fe8ff028 1709
1bb9900a
LC
1710Prior to running @code{guix gc --collect-garbage} to make space, it is
1711often useful to remove old generations from user profiles; that way, old
1712package builds referenced by those generations can be reclaimed. This
1713is achieved by running @code{guix package --delete-generations}
1714(@pxref{Invoking guix package}).
1715
e49951eb 1716The @command{guix gc} command has three modes of operation: it can be
fe8ff028 1717used to garbage-collect any dead files (the default), to delete specific
7770aafc
LC
1718files (the @code{--delete} option), to print garbage-collector
1719information, or for more advanced queries. The garbage collection
1720options are as follows:
fe8ff028
LC
1721
1722@table @code
1723@item --collect-garbage[=@var{min}]
1724@itemx -C [@var{min}]
834129e0 1725Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1726sub-directories. This is the default operation when no option is
1727specified.
1728
1729When @var{min} is given, stop once @var{min} bytes have been collected.
1730@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1731suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1732(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1733
1734When @var{min} is omitted, collect all the garbage.
1735
1736@item --delete
1737@itemx -d
1738Attempt to delete all the store files and directories specified as
1739arguments. This fails if some of the files are not in the store, or if
1740they are still live.
1741
30d9aa54
LC
1742@item --list-failures
1743List store items corresponding to cached build failures.
1744
1745This prints nothing unless the daemon was started with
1746@option{--cache-failures} (@pxref{Invoking guix-daemon,
1747@option{--cache-failures}}).
1748
1749@item --clear-failures
1750Remove the specified store items from the failed-build cache.
1751
1752Again, this option only makes sense when the daemon is started with
1753@option{--cache-failures}. Otherwise, it does nothing.
1754
fe8ff028
LC
1755@item --list-dead
1756Show the list of dead files and directories still present in the
1757store---i.e., files and directories no longer reachable from any root.
1758
1759@item --list-live
1760Show the list of live store files and directories.
ba8b732d
LC
1761
1762@end table
1763
1764In addition, the references among existing store files can be queried:
1765
1766@table @code
1767
1768@item --references
1769@itemx --referrers
1770List the references (respectively, the referrers) of store files given
1771as arguments.
1772
8e59fdd5
LC
1773@item --requisites
1774@itemx -R
fcc58db6 1775@cindex closure
8e59fdd5
LC
1776List the requisites of the store files passed as arguments. Requisites
1777include the store files themselves, their references, and the references
1778of these, recursively. In other words, the returned list is the
1779@dfn{transitive closure} of the store files.
1780
fcc58db6 1781@xref{Invoking guix size}, for a tool to profile the size of an
88856916
LC
1782element's closure. @xref{Invoking guix graph}, for a tool to visualize
1783the graph of references.
fcc58db6 1784
fe8ff028
LC
1785@end table
1786
7770aafc
LC
1787Lastly, the following options allow you to check the integrity of the
1788store and to control disk usage.
1789
1790@table @option
1791
1792@item --verify[=@var{options}]
1793@cindex integrity, of the store
1794@cindex integrity checking
1795Verify the integrity of the store.
1796
1797By default, make sure that all the store items marked as valid in the
1798daemon's database actually exist in @file{/gnu/store}.
1799
1800When provided, @var{options} must a comma-separated list containing one
1801or more of @code{contents} and @code{repair}.
1802
1803When passing @option{--verify=contents}, the daemon will compute the
1804content hash of each store item and compare it against its hash in the
1805database. Hash mismatches are reported as data corruptions. Because it
1806traverses @emph{all the files in the store}, this command can take a
1807long time, especially on systems with a slow disk drive.
1808
1809@cindex repairing the store
1810Using @option{--verify=repair} or @option{--verify=contents,repair}
1811causes the daemon to try to repair corrupt store items by fetching
1812substitutes for them (@pxref{Substitutes}). Because repairing is not
1813atomic, and thus potentially dangerous, it is available only to the
1814system administrator.
1815
1816@item --optimize
1817@cindex deduplication
1818Optimize the store by hard-linking identical files---this is
1819@dfn{deduplication}.
1820
1821The daemon performs deduplication after each successful build or archive
1822import, unless it was started with @code{--disable-deduplication}
1823(@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
1824this option is primarily useful when the daemon was running with
1825@code{--disable-deduplication}.
1826
1827@end table
eeaf4427 1828
f651b477
LC
1829@node Invoking guix pull
1830@section Invoking @command{guix pull}
1831
1832Packages are installed or upgraded to the latest version available in
1833the distribution currently available on your local machine. To update
1834that distribution, along with the Guix tools, you must run @command{guix
1835pull}: the command downloads the latest Guix source code and package
1836descriptions, and deploys it.
1837
1838On completion, @command{guix package} will use packages and package
1839versions from this just-retrieved copy of Guix. Not only that, but all
1840the Guix commands and Scheme modules will also be taken from that latest
1841version. New @command{guix} sub-commands added by the update also
ef54b61d
AV
1842become available@footnote{Under the hood, @command{guix pull} updates
1843the @file{~/.config/guix/latest} symbolic link to point to the latest
1844Guix, and the @command{guix} command loads code from there.}.
f651b477
LC
1845
1846The @command{guix pull} command is usually invoked with no arguments,
1847but it supports the following options:
1848
1849@table @code
1850@item --verbose
1851Produce verbose output, writing build logs to the standard error output.
1852
ab5d72ad
LC
1853@item --url=@var{url}
1854Download the source tarball of Guix from @var{url}.
1855
1856By default, the tarball is taken from its canonical address at
1857@code{gnu.org}, for the stable branch of Guix.
1858
f651b477
LC
1859@item --bootstrap
1860Use the bootstrap Guile to build the latest Guix. This option is only
1861useful to Guix developers.
1862@end table
1863
760c60d6
LC
1864
1865@node Invoking guix archive
1866@section Invoking @command{guix archive}
1867
1868The @command{guix archive} command allows users to @dfn{export} files
1869from the store into a single archive, and to later @dfn{import} them.
1870In particular, it allows store files to be transferred from one machine
1871to another machine's store. For example, to transfer the @code{emacs}
1872package to a machine connected over SSH, one would run:
1873
1874@example
56607088 1875guix archive --export -r emacs | ssh the-machine guix archive --import
760c60d6
LC
1876@end example
1877
87236aed 1878@noindent
56607088
LC
1879Similarly, a complete user profile may be transferred from one machine
1880to another like this:
1881
1882@example
1883guix archive --export -r $(readlink -f ~/.guix-profile) | \
1884 ssh the-machine guix-archive --import
1885@end example
1886
1887@noindent
1888However, note that, in both examples, all of @code{emacs} and the
1889profile as well as all of their dependencies are transferred (due to
1890@code{-r}), regardless of what is already available in the target
1891machine's store. The @code{--missing} option can help figure out which
1892items are missing from the target's store.
87236aed 1893
760c60d6 1894Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1895comparable in spirit to `tar', but with a few noteworthy differences
1896that make it more appropriate for our purposes. First, rather than
1897recording all Unix meta-data for each file, the Nar format only mentions
1898the file type (regular, directory, or symbolic link); Unix permissions
1899and owner/group are dismissed. Second, the order in which directory
1900entries are stored always follows the order of file names according to
1901the C locale collation order. This makes archive production fully
1902deterministic.
1903
1904When exporting, the daemon digitally signs the contents of the archive,
1905and that digital signature is appended. When importing, the daemon
1906verifies the signature and rejects the import in case of an invalid
1907signature or if the signing key is not authorized.
760c60d6
LC
1908@c FIXME: Add xref to daemon doc about signatures.
1909
1910The main options are:
1911
1912@table @code
1913@item --export
1914Export the specified store files or packages (see below.) Write the
1915resulting archive to the standard output.
1916
56607088
LC
1917Dependencies are @emph{not} included in the output, unless
1918@code{--recursive} is passed.
1919
1920@item -r
1921@itemx --recursive
1922When combined with @code{--export}, this instructs @command{guix
1923archive} to include dependencies of the given items in the archive.
1924Thus, the resulting archive is self-contained: it contains the closure
1925of the exported store items.
1926
760c60d6
LC
1927@item --import
1928Read an archive from the standard input, and import the files listed
1929therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1930signature, or if it is signed by a public key not among the authorized
1931keys (see @code{--authorize} below.)
554f26ec 1932
87236aed
LC
1933@item --missing
1934Read a list of store file names from the standard input, one per line,
1935and write on the standard output the subset of these files missing from
1936the store.
1937
554f26ec 1938@item --generate-key[=@var{parameters}]
f82cc5fd 1939@cindex signing, archives
554f26ec
LC
1940Generate a new key pair for the daemons. This is a prerequisite before
1941archives can be exported with @code{--export}. Note that this operation
1942usually takes time, because it needs to gather enough entropy to
1943generate the key pair.
1944
1945The generated key pair is typically stored under @file{/etc/guix}, in
1946@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
867d8473
LC
1947key, which must be kept secret.) When @var{parameters} is omitted,
1948an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
1949versions before 1.6.0, it is a 4096-bit RSA key.
1950Alternately, @var{parameters} can specify
554f26ec
LC
1951@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1952public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1953Libgcrypt Reference Manual}).
f82cc5fd
LC
1954
1955@item --authorize
1956@cindex authorizing, archives
1957Authorize imports signed by the public key passed on standard input.
1958The public key must be in ``s-expression advanced format''---i.e., the
1959same format as the @file{signing-key.pub} file.
1960
1961The list of authorized keys is kept in the human-editable file
1962@file{/etc/guix/acl}. The file contains
1963@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1964s-expressions''} and is structured as an access-control list in the
1965@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1966(SPKI)}.
c6f8e9dd
LC
1967
1968@item --extract=@var{directory}
1969@itemx -x @var{directory}
1970Read a single-item archive as served by substitute servers
1971(@pxref{Substitutes}) and extract it to @var{directory}. This is a
1972low-level operation needed in only very narrow use cases; see below.
1973
1974For example, the following command extracts the substitute for Emacs
1975served by @code{hydra.gnu.org} to @file{/tmp/emacs}:
1976
1977@example
1978$ wget -O - \
1979 http://hydra.gnu.org/nar/@dots{}-emacs-24.5 \
1980 | bunzip2 | guix archive -x /tmp/emacs
1981@end example
1982
1983Single-item archives are different from multiple-item archives produced
1984by @command{guix archive --export}; they contain a single store item,
1985and they do @emph{not} embed a signature. Thus this operation does
1986@emph{no} signature verification and its output should be considered
1987unsafe.
1988
1989The primary purpose of this operation is to facilitate inspection of
1990archive contents coming from possibly untrusted substitute servers.
1991
760c60d6
LC
1992@end table
1993
1994To export store files as an archive to the standard output, run:
1995
1996@example
1997guix archive --export @var{options} @var{specifications}...
1998@end example
1999
2000@var{specifications} may be either store file names or package
2001specifications, as for @command{guix package} (@pxref{Invoking guix
2002package}). For instance, the following command creates an archive
2003containing the @code{gui} output of the @code{git} package and the main
2004output of @code{emacs}:
2005
2006@example
834129e0 2007guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
2008@end example
2009
2010If the specified packages are not built yet, @command{guix archive}
2011automatically builds them. The build process may be controlled with the
2012same options that can be passed to the @command{guix build} command
70ee5642 2013(@pxref{Invoking guix build, common build options}).
760c60d6 2014
c554de89
AK
2015@c *********************************************************************
2016@include emacs.texi
760c60d6 2017
568717fd
LC
2018@c *********************************************************************
2019@node Programming Interface
2020@chapter Programming Interface
2021
3dc1970d
LC
2022GNU Guix provides several Scheme programming interfaces (APIs) to
2023define, build, and query packages. The first interface allows users to
2024write high-level package definitions. These definitions refer to
2025familiar packaging concepts, such as the name and version of a package,
2026its build system, and its dependencies. These definitions can then be
2027turned into concrete build actions.
2028
ba55b1cb 2029Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 2030standard setup, the daemon has write access to the store---the
834129e0 2031@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
2032setup also has the daemon perform builds in chroots, under a specific
2033build users, to minimize interference with the rest of the system.
2034
2035@cindex derivation
2036Lower-level APIs are available to interact with the daemon and the
2037store. To instruct the daemon to perform a build action, users actually
2038provide it with a @dfn{derivation}. A derivation is a low-level
2039representation of the build actions to be taken, and the environment in
2040which they should occur---derivations are to package definitions what
49ad317a
LC
2041assembly is to C programs. The term ``derivation'' comes from the fact
2042that build results @emph{derive} from them.
3dc1970d
LC
2043
2044This chapter describes all these APIs in turn, starting from high-level
2045package definitions.
2046
568717fd 2047@menu
b860f382 2048* Defining Packages:: Defining new packages.
7458bd0a 2049* Build Systems:: Specifying how packages are built.
b860f382
LC
2050* The Store:: Manipulating the package store.
2051* Derivations:: Low-level interface to package derivations.
2052* The Store Monad:: Purely functional interface to the store.
21b679f6 2053* G-Expressions:: Manipulating build expressions.
568717fd
LC
2054@end menu
2055
2056@node Defining Packages
2057@section Defining Packages
2058
3dc1970d
LC
2059The high-level interface to package definitions is implemented in the
2060@code{(guix packages)} and @code{(guix build-system)} modules. As an
2061example, the package definition, or @dfn{recipe}, for the GNU Hello
2062package looks like this:
2063
2064@example
e7f34eb0
LC
2065(define-module (gnu packages hello)
2066 #:use-module (guix packages)
2067 #:use-module (guix download)
2068 #:use-module (guix build-system gnu)
a6dcdcac
SB
2069 #:use-module (guix licenses)
2070 #:use-module (gnu packages gawk))
b22a12fd 2071
79f5dd59 2072(define-public hello
3dc1970d
LC
2073 (package
2074 (name "hello")
17d8e33f 2075 (version "2.10")
3dc1970d 2076 (source (origin
17d8e33f
ML
2077 (method url-fetch)
2078 (uri (string-append "mirror://gnu/hello/hello-" version
2079 ".tar.gz"))
2080 (sha256
2081 (base32
2082 "0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i"))))
3dc1970d 2083 (build-system gnu-build-system)
7458bd0a 2084 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 2085 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
2086 (synopsis "Hello, GNU world: An example GNU package")
2087 (description "Guess what GNU Hello prints!")
3dc1970d 2088 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 2089 (license gpl3+)))
3dc1970d
LC
2090@end example
2091
2092@noindent
2093Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 2094of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
2095to a @code{<package>} object, which is essentially a record
2096(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
2097This package object can be inspected using procedures found in the
2098@code{(guix packages)} module; for instance, @code{(package-name hello)}
2099returns---surprise!---@code{"hello"}.
2100
2f7d2d91
LC
2101With luck, you may be able to import part or all of the definition of
2102the package you are interested in from another repository, using the
2103@code{guix import} command (@pxref{Invoking guix import}).
2104
e7f34eb0
LC
2105In the example above, @var{hello} is defined into a module of its own,
2106@code{(gnu packages hello)}. Technically, this is not strictly
2107necessary, but it is convenient to do so: all the packages defined in
2108modules under @code{(gnu packages @dots{})} are automatically known to
2109the command-line tools (@pxref{Package Modules}).
2110
3dc1970d
LC
2111There are a few points worth noting in the above package definition:
2112
2113@itemize
2114@item
a2bf4907
LC
2115The @code{source} field of the package is an @code{<origin>} object
2116(@pxref{origin Reference}, for the complete reference).
3dc1970d
LC
2117Here, the @code{url-fetch} method from @code{(guix download)} is used,
2118meaning that the source is a file to be downloaded over FTP or HTTP.
2119
2120The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
2121the GNU mirrors defined in @code{(guix download)}.
2122
2123The @code{sha256} field specifies the expected SHA256 hash of the file
2124being downloaded. It is mandatory, and allows Guix to check the
2125integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 2126base32 representation of the hash. You can obtain this information with
210cc920
LC
2127@code{guix download} (@pxref{Invoking guix download}) and @code{guix
2128hash} (@pxref{Invoking guix hash}).
3dc1970d 2129
f9cc8971
LC
2130@cindex patches
2131When needed, the @code{origin} form can also have a @code{patches} field
2132listing patches to be applied, and a @code{snippet} field giving a
2133Scheme expression to modify the source code.
2134
3dc1970d
LC
2135@item
2136@cindex GNU Build System
7458bd0a
LC
2137The @code{build-system} field specifies the procedure to build the
2138package (@pxref{Build Systems}). Here, @var{gnu-build-system}
2139represents the familiar GNU Build System, where packages may be
2140configured, built, and installed with the usual @code{./configure &&
2141make && make check && make install} command sequence.
2142
2143@item
2144The @code{arguments} field specifies options for the build system
2145(@pxref{Build Systems}). Here it is interpreted by
2146@var{gnu-build-system} as a request run @file{configure} with the
2147@code{--enable-silent-rules} flag.
3dc1970d
LC
2148
2149@item
2150The @code{inputs} field specifies inputs to the build process---i.e.,
2151build-time or run-time dependencies of the package. Here, we define an
2152input called @code{"gawk"} whose value is that of the @var{gawk}
2153variable; @var{gawk} is itself bound to a @code{<package>} object.
2154
2155Note that GCC, Coreutils, Bash, and other essential tools do not need to
2156be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 2157of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
2158
2159However, any other dependencies need to be specified in the
2160@code{inputs} field. Any dependency not specified here will simply be
2161unavailable to the build process, possibly leading to a build failure.
2162@end itemize
2163
87eafdbd
TUBK
2164@xref{package Reference}, for a full description of possible fields.
2165
2f7d2d91 2166Once a package definition is in place, the
e49951eb 2167package may actually be built using the @code{guix build} command-line
39bee8a2
LC
2168tool (@pxref{Invoking guix build}). You can easily jump back to the
2169package definition using the @command{guix edit} command
2170(@pxref{Invoking guix edit}).
2171@xref{Packaging Guidelines}, for
b4f5e0e8
CR
2172more information on how to test package definitions, and
2173@ref{Invoking guix lint}, for information on how to check a definition
2174for style conformance.
2175
7458bd0a
LC
2176Eventually, updating the package definition to a new upstream version
2177can be partly automated by the @command{guix refresh} command
2178(@pxref{Invoking guix refresh}).
3dc1970d
LC
2179
2180Behind the scenes, a derivation corresponding to the @code{<package>}
2181object is first computed by the @code{package-derivation} procedure.
834129e0 2182That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 2183The build actions it prescribes may then be realized by using the
3dc1970d
LC
2184@code{build-derivations} procedure (@pxref{The Store}).
2185
2186@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
2187Return the @code{<derivation>} object of @var{package} for @var{system}
2188(@pxref{Derivations}).
3dc1970d
LC
2189
2190@var{package} must be a valid @code{<package>} object, and @var{system}
2191must be a string denoting the target system type---e.g.,
2192@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
2193must be a connection to the daemon, which operates on the store
2194(@pxref{The Store}).
2195@end deffn
568717fd 2196
9c1edabd
LC
2197@noindent
2198@cindex cross-compilation
2199Similarly, it is possible to compute a derivation that cross-builds a
2200package for some other system:
2201
2202@deffn {Scheme Procedure} package-cross-derivation @var{store} @
2203 @var{package} @var{target} [@var{system}]
59688fc4
LC
2204Return the @code{<derivation>} object of @var{package} cross-built from
2205@var{system} to @var{target}.
9c1edabd
LC
2206
2207@var{target} must be a valid GNU triplet denoting the target hardware
2208and operating system, such as @code{"mips64el-linux-gnu"}
2209(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
2210Configure and Build System}).
2211@end deffn
2212
87eafdbd
TUBK
2213@menu
2214* package Reference :: The package data type.
2215* origin Reference:: The origin data type.
2216@end menu
2217
2218
2219@node package Reference
2220@subsection @code{package} Reference
2221
2222This section summarizes all the options available in @code{package}
2223declarations (@pxref{Defining Packages}).
2224
2225@deftp {Data Type} package
2226This is the data type representing a package recipe.
2227
2228@table @asis
2229@item @code{name}
2230The name of the package, as a string.
2231
2232@item @code{version}
2233The version of the package, as a string.
2234
2235@item @code{source}
2236An origin object telling how the source code for the package should be
2237acquired (@pxref{origin Reference}).
2238
2239@item @code{build-system}
2240The build system that should be used to build the package (@pxref{Build
2241Systems}).
2242
2243@item @code{arguments} (default: @code{'()})
2244The arguments that should be passed to the build system. This is a
2245list, typically containing sequential keyword-value pairs.
2246
2247@item @code{inputs} (default: @code{'()})
2248Package or derivation inputs to the build. This is a list of lists,
2249where each list has the name of the input (a string) as its first
2250element, a package or derivation object as its second element, and
2251optionally the name of the output of the package or derivation that
2252should be used, which defaults to @code{"out"}.
2253
21461f27
LC
2254@item @anchor{package-propagated-inputs}@code{propagated-inputs} (default: @code{'()})
2255@cindex propagated inputs
87eafdbd 2256This field is like @code{inputs}, but the specified packages will be
21461f27
LC
2257force-installed alongside the package they belong to
2258(@pxref{package-cmd-propagated-inputs, @command{guix package}}, for
2259information on how @command{guix package} deals with propagated inputs.)
2260
2261For example this is necessary when a library needs headers of another
2262library to compile, or needs another shared library to be linked
2263alongside itself when a program wants to link to it.
87eafdbd
TUBK
2264
2265@item @code{native-inputs} (default: @code{'()})
2266This field is like @code{inputs}, but in case of a cross-compilation it
2267will be ensured that packages for the architecture of the build machine
2268are present, such that executables from them can be used during the
21461f27
LC
2269build.
2270
2271This is typically where you would list tools needed at build time but
2272not at run time, such as Autoconf, Automake, pkg-config, Gettext, or
2273Bison. @command{guix lint} can report likely mistakes in this area
2274(@pxref{Invoking guix lint}).
87eafdbd
TUBK
2275
2276@item @code{self-native-input?} (default: @code{#f})
2277This is a Boolean field telling whether the package should use itself as
2278a native input when cross-compiling.
2279
2280@item @code{outputs} (default: @code{'("out")})
2281The list of output names of the package. @xref{Packages with Multiple
2282Outputs}, for typical uses of additional outputs.
2283
2284@item @code{native-search-paths} (default: @code{'()})
2285@itemx @code{search-paths} (default: @code{'()})
2286A list of @code{search-path-specification} objects describing
2287search-path environment variables honored by the package.
2288
2289@item @code{replacement} (default: @code{#f})
2290This must either @code{#f} or a package object that will be used as a
2291@dfn{replacement} for this package. @xref{Security Updates, grafts},
2292for details.
2293
2294@item @code{synopsis}
2295A one-line description of the package.
2296
2297@item @code{description}
2298A more elaborate description of the package.
2299
2300@item @code{license}
2301The license of the package; a value from @code{(guix licenses)}.
2302
2303@item @code{home-page}
2304The URL to the home-page of the package, as a string.
2305
2306@item @code{supported-systems} (default: @var{%supported-systems})
2307The list of systems supported by the package, as strings of the form
2308@code{architecture-kernel}, for example @code{"x86_64-linux"}.
2309
2310@item @code{maintainers} (default: @code{'()})
2311The list of maintainers of the package, as @code{maintainer} objects.
2312
2313@item @code{location} (default: source location of the @code{package} form)
2314The source location of the package. It's useful to override this when
2315inheriting from another package, in which case this field is not
2316automatically corrected.
2317@end table
2318@end deftp
2319
2320
2321@node origin Reference
2322@subsection @code{origin} Reference
2323
2324This section summarizes all the options available in @code{origin}
2325declarations (@pxref{Defining Packages}).
2326
2327@deftp {Data Type} origin
2328This is the data type representing a source code origin.
2329
2330@table @asis
2331@item @code{uri}
2332An object containing the URI of the source. The object type depends on
2333the @code{method} (see below). For example, when using the
2334@var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
2335values are: a URL represented as a string, or a list thereof.
2336
2337@item @code{method}
2338A procedure that will handle the URI.
2339
2340Examples include:
2341
2342@table @asis
2343@item @var{url-fetch} from @code{(guix download)}
2344download a file the HTTP, HTTPS, or FTP URL specified in the
2345@code{uri} field;
2346
2347@item @var{git-fetch} from @code{(guix git-download)}
2348clone the Git version control repository, and check out the revision
2349specified in the @code{uri} field as a @code{git-reference} object; a
2350@code{git-reference} looks like this:
2351
2352@example
2353(git-reference
2354 (url "git://git.debian.org/git/pkg-shadow/shadow")
2355 (commit "v4.1.5.1"))
2356@end example
2357@end table
2358
2359@item @code{sha256}
2360A bytevector containing the SHA-256 hash of the source. Typically the
2361@code{base32} form is used here to generate the bytevector from a
2362base-32 string.
2363
2364@item @code{file-name} (default: @code{#f})
2365The file name under which the source code should be saved. When this is
2366@code{#f}, a sensible default value will be used in most cases. In case
2367the source is fetched from a URL, the file name from the URL will be
2368used. For version control checkouts, it's recommended to provide the
2369file name explicitly because the default is not very descriptive.
2370
2371@item @code{patches} (default: @code{'()})
2372A list of file names containing patches to be applied to the source.
2373
2374@item @code{snippet} (default: @code{#f})
2375A quoted piece of code that will be run in the source directory to make
2376any modifications, which is sometimes more convenient than a patch.
2377
2378@item @code{patch-flags} (default: @code{'("-p1")})
2379A list of command-line flags that should be passed to the @code{patch}
2380command.
2381
2382@item @code{patch-inputs} (default: @code{#f})
2383Input packages or derivations to the patching process. When this is
2384@code{#f}, the usual set of inputs necessary for patching are provided,
2385such as GNU@tie{}Patch.
2386
2387@item @code{modules} (default: @code{'()})
2388A list of Guile modules that should be loaded during the patching
2389process and while running the code in the @code{snippet} field.
2390
2391@item @code{imported-modules} (default: @code{'()})
2392The list of Guile modules to import in the patch derivation, for use by
2393the @code{snippet}.
2394
2395@item @code{patch-guile} (default: @code{#f})
2396The Guile package that should be used in the patching process. When
2397this is @code{#f}, a sensible default is used.
2398@end table
2399@end deftp
2400
9c1edabd 2401
7458bd0a
LC
2402@node Build Systems
2403@section Build Systems
2404
2405@cindex build system
2406Each package definition specifies a @dfn{build system} and arguments for
2407that build system (@pxref{Defining Packages}). This @code{build-system}
2408field represents the build procedure of the package, as well implicit
2409dependencies of that build procedure.
2410
2411Build systems are @code{<build-system>} objects. The interface to
2412create and manipulate them is provided by the @code{(guix build-system)}
2413module, and actual build systems are exported by specific modules.
2414
f5fd4fd2 2415@cindex bag (low-level package representation)
0d5a559f
LC
2416Under the hood, build systems first compile package objects to
2417@dfn{bags}. A @dfn{bag} is like a package, but with less
2418ornamentation---in other words, a bag is a lower-level representation of
2419a package, which includes all the inputs of that package, including some
2420that were implicitly added by the build system. This intermediate
2421representation is then compiled to a derivation (@pxref{Derivations}).
2422
7458bd0a
LC
2423Build systems accept an optional list of @dfn{arguments}. In package
2424definitions, these are passed @i{via} the @code{arguments} field
2425(@pxref{Defining Packages}). They are typically keyword arguments
2426(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2427Guile Reference Manual}). The value of these arguments is usually
2428evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2429by the daemon (@pxref{Derivations}).
2430
2431The main build system is @var{gnu-build-system}, which implements the
2432standard build procedure for GNU packages and many other packages. It
2433is provided by the @code{(guix build-system gnu)} module.
2434
2435@defvr {Scheme Variable} gnu-build-system
2436@var{gnu-build-system} represents the GNU Build System, and variants
2437thereof (@pxref{Configuration, configuration and makefile conventions,,
2438standards, GNU Coding Standards}).
2439
2440@cindex build phases
2441In a nutshell, packages using it configured, built, and installed with
2442the usual @code{./configure && make && make check && make install}
2443command sequence. In practice, a few additional steps are often needed.
2444All these steps are split up in separate @dfn{phases},
2445notably@footnote{Please see the @code{(guix build gnu-build-system)}
2446modules for more details about the build phases.}:
2447
2448@table @code
2449@item unpack
2450Unpack the source tarball, and change the current directory to the
2451extracted source tree. If the source is actually a directory, copy it
2452to the build tree, and enter that directory.
2453
2454@item patch-source-shebangs
2455Patch shebangs encountered in source files so they refer to the right
2456store file names. For instance, this changes @code{#!/bin/sh} to
2457@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2458
2459@item configure
2460Run the @file{configure} script with a number of default options, such
2461as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2462by the @code{#:configure-flags} argument.
2463
2464@item build
2465Run @code{make} with the list of flags specified with
2466@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
2467(the default), build with @code{make -j}.
2468
2469@item check
2470Run @code{make check}, or some other target specified with
2471@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2472@code{#:parallel-tests?} argument is true (the default), run @code{make
2473check -j}.
2474
2475@item install
2476Run @code{make install} with the flags listed in @code{#:make-flags}.
2477
2478@item patch-shebangs
2479Patch shebangs on the installed executable files.
2480
2481@item strip
2482Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2483is false), copying them to the @code{debug} output when available
2484(@pxref{Installing Debugging Files}).
2485@end table
2486
2487@vindex %standard-phases
2488The build-side module @code{(guix build gnu-build-system)} defines
2489@var{%standard-phases} as the default list of build phases.
2490@var{%standard-phases} is a list of symbol/procedure pairs, where the
2491procedure implements the actual phase.
2492
2493The list of phases used for a particular package can be changed with the
2494@code{#:phases} parameter. For instance, passing:
2495
2496@example
2497#:phases (alist-delete 'configure %standard-phases)
2498@end example
2499
9bf404e9 2500means that all the phases described above will be used, except the
7458bd0a
LC
2501@code{configure} phase.
2502
2503In addition, this build system ensures that the ``standard'' environment
2504for GNU packages is available. This includes tools such as GCC, libc,
2505Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2506build-system gnu)} module for a complete list.) We call these the
2507@dfn{implicit inputs} of a package, because package definitions don't
2508have to mention them.
2509@end defvr
2510
2511Other @code{<build-system>} objects are defined to support other
2512conventions and tools used by free software packages. They inherit most
2513of @var{gnu-build-system}, and differ mainly in the set of inputs
2514implicitly added to the build process, and in the list of phases
2515executed. Some of these build systems are listed below.
2516
2517@defvr {Scheme Variable} cmake-build-system
2518This variable is exported by @code{(guix build-system cmake)}. It
2519implements the build procedure for packages using the
2520@url{http://www.cmake.org, CMake build tool}.
2521
2522It automatically adds the @code{cmake} package to the set of inputs.
2523Which package is used can be specified with the @code{#:cmake}
2524parameter.
9849cfc1
LC
2525
2526The @code{#:configure-flags} parameter is taken as a list of flags
2527passed to the @command{cmake} command. The @code{#:build-type}
2528parameter specifies in abstract terms the flags passed to the compiler;
2529it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2530debugging information''), which roughly means that code is compiled with
2531@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
2532@end defvr
2533
3afcf52b
FB
2534@defvr {Scheme Variable} glib-or-gtk-build-system
2535This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2536is intended for use with packages making use of GLib or GTK+.
2537
2538This build system adds the following two phases to the ones defined by
2539@var{gnu-build-system}:
2540
2541@table @code
2542@item glib-or-gtk-wrap
2543The phase @code{glib-or-gtk-wrap} ensures that programs found under
2544@file{bin/} are able to find GLib's ``schemas'' and
2545@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2546modules}. This is achieved by wrapping the programs in launch scripts
2547that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2548environment variables.
2549
73aa8ddb
LC
2550It is possible to exclude specific package outputs from that wrapping
2551process by listing their names in the
2552@code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
2553when an output is known not to contain any GLib or GTK+ binaries, and
2554where wrapping would gratuitously add a dependency of that output on
2555GLib and GTK+.
2556
3afcf52b
FB
2557@item glib-or-gtk-compile-schemas
2558The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
2559@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
2560GSettings schemas} are compiled. Compilation is performed by the
2561@command{glib-compile-schemas} program. It is provided by the package
2562@code{glib:bin} which is automatically imported by the build system.
2563The @code{glib} package providing @command{glib-compile-schemas} can be
2564specified with the @code{#:glib} parameter.
2565@end table
2566
2567Both phases are executed after the @code{install} phase.
2568@end defvr
2569
7458bd0a
LC
2570@defvr {Scheme Variable} python-build-system
2571This variable is exported by @code{(guix build-system python)}. It
2572implements the more or less standard build procedure used by Python
2573packages, which consists in running @code{python setup.py build} and
2574then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
2575
2576For packages that install stand-alone Python programs under @code{bin/},
2577it takes care of wrapping these programs so their @code{PYTHONPATH}
2578environment variable points to all the Python libraries they depend on.
2579
2580Which Python package is used can be specified with the @code{#:python}
2581parameter.
2582@end defvr
2583
2584@defvr {Scheme Variable} perl-build-system
2585This variable is exported by @code{(guix build-system perl)}. It
2d2a53fc
EB
2586implements the standard build procedure for Perl packages, which either
2587consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
2588followed by @code{Build} and @code{Build install}; or in running
2589@code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
2590@code{make} and @code{make install}; depending on which of
2591@code{Build.PL} or @code{Makefile.PL} is present in the package
2592distribution. Preference is given to the former if both @code{Build.PL}
2593and @code{Makefile.PL} exist in the package distribution. This
2594preference can be reversed by specifying @code{#t} for the
2595@code{#:make-maker?} parameter.
2596
2597The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
2598passes flags specified by the @code{#:make-maker-flags} or
2599@code{#:module-build-flags} parameter, respectively.
7458bd0a
LC
2600
2601Which Perl package is used can be specified with @code{#:perl}.
2602@end defvr
2603
f8f3bef6
RW
2604@defvr {Scheme Variable} r-build-system
2605This variable is exported by @code{(guix build-system r)}. It
2606implements the build procedure used by @uref{http://r-project.org, R}
2607packages, which essentially is little more than running @code{R CMD
2608INSTALL --library=/gnu/store/@dots{}} in an environment where
2609@code{R_LIBS_SITE} contains the paths to all R package inputs. Tests
2610are run after installation using the R function
2611@code{tools::testInstalledPackage}.
2612@end defvr
2613
c08f9818
DT
2614@defvr {Scheme Variable} ruby-build-system
2615This variable is exported by @code{(guix build-system ruby)}. It
2616implements the RubyGems build procedure used by Ruby packages, which
2617involves running @code{gem build} followed by @code{gem install}.
2618
5dc87623
DT
2619The @code{source} field of a package that uses this build system
2620typically references a gem archive, since this is the format that Ruby
2621developers use when releasing their software. The build system unpacks
2622the gem archive, potentially patches the source, runs the test suite,
2623repackages the gem, and installs it. Additionally, directories and
2624tarballs may be referenced to allow building unreleased gems from Git or
2625a traditional source release tarball.
e83c6d00 2626
c08f9818 2627Which Ruby package is used can be specified with the @code{#:ruby}
6e9f2913
PP
2628parameter. A list of additional flags to be passed to the @command{gem}
2629command can be specified with the @code{#:gem-flags} parameter.
c08f9818 2630@end defvr
7458bd0a 2631
a677c726
RW
2632@defvr {Scheme Variable} waf-build-system
2633This variable is exported by @code{(guix build-system waf)}. It
2634implements a build procedure around the @code{waf} script. The common
2635phases---@code{configure}, @code{build}, and @code{install}---are
2636implemented by passing their names as arguments to the @code{waf}
2637script.
2638
2639The @code{waf} script is executed by the Python interpreter. Which
2640Python package is used to run the script can be specified with the
2641@code{#:python} parameter.
2642@end defvr
2643
14dfdf2e
FB
2644@defvr {Scheme Variable} haskell-build-system
2645This variable is exported by @code{(guix build-system haskell)}. It
2646implements the Cabal build procedure used by Haskell packages, which
2647involves running @code{runhaskell Setup.hs configure
2648--prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
2649Instead of installing the package by running @code{runhaskell Setup.hs
2650install}, to avoid trying to register libraries in the read-only
2651compiler store directory, the build system uses @code{runhaskell
2652Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
2653addition, the build system generates the package documentation by
2654running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
2655is passed. Optional Haddock parameters can be passed with the help of
2656the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
2657not found, the build system looks for @code{Setup.lhs} instead.
2658
2659Which Haskell compiler is used can be specified with the @code{#:haskell}
a54bd6d7 2660parameter which defaults to @code{ghc}.
14dfdf2e
FB
2661@end defvr
2662
e9137a53
FB
2663@defvr {Scheme Variable} emacs-build-system
2664This variable is exported by @code{(guix build-system emacs)}. It
2665implements an installation procedure similar to the one of Emacs' own
2666packaging system (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
2667
2668It first creates the @code{@var{package}-autoloads.el} file, then it
2669byte compiles all Emacs Lisp files. Differently from the Emacs
2670packaging system, the Info documentation files are moved to the standard
2671documentation directory and the @file{dir} file is deleted. Each
2672package is installed in its own directory under
2673@file{share/emacs/site-lisp/guix.d}.
2674@end defvr
2675
7458bd0a
LC
2676Lastly, for packages that do not need anything as sophisticated, a
2677``trivial'' build system is provided. It is trivial in the sense that
2678it provides basically no support: it does not pull any implicit inputs,
2679and does not have a notion of build phases.
2680
2681@defvr {Scheme Variable} trivial-build-system
2682This variable is exported by @code{(guix build-system trivial)}.
2683
2684This build system requires a @code{#:builder} argument. This argument
2685must be a Scheme expression that builds the package's output(s)---as
2686with @code{build-expression->derivation} (@pxref{Derivations,
2687@code{build-expression->derivation}}).
2688@end defvr
2689
568717fd
LC
2690@node The Store
2691@section The Store
2692
e531ac2a
LC
2693@cindex store
2694@cindex store paths
2695
2696Conceptually, the @dfn{store} is where derivations that have been
834129e0 2697successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a 2698Sub-directories in the store are referred to as @dfn{store paths}. The
4988dd40 2699store has an associated database that contains information such as the
e531ac2a
LC
2700store paths referred to by each store path, and the list of @emph{valid}
2701store paths---paths that result from a successful build.
2702
2703The store is always accessed by the daemon on behalf of its clients
2704(@pxref{Invoking guix-daemon}). To manipulate the store, clients
2705connect to the daemon over a Unix-domain socket, send it requests, and
2706read the result---these are remote procedure calls, or RPCs.
2707
2708The @code{(guix store)} module provides procedures to connect to the
2709daemon, and to perform RPCs. These are described below.
2710
2711@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
2712Connect to the daemon over the Unix-domain socket at @var{file}. When
2713@var{reserve-space?} is true, instruct it to reserve a little bit of
2714extra space on the file system so that the garbage collector can still
2715operate, should the disk become full. Return a server object.
2716
2717@var{file} defaults to @var{%default-socket-path}, which is the normal
2718location given the options that were passed to @command{configure}.
2719@end deffn
2720
2721@deffn {Scheme Procedure} close-connection @var{server}
2722Close the connection to @var{server}.
2723@end deffn
2724
2725@defvr {Scheme Variable} current-build-output-port
2726This variable is bound to a SRFI-39 parameter, which refers to the port
2727where build and error logs sent by the daemon should be written.
2728@end defvr
2729
2730Procedures that make RPCs all take a server object as their first
2731argument.
2732
2733@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
2734Return @code{#t} when @var{path} is a valid store path.
2735@end deffn
2736
cfbf9160 2737@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
2738Add @var{text} under file @var{name} in the store, and return its store
2739path. @var{references} is the list of store paths referred to by the
2740resulting store path.
2741@end deffn
2742
874e6874 2743@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
2744Build @var{derivations} (a list of @code{<derivation>} objects or
2745derivation paths), and return when the worker is done building them.
2746Return @code{#t} on success.
874e6874
LC
2747@end deffn
2748
b860f382
LC
2749Note that the @code{(guix monads)} module provides a monad as well as
2750monadic versions of the above procedures, with the goal of making it
2751more convenient to work with code that accesses the store (@pxref{The
2752Store Monad}).
2753
e531ac2a
LC
2754@c FIXME
2755@i{This section is currently incomplete.}
568717fd
LC
2756
2757@node Derivations
2758@section Derivations
2759
874e6874
LC
2760@cindex derivations
2761Low-level build actions and the environment in which they are performed
2762are represented by @dfn{derivations}. A derivation contain the
2763following pieces of information:
2764
2765@itemize
2766@item
2767The outputs of the derivation---derivations produce at least one file or
2768directory in the store, but may produce more.
2769
2770@item
2771The inputs of the derivations, which may be other derivations or plain
2772files in the store (patches, build scripts, etc.)
2773
2774@item
2775The system type targeted by the derivation---e.g., @code{x86_64-linux}.
2776
2777@item
2778The file name of a build script in the store, along with the arguments
2779to be passed.
2780
2781@item
2782A list of environment variables to be defined.
2783
2784@end itemize
2785
2786@cindex derivation path
2787Derivations allow clients of the daemon to communicate build actions to
2788the store. They exist in two forms: as an in-memory representation,
2789both on the client- and daemon-side, and as files in the store whose
2790name end in @code{.drv}---these files are referred to as @dfn{derivation
2791paths}. Derivations paths can be passed to the @code{build-derivations}
2792procedure to perform the build actions they prescribe (@pxref{The
2793Store}).
2794
2795The @code{(guix derivations)} module provides a representation of
2796derivations as Scheme objects, along with procedures to create and
2797otherwise manipulate derivations. The lowest-level primitive to create
2798a derivation is the @code{derivation} procedure:
2799
1909431c
LC
2800@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
2801 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 2802 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 2803 [#:system (%current-system)] [#:references-graphs #f] @
4a6aeb67
LC
2804 [#:allowed-references #f] [#:leaked-env-vars #f] [#:local-build? #f] @
2805 [#:substitutable? #t]
59688fc4
LC
2806Build a derivation with the given arguments, and return the resulting
2807@code{<derivation>} object.
874e6874 2808
2096ef47 2809When @var{hash} and @var{hash-algo} are given, a
874e6874 2810@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
2811known in advance, such as a file download. If, in addition,
2812@var{recursive?} is true, then that fixed output may be an executable
2813file or a directory and @var{hash} must be the hash of an archive
2814containing this output.
5b0c9d16 2815
858e9282 2816When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
2817name/store path pairs. In that case, the reference graph of each store
2818path is exported in the build environment in the corresponding file, in
2819a simple text format.
1909431c 2820
b53be755
LC
2821When @var{allowed-references} is true, it must be a list of store items
2822or outputs that the derivation's output may refer to.
2823
c0468155
LC
2824When @var{leaked-env-vars} is true, it must be a list of strings
2825denoting environment variables that are allowed to ``leak'' from the
2826daemon's environment to the build environment. This is only applicable
2827to fixed-output derivations---i.e., when @var{hash} is true. The main
2828use is to allow variables such as @code{http_proxy} to be passed to
2829derivations that download files.
2830
1909431c
LC
2831When @var{local-build?} is true, declare that the derivation is not a
2832good candidate for offloading and should rather be built locally
2833(@pxref{Daemon Offload Setup}). This is the case for small derivations
2834where the costs of data transfers would outweigh the benefits.
4a6aeb67
LC
2835
2836When @var{substitutable?} is false, declare that substitutes of the
2837derivation's output should not be used (@pxref{Substitutes}). This is
2838useful, for instance, when building packages that capture details of the
2839host CPU instruction set.
874e6874
LC
2840@end deffn
2841
2842@noindent
2843Here's an example with a shell script as its builder, assuming
2844@var{store} is an open connection to the daemon, and @var{bash} points
2845to a Bash executable in the store:
2846
2847@lisp
2848(use-modules (guix utils)
2849 (guix store)
2850 (guix derivations))
2851
59688fc4
LC
2852(let ((builder ; add the Bash script to the store
2853 (add-text-to-store store "my-builder.sh"
2854 "echo hello world > $out\n" '())))
2855 (derivation store "foo"
2856 bash `("-e" ,builder)
21b679f6 2857 #:inputs `((,bash) (,builder))
59688fc4 2858 #:env-vars '(("HOME" . "/homeless"))))
834129e0 2859@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
2860@end lisp
2861
21b679f6
LC
2862As can be guessed, this primitive is cumbersome to use directly. A
2863better approach is to write build scripts in Scheme, of course! The
2864best course of action for that is to write the build code as a
2865``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 2866information, @pxref{G-Expressions}.
21b679f6
LC
2867
2868Once upon a time, @code{gexp->derivation} did not exist and constructing
2869derivations with build code written in Scheme was achieved with
2870@code{build-expression->derivation}, documented below. This procedure
2871is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 2872
dd1a5a15
LC
2873@deffn {Scheme Procedure} build-expression->derivation @var{store} @
2874 @var{name} @var{exp} @
2875 [#:system (%current-system)] [#:inputs '()] @
2876 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 2877 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824 2878 [#:references-graphs #f] [#:allowed-references #f] @
4a6aeb67 2879 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
874e6874
LC
2880Return a derivation that executes Scheme expression @var{exp} as a
2881builder for derivation @var{name}. @var{inputs} must be a list of
2882@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
2883@code{"out"} is assumed. @var{modules} is a list of names of Guile
2884modules from the current search path to be copied in the store,
2885compiled, and made available in the load path during the execution of
2886@var{exp}---e.g., @code{((guix build utils) (guix build
2887gnu-build-system))}.
2888
2889@var{exp} is evaluated in an environment where @code{%outputs} is bound
2890to a list of output/path pairs, and where @code{%build-inputs} is bound
2891to a list of string/output-path pairs made from @var{inputs}.
2892Optionally, @var{env-vars} is a list of string pairs specifying the name
2893and value of environment variables visible to the builder. The builder
2894terminates by passing the result of @var{exp} to @code{exit}; thus, when
2895@var{exp} returns @code{#f}, the build is considered to have failed.
2896
2897@var{exp} is built using @var{guile-for-build} (a derivation). When
2898@var{guile-for-build} is omitted or is @code{#f}, the value of the
2899@code{%guile-for-build} fluid is used instead.
9c629a27 2900
63a42824 2901See the @code{derivation} procedure for the meaning of
4a6aeb67
LC
2902@var{references-graphs}, @var{allowed-references}, @var{local-build?},
2903and @var{substitutable?}.
874e6874
LC
2904@end deffn
2905
2906@noindent
2907Here's an example of a single-output derivation that creates a directory
2908containing one file:
2909
2910@lisp
2911(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 2912 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
2913 (call-with-output-file (string-append out "/test")
2914 (lambda (p)
2915 (display '(hello guix) p))))))
dd1a5a15 2916 (build-expression->derivation store "goo" builder))
874e6874 2917
834129e0 2918@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
2919@end lisp
2920
568717fd 2921
b860f382
LC
2922@node The Store Monad
2923@section The Store Monad
2924
2925@cindex monad
2926
2927The procedures that operate on the store described in the previous
2928sections all take an open connection to the build daemon as their first
2929argument. Although the underlying model is functional, they either have
2930side effects or depend on the current state of the store.
2931
2932The former is inconvenient: the connection to the build daemon has to be
2933carried around in all those functions, making it impossible to compose
2934functions that do not take that parameter with functions that do. The
2935latter can be problematic: since store operations have side effects
2936and/or depend on external state, they have to be properly sequenced.
2937
2938@cindex monadic values
2939@cindex monadic functions
2940This is where the @code{(guix monads)} module comes in. This module
2941provides a framework for working with @dfn{monads}, and a particularly
2942useful monad for our uses, the @dfn{store monad}. Monads are a
2943construct that allows two things: associating ``context'' with values
2944(in our case, the context is the store), and building sequences of
561fb6c3 2945computations (here computations include accesses to the store.) Values
b860f382
LC
2946in a monad---values that carry this additional context---are called
2947@dfn{monadic values}; procedures that return such values are called
2948@dfn{monadic procedures}.
2949
2950Consider this ``normal'' procedure:
2951
2952@example
45adbd62
LC
2953(define (sh-symlink store)
2954 ;; Return a derivation that symlinks the 'bash' executable.
2955 (let* ((drv (package-derivation store bash))
2956 (out (derivation->output-path drv))
2957 (sh (string-append out "/bin/bash")))
2958 (build-expression->derivation store "sh"
2959 `(symlink ,sh %output))))
b860f382
LC
2960@end example
2961
c6f30b81
LC
2962Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
2963as a monadic function:
b860f382
LC
2964
2965@example
45adbd62 2966(define (sh-symlink)
b860f382 2967 ;; Same, but return a monadic value.
c6f30b81
LC
2968 (mlet %store-monad ((drv (package->derivation bash)))
2969 (gexp->derivation "sh"
2970 #~(symlink (string-append #$drv "/bin/bash")
2971 #$output))))
b860f382
LC
2972@end example
2973
c6f30b81
LC
2974There several things to note in the second version: the @code{store}
2975parameter is now implicit and is ``threaded'' in the calls to the
2976@code{package->derivation} and @code{gexp->derivation} monadic
2977procedures, and the monadic value returned by @code{package->derivation}
2978is @dfn{bound} using @code{mlet} instead of plain @code{let}.
2979
2980As it turns out, the call to @code{package->derivation} can even be
2981omitted since it will take place implicitly, as we will see later
2982(@pxref{G-Expressions}):
2983
2984@example
2985(define (sh-symlink)
2986 (gexp->derivation "sh"
2987 #~(symlink (string-append #$bash "/bin/bash")
2988 #$output)))
2989@end example
b860f382 2990
7ce21611
LC
2991@c See
2992@c <https://syntaxexclamation.wordpress.com/2014/06/26/escaping-continuations/>
2993@c for the funny quote.
2994Calling the monadic @code{sh-symlink} has no effect. As someone once
2995said, ``you exit a monad like you exit a building on fire: by running''.
2996So, to exit the monad and get the desired effect, one must use
2997@code{run-with-store}:
b860f382
LC
2998
2999@example
8e9aa37f
CAW
3000(run-with-store (open-connection) (sh-symlink))
3001@result{} /gnu/store/...-sh-symlink
b860f382
LC
3002@end example
3003
b9b86078
LC
3004Note that the @code{(guix monad-repl)} module extends Guile's REPL with
3005new ``meta-commands'' to make it easier to deal with monadic procedures:
3006@code{run-in-store}, and @code{enter-store-monad}. The former, is used
3007to ``run'' a single monadic value through the store:
3008
3009@example
3010scheme@@(guile-user)> ,run-in-store (package->derivation hello)
3011$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
3012@end example
3013
3014The latter enters a recursive REPL, where all the return values are
3015automatically run through the store:
3016
3017@example
3018scheme@@(guile-user)> ,enter-store-monad
3019store-monad@@(guile-user) [1]> (package->derivation hello)
3020$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
3021store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
3022$3 = "/gnu/store/@dots{}-foo"
3023store-monad@@(guile-user) [1]> ,q
3024scheme@@(guile-user)>
3025@end example
3026
3027@noindent
3028Note that non-monadic values cannot be returned in the
3029@code{store-monad} REPL.
3030
e87f0591
LC
3031The main syntactic forms to deal with monads in general are provided by
3032the @code{(guix monads)} module and are described below.
b860f382
LC
3033
3034@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
3035Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
3036in @var{monad}.
3037@end deffn
3038
3039@deffn {Scheme Syntax} return @var{val}
3040Return a monadic value that encapsulates @var{val}.
3041@end deffn
3042
751630c9 3043@deffn {Scheme Syntax} >>= @var{mval} @var{mproc} ...
b860f382 3044@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
751630c9
LC
3045procedures @var{mproc}@dots{}@footnote{This operation is commonly
3046referred to as ``bind'', but that name denotes an unrelated procedure in
3047Guile. Thus we use this somewhat cryptic symbol inherited from the
3048Haskell language.}. There can be one @var{mproc} or several of them, as
3049in this example:
3050
3051@example
3052(run-with-state
3053 (with-monad %state-monad
3054 (>>= (return 1)
3055 (lambda (x) (return (+ 1 x)))
3056 (lambda (x) (return (* 2 x)))))
3057 'some-state)
3058
3059@result{} 4
3060@result{} some-state
3061@end example
b860f382
LC
3062@end deffn
3063
3064@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
3065 @var{body} ...
3066@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
3067 @var{body} ...
3068Bind the variables @var{var} to the monadic values @var{mval} in
3069@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
3070``normal'' value @var{val}, as per @code{let}.
3071
3072@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
3073(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
3074@end deffn
3075
405a9d4e
LC
3076@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
3077Bind @var{mexp} and the following monadic expressions in sequence,
3078returning the result of the last expression.
3079
3080This is akin to @code{mlet}, except that the return values of the
3081monadic expressions are ignored. In that sense, it is analogous to
3082@code{begin}, but applied to monadic expressions.
3083@end deffn
3084
561fb6c3
LC
3085@cindex state monad
3086The @code{(guix monads)} module provides the @dfn{state monad}, which
3087allows an additional value---the state---to be @emph{threaded} through
3088monadic procedure calls.
3089
3090@defvr {Scheme Variable} %state-monad
3091The state monad. Procedures in the state monad can access and change
3092the state that is threaded.
3093
3094Consider the example below. The @code{square} procedure returns a value
3095in the state monad. It returns the square of its argument, but also
3096increments the current state value:
3097
3098@example
3099(define (square x)
3100 (mlet %state-monad ((count (current-state)))
3101 (mbegin %state-monad
3102 (set-current-state (+ 1 count))
3103 (return (* x x)))))
3104
3105(run-with-state (sequence %state-monad (map square (iota 3))) 0)
3106@result{} (0 1 4)
3107@result{} 3
3108@end example
3109
3110When ``run'' through @var{%state-monad}, we obtain that additional state
3111value, which is the number of @code{square} calls.
3112@end defvr
3113
3114@deffn {Monadic Procedure} current-state
3115Return the current state as a monadic value.
3116@end deffn
3117
3118@deffn {Monadic Procedure} set-current-state @var{value}
3119Set the current state to @var{value} and return the previous state as a
3120monadic value.
3121@end deffn
3122
3123@deffn {Monadic Procedure} state-push @var{value}
3124Push @var{value} to the current state, which is assumed to be a list,
3125and return the previous state as a monadic value.
3126@end deffn
3127
3128@deffn {Monadic Procedure} state-pop
3129Pop a value from the current state and return it as a monadic value.
3130The state is assumed to be a list.
3131@end deffn
3132
3133@deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
3134Run monadic value @var{mval} starting with @var{state} as the initial
3135state. Return two values: the resulting value, and the resulting state.
3136@end deffn
3137
e87f0591
LC
3138The main interface to the store monad, provided by the @code{(guix
3139store)} module, is as follows.
b860f382
LC
3140
3141@defvr {Scheme Variable} %store-monad
561fb6c3
LC
3142The store monad---an alias for @var{%state-monad}.
3143
3144Values in the store monad encapsulate accesses to the store. When its
3145effect is needed, a value of the store monad must be ``evaluated'' by
3146passing it to the @code{run-with-store} procedure (see below.)
b860f382
LC
3147@end defvr
3148
3149@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
3150Run @var{mval}, a monadic value in the store monad, in @var{store}, an
3151open store connection.
3152@end deffn
3153
ad372953 3154@deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
b860f382 3155Return as a monadic value the absolute file name in the store of the file
ad372953
LC
3156containing @var{text}, a string. @var{references} is a list of store items that the
3157resulting text file refers to; it defaults to the empty list.
45adbd62
LC
3158@end deffn
3159
0a90af15
LC
3160@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
3161 [#:recursive? #t]
3162Return the name of @var{file} once interned in the store. Use
3163@var{name} as its store name, or the basename of @var{file} if
3164@var{name} is omitted.
3165
3166When @var{recursive?} is true, the contents of @var{file} are added
3167recursively; if @var{file} designates a flat file and @var{recursive?}
3168is true, its contents are added, and its permission bits are kept.
3169
3170The example below adds a file to the store, under two different names:
3171
3172@example
3173(run-with-store (open-connection)
3174 (mlet %store-monad ((a (interned-file "README"))
3175 (b (interned-file "README" "LEGU-MIN")))
3176 (return (list a b))))
3177
3178@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
3179@end example
3180
3181@end deffn
3182
e87f0591
LC
3183The @code{(guix packages)} module exports the following package-related
3184monadic procedures:
3185
b860f382 3186@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
3187 [#:system (%current-system)] [#:target #f] @
3188 [#:output "out"] Return as a monadic
b860f382
LC
3189value in the absolute file name of @var{file} within the @var{output}
3190directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
3191of the @var{output} directory of @var{package}. When @var{target} is
3192true, use it as a cross-compilation target triplet.
b860f382
LC
3193@end deffn
3194
b860f382 3195@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
3196@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
3197 @var{target} [@var{system}]
3198Monadic version of @code{package-derivation} and
3199@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
3200@end deffn
3201
3202
21b679f6
LC
3203@node G-Expressions
3204@section G-Expressions
3205
3206@cindex G-expression
3207@cindex build code quoting
3208So we have ``derivations'', which represent a sequence of build actions
3209to be performed to produce an item in the store (@pxref{Derivations}).
3210Those build actions are performed when asking the daemon to actually
3211build the derivations; they are run by the daemon in a container
3212(@pxref{Invoking guix-daemon}).
3213
3214@cindex strata of code
3215It should come as no surprise that we like to write those build actions
3216in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
3217code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
3218Manuel Serrano et al.@: in the context of their work on Hop. Oleg
3219Kiselyov, who has written insightful
3220@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
3221on this topic}, refers to this kind of code generation as
3222@dfn{staging}.}: the ``host code''---code that defines packages, talks
3223to the daemon, etc.---and the ``build code''---code that actually
3224performs build actions, such as making directories, invoking
3225@command{make}, etc.
21b679f6
LC
3226
3227To describe a derivation and its build actions, one typically needs to
3228embed build code inside host code. It boils down to manipulating build
3229code as data, and Scheme's homoiconicity---code has a direct
3230representation as data---comes in handy for that. But we need more than
3231Scheme's normal @code{quasiquote} mechanism to construct build
3232expressions.
3233
3234The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
3235S-expressions adapted to build expressions. G-expressions, or
3236@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
3237@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
3238@code{#$}, and @code{#$@@}), which are comparable respectively to
3239@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
3240(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
3241Reference Manual}). However, there are major differences:
3242
3243@itemize
3244@item
3245Gexps are meant to be written to a file and run or manipulated by other
3246processes.
3247
3248@item
b39fc6f7
LC
3249When a high-level object such as a package or derivation is unquoted
3250inside a gexp, the result is as if its output file name had been
3251introduced.
ff40e9b7 3252
21b679f6
LC
3253@item
3254Gexps carry information about the packages or derivations they refer to,
3255and these dependencies are automatically added as inputs to the build
3256processes that use them.
3257@end itemize
3258
c2b84676 3259@cindex lowering, of high-level objects in gexps
343eacbe
LC
3260This mechanism is not limited to package and derivation
3261objects: @dfn{compilers} able to ``lower'' other high-level objects to
c2b84676
LC
3262derivations or files in the store can be defined,
3263such that these objects can also be inserted
343eacbe
LC
3264into gexps. For example, a useful type of high-level object that can be
3265inserted in a gexp is ``file-like objects'', which make it easy to
3266add files to the store and refer to them in
558e8b11
LC
3267derivations and such (see @code{local-file} and @code{plain-file}
3268below.)
b39fc6f7 3269
21b679f6
LC
3270To illustrate the idea, here is an example of a gexp:
3271
3272@example
3273(define build-exp
3274 #~(begin
3275 (mkdir #$output)
3276 (chdir #$output)
aff8ce7c 3277 (symlink (string-append #$coreutils "/bin/ls")
21b679f6
LC
3278 "list-files")))
3279@end example
3280
3281This gexp can be passed to @code{gexp->derivation}; we obtain a
3282derivation that builds a directory containing exactly one symlink to
3283@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
3284
3285@example
3286(gexp->derivation "the-thing" build-exp)
3287@end example
3288
e20fd1bf 3289As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
3290substituted to the reference to the @var{coreutils} package in the
3291actual build code, and @var{coreutils} is automatically made an input to
3292the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
3293output)}) is replaced by a string containing the derivation's output
667b2508
LC
3294directory name.
3295
3296@cindex cross compilation
3297In a cross-compilation context, it is useful to distinguish between
3298references to the @emph{native} build of a package---that can run on the
3299host---versus references to cross builds of a package. To that end, the
3300@code{#+} plays the same role as @code{#$}, but is a reference to a
3301native package build:
3302
3303@example
3304(gexp->derivation "vi"
3305 #~(begin
3306 (mkdir #$output)
3307 (system* (string-append #+coreutils "/bin/ln")
3308 "-s"
3309 (string-append #$emacs "/bin/emacs")
3310 (string-append #$output "/bin/vi")))
3311 #:target "mips64el-linux")
3312@end example
3313
3314@noindent
3315In the example above, the native build of @var{coreutils} is used, so
3316that @command{ln} can actually run on the host; but then the
3317cross-compiled build of @var{emacs} is referenced.
3318
3319The syntactic form to construct gexps is summarized below.
21b679f6
LC
3320
3321@deffn {Scheme Syntax} #~@var{exp}
3322@deffnx {Scheme Syntax} (gexp @var{exp})
3323Return a G-expression containing @var{exp}. @var{exp} may contain one
3324or more of the following forms:
3325
3326@table @code
3327@item #$@var{obj}
3328@itemx (ungexp @var{obj})
b39fc6f7
LC
3329Introduce a reference to @var{obj}. @var{obj} may have one of the
3330supported types, for example a package or a
21b679f6
LC
3331derivation, in which case the @code{ungexp} form is replaced by its
3332output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
3333
b39fc6f7
LC
3334If @var{obj} is a list, it is traversed and references to supported
3335objects are substituted similarly.
21b679f6
LC
3336
3337If @var{obj} is another gexp, its contents are inserted and its
3338dependencies are added to those of the containing gexp.
3339
3340If @var{obj} is another kind of object, it is inserted as is.
3341
b39fc6f7
LC
3342@item #$@var{obj}:@var{output}
3343@itemx (ungexp @var{obj} @var{output})
21b679f6 3344This is like the form above, but referring explicitly to the
b39fc6f7
LC
3345@var{output} of @var{obj}---this is useful when @var{obj} produces
3346multiple outputs (@pxref{Packages with Multiple Outputs}).
21b679f6 3347
667b2508
LC
3348@item #+@var{obj}
3349@itemx #+@var{obj}:output
3350@itemx (ungexp-native @var{obj})
3351@itemx (ungexp-native @var{obj} @var{output})
3352Same as @code{ungexp}, but produces a reference to the @emph{native}
3353build of @var{obj} when used in a cross compilation context.
3354
21b679f6
LC
3355@item #$output[:@var{output}]
3356@itemx (ungexp output [@var{output}])
3357Insert a reference to derivation output @var{output}, or to the main
3358output when @var{output} is omitted.
3359
3360This only makes sense for gexps passed to @code{gexp->derivation}.
3361
3362@item #$@@@var{lst}
3363@itemx (ungexp-splicing @var{lst})
3364Like the above, but splices the contents of @var{lst} inside the
3365containing list.
3366
667b2508
LC
3367@item #+@@@var{lst}
3368@itemx (ungexp-native-splicing @var{lst})
3369Like the above, but refers to native builds of the objects listed in
3370@var{lst}.
3371
21b679f6
LC
3372@end table
3373
3374G-expressions created by @code{gexp} or @code{#~} are run-time objects
3375of the @code{gexp?} type (see below.)
3376@end deffn
3377
3378@deffn {Scheme Procedure} gexp? @var{obj}
3379Return @code{#t} if @var{obj} is a G-expression.
3380@end deffn
3381
3382G-expressions are meant to be written to disk, either as code building
3383some derivation, or as plain files in the store. The monadic procedures
3384below allow you to do that (@pxref{The Store Monad}, for more
3385information about monads.)
3386
3387@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
ce45eb4c 3388 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
21b679f6
LC
3389 [#:hash #f] [#:hash-algo #f] @
3390 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 3391 [#:module-path @var{%load-path}] @
c8351d9a 3392 [#:references-graphs #f] [#:allowed-references #f] @
c0468155 3393 [#:leaked-env-vars #f] @
0309e1b0 3394 [#:script-name (string-append @var{name} "-builder")] @
4a6aeb67 3395 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
21b679f6 3396Return a derivation @var{name} that runs @var{exp} (a gexp) with
0309e1b0
LC
3397@var{guile-for-build} (a derivation) on @var{system}; @var{exp} is
3398stored in a file called @var{script-name}. When @var{target} is true,
3399it is used as the cross-compilation target triplet for packages referred
3400to by @var{exp}.
21b679f6 3401
ce45eb4c
LC
3402Make @var{modules} available in the evaluation context of @var{exp};
3403@var{modules} is a list of names of Guile modules searched in
3404@var{module-path} to be copied in the store, compiled, and made available in
21b679f6
LC
3405the load path during the execution of @var{exp}---e.g., @code{((guix
3406build utils) (guix build gnu-build-system))}.
3407
ce45eb4c
LC
3408@var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3409applicable.
3410
b53833b2
LC
3411When @var{references-graphs} is true, it must be a list of tuples of one of the
3412following forms:
3413
3414@example
3415(@var{file-name} @var{package})
3416(@var{file-name} @var{package} @var{output})
3417(@var{file-name} @var{derivation})
3418(@var{file-name} @var{derivation} @var{output})
3419(@var{file-name} @var{store-item})
3420@end example
3421
3422The right-hand-side of each element of @var{references-graphs} is automatically made
3423an input of the build process of @var{exp}. In the build environment, each
3424@var{file-name} contains the reference graph of the corresponding item, in a simple
3425text format.
3426
c8351d9a
LC
3427@var{allowed-references} must be either @code{#f} or a list of output names and packages.
3428In the latter case, the list denotes store items that the result is allowed to
3429refer to. Any reference to another store item will lead to a build error.
3430
e20fd1bf 3431The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
3432@end deffn
3433
343eacbe 3434@cindex file-like objects
e1c153e0
LC
3435The @code{local-file}, @code{plain-file}, @code{computed-file},
3436@code{program-file}, and @code{scheme-file} procedures below return
3437@dfn{file-like objects}. That is, when unquoted in a G-expression,
3438these objects lead to a file in the store. Consider this G-expression:
343eacbe
LC
3439
3440@example
3441#~(system* (string-append #$glibc "/sbin/nscd") "-f"
3442 #$(local-file "/tmp/my-nscd.conf"))
3443@end example
3444
3445The effect here is to ``intern'' @file{/tmp/my-nscd.conf} by copying it
3446to the store. Once expanded, for instance @i{via}
3447@code{gexp->derivation}, the G-expression refers to that copy under
3448@file{/gnu/store}; thus, modifying or removing the file in @file{/tmp}
3449does not have any effect on what the G-expression does.
3450@code{plain-file} can be used similarly; it differs in that the file
3451content is directly passed as a string.
3452
d9ae938f
LC
3453@deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
3454 [#:recursive? #t]
3455Return an object representing local file @var{file} to add to the store; this
3456object can be used in a gexp. @var{file} will be added to the store under @var{name}--by
3457default the base name of @var{file}.
3458
3459When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
3460designates a flat file and @var{recursive?} is true, its contents are added, and its
3461permission bits are kept.
3462
3463This is the declarative counterpart of the @code{interned-file} monadic
3464procedure (@pxref{The Store Monad, @code{interned-file}}).
3465@end deffn
3466
558e8b11
LC
3467@deffn {Scheme Procedure} plain-file @var{name} @var{content}
3468Return an object representing a text file called @var{name} with the given
3469@var{content} (a string) to be added to the store.
3470
3471This is the declarative counterpart of @code{text-file}.
3472@end deffn
3473
91937029
LC
3474@deffn {Scheme Procedure} computed-file @var{name} @var{gexp} @
3475 [#:modules '()] [#:options '(#:local-build? #t)]
3476Return an object representing the store item @var{name}, a file or
3477directory computed by @var{gexp}. @var{modules} specifies the set of
3478modules visible in the execution context of @var{gexp}. @var{options}
3479is a list of additional arguments to pass to @code{gexp->derivation}.
3480
3481This is the declarative counterpart of @code{gexp->derivation}.
3482@end deffn
3483
21b679f6
LC
3484@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
3485Return an executable script @var{name} that runs @var{exp} using
3486@var{guile} with @var{modules} in its search path.
3487
3488The example below builds a script that simply invokes the @command{ls}
3489command:
3490
3491@example
3492(use-modules (guix gexp) (gnu packages base))
3493
3494(gexp->script "list-files"
3495 #~(execl (string-append #$coreutils "/bin/ls")
3496 "ls"))
3497@end example
3498
3499When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 3500@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
3501executable file @file{/gnu/store/@dots{}-list-files} along these lines:
3502
3503@example
3504#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
3505!#
3506(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
3507 "ls")
3508@end example
3509@end deffn
3510
15a01c72
LC
3511@deffn {Scheme Procedure} program-file @var{name} @var{exp} @
3512 [#:modules '()] [#:guile #f]
3513Return an object representing the executable store item @var{name} that
3514runs @var{gexp}. @var{guile} is the Guile package used to execute that
3515script, and @var{modules} is the list of modules visible to that script.
3516
3517This is the declarative counterpart of @code{gexp->script}.
3518@end deffn
3519
21b679f6
LC
3520@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
3521Return a derivation that builds a file @var{name} containing @var{exp}.
3522
3523The resulting file holds references to all the dependencies of @var{exp}
3524or a subset thereof.
3525@end deffn
1ed19464 3526
e1c153e0
LC
3527@deffn {Scheme Procedure} scheme-file @var{name} @var{exp}
3528Return an object representing the Scheme file @var{name} that contains
3529@var{exp}.
3530
3531This is the declarative counterpart of @code{gexp->file}.
3532@end deffn
3533
1ed19464
LC
3534@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
3535Return as a monadic value a derivation that builds a text file
3536containing all of @var{text}. @var{text} may list, in addition to
d9ae938f
LC
3537strings, objects of any type that can be used in a gexp: packages,
3538derivations, local file objects, etc. The resulting store file holds
3539references to all these.
1ed19464
LC
3540
3541This variant should be preferred over @code{text-file} anytime the file
3542to create will reference items from the store. This is typically the
3543case when building a configuration file that embeds store file names,
3544like this:
3545
3546@example
3547(define (profile.sh)
3548 ;; Return the name of a shell script in the store that
3549 ;; initializes the 'PATH' environment variable.
3550 (text-file* "profile.sh"
3551 "export PATH=" coreutils "/bin:"
3552 grep "/bin:" sed "/bin\n"))
3553@end example
3554
3555In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
3556will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
3557preventing them from being garbage-collected during its lifetime.
3558@end deffn
21b679f6 3559
b751cde3
LC
3560@deffn {Scheme Procedure} mixed-text-file @var{name} @var{text} @dots{}
3561Return an object representing store file @var{name} containing
3562@var{text}. @var{text} is a sequence of strings and file-like objects,
3563as in:
3564
3565@example
3566(mixed-text-file "profile"
3567 "export PATH=" coreutils "/bin:" grep "/bin")
3568@end example
3569
3570This is the declarative counterpart of @code{text-file*}.
3571@end deffn
3572
21b679f6
LC
3573Of course, in addition to gexps embedded in ``host'' code, there are
3574also modules containing build tools. To make it clear that they are
3575meant to be used in the build stratum, these modules are kept in the
3576@code{(guix build @dots{})} name space.
3577
c2b84676
LC
3578@cindex lowering, of high-level objects in gexps
3579Internally, high-level objects are @dfn{lowered}, using their compiler,
3580to either derivations or store items. For instance, lowering a package
3581yields a derivation, and lowering a @code{plain-file} yields a store
3582item. This is achieved using the @code{lower-object} monadic procedure.
3583
3584@deffn {Monadic Procedure} lower-object @var{obj} [@var{system}] @
3585 [#:target #f]
3586Return as a value in @var{%store-monad} the derivation or store item
3587corresponding to @var{obj} for @var{system}, cross-compiling for
3588@var{target} if @var{target} is true. @var{obj} must be an object that
3589has an associated gexp compiler, such as a @code{<package>}.
3590@end deffn
3591
21b679f6 3592
568717fd
LC
3593@c *********************************************************************
3594@node Utilities
3595@chapter Utilities
3596
210cc920
LC
3597This section describes tools primarily targeted at developers and users
3598who write new package definitions. They complement the Scheme
3599programming interface of Guix in a convenient way.
3600
568717fd 3601@menu
37166310 3602* Invoking guix build:: Building packages from the command line.
39bee8a2 3603* Invoking guix edit:: Editing package definitions.
210cc920 3604* Invoking guix download:: Downloading a file and printing its hash.
37166310 3605* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 3606* Invoking guix import:: Importing package definitions.
37166310 3607* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 3608* Invoking guix lint:: Finding errors in package definitions.
fcc58db6 3609* Invoking guix size:: Profiling disk usage.
88856916 3610* Invoking guix graph:: Visualizing the graph of packages.
372c4bbc 3611* Invoking guix environment:: Setting up development environments.
aff8ce7c 3612* Invoking guix publish:: Sharing substitutes.
d23c20f1 3613* Invoking guix challenge:: Challenging substitute servers.
32efa254 3614* Invoking guix container:: Process isolation.
568717fd
LC
3615@end menu
3616
e49951eb
MW
3617@node Invoking guix build
3618@section Invoking @command{guix build}
568717fd 3619
e49951eb 3620The @command{guix build} command builds packages or derivations and
6798a8e4
LC
3621their dependencies, and prints the resulting store paths. Note that it
3622does not modify the user's profile---this is the job of the
e49951eb 3623@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
3624it is mainly useful for distribution developers.
3625
3626The general syntax is:
c78bd12b
LC
3627
3628@example
e49951eb 3629guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
3630@end example
3631
3632@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
3633the software distribution such as @code{coreutils} or
3634@code{coreutils-8.20}, or a derivation such as
834129e0 3635@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
3636package with the corresponding name (and optionally version) is searched
3637for among the GNU distribution modules (@pxref{Package Modules}).
3638
3639Alternatively, the @code{--expression} option may be used to specify a
3640Scheme expression that evaluates to a package; this is useful when
3641disambiguation among several same-named packages or package variants is
3642needed.
c78bd12b
LC
3643
3644The @var{options} may be zero or more of the following:
3645
3646@table @code
3647
34a1783f
DT
3648@item --file=@var{file}
3649@itemx -f @var{file}
3650
3651Build the package or derivation that the code within @var{file}
3652evaluates to.
3653
3654As an example, @var{file} might contain a package definition like this
3655(@pxref{Defining Packages}):
3656
3657@example
3658@verbatiminclude package-hello.scm
3659@end example
3660
c78bd12b
LC
3661@item --expression=@var{expr}
3662@itemx -e @var{expr}
ac5de156 3663Build the package or derivation @var{expr} evaluates to.
c78bd12b 3664
5401dd75 3665For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
3666guile-1.8)}, which unambiguously designates this specific variant of
3667version 1.8 of Guile.
3668
56b82106
LC
3669Alternately, @var{expr} may be a G-expression, in which case it is used
3670as a build program passed to @code{gexp->derivation}
3671(@pxref{G-Expressions}).
3672
3673Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
3674(@pxref{The Store Monad}). The procedure must return a derivation as a
3675monadic value, which is then passed through @code{run-with-store}.
3676
c78bd12b
LC
3677@item --source
3678@itemx -S
3679Build the packages' source derivations, rather than the packages
3680themselves.
3681
e49951eb 3682For instance, @code{guix build -S gcc} returns something like
834129e0 3683@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 3684
f9cc8971
LC
3685The returned source tarball is the result of applying any patches and
3686code snippets specified in the package's @code{origin} (@pxref{Defining
3687Packages}).
3688
2cdfe13d
EB
3689@item --sources
3690Fetch and return the source of @var{package-or-derivation} and all their
3691dependencies, recursively. This is a handy way to obtain a local copy
3692of all the source code needed to build @var{packages}, allowing you to
3693eventually build them even without network access. It is an extension
3694of the @code{--source} option and can accept one of the following
3695optional argument values:
3696
3697@table @code
3698@item package
3699This value causes the @code{--sources} option to behave in the same way
3700as the @code{--source} option.
3701
3702@item all
3703Build all packages' source derivations, including any source that might
3704be listed as @code{inputs}. This is the default value.
3705
3706@example
3707$ guix build --sources tzdata
3708The following derivations will be built:
3709 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
3710 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3711@end example
3712
3713@item transitive
3714Build all packages' source derivations, as well as all source
3715derivations for packages' transitive inputs. This can be used e.g. to
3716prefetch package source for later offline building.
3717
3718@example
3719$ guix build --sources=transitive tzdata
3720The following derivations will be built:
3721 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3722 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
3723 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
3724 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
3725 /gnu/store/@dots{}-make-4.1.tar.xz.drv
3726 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
3727@dots{}
3728@end example
3729
3730@end table
3731
c78bd12b
LC
3732@item --system=@var{system}
3733@itemx -s @var{system}
3734Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
3735the host's system type.
3736
3737An example use of this is on Linux-based systems, which can emulate
3738different personalities. For instance, passing
3739@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
3740to build packages in a complete 32-bit environment.
3741
e55ec43d
LC
3742@item --target=@var{triplet}
3743@cindex cross-compilation
3744Cross-build for @var{triplet}, which must be a valid GNU triplet, such
3745as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
3746configuration triplets,, configure, GNU Configure and Build System}).
3747
7f3673f2
LC
3748@item --with-source=@var{source}
3749Use @var{source} as the source of the corresponding package.
3750@var{source} must be a file name or a URL, as for @command{guix
3751download} (@pxref{Invoking guix download}).
3752
3753The ``corresponding package'' is taken to be one specified on the
3754command line whose name matches the base of @var{source}---e.g., if
3755@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
3756package is @code{guile}. Likewise, the version string is inferred from
3757@var{source}; in the previous example, it's @code{2.0.10}.
3758
3759This option allows users to try out versions of packages other than the
3760one provided by the distribution. The example below downloads
3761@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
3762the @code{ed} package:
3763
3764@example
3765guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
3766@end example
3767
3768As a developer, @code{--with-source} makes it easy to test release
3769candidates:
3770
3771@example
3772guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
3773@end example
3774
a43b55f1
LC
3775@dots{} or to build from a checkout in a pristine environment:
3776
3777@example
3778$ git clone git://git.sv.gnu.org/guix.git
3779$ guix build guix --with-source=./guix
3780@end example
3781
05962f29
LC
3782@item --no-grafts
3783Do not ``graft'' packages. In practice, this means that package updates
3784available as grafts are not applied. @xref{Security Updates}, for more
3785information on grafts.
7f3673f2 3786
c78bd12b
LC
3787@item --derivations
3788@itemx -d
3789Return the derivation paths, not the output paths, of the given
3790packages.
3791
70ee5642
LC
3792@item --root=@var{file}
3793@itemx -r @var{file}
3794Make @var{file} a symlink to the result, and register it as a garbage
3795collector root.
3796
3797@item --log-file
3f208ad7 3798Return the build log file names or URLs for the given
70ee5642
LC
3799@var{package-or-derivation}s, or raise an error if build logs are
3800missing.
3801
3802This works regardless of how packages or derivations are specified. For
3803instance, the following invocations are equivalent:
3804
3805@example
3806guix build --log-file `guix build -d guile`
3807guix build --log-file `guix build guile`
3808guix build --log-file guile
3809guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
3810@end example
3811
3f208ad7
LC
3812If a log is unavailable locally, and unless @code{--no-substitutes} is
3813passed, the command looks for a corresponding log on one of the
3814substitute servers (as specified with @code{--substitute-urls}.)
70ee5642 3815
3f208ad7
LC
3816So for instance, let's say you want to see the build log of GDB on MIPS
3817but you're actually on an @code{x86_64} machine:
3818
3819@example
3820$ guix build --log-file gdb -s mips64el-linux
3821http://hydra.gnu.org/log/@dots{}-gdb-7.10
3822@end example
3823
3824You can freely access a huge library of build logs!
70ee5642
LC
3825@end table
3826
3827@cindex common build options
3828In addition, a number of options that control the build process are
3829common to @command{guix build} and other commands that can spawn builds,
3830such as @command{guix package} or @command{guix archive}. These are the
3831following:
3832
3833@table @code
3834
300868ba
LC
3835@item --load-path=@var{directory}
3836@itemx -L @var{directory}
3837Add @var{directory} to the front of the package module search path
3838(@pxref{Package Modules}).
3839
3840This allows users to define their own packages and make them visible to
3841the command-line tools.
3842
c78bd12b
LC
3843@item --keep-failed
3844@itemx -K
3845Keep the build tree of failed builds. Thus, if a build fail, its build
3846tree is kept under @file{/tmp}, in a directory whose name is shown at
3847the end of the build log. This is useful when debugging build issues.
3848
3849@item --dry-run
3850@itemx -n
3851Do not build the derivations.
3852
56b1f4b7
LC
3853@item --fallback
3854When substituting a pre-built binary fails, fall back to building
3855packages locally.
3856
f8a8e0fe
LC
3857@item --substitute-urls=@var{urls}
3858@anchor{client-substitute-urls}
3859Consider @var{urls} the whitespace-separated list of substitute source
3860URLs, overriding the default list of URLs of @command{guix-daemon}
3861(@pxref{daemon-substitute-urls,, @command{guix-daemon} URLs}).
3862
3863This means that substitutes may be downloaded from @var{urls}, provided
3864they are signed by a key authorized by the system administrator
3865(@pxref{Substitutes}).
3866
c78bd12b 3867@item --no-substitutes
b5385b52 3868Do not use substitutes for build products. That is, always build things
c4202d60
LC
3869locally instead of allowing downloads of pre-built binaries
3870(@pxref{Substitutes}).
c78bd12b 3871
425b0bfc 3872@item --no-build-hook
4ec2e92d
LC
3873Do not attempt to offload builds @i{via} the daemon's ``build hook''
3874(@pxref{Daemon Offload Setup}). That is, always build things locally
3875instead of offloading builds to remote machines.
425b0bfc 3876
969e678e
LC
3877@item --max-silent-time=@var{seconds}
3878When the build or substitution process remains silent for more than
3879@var{seconds}, terminate it and report a build failure.
3880
002622b6
LC
3881@item --timeout=@var{seconds}
3882Likewise, when the build or substitution process lasts for more than
3883@var{seconds}, terminate it and report a build failure.
3884
3885By default there is no timeout. This behavior can be restored with
3886@code{--timeout=0}.
3887
07ab4bf1
LC
3888@item --verbosity=@var{level}
3889Use the given verbosity level. @var{level} must be an integer between 0
3890and 5; higher means more verbose output. Setting a level of 4 or more
3891may be helpful when debugging setup issues with the build daemon.
3892
70ee5642
LC
3893@item --cores=@var{n}
3894@itemx -c @var{n}
3895Allow the use of up to @var{n} CPU cores for the build. The special
3896value @code{0} means to use as many CPU cores as available.
bf421152 3897
f6526eb3
LC
3898@item --max-jobs=@var{n}
3899@itemx -M @var{n}
3900Allow at most @var{n} build jobs in parallel. @xref{Invoking
3901guix-daemon, @code{--max-jobs}}, for details about this option and the
3902equivalent @command{guix-daemon} option.
3903
c78bd12b
LC
3904@end table
3905
e49951eb 3906Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
3907the @code{package-derivation} procedure of the @code{(guix packages)}
3908module, and to the @code{build-derivations} procedure of the @code{(guix
01d8ac64 3909derivations)} module.
c78bd12b 3910
16eb115e
DP
3911In addition to options explicitly passed on the command line,
3912@command{guix build} and other @command{guix} commands that support
3913building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
3914
3915@defvr {Environment Variable} GUIX_BUILD_OPTIONS
3916Users can define this variable to a list of command line options that
3917will automatically be used by @command{guix build} and other
3918@command{guix} commands that can perform builds, as in the example
3919below:
3920
3921@example
3922$ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
3923@end example
3924
847391fe
DP
3925These options are parsed independently, and the result is appended to
3926the parsed command-line options.
16eb115e
DP
3927@end defvr
3928
3929
39bee8a2
LC
3930@node Invoking guix edit
3931@section Invoking @command{guix edit}
3932
3933@cindex package definition, editing
3934So many packages, so many source files! The @command{guix edit} command
3935facilitates the life of packagers by pointing their editor at the source
3936file containing the definition of the specified packages. For instance:
3937
3938@example
3939guix edit gcc-4.8 vim
3940@end example
3941
3942@noindent
6237b9fa
LC
3943launches the program specified in the @code{VISUAL} or in the
3944@code{EDITOR} environment variable to edit the recipe of GCC@tie{}4.8.4
3945and that of Vim.
39bee8a2
LC
3946
3947If you are using Emacs, note that the Emacs user interface provides
6248e326
AK
3948similar functionality in the ``package info'' and ``package list''
3949buffers created by @kbd{M-x guix-search-by-name} and similar commands
3950(@pxref{Emacs Commands}).
39bee8a2
LC
3951
3952
210cc920
LC
3953@node Invoking guix download
3954@section Invoking @command{guix download}
3955
3956When writing a package definition, developers typically need to download
3957the package's source tarball, compute its SHA256 hash, and write that
3958hash in the package definition (@pxref{Defining Packages}). The
3959@command{guix download} tool helps with this task: it downloads a file
3960from the given URI, adds it to the store, and prints both its file name
3961in the store and its SHA256 hash.
3962
3963The fact that the downloaded file is added to the store saves bandwidth:
3964when the developer eventually tries to build the newly defined package
3965with @command{guix build}, the source tarball will not have to be
3966downloaded again because it is already in the store. It is also a
3967convenient way to temporarily stash files, which may be deleted
3968eventually (@pxref{Invoking guix gc}).
3969
3970The @command{guix download} command supports the same URIs as used in
3971package definitions. In particular, it supports @code{mirror://} URIs.
3972@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
3973Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
3974they are not available, an error is raised. @xref{Guile Preparations,
3975how to install the GnuTLS bindings for Guile,, gnutls-guile,
3976GnuTLS-Guile}, for more information.
210cc920
LC
3977
3978The following option is available:
3979
3980@table @code
3981@item --format=@var{fmt}
3982@itemx -f @var{fmt}
3983Write the hash in the format specified by @var{fmt}. For more
081145cf 3984information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
3985@end table
3986
6c365eca
NK
3987@node Invoking guix hash
3988@section Invoking @command{guix hash}
3989
210cc920 3990The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
3991It is primarily a convenience tool for anyone contributing to the
3992distribution: it computes the cryptographic hash of a file, which can be
3993used in the definition of a package (@pxref{Defining Packages}).
3994
3995The general syntax is:
3996
3997@example
3998guix hash @var{option} @var{file}
3999@end example
4000
4001@command{guix hash} has the following option:
4002
4003@table @code
4004
4005@item --format=@var{fmt}
4006@itemx -f @var{fmt}
210cc920 4007Write the hash in the format specified by @var{fmt}.
6c365eca
NK
4008
4009Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
4010(@code{hex} and @code{hexadecimal} can be used as well).
4011
4012If the @option{--format} option is not specified, @command{guix hash}
4013will output the hash in @code{nix-base32}. This representation is used
4014in the definitions of packages.
4015
3140f2df
LC
4016@item --recursive
4017@itemx -r
4018Compute the hash on @var{file} recursively.
4019
4020In this case, the hash is computed on an archive containing @var{file},
4021including its children if it is a directory. Some of @var{file}'s
4022meta-data is part of the archive; for instance, when @var{file} is a
4023regular file, the hash is different depending on whether @var{file} is
4024executable or not. Meta-data such as time stamps has no impact on the
4025hash (@pxref{Invoking guix archive}).
4026@c FIXME: Replace xref above with xref to an ``Archive'' section when
4027@c it exists.
4028
6c365eca
NK
4029@end table
4030
2f7d2d91
LC
4031@node Invoking guix import
4032@section Invoking @command{guix import}
4033
4034@cindex importing packages
4035@cindex package import
4036@cindex package conversion
4037The @command{guix import} command is useful for people willing to add a
4038package to the distribution but who'd rather do as little work as
4039possible to get there---a legitimate demand. The command knows of a few
4040repositories from which it can ``import'' package meta-data. The result
4041is a package definition, or a template thereof, in the format we know
4042(@pxref{Defining Packages}).
4043
4044The general syntax is:
4045
4046@example
4047guix import @var{importer} @var{options}@dots{}
4048@end example
4049
4050@var{importer} specifies the source from which to import package
4051meta-data, and @var{options} specifies a package identifier and other
4052options specific to @var{importer}. Currently, the available
4053``importers'' are:
4054
4055@table @code
4056@item gnu
4057Import meta-data for the given GNU package. This provides a template
4058for the latest version of that GNU package, including the hash of its
4059source tarball, and its canonical synopsis and description.
4060
4061Additional information such as the package's dependencies and its
4062license needs to be figured out manually.
4063
4064For example, the following command returns a package definition for
4065GNU@tie{}Hello:
4066
4067@example
4068guix import gnu hello
4069@end example
4070
4071Specific command-line options are:
4072
4073@table @code
4074@item --key-download=@var{policy}
4075As for @code{guix refresh}, specify the policy to handle missing OpenPGP
4076keys when verifying the package's signature. @xref{Invoking guix
4077refresh, @code{--key-download}}.
4078@end table
4079
4080@item pypi
4081@cindex pypi
4082Import meta-data from the @uref{https://pypi.python.org/, Python Package
4083Index}@footnote{This functionality requires Guile-JSON to be installed.
4084@xref{Requirements}.}. Information is taken from the JSON-formatted
4085description available at @code{pypi.python.org} and usually includes all
4086the relevant information, including package dependencies.
4087
4088The command below imports meta-data for the @code{itsdangerous} Python
4089package:
4090
4091@example
4092guix import pypi itsdangerous
4093@end example
4094
3aae8145
DT
4095@item gem
4096@cindex gem
4097Import meta-data from @uref{https://rubygems.org/,
4098RubyGems}@footnote{This functionality requires Guile-JSON to be
4099installed. @xref{Requirements}.}. Information is taken from the
4100JSON-formatted description available at @code{rubygems.org} and includes
4101most relevant information, including runtime dependencies. There are
4102some caveats, however. The meta-data doesn't distinguish between
4103synopses and descriptions, so the same string is used for both fields.
4104Additionally, the details of non-Ruby dependencies required to build
4105native extensions is unavailable and left as an exercise to the
4106packager.
4107
4108The command below imports meta-data for the @code{rails} Ruby package:
4109
4110@example
4111guix import gem rails
4112@end example
4113
d45dc6da
EB
4114@item cpan
4115@cindex CPAN
4116Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}.
4117Information is taken from the JSON-formatted meta-data provided through
4118@uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
66392e47
EB
4119relevant information, such as module dependencies. License information
4120should be checked closely. If Perl is available in the store, then the
4121@code{corelist} utility will be used to filter core modules out of the
4122list of dependencies.
d45dc6da
EB
4123
4124The command command below imports meta-data for the @code{Acme::Boolean}
4125Perl module:
4126
4127@example
4128guix import cpan Acme::Boolean
4129@end example
4130
e1248602
RW
4131@item cran
4132@cindex CRAN
4133Import meta-data from @uref{http://cran.r-project.org/, CRAN}, the
4134central repository for the @uref{http://r-project.org, GNU@tie{}R
4135statistical and graphical environment}.
4136
4137Information is extracted from the HTML package description.
4138
4139The command command below imports meta-data for the @code{Cairo}
4140R package:
4141
4142@example
4143guix import cran Cairo
4144@end example
4145
2f7d2d91
LC
4146@item nix
4147Import meta-data from a local copy of the source of the
4148@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
4149relies on the @command{nix-instantiate} command of
4150@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
4151typically written in a mixture of Nix-language and Bash code. This
4152command only imports the high-level package structure that is written in
4153the Nix language. It normally includes all the basic fields of a
4154package definition.
4155
4156When importing a GNU package, the synopsis and descriptions are replaced
4157by their canonical upstream variant.
4158
961d0d2d
LC
4159Usually, you will first need to do:
4160
4161@example
4162export NIX_REMOTE=daemon
4163@end example
4164
4165@noindent
4166so that @command{nix-instantiate} does not try to open the Nix database.
4167
2f7d2d91
LC
4168As an example, the command below imports the package definition of
4169LibreOffice (more precisely, it imports the definition of the package
4170bound to the @code{libreoffice} top-level attribute):
4171
4172@example
4173guix import nix ~/path/to/nixpkgs libreoffice
4174@end example
863af4e1
FB
4175
4176@item hackage
4177@cindex hackage
4178Import meta-data from Haskell community's central package archive
4179@uref{https://hackage.haskell.org/, Hackage}. Information is taken from
4180Cabal files and includes all the relevant information, including package
4181dependencies.
4182
4183Specific command-line options are:
4184
4185@table @code
a4154748
FB
4186@item --stdin
4187@itemx -s
4188Read a Cabal file from the standard input.
863af4e1
FB
4189@item --no-test-dependencies
4190@itemx -t
a4154748
FB
4191Do not include dependencies required by the test suites only.
4192@item --cabal-environment=@var{alist}
4193@itemx -e @var{alist}
4194@var{alist} is a Scheme alist defining the environment in which the
4195Cabal conditionals are evaluated. The accepted keys are: @code{os},
4196@code{arch}, @code{impl} and a string representing the name of a flag.
4197The value associated with a flag has to be either the symbol
4198@code{true} or @code{false}. The value associated with other keys
4199has to conform to the Cabal file format definition. The default value
4200associated with the keys @code{os}, @code{arch} and @code{impl} is
4201@samp{linux}, @samp{x86_64} and @samp{ghc} respectively.
863af4e1
FB
4202@end table
4203
4204The command below imports meta-data for the latest version of the
a4154748
FB
4205@code{HTTP} Haskell package without including test dependencies and
4206specifying the value of the flag @samp{network-uri} as @code{false}:
863af4e1
FB
4207
4208@example
a4154748 4209guix import hackage -t -e "'((\"network-uri\" . false))" HTTP
863af4e1
FB
4210@end example
4211
4212A specific package version may optionally be specified by following the
4213package name by a hyphen and a version number as in the following example:
4214
4215@example
4216guix import hackage mtl-2.1.3.1
4217@end example
7f74a931
FB
4218
4219@item elpa
4220@cindex elpa
4221Import meta-data from an Emacs Lisp Package Archive (ELPA) package
4222repository (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
4223
4224Specific command-line options are:
4225
4226@table @code
4227@item --archive=@var{repo}
4228@itemx -a @var{repo}
4229@var{repo} identifies the archive repository from which to retrieve the
4230information. Currently the supported repositories and their identifiers
4231are:
4232@itemize -
4233@item
840bd1d3 4234@uref{http://elpa.gnu.org/packages, GNU}, selected by the @code{gnu}
7f74a931
FB
4235identifier. This is the default.
4236
4237@item
840bd1d3 4238@uref{http://stable.melpa.org/packages, MELPA-Stable}, selected by the
7f74a931
FB
4239@code{melpa-stable} identifier.
4240
4241@item
840bd1d3 4242@uref{http://melpa.org/packages, MELPA}, selected by the @code{melpa}
7f74a931
FB
4243identifier.
4244@end itemize
4245@end table
2f7d2d91
LC
4246@end table
4247
4248The structure of the @command{guix import} code is modular. It would be
4249useful to have more importers for other package formats, and your help
4250is welcome here (@pxref{Contributing}).
4251
37166310
LC
4252@node Invoking guix refresh
4253@section Invoking @command{guix refresh}
4254
4255The primary audience of the @command{guix refresh} command is developers
4256of the GNU software distribution. By default, it reports any packages
4257provided by the distribution that are outdated compared to the latest
4258upstream version, like this:
4259
4260@example
4261$ guix refresh
4262gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
4263gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
4264@end example
4265
4266It does so by browsing each package's FTP directory and determining the
bcb571cb
LC
4267highest version number of the source tarballs therein. The command
4268knows how to update specific types of packages: GNU packages, ELPA
4269packages, etc.---see the documentation for @option{--type} below. The
4270are many packages, though, for which it lacks a method to determine
4271whether a new upstream release is available. However, the mechanism is
4272extensible, so feel free to get in touch with us to add a new method!
37166310
LC
4273
4274When passed @code{--update}, it modifies distribution source files to
4275update the version numbers and source tarball hashes of those packages'
4276recipes (@pxref{Defining Packages}). This is achieved by downloading
4277each package's latest source tarball and its associated OpenPGP
4278signature, authenticating the downloaded tarball against its signature
4279using @command{gpg}, and finally computing its hash. When the public
4280key used to sign the tarball is missing from the user's keyring, an
4281attempt is made to automatically retrieve it from a public key server;
4282when it's successful, the key is added to the user's keyring; otherwise,
4283@command{guix refresh} reports an error.
4284
4285The following options are supported:
4286
4287@table @code
4288
2d7fc7da
LC
4289@item --expression=@var{expr}
4290@itemx -e @var{expr}
4291Consider the package @var{expr} evaluates to.
4292
4293This is useful to precisely refer to a package, as in this example:
4294
4295@example
4296guix refresh -l -e '(@@@@ (gnu packages commencement) glibc-final)'
4297@end example
4298
4299This command lists the dependents of the ``final'' libc (essentially all
4300the packages.)
4301
37166310
LC
4302@item --update
4303@itemx -u
38e16b49
LC
4304Update distribution source files (package recipes) in place. This is
4305usually run from a checkout of the Guix source tree (@pxref{Running
4306Guix Before It Is Installed}):
4307
4308@example
4309$ ./pre-inst-env guix refresh -s non-core
4310@end example
4311
081145cf 4312@xref{Defining Packages}, for more information on package definitions.
37166310
LC
4313
4314@item --select=[@var{subset}]
4315@itemx -s @var{subset}
4316Select all the packages in @var{subset}, one of @code{core} or
4317@code{non-core}.
4318
4319The @code{core} subset refers to all the packages at the core of the
4320distribution---i.e., packages that are used to build ``everything
4321else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
4322changing one of these packages in the distribution entails a rebuild of
4323all the others. Thus, such updates are an inconvenience to users in
4324terms of build time or bandwidth used to achieve the upgrade.
4325
4326The @code{non-core} subset refers to the remaining packages. It is
4327typically useful in cases where an update of the core packages would be
4328inconvenient.
4329
bcb571cb
LC
4330@item --type=@var{updater}
4331@itemx -t @var{updater}
7191adc5
AK
4332Select only packages handled by @var{updater} (may be a comma-separated
4333list of updaters). Currently, @var{updater} may be one of:
bcb571cb
LC
4334
4335@table @code
4336@item gnu
4337the updater for GNU packages;
4338@item elpa
d882c235
LC
4339the updater for @uref{http://elpa.gnu.org/, ELPA} packages;
4340@item cran
b9d044ef 4341the updater for @uref{http://cran.r-project.org/, CRAN} packages;
bab020d7 4342@item pypi
b9d044ef 4343the updater for @uref{https://pypi.python.org, PyPI} packages.
bcb571cb
LC
4344@end table
4345
4346For instance, the following commands only checks for updates of Emacs
d882c235 4347packages hosted at @code{elpa.gnu.org} and updates of CRAN packages:
bcb571cb
LC
4348
4349@example
7191adc5 4350$ guix refresh --type=elpa,cran
d882c235 4351gnu/packages/statistics.scm:819:13: r-testthat would be upgraded from 0.10.0 to 0.11.0
bcb571cb
LC
4352gnu/packages/emacs.scm:856:13: emacs-auctex would be upgraded from 11.88.6 to 11.88.9
4353@end example
4354
37166310
LC
4355@end table
4356
4357In addition, @command{guix refresh} can be passed one or more package
4358names, as in this example:
4359
4360@example
38e16b49 4361$ ./pre-inst-env guix refresh -u emacs idutils gcc-4.8.4
37166310
LC
4362@end example
4363
4364@noindent
4365The command above specifically updates the @code{emacs} and
4366@code{idutils} packages. The @code{--select} option would have no
4367effect in this case.
4368
7d193ec3
EB
4369When considering whether to upgrade a package, it is sometimes
4370convenient to know which packages would be affected by the upgrade and
4371should be checked for compatibility. For this the following option may
4372be used when passing @command{guix refresh} one or more package names:
4373
4374@table @code
4375
6ffa706b
AK
4376@item --list-updaters
4377@itemx -L
4378List available updaters and exit (see @option{--type} above.)
4379
7d193ec3
EB
4380@item --list-dependent
4381@itemx -l
4382List top-level dependent packages that would need to be rebuilt as a
4383result of upgrading one or more packages.
4384
4385@end table
4386
4387Be aware that the @code{--list-dependent} option only
4388@emph{approximates} the rebuilds that would be required as a result of
4389an upgrade. More rebuilds might be required under some circumstances.
4390
4391@example
7779ab61
LC
4392$ guix refresh --list-dependent flex
4393Building the following 120 packages would ensure 213 dependent packages are rebuilt:
4394hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
4395@end example
4396
4397The command above lists a set of packages that could be built to check
4398for compatibility with an upgraded @code{flex} package.
4399
f9230085
LC
4400The following options can be used to customize GnuPG operation:
4401
4402@table @code
4403
f9230085
LC
4404@item --gpg=@var{command}
4405Use @var{command} as the GnuPG 2.x command. @var{command} is searched
4406for in @code{$PATH}.
4407
2bc53ba9
LC
4408@item --key-download=@var{policy}
4409Handle missing OpenPGP keys according to @var{policy}, which may be one
4410of:
4411
4412@table @code
4413@item always
4414Always download missing OpenPGP keys from the key server, and add them
4415to the user's GnuPG keyring.
4416
4417@item never
4418Never try to download missing OpenPGP keys. Instead just bail out.
4419
4420@item interactive
4421When a package signed with an unknown OpenPGP key is encountered, ask
4422the user whether to download it or not. This is the default behavior.
4423@end table
4424
4425@item --key-server=@var{host}
4426Use @var{host} as the OpenPGP key server when importing a public key.
4427
f9230085
LC
4428@end table
4429
b4f5e0e8
CR
4430@node Invoking guix lint
4431@section Invoking @command{guix lint}
4432The @command{guix lint} is meant to help package developers avoid common
873c4085
LC
4433errors and use a consistent style. It runs a number of checks on a
4434given set of packages in order to find common mistakes in their
4435definitions. Available @dfn{checkers} include (see
4436@code{--list-checkers} for a complete list):
4437
4438@table @code
4439@item synopsis
4440@itemx description
4441Validate certain typographical and stylistic rules about package
4442descriptions and synopses.
4443
4444@item inputs-should-be-native
4445Identify inputs that should most likely be native inputs.
4446
4447@item source
4448@itemx home-page
50f5c46d 4449@itemx source-file-name
873c4085 4450Probe @code{home-page} and @code{source} URLs and report those that are
50f5c46d
EB
4451invalid. Check that the source file name is meaningful, e.g. is not
4452just a version number or ``git-checkout'', and should not have a
4453@code{file-name} declared (@pxref{origin Reference}).
40a7d4e5 4454
5432734b
LC
4455@item cve
4456Report known vulnerabilities found in the Common Vulnerabilities and
4457Exposures (CVE) database
4458@uref{https://nvd.nist.gov/download.cfm#CVE_FEED, published by the US
4459NIST}.
4460
40a7d4e5
LC
4461@item formatting
4462Warn about obvious source code formatting issues: trailing white space,
4463use of tabulations, etc.
873c4085 4464@end table
b4f5e0e8
CR
4465
4466The general syntax is:
4467
4468@example
4469guix lint @var{options} @var{package}@dots{}
4470@end example
4471
4472If no package is given on the command line, then all packages are checked.
4473The @var{options} may be zero or more of the following:
4474
4475@table @code
4476
dd7c013d
CR
4477@item --checkers
4478@itemx -c
4479Only enable the checkers specified in a comma-separated list using the
4480names returned by @code{--list-checkers}.
4481
b4f5e0e8
CR
4482@item --list-checkers
4483@itemx -l
4484List and describe all the available checkers that will be run on packages
4485and exit.
4486
4487@end table
37166310 4488
fcc58db6
LC
4489@node Invoking guix size
4490@section Invoking @command{guix size}
4491
4492The @command{guix size} command helps package developers profile the
4493disk usage of packages. It is easy to overlook the impact of an
4494additional dependency added to a package, or the impact of using a
4495single output for a package that could easily be split (@pxref{Packages
4496with Multiple Outputs}). These are the typical issues that
4497@command{guix size} can highlight.
4498
4499The command can be passed a package specification such as @code{gcc-4.8}
4500or @code{guile:debug}, or a file name in the store. Consider this
4501example:
4502
4503@example
4504$ guix size coreutils
4505store item total self
4506/gnu/store/@dots{}-coreutils-8.23 70.0 13.9 19.8%
4507/gnu/store/@dots{}-gmp-6.0.0a 55.3 2.5 3.6%
4508/gnu/store/@dots{}-acl-2.2.52 53.7 0.5 0.7%
4509/gnu/store/@dots{}-attr-2.4.46 53.2 0.3 0.5%
4510/gnu/store/@dots{}-gcc-4.8.4-lib 52.9 15.7 22.4%
4511/gnu/store/@dots{}-glibc-2.21 37.2 37.2 53.1%
4512@end example
4513
4514@cindex closure
4515The store items listed here constitute the @dfn{transitive closure} of
4516Coreutils---i.e., Coreutils and all its dependencies, recursively---as
4517would be returned by:
4518
4519@example
4520$ guix gc -R /gnu/store/@dots{}-coreutils-8.23
4521@end example
4522
4523Here the output shows 3 columns next to store items. The first column,
4524labeled ``total'', shows the size in mebibytes (MiB) of the closure of
4525the store item---that is, its own size plus the size of all its
4526dependencies. The next column, labeled ``self'', shows the size of the
4527item itself. The last column shows the ratio of the item's size to the
4528space occupied by all the items listed here.
4529
4530In this example, we see that the closure of Coreutils weighs in at
453170@tie{}MiB, half of which is taken by libc. (That libc represents a
4532large fraction of the closure is not a problem @i{per se} because it is
4533always available on the system anyway.)
4534
4535When the package passed to @command{guix size} is available in the
4536store, @command{guix size} queries the daemon to determine its
4537dependencies, and measures its size in the store, similar to @command{du
4538-ms --apparent-size} (@pxref{du invocation,,, coreutils, GNU
4539Coreutils}).
4540
4541When the given package is @emph{not} in the store, @command{guix size}
4542reports information based on information about the available substitutes
4543(@pxref{Substitutes}). This allows it to profile disk usage of store
4544items that are not even on disk, only available remotely.
4545
a8f996c6 4546The available options are:
fcc58db6
LC
4547
4548@table @option
4549
d490d06e
LC
4550@item --substitute-urls=@var{urls}
4551Use substitute information from @var{urls}.
4552@xref{client-substitute-urls, the same option for @code{guix build}}.
4553
a8f996c6
LC
4554@item --map-file=@var{file}
4555Write to @var{file} a graphical map of disk usage as a PNG file.
4556
4557For the example above, the map looks like this:
4558
4559@image{images/coreutils-size-map,5in,, map of Coreutils disk usage
4560produced by @command{guix size}}
4561
4562This option requires that
4563@uref{http://wingolog.org/software/guile-charting/, Guile-Charting} be
4564installed and visible in Guile's module search path. When that is not
4565the case, @command{guix size} fails as it tries to load it.
4566
fcc58db6
LC
4567@item --system=@var{system}
4568@itemx -s @var{system}
4569Consider packages for @var{system}---e.g., @code{x86_64-linux}.
4570
4571@end table
4572
88856916
LC
4573@node Invoking guix graph
4574@section Invoking @command{guix graph}
4575
4576@cindex DAG
4577Packages and their dependencies form a @dfn{graph}, specifically a
4578directed acyclic graph (DAG). It can quickly become difficult to have a
4579mental model of the package DAG, so the @command{guix graph} command is
4580here to provide a visual representation of the DAG. @command{guix
4581graph} emits a DAG representation in the input format of
4582@uref{http://www.graphviz.org/, Graphviz}, so its output can be passed
4583directly to Graphviz's @command{dot} command, for instance. The general
4584syntax is:
4585
4586@example
4587guix graph @var{options} @var{package}@dots{}
4588@end example
4589
4590For example, the following command generates a PDF file representing the
4591package DAG for the GNU@tie{}Core Utilities, showing its build-time
4592dependencies:
4593
4594@example
4595guix graph coreutils | dot -Tpdf > dag.pdf
4596@end example
4597
4598The output looks like this:
4599
4600@image{images/coreutils-graph,2in,,Dependency graph of the GNU Coreutils}
4601
4602Nice little graph, no?
4603
4604But there's more than one graph! The one above is concise: it's the
4605graph of package objects, omitting implicit inputs such as GCC, libc,
4606grep, etc. It's often useful to have such a concise graph, but
4607sometimes you want to see more details. @command{guix graph} supports
4608several types of graphs, allowing you to choose the level of details:
4609
4610@table @code
4611@item package
4612This is the default type, the one we used above. It shows the DAG of
4613package objects, excluding implicit dependencies. It is concise, but
4614filters out many details.
4615
4616@item bag-emerged
4617This is the package DAG, @emph{including} implicit inputs.
4618
4619For instance, the following command:
4620
4621@example
4622guix graph --type=bag-emerged coreutils | dot -Tpdf > dag.pdf
4623@end example
4624
4625... yields this bigger graph:
4626
4627@image{images/coreutils-bag-graph,,5in,Detailed dependency graph of the GNU Coreutils}
4628
4629At the bottom of the graph, we see all the implicit inputs of
4630@var{gnu-build-system} (@pxref{Build Systems, @code{gnu-build-system}}).
4631
4632Now, note that the dependencies of those implicit inputs---that is, the
4633@dfn{bootstrap dependencies} (@pxref{Bootstrapping})---are not shown
4634here, for conciseness.
4635
4636@item bag
4637Similar to @code{bag-emerged}, but this time including all the bootstrap
4638dependencies.
4639
38b92daa
LC
4640@item bag-with-origins
4641Similar to @code{bag}, but also showing origins and their dependencies.
4642
88856916
LC
4643@item derivations
4644This is the most detailed representation: It shows the DAG of
4645derivations (@pxref{Derivations}) and plain store items. Compared to
4646the above representation, many additional nodes are visible, including
4647builds scripts, patches, Guile modules, etc.
4648
4649@end table
4650
4651All the above types correspond to @emph{build-time dependencies}. The
4652following graph type represents the @emph{run-time dependencies}:
4653
4654@table @code
4655@item references
4656This is the graph of @dfn{references} of a package output, as returned
4657by @command{guix gc --references} (@pxref{Invoking guix gc}).
4658
4659If the given package output is not available in the store, @command{guix
4660graph} attempts to obtain dependency information from substitutes.
4661@end table
4662
4663The available options are the following:
4664
4665@table @option
4666@item --type=@var{type}
4667@itemx -t @var{type}
4668Produce a graph output of @var{type}, where @var{type} must be one of
4669the values listed above.
4670
4671@item --list-types
4672List the supported graph types.
4c8f997a
LC
4673
4674@item --expression=@var{expr}
4675@itemx -e @var{expr}
4676Consider the package @var{expr} evaluates to.
4677
4678This is useful to precisely refer to a package, as in this example:
4679
4680@example
4681guix graph -e '(@@@@ (gnu packages commencement) gnu-make-final)'
4682@end example
88856916
LC
4683@end table
4684
4685
372c4bbc
DT
4686@node Invoking guix environment
4687@section Invoking @command{guix environment}
4688
f5fd4fd2 4689@cindex reproducible build environments
fe36d84e 4690@cindex development environments
372c4bbc
DT
4691The purpose of @command{guix environment} is to assist hackers in
4692creating reproducible development environments without polluting their
4693package profile. The @command{guix environment} tool takes one or more
4694packages, builds all of the necessary inputs, and creates a shell
4695environment to use them.
4696
4697The general syntax is:
4698
4699@example
4700guix environment @var{options} @var{package}@dots{}
4701@end example
4702
fe36d84e
LC
4703The following example spawns a new shell set up for the development of
4704GNU@tie{}Guile:
372c4bbc
DT
4705
4706@example
4707guix environment guile
4708@end example
4709
4710If the specified packages are not built yet, @command{guix environment}
4711automatically builds them. The new shell's environment is an augmented
4712version of the environment that @command{guix environment} was run in.
4713It contains the necessary search paths for building the given package
4714added to the existing environment variables. To create a ``pure''
4715environment in which the original environment variables have been unset,
50500f7c
LC
4716use the @code{--pure} option@footnote{Users sometimes wrongfully augment
4717environment variables such as @code{PATH} in their @file{~/.bashrc}
4718file. As a consequence, when @code{guix environment} launches it, Bash
4719may read @file{~/.bashrc}, thereby introducing ``impurities'' in these
4720environment variables. It is an error to define such environment
4721variables in @file{.bashrc}; instead, they should be defined in
4722@file{.bash_profile}, which is sourced only by log-in shells.
4723@xref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}, for
4724details on Bash start-up files.}.
372c4bbc 4725
28de8d25
LC
4726@vindex GUIX_ENVIRONMENT
4727@command{guix environment} defines the @code{GUIX_ENVIRONMENT}
4728variable in the shell it spaws. This allows users to, say, define a
4729specific prompt for development environments in their @file{.bashrc}
4730(@pxref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}):
4731
4732@example
4733if [ -n "$GUIX_ENVIRONMENT" ]
4734then
4735 export PS1="\u@@\h \w [dev]\$ "
4736fi
4737@end example
4738
372c4bbc
DT
4739Additionally, more than one package may be specified, in which case the
4740union of the inputs for the given packages are used. For example, the
4741command below spawns a shell where all of the dependencies of both Guile
4742and Emacs are available:
4743
4744@example
4745guix environment guile emacs
4746@end example
4747
1de2fe95
DT
4748Sometimes an interactive shell session is not desired. An arbitrary
4749command may be invoked by placing the @code{--} token to separate the
4750command from the rest of the arguments:
372c4bbc
DT
4751
4752@example
1de2fe95 4753guix environment guile -- make -j4
372c4bbc
DT
4754@end example
4755
fe36d84e
LC
4756In other situations, it is more convenient to specify the list of
4757packages needed in the environment. For example, the following command
4758runs @command{python} from an environment containing Python@tie{}2.7 and
4759NumPy:
4760
4761@example
1de2fe95 4762guix environment --ad-hoc python2-numpy python-2.7 -- python
fe36d84e
LC
4763@end example
4764
cc90fbbf
DT
4765Furthermore, one might want the dependencies of a package and also some
4766additional packages that are not build-time or runtime dependencies, but
4767are useful when developing nonetheless. Because of this, the
4768@code{--ad-hoc} flag is positional. Packages appearing before
4769@code{--ad-hoc} are interpreted as packages whose dependencies will be
4770added to the environment. Packages appearing after are interpreted as
4771packages that will be added to the environment directly. For example,
4772the following command creates a Guix development environment that
4773additionally includes Git and strace:
4774
4775@example
4776guix environment guix --ad-hoc git strace
4777@end example
4778
f535dcbe
DT
4779Sometimes it is desirable to isolate the environment as much as
4780possible, for maximal purity and reproducibility. In particular, when
4781using Guix on a host distro that is not GuixSD, it is desirable to
4782prevent access to @file{/usr/bin} and other system-wide resources from
4783the development environment. For example, the following command spawns
4784a Guile REPL in a ``container'' where only the store and the current
4785working directory are mounted:
4786
4787@example
4788guix environment --ad-hoc --container guile -- guile
4789@end example
4790
0f252e26 4791@quotation Note
cfd35b4e 4792The @code{--container} option requires Linux-libre 3.19 or newer.
0f252e26
DT
4793@end quotation
4794
fe36d84e 4795The available options are summarized below.
372c4bbc
DT
4796
4797@table @code
4798@item --expression=@var{expr}
4799@itemx -e @var{expr}
c9c282ce
DT
4800Create an environment for the package or list of packages that
4801@var{expr} evaluates to.
372c4bbc 4802
fe36d84e
LC
4803For example, running:
4804
4805@example
4806guix environment -e '(@@ (gnu packages maths) petsc-openmpi)'
4807@end example
4808
4809starts a shell with the environment for this specific variant of the
4810PETSc package.
4811
c9c282ce
DT
4812Running:
4813
4814@example
5c2b2f00 4815guix environment --ad-hoc -e '(@@ (gnu) %base-packages)'
c9c282ce
DT
4816@end example
4817
4818starts a shell with all the GuixSD base packages available.
4819
372c4bbc
DT
4820@item --load=@var{file}
4821@itemx -l @var{file}
c9c282ce
DT
4822Create an environment for the package or list of packages that the code
4823within @var{file} evaluates to.
372c4bbc 4824
fe36d84e
LC
4825As an example, @var{file} might contain a definition like this
4826(@pxref{Defining Packages}):
4827
4828@example
4829@verbatiminclude environment-gdb.scm
4830@end example
4831
a54bd6d7
DT
4832@item --ad-hoc
4833Include all specified packages in the resulting environment, as if an
4834@i{ad hoc} package were defined with them as inputs. This option is
4835useful for quickly creating an environment without having to write a
4836package expression to contain the desired inputs.
4837
4838For instance, the command:
4839
4840@example
1de2fe95 4841guix environment --ad-hoc guile guile-sdl -- guile
a54bd6d7
DT
4842@end example
4843
4844runs @command{guile} in an environment where Guile and Guile-SDL are
4845available.
4846
417c39f1
LC
4847Note that this example implicitly asks for the default output of
4848@code{guile} and @code{guile-sdl} but it is possible to ask for a
4849specific output---e.g., @code{glib:bin} asks for the @code{bin} output
4850of @code{glib} (@pxref{Packages with Multiple Outputs}).
4851
cc90fbbf
DT
4852This option may be composed with the default behavior of @command{guix
4853environment}. Packages appearing before @code{--ad-hoc} are interpreted
4854as packages whose dependencies will be added to the environment, the
4855default behavior. Packages appearing after are interpreted as packages
4856that will be added to the environment directly.
4857
372c4bbc
DT
4858@item --pure
4859Unset existing environment variables when building the new environment.
4860This has the effect of creating an environment in which search paths
4861only contain package inputs.
4862
4863@item --search-paths
4864Display the environment variable definitions that make up the
4865environment.
ce367ef3
LC
4866
4867@item --system=@var{system}
4868@itemx -s @var{system}
4869Attempt to build for @var{system}---e.g., @code{i686-linux}.
f535dcbe
DT
4870
4871@item --container
4872@itemx -C
4873@cindex container
4874Run @var{command} within an isolated container. The current working
4875directory outside the container is mapped to @file{/env} inside the
4876container. Additionally, the spawned process runs as the current user
4877outside the container, but has root privileges in the context of the
4878container.
4879
4880@item --network
4881@itemx -N
4882For containers, share the network namespace with the host system.
4883Containers created without this flag only have access to the loopback
4884device.
4885
4886@item --expose=@var{source}[=@var{target}]
4887For containers, expose the file system @var{source} from the host system
4888as the read-only file system @var{target} within the container. If
4889@var{target} is not specified, @var{source} is used as the target mount
4890point in the container.
4891
4892The example below spawns a Guile REPL in a container in which the user's
4893home directory is accessible read-only via the @file{/exchange}
4894directory:
4895
4896@example
4897guix environment --container --expose=$HOME=/exchange guile -- guile
4898@end example
4899
5c2b2f00 4900@item --share=@var{source}[=@var{target}]
f535dcbe
DT
4901For containers, share the file system @var{source} from the host system
4902as the writable file system @var{target} within the container. If
4903@var{target} is not specified, @var{source} is used as the target mount
4904point in the container.
4905
4906The example below spawns a Guile REPL in a container in which the user's
4907home directory is accessible for both reading and writing via the
4908@file{/exchange} directory:
4909
4910@example
4911guix environment --container --share=$HOME=/exchange guile -- guile
4912@end example
372c4bbc
DT
4913@end table
4914
4915It also supports all of the common build options that @command{guix
4916build} supports (@pxref{Invoking guix build, common build options}).
4917
aff8ce7c
DT
4918@node Invoking guix publish
4919@section Invoking @command{guix publish}
4920
4921The purpose of @command{guix publish} is to enable users to easily share
8ce229fc
LC
4922their store with others, which can then use it as a substitute server
4923(@pxref{Substitutes}).
4924
4925When @command{guix publish} runs, it spawns an HTTP server which allows
4926anyone with network access to obtain substitutes from it. This means
4927that any machine running Guix can also act as if it were a build farm,
4928since the HTTP interface is compatible with Hydra, the software behind
4929the @code{hydra.gnu.org} build farm.
aff8ce7c
DT
4930
4931For security, each substitute is signed, allowing recipients to check
4932their authenticity and integrity (@pxref{Substitutes}). Because
4933@command{guix publish} uses the system's signing key, which is only
5463fe51
LC
4934readable by the system administrator, it must be started as root; the
4935@code{--user} option makes it drop root privileges early on.
aff8ce7c 4936
b18812b6
LC
4937The signing key pair must be generated before @command{guix publish} is
4938launched, using @command{guix archive --generate-key} (@pxref{Invoking
4939guix archive}).
4940
aff8ce7c
DT
4941The general syntax is:
4942
4943@example
4944guix publish @var{options}@dots{}
4945@end example
4946
4947Running @command{guix publish} without any additional arguments will
4948spawn an HTTP server on port 8080:
4949
4950@example
4951guix publish
4952@end example
4953
4954Once a publishing server has been authorized (@pxref{Invoking guix
4955archive}), the daemon may download substitutes from it:
4956
4957@example
4958guix-daemon --substitute-urls=http://example.org:8080
4959@end example
4960
4961The following options are available:
4962
4963@table @code
4964@item --port=@var{port}
4965@itemx -p @var{port}
4966Listen for HTTP requests on @var{port}.
4967
9e2292ef
LC
4968@item --listen=@var{host}
4969Listen on the network interface for @var{host}. The default is to
4970accept connections from any interface.
4971
5463fe51
LC
4972@item --user=@var{user}
4973@itemx -u @var{user}
4974Change privileges to @var{user} as soon as possible---i.e., once the
4975server socket is open and the signing key has been read.
4976
aff8ce7c
DT
4977@item --repl[=@var{port}]
4978@itemx -r [@var{port}]
4979Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
8ce229fc
LC
4980Reference Manual}) on @var{port} (37146 by default). This is used
4981primarily for debugging a running @command{guix publish} server.
aff8ce7c
DT
4982@end table
4983
1c52181f
LC
4984Enabling @command{guix publish} on a GuixSD system is a one-liner: just
4985add a call to @code{guix-publish-service} in the @code{services} field
4986of the @code{operating-system} declaration (@pxref{guix-publish-service,
4987@code{guix-publish-service}}).
4988
d23c20f1
LC
4989
4990@node Invoking guix challenge
4991@section Invoking @command{guix challenge}
4992
4993@cindex reproducible builds
4994@cindex verifiable builds
4995
4996Do the binaries provided by this server really correspond to the source
4997code it claims to build? Is this package's build process deterministic?
4998These are the questions the @command{guix challenge} command attempts to
4999answer.
5000
5001The former is obviously an important question: Before using a substitute
5002server (@pxref{Substitutes}), you'd rather @emph{verify} that it
5003provides the right binaries, and thus @emph{challenge} it. The latter
5004is what enables the former: If package builds are deterministic, then
5005independent builds of the package should yield the exact same result,
5006bit for bit; if a server provides a binary different from the one
5007obtained locally, it may be either corrupt or malicious.
5008
5009We know that the hash that shows up in @file{/gnu/store} file names is
5010the hash of all the inputs of the process that built the file or
5011directory---compilers, libraries, build scripts,
5012etc. (@pxref{Introduction}). Assuming deterministic build processes,
5013one store file name should map to exactly one build output.
5014@command{guix challenge} checks whether there is, indeed, a single
5015mapping by comparing the build outputs of several independent builds of
5016any given store item.
5017
5018The command's output looks like this:
5019
5020@smallexample
5021$ guix challenge --substitute-urls="http://hydra.gnu.org http://guix.example.org"
5022updating list of substitutes from 'http://hydra.gnu.org'... 100.0%
5023updating list of substitutes from 'http://guix.example.org'... 100.0%
5024/gnu/store/@dots{}-openssl-1.0.2d contents differ:
5025 local hash: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q
5026 http://hydra.gnu.org/nar/@dots{}-openssl-1.0.2d: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q
5027 http://guix.example.org/nar/@dots{}-openssl-1.0.2d: 1zy4fmaaqcnjrzzajkdn3f5gmjk754b43qkq47llbyak9z0qjyim
5028/gnu/store/@dots{}-git-2.5.0 contents differ:
5029 local hash: 00p3bmryhjxrhpn2gxs2fy0a15lnip05l97205pgbk5ra395hyha
5030 http://hydra.gnu.org/nar/@dots{}-git-2.5.0: 069nb85bv4d4a6slrwjdy8v1cn4cwspm3kdbmyb81d6zckj3nq9f
5031 http://guix.example.org/nar/@dots{}-git-2.5.0: 0mdqa9w1p6cmli6976v4wi0sw9r4p5prkj7lzfd1877wk11c9c73
5032/gnu/store/@dots{}-pius-2.1.1 contents differ:
5033 local hash: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax
5034 http://hydra.gnu.org/nar/@dots{}-pius-2.1.1: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax
5035 http://guix.example.org/nar/@dots{}-pius-2.1.1: 1cy25x1a4fzq5rk0pmvc8xhwyffnqz95h2bpvqsz2mpvlbccy0gs
5036@end smallexample
5037
5038@noindent
5039In this example, @command{guix challenge} first scans the store to
5040determine the set of locally-built derivations---as opposed to store
5041items that were downloaded from a substitute server---and then queries
5042all the substitute servers. It then reports those store items for which
5043the servers obtained a result different from the local build.
5044
5045@cindex non-determinism, in package builds
5046As an example, @code{guix.example.org} always gets a different answer.
5047Conversely, @code{hydra.gnu.org} agrees with local builds, except in the
5048case of Git. This might indicate that the build process of Git is
5049non-deterministic, meaning that its output varies as a function of
5050various things that Guix does not fully control, in spite of building
5051packages in isolated environments (@pxref{Features}). Most common
5052sources of non-determinism include the addition of timestamps in build
5053results, the inclusion of random numbers, and directory listings sorted
5054by inode number. See @uref{http://reproducible.debian.net/howto/}, for
5055more information.
5056
5057To find out what's wrong with this Git binary, we can do something along
5058these lines (@pxref{Invoking guix archive}):
5059
5060@example
5061$ wget -q -O - http://hydra.gnu.org/nar/@dots{}-git-2.5.0 \
5062 | guix archive -x /tmp/git
043f4698 5063$ diff -ur --no-dereference /gnu/store/@dots{}-git.2.5.0 /tmp/git
d23c20f1
LC
5064@end example
5065
5066This command shows the difference between the files resulting from the
5067local build, and the files resulting from the build on
5068@code{hydra.gnu.org} (@pxref{Overview, Comparing and Merging Files,,
5069diffutils, Comparing and Merging Files}). The @command{diff} command
5070works great for text files. When binary files differ, a better option
5071is @uref{http://diffoscope.org/, Diffoscope}, a tool that helps
5072visualize differences for all kinds of files.
5073
5074Once you've done that work, you can tell whether the differences are due
5075to a non-deterministic build process or to a malicious server. We try
5076hard to remove sources of non-determinism in packages to make it easier
5077to verify substitutes, but of course, this is a process, one that
5078involves not just Guix but a large part of the free software community.
5079In the meantime, @command{guix challenge} is one tool to help address
5080the problem.
5081
5082If you are writing packages for Guix, you are encouraged to check
5083whether @code{hydra.gnu.org} and other substitute servers obtain the
5084same build result as you did with:
5085
5086@example
5087$ guix challenge @var{package}
5088@end example
5089
5090@noindent
5091... where @var{package} is a package specification such as
5092@code{guile-2.0} or @code{glibc:debug}.
5093
5094The general syntax is:
5095
5096@example
5097guix challenge @var{options} [@var{packages}@dots{}]
5098@end example
5099
5100The one option that matters is:
5101
5102@table @code
5103
5104@item --substitute-urls=@var{urls}
5105Consider @var{urls} the whitespace-separated list of substitute source
5106URLs to compare to.
5107
5108@end table
5109
5110
32efa254
DT
5111@node Invoking guix container
5112@section Invoking @command{guix container}
5113@cindex container
5114
5115@quotation Note
5116As of version @value{VERSION}, this tool is experimental. The interface
5117is subject to radical change in the future.
5118@end quotation
5119
5120The purpose of @command{guix container} is to manipulate processes
5121running within an isolated environment, commonly known as a
46c36586 5122``container'', typically created by the @command{guix environment}
32efa254
DT
5123(@pxref{Invoking guix environment}) and @command{guix system container}
5124(@pxref{Invoking guix system}) commands.
5125
5126The general syntax is:
5127
5128@example
5129guix container @var{action} @var{options}@dots{}
5130@end example
5131
5132@var{action} specifies the operation to perform with a container, and
5133@var{options} specifies the context-specific arguments for the action.
5134
5135The following actions are available:
5136
5137@table @code
5138@item exec
5139Execute a command within the context of a running container.
5140
5141The syntax is:
5142
5143@example
5144guix container exec @var{pid} @var{program} @var{arguments}@dots{}
5145@end example
5146
5147@var{pid} specifies the process ID of the running container.
5148@var{program} specifies an executable file name within the container's
5149root file system. @var{arguments} are the additional options that will
5150be passed to @var{program}.
5151
5152The following command launches an interactive login shell inside a
5153GuixSD container, started by @command{guix system container}, and whose
5154process ID is 9001:
5155
5156@example
5157guix container exec 9001 /run/current-system/profile/bin/bash --login
5158@end example
5159
5160Note that the @var{pid} cannot be the parent process of a container. It
5161must be the container's PID 1 or one of its child processes.
5162
5163@end table
5164
a1ba8475
LC
5165@c *********************************************************************
5166@node GNU Distribution
5167@chapter GNU Distribution
5168
3ca2731c 5169@cindex Guix System Distribution
4705641f 5170@cindex GuixSD
3ca2731c
LC
5171Guix comes with a distribution of the GNU system consisting entirely of
5172free software@footnote{The term ``free'' here refers to the
a1ba8475 5173@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
3ca2731c 5174users of that software}.}. The
35ed9306
LC
5175distribution can be installed on its own (@pxref{System Installation}),
5176but it is also possible to install Guix as a package manager on top of
5177an installed GNU/Linux system (@pxref{Installation}). To distinguish
3ca2731c 5178between the two, we refer to the standalone distribution as the Guix
4705641f 5179System Distribution, or GuixSD.
35ed9306
LC
5180
5181The distribution provides core GNU packages such as GNU libc, GCC, and
5182Binutils, as well as many GNU and non-GNU applications. The complete
5183list of available packages can be browsed
093ae1be 5184@url{http://www.gnu.org/software/guix/packages,on-line} or by
d03bb653 5185running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
5186
5187@example
e49951eb 5188guix package --list-available
a1ba8475
LC
5189@end example
5190
35ed9306 5191Our goal has been to provide a practical 100% free software distribution of
401c53c4
LC
5192Linux-based and other variants of GNU, with a focus on the promotion and
5193tight integration of GNU components, and an emphasis on programs and
5194tools that help users exert that freedom.
5195
3ca2731c 5196Packages are currently available on the following platforms:
c320011d
LC
5197
5198@table @code
5199
5200@item x86_64-linux
5201Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
5202
5203@item i686-linux
5204Intel 32-bit architecture (IA32), Linux-Libre kernel;
5205
aa1e1947 5206@item armhf-linux
aa725117 5207ARMv7-A architecture with hard float, Thumb-2 and NEON,
aa1e1947
MW
5208using the EABI hard-float ABI, and Linux-Libre kernel.
5209
c320011d
LC
5210@item mips64el-linux
5211little-endian 64-bit MIPS processors, specifically the Loongson series,
5212n32 application binary interface (ABI), and Linux-Libre kernel.
5213
5214@end table
5215
4705641f 5216GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
3ca2731c 5217
c320011d
LC
5218@noindent
5219For information on porting to other architectures or kernels,
5220@xref{Porting}.
5221
401c53c4 5222@menu
5af6de3e 5223* System Installation:: Installing the whole operating system.
35ed9306 5224* System Configuration:: Configuring the operating system.
91ef73d4 5225* Installing Debugging Files:: Feeding the debugger.
05962f29 5226* Security Updates:: Deploying security fixes quickly.
401c53c4 5227* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 5228* Packaging Guidelines:: Growing the distribution.
401c53c4 5229* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 5230* Porting:: Targeting another platform or kernel.
401c53c4
LC
5231@end menu
5232
5233Building this distribution is a cooperative effort, and you are invited
081145cf 5234to join! @xref{Contributing}, for information about how you can help.
401c53c4 5235
5af6de3e
LC
5236@node System Installation
5237@section System Installation
5238
3ca2731c
LC
5239@cindex Guix System Distribution
5240This section explains how to install the Guix System Distribution
5241on a machine. The Guix package manager can
35ed9306
LC
5242also be installed on top of a running GNU/Linux system,
5243@pxref{Installation}.
5af6de3e
LC
5244
5245@ifinfo
5246@c This paragraph is for people reading this from tty2 of the
5247@c installation image.
5248You're reading this documentation with an Info reader. For details on
5249how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 5250link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
5251@kbd{l} afterwards to come back here.
5252@end ifinfo
5253
8aaaae38
LC
5254@subsection Limitations
5255
4705641f 5256As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
3ca2731c 5257not production-ready. It may contain bugs and lack important
8aaaae38
LC
5258features. Thus, if you are looking for a stable production system that
5259respects your freedom as a computer user, a good solution at this point
5260is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
5261more established GNU/Linux distributions}. We hope you can soon switch
4705641f 5262to the GuixSD without fear, of course. In the meantime, you can
8aaaae38
LC
5263also keep using your distribution and try out the package manager on top
5264of it (@pxref{Installation}).
5265
5266Before you proceed with the installation, be aware of the following
5267noteworthy limitations applicable to version @value{VERSION}:
5268
5269@itemize
5270@item
5271The installation process does not include a graphical user interface and
5272requires familiarity with GNU/Linux (see the following subsections to
5273get a feel of what that means.)
5274
5275@item
093ae1be
LC
5276The system does not yet provide full GNOME and KDE desktops. Xfce and
5277Enlightenment are available though, if graphical desktop environments
5278are your thing, as well as a number of X11 window managers.
8aaaae38
LC
5279
5280@item
dbcb0ab1 5281Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
5282
5283@item
5284Few system services are currently supported out-of-the-box
5285(@pxref{Services}).
5286
5287@item
093ae1be 5288More than 2,000 packages are available, but you may
8aaaae38
LC
5289occasionally find that a useful package is missing.
5290@end itemize
5291
5292You've been warned. But more than a disclaimer, this is an invitation
5293to report issues (and success stories!), and join us in improving it.
5294@xref{Contributing}, for more info.
5af6de3e
LC
5295
5296@subsection USB Stick Installation
5297
5298An installation image for USB sticks can be downloaded from
4705641f 5299@indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
5af6de3e
LC
5300where @var{system} is one of:
5301
5302@table @code
5303@item x86_64-linux
5304for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
5305
5306@item i686-linux
5307for a 32-bit GNU/Linux system on Intel-compatible CPUs.
5308@end table
5309
5310This image contains a single partition with the tools necessary for an
5311installation. It is meant to be copied @emph{as is} to a large-enough
5312USB stick.
5313
5314To copy the image to a USB stick, follow these steps:
5315
5316@enumerate
5317@item
5318Decompress the image using the @command{xz} command:
5319
5320@example
4705641f 5321xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
5af6de3e
LC
5322@end example
5323
5324@item
5325Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
5326its device name. Assuming that USB stick is known as @file{/dev/sdX},
5327copy the image with:
5328
5329@example
4705641f 5330dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
5331@end example
5332
5333Access to @file{/dev/sdX} usually requires root privileges.
5334@end enumerate
5335
5336Once this is done, you should be able to reboot the system and boot from
5337the USB stick. The latter usually requires you to get in the BIOS' boot
5338menu, where you can choose to boot from the USB stick.
5339
5340@subsection Preparing for Installation
5341
5342Once you have successfully booted the image on the USB stick, you should
5343end up with a root prompt. Several console TTYs are configured and can
5344be used to run commands as root. TTY2 shows this documentation,
5345browsable using the Info reader commands (@pxref{Help,,, info, Info: An
ae7ffa9e
LC
5346Introduction}). The installation system runs the GPM mouse daemon,
5347which allows you to select text with the left mouse button and to paste
5348it with the middle button.
5af6de3e
LC
5349
5350To install the system, you would:
5351
5352@enumerate
5353
5354@item
235cba85
LC
5355Configure the network, by running:
5356
5357@example
5358ifconfig eno1 up && dhclient eno1
5359@end example
5360
5361to get an automatically assigned IP address from the wired
152dd61c 5362network interface controller@footnote{
95c559c1
LC
5363@c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
5364The name @code{eno1} is for the first on-board Ethernet controller. The
5365interface name for an Ethernet controller that is in the first slot of
5366the first PCI bus, for instance, would be @code{enp1s0}. Use
235cba85 5367@command{ifconfig -a} to list all the available network interfaces.},
95c559c1 5368or using the @command{ifconfig} command.
5af6de3e
LC
5369
5370The system automatically loads drivers for your network interface
5371controllers.
5372
5373Setting up network access is almost always a requirement because the
5374image does not contain all the software and tools that may be needed.
5375
5376@item
316d65be
LC
5377Unless this has already been done, you must partition, and then format
5378the target partition.
5af6de3e 5379
7ab44369
LC
5380Preferably, assign partitions a label so that you can easily and
5381reliably refer to them in @code{file-system} declarations (@pxref{File
5382Systems}). This is typically done using the @code{-L} option of
5383@command{mkfs.ext4} and related commands.
5384
316d65be
LC
5385@c FIXME: Uncomment this once GRUB fully supports encrypted roots.
5386@c A typical command sequence may be:
5387@c
5388@c @example
5389@c # fdisk /dev/sdX
5390@c @dots{} Create partitions etc.@dots{}
5391@c # cryptsetup luksFormat /dev/sdX1
5392@c # cryptsetup open --type luks /dev/sdX1 my-partition
5393@c # mkfs.ext4 -L my-root /dev/mapper/my-partition
5394@c @end example
6d6e6281 5395
5af6de3e 5396The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
5397Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
5398encryption, and e2fsprogs, the suite of tools to manipulate
5399ext2/ext3/ext4 file systems.
5af6de3e 5400
83a17b62
LC
5401@item
5402Once that is done, mount the target root partition under @file{/mnt}.
5403
5404@item
5405Lastly, run @code{deco start cow-store /mnt}.
5406
5407This will make @file{/gnu/store} copy-on-write, such that packages added
5408to it during the installation phase will be written to the target disk
5409rather than kept in memory.
5410
5af6de3e
LC
5411@end enumerate
5412
5af6de3e
LC
5413
5414@subsection Proceeding with the Installation
5415
5416With the target partitions ready, you now have to edit a file and
5417provide the declaration of the operating system to be installed. To
5418that end, the installation system comes with two text editors: GNU nano
5419(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
5420It is better to store that file on the target root file system, say, as
5421@file{/mnt/etc/config.scm}.
5422
dd51caac
LC
5423@xref{Using the Configuration System}, for examples of operating system
5424configurations. These examples are available under
5425@file{/etc/configuration} in the installation image, so you can copy
5426them and use them as a starting point for your own configuration.
5af6de3e 5427
dd51caac
LC
5428Once you are done preparing the configuration file, the new system must
5429be initialized (remember that the target root file system is mounted
5430under @file{/mnt}):
5af6de3e
LC
5431
5432@example
5433guix system init /mnt/etc/config.scm /mnt
5434@end example
5435
5436@noindent
5437This will copy all the necessary files, and install GRUB on
5438@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 5439more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
5440downloads or builds of missing packages, which can take some time.
5441
1bd4e6db
LC
5442Once that command has completed---and hopefully succeeded!---you can run
5443@command{reboot} and boot into the new system. The @code{root} password
5444in the new system is initially empty; other users' passwords need to be
5445initialized by running the @command{passwd} command as @code{root},
5446unless your configuration specifies otherwise
5447(@pxref{user-account-password, user account passwords}).
5448
5449Join us on @code{#guix} on the Freenode IRC network or on
5af6de3e
LC
5450@file{guix-devel@@gnu.org} to share your experience---good or not so
5451good.
5452
5453@subsection Building the Installation Image
5454
5455The installation image described above was built using the @command{guix
5456system} command, specifically:
5457
5458@example
8a225c66 5459guix system disk-image --image-size=850MiB gnu/system/install.scm
5af6de3e
LC
5460@end example
5461
5462@xref{Invoking guix system}, for more information. See
5463@file{gnu/system/install.scm} in the source tree for more information
5464about the installation image.
5465
cf4a9129
LC
5466@node System Configuration
5467@section System Configuration
b208a005 5468
cf4a9129 5469@cindex system configuration
3ca2731c 5470The Guix System Distribution supports a consistent whole-system configuration
cf4a9129
LC
5471mechanism. By that we mean that all aspects of the global system
5472configuration---such as the available system services, timezone and
5473locale settings, user accounts---are declared in a single place. Such
5474a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 5475
cf4a9129
LC
5476One of the advantages of putting all the system configuration under the
5477control of Guix is that it supports transactional system upgrades, and
5478makes it possible to roll-back to a previous system instantiation,
5479should something go wrong with the new one (@pxref{Features}). Another
5480one is that it makes it easy to replicate the exact same configuration
5481across different machines, or at different points in time, without
5482having to resort to additional administration tools layered on top of
5483the system's own tools.
5484@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 5485
cf4a9129
LC
5486This section describes this mechanism. First we focus on the system
5487administrator's viewpoint---explaining how the system is configured and
5488instantiated. Then we show how this mechanism can be extended, for
5489instance to support new system services.
91ef73d4 5490
cf4a9129
LC
5491@menu
5492* Using the Configuration System:: Customizing your GNU system.
7313a52e 5493* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 5494* File Systems:: Configuring file system mounts.
510f9d86 5495* Mapped Devices:: Block device extra processing.
cf4a9129 5496* User Accounts:: Specifying user accounts.
598e19dc 5497* Locales:: Language and cultural convention settings.
cf4a9129 5498* Services:: Specifying system services.
0ae8c15a 5499* Setuid Programs:: Programs running with root privileges.
efb5e833 5500* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 5501* Name Service Switch:: Configuring libc's name service switch.
fd1b1fa2 5502* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 5503* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
5504* Invoking guix system:: Instantiating a system configuration.
5505* Defining Services:: Adding new service definitions.
5506@end menu
91ef73d4 5507
cf4a9129
LC
5508@node Using the Configuration System
5509@subsection Using the Configuration System
64d76fa6 5510
cf4a9129
LC
5511The operating system is configured by providing an
5512@code{operating-system} declaration in a file that can then be passed to
5513the @command{guix system} command (@pxref{Invoking guix system}). A
5514simple setup, with the default system services, the default Linux-Libre
5515kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 5516
cf4a9129
LC
5517@findex operating-system
5518@lisp
dd51caac 5519@include os-config-bare-bones.texi
cf4a9129 5520@end lisp
401c53c4 5521
cf4a9129
LC
5522This example should be self-describing. Some of the fields defined
5523above, such as @code{host-name} and @code{bootloader}, are mandatory.
5524Others, such as @code{packages} and @code{services}, can be omitted, in
5525which case they get a default value.
e7f34eb0 5526
cf4a9129
LC
5527@vindex %base-packages
5528The @code{packages} field lists
5529packages that will be globally visible on the system, for all user
5530accounts---i.e., in every user's @code{PATH} environment variable---in
5531addition to the per-user profiles (@pxref{Invoking guix package}). The
5532@var{%base-packages} variable provides all the tools one would expect
5533for basic user and administrator tasks---including the GNU Core
5534Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
5535editor, @command{find}, @command{grep}, etc. The example above adds
2e437e29 5536tcpdump to those, taken from the @code{(gnu packages admin)} module
cf4a9129 5537(@pxref{Package Modules}).
e7f34eb0 5538
cf4a9129
LC
5539@vindex %base-services
5540The @code{services} field lists @dfn{system services} to be made
5541available when the system starts (@pxref{Services}).
5542The @code{operating-system} declaration above specifies that, in
5543addition to the basic services, we want the @command{lshd} secure shell
cd6f6c22
LC
5544daemon listening on port 2222 (@pxref{Networking Services,
5545@code{lsh-service}}). Under the hood,
cf4a9129
LC
5546@code{lsh-service} arranges so that @code{lshd} is started with the
5547right command-line options, possibly with supporting configuration files
cd6f6c22
LC
5548generated as needed (@pxref{Defining Services}).
5549
5550@cindex customization, of services
5551@findex modify-services
5552Occasionally, instead of using the base services as is, you will want to
5553customize them. For instance, to change the configuration of
5554@code{guix-daemon} and Mingetty (the console log-in), you may write the
5555following instead of @var{%base-services}:
5556
5557@lisp
5558(modify-services %base-services
5559 (guix-service-type config =>
5560 (guix-configuration
5561 (inherit config)
5562 (use-substitutes? #f)
5563 (extra-options '("--gc-keep-outputs"))))
5564 (mingetty-service-type config =>
5565 (mingetty-configuration
5566 (inherit config)
5567 (motd (plain-file "motd" "Hi there!")))))
5568@end lisp
5569
5570@noindent
5571The effect here is to change the options passed to @command{guix-daemon}
5572when it is started, as well as the ``message of the day'' that appears
5573when logging in at the console. @xref{Service Reference,
5574@code{modify-services}}, for more on that.
a1ba8475 5575
dd51caac 5576The configuration for a typical ``desktop'' usage, with the X11 display
cd6f6c22 5577server, a desktop environment, network management, power management, and
dd51caac
LC
5578more, would look like this:
5579
5580@lisp
5581@include os-config-desktop.texi
5582@end lisp
5583
5584@xref{Desktop Services}, for the exact list of services provided by
efb5e833
LC
5585@var{%desktop-services}. @xref{X.509 Certificates}, for background
5586information about the @code{nss-certs} package that is used here.
cd6f6c22
LC
5587@xref{operating-system Reference}, for details about all the available
5588@code{operating-system} fields.
dd51caac 5589
cf4a9129
LC
5590Assuming the above snippet is stored in the @file{my-system-config.scm}
5591file, the @command{guix system reconfigure my-system-config.scm} command
5592instantiates that configuration, and makes it the default GRUB boot
65797bff
LC
5593entry (@pxref{Invoking guix system}).
5594
5595The normal way to change the system's configuration is by updating this
5596file and re-running @command{guix system reconfigure}. One should never
5597have to touch files in @command{/etc} or to run commands that modify the
5598system state such as @command{useradd} or @command{grub-install}. In
5599fact, you must avoid that since that would not only void your warranty
5600but also prevent you from rolling back to previous versions of your
5601system, should you ever need to.
5602
5603@cindex roll-back, of the operating system
5604Speaking of roll-back, each time you run @command{guix system
5605reconfigure}, a new @dfn{generation} of the system is created---without
5606modifying or deleting previous generations. Old system generations get
5607an entry in the GRUB boot menu, allowing you to boot them in case
5608something went wrong with the latest generation. Reassuring, no? The
5609@command{guix system list-generations} command lists the system
5610generations available on disk.
b81e1947 5611
cf4a9129
LC
5612At the Scheme level, the bulk of an @code{operating-system} declaration
5613is instantiated with the following monadic procedure (@pxref{The Store
5614Monad}):
b81e1947 5615
cf4a9129
LC
5616@deffn {Monadic Procedure} operating-system-derivation os
5617Return a derivation that builds @var{os}, an @code{operating-system}
5618object (@pxref{Derivations}).
b81e1947 5619
cf4a9129
LC
5620The output of the derivation is a single directory that refers to all
5621the packages, configuration files, and other supporting files needed to
5622instantiate @var{os}.
5623@end deffn
b81e1947 5624
7313a52e
LC
5625@node operating-system Reference
5626@subsection @code{operating-system} Reference
5627
5628This section summarizes all the options available in
5629@code{operating-system} declarations (@pxref{Using the Configuration
5630System}).
5631
5632@deftp {Data Type} operating-system
5633This is the data type representing an operating system configuration.
5634By that, we mean all the global system configuration, not per-user
5635configuration (@pxref{Using the Configuration System}).
5636
5637@table @asis
5638@item @code{kernel} (default: @var{linux-libre})
fbb25e56 5639The package object of the operating system kernel to use@footnote{Currently
7313a52e
LC
5640only the Linux-libre kernel is supported. In the future, it will be
5641possible to use the GNU@tie{}Hurd.}.
5642
ee2a6304
LC
5643@item @code{kernel-arguments} (default: @code{'()})
5644List of strings or gexps representing additional arguments to pass on
5645the kernel's command-line---e.g., @code{("console=ttyS0")}.
5646
7313a52e 5647@item @code{bootloader}
88faf933 5648The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
5649
5650@item @code{initrd} (default: @code{base-initrd})
5651A two-argument monadic procedure that returns an initial RAM disk for
5652the Linux kernel. @xref{Initial RAM Disk}.
5653
f34c56be
LC
5654@item @code{firmware} (default: @var{%base-firmware})
5655@cindex firmware
5656List of firmware packages loadable by the operating system kernel.
5657
5658The default includes firmware needed for Atheros-based WiFi devices
5659(Linux-libre module @code{ath9k}.)
5660
7313a52e
LC
5661@item @code{host-name}
5662The host name.
5663
5664@item @code{hosts-file}
5665@cindex hosts file
24e02c28 5666A file-like object (@pxref{G-Expressions, file-like objects}) for use as
7313a52e 5667@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
24e02c28 5668Reference Manual}). The default is a file with entries for
7313a52e
LC
5669@code{localhost} and @var{host-name}.
5670
5671@item @code{mapped-devices} (default: @code{'()})
5672A list of mapped devices. @xref{Mapped Devices}.
5673
5674@item @code{file-systems}
5675A list of file systems. @xref{File Systems}.
5676
5677@item @code{swap-devices} (default: @code{'()})
5678@cindex swap devices
5679A list of strings identifying devices to be used for ``swap space''
5680(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
5681For example, @code{'("/dev/sda3")}.
5682
bf87f38a 5683@item @code{users} (default: @code{%base-user-accounts})
7313a52e
LC
5684@itemx @code{groups} (default: @var{%base-groups})
5685List of user accounts and groups. @xref{User Accounts}.
5686
5687@item @code{skeletons} (default: @code{(default-skeletons)})
5688A monadic list of pairs of target file name and files. These are the
5689files that will be used as skeletons as new accounts are created.
5690
5691For instance, a valid value may look like this:
5692
5693@example
5694(mlet %store-monad ((bashrc (text-file "bashrc" "\
5695 export PATH=$HOME/.guix-profile/bin")))
5696 (return `((".bashrc" ,bashrc))))
5697@end example
5698
5699@item @code{issue} (default: @var{%default-issue})
5700A string denoting the contents of the @file{/etc/issue} file, which is
5701what displayed when users log in on a text console.
5702
5703@item @code{packages} (default: @var{%base-packages})
5704The set of packages installed in the global profile, which is accessible
5705at @file{/run/current-system/profile}.
5706
5707The default set includes core utilities, but it is good practice to
5708install non-core utilities in user profiles (@pxref{Invoking guix
5709package}).
5710
5711@item @code{timezone}
5712A timezone identifying string---e.g., @code{"Europe/Paris"}.
5713
598e19dc
LC
5714@item @code{locale} (default: @code{"en_US.utf8"})
5715The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
5716Library Reference Manual}). @xref{Locales}, for more information.
5717
5718@item @code{locale-definitions} (default: @var{%default-locale-definitions})
5719The list of locale definitions to be compiled and that may be used at
5720run time. @xref{Locales}.
7313a52e 5721
34760ae7
LC
5722@item @code{locale-libcs} (default: @code{(list @var{glibc})})
5723The list of GNU@tie{}libc packages whose locale data and tools are used
5724to build the locale definitions. @xref{Locales}, for compatibility
5725considerations that justify this option.
5726
996ed739
LC
5727@item @code{name-service-switch} (default: @var{%default-nss})
5728Configuration of libc's name service switch (NSS)---a
5729@code{<name-service-switch>} object. @xref{Name Service Switch}, for
5730details.
5731
7313a52e 5732@item @code{services} (default: @var{%base-services})
28d939af 5733A list of service objects denoting system services. @xref{Services}.
7313a52e
LC
5734
5735@item @code{pam-services} (default: @code{(base-pam-services)})
5736@cindex PAM
5737@cindex pluggable authentication modules
5738Linux @dfn{pluggable authentication module} (PAM) services.
5739@c FIXME: Add xref to PAM services section.
5740
5741@item @code{setuid-programs} (default: @var{%setuid-programs})
5742List of string-valued G-expressions denoting setuid programs.
5743@xref{Setuid Programs}.
5744
f5a9ffa0
AK
5745@item @code{sudoers-file} (default: @var{%sudoers-specification})
5746@cindex sudoers file
84765839
LC
5747The contents of the @file{/etc/sudoers} file as a file-like object
5748(@pxref{G-Expressions, @code{local-file} and @code{plain-file}}).
7313a52e
LC
5749
5750This file specifies which users can use the @command{sudo} command, what
5751they are allowed to do, and what privileges they may gain. The default
5752is that only @code{root} and members of the @code{wheel} group may use
5753@code{sudo}.
5754
5755@end table
5756@end deftp
5757
cf4a9129
LC
5758@node File Systems
5759@subsection File Systems
b81e1947 5760
cf4a9129
LC
5761The list of file systems to be mounted is specified in the
5762@code{file-systems} field of the operating system's declaration
5763(@pxref{Using the Configuration System}). Each file system is declared
5764using the @code{file-system} form, like this:
b81e1947
LC
5765
5766@example
cf4a9129
LC
5767(file-system
5768 (mount-point "/home")
5769 (device "/dev/sda3")
5770 (type "ext4"))
b81e1947
LC
5771@end example
5772
cf4a9129
LC
5773As usual, some of the fields are mandatory---those shown in the example
5774above---while others can be omitted. These are described below.
b81e1947 5775
cf4a9129
LC
5776@deftp {Data Type} file-system
5777Objects of this type represent file systems to be mounted. They
5778contain the following members:
5ff3c4b8 5779
cf4a9129
LC
5780@table @asis
5781@item @code{type}
5782This is a string specifying the type of the file system---e.g.,
5783@code{"ext4"}.
5ff3c4b8 5784
cf4a9129
LC
5785@item @code{mount-point}
5786This designates the place where the file system is to be mounted.
b81e1947 5787
cf4a9129
LC
5788@item @code{device}
5789This names the ``source'' of the file system. By default it is the name
5790of a node under @file{/dev}, but its meaning depends on the @code{title}
5791field described below.
401c53c4 5792
cf4a9129
LC
5793@item @code{title} (default: @code{'device})
5794This is a symbol that specifies how the @code{device} field is to be
5795interpreted.
401c53c4 5796
cf4a9129
LC
5797When it is the symbol @code{device}, then the @code{device} field is
5798interpreted as a file name; when it is @code{label}, then @code{device}
5799is interpreted as a partition label name; when it is @code{uuid},
5800@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 5801
661a1d79
LC
5802UUIDs may be converted from their string representation (as shown by the
5803@command{tune2fs -l} command) using the @code{uuid} form, like this:
5804
5805@example
5806(file-system
5807 (mount-point "/home")
5808 (type "ext4")
5809 (title 'uuid)
5810 (device (uuid "4dab5feb-d176-45de-b287-9b0a6e4c01cb")))
5811@end example
5812
cf4a9129 5813The @code{label} and @code{uuid} options offer a way to refer to disk
661a1d79
LC
5814partitions without having to hard-code their actual device
5815name@footnote{Note that, while it is tempting to use
5816@file{/dev/disk/by-uuid} and similar device names to achieve the same
5817result, this is not recommended: These special device nodes are created
5818by the udev daemon and may be unavailable at the time the device is
5819mounted.}.
da7cabd4 5820
5f86a66e
LC
5821However, when a file system's source is a mapped device (@pxref{Mapped
5822Devices}), its @code{device} field @emph{must} refer to the mapped
5823device name---e.g., @file{/dev/mapper/root-partition}---and consequently
5824@code{title} must be set to @code{'device}. This is required so that
5825the system knows that mounting the file system depends on having the
5826corresponding device mapping established.
5827
cf4a9129
LC
5828@item @code{flags} (default: @code{'()})
5829This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
5830include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
5831access to special files), @code{no-suid} (ignore setuid and setgid
5832bits), and @code{no-exec} (disallow program execution.)
da7cabd4 5833
cf4a9129
LC
5834@item @code{options} (default: @code{#f})
5835This is either @code{#f}, or a string denoting mount options.
da7cabd4 5836
cf4a9129
LC
5837@item @code{needed-for-boot?} (default: @code{#f})
5838This Boolean value indicates whether the file system is needed when
5839booting. If that is true, then the file system is mounted when the
5840initial RAM disk (initrd) is loaded. This is always the case, for
5841instance, for the root file system.
da7cabd4 5842
cf4a9129
LC
5843@item @code{check?} (default: @code{#t})
5844This Boolean indicates whether the file system needs to be checked for
5845errors before being mounted.
f9cc8971 5846
4e469051
LC
5847@item @code{create-mount-point?} (default: @code{#f})
5848When true, the mount point is created if it does not exist yet.
5849
e51710d1
LC
5850@item @code{dependencies} (default: @code{'()})
5851This is a list of @code{<file-system>} objects representing file systems
5852that must be mounted before (and unmounted after) this one.
5853
5854As an example, consider a hierarchy of mounts: @file{/sys/fs/cgroup} is
5855a dependency of @file{/sys/fs/cgroup/cpu} and
5856@file{/sys/fs/cgroup/memory}.
5857
cf4a9129
LC
5858@end table
5859@end deftp
da7cabd4 5860
a69576ea
LC
5861The @code{(gnu system file-systems)} exports the following useful
5862variables.
5863
5864@defvr {Scheme Variable} %base-file-systems
5865These are essential file systems that are required on normal systems,
cc0e575a 5866such as @var{%pseudo-terminal-file-system} and @var{%immutable-store} (see
3392ce5d
LC
5867below.) Operating system declarations should always contain at least
5868these.
a69576ea
LC
5869@end defvr
5870
7f239fd3
LC
5871@defvr {Scheme Variable} %pseudo-terminal-file-system
5872This is the file system to be mounted as @file{/dev/pts}. It supports
5873@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
5874functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
5875Manual}). Pseudo-terminals are used by terminal emulators such as
5876@command{xterm}.
5877@end defvr
5878
db17ae5c
LC
5879@defvr {Scheme Variable} %shared-memory-file-system
5880This file system is mounted as @file{/dev/shm} and is used to support
5881memory sharing across processes (@pxref{Memory-mapped I/O,
5882@code{shm_open},, libc, The GNU C Library Reference Manual}).
5883@end defvr
5884
3392ce5d
LC
5885@defvr {Scheme Variable} %immutable-store
5886This file system performs a read-only ``bind mount'' of
5887@file{/gnu/store}, making it read-only for all the users including
5888@code{root}. This prevents against accidental modification by software
5889running as @code{root} or by system administrators.
5890
5891The daemon itself is still able to write to the store: it remounts it
5892read-write in its own ``name space.''
5893@end defvr
5894
a69576ea
LC
5895@defvr {Scheme Variable} %binary-format-file-system
5896The @code{binfmt_misc} file system, which allows handling of arbitrary
5897executable file types to be delegated to user space. This requires the
5898@code{binfmt.ko} kernel module to be loaded.
5899@end defvr
5900
5901@defvr {Scheme Variable} %fuse-control-file-system
5902The @code{fusectl} file system, which allows unprivileged users to mount
5903and unmount user-space FUSE file systems. This requires the
5904@code{fuse.ko} kernel module to be loaded.
5905@end defvr
5906
510f9d86
LC
5907@node Mapped Devices
5908@subsection Mapped Devices
5909
5910@cindex device mapping
5911@cindex mapped devices
5912The Linux kernel has a notion of @dfn{device mapping}: a block device,
5913such as a hard disk partition, can be @dfn{mapped} into another device,
5914with additional processing over the data that flows through
5915it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
5916concept of a ``mapped device'' and that of a file system: both boil down
5917to @emph{translating} input/output operations made on a file to
5918operations on its backing store. Thus, the Hurd implements mapped
5919devices, like file systems, using the generic @dfn{translator} mechanism
5920(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
5921typical example is encryption device mapping: all writes to the mapped
5922device are encrypted, and all reads are deciphered, transparently.
5923
5924Mapped devices are declared using the @code{mapped-device} form:
5925
5926@example
5927(mapped-device
5928 (source "/dev/sda3")
5929 (target "home")
5930 (type luks-device-mapping))
5931@end example
5932
5933@noindent
5934@cindex disk encryption
5935@cindex LUKS
5936This example specifies a mapping from @file{/dev/sda3} to
5937@file{/dev/mapper/home} using LUKS---the
5938@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
5939standard mechanism for disk encryption. The @file{/dev/mapper/home}
5940device can then be used as the @code{device} of a @code{file-system}
5941declaration (@pxref{File Systems}). The @code{mapped-device} form is
5942detailed below.
5943
5944@deftp {Data Type} mapped-device
5945Objects of this type represent device mappings that will be made when
5946the system boots up.
5947
9cb426b8
LC
5948@table @code
5949@item source
510f9d86
LC
5950This string specifies the name of the block device to be mapped, such as
5951@code{"/dev/sda3"}.
5952
9cb426b8 5953@item target
510f9d86
LC
5954This string specifies the name of the mapping to be established. For
5955example, specifying @code{"my-partition"} will lead to the creation of
5956the @code{"/dev/mapper/my-partition"} device.
5957
9cb426b8 5958@item type
510f9d86
LC
5959This must be a @code{mapped-device-kind} object, which specifies how
5960@var{source} is mapped to @var{target}.
5961@end table
5962@end deftp
5963
5964@defvr {Scheme Variable} luks-device-mapping
5965This defines LUKS block device encryption using the @command{cryptsetup}
5966command, from the same-named package. This relies on the
5967@code{dm-crypt} Linux kernel module.
5968@end defvr
5969
cf4a9129
LC
5970@node User Accounts
5971@subsection User Accounts
ee85f3db 5972
9bea87a5
LC
5973User accounts and groups are entirely managed through the
5974@code{operating-system} declaration. They are specified with the
5975@code{user-account} and @code{user-group} forms:
ee85f3db 5976
cf4a9129
LC
5977@example
5978(user-account
5979 (name "alice")
5980 (group "users")
24e752c0
LC
5981 (supplementary-groups '("wheel" ;allow use of sudo, etc.
5982 "audio" ;sound card
5983 "video" ;video devices such as webcams
5984 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
5985 (comment "Bob's sister")
5986 (home-directory "/home/alice"))
5987@end example
25083588 5988
9bea87a5
LC
5989When booting or upon completion of @command{guix system reconfigure},
5990the system ensures that only the user accounts and groups specified in
5991the @code{operating-system} declaration exist, and with the specified
5992properties. Thus, account or group creations or modifications made by
5993directly invoking commands such as @command{useradd} are lost upon
5994reconfiguration or reboot. This ensures that the system remains exactly
5995as declared.
5996
cf4a9129
LC
5997@deftp {Data Type} user-account
5998Objects of this type represent user accounts. The following members may
5999be specified:
ee85f3db 6000
cf4a9129
LC
6001@table @asis
6002@item @code{name}
6003The name of the user account.
ee85f3db 6004
cf4a9129
LC
6005@item @code{group}
6006This is the name (a string) or identifier (a number) of the user group
6007this account belongs to.
ee85f3db 6008
cf4a9129
LC
6009@item @code{supplementary-groups} (default: @code{'()})
6010Optionally, this can be defined as a list of group names that this
6011account belongs to.
ee85f3db 6012
cf4a9129
LC
6013@item @code{uid} (default: @code{#f})
6014This is the user ID for this account (a number), or @code{#f}. In the
6015latter case, a number is automatically chosen by the system when the
6016account is created.
ee85f3db 6017
cf4a9129
LC
6018@item @code{comment} (default: @code{""})
6019A comment about the account, such as the account's owner full name.
c8c871d1 6020
cf4a9129
LC
6021@item @code{home-directory}
6022This is the name of the home directory for the account.
ee85f3db 6023
cf4a9129
LC
6024@item @code{shell} (default: Bash)
6025This is a G-expression denoting the file name of a program to be used as
6026the shell (@pxref{G-Expressions}).
ee85f3db 6027
cf4a9129
LC
6028@item @code{system?} (default: @code{#f})
6029This Boolean value indicates whether the account is a ``system''
6030account. System accounts are sometimes treated specially; for instance,
6031graphical login managers do not list them.
ee85f3db 6032
1bd4e6db 6033@anchor{user-account-password}
cf4a9129 6034@item @code{password} (default: @code{#f})
eb59595c
LC
6035You would normally leave this field to @code{#f}, initialize user
6036passwords as @code{root} with the @command{passwd} command, and then let
9bea87a5
LC
6037users change it with @command{passwd}. Passwords set with
6038@command{passwd} are of course preserved across reboot and
6039reconfiguration.
eb59595c
LC
6040
6041If you @emph{do} want to have a preset password for an account, then
6042this field must contain the encrypted password, as a string.
5d1f1177
LC
6043@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
6044on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 6045Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 6046
cf4a9129
LC
6047@end table
6048@end deftp
ee85f3db 6049
cf4a9129 6050User group declarations are even simpler:
ee85f3db 6051
cf4a9129
LC
6052@example
6053(user-group (name "students"))
6054@end example
ee85f3db 6055
cf4a9129
LC
6056@deftp {Data Type} user-group
6057This type is for, well, user groups. There are just a few fields:
af8a56b8 6058
cf4a9129
LC
6059@table @asis
6060@item @code{name}
6061The group's name.
ee85f3db 6062
cf4a9129
LC
6063@item @code{id} (default: @code{#f})
6064The group identifier (a number). If @code{#f}, a new number is
6065automatically allocated when the group is created.
ee85f3db 6066
c8fa3426
LC
6067@item @code{system?} (default: @code{#f})
6068This Boolean value indicates whether the group is a ``system'' group.
6069System groups have low numerical IDs.
6070
cf4a9129
LC
6071@item @code{password} (default: @code{#f})
6072What, user groups can have a password? Well, apparently yes. Unless
6073@code{#f}, this field specifies the group's password.
ee85f3db 6074
cf4a9129
LC
6075@end table
6076@end deftp
401c53c4 6077
cf4a9129
LC
6078For convenience, a variable lists all the basic user groups one may
6079expect:
401c53c4 6080
cf4a9129
LC
6081@defvr {Scheme Variable} %base-groups
6082This is the list of basic user groups that users and/or packages expect
6083to be present on the system. This includes groups such as ``root'',
6084``wheel'', and ``users'', as well as groups used to control access to
6085specific devices such as ``audio'', ``disk'', and ``cdrom''.
6086@end defvr
401c53c4 6087
bf87f38a
LC
6088@defvr {Scheme Variable} %base-user-accounts
6089This is the list of basic system accounts that programs may expect to
6090find on a GNU/Linux system, such as the ``nobody'' account.
6091
6092Note that the ``root'' account is not included here. It is a
6093special-case and is automatically added whether or not it is specified.
6094@end defvr
6095
598e19dc
LC
6096@node Locales
6097@subsection Locales
6098
6099@cindex locale
6100A @dfn{locale} defines cultural conventions for a particular language
6101and region of the world (@pxref{Locales,,, libc, The GNU C Library
6102Reference Manual}). Each locale has a name that typically has the form
b2636518 6103@code{@var{language}_@var{territory}.@var{codeset}}---e.g.,
598e19dc
LC
6104@code{fr_LU.utf8} designates the locale for the French language, with
6105cultural conventions from Luxembourg, and using the UTF-8 encoding.
6106
6107@cindex locale definition
6108Usually, you will want to specify the default locale for the machine
6109using the @code{locale} field of the @code{operating-system} declaration
6110(@pxref{operating-system Reference, @code{locale}}).
6111
6112That locale must be among the @dfn{locale definitions} that are known to
6113the system---and these are specified in the @code{locale-definitions}
6114slot of @code{operating-system}. The default value includes locale
6115definition for some widely used locales, but not for all the available
6116locales, in order to save space.
6117
6118If the locale specified in the @code{locale} field is not among the
6119definitions listed in @code{locale-definitions}, @command{guix system}
6120raises an error. In that case, you should add the locale definition to
6121the @code{locale-definitions} field. For instance, to add the North
6122Frisian locale for Germany, the value of that field may be:
6123
6124@example
6125(cons (locale-definition
6126 (name "fy_DE.utf8") (source "fy_DE"))
6127 %default-locale-definitions)
6128@end example
6129
6130Likewise, to save space, one might want @code{locale-definitions} to
6131list only the locales that are actually used, as in:
6132
6133@example
6134(list (locale-definition
6135 (name "ja_JP.eucjp") (source "ja_JP")
6136 (charset "EUC-JP")))
6137@end example
6138
5c3c1427
LC
6139@vindex LOCPATH
6140The compiled locale definitions are available at
46bd6edd
LC
6141@file{/run/current-system/locale/X.Y}, where @code{X.Y} is the libc
6142version, which is the default location where the GNU@tie{}libc provided
6143by Guix looks for locale data. This can be overridden using the
6144@code{LOCPATH} environment variable (@pxref{locales-and-locpath,
5c3c1427
LC
6145@code{LOCPATH} and locale packages}).
6146
598e19dc
LC
6147The @code{locale-definition} form is provided by the @code{(gnu system
6148locale)} module. Details are given below.
6149
6150@deftp {Data Type} locale-definition
6151This is the data type of a locale definition.
6152
6153@table @asis
6154
6155@item @code{name}
6156The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
6157Reference Manual}, for more information on locale names.
6158
6159@item @code{source}
6160The name of the source for that locale. This is typically the
6161@code{@var{language}_@var{territory}} part of the locale name.
6162
6163@item @code{charset} (default: @code{"UTF-8"})
6164The ``character set'' or ``code set'' for that locale,
6165@uref{http://www.iana.org/assignments/character-sets, as defined by
6166IANA}.
6167
6168@end table
6169@end deftp
6170
6171@defvr {Scheme Variable} %default-locale-definitions
b2636518
LC
6172An arbitrary list of commonly used UTF-8 locales, used as the default
6173value of the @code{locale-definitions} field of @code{operating-system}
598e19dc 6174declarations.
b2636518
LC
6175
6176@cindex locale name
6177@cindex normalized codeset in locale names
6178These locale definitions use the @dfn{normalized codeset} for the part
6179that follows the dot in the name (@pxref{Using gettextized software,
6180normalized codeset,, libc, The GNU C Library Reference Manual}). So for
6181instance it has @code{uk_UA.utf8} but @emph{not}, say,
6182@code{uk_UA.UTF-8}.
598e19dc 6183@end defvr
401c53c4 6184
34760ae7
LC
6185@subsubsection Locale Data Compatibility Considerations
6186
6187@cindex incompatibility, of locale data
6188@code{operating-system} declarations provide a @code{locale-libcs} field
6189to specify the GNU@tie{}libc packages that are used to compile locale
6190declarations (@pxref{operating-system Reference}). ``Why would I
6191care?'', you may ask. Well, it turns out that the binary format of
6192locale data is occasionally incompatible from one libc version to
6193another.
6194
6195@c See <https://sourceware.org/ml/libc-alpha/2015-09/msg00575.html>
6196@c and <https://lists.gnu.org/archive/html/guix-devel/2015-08/msg00737.html>.
6197For instance, a program linked against libc version 2.21 is unable to
6198read locale data produced with libc 2.22; worse, that program
6199@emph{aborts} instead of simply ignoring the incompatible locale
6200data@footnote{Versions 2.23 and later of GNU@tie{}libc will simply skip
6201the incompatible locale data, which is already an improvement.}.
6202Similarly, a program linked against libc 2.22 can read most, but not
6203all, the locale data from libc 2.21 (specifically, @code{LC_COLLATE}
6204data is incompatible); thus calls to @code{setlocale} may fail, but
6205programs will not abort.
6206
6207The ``problem'' in GuixSD is that users have a lot of freedom: They can
6208choose whether and when to upgrade software in their profiles, and might
6209be using a libc version different from the one the system administrator
6210used to build the system-wide locale data.
6211
6212Fortunately, unprivileged users can also install their own locale data
6213and define @var{GUIX_LOCPATH} accordingly (@pxref{locales-and-locpath,
6214@code{GUIX_LOCPATH} and locale packages}).
6215
6216Still, it is best if the system-wide locale data at
6217@file{/run/current-system/locale} is built for all the libc versions
6218actually in use on the system, so that all the programs can access
6219it---this is especially crucial on a multi-user system. To do that, the
6220administrator can specify several libc packages in the
6221@code{locale-libcs} field of @code{operating-system}:
6222
6223@example
6224(use-package-modules base)
6225
6226(operating-system
6227 ;; @dots{}
6228 (locale-libcs (list glibc-2.21 (canonical-package glibc))))
6229@end example
6230
6231This example would lead to a system containing locale definitions for
6232both libc 2.21 and the current version of libc in
6233@file{/run/current-system/locale}.
6234
6235
cf4a9129
LC
6236@node Services
6237@subsection Services
401c53c4 6238
cf4a9129
LC
6239@cindex system services
6240An important part of preparing an @code{operating-system} declaration is
6241listing @dfn{system services} and their configuration (@pxref{Using the
6242Configuration System}). System services are typically daemons launched
6243when the system boots, or other actions needed at that time---e.g.,
d8b94dbd
LC
6244configuring network access.
6245
6246Services are managed by GNU@tie{}dmd (@pxref{Introduction,,, dmd, GNU
6247dmd Manual}). On a running system, the @command{deco} command allows
6248you to list the available services, show their status, start and stop
6249them, or do other specific operations (@pxref{Jump Start,,, dmd, GNU dmd
6250Manual}). For example:
6251
6252@example
6253# deco status dmd
6254@end example
6255
6256The above command, run as @code{root}, lists the currently defined
6257services. The @command{deco doc} command shows a synopsis of the given
6258service:
6259
6260@example
6261# deco doc nscd
6262Run libc's name service cache daemon (nscd).
6263@end example
6264
6265The @command{start}, @command{stop}, and @command{restart} sub-commands
6266have the effect you would expect. For instance, the commands below stop
6267the nscd service and restart the Xorg display server:
6268
6269@example
6270# deco stop nscd
6271Service nscd has been stopped.
6272# deco restart xorg-server
6273Service xorg-server has been stopped.
6274Service xorg-server has been started.
6275@end example
401c53c4 6276
cf4a9129 6277The following sections document the available services, starting with
d8b94dbd
LC
6278the core services, that may be used in an @code{operating-system}
6279declaration.
401c53c4 6280
cf4a9129
LC
6281@menu
6282* Base Services:: Essential system services.
6283* Networking Services:: Network setup, SSH daemon, etc.
6284* X Window:: Graphical display.
fe1a39d3 6285* Desktop Services:: D-Bus and desktop services.
105369a4 6286* Database Services:: SQL databases.
58724c48 6287* Web Services:: Web servers.
aa4ed923 6288* Various Services:: Other services.
cf4a9129 6289@end menu
401c53c4 6290
cf4a9129
LC
6291@node Base Services
6292@subsubsection Base Services
a1ba8475 6293
cf4a9129
LC
6294The @code{(gnu services base)} module provides definitions for the basic
6295services that one expects from the system. The services exported by
6296this module are listed below.
401c53c4 6297
cf4a9129 6298@defvr {Scheme Variable} %base-services
31771497
LC
6299This variable contains a list of basic services (@pxref{Service Types
6300and Services}, for more information on service objects) one would
cf4a9129
LC
6301expect from the system: a login service (mingetty) on each tty, syslogd,
6302libc's name service cache daemon (nscd), the udev device manager, and
6303more.
401c53c4 6304
cf4a9129
LC
6305This is the default value of the @code{services} field of
6306@code{operating-system} declarations. Usually, when customizing a
6307system, you will want to append services to @var{%base-services}, like
6308this:
401c53c4 6309
cf4a9129 6310@example
fa1e31b8 6311(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
6312@end example
6313@end defvr
401c53c4 6314
be1c2c54 6315@deffn {Scheme Procedure} host-name-service @var{name}
cf4a9129
LC
6316Return a service that sets the host name to @var{name}.
6317@end deffn
401c53c4 6318
66e4f01c
LC
6319@deffn {Scheme Procedure} mingetty-service @var{config}
6320Return a service to run mingetty according to @var{config}, a
6321@code{<mingetty-configuration>} object, which specifies the tty to run, among
6322other things.
cf4a9129 6323@end deffn
401c53c4 6324
66e4f01c
LC
6325@deftp {Data Type} mingetty-configuration
6326This is the data type representing the configuration of Mingetty, which
6327implements console log-in.
6328
6329@table @asis
6330
6331@item @code{tty}
6332The name of the console this Mingetty runs on---e.g., @code{"tty1"}.
6333
6334@item @code{motd}
6335A file-like object containing the ``message of the day''.
6336
6337@item @code{auto-login} (default: @code{#f})
6338When true, this field must be a string denoting the user name under
6339which the the system automatically logs in. When it is @code{#f}, a
6340user name and password must be entered to log in.
6341
6342@item @code{login-program} (default: @code{#f})
6343This must be either @code{#f}, in which case the default log-in program
6344is used (@command{login} from the Shadow tool suite), or a gexp denoting
6345the name of the log-in program.
6346
6347@item @code{login-pause?} (default: @code{#f})
6348When set to @code{#t} in conjunction with @var{auto-login}, the user
6349will have to press a key before the log-in shell is launched.
6350
6351@item @code{mingetty} (default: @var{mingetty})
6352The Mingetty package to use.
6353
6354@end table
6355@end deftp
6356
6454b333
LC
6357@cindex name service cache daemon
6358@cindex nscd
be1c2c54 6359@deffn {Scheme Procedure} nscd-service [@var{config}] [#:glibc glibc] @
4aee6e60 6360 [#:name-services '()]
b893f1ae
LC
6361Return a service that runs libc's name service cache daemon (nscd) with the
6362given @var{config}---an @code{<nscd-configuration>} object. @xref{Name
6363Service Switch}, for an example.
cf4a9129 6364@end deffn
401c53c4 6365
6454b333
LC
6366@defvr {Scheme Variable} %nscd-default-configuration
6367This is the default @code{<nscd-configuration>} value (see below) used
6368by @code{nscd-service}. This uses the caches defined by
6369@var{%nscd-default-caches}; see below.
6370@end defvr
6371
6372@deftp {Data Type} nscd-configuration
6373This is the type representing the name service cache daemon (nscd)
6374configuration.
6375
6376@table @asis
6377
b893f1ae
LC
6378@item @code{name-services} (default: @code{'()})
6379List of packages denoting @dfn{name services} that must be visible to
6380the nscd---e.g., @code{(list @var{nss-mdns})}.
6381
6382@item @code{glibc} (default: @var{glibc})
6383Package object denoting the GNU C Library providing the @command{nscd}
6384command.
6385
6454b333
LC
6386@item @code{log-file} (default: @code{"/var/log/nscd.log"})
6387Name of nscd's log file. This is where debugging output goes when
6388@code{debug-level} is strictly positive.
6389
6390@item @code{debug-level} (default: @code{0})
6391Integer denoting the debugging levels. Higher numbers mean more
6392debugging output is logged.
6393
6394@item @code{caches} (default: @var{%nscd-default-caches})
6395List of @code{<nscd-cache>} objects denoting things to be cached; see
6396below.
6397
6398@end table
6399@end deftp
6400
6401@deftp {Data Type} nscd-cache
6402Data type representing a cache database of nscd and its parameters.
6403
6404@table @asis
6405
6406@item @code{database}
6407This is a symbol representing the name of the database to be cached.
6408Valid values are @code{passwd}, @code{group}, @code{hosts}, and
6409@code{services}, which designate the corresponding NSS database
6410(@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
6411
6412@item @code{positive-time-to-live}
6413@itemx @code{negative-time-to-live} (default: @code{20})
6414A number representing the number of seconds during which a positive or
6415negative lookup result remains in cache.
6416
6417@item @code{check-files?} (default: @code{#t})
6418Whether to check for updates of the files corresponding to
6419@var{database}.
6420
6421For instance, when @var{database} is @code{hosts}, setting this flag
6422instructs nscd to check for updates in @file{/etc/hosts} and to take
6423them into account.
6424
6425@item @code{persistent?} (default: @code{#t})
6426Whether the cache should be stored persistently on disk.
6427
6428@item @code{shared?} (default: @code{#t})
6429Whether the cache should be shared among users.
6430
6431@item @code{max-database-size} (default: 32@tie{}MiB)
6432Maximum size in bytes of the database cache.
6433
6434@c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
6435@c settings, so leave them out.
6436
6437@end table
6438@end deftp
6439
6440@defvr {Scheme Variable} %nscd-default-caches
6441List of @code{<nscd-cache>} objects used by default by
6442@code{nscd-configuration} (see above.)
6443
6444It enables persistent and aggressive caching of service and host name
6445lookups. The latter provides better host name lookup performance,
6446resilience in the face of unreliable name servers, and also better
6447privacy---often the result of host name lookups is in local cache, so
6448external name servers do not even need to be queried.
6449@end defvr
6450
6451
be1c2c54 6452@deffn {Scheme Procedure} syslog-service [#:config-file #f]
1bb76f75
AK
6453Return a service that runs @code{syslogd}. If configuration file name
6454@var{config-file} is not specified, use some reasonable default
cf4a9129
LC
6455settings.
6456@end deffn
401c53c4 6457
0adfe95a
LC
6458@anchor{guix-configuration-type}
6459@deftp {Data Type} guix-configuration
6460This data type represents the configuration of the Guix build daemon.
6461@xref{Invoking guix-daemon}, for more information.
6462
6463@table @asis
6464@item @code{guix} (default: @var{guix})
6465The Guix package to use.
401c53c4 6466
0adfe95a
LC
6467@item @code{build-group} (default: @code{"guixbuild"})
6468Name of the group for build user accounts.
401c53c4 6469
0adfe95a
LC
6470@item @code{build-accounts} (default: @code{10})
6471Number of build user accounts to create.
401c53c4 6472
0adfe95a
LC
6473@item @code{authorize-key?} (default: @code{#t})
6474Whether to authorize the substitute key for @code{hydra.gnu.org}
6475(@pxref{Substitutes}).
6476
6477@item @code{use-substitutes?} (default: @code{#t})
6478Whether to use substitutes.
6479
b0b9f6e0
LC
6480@item @code{substitute-urls} (default: @var{%default-substitute-urls})
6481The list of URLs where to look for substitutes by default.
6482
0adfe95a
LC
6483@item @code{extra-options} (default: @code{'()})
6484List of extra command-line options for @command{guix-daemon}.
6485
6486@item @code{lsof} (default: @var{lsof})
6487@itemx @code{lsh} (default: @var{lsh})
6488The lsof and lsh packages to use.
6489
6490@end table
6491@end deftp
6492
6493@deffn {Scheme Procedure} guix-service @var{config}
6494Return a service that runs the Guix build daemon according to
6495@var{config}.
cf4a9129 6496@end deffn
a1ba8475 6497
be1c2c54 6498@deffn {Scheme Procedure} udev-service [#:udev udev]
cf4a9129
LC
6499Run @var{udev}, which populates the @file{/dev} directory dynamically.
6500@end deffn
401c53c4 6501
be1c2c54 6502@deffn {Scheme Procedure} console-keymap-service @var{file}
5eca9459
AK
6503Return a service to load console keymap from @var{file} using
6504@command{loadkeys} command.
6505@end deffn
6506
8664cc88
LC
6507@deffn {Scheme Procedure} gpm-service-type [#:gpm @var{gpm}] @
6508 [#:options]
6509Run @var{gpm}, the general-purpose mouse daemon, with the given
6510command-line @var{options}. GPM allows users to use the mouse in the console,
6511notably to select, copy, and paste text. The default value of @var{options}
6512uses the @code{ps2} protocol, which works for both USB and PS/2 mice.
6513
6514This service is not part of @var{%base-services}.
6515@end deffn
6516
1c52181f
LC
6517@anchor{guix-publish-service}
6518@deffn {Scheme Procedure} guix-publish-service [#:guix @var{guix}] @
6519 [#:port 80] [#:host "localhost"]
6520Return a service that runs @command{guix publish} listening on @var{host}
6521and @var{port} (@pxref{Invoking guix publish}).
6522
6523This assumes that @file{/etc/guix} already contains a signing key pair as
6524created by @command{guix archive --generate-key} (@pxref{Invoking guix
6525archive}). If that is not the case, the service will fail to start.
6526@end deffn
6527
a69576ea 6528
cf4a9129
LC
6529@node Networking Services
6530@subsubsection Networking Services
401c53c4 6531
fa1e31b8 6532The @code{(gnu services networking)} module provides services to configure
cf4a9129 6533the network interface.
a1ba8475 6534
a023cca8 6535@cindex DHCP, networking service
be1c2c54 6536@deffn {Scheme Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
a023cca8
LC
6537Return a service that runs @var{dhcp}, a Dynamic Host Configuration
6538Protocol (DHCP) client, on all the non-loopback network interfaces.
6539@end deffn
6540
be1c2c54 6541@deffn {Scheme Procedure} static-networking-service @var{interface} @var{ip} @
cf4a9129
LC
6542 [#:gateway #f] [#:name-services @code{'()}]
6543Return a service that starts @var{interface} with address @var{ip}. If
6544@var{gateway} is true, it must be a string specifying the default network
6545gateway.
6546@end deffn
8b315a6d 6547
b7d0c494 6548@cindex wicd
87f40011 6549@cindex network management
be1c2c54 6550@deffn {Scheme Procedure} wicd-service [#:wicd @var{wicd}]
87f40011
LC
6551Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a network
6552management daemon that aims to simplify wired and wireless networking.
6553
6554This service adds the @var{wicd} package to the global profile, providing
6555several commands to interact with the daemon and configure networking:
6556@command{wicd-client}, a graphical user interface, and the @command{wicd-cli}
6557and @command{wicd-curses} user interfaces.
b7d0c494
MW
6558@end deffn
6559
be1c2c54 6560@deffn {Scheme Procedure} ntp-service [#:ntp @var{ntp}] @
63854bcb
LC
6561 [#:name-service @var{%ntp-servers}]
6562Return a service that runs the daemon from @var{ntp}, the
6563@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
6564keep the system clock synchronized with that of @var{servers}.
6565@end deffn
6566
6567@defvr {Scheme Variable} %ntp-servers
6568List of host names used as the default NTP servers.
6569@end defvr
6570
375c6108
LC
6571@deffn {Scheme Procedure} tor-service [@var{config-file}] [#:tor @var{tor}]
6572Return a service to run the @uref{https://torproject.org, Tor} anonymous
6573networking daemon.
8b315a6d 6574
375c6108
LC
6575The daemon runs as the @code{tor} unprivileged user. It is passed
6576@var{config-file}, a file-like object, with an additional @code{User tor}
6577line. Run @command{man tor} for information about the configuration file.
cf4a9129 6578@end deffn
8b315a6d 6579
be1c2c54 6580@deffn {Scheme Procedure} bitlbee-service [#:bitlbee bitlbee] @
4627a464
LC
6581 [#:interface "127.0.0.1"] [#:port 6667] @
6582 [#:extra-settings ""]
6583Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
6584acts as a gateway between IRC and chat networks.
6585
6586The daemon will listen to the interface corresponding to the IP address
6587specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
6588local clients can connect, whereas @code{0.0.0.0} means that connections can
6589come from any networking interface.
6590
6591In addition, @var{extra-settings} specifies a string to append to the
6592configuration file.
6593@end deffn
6594
f4391bec 6595Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 6596
be1c2c54 6597@deffn {Scheme Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
5833bf33 6598 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
cf4a9129
LC
6599 [#:allow-empty-passwords? #f] [#:root-login? #f] @
6600 [#:syslog-output? #t] [#:x11-forwarding? #t] @
6601 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
21cc905a 6602 [#:public-key-authentication? #t] [#:initialize? #t]
cf4a9129
LC
6603Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
6604@var{host-key} must designate a file containing the host key, and readable
6605only by root.
72e25e35 6606
5833bf33
DP
6607When @var{daemonic?} is true, @command{lshd} will detach from the
6608controlling terminal and log its output to syslogd, unless one sets
6609@var{syslog-output?} to false. Obviously, it also makes lsh-service
6610depend on existence of syslogd service. When @var{pid-file?} is true,
6611@command{lshd} writes its PID to the file called @var{pid-file}.
6612
cf4a9129
LC
6613When @var{initialize?} is true, automatically create the seed and host key
6614upon service activation if they do not exist yet. This may take long and
6615require interaction.
8b315a6d 6616
20dd519c
LC
6617When @var{initialize?} is false, it is up to the user to initialize the
6618randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
6619a key pair with the private key stored in file @var{host-key} (@pxref{lshd
6620basics,,, lsh, LSH Manual}).
6621
cf4a9129
LC
6622When @var{interfaces} is empty, lshd listens for connections on all the
6623network interfaces; otherwise, @var{interfaces} must be a list of host names
6624or addresses.
9bf3c1a7 6625
20dd519c
LC
6626@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
6627passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 6628root.
4af2447e 6629
cf4a9129
LC
6630The other options should be self-descriptive.
6631@end deffn
4af2447e 6632
fa0c1d61
LC
6633@defvr {Scheme Variable} %facebook-host-aliases
6634This variable contains a string for use in @file{/etc/hosts}
6635(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
6636line contains a entry that maps a known server name of the Facebook
6637on-line service---e.g., @code{www.facebook.com}---to the local
6638host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
6639
6640This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
6641@code{operating-system} declaration (@pxref{operating-system Reference,
6642@file{/etc/hosts}}):
fa0c1d61
LC
6643
6644@example
6645(use-modules (gnu) (guix))
6646
6647(operating-system
6648 (host-name "mymachine")
6649 ;; ...
6650 (hosts-file
6651 ;; Create a /etc/hosts file with aliases for "localhost"
6652 ;; and "mymachine", as well as for Facebook servers.
24e02c28
LC
6653 (plain-file "hosts"
6654 (string-append (local-host-aliases host-name)
6655 %facebook-host-aliases))))
fa0c1d61
LC
6656@end example
6657
6658This mechanism can prevent programs running locally, such as Web
6659browsers, from accessing Facebook.
6660@end defvr
6661
965a7332
LC
6662The @code{(gnu services avahi)} provides the following definition.
6663
be1c2c54 6664@deffn {Scheme Procedure} avahi-service [#:avahi @var{avahi}] @
965a7332
LC
6665 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
6666 [#:ipv6? #t] [#:wide-area? #f] @
6667 [#:domains-to-browse '()]
6668Return a service that runs @command{avahi-daemon}, a system-wide
6669mDNS/DNS-SD responder that allows for service discovery and
cc9c1f39
LC
6670"zero-configuration" host name lookups (see @uref{http://avahi.org/}), and
6671extends the name service cache daemon (nscd) so that it can resolve
6672@code{.local} host names using
1065bed9
LC
6673@uref{http://0pointer.de/lennart/projects/nss-mdns/, nss-mdns}. Additionally,
6674add the @var{avahi} package to the system profile so that commands such as
6675@command{avahi-browse} are directly usable.
965a7332
LC
6676
6677If @var{host-name} is different from @code{#f}, use that as the host name to
6678publish for this machine; otherwise, use the machine's actual host name.
6679
6680When @var{publish?} is true, publishing of host names and services is allowed;
6681in particular, avahi-daemon will publish the machine's host name and IP
6682address via mDNS on the local network.
6683
6684When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
6685
6686Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
6687sockets.
6688@end deffn
6689
6690
cf4a9129
LC
6691@node X Window
6692@subsubsection X Window
68ad877c 6693
cf4a9129
LC
6694Support for the X Window graphical display system---specifically
6695Xorg---is provided by the @code{(gnu services xorg)} module. Note that
6696there is no @code{xorg-service} procedure. Instead, the X server is
6697started by the @dfn{login manager}, currently SLiM.
4af2447e 6698
be1c2c54 6699@deffn {Scheme Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
6700 [#:auto-login? #f] [#:default-user ""] [#:startx] @
6701 [#:theme @var{%default-slim-theme}] @
4bd43bbe 6702 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
6703Return a service that spawns the SLiM graphical login manager, which in
6704turn starts the X display server with @var{startx}, a command as returned by
6705@code{xorg-start-command}.
4af2447e 6706
04e4e6ab
LC
6707@cindex X session
6708
6709SLiM automatically looks for session types described by the @file{.desktop}
6710files in @file{/run/current-system/profile/share/xsessions} and allows users
6711to choose a session from the log-in screen using @kbd{F1}. Packages such as
6712@var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
6713adding them to the system-wide set of packages automatically makes them
6714available at the log-in screen.
6715
6716In addition, @file{~/.xsession} files are honored. When available,
6717@file{~/.xsession} must be an executable that starts a window manager
6718and/or other X clients.
6719
cf4a9129
LC
6720When @var{allow-empty-passwords?} is true, allow logins with an empty
6721password. When @var{auto-login?} is true, log in automatically as
6722@var{default-user}.
0ecc3bf3
LC
6723
6724If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
6725@var{theme} must be a gexp denoting the name of a directory containing the
6726theme to use. In that case, @var{theme-name} specifies the name of the
6727theme.
cf4a9129 6728@end deffn
4af2447e 6729
0ecc3bf3
LC
6730@defvr {Scheme Variable} %default-theme
6731@defvrx {Scheme Variable} %default-theme-name
6732The G-Expression denoting the default SLiM theme and its name.
6733@end defvr
6734
be1c2c54 6735@deffn {Scheme Procedure} xorg-start-command [#:guile] @
d1cdd7ba 6736 [#:configuration-file #f] [#:xorg-server @var{xorg-server}]
f703413e 6737Return a derivation that builds a @var{guile} script to start the X server
d1cdd7ba
LC
6738from @var{xorg-server}. @var{configuration-file} is the server configuration
6739file or a derivation that builds it; when omitted, the result of
6740@code{xorg-configuration-file} is used.
6741
6742Usually the X server is started by a login manager.
6743@end deffn
6744
be1c2c54 6745@deffn {Scheme Procedure} xorg-configuration-file @
12422c9d 6746 [#:drivers '()] [#:resolutions '()] [#:extra-config '()]
d1cdd7ba
LC
6747Return a configuration file for the Xorg server containing search paths for
6748all the common drivers.
f703413e
LC
6749
6750@var{drivers} must be either the empty list, in which case Xorg chooses a
6751graphics driver automatically, or a list of driver names that will be tried in
d1cdd7ba 6752this order---e.g., @code{(\"modesetting\" \"vesa\")}.
d2e59637
LC
6753
6754Likewise, when @var{resolutions} is the empty list, Xorg chooses an
6755appropriate screen resolution; otherwise, it must be a list of
6756resolutions---e.g., @code{((1024 768) (640 480))}.
12422c9d
LC
6757
6758Last, @var{extra-config} is a list of strings or objects appended to the
6759@code{text-file*} argument list. It is used to pass extra text to be added
6760verbatim to the configuration file.
f703413e 6761@end deffn
4af2447e 6762
6726282b
LC
6763@deffn {Scheme Procedure} screen-locker-service @var{package} [@var{name}]
6764Add @var{package}, a package for a screen-locker or screen-saver whose
6765command is @var{program}, to the set of setuid programs and add a PAM entry
6766for it. For example:
6767
6768@lisp
6769(screen-locker-service xlockmore "xlock")
6770@end lisp
6771
6772makes the good ol' XlockMore usable.
6773@end deffn
6774
6775
fe1a39d3
LC
6776@node Desktop Services
6777@subsubsection Desktop Services
aa4ed923 6778
fe1a39d3
LC
6779The @code{(gnu services desktop)} module provides services that are
6780usually useful in the context of a ``desktop'' setup---that is, on a
6781machine running a graphical display server, possibly with graphical user
6782interfaces, etc.
aa4ed923 6783
4467be21
LC
6784To simplify things, the module defines a variable containing the set of
6785services that users typically expect on a machine with a graphical
6786environment and networking:
6787
6788@defvr {Scheme Variable} %desktop-services
6789This is a list of services that builds upon @var{%base-services} and
6790adds or adjust services for a typical ``desktop'' setup.
6791
6792In particular, it adds a graphical login manager (@pxref{X Window,
6726282b
LC
6793@code{slim-service}}), screen lockers,
6794a network management tool (@pxref{Networking
4467be21 6795Services, @code{wicd-service}}), energy and color management services,
4650a77e 6796the @code{elogind} login and seat manager, the Polkit privilege service,
cee32ee4
AW
6797the GeoClue location service, an NTP client (@pxref{Networking
6798Services}), the Avahi daemon, and has the name service switch service
6799configured to be able to use @code{nss-mdns} (@pxref{Name Service
6800Switch, mDNS}).
4467be21
LC
6801@end defvr
6802
6803The @var{%desktop-services} variable can be used as the @code{services}
6804field of an @code{operating-system} declaration (@pxref{operating-system
6805Reference, @code{services}}).
6806
0adfe95a
LC
6807The actual service definitions provided by @code{(gnu services dbus)}
6808and @code{(gnu services desktop)} are described below.
4467be21 6809
0adfe95a 6810@deffn {Scheme Procedure} dbus-service [#:dbus @var{dbus}] [#:services '()]
fe1a39d3
LC
6811Return a service that runs the ``system bus'', using @var{dbus}, with
6812support for @var{services}.
aa4ed923 6813
fe1a39d3
LC
6814@uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
6815facility. Its system bus is used to allow system services to communicate
6816and be notified of system-wide events.
aa4ed923 6817
fe1a39d3
LC
6818@var{services} must be a list of packages that provide an
6819@file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
6820and policy files. For example, to allow avahi-daemon to use the system bus,
6821@var{services} must be equal to @code{(list avahi)}.
aa4ed923
AK
6822@end deffn
6823
0adfe95a 6824@deffn {Scheme Procedure} elogind-service [#:config @var{config}]
4650a77e
AW
6825Return a service that runs the @code{elogind} login and
6826seat management daemon. @uref{https://github.com/andywingo/elogind,
6827Elogind} exposes a D-Bus interface that can be used to know which users
6828are logged in, know what kind of sessions they have open, suspend the
6829system, inhibit system suspend, reboot the system, and other tasks.
6830
6831Elogind handles most system-level power events for a computer, for
6832example suspending the system when a lid is closed, or shutting it down
6833when the power button is pressed.
6834
6835The @var{config} keyword argument specifies the configuration for
6836elogind, and should be the result of a @code{(elogind-configuration
6837(@var{parameter} @var{value})...)} invocation. Available parameters and
6838their default values are:
6839
6840@table @code
6841@item kill-user-processes?
6842@code{#f}
6843@item kill-only-users
6844@code{()}
6845@item kill-exclude-users
6846@code{("root")}
6847@item inhibit-delay-max-seconds
6848@code{5}
6849@item handle-power-key
6850@code{poweroff}
6851@item handle-suspend-key
6852@code{suspend}
6853@item handle-hibernate-key
6854@code{hibernate}
6855@item handle-lid-switch
6856@code{suspend}
6857@item handle-lid-switch-docked
6858@code{ignore}
6859@item power-key-ignore-inhibited?
6860@code{#f}
6861@item suspend-key-ignore-inhibited?
6862@code{#f}
6863@item hibernate-key-ignore-inhibited?
6864@code{#f}
6865@item lid-switch-ignore-inhibited?
6866@code{#t}
6867@item holdoff-timeout-seconds
6868@code{30}
6869@item idle-action
6870@code{ignore}
6871@item idle-action-seconds
6872@code{(* 30 60)}
6873@item runtime-directory-size-percent
6874@code{10}
6875@item runtime-directory-size
6876@code{#f}
6877@item remove-ipc?
6878@code{#t}
6879@item suspend-state
6880@code{("mem" "standby" "freeze")}
6881@item suspend-mode
6882@code{()}
6883@item hibernate-state
6884@code{("disk")}
6885@item hibernate-mode
6886@code{("platform" "shutdown")}
6887@item hybrid-sleep-state
6888@code{("disk")}
6889@item hybrid-sleep-mode
6890@code{("suspend" "platform" "shutdown")}
6891@end table
6892@end deffn
6893
be1c2c54 6894@deffn {Scheme Procedure} polkit-service @
4650a77e 6895 [#:polkit @var{polkit}]
222e3319
LC
6896Return a service that runs the
6897@uref{http://www.freedesktop.org/wiki/Software/polkit/, Polkit privilege
6898management service}, which allows system administrators to grant access to
6899privileged operations in a structured way. By querying the Polkit service, a
6900privileged system component can know when it should grant additional
6901capabilities to ordinary users. For example, an ordinary user can be granted
6902the capability to suspend the system if the user is logged in locally.
4650a77e
AW
6903@end deffn
6904
be1c2c54 6905@deffn {Scheme Procedure} upower-service [#:upower @var{upower}] @
be234128
AW
6906 [#:watts-up-pro? #f] @
6907 [#:poll-batteries? #t] @
6908 [#:ignore-lid? #f] @
6909 [#:use-percentage-for-policy? #f] @
6910 [#:percentage-low 10] @
6911 [#:percentage-critical 3] @
6912 [#:percentage-action 2] @
6913 [#:time-low 1200] @
6914 [#:time-critical 300] @
6915 [#:time-action 120] @
6916 [#:critical-power-action 'hybrid-sleep]
6917Return a service that runs @uref{http://upower.freedesktop.org/,
6918@command{upowerd}}, a system-wide monitor for power consumption and battery
6919levels, with the given configuration settings. It implements the
6920@code{org.freedesktop.UPower} D-Bus interface, and is notably used by
6921GNOME.
6922@end deffn
6923
2b9e0a94
LC
6924@deffn {Scheme Procedure} udisks-service [#:udisks @var{udisks}]
6925Return a service for @uref{http://udisks.freedesktop.org/docs/latest/,
6926UDisks}, a @dfn{disk management} daemon that provides user interfaces with
6927notifications and ways to mount/unmount disks. Programs that talk to UDisks
6928include the @command{udisksctl} command, part of UDisks, and GNOME Disks.
6929@end deffn
6930
be1c2c54 6931@deffn {Scheme Procedure} colord-service [#:colord @var{colord}]
7ce597ff
AW
6932Return a service that runs @command{colord}, a system service with a D-Bus
6933interface to manage the color profiles of input and output devices such as
6934screens and scanners. It is notably used by the GNOME Color Manager graphical
6935tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
6936site} for more information.
6937@end deffn
6938
cee32ee4
AW
6939@deffn {Scheme Procedure} geoclue-application name [#:allowed? #t] [#:system? #f] [#:users '()]
6940Return an configuration allowing an application to access GeoClue
6941location data. @var{name} is the Desktop ID of the application, without
6942the @code{.desktop} part. If @var{allowed?} is true, the application
6943will have access to location information by default. The boolean
6944@var{system?} value indicates that an application is a system component
6945or not. Finally @var{users} is a list of UIDs of all users for which
6946this application is allowed location info access. An empty users list
6947means that all users are allowed.
6948@end deffn
6949
6950@defvr {Scheme Variable} %standard-geoclue-applications
6951The standard list of well-known GeoClue application configurations,
6952granting authority to GNOME's date-and-time utility to ask for the
6953current location in order to set the time zone, and allowing the Firefox
6954(IceCat) and Epiphany web browsers to request location information.
6955Firefox and Epiphany both query the user before allowing a web page to
6956know the user's location.
6957@end defvr
6958
be1c2c54 6959@deffn {Scheme Procedure} geoclue-service [#:colord @var{colord}] @
cee32ee4
AW
6960 [#:whitelist '()] @
6961 [#:wifi-geolocation-url "https://location.services.mozilla.com/v1/geolocate?key=geoclue"] @
6962 [#:submit-data? #f]
6963 [#:wifi-submission-url "https://location.services.mozilla.com/v1/submit?key=geoclue"] @
6964 [#:submission-nick "geoclue"] @
6965 [#:applications %standard-geoclue-applications]
6966Return a service that runs the GeoClue location service. This service
6967provides a D-Bus interface to allow applications to request access to a
6968user's physical location, and optionally to add information to online
6969location databases. See
6970@uref{https://wiki.freedesktop.org/www/Software/GeoClue/, the GeoClue
6971web site} for more information.
6972@end deffn
6973
105369a4
DT
6974@node Database Services
6975@subsubsection Database Services
6976
6977The @code{(gnu services databases)} module provides the following service.
6978
be1c2c54 6979@deffn {Scheme Procedure} postgresql-service [#:postgresql postgresql] @
105369a4
DT
6980 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
6981Return a service that runs @var{postgresql}, the PostgreSQL database
6982server.
6983
6984The PostgreSQL daemon loads its runtime configuration from
6985@var{config-file} and stores the database cluster in
6986@var{data-directory}.
6987@end deffn
fe1a39d3 6988
58724c48
DT
6989@node Web Services
6990@subsubsection Web Services
6991
6992The @code{(gnu services web)} module provides the following service:
6993
be1c2c54 6994@deffn {Scheme Procedure} nginx-service [#:nginx nginx] @
58724c48
DT
6995 [#:log-directory ``/var/log/nginx''] @
6996 [#:run-directory ``/var/run/nginx''] @
6997 [#:config-file]
6998
6999Return a service that runs @var{nginx}, the nginx web server.
7000
7001The nginx daemon loads its runtime configuration from @var{config-file}.
7002Log files are written to @var{log-directory} and temporary runtime data
7003files are written to @var{run-directory}. For proper operation, these
7004arguments should match what is in @var{config-file} to ensure that the
7005directories are created when the service is activated.
7006
7007@end deffn
7008
fe1a39d3
LC
7009@node Various Services
7010@subsubsection Various Services
7011
7012The @code{(gnu services lirc)} module provides the following service.
7013
be1c2c54 7014@deffn {Scheme Procedure} lirc-service [#:lirc lirc] @
fe1a39d3
LC
7015 [#:device #f] [#:driver #f] [#:config-file #f] @
7016 [#:extra-options '()]
7017Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
7018decodes infrared signals from remote controls.
7019
7020Optionally, @var{device}, @var{driver} and @var{config-file}
7021(configuration file name) may be specified. See @command{lircd} manual
7022for details.
7023
7024Finally, @var{extra-options} is a list of additional command-line options
7025passed to @command{lircd}.
7026@end deffn
7027
7028
0ae8c15a
LC
7029@node Setuid Programs
7030@subsection Setuid Programs
7031
7032@cindex setuid programs
7033Some programs need to run with ``root'' privileges, even when they are
7034launched by unprivileged users. A notorious example is the
4d40227c
LC
7035@command{passwd} program, which users can run to change their
7036password, and which needs to access the @file{/etc/passwd} and
0ae8c15a
LC
7037@file{/etc/shadow} files---something normally restricted to root, for
7038obvious security reasons. To address that, these executables are
7039@dfn{setuid-root}, meaning that they always run with root privileges
7040(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
7041for more info about the setuid mechanisms.)
7042
7043The store itself @emph{cannot} contain setuid programs: that would be a
7044security issue since any user on the system can write derivations that
7045populate the store (@pxref{The Store}). Thus, a different mechanism is
7046used: instead of changing the setuid bit directly on files that are in
7047the store, we let the system administrator @emph{declare} which programs
7048should be setuid root.
7049
7050The @code{setuid-programs} field of an @code{operating-system}
7051declaration contains a list of G-expressions denoting the names of
7052programs to be setuid-root (@pxref{Using the Configuration System}).
7053For instance, the @command{passwd} program, which is part of the Shadow
7054package, can be designated by this G-expression (@pxref{G-Expressions}):
7055
7056@example
7057#~(string-append #$shadow "/bin/passwd")
7058@end example
7059
7060A default set of setuid programs is defined by the
7061@code{%setuid-programs} variable of the @code{(gnu system)} module.
7062
7063@defvr {Scheme Variable} %setuid-programs
7064A list of G-expressions denoting common programs that are setuid-root.
7065
7066The list includes commands such as @command{passwd}, @command{ping},
7067@command{su}, and @command{sudo}.
7068@end defvr
7069
7070Under the hood, the actual setuid programs are created in the
7071@file{/run/setuid-programs} directory at system activation time. The
7072files in this directory refer to the ``real'' binaries, which are in the
7073store.
7074
efb5e833
LC
7075@node X.509 Certificates
7076@subsection X.509 Certificates
7077
7078@cindex HTTPS, certificates
7079@cindex X.509 certificates
7080@cindex TLS
7081Web servers available over HTTPS (that is, HTTP over the transport-layer
7082security mechanism, TLS) send client programs an @dfn{X.509 certificate}
7083that the client can then use to @emph{authenticate} the server. To do
7084that, clients verify that the server's certificate is signed by a
7085so-called @dfn{certificate authority} (CA). But to verify the CA's
7086signature, clients must have first acquired the CA's certificate.
7087
7088Web browsers such as GNU@tie{}IceCat include their own set of CA
7089certificates, such that they are able to verify CA signatures
7090out-of-the-box.
7091
7092However, most other programs that can talk HTTPS---@command{wget},
7093@command{git}, @command{w3m}, etc.---need to be told where CA
7094certificates can be found.
7095
7096@cindex @code{nss-certs}
7097In GuixSD, this is done by adding a package that provides certificates
7098to the @code{packages} field of the @code{operating-system} declaration
7099(@pxref{operating-system Reference}). GuixSD includes one such package,
7100@code{nss-certs}, which is a set of CA certificates provided as part of
7101Mozilla's Network Security Services.
7102
7103Note that it is @emph{not} part of @var{%base-packages}, so you need to
7104explicitly add it. The @file{/etc/ssl/certs} directory, which is where
7105most applications and libraries look for certificates by default, points
7106to the certificates installed globally.
7107
7108Unprivileged users can also install their own certificate package in
7109their profile. A number of environment variables need to be defined so
7110that applications and libraries know where to find them. Namely, the
7111OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
7112variables. Some applications add their own environment variables; for
7113instance, the Git version control system honors the certificate bundle
7114pointed to by the @code{GIT_SSL_CAINFO} environment variable.
7115
7116
996ed739
LC
7117@node Name Service Switch
7118@subsection Name Service Switch
7119
7120@cindex name service switch
7121@cindex NSS
7122The @code{(gnu system nss)} module provides bindings to the
7123configuration file of libc's @dfn{name service switch} or @dfn{NSS}
7124(@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
7125Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
7126extended with new ``name'' lookup methods for system databases, which
7127includes host names, service names, user accounts, and more (@pxref{Name
7128Service Switch, System Databases and Name Service Switch,, libc, The GNU
7129C Library Reference Manual}).
7130
7131The NSS configuration specifies, for each system database, which lookup
7132method is to be used, and how the various methods are chained
7133together---for instance, under which circumstances NSS should try the
7134next method in the list. The NSS configuration is given in the
7135@code{name-service-switch} field of @code{operating-system} declarations
7136(@pxref{operating-system Reference, @code{name-service-switch}}).
7137
4c9050c6
LC
7138@cindex nss-mdns
7139@cindex .local, host name lookup
996ed739 7140As an example, the declaration below configures the NSS to use the
4c9050c6
LC
7141@uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
7142back-end}, which supports host name lookups over multicast DNS (mDNS)
7143for host names ending in @code{.local}:
996ed739
LC
7144
7145@example
7146(name-service-switch
7147 (hosts (list %files ;first, check /etc/hosts
7148
7149 ;; If the above did not succeed, try
7150 ;; with 'mdns_minimal'.
7151 (name-service
7152 (name "mdns_minimal")
7153
7154 ;; 'mdns_minimal' is authoritative for
7155 ;; '.local'. When it returns "not found",
7156 ;; no need to try the next methods.
7157 (reaction (lookup-specification
7158 (not-found => return))))
7159
7160 ;; Then fall back to DNS.
7161 (name-service
7162 (name "dns"))
7163
7164 ;; Finally, try with the "full" 'mdns'.
7165 (name-service
7166 (name "mdns")))))
7167@end example
7168
15137a29
LC
7169Don't worry: the @code{%mdns-host-lookup-nss} variable (see below)
7170contains this configuration, so you won't have to type it if all you
7171want is to have @code{.local} host lookup working.
7172
4c9050c6
LC
7173Note that, in this case, in addition to setting the
7174@code{name-service-switch} of the @code{operating-system} declaration,
cc9c1f39
LC
7175you also need to use @code{avahi-service} (@pxref{Networking Services,
7176@code{avahi-service}}), or @var{%desktop-services}, which includes it
7177(@pxref{Desktop Services}). Doing this makes @code{nss-mdns} accessible
7178to the name service cache daemon (@pxref{Base Services,
7179@code{nscd-service}}).
15137a29
LC
7180
7181For convenience, the following variables provide typical NSS
7182configurations.
7183
7184@defvr {Scheme Variable} %default-nss
7185This is the default name service switch configuration, a
7186@code{name-service-switch} object.
7187@end defvr
7188
7189@defvr {Scheme Variable} %mdns-host-lookup-nss
7190This is the name service switch configuration with support for host name
7191lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
7192@end defvr
4c9050c6 7193
996ed739
LC
7194The reference for name service switch configuration is given below. It
7195is a direct mapping of the C library's configuration file format, so
7196please refer to the C library manual for more information (@pxref{NSS
7197Configuration File,,, libc, The GNU C Library Reference Manual}).
7198Compared to libc's NSS configuration file format, it has the advantage
7199not only of adding this warm parenthetic feel that we like, but also
7200static checks: you'll know about syntax errors and typos as soon as you
7201run @command{guix system}.
7202
996ed739
LC
7203@deftp {Data Type} name-service-switch
7204
7205This is the data type representation the configuration of libc's name
7206service switch (NSS). Each field below represents one of the supported
7207system databases.
7208
7209@table @code
7210@item aliases
7211@itemx ethers
7212@itemx group
7213@itemx gshadow
7214@itemx hosts
7215@itemx initgroups
7216@itemx netgroup
7217@itemx networks
7218@itemx password
7219@itemx public-key
7220@itemx rpc
7221@itemx services
7222@itemx shadow
7223The system databases handled by the NSS. Each of these fields must be a
7224list of @code{<name-service>} objects (see below.)
7225@end table
7226@end deftp
7227
7228@deftp {Data Type} name-service
7229
7230This is the data type representing an actual name service and the
7231associated lookup action.
7232
7233@table @code
7234@item name
7235A string denoting the name service (@pxref{Services in the NSS
7236configuration,,, libc, The GNU C Library Reference Manual}).
7237
4aee6e60
LC
7238Note that name services listed here must be visible to nscd. This is
7239achieved by passing the @code{#:name-services} argument to
7240@code{nscd-service} the list of packages providing the needed name
7241services (@pxref{Base Services, @code{nscd-service}}).
7242
996ed739
LC
7243@item reaction
7244An action specified using the @code{lookup-specification} macro
7245(@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
7246Reference Manual}). For example:
7247
7248@example
7249(lookup-specification (unavailable => continue)
7250 (success => return))
7251@end example
7252@end table
7253@end deftp
0ae8c15a 7254
fd1b1fa2
LC
7255@node Initial RAM Disk
7256@subsection Initial RAM Disk
7257
7258@cindex initial RAM disk (initrd)
7259@cindex initrd (initial RAM disk)
7260For bootstrapping purposes, the Linux-Libre kernel is passed an
7261@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
7262root file system, as well as an initialization script. The latter is
7263responsible for mounting the real root file system, and for loading any
7264kernel modules that may be needed to achieve that.
7265
7266The @code{initrd} field of an @code{operating-system} declaration allows
7267you to specify which initrd you would like to use. The @code{(gnu
7268system linux-initrd)} module provides two ways to build an initrd: the
7269high-level @code{base-initrd} procedure, and the low-level
7270@code{expression->initrd} procedure.
7271
7272The @code{base-initrd} procedure is intended to cover most common uses.
7273For example, if you want to add a bunch of kernel modules to be loaded
7274at boot time, you can define the @code{initrd} field of the operating
7275system declaration like this:
7276
7277@example
52ac153e 7278(initrd (lambda (file-systems . rest)
027981d6
LC
7279 ;; Create a standard initrd that has modules "foo.ko"
7280 ;; and "bar.ko", as well as their dependencies, in
7281 ;; addition to the modules available by default.
52ac153e 7282 (apply base-initrd file-systems
027981d6 7283 #:extra-modules '("foo" "bar")
52ac153e 7284 rest)))
fd1b1fa2
LC
7285@end example
7286
52ac153e
LC
7287The @code{base-initrd} procedure also handles common use cases that
7288involves using the system as a QEMU guest, or as a ``live'' system whose
7289root file system is volatile.
fd1b1fa2
LC
7290
7291@deffn {Monadic Procedure} base-initrd @var{file-systems} @
7292 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 7293 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
7294Return a monadic derivation that builds a generic initrd. @var{file-systems} is
7295a list of file-systems to be mounted by the initrd, possibly in addition to
7296the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
7297@var{mapped-devices} is a list of device mappings to realize before
7298@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
7299
7300When @var{qemu-networking?} is true, set up networking with the standard QEMU
7301parameters. When @var{virtio?} is true, load additional modules so the initrd can
7302be used as a QEMU guest with para-virtualized I/O drivers.
7303
7304When @var{volatile-root?} is true, the root file system is writable but any changes
7305to it are lost.
7306
7307The initrd is automatically populated with all the kernel modules necessary
7308for @var{file-systems} and for the given options. However, additional kernel
7309modules can be listed in @var{extra-modules}. They will be added to the initrd, and
7310loaded at boot time in the order in which they appear.
7311@end deffn
7312
7313Needless to say, the initrds we produce and use embed a
7314statically-linked Guile, and the initialization program is a Guile
7315program. That gives a lot of flexibility. The
7316@code{expression->initrd} procedure builds such an initrd, given the
7317program to run in that initrd.
7318
7319@deffn {Monadic Procedure} expression->initrd @var{exp} @
7320 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 7321 [#:modules '()]
fd1b1fa2
LC
7322Return a derivation that builds a Linux initrd (a gzipped cpio archive)
7323containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
7324upon booting. All the derivations referenced by @var{exp} are
7325automatically copied to the initrd.
fd1b1fa2 7326
42d10464
LC
7327@var{modules} is a list of Guile module names to be embedded in the
7328initrd.
fd1b1fa2
LC
7329@end deffn
7330
88faf933
LC
7331@node GRUB Configuration
7332@subsection GRUB Configuration
7333
7334@cindex GRUB
7335@cindex boot loader
7336
7337The operating system uses GNU@tie{}GRUB as its boot loader
7338(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
7339configured using @code{grub-configuration} declarations. This data type
7340is exported by the @code{(gnu system grub)} module, and described below.
7341
7342@deftp {Data Type} grub-configuration
7343The type of a GRUB configuration declaration.
7344
7345@table @asis
7346
7347@item @code{device}
7348This is a string denoting the boot device. It must be a device name
7349understood by the @command{grub-install} command, such as
7350@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
7351GNU GRUB Manual}).
7352
7353@item @code{menu-entries} (default: @code{()})
7354A possibly empty list of @code{menu-entry} objects (see below), denoting
7355entries to appear in the GRUB boot menu, in addition to the current
7356system entry and the entry pointing to previous system generations.
7357
7358@item @code{default-entry} (default: @code{0})
7359The index of the default boot menu entry. Index 0 is for the current
7360system's entry.
7361
7362@item @code{timeout} (default: @code{5})
7363The number of seconds to wait for keyboard input before booting. Set to
73640 to boot immediately, and to -1 to wait indefinitely.
7365
7366@item @code{theme} (default: @var{%default-theme})
7367The @code{grub-theme} object describing the theme to use.
7368@end table
7369
7370@end deftp
7371
7372Should you want to list additional boot menu entries @i{via} the
7373@code{menu-entries} field above, you will need to create them with the
7374@code{menu-entry} form:
7375
7376@deftp {Data Type} menu-entry
7377The type of an entry in the GRUB boot menu.
7378
7379@table @asis
7380
7381@item @code{label}
35ed9306 7382The label to show in the menu---e.g., @code{"GNU"}.
88faf933
LC
7383
7384@item @code{linux}
7385The Linux kernel to boot.
7386
7387@item @code{linux-arguments} (default: @code{()})
7388The list of extra Linux kernel command-line arguments---e.g.,
7389@code{("console=ttyS0")}.
7390
7391@item @code{initrd}
7392A G-Expression or string denoting the file name of the initial RAM disk
7393to use (@pxref{G-Expressions}).
7394
7395@end table
7396@end deftp
7397
7398@c FIXME: Write documentation once it's stable.
7399Themes are created using the @code{grub-theme} form, which is not
7400documented yet.
7401
7402@defvr {Scheme Variable} %default-theme
7403This is the default GRUB theme used by the operating system, with a
7404fancy background image displaying the GNU and Guix logos.
7405@end defvr
7406
7407
cf4a9129
LC
7408@node Invoking guix system
7409@subsection Invoking @code{guix system}
0918e64a 7410
cf4a9129
LC
7411Once you have written an operating system declaration, as seen in the
7412previous section, it can be @dfn{instantiated} using the @command{guix
7413system} command. The synopsis is:
4af2447e 7414
cf4a9129
LC
7415@example
7416guix system @var{options}@dots{} @var{action} @var{file}
7417@end example
4af2447e 7418
cf4a9129
LC
7419@var{file} must be the name of a file containing an
7420@code{operating-system} declaration. @var{action} specifies how the
7421operating system is instantiate. Currently the following values are
7422supported:
4af2447e 7423
cf4a9129
LC
7424@table @code
7425@item reconfigure
7426Build the operating system described in @var{file}, activate it, and
7427switch to it@footnote{This action is usable only on systems already
65797bff 7428running GuixSD.}.
4af2447e 7429
cf4a9129
LC
7430This effects all the configuration specified in @var{file}: user
7431accounts, system services, global package list, setuid programs, etc.
4af2447e 7432
cf4a9129
LC
7433It also adds a GRUB menu entry for the new OS configuration, and moves
7434entries for older configurations to a submenu---unless
7435@option{--no-grub} is passed.
4af2447e 7436
bf2479c7
LC
7437@c The paragraph below refers to the problem discussed at
7438@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
7439It is highly recommended to run @command{guix pull} once before you run
7440@command{guix system reconfigure} for the first time (@pxref{Invoking
7441guix pull}). Failing to do that you would see an older version of Guix
7442once @command{reconfigure} has completed.
7443
cf4a9129
LC
7444@item build
7445Build the operating system's derivation, which includes all the
7446configuration files and programs needed to boot and run the system.
7447This action does not actually install anything.
113daf62 7448
cf4a9129
LC
7449@item init
7450Populate the given directory with all the files necessary to run the
7451operating system specified in @var{file}. This is useful for first-time
4705641f 7452installations of GuixSD. For instance:
113daf62
LC
7453
7454@example
cf4a9129 7455guix system init my-os-config.scm /mnt
113daf62
LC
7456@end example
7457
cf4a9129
LC
7458copies to @file{/mnt} all the store items required by the configuration
7459specified in @file{my-os-config.scm}. This includes configuration
7460files, packages, and so on. It also creates other essential files
7461needed for the system to operate correctly---e.g., the @file{/etc},
7462@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 7463
cf4a9129
LC
7464This command also installs GRUB on the device specified in
7465@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 7466
cf4a9129
LC
7467@item vm
7468@cindex virtual machine
0276f697 7469@cindex VM
f535dcbe 7470@anchor{guix system vm}
cf4a9129
LC
7471Build a virtual machine that contain the operating system declared in
7472@var{file}, and return a script to run that virtual machine (VM).
810568b3 7473Arguments given to the script are passed as is to QEMU.
113daf62 7474
cf4a9129 7475The VM shares its store with the host system.
113daf62 7476
0276f697
LC
7477Additional file systems can be shared between the host and the VM using
7478the @code{--share} and @code{--expose} command-line options: the former
7479specifies a directory to be shared with write access, while the latter
7480provides read-only access to the shared directory.
7481
7482The example below creates a VM in which the user's home directory is
7483accessible read-only, and where the @file{/exchange} directory is a
7484read-write mapping of the host's @file{$HOME/tmp}:
7485
7486@example
7487guix system vm my-config.scm \
7488 --expose=$HOME --share=$HOME/tmp=/exchange
7489@end example
7490
6aa260af
LC
7491On GNU/Linux, the default is to boot directly to the kernel; this has
7492the advantage of requiring only a very tiny root disk image since the
7493host's store can then be mounted.
7494
7495The @code{--full-boot} option forces a complete boot sequence, starting
7496with the bootloader. This requires more disk space since a root image
7497containing at least the kernel, initrd, and bootloader data files must
7498be created. The @code{--image-size} option can be used to specify the
7499image's size.
ab11f0be 7500
cf4a9129
LC
7501@item vm-image
7502@itemx disk-image
7503Return a virtual machine or disk image of the operating system declared
7504in @var{file} that stands alone. Use the @option{--image-size} option
7505to specify the size of the image.
113daf62 7506
cf4a9129
LC
7507When using @code{vm-image}, the returned image is in qcow2 format, which
7508the QEMU emulator can efficiently use.
113daf62 7509
cf4a9129
LC
7510When using @code{disk-image}, a raw disk image is produced; it can be
7511copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
7512the device corresponding to a USB stick, one can copy the image on it
7513using the following command:
113daf62 7514
cf4a9129
LC
7515@example
7516# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
7517@end example
113daf62 7518
1c8a81b1
DT
7519@item container
7520Return a script to run the operating system declared in @var{file}
7521within a container. Containers are a set of lightweight isolation
7522mechanisms provided by the kernel Linux-libre. Containers are
7523substantially less resource-demanding than full virtual machines since
7524the kernel, shared objects, and other resources can be shared with the
7525host system; this also means they provide thinner isolation.
7526
7527Currently, the script must be run as root in order to support more than
7528a single user and group. The container shares its store with the host
7529system.
7530
7531As with the @code{vm} action (@pxref{guix system vm}), additional file
7532systems to be shared between the host and container can be specified
7533using the @option{--share} and @option{--expose} options:
7534
7535@example
7536guix system container my-config.scm \
7537 --expose=$HOME --share=$HOME/tmp=/exchange
7538@end example
7539
0f252e26 7540@quotation Note
cfd35b4e 7541This option requires Linux-libre 3.19 or newer.
0f252e26
DT
7542@end quotation
7543
cf4a9129 7544@end table
113daf62 7545
cf4a9129
LC
7546@var{options} can contain any of the common build options provided by
7547@command{guix build} (@pxref{Invoking guix build}). In addition,
7548@var{options} can contain one of the following:
113daf62 7549
cf4a9129
LC
7550@table @option
7551@item --system=@var{system}
7552@itemx -s @var{system}
7553Attempt to build for @var{system} instead of the host's system type.
7554This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 7555
f3f427c2
LC
7556@item --derivation
7557@itemx -d
7558Return the derivation file name of the given operating system without
7559building anything.
7560
cf4a9129
LC
7561@item --image-size=@var{size}
7562For the @code{vm-image} and @code{disk-image} actions, create an image
7563of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
7564include a unit as a suffix (@pxref{Block size, size specifications,,
7565coreutils, GNU Coreutils}).
db030303
LC
7566
7567@item --on-error=@var{strategy}
7568Apply @var{strategy} when an error occurs when reading @var{file}.
7569@var{strategy} may be one of the following:
7570
7571@table @code
7572@item nothing-special
7573Report the error concisely and exit. This is the default strategy.
7574
7575@item backtrace
7576Likewise, but also display a backtrace.
7577
7578@item debug
7579Report the error and enter Guile's debugger. From there, you can run
7580commands such as @code{,bt} to get a backtrace, @code{,locals} to
7581display local variable values, and more generally inspect the program's
7582state. @xref{Debug Commands,,, guile, GNU Guile Reference Manual}, for
7583a list of available debugging commands.
7584@end table
113daf62 7585@end table
113daf62 7586
cf4a9129
LC
7587Note that all the actions above, except @code{build} and @code{init},
7588rely on KVM support in the Linux-Libre kernel. Specifically, the
7589machine should have hardware virtualization support, the corresponding
7590KVM kernel module should be loaded, and the @file{/dev/kvm} device node
7591must exist and be readable and writable by the user and by the daemon's
7592build users.
8451a568 7593
65797bff
LC
7594Once you have built, configured, re-configured, and re-re-configured
7595your GuixSD installation, you may find it useful to list the operating
7596system generations available on disk---and that you can choose from the
7597GRUB boot menu:
7598
7599@table @code
7600
7601@item list-generations
7602List a summary of each generation of the operating system available on
7603disk, in a human-readable way. This is similar to the
7604@option{--list-generations} option of @command{guix package}
7605(@pxref{Invoking guix package}).
7606
7607Optionally, one can specify a pattern, with the same syntax that is used
7608in @command{guix package --list-generations}, to restrict the list of
7609generations displayed. For instance, the following command displays
7610generations up to 10-day old:
7611
7612@example
7613$ guix system list-generations 10d
7614@end example
7615
7616@end table
7617
d6c3267a
LC
7618The @command{guix system} command has even more to offer! The following
7619sub-commands allow you to visualize how your system services relate to
7620each other:
7621
7622@anchor{system-extension-graph}
7623@table @code
7624
7625@item extension-graph
7626Emit in Dot/Graphviz format to standard output the @dfn{service
7627extension graph} of the operating system defined in @var{file}
7628(@pxref{Service Composition}, for more information on service
7629extensions.)
7630
7631The command:
7632
7633@example
7634$ guix system extension-graph @var{file} | dot -Tpdf > services.pdf
7635@end example
7636
7637produces a PDF file showing the extension relations among services.
7638
6f305ea5
LC
7639@anchor{system-dmd-graph}
7640@item dmd-graph
7641Emit in Dot/Graphviz format to standard output the @dfn{dependency
7642graph} of dmd services of the operating system defined in @var{file}.
7643@xref{dmd Services}, for more information and for an example graph.
7644
d6c3267a
LC
7645@end table
7646
7647
cf4a9129
LC
7648@node Defining Services
7649@subsection Defining Services
8451a568 7650
eb524192 7651The previous sections show the available services and how one can combine
0adfe95a
LC
7652them in an @code{operating-system} declaration. But how do we define
7653them in the first place? And what is a service anyway?
8451a568 7654
0adfe95a
LC
7655@menu
7656* Service Composition:: The model for composing services.
7657* Service Types and Services:: Types and services.
7658* Service Reference:: API reference.
7659* dmd Services:: A particular type of service.
7660@end menu
7661
7662@node Service Composition
7663@subsubsection Service Composition
7664
7665@cindex services
7666@cindex daemons
7667Here we define a @dfn{service} as, broadly, something that extends the
7668operating system's functionality. Often a service is a process---a
7669@dfn{daemon}---started when the system boots: a secure shell server, a
7670Web server, the Guix build daemon, etc. Sometimes a service is a daemon
7671whose execution can be triggered by another daemon---e.g., an FTP server
7672started by @command{inetd} or a D-Bus service activated by
7673@command{dbus-daemon}. Occasionally, a service does not map to a
7674daemon. For instance, the ``account'' service collects user accounts
7675and makes sure they exist when the system runs; the ``udev'' service
7676collects device management rules and makes them available to the eudev
7677daemon; the @file{/etc} service populates the system's @file{/etc}
7678directory.
7679
d6c3267a 7680@cindex service extensions
0adfe95a
LC
7681GuixSD services are connected by @dfn{extensions}. For instance, the
7682secure shell service @emph{extends} dmd---GuixSD's initialization system,
7683running as PID@tie{}1---by giving it the command lines to start and stop
7684the secure shell daemon (@pxref{Networking Services,
7685@code{lsh-service}}); the UPower service extends the D-Bus service by
7686passing it its @file{.service} specification, and extends the udev
7687service by passing it device management rules (@pxref{Desktop Services,
7688@code{upower-service}}); the Guix daemon service extends dmd by passing
7689it the command lines to start and stop the daemon, and extends the
7690account service by passing it a list of required build user accounts
7691(@pxref{Base Services}).
7692
7693All in all, services and their ``extends'' relations form a directed
7694acyclic graph (DAG). If we represent services as boxes and extensions
7695as arrows, a typical system might provide something like this:
7696
7697@image{images/service-graph,,5in,Typical service extension graph.}
7698
d62e201c
LC
7699@cindex system service
7700At the bottom, we see the @dfn{system service}, which produces the
7701directory containing everything to run and boot the system, as returned
7702by the @command{guix system build} command. @xref{Service Reference},
7703to learn about the other service types shown here.
d6c3267a
LC
7704@xref{system-extension-graph, the @command{guix system extension-graph}
7705command}, for information on how to generate this representation for a
7706particular operating system definition.
0adfe95a
LC
7707
7708@cindex service types
7709Technically, developers can define @dfn{service types} to express these
7710relations. There can be any number of services of a given type on the
7711system---for instance, a system running two instances of the GNU secure
7712shell server (lsh) has two instances of @var{lsh-service-type}, with
7713different parameters.
7714
7715The following section describes the programming interface for service
7716types and services.
7717
7718@node Service Types and Services
7719@subsubsection Service Types and Services
7720
7721A @dfn{service type} is a node in the DAG described above. Let us start
7722with a simple example, the service type for the Guix build daemon
7723(@pxref{Invoking guix-daemon}):
7724
7725@example
7726(define guix-service-type
7727 (service-type
7728 (name 'guix)
7729 (extensions
7730 (list (service-extension dmd-root-service-type guix-dmd-service)
7731 (service-extension account-service-type guix-accounts)
7732 (service-extension activation-service-type guix-activation)))))
7733@end example
8451a568 7734
cf4a9129 7735@noindent
0adfe95a
LC
7736It defines a two things:
7737
7738@enumerate
7739@item
7740A name, whose sole purpose is to make inspection and debugging easier.
7741
7742@item
7743A list of @dfn{service extensions}, where each extension designates the
7744target service type and a procedure that, given the service's
7745parameters, returns a list of object to extend the service of that type.
7746
7747Every service type has at least one service extension. The only
7748exception is the @dfn{boot service type}, which is the ultimate service.
7749@end enumerate
7750
7751In this example, @var{guix-service-type} extends three services:
7752
7753@table @var
7754@item dmd-root-service-type
7755The @var{guix-dmd-service} procedure defines how the dmd service is
7756extended. Namely, it returns a @code{<dmd-service>} object that defines
7757how @command{guix-daemon} is started and stopped (@pxref{dmd Services}).
7758
7759@item account-service-type
7760This extension for this service is computed by @var{guix-accounts},
7761which returns a list of @code{user-group} and @code{user-account}
7762objects representing the build user accounts (@pxref{Invoking
7763guix-daemon}).
7764
7765@item activation-service-type
7766Here @var{guix-activation} is a procedure that returns a gexp, which is
7767a code snippet to run at ``activation time''---e.g., when the service is
7768booted.
7769@end table
7770
7771A service of this type is instantiated like this:
7772
7773@example
7774(service guix-service-type
7775 (guix-configuration
7776 (build-accounts 5)
7777 (use-substitutes? #f)))
7778@end example
7779
7780The second argument to the @code{service} form is a value representing
7781the parameters of this specific service instance.
7782@xref{guix-configuration-type, @code{guix-configuration}}, for
7783information about the @code{guix-configuration} data type.
7784
7785@var{guix-service-type} is quite simple because it extends other
7786services but is not extensible itself.
7787
7788@c @subsubsubsection Extensible Service Types
7789
7790The service type for an @emph{extensible} service looks like this:
7791
7792@example
7793(define udev-service-type
7794 (service-type (name 'udev)
7795 (extensions
7796 (list (service-extension dmd-root-service-type
7797 udev-dmd-service)))
7798
7799 (compose concatenate) ;concatenate the list of rules
7800 (extend (lambda (config rules)
7801 (match config
7802 (($ <udev-configuration> udev initial-rules)
7803 (udev-configuration
7804 (udev udev) ;the udev package to use
7805 (rules (append initial-rules rules)))))))))
7806@end example
7807
7808This is the service type for the
7809@uref{https://wiki.gentoo.org/wiki/Project:Eudev, eudev device
7810management daemon}. Compared to the previous example, in addition to an
7811extension of @var{dmd-root-service-type}, we see two new fields:
7812
7813@table @code
7814@item compose
7815This is the procedure to @dfn{compose} the list of extensions to
7816services of this type.
7817
7818Services can extend the udev service by passing it lists of rules; we
7819compose those extensions simply by concatenating them.
7820
7821@item extend
7822This procedure defines how the service's value is @dfn{extended} with
7823the composition of the extensions.
7824
7825Udev extensions are composed into a list of rules, but the udev service
7826value is itself a @code{<udev-configuration>} record. So here, we
7827extend that record by appending the list of rules is contains to the
7828list of contributed rules.
7829@end table
7830
7831There can be only one instance of an extensible service type such as
7832@var{udev-service-type}. If there were more, the
7833@code{service-extension} specifications would be ambiguous.
7834
7835Still here? The next section provides a reference of the programming
7836interface for services.
7837
7838@node Service Reference
7839@subsubsection Service Reference
7840
7841We have seen an overview of service types (@pxref{Service Types and
7842Services}). This section provides a reference on how to manipulate
7843services and service types. This interface is provided by the
7844@code{(gnu services)} module.
7845
7846@deffn {Scheme Procedure} service @var{type} @var{value}
7847Return a new service of @var{type}, a @code{<service-type>} object (see
7848below.) @var{value} can be any object; it represents the parameters of
7849this particular service instance.
7850@end deffn
7851
7852@deffn {Scheme Procedure} service? @var{obj}
7853Return true if @var{obj} is a service.
7854@end deffn
8451a568 7855
0adfe95a
LC
7856@deffn {Scheme Procedure} service-kind @var{service}
7857Return the type of @var{service}---i.e., a @code{<service-type>} object.
7858@end deffn
7859
7860@deffn {Scheme Procedure} service-parameters @var{service}
7861Return the value associated with @var{service}. It represents its
7862parameters.
7863@end deffn
7864
7865Here is an example of how a service is created and manipulated:
7866
7867@example
7868(define s
7869 (service nginx-service-type
7870 (nginx-configuration
7871 (nginx nginx)
7872 (log-directory log-directory)
7873 (run-directory run-directory)
7874 (file config-file))))
7875
7876(service? s)
7877@result{} #t
7878
7879(eq? (service-kind s) nginx-service-type)
7880@result{} #t
7881@end example
7882
cd6f6c22
LC
7883The @code{modify-services} form provides a handy way to change the
7884parameters of some of the services of a list such as
7885@var{%base-services} (@pxref{Base Services, @code{%base-services}}). Of
7886course, you could always use standard list combinators such as
7887@code{map} and @code{fold} to do that (@pxref{SRFI-1, List Library,,
7888guile, GNU Guile Reference Manual}); @code{modify-services} simply
7889provides a more concise form for this common pattern.
7890
7891@deffn {Scheme Syntax} modify-services @var{services} @
7892 (@var{type} @var{variable} => @var{body}) @dots{}
7893
7894Modify the services listed in @var{services} according to the given
7895clauses. Each clause has the form:
7896
7897@example
7898(@var{type} @var{variable} => @var{body})
7899@end example
7900
7901where @var{type} is a service type, such as @var{guix-service-type}, and
7902@var{variable} is an identifier that is bound within @var{body} to the
7903value of the service of that @var{type}. @xref{Using the Configuration
7904System}, for an example.
7905
7906This is a shorthand for:
7907
7908@example
7909(map (lambda (service) @dots{}) @var{services})
7910@end example
7911@end deffn
7912
7913Next comes the programming interface for service types. This is
7914something you want to know when writing new service definitions, but not
7915necessarily when simply looking for ways to customize your
7916@code{operating-system} declaration.
7917
0adfe95a
LC
7918@deftp {Data Type} service-type
7919@cindex service type
7920This is the representation of a @dfn{service type} (@pxref{Service Types
7921and Services}).
7922
7923@table @asis
7924@item @code{name}
7925This is a symbol, used only to simplify inspection and debugging.
7926
7927@item @code{extensions}
7928A non-empty list of @code{<service-extension>} objects (see below.)
7929
7930@item @code{compose} (default: @code{#f})
7931If this is @code{#f}, then the service type denotes services that cannot
7932be extended---i.e., services that do not receive ``values'' from other
7933services.
7934
7935Otherwise, it must be a one-argument procedure. The procedure is called
7936by @code{fold-services} and is passed a list of values collected from
7937extensions. It must return a value that is a valid parameter value for
7938the service instance.
7939
7940@item @code{extend} (default: @code{#f})
7941If this is @code{#f}, services of this type cannot be extended.
7942
7943Otherwise, it must be a two-argument procedure: @code{fold-services}
7944calls it, passing it the service's initial value as the first argument
7945and the result of applying @code{compose} to the extension values as the
7946second argument.
7947@end table
7948
7949@xref{Service Types and Services}, for examples.
7950@end deftp
7951
7952@deffn {Scheme Procedure} service-extension @var{target-type} @
7953 @var{compute}
7954Return a new extension for services of type @var{target-type}.
7955@var{compute} must be a one-argument procedure: @code{fold-services}
7956calls it, passing it the value associated with the service that provides
7957the extension; it must return a valid value for the target service.
7958@end deffn
7959
7960@deffn {Scheme Procedure} service-extension? @var{obj}
7961Return true if @var{obj} is a service extension.
7962@end deffn
7963
7964At the core of the service abstraction lies the @code{fold-services}
7965procedure, which is responsible for ``compiling'' a list of services
d62e201c
LC
7966down to a single directory that contains everything needed to boot and
7967run the system---the directory shown by the @command{guix system build}
7968command (@pxref{Invoking guix system}). In essence, it propagates
7969service extensions down the service graph, updating each node parameters
7970on the way, until it reaches the root node.
0adfe95a
LC
7971
7972@deffn {Scheme Procedure} fold-services @var{services} @
d62e201c 7973 [#:target-type @var{system-service-type}]
0adfe95a
LC
7974Fold @var{services} by propagating their extensions down to the root of
7975type @var{target-type}; return the root service adjusted accordingly.
7976@end deffn
7977
7978Lastly, the @code{(gnu services)} module also defines several essential
7979service types, some of which are listed below.
7980
d62e201c
LC
7981@defvr {Scheme Variable} system-service-type
7982This is the root of the service graph. It produces the system directory
7983as returned by the @command{guix system build} command.
7984@end defvr
7985
0adfe95a 7986@defvr {Scheme Variable} boot-service-type
d62e201c
LC
7987The type of the ``boot service'', which produces the @dfn{boot script}.
7988The boot script is what the initial RAM disk runs when booting.
0adfe95a
LC
7989@end defvr
7990
7991@defvr {Scheme Variable} etc-service-type
7992The type of the @file{/etc} service. This service can be extended by
7993passing it name/file tuples such as:
7994
7995@example
7996(list `("issue" ,(plain-file "issue" "Welcome!\n")))
7997@end example
7998
7999In this example, the effect would be to add an @file{/etc/issue} file
8000pointing to the given file.
8001@end defvr
8002
8003@defvr {Scheme Variable} setuid-program-service-type
8004Type for the ``setuid-program service''. This service collects lists of
8005executable file names, passed as gexps, and adds them to the set of
8006setuid-root programs on the system (@pxref{Setuid Programs}).
8007@end defvr
8008
af4c3fd5
LC
8009@defvr {Scheme Variable} profile-service-type
8010Type of the service that populates the @dfn{system profile}---i.e., the
8011programs under @file{/run/current-system/profile}. Other services can
8012extend it by passing it lists of packages to add to the system profile.
8013@end defvr
8014
0adfe95a
LC
8015
8016@node dmd Services
8017@subsubsection dmd Services
8018
8019@cindex PID 1
8020@cindex init system
8021The @code{(gnu services dmd)} provides a way to define services managed
8022by GNU@tie{}dmd, which is GuixSD initialization system---the first
8023process that is started when the system boots, aka. PID@tie{}1
6f305ea5
LC
8024(@pxref{Introduction,,, dmd, GNU dmd Manual}).
8025
8026Services in dmd can depend on each other. For instance, the SSH daemon
8027may need to be started after the syslog daemon has been started, which
8028in turn can only happen once all the file systems have been mounted.
8029The simple operating system defined earlier (@pxref{Using the
8030Configuration System}) results in a service graph like this:
8031
8032@image{images/dmd-graph,,5in,Typical dmd service graph.}
8033
8034You can actually generate such a graph for any operating system
8035definition using the @command{guix system dmd-graph} command
8036(@pxref{system-dmd-graph, @command{guix system dmd-graph}}).
8037
8038The @var{%dmd-root-service} is a service object representing PID@tie{}1,
8039of type @var{dmd-root-service-type}; it can be extended by passing it
8040lists of @code{<dmd-service>} objects.
0adfe95a
LC
8041
8042@deftp {Data Type} dmd-service
8043The data type representing a service managed by dmd.
8044
8045@table @asis
8046@item @code{provision}
8047This is a list of symbols denoting what the service provides.
8048
8049These are the names that may be passed to @command{deco start},
8050@command{deco status}, and similar commands (@pxref{Invoking deco,,,
8051dmd, GNU dmd Manual}). @xref{Slots of services, the @code{provides}
8052slot,, dmd, GNU dmd Manual}, for details.
8053
8054@item @code{requirements} (default: @code{'()})
8055List of symbols denoting the dmd services this one depends on.
8056
8057@item @code{respawn?} (default: @code{#t})
8058Whether to restart the service when it stops, for instance when the
8059underlying process dies.
8060
8061@item @code{start}
8062@itemx @code{stop} (default: @code{#~(const #f)})
cf4a9129
LC
8063The @code{start} and @code{stop} fields refer to dmd's facilities to
8064start and stop processes (@pxref{Service De- and Constructors,,, dmd,
0adfe95a
LC
8065GNU dmd Manual}). They are given as G-expressions that get expanded in
8066the dmd configuration file (@pxref{G-Expressions}).
8067
8068@item @code{documentation}
8069A documentation string, as shown when running:
8070
8071@example
8072deco doc @var{service-name}
8073@end example
8074
8075where @var{service-name} is one of the symbols in @var{provision}
8076(@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
fae685b9
LC
8077
8078@item @code{modules} (default: @var{%default-modules})
8079This is the list of modules that must be in scope when @code{start} and
8080@code{stop} are evaluated.
8081
8082@item @code{imported-modules} (default: @var{%default-imported-modules})
8083This is the list of modules to import in the execution environment of
8084dmd.
8085
0adfe95a
LC
8086@end table
8087@end deftp
8088
8089@defvr {Scheme Variable} dmd-root-service-type
8090The service type for the dmd ``root service''---i.e., PID@tie{}1.
8091
8092This is the service type that extensions target when they want to create
8093dmd services (@pxref{Service Types and Services}, for an example). Each
8094extension must pass a list of @code{<dmd-service>}.
8095@end defvr
8096
8097@defvr {Scheme Variable} %dmd-root-service
8098This service represents PID@tie{}1.
8099@end defvr
8451a568 8100
8451a568 8101
cf4a9129
LC
8102@node Installing Debugging Files
8103@section Installing Debugging Files
8451a568 8104
cf4a9129
LC
8105@cindex debugging files
8106Program binaries, as produced by the GCC compilers for instance, are
8107typically written in the ELF format, with a section containing
8108@dfn{debugging information}. Debugging information is what allows the
8109debugger, GDB, to map binary code to source code; it is required to
8110debug a compiled program in good conditions.
8451a568 8111
cf4a9129
LC
8112The problem with debugging information is that is takes up a fair amount
8113of disk space. For example, debugging information for the GNU C Library
8114weighs in at more than 60 MiB. Thus, as a user, keeping all the
8115debugging info of all the installed programs is usually not an option.
8116Yet, space savings should not come at the cost of an impediment to
8117debugging---especially in the GNU system, which should make it easier
8118for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 8119
cf4a9129
LC
8120Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
8121mechanism that allows users to get the best of both worlds: debugging
8122information can be stripped from the binaries and stored in separate
8123files. GDB is then able to load debugging information from those files,
8124when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
8125with GDB}).
8451a568 8126
cf4a9129
LC
8127The GNU distribution takes advantage of this by storing debugging
8128information in the @code{lib/debug} sub-directory of a separate package
8129output unimaginatively called @code{debug} (@pxref{Packages with
8130Multiple Outputs}). Users can choose to install the @code{debug} output
8131of a package when they need it. For instance, the following command
8132installs the debugging information for the GNU C Library and for GNU
8133Guile:
8451a568
LC
8134
8135@example
cf4a9129 8136guix package -i glibc:debug guile:debug
8451a568
LC
8137@end example
8138
cf4a9129
LC
8139GDB must then be told to look for debug files in the user's profile, by
8140setting the @code{debug-file-directory} variable (consider setting it
8141from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
8142GDB}):
8451a568 8143
cf4a9129
LC
8144@example
8145(gdb) set debug-file-directory ~/.guix-profile/lib/debug
8146@end example
8451a568 8147
cf4a9129
LC
8148From there on, GDB will pick up debugging information from the
8149@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 8150
cf4a9129
LC
8151In addition, you will most likely want GDB to be able to show the source
8152code being debugged. To do that, you will have to unpack the source
8153code of the package of interest (obtained with @code{guix build
8154--source}, @pxref{Invoking guix build}), and to point GDB to that source
8155directory using the @code{directory} command (@pxref{Source Path,
8156@code{directory},, gdb, Debugging with GDB}).
8451a568 8157
cf4a9129
LC
8158@c XXX: keep me up-to-date
8159The @code{debug} output mechanism in Guix is implemented by the
8160@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
8161opt-in---debugging information is available only for those packages
8162whose definition explicitly declares a @code{debug} output. This may be
8163changed to opt-out in the future, if our build farm servers can handle
8164the load. To check whether a package has a @code{debug} output, use
8165@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 8166
8451a568 8167
05962f29
LC
8168@node Security Updates
8169@section Security Updates
8170
843858b8
LC
8171@quotation Note
8172As of version @value{VERSION}, the feature described in this section is
8173experimental.
8174@end quotation
05962f29
LC
8175
8176@cindex security updates
8177Occasionally, important security vulnerabilities are discovered in core
8178software packages and must be patched. Guix follows a functional
8179package management discipline (@pxref{Introduction}), which implies
8180that, when a package is changed, @emph{every package that depends on it}
8181must be rebuilt. This can significantly slow down the deployment of
8182fixes in core packages such as libc or Bash, since basically the whole
8183distribution would need to be rebuilt. Using pre-built binaries helps
8184(@pxref{Substitutes}), but deployment may still take more time than
8185desired.
8186
8187@cindex grafts
8188To address that, Guix implements @dfn{grafts}, a mechanism that allows
8189for fast deployment of critical updates without the costs associated
8190with a whole-distribution rebuild. The idea is to rebuild only the
8191package that needs to be patched, and then to ``graft'' it onto packages
8192explicitly installed by the user and that were previously referring to
8193the original package. The cost of grafting is typically very low, and
8194order of magnitudes lower than a full rebuild of the dependency chain.
8195
8196@cindex replacements of packages, for grafts
8197For instance, suppose a security update needs to be applied to Bash.
8198Guix developers will provide a package definition for the ``fixed''
8199Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
8200Packages}). Then, the original package definition is augmented with a
8201@code{replacement} field pointing to the package containing the bug fix:
8202
8203@example
8204(define bash
8205 (package
8206 (name "bash")
8207 ;; @dots{}
8208 (replacement bash-fixed)))
8209@end example
8210
8211From there on, any package depending directly or indirectly on Bash that
8212is installed will automatically be ``rewritten'' to refer to
8213@var{bash-fixed} instead of @var{bash}. This grafting process takes
8214time proportional to the size of the package, but expect less than a
8215minute for an ``average'' package on a recent machine.
8216
8217Currently, the graft and the package it replaces (@var{bash-fixed} and
8218@var{bash} in the example above) must have the exact same @code{name}
8219and @code{version} fields. This restriction mostly comes from the fact
8220that grafting works by patching files, including binary files, directly.
8221Other restrictions may apply: for instance, when adding a graft to a
8222package providing a shared library, the original shared library and its
8223replacement must have the same @code{SONAME} and be binary-compatible.
8224
8225
cf4a9129
LC
8226@node Package Modules
8227@section Package Modules
8451a568 8228
cf4a9129
LC
8229From a programming viewpoint, the package definitions of the
8230GNU distribution are provided by Guile modules in the @code{(gnu packages
8231@dots{})} name space@footnote{Note that packages under the @code{(gnu
8232packages @dots{})} module name space are not necessarily ``GNU
8233packages''. This module naming scheme follows the usual Guile module
8234naming convention: @code{gnu} means that these modules are distributed
8235as part of the GNU system, and @code{packages} identifies modules that
8236define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
8237Reference Manual}). For instance, the @code{(gnu packages emacs)}
8238module exports a variable named @code{emacs}, which is bound to a
8239@code{<package>} object (@pxref{Defining Packages}).
113daf62 8240
300868ba 8241The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
8242automatically scanned for packages by the command-line tools. For
8243instance, when running @code{guix package -i emacs}, all the @code{(gnu
8244packages @dots{})} modules are scanned until one that exports a package
8245object whose name is @code{emacs} is found. This package search
8246facility is implemented in the @code{(gnu packages)} module.
113daf62 8247
300868ba 8248@cindex customization, of packages
8689901f 8249@cindex package module search path
cf4a9129 8250Users can store package definitions in modules with different
60142854 8251names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
c95ded7e
LC
8252name and module name must match. For instance, the @code{(my-packages
8253emacs)} module must be stored in a @file{my-packages/emacs.scm} file
8254relative to the load path specified with @option{--load-path} or
8255@code{GUIX_PACKAGE_PATH}. @xref{Modules and the File System,,,
8256guile, GNU Guile Reference Manual}, for details.}. These package definitions
300868ba
LC
8257will not be visible by default. Thus, users can invoke commands such as
8258@command{guix package} and @command{guix build} have to be used with the
c95ded7e
LC
8259@code{-e} option so that they know where to find the package. Better
8260yet, they can use the
300868ba 8261@code{-L} option of these commands to make those modules visible
8689901f
LC
8262(@pxref{Invoking guix build, @code{--load-path}}), or define the
8263@code{GUIX_PACKAGE_PATH} environment variable. This environment
8264variable makes it easy to extend or customize the distribution and is
8265honored by all the user interfaces.
8266
8267@defvr {Environment Variable} GUIX_PACKAGE_PATH
8268This is a colon-separated list of directories to search for package
8269modules. Directories listed in this variable take precedence over the
8270distribution's own modules.
8271@end defvr
ef5dd60a 8272
cf4a9129
LC
8273The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
8274each package is built based solely on other packages in the
8275distribution. The root of this dependency graph is a small set of
8276@dfn{bootstrap binaries}, provided by the @code{(gnu packages
8277bootstrap)} module. For more information on bootstrapping,
081145cf 8278@pxref{Bootstrapping}.
ef5dd60a 8279
cf4a9129
LC
8280@node Packaging Guidelines
8281@section Packaging Guidelines
ef5dd60a 8282
cf4a9129
LC
8283The GNU distribution is nascent and may well lack some of your favorite
8284packages. This section describes how you can help make the distribution
8285grow. @xref{Contributing}, for additional information on how you can
8286help.
ef5dd60a 8287
cf4a9129
LC
8288Free software packages are usually distributed in the form of
8289@dfn{source code tarballs}---typically @file{tar.gz} files that contain
8290all the source files. Adding a package to the distribution means
8291essentially two things: adding a @dfn{recipe} that describes how to
8292build the package, including a list of other packages required to build
8293it, and adding @dfn{package meta-data} along with that recipe, such as a
8294description and licensing information.
ef5dd60a 8295
cf4a9129
LC
8296In Guix all this information is embodied in @dfn{package definitions}.
8297Package definitions provide a high-level view of the package. They are
8298written using the syntax of the Scheme programming language; in fact,
8299for each package we define a variable bound to the package definition,
8300and export that variable from a module (@pxref{Package Modules}).
8301However, in-depth Scheme knowledge is @emph{not} a prerequisite for
8302creating packages. For more information on package definitions,
081145cf 8303@pxref{Defining Packages}.
ef5dd60a 8304
cf4a9129
LC
8305Once a package definition is in place, stored in a file in the Guix
8306source tree, it can be tested using the @command{guix build} command
8307(@pxref{Invoking guix build}). For example, assuming the new package is
c71979f4
LC
8308called @code{gnew}, you may run this command from the Guix build tree
8309(@pxref{Running Guix Before It Is Installed}):
ef5dd60a
LC
8310
8311@example
cf4a9129 8312./pre-inst-env guix build gnew --keep-failed
ef5dd60a 8313@end example
ef5dd60a 8314
cf4a9129
LC
8315Using @code{--keep-failed} makes it easier to debug build failures since
8316it provides access to the failed build tree. Another useful
8317command-line option when debugging is @code{--log-file}, to access the
8318build log.
ef5dd60a 8319
cf4a9129
LC
8320If the package is unknown to the @command{guix} command, it may be that
8321the source file contains a syntax error, or lacks a @code{define-public}
8322clause to export the package variable. To figure it out, you may load
8323the module from Guile to get more information about the actual error:
ef5dd60a 8324
cf4a9129
LC
8325@example
8326./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
8327@end example
ef5dd60a 8328
cf4a9129
LC
8329Once your package builds correctly, please send us a patch
8330(@pxref{Contributing}). Well, if you need help, we will be happy to
8331help you too. Once the patch is committed in the Guix repository, the
8332new package automatically gets built on the supported platforms by
2b1cee21 8333@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 8334system}.
ef5dd60a 8335
cf4a9129
LC
8336@cindex substituter
8337Users can obtain the new package definition simply by running
8338@command{guix pull} (@pxref{Invoking guix pull}). When
8339@code{hydra.gnu.org} is done building the package, installing the
8340package automatically downloads binaries from there
8341(@pxref{Substitutes}). The only place where human intervention is
8342needed is to review and apply the patch.
ef5dd60a 8343
ef5dd60a 8344
cf4a9129 8345@menu
ec0339cd
LC
8346* Software Freedom:: What may go into the distribution.
8347* Package Naming:: What's in a name?
8348* Version Numbers:: When the name is not enough.
cbd02397 8349* Synopses and Descriptions:: Helping users find the right package.
ec0339cd
LC
8350* Python Modules:: Taming the snake.
8351* Perl Modules:: Little pearls.
8352* Fonts:: Fond of fonts.
cf4a9129 8353@end menu
ef5dd60a 8354
cf4a9129
LC
8355@node Software Freedom
8356@subsection Software Freedom
ef5dd60a 8357
cf4a9129 8358@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 8359
cf4a9129
LC
8360The GNU operating system has been developed so that users can have
8361freedom in their computing. GNU is @dfn{free software}, meaning that
8362users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
8363essential freedoms}: to run the program, to study and change the program
8364in source code form, to redistribute exact copies, and to distribute
8365modified versions. Packages found in the GNU distribution provide only
8366software that conveys these four freedoms.
c11a6eb1 8367
cf4a9129
LC
8368In addition, the GNU distribution follow the
8369@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
8370software distribution guidelines}. Among other things, these guidelines
8371reject non-free firmware, recommendations of non-free software, and
8372discuss ways to deal with trademarks and patents.
ef5dd60a 8373
cf4a9129
LC
8374Some packages contain a small and optional subset that violates the
8375above guidelines, for instance because this subset is itself non-free
8376code. When that happens, the offending items are removed with
8377appropriate patches or code snippets in the package definition's
8378@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
8379build --source} returns the ``freed'' source rather than the unmodified
8380upstream source.
ef5dd60a 8381
ef5dd60a 8382
cf4a9129
LC
8383@node Package Naming
8384@subsection Package Naming
ef5dd60a 8385
cf4a9129
LC
8386A package has actually two names associated with it:
8387First, there is the name of the @emph{Scheme variable}, the one following
8388@code{define-public}. By this name, the package can be made known in the
8389Scheme code, for instance as input to another package. Second, there is
8390the string in the @code{name} field of a package definition. This name
8391is used by package management commands such as
8392@command{guix package} and @command{guix build}.
ef5dd60a 8393
cf4a9129
LC
8394Both are usually the same and correspond to the lowercase conversion of
8395the project name chosen upstream, with underscores replaced with
8396hyphens. For instance, GNUnet is available as @code{gnunet}, and
8397SDL_net as @code{sdl-net}.
927097ef 8398
cf4a9129 8399We do not add @code{lib} prefixes for library packages, unless these are
081145cf 8400already part of the official project name. But @pxref{Python
cf4a9129
LC
8401Modules} and @ref{Perl Modules} for special rules concerning modules for
8402the Python and Perl languages.
927097ef 8403
1b366ee4 8404Font package names are handled differently, @pxref{Fonts}.
7fec52b7 8405
ef5dd60a 8406
cf4a9129
LC
8407@node Version Numbers
8408@subsection Version Numbers
ef5dd60a 8409
cf4a9129
LC
8410We usually package only the latest version of a given free software
8411project. But sometimes, for instance for incompatible library versions,
8412two (or more) versions of the same package are needed. These require
8413different Scheme variable names. We use the name as defined
8414in @ref{Package Naming}
8415for the most recent version; previous versions use the same name, suffixed
8416by @code{-} and the smallest prefix of the version number that may
8417distinguish the two versions.
ef5dd60a 8418
cf4a9129
LC
8419The name inside the package definition is the same for all versions of a
8420package and does not contain any version number.
ef5dd60a 8421
cf4a9129 8422For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 8423
cf4a9129
LC
8424@example
8425(define-public gtk+
8426 (package
17d8e33f
ML
8427 (name "gtk+")
8428 (version "3.9.12")
8429 ...))
cf4a9129
LC
8430(define-public gtk+-2
8431 (package
17d8e33f
ML
8432 (name "gtk+")
8433 (version "2.24.20")
8434 ...))
cf4a9129
LC
8435@end example
8436If we also wanted GTK+ 3.8.2, this would be packaged as
8437@example
8438(define-public gtk+-3.8
8439 (package
17d8e33f
ML
8440 (name "gtk+")
8441 (version "3.8.2")
8442 ...))
cf4a9129 8443@end example
ef5dd60a 8444
cbd02397
LC
8445@node Synopses and Descriptions
8446@subsection Synopses and Descriptions
8447
8448As we have seen before, each package in GNU@tie{}Guix includes a
8449synopsis and a description (@pxref{Defining Packages}). Synopses and
8450descriptions are important: They are what @command{guix package
8451--search} searches, and a crucial piece of information to help users
8452determine whether a given package suits their needs. Consequently,
8453packagers should pay attention to what goes into them.
8454
8455Synopses must start with a capital letter and must not end with a
8456period. They must not start with ``a'' or ``the'', which usually does
8457not bring anything; for instance, prefer ``File-frobbing tool'' over ``A
8458tool that frobs files''. The synopsis should say what the package
8459is---e.g., ``Core GNU utilities (file, text, shell)''---or what it is
8460used for---e.g., the synopsis for GNU@tie{}grep is ``Print lines
8461matching a pattern''.
8462
8463Keep in mind that the synopsis must be meaningful for a very wide
8464audience. For example, ``Manipulate alignments in the SAM format''
8465might make sense for a seasoned bioinformatics researcher, but might be
8466fairly unhelpful or even misleading to a non-specialized audience. It
8467is a good idea to come up with a synopsis that gives an idea of the
8468application domain of the package. In this example, this might give
8469something like ``Manipulate nucleotide sequence alignments'', which
8470hopefully gives the user a better idea of whether this is what they are
8471looking for.
8472
8473@cindex Texinfo markup, in package descriptions
8474Descriptions should take between five and ten lines. Use full
8475sentences, and avoid using acronyms without first introducing them.
8476Descriptions can include Texinfo markup, which is useful to introduce
8477ornaments such as @code{@@code} or @code{@@dfn}, bullet lists, or
ba7d6c76
ML
8478hyperlinks (@pxref{Overview,,, texinfo, GNU Texinfo}). However you
8479should be careful when using some characters for example @samp{@@} and
8480curly braces which are the basic special characters in Texinfo
8481(@pxref{Special Characters,,, texinfo, GNU Texinfo}). User interfaces
8482such as @command{guix package --show} take care of rendering it
8483appropriately.
cbd02397
LC
8484
8485Synopses and descriptions are translated by volunteers
8486@uref{http://translationproject.org/domain/guix-packages.html, at the
8487Translation Project} so that as many users as possible can read them in
8488their native language. User interfaces search them and display them in
8489the language specified by the current locale.
8490
8491Translation is a lot of work so, as a packager, please pay even more
8492attention to your synopses and descriptions as every change may entail
ba7d6c76 8493additional work for translators. In order to help them, it is possible
36743e71 8494to make recommendations or instructions visible to them by inserting
ba7d6c76
ML
8495special comments like this (@pxref{xgettext Invocation,,, gettext, GNU
8496Gettext}):
8497
8498@example
8499;; TRANSLATORS: "X11 resize-and-rotate" should not be translated.
8500(description "ARandR is designed to provide a simple visual front end
8501for the X11 resize-and-rotate (RandR) extension. @dots{}")
8502@end example
cbd02397 8503
ef5dd60a 8504
cf4a9129
LC
8505@node Python Modules
8506@subsection Python Modules
ef5dd60a 8507
cf4a9129
LC
8508We currently package Python 2 and Python 3, under the Scheme variable names
8509@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
8510To avoid confusion and naming clashes with other programming languages, it
8511seems desirable that the name of a package for a Python module contains
8512the word @code{python}.
ef5dd60a 8513
cf4a9129
LC
8514Some modules are compatible with only one version of Python, others with both.
8515If the package Foo compiles only with Python 3, we name it
8516@code{python-foo}; if it compiles only with Python 2, we name it
8517@code{python2-foo}. If it is compatible with both versions, we create two
8518packages with the corresponding names.
ef5dd60a 8519
cf4a9129
LC
8520If a project already contains the word @code{python}, we drop this;
8521for instance, the module python-dateutil is packaged under the names
8522@code{python-dateutil} and @code{python2-dateutil}.
113daf62 8523
523e4896 8524
cf4a9129
LC
8525@node Perl Modules
8526@subsection Perl Modules
523e4896 8527
cf4a9129
LC
8528Perl programs standing for themselves are named as any other package,
8529using the lowercase upstream name.
8530For Perl packages containing a single class, we use the lowercase class name,
8531replace all occurrences of @code{::} by dashes and prepend the prefix
8532@code{perl-}.
8533So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
8534Modules containing several classes keep their lowercase upstream name and
8535are also prepended by @code{perl-}. Such modules tend to have the word
8536@code{perl} somewhere in their name, which gets dropped in favor of the
8537prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 8538
523e4896 8539
7fec52b7
AE
8540@node Fonts
8541@subsection Fonts
8542
8543For fonts that are in general not installed by a user for typesetting
8544purposes, or that are distributed as part of a larger software package,
8545we rely on the general packaging rules for software; for instance, this
8546applies to the fonts delivered as part of the X.Org system or fonts that
8547are part of TeX Live.
8548
8549To make it easier for a user to search for fonts, names for other packages
8550containing only fonts are constructed as follows, independently of the
8551upstream package name.
8552
8553The name of a package containing only one font family starts with
8554@code{font-}; it is followed by the foundry name and a dash @code{-}
8555if the foundry is known, and the font family name, in which spaces are
8556replaced by dashes (and as usual, all upper case letters are transformed
8557to lower case).
8558For example, the Gentium font family by SIL is packaged under the name
8559@code{font-sil-gentium}.
8560
8561For a package containing several font families, the name of the collection
8562is used in the place of the font family name.
8563For instance, the Liberation fonts consist of three families,
8564Liberation Sans, Liberation Serif and Liberation Mono.
8565These could be packaged separately under the names
8566@code{font-liberation-sans} and so on; but as they are distributed together
8567under a common name, we prefer to package them together as
8568@code{font-liberation}.
8569
8570In the case where several formats of the same font family or font collection
8571are packaged separately, a short form of the format, prepended by a dash,
8572is added to the package name. We use @code{-ttf} for TrueType fonts,
1b366ee4 8573@code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
7fec52b7
AE
8574fonts.
8575
8576
b25937e3 8577
cf4a9129
LC
8578@node Bootstrapping
8579@section Bootstrapping
b25937e3 8580
cf4a9129 8581@c Adapted from the ELS 2013 paper.
b25937e3 8582
cf4a9129 8583@cindex bootstrapping
7889394e 8584
cf4a9129
LC
8585Bootstrapping in our context refers to how the distribution gets built
8586``from nothing''. Remember that the build environment of a derivation
8587contains nothing but its declared inputs (@pxref{Introduction}). So
8588there's an obvious chicken-and-egg problem: how does the first package
8589get built? How does the first compiler get compiled? Note that this is
8590a question of interest only to the curious hacker, not to the regular
8591user, so you can shamelessly skip this section if you consider yourself
8592a ``regular user''.
72b9d60d 8593
cf4a9129
LC
8594@cindex bootstrap binaries
8595The GNU system is primarily made of C code, with libc at its core. The
8596GNU build system itself assumes the availability of a Bourne shell and
8597command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
8598`grep'. Furthermore, build programs---programs that run
8599@code{./configure}, @code{make}, etc.---are written in Guile Scheme
8600(@pxref{Derivations}). Consequently, to be able to build anything at
8601all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
8602Binutils, libc, and the other packages mentioned above---the
8603@dfn{bootstrap binaries}.
72b9d60d 8604
cf4a9129
LC
8605These bootstrap binaries are ``taken for granted'', though we can also
8606re-create them if needed (more on that later).
72b9d60d 8607
cf4a9129 8608@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 8609
cf4a9129
LC
8610@c As of Emacs 24.3, Info-mode displays the image, but since it's a
8611@c large image, it's hard to scroll. Oh well.
8612@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 8613
cf4a9129
LC
8614The figure above shows the very beginning of the dependency graph of the
8615distribution, corresponding to the package definitions of the @code{(gnu
8616packages bootstrap)} module. At this level of detail, things are
8617slightly complex. First, Guile itself consists of an ELF executable,
8618along with many source and compiled Scheme files that are dynamically
8619loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
8620tarball shown in this graph. This tarball is part of Guix's ``source''
8621distribution, and gets inserted into the store with @code{add-to-store}
8622(@pxref{The Store}).
2e7b5cea 8623
cf4a9129
LC
8624But how do we write a derivation that unpacks this tarball and adds it
8625to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
8626derivation---the first one that gets built---uses @code{bash} as its
8627builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
8628@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
8629@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
8630the Guix source distribution, whose sole purpose is to allow the Guile
8631tarball to be unpacked.
fb729425 8632
cf4a9129
LC
8633Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
8634Guile that can be used to run subsequent build programs. Its first task
8635is to download tarballs containing the other pre-built binaries---this
8636is what the @code{.tar.xz.drv} derivations do. Guix modules such as
8637@code{ftp-client.scm} are used for this purpose. The
8638@code{module-import.drv} derivations import those modules in a directory
8639in the store, using the original layout. The
8640@code{module-import-compiled.drv} derivations compile those modules, and
8641write them in an output directory with the right layout. This
8642corresponds to the @code{#:modules} argument of
8643@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 8644
cf4a9129
LC
8645Finally, the various tarballs are unpacked by the
8646derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
8647etc., at which point we have a working C tool chain.
fb729425 8648
fb729425 8649
cf4a9129 8650@unnumberedsubsec Building the Build Tools
523e4896 8651
cf4a9129
LC
8652@c TODO: Add a package-level dependency graph generated from (gnu
8653@c packages base).
df2ce343 8654
cf4a9129
LC
8655Bootstrapping is complete when we have a full tool chain that does not
8656depend on the pre-built bootstrap tools discussed above. This
8657no-dependency requirement is verified by checking whether the files of
8658the final tool chain contain references to the @file{/gnu/store}
8659directories of the bootstrap inputs. The process that leads to this
8660``final'' tool chain is described by the package definitions found in
1f6f57df 8661the @code{(gnu packages commencement)} module.
df2ce343 8662
cf4a9129
LC
8663@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
8664The first tool that gets built with the bootstrap binaries is
8665GNU Make, which is a prerequisite for all the following packages.
8666From there Findutils and Diffutils get built.
523e4896 8667
cf4a9129
LC
8668Then come the first-stage Binutils and GCC, built as pseudo cross
8669tools---i.e., with @code{--target} equal to @code{--host}. They are
8670used to build libc. Thanks to this cross-build trick, this libc is
8671guaranteed not to hold any reference to the initial tool chain.
4af2447e 8672
cf4a9129
LC
8673From there the final Binutils and GCC are built. GCC uses @code{ld}
8674from the final Binutils, and links programs against the just-built libc.
8675This tool chain is used to build the other packages used by Guix and by
8676the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 8677
cf4a9129
LC
8678And voilà! At this point we have the complete set of build tools that
8679the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
8680variable of the @code{(gnu packages commencement)} module, and are
8681implicitly used by any package that uses @code{gnu-build-system}
1f6f57df 8682(@pxref{Build Systems, @code{gnu-build-system}}).
4af2447e 8683
4af2447e 8684
cf4a9129 8685@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 8686
cf4a9129
LC
8687Because the final tool chain does not depend on the bootstrap binaries,
8688those rarely need to be updated. Nevertheless, it is useful to have an
8689automated way to produce them, should an update occur, and this is what
8690the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 8691
cf4a9129
LC
8692The following command builds the tarballs containing the bootstrap
8693binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
8694of Coreutils and other basic command-line tools):
4b2615e1 8695
cf4a9129
LC
8696@example
8697guix build bootstrap-tarballs
8698@end example
8699
8700The generated tarballs are those that should be referred to in the
8701@code{(gnu packages bootstrap)} module mentioned at the beginning of
8702this section.
8703
8704Still here? Then perhaps by now you've started to wonder: when do we
8705reach a fixed point? That is an interesting question! The answer is
8706unknown, but if you would like to investigate further (and have
8707significant computational and storage resources to do so), then let us
8708know.
8709
8710@node Porting
8711@section Porting to a New Platform
8712
8713As discussed above, the GNU distribution is self-contained, and
8714self-containment is achieved by relying on pre-built ``bootstrap
8715binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
8716operating system kernel, CPU architecture, and application binary
8717interface (ABI). Thus, to port the distribution to a platform that is
8718not yet supported, one must build those bootstrap binaries, and update
8719the @code{(gnu packages bootstrap)} module to use them on that platform.
8720
8721Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
8722When everything goes well, and assuming the GNU tool chain supports the
8723target platform, this can be as simple as running a command like this
8724one:
8725
8726@example
8727guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
8728@end example
8729
1c0c417d
LC
8730For this to work, the @code{glibc-dynamic-linker} procedure in
8731@code{(gnu packages bootstrap)} must be augmented to return the right
8732file name for libc's dynamic linker on that platform; likewise,
8733@code{system->linux-architecture} in @code{(gnu packages linux)} must be
8734taught about the new platform.
8735
cf4a9129 8736Once these are built, the @code{(gnu packages bootstrap)} module needs
1c0c417d
LC
8737to be updated to refer to these binaries on the target platform. That
8738is, the hashes and URLs of the bootstrap tarballs for the new platform
8739must be added alongside those of the currently supported platforms. The
8740bootstrap Guile tarball is treated specially: it is expected to be
8741available locally, and @file{gnu-system.am} has rules do download it for
8742the supported architectures; a rule for the new platform must be added
8743as well.
cf4a9129
LC
8744
8745In practice, there may be some complications. First, it may be that the
8746extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
8747above) is not recognized by all the GNU tools. Typically, glibc
8748recognizes some of these, whereas GCC uses an extra @code{--with-abi}
8749configure flag (see @code{gcc.scm} for examples of how to handle this).
8750Second, some of the required packages could fail to build for that
8751platform. Lastly, the generated binaries could be broken for some
8752reason.
4af2447e 8753
9bf3c1a7 8754@c *********************************************************************
8c01b9d0 8755@include contributing.texi
c78bd12b 8756
568717fd
LC
8757@c *********************************************************************
8758@node Acknowledgments
8759@chapter Acknowledgments
8760
136787cb
LC
8761Guix is based on the @uref{http://nixos.org/nix/, Nix package manager},
8762which was designed and
4c7ac9aa
LC
8763implemented by Eelco Dolstra, with contributions from other people (see
8764the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
8765management, and promoted unprecedented features, such as transactional
8766package upgrades and rollbacks, per-user profiles, and referentially
8767transparent build processes. Without this work, Guix would not exist.
8768
8769The Nix-based software distributions, Nixpkgs and NixOS, have also been
8770an inspiration for Guix.
8771
4c7ac9aa
LC
8772GNU@tie{}Guix itself is a collective work with contributions from a
8773number of people. See the @file{AUTHORS} file in Guix for more
8774information on these fine people. The @file{THANKS} file lists people
8775who have helped by reporting bugs, taking care of the infrastructure,
8776providing artwork and themes, making suggestions, and more---thank you!
8777
8778
568717fd
LC
8779@c *********************************************************************
8780@node GNU Free Documentation License
8781@appendix GNU Free Documentation License
8782
8783@include fdl-1.3.texi
8784
8785@c *********************************************************************
8786@node Concept Index
8787@unnumbered Concept Index
8788@printindex cp
8789
a85b83d2
LC
8790@node Programming Index
8791@unnumbered Programming Index
8792@syncodeindex tp fn
8793@syncodeindex vr fn
568717fd
LC
8794@printindex fn
8795
8796@bye
8797
8798@c Local Variables:
8799@c ispell-local-dictionary: "american";
8800@c End: