doc: Update detailed node list.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
4379c35b 13Copyright @copyright{} 2012, 2013, 2014, 2015 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
87eafdbd
TUBK
15Copyright @copyright{} 2013 Nikita Karetnikov@*
16Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer
7df7a74e
NK
17
18Permission is granted to copy, distribute and/or modify this document
19under the terms of the GNU Free Documentation License, Version 1.3 or
20any later version published by the Free Software Foundation; with no
21Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
22copy of the license is included in the section entitled ``GNU Free
23Documentation License''.
24@end copying
568717fd 25
eeaf4427 26@dircategory Package management
568717fd
LC
27@direntry
28* guix: (guix). Guix, the functional package manager.
e49951eb 29* guix package: (guix)Invoking guix package
eeaf4427 30 Managing packages with Guix.
e49951eb 31* guix build: (guix)Invoking guix build
568717fd 32 Building packages with Guix.
054e8576
LC
33* guix system: (guix)Invoking guix system
34 Managing the operating system configuration.
568717fd 35@end direntry
568717fd 36
372c4bbc
DT
37@dircategory Software development
38@direntry
39* guix environment: (guix)Invoking guix environment
40 Building development environments with Guix.
41@end direntry
42
568717fd 43@titlepage
7730d112
LC
44@title GNU Guix Reference Manual
45@subtitle Using the GNU Guix Functional Package Manager
568717fd 46@author Ludovic Courtès
da7cabd4 47@author Andreas Enge
acc08466 48@author Nikita Karetnikov
568717fd
LC
49
50@page
51@vskip 0pt plus 1filll
52Edition @value{EDITION} @*
53@value{UPDATED} @*
54
7df7a74e 55@insertcopying
568717fd
LC
56@end titlepage
57
568717fd
LC
58@contents
59
60@c *********************************************************************
61@node Top
f8348b91 62@top GNU Guix
568717fd 63
f8348b91
LC
64This document describes GNU Guix version @value{VERSION}, a functional
65package management tool written for the GNU system.
568717fd
LC
66
67@menu
68* Introduction:: What is Guix about?
bd5e766b 69* Installation:: Installing Guix.
eeaf4427 70* Package Management:: Package installation, upgrade, etc.
568717fd
LC
71* Programming Interface:: Using Guix in Scheme.
72* Utilities:: Package management commands.
a1ba8475 73* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 74* Contributing:: Your help needed!
568717fd
LC
75
76* Acknowledgments:: Thanks!
77* GNU Free Documentation License:: The license of this manual.
78* Concept Index:: Concepts.
a85b83d2 79* Programming Index:: Data types, functions, and variables.
aaa3eaa9
LC
80
81@detailmenu
82 --- The Detailed Node Listing ---
83
84Installation
85
1b2b8177 86* Binary Installation:: Getting Guix running in no time!
aaa3eaa9 87* Requirements:: Software needed to build and run Guix.
ec0339cd 88* Running the Test Suite:: Testing Guix.
aaa3eaa9
LC
89* Setting Up the Daemon:: Preparing the build daemon's environment.
90* Invoking guix-daemon:: Running the build daemon.
91
92Setting Up the Daemon
93
94* Build Environment Setup:: Preparing the isolated build environment.
95* Daemon Offload Setup:: Offloading builds to remote machines.
96
97Package Management
98
99* Features:: How Guix will make your life brighter.
100* Invoking guix package:: Package installation, removal, etc.
101* Emacs Interface:: Package management from Emacs.
102* Substitutes:: Downloading pre-built binaries.
103* Packages with Multiple Outputs:: Single source package, multiple outputs.
104* Invoking guix gc:: Running the garbage collector.
105* Invoking guix pull:: Fetching the latest Guix and distribution.
106* Invoking guix archive:: Exporting and importing store files.
107
108Programming Interface
109
110* Defining Packages:: Defining new packages.
111* Build Systems:: Specifying how packages are built.
112* The Store:: Manipulating the package store.
113* Derivations:: Low-level interface to package derivations.
114* The Store Monad:: Purely functional interface to the store.
115* G-Expressions:: Manipulating build expressions.
116
92492b23
LC
117Defining Packages
118
119* package Reference:: The package data type.
120* origin Reference:: The origin data type.
121
aaa3eaa9
LC
122Utilities
123
124* Invoking guix build:: Building packages from the command line.
125* Invoking guix download:: Downloading a file and printing its hash.
126* Invoking guix hash:: Computing the cryptographic hash of a file.
127* Invoking guix import:: Importing package definitions.
128* Invoking guix refresh:: Updating package definitions.
129* Invoking guix lint:: Finding errors in package definitions.
130* Invoking guix environment:: Setting up development environments.
aff8ce7c 131* Invoking guix publish:: Sharing substitutes.
aaa3eaa9
LC
132
133GNU Distribution
134
135* System Installation:: Installing the whole operating system.
35ed9306 136* System Configuration:: Configuring the operating system.
aaa3eaa9
LC
137* Installing Debugging Files:: Feeding the debugger.
138* Security Updates:: Deploying security fixes quickly.
139* Package Modules:: Packages from the programmer's viewpoint.
140* Packaging Guidelines:: Growing the distribution.
141* Bootstrapping:: GNU/Linux built from scratch.
142* Porting:: Targeting another platform or kernel.
143
144System Configuration
145
146* Using the Configuration System:: Customizing your GNU system.
147* operating-system Reference:: Detail of operating-system declarations.
148* File Systems:: Configuring file system mounts.
149* Mapped Devices:: Block device extra processing.
150* User Accounts:: Specifying user accounts.
598e19dc 151* Locales:: Language and cultural convention settings.
aaa3eaa9
LC
152* Services:: Specifying system services.
153* Setuid Programs:: Programs running with root privileges.
1b2b8177 154* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 155* Name Service Switch:: Configuring libc's name service switch.
aaa3eaa9
LC
156* Initial RAM Disk:: Linux-Libre bootstrapping.
157* GRUB Configuration:: Configuring the boot loader.
158* Invoking guix system:: Instantiating a system configuration.
159* Defining Services:: Adding new service definitions.
160
161Services
162
163* Base Services:: Essential system services.
164* Networking Services:: Network setup, SSH daemon, etc.
165* X Window:: Graphical display.
1b2b8177
LC
166* Desktop Services:: D-Bus and desktop services.
167* Database Services:: SQL databases.
aa4ed923 168* Various Services:: Other services.
aaa3eaa9
LC
169
170Packaging Guidelines
171
ec0339cd
LC
172* Software Freedom:: What may go into the distribution.
173* Package Naming:: What's in a name?
174* Version Numbers:: When the name is not enough.
175* Python Modules:: Taming the snake.
176* Perl Modules:: Little pearls.
177* Fonts:: Fond of fonts.
aaa3eaa9
LC
178
179@end detailmenu
568717fd
LC
180@end menu
181
182@c *********************************************************************
183@node Introduction
184@chapter Introduction
185
c80e7e55
LC
186GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
187using the international phonetic alphabet (IPA).} is a functional
188package management tool for the GNU system. Package management consists
4bfc4ea3
NK
189of all activities that relate to building packages from sources,
190honoring their build-time and run-time dependencies,
c80e7e55
LC
191installing packages in user environments, upgrading installed packages
192to new versions or rolling back to a previous set, removing unused
193software packages, etc.
568717fd
LC
194
195@cindex functional package management
196The term @dfn{functional} refers to a specific package management
197discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
198as a function, in the mathematical sense. That function takes inputs,
199such as build scripts, a compiler, and libraries, and
200returns an installed package. As a pure function, its result depends
568717fd
LC
201solely on its inputs---for instance, it cannot refer to software or
202scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
203always produces the same result when passed a given set of inputs. It
204cannot alter the system's environment in
568717fd
LC
205any way; for instance, it cannot create, modify, or delete files outside
206of its build and installation directories. This is achieved by running
e900c503 207build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 208explicit inputs are visible.
568717fd 209
e531ac2a 210@cindex store
568717fd 211The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
212system, in a special directory called @dfn{the store} (@pxref{The
213Store}). Each package is installed in a directory of its own, in the
834129e0 214store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
215a hash of all the inputs used to build that package; thus, changing an
216input yields a different directory name.
217
218This approach is the foundation of Guix's salient features: support for
4bfc4ea3 219transactional package upgrade and rollback, per-user installation, and
eeaf4427 220garbage collection of packages (@pxref{Features}).
568717fd 221
4bfc4ea3 222Guix has a command-line interface, which allows users to build, install,
568717fd 223upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 224
3ca2731c 225@cindex Guix System Distribution
4705641f 226@cindex GuixSD
a1ba8475 227Last but not least, Guix is used to build a distribution of the GNU
3ca2731c 228system, with many GNU and non-GNU free software packages. The Guix
4705641f
LC
229System Distribution, or GNU@tie{}GuixSD, takes advantage of the core
230properties of Guix at the system level. With GuixSD, users
3ca2731c
LC
231@emph{declare} all aspects of the operating system configuration, and
232Guix takes care of instantiating that configuration in a reproducible,
233stateless fashion. @xref{GNU Distribution}.
a1ba8475 234
bd5e766b
LC
235@c *********************************************************************
236@node Installation
237@chapter Installation
238
48febeb8
LC
239GNU Guix is available for download from its website at
240@url{http://www.gnu.org/software/guix/}. This section describes the
241software requirements of Guix, as well as how to install it and get
242ready to use it.
bd5e766b 243
5af6de3e
LC
244Note that this section is concerned with the installation of the package
245manager, which can be done on top of a running GNU/Linux system. If,
246instead, you want to install the complete GNU operating system,
6621cdb6 247@pxref{System Installation}.
5af6de3e 248
bd5e766b 249@menu
09722b11 250* Binary Installation:: Getting Guix running in no time!
bd5e766b 251* Requirements:: Software needed to build and run Guix.
ec0339cd 252* Running the Test Suite:: Testing Guix.
bd5e766b
LC
253* Setting Up the Daemon:: Preparing the build daemon's environment.
254* Invoking guix-daemon:: Running the build daemon.
255@end menu
256
09722b11
LC
257@node Binary Installation
258@section Binary Installation
259
260This section describes how to install Guix on an arbitrary system from a
261self-contained tarball providing binaries for Guix and for all its
262dependencies. This is often quicker than installing from source, which
263is described in the next sections. The only requirement is to have
264GNU@tie{}tar and Xz.
265
266Installing goes along these lines:
267
268@enumerate
269@item
270Download the binary tarball from
ae806096 271@indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz}@footnote{As
09722b11
LC
272usual, make sure to download the associated @file{.sig} file and to
273verify the authenticity of the tarball against it!}, where @var{system}
274is @code{x86_64-linux} for an @code{x86_64} machine already running the
275kernel Linux, and so on.
276
277@item
278As @code{root}, run:
279
280@example
281# cd /
b91d7f0f 282# tar xf guix-binary-@value{VERSION}.@var{system}.tar.xz
09722b11
LC
283@end example
284
285This creates @file{/gnu/store} (@pxref{The Store}), @file{/var/guix},
286and @file{/root/.guix-profile}. @file{/root/.guix-profile} is a
287ready-to-use profile for @code{root} where Guix is installed.
288
5dc3ce5f
LC
289Do @emph{not} unpack the tarball on a working Guix system since that
290would overwrite its own essential files.
291
09722b11 292@item
175ced41 293Run the daemon:
09722b11
LC
294
295@example
cfc149dc 296# /root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
09722b11
LC
297@end example
298
299@item
300Make the @command{guix} command available to other users on the machine,
301for instance with:
302
303@example
304# mkdir -p /usr/local/bin
305# cd /usr/local/bin
d72d05f9 306# ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
09722b11 307@end example
39f8ed14
LC
308
309@item
310To use substitutes from @code{hydra.gnu.org} (@pxref{Substitutes}),
311authorize them:
312
313@example
314# guix archive --authorize < /root/.guix-profile/share/guix/hydra.gnu.org.pub
315@end example
09722b11
LC
316@end enumerate
317
318And that's it!
319
5dc3ce5f 320The @code{guix} package must remain available in @code{root}'s
09722b11
LC
321profile, or it would become subject to garbage collection---in which
322case you would find yourself badly handicapped by the lack of the
323@command{guix} command.
324
39f8ed14
LC
325The tarball in question can be (re)produced and verified simply by
326running the following command in the Guix source tree:
09722b11
LC
327
328@example
329make guix-binary.@var{system}.tar.xz
330@end example
331
332
bd5e766b
LC
333@node Requirements
334@section Requirements
335
09722b11
LC
336This section lists requirements when building Guix from source. The
337build procedure for Guix is the same as for other GNU software, and is
338not covered here. Please see the files @file{README} and @file{INSTALL}
339in the Guix source tree for additional details.
340
bd5e766b
LC
341GNU Guix depends on the following packages:
342
343@itemize
47c66da0 344@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
288dca55 345@item @url{http://gnupg.org/, GNU libgcrypt};
f0b98b84 346@item @url{http://www.gnu.org/software/make/, GNU Make}.
8a96bd4b
ID
347@end itemize
348
349The following dependencies are optional:
350
351@itemize
288dca55 352@item
8a96bd4b 353Installing
288dca55 354@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
355allow you to use the @command{guix import pypi} command (@pxref{Invoking
356guix import}). It is of
288dca55 357interest primarily for developers and not for casual users.
8a96bd4b
ID
358@item
359Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
360allow you to access @code{https} URLs with the @command{guix download}
d45dc6da
EB
361command (@pxref{Invoking guix download}), the @command{guix import pypi}
362command, and the @command{guix import cpan} command. This is primarily
363of interest to developers. @xref{Guile Preparations, how to install the
364GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
365@end itemize
366
367Unless @code{--disable-daemon} was passed to @command{configure}, the
368following packages are also needed:
369
370@itemize
368d08f7
LC
371@item @url{http://sqlite.org, SQLite 3};
372@item @url{http://www.bzip.org, libbz2};
373@item @url{http://gcc.gnu.org, GCC's g++}, with support for the
374C++11 standard.
bd5e766b
LC
375@end itemize
376
4bfc4ea3
NK
377When a working installation of @url{http://nixos.org/nix/, the Nix package
378manager} is available, you
bd5e766b 379can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 380Nix replaces the three dependencies above.
bd5e766b 381
b22a12fd
LC
382Guix is compatible with Nix, so it is possible to share the same store
383between both. To do so, you must pass @command{configure} not only the
384same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
385@code{--localstatedir} value. The latter is essential because it
386specifies where the database that stores metadata about the store is
834129e0 387located, among other things. The default values for Nix are
b22a12fd 388@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
389Note that @code{--disable-daemon} is not required if
390your goal is to share the store with Nix.
b22a12fd 391
ec0339cd
LC
392@node Running the Test Suite
393@section Running the Test Suite
394
395After a successful @command{configure} and @code{make} run, it is a good
396idea to run the test suite. It can help catch issues with the setup or
397environment, or bugs in Guix itself---and really, reporting test
398failures is a good way to help improve the software. To run the test
399suite, type:
400
401@example
402make check
403@end example
404
405Test cases can run in parallel: you can use the @code{-j} option of
406GNU@tie{}make to speed things up. The first run may take a few minutes
407on a recent machine; subsequent runs will be faster because the store
408that is created for test purposes will already have various things in
409cache.
410
411Upon failure, please email @email{bug-guix@@gnu.org} and attach the
412@file{test-suite.log} file. When @file{tests/@var{something}.scm}
413fails, please also attach the @file{@var{something}.log} file available
414in the top-level build directory. Please specify the Guix version being
415used as well as version numbers of the dependencies
416(@pxref{Requirements}) in your message.
417
bd5e766b
LC
418@node Setting Up the Daemon
419@section Setting Up the Daemon
420
421@cindex daemon
422Operations such as building a package or running the garbage collector
49e6291a 423are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
424behalf of clients. Only the daemon may access the store and its
425associated database. Thus, any operation that manipulates the store
426goes through the daemon. For instance, command-line tools such as
e49951eb 427@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
428daemon (@i{via} remote procedure calls) to instruct it what to do.
429
49e6291a 430The following sections explain how to prepare the build daemon's
225dafde
LC
431environment. Also @ref{Substitutes}, for information on how to allow
432the daemon to download pre-built binaries.
49e6291a
LC
433
434@menu
435* Build Environment Setup:: Preparing the isolated build environment.
436* Daemon Offload Setup:: Offloading builds to remote machines.
437@end menu
438
439@node Build Environment Setup
440@subsection Build Environment Setup
441
bd5e766b
LC
442In a standard multi-user setup, Guix and its daemon---the
443@command{guix-daemon} program---are installed by the system
834129e0 444administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
445@command{guix-daemon} runs as @code{root}. Unprivileged users may use
446Guix tools to build packages or otherwise access the store, and the
447daemon will do it on their behalf, ensuring that the store is kept in a
448consistent state, and allowing built packages to be shared among users.
449
450@cindex build users
451When @command{guix-daemon} runs as @code{root}, you may not want package
452build processes themselves to run as @code{root} too, for obvious
453security reasons. To avoid that, a special pool of @dfn{build users}
454should be created for use by build processes started by the daemon.
455These build users need not have a shell and a home directory: they will
456just be used when the daemon drops @code{root} privileges in build
457processes. Having several such users allows the daemon to launch
458distinct build processes under separate UIDs, which guarantees that they
459do not interfere with each other---an essential feature since builds are
460regarded as pure functions (@pxref{Introduction}).
461
462On a GNU/Linux system, a build user pool may be created like this (using
463Bash syntax and the @code{shadow} commands):
464
091196b3
LC
465@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
466@c for why `-G' is needed.
bd5e766b 467@example
cfc149dc
LC
468# groupadd --system guixbuild
469# for i in `seq -w 1 10`;
bd5e766b 470 do
cfc149dc
LC
471 useradd -g guixbuild -G guixbuild \
472 -d /var/empty -s `which nologin` \
473 -c "Guix build user $i" --system \
474 guixbuilder$i;
bd5e766b
LC
475 done
476@end example
477
478@noindent
479The @code{guix-daemon} program may then be run as @code{root} with:
480
481@example
cfc149dc 482# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
483@end example
484
e900c503 485@cindex chroot
b095792f
LC
486@noindent
487This way, the daemon starts build processes in a chroot, under one of
cfc149dc 488the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
489environment contains nothing but:
490
491@c Keep this list in sync with libstore/build.cc! -----------------------
492@itemize
493@item
4743a4da
LC
494a minimal @code{/dev} directory, created mostly independently from the
495host @code{/dev}@footnote{``Mostly'', because while the set of files
496that appear in the chroot's @code{/dev} is fixed, most of these files
497can only be created if the host has them.};
498
499@item
500the @code{/proc} directory; it only shows the container's processes
501since a separate PID name space is used;
6dc99317
LC
502
503@item
504@file{/etc/passwd} with an entry for the current user and an entry for
505user @file{nobody};
506
507@item
508@file{/etc/group} with an entry for the user's group;
509
510@item
511@file{/etc/hosts} with an entry that maps @code{localhost} to
512@code{127.0.0.1};
513
514@item
515a writable @file{/tmp} directory.
516@end itemize
b095792f 517
d43eb499 518If you are installing Guix as an unprivileged user, it is still
bd5e766b
LC
519possible to run @command{guix-daemon}. However, build processes will
520not be isolated from one another, and not from the rest of the system.
521Thus, build processes may interfere with each other, and may access
522programs, libraries, and other files available on the system---making it
523much harder to view them as @emph{pure} functions.
524
49e6291a
LC
525
526@node Daemon Offload Setup
527@subsection Using the Offload Facility
528
529@cindex offloading
4ec2e92d
LC
530@cindex build hook
531When desired, the build daemon can @dfn{offload}
532derivation builds to other machines
49e6291a
LC
533running Guix, using the @code{offload} @dfn{build hook}. When that
534feature is enabled, a list of user-specified build machines is read from
535@file{/etc/guix/machines.scm}; anytime a build is requested, for
536instance via @code{guix build}, the daemon attempts to offload it to one
537of the machines that satisfies the derivation's constraints, in
538particular its system type---e.g., @file{x86_64-linux}. Missing
539prerequisites for the build are copied over SSH to the target machine,
540which then proceeds with the build; upon success the output(s) of the
541build are copied back to the initial machine.
542
4ec2e92d 543The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
544
545@example
546(list (build-machine
547 (name "eightysix.example.org")
548 (system "x86_64-linux")
549 (user "bob")
550 (speed 2.)) ; incredibly fast!
551
552 (build-machine
553 (name "meeps.example.org")
554 (system "mips64el-linux")
555 (user "alice")
556 (private-key
557 (string-append (getenv "HOME")
558 "/.ssh/id-rsa-for-guix"))))
559@end example
560
561@noindent
562In the example above we specify a list of two build machines, one for
563the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
564architecture.
565
566In fact, this file is---not surprisingly!---a Scheme file that is
567evaluated when the @code{offload} hook is started. Its return value
568must be a list of @code{build-machine} objects. While this example
569shows a fixed list of build machines, one could imagine, say, using
570DNS-SD to return a list of potential build machines discovered in the
571local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
572Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
573detailed below.
4ec2e92d 574
c678a4ee
LC
575@deftp {Data Type} build-machine
576This data type represents build machines the daemon may offload builds
577to. The important fields are:
49e6291a
LC
578
579@table @code
580
581@item name
582The remote machine's host name.
583
584@item system
c678a4ee 585The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
586
587@item user
588The user account to use when connecting to the remote machine over SSH.
589Note that the SSH key pair must @emph{not} be passphrase-protected, to
590allow non-interactive logins.
591
592@end table
593
4ec2e92d 594A number of optional fields may be specified:
49e6291a
LC
595
596@table @code
597
cecd72d5
LC
598@item port
599Port number of the machine's SSH server (default: 22).
600
49e6291a
LC
601@item private-key
602The SSH private key file to use when connecting to the machine.
603
604@item parallel-builds
605The number of builds that may run in parallel on the machine (1 by
606default.)
607
608@item speed
609A ``relative speed factor''. The offload scheduler will tend to prefer
610machines with a higher speed factor.
611
612@item features
613A list of strings denoting specific features supported by the machine.
614An example is @code{"kvm"} for machines that have the KVM Linux modules
615and corresponding hardware support. Derivations can request features by
616name, and they will be scheduled on matching build machines.
617
618@end table
c678a4ee 619@end deftp
49e6291a
LC
620
621The @code{guix} command must be in the search path on the build
622machines, since offloading works by invoking the @code{guix archive} and
623@code{guix build} commands.
624
625There's one last thing to do once @file{machines.scm} is in place. As
626explained above, when offloading, files are transferred back and forth
627between the machine stores. For this to work, you need to generate a
628key pair to allow the daemon to export signed archives of files from the
629store (@pxref{Invoking guix archive}):
630
631@example
632# guix archive --generate-key
633@end example
634
635@noindent
636Thus, when receiving files, a machine's build daemon can make sure they
637are genuine, have not been tampered with, and that they are signed by an
638authorized key.
639
640
bd5e766b
LC
641@node Invoking guix-daemon
642@section Invoking @command{guix-daemon}
643
644The @command{guix-daemon} program implements all the functionality to
645access the store. This includes launching build processes, running the
646garbage collector, querying the availability of a build result, etc. It
647is normally run as @code{root} like this:
648
649@example
cfc149dc 650# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
651@end example
652
653@noindent
081145cf 654For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 655
e900c503
LC
656@cindex chroot
657@cindex container, build environment
658@cindex build environment
659@cindex reproducible builds
bd5e766b
LC
660By default, @command{guix-daemon} launches build processes under
661different UIDs, taken from the build group specified with
662@code{--build-users-group}. In addition, each build process is run in a
663chroot environment that only contains the subset of the store that the
664build process depends on, as specified by its derivation
665(@pxref{Programming Interface, derivation}), plus a set of specific
666system directories. By default, the latter contains @file{/dev} and
e900c503
LC
667@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
668@dfn{container}: in addition to having its own file system tree, it has
669a separate mount name space, its own PID name space, network name space,
670etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b 671
cbc538fe
LC
672When the daemon performs a build on behalf of the user, it creates a
673build directory under @file{/tmp} or under the directory specified by
674its @code{TMPDIR} environment variable; this directory is shared with
675the container for the duration of the build. Be aware that using a
676directory other than @file{/tmp} can affect build results---for example,
677with a longer directory name, a build process that uses Unix-domain
678sockets might hit the name length limitation for @code{sun_path}, which
679it would otherwise not hit.
680
681The build directory is automatically deleted upon completion, unless the
682build failed and the client specified @option{--keep-failed}
683(@pxref{Invoking guix build, @option{--keep-failed}}).
684
bd5e766b
LC
685The following command-line options are supported:
686
687@table @code
688@item --build-users-group=@var{group}
689Take users from @var{group} to run build processes (@pxref{Setting Up
690the Daemon, build users}).
691
6858f9d1 692@item --no-substitutes
b5385b52 693@cindex substitutes
6858f9d1 694Do not use substitutes for build products. That is, always build things
c4202d60
LC
695locally instead of allowing downloads of pre-built binaries
696(@pxref{Substitutes}).
6858f9d1 697
b5385b52
LC
698By default substitutes are used, unless the client---such as the
699@command{guix package} command---is explicitly invoked with
700@code{--no-substitutes}.
701
702When the daemon runs with @code{--no-substitutes}, clients can still
703explicitly enable substitution @i{via} the @code{set-build-options}
704remote procedure call (@pxref{The Store}).
705
9176607e
LC
706@item --substitute-urls=@var{urls}
707Consider @var{urls} the default whitespace-separated list of substitute
ae806096 708source URLs. When this option is omitted, @indicateurl{http://hydra.gnu.org}
9176607e
LC
709is used.
710
711This means that substitutes may be downloaded from @var{urls}, as long
712as they are signed by a trusted signature (@pxref{Substitutes}).
713
4ec2e92d
LC
714@cindex build hook
715@item --no-build-hook
716Do not use the @dfn{build hook}.
717
718The build hook is a helper program that the daemon can start and to
719which it submits build requests. This mechanism is used to offload
720builds to other machines (@pxref{Daemon Offload Setup}).
721
bd5e766b
LC
722@item --cache-failures
723Cache build failures. By default, only successful builds are cached.
724
725@item --cores=@var{n}
726@itemx -c @var{n}
727Use @var{n} CPU cores to build each derivation; @code{0} means as many
728as available.
729
6efc160e 730The default value is @code{0}, but it may be overridden by clients, such
e49951eb
MW
731as the @code{--cores} option of @command{guix build} (@pxref{Invoking
732guix build}).
bd5e766b
LC
733
734The effect is to define the @code{NIX_BUILD_CORES} environment variable
735in the build process, which can then use it to exploit internal
736parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
737
738@item --max-jobs=@var{n}
739@itemx -M @var{n}
740Allow at most @var{n} build jobs in parallel. The default value is
f6526eb3
LC
741@code{1}. Setting it to @code{0} means that no builds will be performed
742locally; instead, the daemon will offload builds (@pxref{Daemon Offload
743Setup}), or simply fail.
bd5e766b
LC
744
745@item --debug
746Produce debugging output.
747
748This is useful to debug daemon start-up issues, but then it may be
749overridden by clients, for example the @code{--verbosity} option of
e49951eb 750@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
751
752@item --chroot-directory=@var{dir}
753Add @var{dir} to the build chroot.
754
755Doing this may change the result of build processes---for instance if
756they use optional dependencies found in @var{dir} when it is available,
757and not otherwise. For that reason, it is not recommended to do so.
758Instead, make sure that each derivation declares all the inputs that it
759needs.
760
761@item --disable-chroot
762Disable chroot builds.
763
764Using this option is not recommended since, again, it would allow build
765processes to gain access to undeclared dependencies.
766
767@item --disable-log-compression
768Disable compression of the build logs.
769
1da983b9
LC
770Unless @code{--lose-logs} is used, all the build logs are kept in the
771@var{localstatedir}. To save space, the daemon automatically compresses
772them with bzip2 by default. This option disables that.
773
ab3893d7
LC
774@item --disable-deduplication
775@cindex deduplication
bd5e766b
LC
776Disable automatic file ``deduplication'' in the store.
777
1da983b9 778By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
779if a newly added file is identical to another one found in the store,
780the daemon makes the new file a hard link to the other file. This can
781noticeably reduce disk usage, at the expense of slightly increasde
782input/output load at the end of a build process. This option disables
783this optimization.
1da983b9 784
6e37066e
LC
785@item --gc-keep-outputs[=yes|no]
786Tell whether the garbage collector (GC) must keep outputs of live
787derivations.
788
789When set to ``yes'', the GC will keep the outputs of any live derivation
790available in the store---the @code{.drv} files. The default is ``no'',
791meaning that derivation outputs are kept only if they are GC roots.
792
793@item --gc-keep-derivations[=yes|no]
794Tell whether the garbage collector (GC) must keep derivations
795corresponding to live outputs.
796
797When set to ``yes'', as is the case by default, the GC keeps
798derivations---i.e., @code{.drv} files---as long as at least one of their
799outputs is live. This allows users to keep track of the origins of
800items in their store. Setting it to ``no'' saves a bit of disk space.
801
802Note that when both @code{--gc-keep-derivations} and
803@code{--gc-keep-outputs} are used, the effect is to keep all the build
804prerequisites (the sources, compiler, libraries, and other build-time
805tools) of live objects in the store, regardless of whether these
806prerequisites are live. This is convenient for developers since it
807saves rebuilds or downloads.
808
bd5e766b
LC
809@item --impersonate-linux-2.6
810On Linux-based systems, impersonate Linux 2.6. This means that the
811kernel's @code{uname} system call will report 2.6 as the release number.
812
813This might be helpful to build programs that (usually wrongfully) depend
814on the kernel version number.
815
816@item --lose-logs
817Do not keep build logs. By default they are kept under
ce33631f 818@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
819
820@item --system=@var{system}
821Assume @var{system} as the current system type. By default it is the
822architecture/kernel pair found at configure time, such as
823@code{x86_64-linux}.
b8d2aa26
LC
824
825@item --listen=@var{socket}
826Listen for connections on @var{socket}, the file name of a Unix-domain
827socket. The default socket is
828@file{@var{localstatedir}/daemon-socket/socket}. This option is only
829useful in exceptional circumstances, such as if you need to run several
830daemons on the same machine.
bd5e766b
LC
831@end table
832
833
eeaf4427
LC
834@c *********************************************************************
835@node Package Management
836@chapter Package Management
837
f8348b91 838The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
839remove software packages, without having to know about their build
840procedure or dependencies. Guix also goes beyond this obvious set of
841features.
842
843This chapter describes the main features of Guix, as well as the package
c1941588
LC
844management tools it provides. Two user interfaces are provided for
845routine package management tasks: a command-line interface
846(@pxref{Invoking guix package, @code{guix package}}), and a visual user
847interface in Emacs (@pxref{Emacs Interface}).
eeaf4427
LC
848
849@menu
850* Features:: How Guix will make your life brighter.
e49951eb 851* Invoking guix package:: Package installation, removal, etc.
457f60fa 852* Emacs Interface:: Package management from Emacs.
c4202d60 853* Substitutes:: Downloading pre-built binaries.
760c60d6 854* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 855* Invoking guix gc:: Running the garbage collector.
f651b477 856* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 857* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
858@end menu
859
860@node Features
861@section Features
862
863When using Guix, each package ends up in the @dfn{package store}, in its
864own directory---something that resembles
9a130e19
AK
865@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
866(note that Guix comes with an Emacs extension to shorten those file
081145cf 867names, @pxref{Emacs Prettify}.)
eeaf4427
LC
868
869Instead of referring to these directories, users have their own
870@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
871use. These profiles are stored within each user's home directory, at
872@code{$HOME/.guix-profile}.
eeaf4427 873
821b0015 874For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 875@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 876@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
877@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
878simply continues to point to
834129e0 879@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 880coexist on the same system without any interference.
eeaf4427 881
e49951eb
MW
882The @command{guix package} command is the central tool to manage
883packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 884profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
885
886The command provides the obvious install, remove, and upgrade
887operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 888the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 889@command{guix package} process is terminated during the transaction,
eeaf4427
LC
890or if a power outage occurs during the transaction, then the user's
891profile remains in its previous state, and remains usable.
892
893In addition, any package transaction may be @emph{rolled back}. So, if,
894for example, an upgrade installs a new version of a package that turns
895out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
896of their profile, which was known to work well. Similarly, the global
897system configuration is subject to transactional upgrades and roll-back
898(@pxref{Using the Configuration System}).
eeaf4427
LC
899
900All those packages in the package store may be @emph{garbage-collected}.
901Guix can determine which packages are still referenced by the user
fe8ff028 902profiles, and remove those that are provably no longer referenced
e49951eb 903(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
904generations of their profile so that the packages they refer to can be
905collected.
eeaf4427 906
e900c503
LC
907@cindex reproducibility
908@cindex reproducible builds
eeaf4427
LC
909Finally, Guix takes a @dfn{purely functional} approach to package
910management, as described in the introduction (@pxref{Introduction}).
834129e0 911Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
912inputs that were used to build that package---compiler, libraries, build
913scripts, etc. This direct correspondence allows users to make sure a
914given package installation matches the current state of their
e900c503
LC
915distribution. It also helps maximize @dfn{build reproducibility}:
916thanks to the isolated build environments that are used, a given build
917is likely to yield bit-identical files when performed on different
918machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 919
c4202d60 920@cindex substitutes
eeaf4427 921This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 922deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 923available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
924downloads it and unpacks it;
925otherwise, it builds the package from source, locally
926(@pxref{Substitutes}).
eeaf4427 927
f5fd4fd2
LC
928Control over the build environment is a feature that is also useful for
929developers. The @command{guix environment} command allows developers of
930a package to quickly set up the right development environment for their
931package, without having to manually install the package's dependencies
932in their profile (@pxref{Invoking guix environment}).
933
e49951eb
MW
934@node Invoking guix package
935@section Invoking @command{guix package}
eeaf4427 936
e49951eb 937The @command{guix package} command is the tool that allows users to
eeaf4427
LC
938install, upgrade, and remove packages, as well as rolling back to
939previous configurations. It operates only on the user's own profile,
940and works with normal user privileges (@pxref{Features}). Its syntax
941is:
942
943@example
e49951eb 944guix package @var{options}
eeaf4427
LC
945@end example
946
ba55b1cb 947Primarily, @var{options} specifies the operations to be performed during
eeaf4427 948the transaction. Upon completion, a new profile is created, but
99bd74d5 949previous @dfn{generations} of the profile remain available, should the user
eeaf4427
LC
950want to roll back.
951
6447738c
MW
952For example, to remove @code{lua} and install @code{guile} and
953@code{guile-cairo} in a single transaction:
954
955@example
956guix package -r lua -i guile guile-cairo
957@end example
958
99bd74d5
LC
959@command{guix package} also supports a @dfn{declarative approach}
960whereby the user specifies the exact set of packages to be available and
961passes it @i{via} the @option{--manifest} option
962(@pxref{profile-manifest, @option{--manifest}}).
963
b9e5c0a9 964For each user, a symlink to the user's default profile is automatically
0ec1af59 965created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
966current generation of the user's default profile. Thus, users can add
967@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
968variable, and so on.
d664f1b4
LC
969@cindex search paths
970If you are not using the Guix System Distribution, consider adding the
971following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
972Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
973shells get all the right environment variable definitions:
974
975@example
976GUIX_PROFILE="$HOME/.guix-profile" \
977source "$HOME/.guix-profile/etc/profile"
978@end example
b9e5c0a9 979
4379c35b
LC
980In a multi-user setup, user profiles are stored in a place registered as
981a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
982to (@pxref{Invoking guix gc}). That directory is normally
0ec1af59
LC
983@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
984@var{localstatedir} is the value passed to @code{configure} as
4379c35b
LC
985@code{--localstatedir}, and @var{user} is the user name. The
986@file{per-user} directory is created when @command{guix-daemon} is
987started, and the @var{user} sub-directory is created by @command{guix
988package}.
0ec1af59
LC
989
990The @var{options} can be among the following:
991
eeaf4427
LC
992@table @code
993
6447738c
MW
994@item --install=@var{package} @dots{}
995@itemx -i @var{package} @dots{}
996Install the specified @var{package}s.
eeaf4427 997
6447738c 998Each @var{package} may specify either a simple package name, such as
eeaf4427 999@code{guile}, or a package name followed by a hyphen and version number,
724311a2
LC
1000such as @code{guile-1.8.8} or simply @code{guile-1.8} (in the latter
1001case, the newest version prefixed by @code{1.8} is selected.)
1002
1003If no version number is specified, the
dc5669cd
MW
1004newest available version will be selected. In addition, @var{package}
1005may contain a colon, followed by the name of one of the outputs of the
6e721c4d 1006package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
1007(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
1008name (and optionally version) are searched for among the GNU
1009distribution modules (@pxref{Package Modules}).
eeaf4427 1010
461572cc
LC
1011@cindex propagated inputs
1012Sometimes packages have @dfn{propagated inputs}: these are dependencies
21461f27
LC
1013that automatically get installed along with the required package
1014(@pxref{package-propagated-inputs, @code{propagated-inputs} in
1015@code{package} objects}, for information about propagated inputs in
1016package definitions).
461572cc 1017
21461f27 1018@anchor{package-cmd-propagated-inputs}
461572cc
LC
1019An example is the GNU MPC library: its C header files refer to those of
1020the GNU MPFR library, which in turn refer to those of the GMP library.
1021Thus, when installing MPC, the MPFR and GMP libraries also get installed
1022in the profile; removing MPC also removes MPFR and GMP---unless they had
1023also been explicitly installed independently.
1024
ba7ea5ce 1025Besides, packages sometimes rely on the definition of environment
5924080d 1026variables for their search paths (see explanation of
ba7ea5ce 1027@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
1028environment variable definitions are reported here.
1029
ef010c0f 1030@c XXX: keep me up-to-date
5924080d 1031Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
1032availability of a newer upstream version. In the future, it may provide
1033the option of installing directly from the upstream version, even if
1034that version is not yet in the distribution.
1035
5d4b411f
LC
1036@item --install-from-expression=@var{exp}
1037@itemx -e @var{exp}
1038Install the package @var{exp} evaluates to.
1039
1040@var{exp} must be a Scheme expression that evaluates to a
1041@code{<package>} object. This option is notably useful to disambiguate
1042between same-named variants of a package, with expressions such as
1043@code{(@@ (gnu packages base) guile-final)}.
1044
1045Note that this option installs the first output of the specified
1046package, which may be insufficient when needing a specific output of a
1047multiple-output package.
1048
6447738c
MW
1049@item --remove=@var{package} @dots{}
1050@itemx -r @var{package} @dots{}
1051Remove the specified @var{package}s.
eeaf4427 1052
6447738c 1053As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
1054and/or output name in addition to the package name. For instance,
1055@code{-r glibc:debug} would remove the @code{debug} output of
1056@code{glibc}.
1057
6447738c
MW
1058@item --upgrade[=@var{regexp} @dots{}]
1059@itemx -u [@var{regexp} @dots{}]
1060Upgrade all the installed packages. If one or more @var{regexp}s are
1061specified, upgrade only installed packages whose name matches a
d5f01e48 1062@var{regexp}. Also see the @code{--do-not-upgrade} option below.
eeaf4427 1063
f651b477
LC
1064Note that this upgrades package to the latest version of packages found
1065in the distribution currently installed. To update your distribution,
1066you should regularly run @command{guix pull} (@pxref{Invoking guix
1067pull}).
1068
d5f01e48
MW
1069@item --do-not-upgrade[=@var{regexp} @dots{}]
1070When used together with the @code{--upgrade} option, do @emph{not}
1071upgrade any packages whose name matches a @var{regexp}. For example, to
1072upgrade all packages in the current profile except those containing the
1073substring ``emacs'':
1074
1075@example
1076$ guix package --upgrade . --do-not-upgrade emacs
1077@end example
1078
99bd74d5 1079@item @anchor{profile-manifest}--manifest=@var{file}
1b676447 1080@itemx -m @var{file}
99bd74d5
LC
1081@cindex profile declaration
1082@cindex profile manifest
1083Create a new generation of the profile from the manifest object
1b676447
DT
1084returned by the Scheme code in @var{file}.
1085
99bd74d5
LC
1086This allows you to @emph{declare} the profile's contents rather than
1087constructing it through a sequence of @code{--install} and similar
1088commands. The advantage is that @var{file} can be put under version
1089control, copied to different machines to reproduce the same profile, and
1090so on.
1091
1092@c FIXME: Add reference to (guix profile) documentation when available.
1093@var{file} must return a @dfn{manifest} object, which is roughly a list
1094of packages:
1b676447 1095
99bd74d5 1096@findex packages->manifest
1b676447 1097@example
99bd74d5 1098(use-package-modules guile emacs)
1b676447
DT
1099
1100(packages->manifest
99bd74d5
LC
1101 (list emacs
1102 guile-2.0
1b676447 1103 ;; Use a specific package output.
99bd74d5 1104 (list guile-2.0 "debug")))
1b676447
DT
1105@end example
1106
24e262f0
LC
1107@item --roll-back
1108Roll back to the previous @dfn{generation} of the profile---i.e., undo
1109the last transaction.
1110
1111When combined with options such as @code{--install}, roll back occurs
1112before any other actions.
1113
d9307267 1114When rolling back from the first generation that actually contains
4b2bc804
NK
1115installed packages, the profile is made to point to the @dfn{zeroth
1116generation}, which contains no files apart from its own meta-data.
d9307267 1117
82fe08ed
LC
1118Installing, removing, or upgrading packages from a generation that has
1119been rolled back to overwrites previous future generations. Thus, the
1120history of a profile's generations is always linear.
1121
b3bb82f1
AK
1122@item --switch-generation=@var{pattern}
1123@itemx -S @var{pattern}
1124Switch to a particular generation defined by @var{pattern}.
1125
1126@var{pattern} may be either a generation number or a number prefixed
1127with ``+'' or ``-''. The latter means: move forward/backward by a
1128specified number of generations. For example, if you want to return to
1129the latest generation after @code{--roll-back}, use
1130@code{--switch-generation=+1}.
1131
1132The difference between @code{--roll-back} and
1133@code{--switch-generation=-1} is that @code{--switch-generation} will
1134not make a zeroth generation, so if a specified generation does not
1135exist, the current generation will not be changed.
1136
dbc31ab2 1137@item --search-paths[=@var{kind}]
5924080d
LC
1138@cindex search paths
1139Report environment variable definitions, in Bash syntax, that may be
1140needed in order to use the set of installed packages. These environment
1141variables are used to specify @dfn{search paths} for files used by some
1142of the installed packages.
1143
1144For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1145environment variables to be defined so it can look for headers and
1146libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1147Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1148library are installed in the profile, then @code{--search-paths} will
1149suggest setting these variables to @code{@var{profile}/include} and
1150@code{@var{profile}/lib}, respectively.
1151
dbc31ab2
LC
1152The typical use case is to define these environment variables in the
1153shell:
1154
1155@example
1156$ eval `guix package --search-paths`
1157@end example
1158
1159@var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1160meaning that the returned environment variable definitions will either
1161be exact settings, or prefixes or suffixes of the current value of these
1162variables. When omitted, @var{kind} defaults to @code{exact}.
1163
eeaf4427
LC
1164@item --profile=@var{profile}
1165@itemx -p @var{profile}
1166Use @var{profile} instead of the user's default profile.
1167
70915c1a
LC
1168@item --verbose
1169Produce verbose output. In particular, emit the environment's build log
1170on the standard error port.
1171
eeaf4427
LC
1172@item --bootstrap
1173Use the bootstrap Guile to build the profile. This option is only
1174useful to distribution developers.
1175
1176@end table
1177
e49951eb 1178In addition to these actions @command{guix package} supports the
733b4130
LC
1179following options to query the current state of a profile, or the
1180availability of packages:
eeaf4427 1181
733b4130
LC
1182@table @option
1183
acc08466
NK
1184@item --search=@var{regexp}
1185@itemx -s @var{regexp}
5763ad92 1186List the available packages whose name, synopsis, or description matches
299112d3
LC
1187@var{regexp}. Print all the meta-data of matching packages in
1188@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1189GNU recutils manual}).
acc08466 1190
299112d3
LC
1191This allows specific fields to be extracted using the @command{recsel}
1192command, for instance:
1193
1194@example
e49951eb 1195$ guix package -s malloc | recsel -p name,version
299112d3
LC
1196name: glibc
1197version: 2.17
1198
1199name: libgc
1200version: 7.2alpha6
1201@end example
acc08466 1202
a12d92f5
LC
1203Similarly, to show the name of all the packages available under the
1204terms of the GNU@tie{}LGPL version 3:
1205
1206@example
1207$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1208name: elfutils
1209
1210name: gmp
1211@dots{}
1212@end example
1213
2aa6efb0
CR
1214@item --show=@var{package}
1215Show details about @var{package}, taken from the list of available packages, in
1216@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1217recutils manual}).
1218
1219@example
1220$ guix package --show=python | recsel -p name,version
1221name: python
1222version: 2.7.6
1223
1224name: python
1225version: 3.3.5
1226@end example
1227
1228You may also specify the full name of a package to only get details about a
1229specific version of it:
1230@example
1231$ guix package --show=python-3.3.5 | recsel -p name,version
1232name: python
1233version: 3.3.5
1234@end example
1235
1236
1237
733b4130
LC
1238@item --list-installed[=@var{regexp}]
1239@itemx -I [@var{regexp}]
bd9bde1c
LC
1240List the currently installed packages in the specified profile, with the
1241most recently installed packages shown last. When @var{regexp} is
1242specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
1243
1244For each installed package, print the following items, separated by
1245tabs: the package name, its version string, the part of the package that
1246is installed (for instance, @code{out} for the default output,
1247@code{include} for its headers, etc.), and the path of this package in
1248the store.
1249
64fc89b6
LC
1250@item --list-available[=@var{regexp}]
1251@itemx -A [@var{regexp}]
5763ad92 1252List packages currently available in the distribution for this system
a1ba8475
LC
1253(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1254installed packages whose name matches @var{regexp}.
64fc89b6
LC
1255
1256For each package, print the following items separated by tabs: its name,
6e721c4d
LC
1257its version string, the parts of the package (@pxref{Packages with
1258Multiple Outputs}), and the source location of its definition.
64fc89b6 1259
f566d765
LC
1260@item --list-generations[=@var{pattern}]
1261@itemx -l [@var{pattern}]
1262Return a list of generations along with their creation dates; for each
1263generation, show the installed packages, with the most recently
4b2bc804
NK
1264installed packages shown last. Note that the zeroth generation is never
1265shown.
f566d765
LC
1266
1267For each installed package, print the following items, separated by
1268tabs: the name of a package, its version string, the part of the package
1269that is installed (@pxref{Packages with Multiple Outputs}), and the
1270location of this package in the store.
1271
1272When @var{pattern} is used, the command returns only matching
1273generations. Valid patterns include:
1274
1275@itemize
1276@item @emph{Integers and comma-separated integers}. Both patterns denote
1277generation numbers. For instance, @code{--list-generations=1} returns
1278the first one.
1279
1280And @code{--list-generations=1,8,2} outputs three generations in the
1281specified order. Neither spaces nor trailing commas are allowed.
1282
1283@item @emph{Ranges}. @code{--list-generations=2..9} prints the
1284specified generations and everything in between. Note that the start of
1285a range must be lesser than its end.
1286
1287It is also possible to omit the endpoint. For example,
1288@code{--list-generations=2..}, returns all generations starting from the
1289second one.
1290
1291@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1292or months by passing an integer along with the first letter of the
d7ddb257
LC
1293duration. For example, @code{--list-generations=20d} lists generations
1294that are up to 20 days old.
f566d765
LC
1295@end itemize
1296
b7884ca3
NK
1297@item --delete-generations[=@var{pattern}]
1298@itemx -d [@var{pattern}]
d7ddb257
LC
1299When @var{pattern} is omitted, delete all generations except the current
1300one.
b7884ca3
NK
1301
1302This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1303When @var{pattern} is specified, delete the matching generations. When
1304@var{pattern} specifies a duration, generations @emph{older} than the
1305specified duration match. For instance, @code{--delete-generations=1m}
1306deletes generations that are more than one month old.
1307
391bdd8f
LC
1308If the current generation matches, it is @emph{not} deleted. Also, the
1309zeroth generation is never deleted.
b7884ca3 1310
1bb9900a
LC
1311Note that deleting generations prevents roll-back to them.
1312Consequently, this command must be used with care.
1313
733b4130 1314@end table
eeaf4427 1315
70ee5642
LC
1316Finally, since @command{guix package} may actually start build
1317processes, it supports all the common build options that @command{guix
1318build} supports (@pxref{Invoking guix build, common build options}).
1319
457f60fa
AK
1320@include emacs.texi
1321
c4202d60
LC
1322@node Substitutes
1323@section Substitutes
1324
1325@cindex substitutes
1326@cindex pre-built binaries
1327Guix supports transparent source/binary deployment, which means that it
1328can either build things locally, or download pre-built items from a
1329server. We call these pre-built items @dfn{substitutes}---they are
1330substitutes for local build results. In many cases, downloading a
1331substitute is much faster than building things locally.
1332
1333Substitutes can be anything resulting from a derivation build
1334(@pxref{Derivations}). Of course, in the common case, they are
1335pre-built package binaries, but source tarballs, for instance, which
1336also result from derivation builds, can be available as substitutes.
1337
1338The @code{hydra.gnu.org} server is a front-end to a build farm that
1339builds packages from the GNU distribution continuously for some
9176607e
LC
1340architectures, and makes them available as substitutes. This is the
1341default source of substitutes; it can be overridden by passing
1342@command{guix-daemon} the @code{--substitute-urls} option
1343(@pxref{Invoking guix-daemon}).
c4202d60
LC
1344
1345@cindex security
1346@cindex digital signatures
1347To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1348must add its public key to the access control list (ACL) of archive
1349imports, using the @command{guix archive} command (@pxref{Invoking guix
1350archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1351be compromised and to serve genuine substitutes.
1352
1353This public key is installed along with Guix, in
1354@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1355the installation prefix of Guix. If you installed Guix from source,
1356make sure you checked the GPG signature of
1357@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1358Then, you can run something like this:
1359
1360@example
1361# guix archive --authorize < hydra.gnu.org.pub
1362@end example
1363
1364Once this is in place, the output of a command like @code{guix build}
1365should change from something like:
1366
1367@example
1368$ guix build emacs --dry-run
1369The following derivations would be built:
1370 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1371 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1372 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1373 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1374@dots{}
1375@end example
1376
1377@noindent
1378to something like:
1379
1380@example
1381$ guix build emacs --dry-run
1382The following files would be downloaded:
1383 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1384 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1385 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1386 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1387@dots{}
1388@end example
1389
1390@noindent
1391This indicates that substitutes from @code{hydra.gnu.org} are usable and
1392will be downloaded, when possible, for future builds.
1393
1394Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1395one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1396when attempting to use a substitute that has been tampered with.
1397
1398The substitute mechanism can be disabled globally by running
1399@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1400guix-daemon}). It can also be disabled temporarily by passing the
1401@code{--no-substitutes} option to @command{guix package}, @command{guix
1402build}, and other command-line tools.
1403
1404
1405Today, each individual's control over their own computing is at the
1406mercy of institutions, corporations, and groups with enough power and
1407determination to subvert the computing infrastructure and exploit its
1408weaknesses. While using @code{hydra.gnu.org} substitutes can be
1409convenient, we encourage users to also build on their own, or even run
1410their own build farm, such that @code{hydra.gnu.org} is less of an
8ce229fc
LC
1411interesting target. One way to help is by publishing the software you
1412build using @command{guix publish} so that others have one more choice
1413of server to download substitutes from (@pxref{Invoking guix publish}).
c4202d60
LC
1414
1415Guix has the foundations to maximize build reproducibility
1416(@pxref{Features}). In most cases, independent builds of a given
1417package or derivation should yield bit-identical results. Thus, through
1418a diverse set of independent package builds, we can strengthen the
1419integrity of our systems.
1420
1421In the future, we want Guix to have support to publish and retrieve
1422binaries to/from other users, in a peer-to-peer fashion. If you would
1423like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1424
1425
6e721c4d
LC
1426@node Packages with Multiple Outputs
1427@section Packages with Multiple Outputs
1428
1429@cindex multiple-output packages
1430@cindex package outputs
1431
1432Often, packages defined in Guix have a single @dfn{output}---i.e., the
1433source package leads exactly one directory in the store. When running
1434@command{guix package -i glibc}, one installs the default output of the
1435GNU libc package; the default output is called @code{out}, but its name
1436can be omitted as shown in this command. In this particular case, the
1437default output of @code{glibc} contains all the C header files, shared
1438libraries, static libraries, Info documentation, and other supporting
1439files.
1440
1441Sometimes it is more appropriate to separate the various types of files
1442produced from a single source package into separate outputs. For
1443instance, the GLib C library (used by GTK+ and related packages)
1444installs more than 20 MiB of reference documentation as HTML pages.
1445To save space for users who do not need it, the documentation goes to a
1446separate output, called @code{doc}. To install the main GLib output,
1447which contains everything but the documentation, one would run:
1448
1449@example
1450guix package -i glib
1451@end example
1452
1453The command to install its documentation is:
1454
1455@example
1456guix package -i glib:doc
1457@end example
1458
1459Some packages install programs with different ``dependency footprints''.
1460For instance, the WordNet package install both command-line tools and
1461graphical user interfaces (GUIs). The former depend solely on the C
1462library, whereas the latter depend on Tcl/Tk and the underlying X
1463libraries. In this case, we leave the command-line tools in the default
1464output, whereas the GUIs are in a separate output. This allows users
1465who do not need the GUIs to save space.
1466
1467There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1468Other conventional output names include @code{lib} for libraries and
1469possibly header files, @code{bin} for stand-alone programs, and
1470@code{debug} for debugging information (@pxref{Installing Debugging
1471Files}). The outputs of a packages are listed in the third column of
1472the output of @command{guix package --list-available} (@pxref{Invoking
1473guix package}).
6e721c4d 1474
eeaf4427 1475
e49951eb
MW
1476@node Invoking guix gc
1477@section Invoking @command{guix gc}
fe8ff028
LC
1478
1479@cindex garbage collector
1480Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1481The @command{guix gc} command allows users to explicitly run the garbage
c22eb992
LC
1482collector to reclaim space from the @file{/gnu/store} directory. It is
1483the @emph{only} way to remove files from @file{/gnu/store}---removing
1484files or directories manually may break it beyond repair!
fe8ff028
LC
1485
1486The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1487@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1488cannot be deleted; any other file is considered @dfn{dead} and may be
1489deleted. The set of garbage collector roots includes default user
e49951eb
MW
1490profiles, and may be augmented with @command{guix build --root}, for
1491example (@pxref{Invoking guix build}).
fe8ff028 1492
1bb9900a
LC
1493Prior to running @code{guix gc --collect-garbage} to make space, it is
1494often useful to remove old generations from user profiles; that way, old
1495package builds referenced by those generations can be reclaimed. This
1496is achieved by running @code{guix package --delete-generations}
1497(@pxref{Invoking guix package}).
1498
e49951eb 1499The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
1500used to garbage-collect any dead files (the default), to delete specific
1501files (the @code{--delete} option), or to print garbage-collector
1502information. The available options are listed below:
1503
1504@table @code
1505@item --collect-garbage[=@var{min}]
1506@itemx -C [@var{min}]
834129e0 1507Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1508sub-directories. This is the default operation when no option is
1509specified.
1510
1511When @var{min} is given, stop once @var{min} bytes have been collected.
1512@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1513suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1514(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1515
1516When @var{min} is omitted, collect all the garbage.
1517
1518@item --delete
1519@itemx -d
1520Attempt to delete all the store files and directories specified as
1521arguments. This fails if some of the files are not in the store, or if
1522they are still live.
1523
38d27786
LC
1524@item --optimize
1525@cindex deduplication
1526Optimize the store by hard-linking identical files---this is
1527@dfn{deduplication}.
1528
1529The daemon performs deduplication after each successful build or archive
1530import, unless it was started with @code{--disable-deduplication}
1531(@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
1532this option is primarily useful when the daemon was running with
1533@code{--disable-deduplication}.
1534
fe8ff028
LC
1535@item --list-dead
1536Show the list of dead files and directories still present in the
1537store---i.e., files and directories no longer reachable from any root.
1538
1539@item --list-live
1540Show the list of live store files and directories.
ba8b732d
LC
1541
1542@end table
1543
1544In addition, the references among existing store files can be queried:
1545
1546@table @code
1547
1548@item --references
1549@itemx --referrers
1550List the references (respectively, the referrers) of store files given
1551as arguments.
1552
8e59fdd5
LC
1553@item --requisites
1554@itemx -R
1555List the requisites of the store files passed as arguments. Requisites
1556include the store files themselves, their references, and the references
1557of these, recursively. In other words, the returned list is the
1558@dfn{transitive closure} of the store files.
1559
fe8ff028
LC
1560@end table
1561
eeaf4427 1562
f651b477
LC
1563@node Invoking guix pull
1564@section Invoking @command{guix pull}
1565
1566Packages are installed or upgraded to the latest version available in
1567the distribution currently available on your local machine. To update
1568that distribution, along with the Guix tools, you must run @command{guix
1569pull}: the command downloads the latest Guix source code and package
1570descriptions, and deploys it.
1571
1572On completion, @command{guix package} will use packages and package
1573versions from this just-retrieved copy of Guix. Not only that, but all
1574the Guix commands and Scheme modules will also be taken from that latest
1575version. New @command{guix} sub-commands added by the update also
1576become available.
1577
1578The @command{guix pull} command is usually invoked with no arguments,
1579but it supports the following options:
1580
1581@table @code
1582@item --verbose
1583Produce verbose output, writing build logs to the standard error output.
1584
ab5d72ad
LC
1585@item --url=@var{url}
1586Download the source tarball of Guix from @var{url}.
1587
1588By default, the tarball is taken from its canonical address at
1589@code{gnu.org}, for the stable branch of Guix.
1590
f651b477
LC
1591@item --bootstrap
1592Use the bootstrap Guile to build the latest Guix. This option is only
1593useful to Guix developers.
1594@end table
1595
760c60d6
LC
1596
1597@node Invoking guix archive
1598@section Invoking @command{guix archive}
1599
1600The @command{guix archive} command allows users to @dfn{export} files
1601from the store into a single archive, and to later @dfn{import} them.
1602In particular, it allows store files to be transferred from one machine
1603to another machine's store. For example, to transfer the @code{emacs}
1604package to a machine connected over SSH, one would run:
1605
1606@example
56607088 1607guix archive --export -r emacs | ssh the-machine guix archive --import
760c60d6
LC
1608@end example
1609
87236aed 1610@noindent
56607088
LC
1611Similarly, a complete user profile may be transferred from one machine
1612to another like this:
1613
1614@example
1615guix archive --export -r $(readlink -f ~/.guix-profile) | \
1616 ssh the-machine guix-archive --import
1617@end example
1618
1619@noindent
1620However, note that, in both examples, all of @code{emacs} and the
1621profile as well as all of their dependencies are transferred (due to
1622@code{-r}), regardless of what is already available in the target
1623machine's store. The @code{--missing} option can help figure out which
1624items are missing from the target's store.
87236aed 1625
760c60d6 1626Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1627comparable in spirit to `tar', but with a few noteworthy differences
1628that make it more appropriate for our purposes. First, rather than
1629recording all Unix meta-data for each file, the Nar format only mentions
1630the file type (regular, directory, or symbolic link); Unix permissions
1631and owner/group are dismissed. Second, the order in which directory
1632entries are stored always follows the order of file names according to
1633the C locale collation order. This makes archive production fully
1634deterministic.
1635
1636When exporting, the daemon digitally signs the contents of the archive,
1637and that digital signature is appended. When importing, the daemon
1638verifies the signature and rejects the import in case of an invalid
1639signature or if the signing key is not authorized.
760c60d6
LC
1640@c FIXME: Add xref to daemon doc about signatures.
1641
1642The main options are:
1643
1644@table @code
1645@item --export
1646Export the specified store files or packages (see below.) Write the
1647resulting archive to the standard output.
1648
56607088
LC
1649Dependencies are @emph{not} included in the output, unless
1650@code{--recursive} is passed.
1651
1652@item -r
1653@itemx --recursive
1654When combined with @code{--export}, this instructs @command{guix
1655archive} to include dependencies of the given items in the archive.
1656Thus, the resulting archive is self-contained: it contains the closure
1657of the exported store items.
1658
760c60d6
LC
1659@item --import
1660Read an archive from the standard input, and import the files listed
1661therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1662signature, or if it is signed by a public key not among the authorized
1663keys (see @code{--authorize} below.)
554f26ec 1664
87236aed
LC
1665@item --missing
1666Read a list of store file names from the standard input, one per line,
1667and write on the standard output the subset of these files missing from
1668the store.
1669
554f26ec 1670@item --generate-key[=@var{parameters}]
f82cc5fd 1671@cindex signing, archives
554f26ec
LC
1672Generate a new key pair for the daemons. This is a prerequisite before
1673archives can be exported with @code{--export}. Note that this operation
1674usually takes time, because it needs to gather enough entropy to
1675generate the key pair.
1676
1677The generated key pair is typically stored under @file{/etc/guix}, in
1678@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
867d8473
LC
1679key, which must be kept secret.) When @var{parameters} is omitted,
1680an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
1681versions before 1.6.0, it is a 4096-bit RSA key.
1682Alternately, @var{parameters} can specify
554f26ec
LC
1683@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1684public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1685Libgcrypt Reference Manual}).
f82cc5fd
LC
1686
1687@item --authorize
1688@cindex authorizing, archives
1689Authorize imports signed by the public key passed on standard input.
1690The public key must be in ``s-expression advanced format''---i.e., the
1691same format as the @file{signing-key.pub} file.
1692
1693The list of authorized keys is kept in the human-editable file
1694@file{/etc/guix/acl}. The file contains
1695@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1696s-expressions''} and is structured as an access-control list in the
1697@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1698(SPKI)}.
760c60d6
LC
1699@end table
1700
1701To export store files as an archive to the standard output, run:
1702
1703@example
1704guix archive --export @var{options} @var{specifications}...
1705@end example
1706
1707@var{specifications} may be either store file names or package
1708specifications, as for @command{guix package} (@pxref{Invoking guix
1709package}). For instance, the following command creates an archive
1710containing the @code{gui} output of the @code{git} package and the main
1711output of @code{emacs}:
1712
1713@example
834129e0 1714guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1715@end example
1716
1717If the specified packages are not built yet, @command{guix archive}
1718automatically builds them. The build process may be controlled with the
1719same options that can be passed to the @command{guix build} command
70ee5642 1720(@pxref{Invoking guix build, common build options}).
760c60d6
LC
1721
1722
568717fd
LC
1723@c *********************************************************************
1724@node Programming Interface
1725@chapter Programming Interface
1726
3dc1970d
LC
1727GNU Guix provides several Scheme programming interfaces (APIs) to
1728define, build, and query packages. The first interface allows users to
1729write high-level package definitions. These definitions refer to
1730familiar packaging concepts, such as the name and version of a package,
1731its build system, and its dependencies. These definitions can then be
1732turned into concrete build actions.
1733
ba55b1cb 1734Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1735standard setup, the daemon has write access to the store---the
834129e0 1736@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1737setup also has the daemon perform builds in chroots, under a specific
1738build users, to minimize interference with the rest of the system.
1739
1740@cindex derivation
1741Lower-level APIs are available to interact with the daemon and the
1742store. To instruct the daemon to perform a build action, users actually
1743provide it with a @dfn{derivation}. A derivation is a low-level
1744representation of the build actions to be taken, and the environment in
1745which they should occur---derivations are to package definitions what
49ad317a
LC
1746assembly is to C programs. The term ``derivation'' comes from the fact
1747that build results @emph{derive} from them.
3dc1970d
LC
1748
1749This chapter describes all these APIs in turn, starting from high-level
1750package definitions.
1751
568717fd 1752@menu
b860f382 1753* Defining Packages:: Defining new packages.
7458bd0a 1754* Build Systems:: Specifying how packages are built.
b860f382
LC
1755* The Store:: Manipulating the package store.
1756* Derivations:: Low-level interface to package derivations.
1757* The Store Monad:: Purely functional interface to the store.
21b679f6 1758* G-Expressions:: Manipulating build expressions.
568717fd
LC
1759@end menu
1760
1761@node Defining Packages
1762@section Defining Packages
1763
3dc1970d
LC
1764The high-level interface to package definitions is implemented in the
1765@code{(guix packages)} and @code{(guix build-system)} modules. As an
1766example, the package definition, or @dfn{recipe}, for the GNU Hello
1767package looks like this:
1768
1769@example
e7f34eb0
LC
1770(define-module (gnu packages hello)
1771 #:use-module (guix packages)
1772 #:use-module (guix download)
1773 #:use-module (guix build-system gnu)
1774 #:use-module (guix licenses))
b22a12fd 1775
79f5dd59 1776(define-public hello
3dc1970d
LC
1777 (package
1778 (name "hello")
1779 (version "2.8")
1780 (source (origin
1781 (method url-fetch)
1782 (uri (string-append "mirror://gnu/hello/hello-" version
1783 ".tar.gz"))
1784 (sha256
1785 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1786 (build-system gnu-build-system)
7458bd0a 1787 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1788 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1789 (synopsis "Hello, GNU world: An example GNU package")
1790 (description "Guess what GNU Hello prints!")
3dc1970d 1791 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 1792 (license gpl3+)))
3dc1970d
LC
1793@end example
1794
1795@noindent
1796Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 1797of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
1798to a @code{<package>} object, which is essentially a record
1799(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1800This package object can be inspected using procedures found in the
1801@code{(guix packages)} module; for instance, @code{(package-name hello)}
1802returns---surprise!---@code{"hello"}.
1803
2f7d2d91
LC
1804With luck, you may be able to import part or all of the definition of
1805the package you are interested in from another repository, using the
1806@code{guix import} command (@pxref{Invoking guix import}).
1807
e7f34eb0
LC
1808In the example above, @var{hello} is defined into a module of its own,
1809@code{(gnu packages hello)}. Technically, this is not strictly
1810necessary, but it is convenient to do so: all the packages defined in
1811modules under @code{(gnu packages @dots{})} are automatically known to
1812the command-line tools (@pxref{Package Modules}).
1813
3dc1970d
LC
1814There are a few points worth noting in the above package definition:
1815
1816@itemize
1817@item
a2bf4907
LC
1818The @code{source} field of the package is an @code{<origin>} object
1819(@pxref{origin Reference}, for the complete reference).
3dc1970d
LC
1820Here, the @code{url-fetch} method from @code{(guix download)} is used,
1821meaning that the source is a file to be downloaded over FTP or HTTP.
1822
1823The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1824the GNU mirrors defined in @code{(guix download)}.
1825
1826The @code{sha256} field specifies the expected SHA256 hash of the file
1827being downloaded. It is mandatory, and allows Guix to check the
1828integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 1829base32 representation of the hash. You can obtain this information with
210cc920
LC
1830@code{guix download} (@pxref{Invoking guix download}) and @code{guix
1831hash} (@pxref{Invoking guix hash}).
3dc1970d 1832
f9cc8971
LC
1833@cindex patches
1834When needed, the @code{origin} form can also have a @code{patches} field
1835listing patches to be applied, and a @code{snippet} field giving a
1836Scheme expression to modify the source code.
1837
3dc1970d
LC
1838@item
1839@cindex GNU Build System
7458bd0a
LC
1840The @code{build-system} field specifies the procedure to build the
1841package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1842represents the familiar GNU Build System, where packages may be
1843configured, built, and installed with the usual @code{./configure &&
1844make && make check && make install} command sequence.
1845
1846@item
1847The @code{arguments} field specifies options for the build system
1848(@pxref{Build Systems}). Here it is interpreted by
1849@var{gnu-build-system} as a request run @file{configure} with the
1850@code{--enable-silent-rules} flag.
3dc1970d
LC
1851
1852@item
1853The @code{inputs} field specifies inputs to the build process---i.e.,
1854build-time or run-time dependencies of the package. Here, we define an
1855input called @code{"gawk"} whose value is that of the @var{gawk}
1856variable; @var{gawk} is itself bound to a @code{<package>} object.
1857
1858Note that GCC, Coreutils, Bash, and other essential tools do not need to
1859be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 1860of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
1861
1862However, any other dependencies need to be specified in the
1863@code{inputs} field. Any dependency not specified here will simply be
1864unavailable to the build process, possibly leading to a build failure.
1865@end itemize
1866
87eafdbd
TUBK
1867@xref{package Reference}, for a full description of possible fields.
1868
2f7d2d91 1869Once a package definition is in place, the
e49951eb 1870package may actually be built using the @code{guix build} command-line
7458bd0a 1871tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
b4f5e0e8
CR
1872more information on how to test package definitions, and
1873@ref{Invoking guix lint}, for information on how to check a definition
1874for style conformance.
1875
7458bd0a
LC
1876Eventually, updating the package definition to a new upstream version
1877can be partly automated by the @command{guix refresh} command
1878(@pxref{Invoking guix refresh}).
3dc1970d
LC
1879
1880Behind the scenes, a derivation corresponding to the @code{<package>}
1881object is first computed by the @code{package-derivation} procedure.
834129e0 1882That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 1883The build actions it prescribes may then be realized by using the
3dc1970d
LC
1884@code{build-derivations} procedure (@pxref{The Store}).
1885
1886@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1887Return the @code{<derivation>} object of @var{package} for @var{system}
1888(@pxref{Derivations}).
3dc1970d
LC
1889
1890@var{package} must be a valid @code{<package>} object, and @var{system}
1891must be a string denoting the target system type---e.g.,
1892@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1893must be a connection to the daemon, which operates on the store
1894(@pxref{The Store}).
1895@end deffn
568717fd 1896
9c1edabd
LC
1897@noindent
1898@cindex cross-compilation
1899Similarly, it is possible to compute a derivation that cross-builds a
1900package for some other system:
1901
1902@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1903 @var{package} @var{target} [@var{system}]
59688fc4
LC
1904Return the @code{<derivation>} object of @var{package} cross-built from
1905@var{system} to @var{target}.
9c1edabd
LC
1906
1907@var{target} must be a valid GNU triplet denoting the target hardware
1908and operating system, such as @code{"mips64el-linux-gnu"}
1909(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1910Configure and Build System}).
1911@end deffn
1912
87eafdbd
TUBK
1913@menu
1914* package Reference :: The package data type.
1915* origin Reference:: The origin data type.
1916@end menu
1917
1918
1919@node package Reference
1920@subsection @code{package} Reference
1921
1922This section summarizes all the options available in @code{package}
1923declarations (@pxref{Defining Packages}).
1924
1925@deftp {Data Type} package
1926This is the data type representing a package recipe.
1927
1928@table @asis
1929@item @code{name}
1930The name of the package, as a string.
1931
1932@item @code{version}
1933The version of the package, as a string.
1934
1935@item @code{source}
1936An origin object telling how the source code for the package should be
1937acquired (@pxref{origin Reference}).
1938
1939@item @code{build-system}
1940The build system that should be used to build the package (@pxref{Build
1941Systems}).
1942
1943@item @code{arguments} (default: @code{'()})
1944The arguments that should be passed to the build system. This is a
1945list, typically containing sequential keyword-value pairs.
1946
1947@item @code{inputs} (default: @code{'()})
1948Package or derivation inputs to the build. This is a list of lists,
1949where each list has the name of the input (a string) as its first
1950element, a package or derivation object as its second element, and
1951optionally the name of the output of the package or derivation that
1952should be used, which defaults to @code{"out"}.
1953
21461f27
LC
1954@item @anchor{package-propagated-inputs}@code{propagated-inputs} (default: @code{'()})
1955@cindex propagated inputs
87eafdbd 1956This field is like @code{inputs}, but the specified packages will be
21461f27
LC
1957force-installed alongside the package they belong to
1958(@pxref{package-cmd-propagated-inputs, @command{guix package}}, for
1959information on how @command{guix package} deals with propagated inputs.)
1960
1961For example this is necessary when a library needs headers of another
1962library to compile, or needs another shared library to be linked
1963alongside itself when a program wants to link to it.
87eafdbd
TUBK
1964
1965@item @code{native-inputs} (default: @code{'()})
1966This field is like @code{inputs}, but in case of a cross-compilation it
1967will be ensured that packages for the architecture of the build machine
1968are present, such that executables from them can be used during the
21461f27
LC
1969build.
1970
1971This is typically where you would list tools needed at build time but
1972not at run time, such as Autoconf, Automake, pkg-config, Gettext, or
1973Bison. @command{guix lint} can report likely mistakes in this area
1974(@pxref{Invoking guix lint}).
87eafdbd
TUBK
1975
1976@item @code{self-native-input?} (default: @code{#f})
1977This is a Boolean field telling whether the package should use itself as
1978a native input when cross-compiling.
1979
1980@item @code{outputs} (default: @code{'("out")})
1981The list of output names of the package. @xref{Packages with Multiple
1982Outputs}, for typical uses of additional outputs.
1983
1984@item @code{native-search-paths} (default: @code{'()})
1985@itemx @code{search-paths} (default: @code{'()})
1986A list of @code{search-path-specification} objects describing
1987search-path environment variables honored by the package.
1988
1989@item @code{replacement} (default: @code{#f})
1990This must either @code{#f} or a package object that will be used as a
1991@dfn{replacement} for this package. @xref{Security Updates, grafts},
1992for details.
1993
1994@item @code{synopsis}
1995A one-line description of the package.
1996
1997@item @code{description}
1998A more elaborate description of the package.
1999
2000@item @code{license}
2001The license of the package; a value from @code{(guix licenses)}.
2002
2003@item @code{home-page}
2004The URL to the home-page of the package, as a string.
2005
2006@item @code{supported-systems} (default: @var{%supported-systems})
2007The list of systems supported by the package, as strings of the form
2008@code{architecture-kernel}, for example @code{"x86_64-linux"}.
2009
2010@item @code{maintainers} (default: @code{'()})
2011The list of maintainers of the package, as @code{maintainer} objects.
2012
2013@item @code{location} (default: source location of the @code{package} form)
2014The source location of the package. It's useful to override this when
2015inheriting from another package, in which case this field is not
2016automatically corrected.
2017@end table
2018@end deftp
2019
2020
2021@node origin Reference
2022@subsection @code{origin} Reference
2023
2024This section summarizes all the options available in @code{origin}
2025declarations (@pxref{Defining Packages}).
2026
2027@deftp {Data Type} origin
2028This is the data type representing a source code origin.
2029
2030@table @asis
2031@item @code{uri}
2032An object containing the URI of the source. The object type depends on
2033the @code{method} (see below). For example, when using the
2034@var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
2035values are: a URL represented as a string, or a list thereof.
2036
2037@item @code{method}
2038A procedure that will handle the URI.
2039
2040Examples include:
2041
2042@table @asis
2043@item @var{url-fetch} from @code{(guix download)}
2044download a file the HTTP, HTTPS, or FTP URL specified in the
2045@code{uri} field;
2046
2047@item @var{git-fetch} from @code{(guix git-download)}
2048clone the Git version control repository, and check out the revision
2049specified in the @code{uri} field as a @code{git-reference} object; a
2050@code{git-reference} looks like this:
2051
2052@example
2053(git-reference
2054 (url "git://git.debian.org/git/pkg-shadow/shadow")
2055 (commit "v4.1.5.1"))
2056@end example
2057@end table
2058
2059@item @code{sha256}
2060A bytevector containing the SHA-256 hash of the source. Typically the
2061@code{base32} form is used here to generate the bytevector from a
2062base-32 string.
2063
2064@item @code{file-name} (default: @code{#f})
2065The file name under which the source code should be saved. When this is
2066@code{#f}, a sensible default value will be used in most cases. In case
2067the source is fetched from a URL, the file name from the URL will be
2068used. For version control checkouts, it's recommended to provide the
2069file name explicitly because the default is not very descriptive.
2070
2071@item @code{patches} (default: @code{'()})
2072A list of file names containing patches to be applied to the source.
2073
2074@item @code{snippet} (default: @code{#f})
2075A quoted piece of code that will be run in the source directory to make
2076any modifications, which is sometimes more convenient than a patch.
2077
2078@item @code{patch-flags} (default: @code{'("-p1")})
2079A list of command-line flags that should be passed to the @code{patch}
2080command.
2081
2082@item @code{patch-inputs} (default: @code{#f})
2083Input packages or derivations to the patching process. When this is
2084@code{#f}, the usual set of inputs necessary for patching are provided,
2085such as GNU@tie{}Patch.
2086
2087@item @code{modules} (default: @code{'()})
2088A list of Guile modules that should be loaded during the patching
2089process and while running the code in the @code{snippet} field.
2090
2091@item @code{imported-modules} (default: @code{'()})
2092The list of Guile modules to import in the patch derivation, for use by
2093the @code{snippet}.
2094
2095@item @code{patch-guile} (default: @code{#f})
2096The Guile package that should be used in the patching process. When
2097this is @code{#f}, a sensible default is used.
2098@end table
2099@end deftp
2100
9c1edabd 2101
7458bd0a
LC
2102@node Build Systems
2103@section Build Systems
2104
2105@cindex build system
2106Each package definition specifies a @dfn{build system} and arguments for
2107that build system (@pxref{Defining Packages}). This @code{build-system}
2108field represents the build procedure of the package, as well implicit
2109dependencies of that build procedure.
2110
2111Build systems are @code{<build-system>} objects. The interface to
2112create and manipulate them is provided by the @code{(guix build-system)}
2113module, and actual build systems are exported by specific modules.
2114
f5fd4fd2 2115@cindex bag (low-level package representation)
0d5a559f
LC
2116Under the hood, build systems first compile package objects to
2117@dfn{bags}. A @dfn{bag} is like a package, but with less
2118ornamentation---in other words, a bag is a lower-level representation of
2119a package, which includes all the inputs of that package, including some
2120that were implicitly added by the build system. This intermediate
2121representation is then compiled to a derivation (@pxref{Derivations}).
2122
7458bd0a
LC
2123Build systems accept an optional list of @dfn{arguments}. In package
2124definitions, these are passed @i{via} the @code{arguments} field
2125(@pxref{Defining Packages}). They are typically keyword arguments
2126(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2127Guile Reference Manual}). The value of these arguments is usually
2128evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2129by the daemon (@pxref{Derivations}).
2130
2131The main build system is @var{gnu-build-system}, which implements the
2132standard build procedure for GNU packages and many other packages. It
2133is provided by the @code{(guix build-system gnu)} module.
2134
2135@defvr {Scheme Variable} gnu-build-system
2136@var{gnu-build-system} represents the GNU Build System, and variants
2137thereof (@pxref{Configuration, configuration and makefile conventions,,
2138standards, GNU Coding Standards}).
2139
2140@cindex build phases
2141In a nutshell, packages using it configured, built, and installed with
2142the usual @code{./configure && make && make check && make install}
2143command sequence. In practice, a few additional steps are often needed.
2144All these steps are split up in separate @dfn{phases},
2145notably@footnote{Please see the @code{(guix build gnu-build-system)}
2146modules for more details about the build phases.}:
2147
2148@table @code
2149@item unpack
2150Unpack the source tarball, and change the current directory to the
2151extracted source tree. If the source is actually a directory, copy it
2152to the build tree, and enter that directory.
2153
2154@item patch-source-shebangs
2155Patch shebangs encountered in source files so they refer to the right
2156store file names. For instance, this changes @code{#!/bin/sh} to
2157@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2158
2159@item configure
2160Run the @file{configure} script with a number of default options, such
2161as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2162by the @code{#:configure-flags} argument.
2163
2164@item build
2165Run @code{make} with the list of flags specified with
2166@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
2167(the default), build with @code{make -j}.
2168
2169@item check
2170Run @code{make check}, or some other target specified with
2171@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2172@code{#:parallel-tests?} argument is true (the default), run @code{make
2173check -j}.
2174
2175@item install
2176Run @code{make install} with the flags listed in @code{#:make-flags}.
2177
2178@item patch-shebangs
2179Patch shebangs on the installed executable files.
2180
2181@item strip
2182Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2183is false), copying them to the @code{debug} output when available
2184(@pxref{Installing Debugging Files}).
2185@end table
2186
2187@vindex %standard-phases
2188The build-side module @code{(guix build gnu-build-system)} defines
2189@var{%standard-phases} as the default list of build phases.
2190@var{%standard-phases} is a list of symbol/procedure pairs, where the
2191procedure implements the actual phase.
2192
2193The list of phases used for a particular package can be changed with the
2194@code{#:phases} parameter. For instance, passing:
2195
2196@example
2197#:phases (alist-delete 'configure %standard-phases)
2198@end example
2199
9bf404e9 2200means that all the phases described above will be used, except the
7458bd0a
LC
2201@code{configure} phase.
2202
2203In addition, this build system ensures that the ``standard'' environment
2204for GNU packages is available. This includes tools such as GCC, libc,
2205Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2206build-system gnu)} module for a complete list.) We call these the
2207@dfn{implicit inputs} of a package, because package definitions don't
2208have to mention them.
2209@end defvr
2210
2211Other @code{<build-system>} objects are defined to support other
2212conventions and tools used by free software packages. They inherit most
2213of @var{gnu-build-system}, and differ mainly in the set of inputs
2214implicitly added to the build process, and in the list of phases
2215executed. Some of these build systems are listed below.
2216
2217@defvr {Scheme Variable} cmake-build-system
2218This variable is exported by @code{(guix build-system cmake)}. It
2219implements the build procedure for packages using the
2220@url{http://www.cmake.org, CMake build tool}.
2221
2222It automatically adds the @code{cmake} package to the set of inputs.
2223Which package is used can be specified with the @code{#:cmake}
2224parameter.
9849cfc1
LC
2225
2226The @code{#:configure-flags} parameter is taken as a list of flags
2227passed to the @command{cmake} command. The @code{#:build-type}
2228parameter specifies in abstract terms the flags passed to the compiler;
2229it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2230debugging information''), which roughly means that code is compiled with
2231@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
2232@end defvr
2233
3afcf52b
FB
2234@defvr {Scheme Variable} glib-or-gtk-build-system
2235This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2236is intended for use with packages making use of GLib or GTK+.
2237
2238This build system adds the following two phases to the ones defined by
2239@var{gnu-build-system}:
2240
2241@table @code
2242@item glib-or-gtk-wrap
2243The phase @code{glib-or-gtk-wrap} ensures that programs found under
2244@file{bin/} are able to find GLib's ``schemas'' and
2245@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2246modules}. This is achieved by wrapping the programs in launch scripts
2247that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2248environment variables.
2249
73aa8ddb
LC
2250It is possible to exclude specific package outputs from that wrapping
2251process by listing their names in the
2252@code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
2253when an output is known not to contain any GLib or GTK+ binaries, and
2254where wrapping would gratuitously add a dependency of that output on
2255GLib and GTK+.
2256
3afcf52b
FB
2257@item glib-or-gtk-compile-schemas
2258The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
2259@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
2260GSettings schemas} are compiled. Compilation is performed by the
2261@command{glib-compile-schemas} program. It is provided by the package
2262@code{glib:bin} which is automatically imported by the build system.
2263The @code{glib} package providing @command{glib-compile-schemas} can be
2264specified with the @code{#:glib} parameter.
2265@end table
2266
2267Both phases are executed after the @code{install} phase.
2268@end defvr
2269
7458bd0a
LC
2270@defvr {Scheme Variable} python-build-system
2271This variable is exported by @code{(guix build-system python)}. It
2272implements the more or less standard build procedure used by Python
2273packages, which consists in running @code{python setup.py build} and
2274then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
2275
2276For packages that install stand-alone Python programs under @code{bin/},
2277it takes care of wrapping these programs so their @code{PYTHONPATH}
2278environment variable points to all the Python libraries they depend on.
2279
2280Which Python package is used can be specified with the @code{#:python}
2281parameter.
2282@end defvr
2283
2284@defvr {Scheme Variable} perl-build-system
2285This variable is exported by @code{(guix build-system perl)}. It
2d2a53fc
EB
2286implements the standard build procedure for Perl packages, which either
2287consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
2288followed by @code{Build} and @code{Build install}; or in running
2289@code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
2290@code{make} and @code{make install}; depending on which of
2291@code{Build.PL} or @code{Makefile.PL} is present in the package
2292distribution. Preference is given to the former if both @code{Build.PL}
2293and @code{Makefile.PL} exist in the package distribution. This
2294preference can be reversed by specifying @code{#t} for the
2295@code{#:make-maker?} parameter.
2296
2297The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
2298passes flags specified by the @code{#:make-maker-flags} or
2299@code{#:module-build-flags} parameter, respectively.
7458bd0a
LC
2300
2301Which Perl package is used can be specified with @code{#:perl}.
2302@end defvr
2303
c08f9818
DT
2304@defvr {Scheme Variable} ruby-build-system
2305This variable is exported by @code{(guix build-system ruby)}. It
2306implements the RubyGems build procedure used by Ruby packages, which
2307involves running @code{gem build} followed by @code{gem install}.
2308
2309Which Ruby package is used can be specified with the @code{#:ruby}
2310parameter.
2311@end defvr
7458bd0a 2312
a677c726
RW
2313@defvr {Scheme Variable} waf-build-system
2314This variable is exported by @code{(guix build-system waf)}. It
2315implements a build procedure around the @code{waf} script. The common
2316phases---@code{configure}, @code{build}, and @code{install}---are
2317implemented by passing their names as arguments to the @code{waf}
2318script.
2319
2320The @code{waf} script is executed by the Python interpreter. Which
2321Python package is used to run the script can be specified with the
2322@code{#:python} parameter.
2323@end defvr
2324
14dfdf2e
FB
2325@defvr {Scheme Variable} haskell-build-system
2326This variable is exported by @code{(guix build-system haskell)}. It
2327implements the Cabal build procedure used by Haskell packages, which
2328involves running @code{runhaskell Setup.hs configure
2329--prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
2330Instead of installing the package by running @code{runhaskell Setup.hs
2331install}, to avoid trying to register libraries in the read-only
2332compiler store directory, the build system uses @code{runhaskell
2333Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
2334addition, the build system generates the package documentation by
2335running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
2336is passed. Optional Haddock parameters can be passed with the help of
2337the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
2338not found, the build system looks for @code{Setup.lhs} instead.
2339
2340Which Haskell compiler is used can be specified with the @code{#:haskell}
2341parameter which defaults to @code{ghc}.
2342@end defvr
2343
7458bd0a
LC
2344Lastly, for packages that do not need anything as sophisticated, a
2345``trivial'' build system is provided. It is trivial in the sense that
2346it provides basically no support: it does not pull any implicit inputs,
2347and does not have a notion of build phases.
2348
2349@defvr {Scheme Variable} trivial-build-system
2350This variable is exported by @code{(guix build-system trivial)}.
2351
2352This build system requires a @code{#:builder} argument. This argument
2353must be a Scheme expression that builds the package's output(s)---as
2354with @code{build-expression->derivation} (@pxref{Derivations,
2355@code{build-expression->derivation}}).
2356@end defvr
2357
568717fd
LC
2358@node The Store
2359@section The Store
2360
e531ac2a
LC
2361@cindex store
2362@cindex store paths
2363
2364Conceptually, the @dfn{store} is where derivations that have been
834129e0 2365successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a
LC
2366Sub-directories in the store are referred to as @dfn{store paths}. The
2367store has an associated database that contains information such has the
2368store paths referred to by each store path, and the list of @emph{valid}
2369store paths---paths that result from a successful build.
2370
2371The store is always accessed by the daemon on behalf of its clients
2372(@pxref{Invoking guix-daemon}). To manipulate the store, clients
2373connect to the daemon over a Unix-domain socket, send it requests, and
2374read the result---these are remote procedure calls, or RPCs.
2375
2376The @code{(guix store)} module provides procedures to connect to the
2377daemon, and to perform RPCs. These are described below.
2378
2379@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
2380Connect to the daemon over the Unix-domain socket at @var{file}. When
2381@var{reserve-space?} is true, instruct it to reserve a little bit of
2382extra space on the file system so that the garbage collector can still
2383operate, should the disk become full. Return a server object.
2384
2385@var{file} defaults to @var{%default-socket-path}, which is the normal
2386location given the options that were passed to @command{configure}.
2387@end deffn
2388
2389@deffn {Scheme Procedure} close-connection @var{server}
2390Close the connection to @var{server}.
2391@end deffn
2392
2393@defvr {Scheme Variable} current-build-output-port
2394This variable is bound to a SRFI-39 parameter, which refers to the port
2395where build and error logs sent by the daemon should be written.
2396@end defvr
2397
2398Procedures that make RPCs all take a server object as their first
2399argument.
2400
2401@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
2402Return @code{#t} when @var{path} is a valid store path.
2403@end deffn
2404
cfbf9160 2405@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
2406Add @var{text} under file @var{name} in the store, and return its store
2407path. @var{references} is the list of store paths referred to by the
2408resulting store path.
2409@end deffn
2410
874e6874 2411@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
2412Build @var{derivations} (a list of @code{<derivation>} objects or
2413derivation paths), and return when the worker is done building them.
2414Return @code{#t} on success.
874e6874
LC
2415@end deffn
2416
b860f382
LC
2417Note that the @code{(guix monads)} module provides a monad as well as
2418monadic versions of the above procedures, with the goal of making it
2419more convenient to work with code that accesses the store (@pxref{The
2420Store Monad}).
2421
e531ac2a
LC
2422@c FIXME
2423@i{This section is currently incomplete.}
568717fd
LC
2424
2425@node Derivations
2426@section Derivations
2427
874e6874
LC
2428@cindex derivations
2429Low-level build actions and the environment in which they are performed
2430are represented by @dfn{derivations}. A derivation contain the
2431following pieces of information:
2432
2433@itemize
2434@item
2435The outputs of the derivation---derivations produce at least one file or
2436directory in the store, but may produce more.
2437
2438@item
2439The inputs of the derivations, which may be other derivations or plain
2440files in the store (patches, build scripts, etc.)
2441
2442@item
2443The system type targeted by the derivation---e.g., @code{x86_64-linux}.
2444
2445@item
2446The file name of a build script in the store, along with the arguments
2447to be passed.
2448
2449@item
2450A list of environment variables to be defined.
2451
2452@end itemize
2453
2454@cindex derivation path
2455Derivations allow clients of the daemon to communicate build actions to
2456the store. They exist in two forms: as an in-memory representation,
2457both on the client- and daemon-side, and as files in the store whose
2458name end in @code{.drv}---these files are referred to as @dfn{derivation
2459paths}. Derivations paths can be passed to the @code{build-derivations}
2460procedure to perform the build actions they prescribe (@pxref{The
2461Store}).
2462
2463The @code{(guix derivations)} module provides a representation of
2464derivations as Scheme objects, along with procedures to create and
2465otherwise manipulate derivations. The lowest-level primitive to create
2466a derivation is the @code{derivation} procedure:
2467
1909431c
LC
2468@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
2469 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 2470 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 2471 [#:system (%current-system)] [#:references-graphs #f] @
c0468155 2472 [#:allowed-references #f] [#:leaked-env-vars #f] [#:local-build? #f]
59688fc4
LC
2473Build a derivation with the given arguments, and return the resulting
2474@code{<derivation>} object.
874e6874 2475
2096ef47 2476When @var{hash} and @var{hash-algo} are given, a
874e6874 2477@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
2478known in advance, such as a file download. If, in addition,
2479@var{recursive?} is true, then that fixed output may be an executable
2480file or a directory and @var{hash} must be the hash of an archive
2481containing this output.
5b0c9d16 2482
858e9282 2483When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
2484name/store path pairs. In that case, the reference graph of each store
2485path is exported in the build environment in the corresponding file, in
2486a simple text format.
1909431c 2487
b53be755
LC
2488When @var{allowed-references} is true, it must be a list of store items
2489or outputs that the derivation's output may refer to.
2490
c0468155
LC
2491When @var{leaked-env-vars} is true, it must be a list of strings
2492denoting environment variables that are allowed to ``leak'' from the
2493daemon's environment to the build environment. This is only applicable
2494to fixed-output derivations---i.e., when @var{hash} is true. The main
2495use is to allow variables such as @code{http_proxy} to be passed to
2496derivations that download files.
2497
1909431c
LC
2498When @var{local-build?} is true, declare that the derivation is not a
2499good candidate for offloading and should rather be built locally
2500(@pxref{Daemon Offload Setup}). This is the case for small derivations
2501where the costs of data transfers would outweigh the benefits.
874e6874
LC
2502@end deffn
2503
2504@noindent
2505Here's an example with a shell script as its builder, assuming
2506@var{store} is an open connection to the daemon, and @var{bash} points
2507to a Bash executable in the store:
2508
2509@lisp
2510(use-modules (guix utils)
2511 (guix store)
2512 (guix derivations))
2513
59688fc4
LC
2514(let ((builder ; add the Bash script to the store
2515 (add-text-to-store store "my-builder.sh"
2516 "echo hello world > $out\n" '())))
2517 (derivation store "foo"
2518 bash `("-e" ,builder)
21b679f6 2519 #:inputs `((,bash) (,builder))
59688fc4 2520 #:env-vars '(("HOME" . "/homeless"))))
834129e0 2521@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
2522@end lisp
2523
21b679f6
LC
2524As can be guessed, this primitive is cumbersome to use directly. A
2525better approach is to write build scripts in Scheme, of course! The
2526best course of action for that is to write the build code as a
2527``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 2528information, @pxref{G-Expressions}.
21b679f6
LC
2529
2530Once upon a time, @code{gexp->derivation} did not exist and constructing
2531derivations with build code written in Scheme was achieved with
2532@code{build-expression->derivation}, documented below. This procedure
2533is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 2534
dd1a5a15
LC
2535@deffn {Scheme Procedure} build-expression->derivation @var{store} @
2536 @var{name} @var{exp} @
2537 [#:system (%current-system)] [#:inputs '()] @
2538 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 2539 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824
LC
2540 [#:references-graphs #f] [#:allowed-references #f] @
2541 [#:local-build? #f] [#:guile-for-build #f]
874e6874
LC
2542Return a derivation that executes Scheme expression @var{exp} as a
2543builder for derivation @var{name}. @var{inputs} must be a list of
2544@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
2545@code{"out"} is assumed. @var{modules} is a list of names of Guile
2546modules from the current search path to be copied in the store,
2547compiled, and made available in the load path during the execution of
2548@var{exp}---e.g., @code{((guix build utils) (guix build
2549gnu-build-system))}.
2550
2551@var{exp} is evaluated in an environment where @code{%outputs} is bound
2552to a list of output/path pairs, and where @code{%build-inputs} is bound
2553to a list of string/output-path pairs made from @var{inputs}.
2554Optionally, @var{env-vars} is a list of string pairs specifying the name
2555and value of environment variables visible to the builder. The builder
2556terminates by passing the result of @var{exp} to @code{exit}; thus, when
2557@var{exp} returns @code{#f}, the build is considered to have failed.
2558
2559@var{exp} is built using @var{guile-for-build} (a derivation). When
2560@var{guile-for-build} is omitted or is @code{#f}, the value of the
2561@code{%guile-for-build} fluid is used instead.
9c629a27 2562
63a42824
LC
2563See the @code{derivation} procedure for the meaning of
2564@var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
874e6874
LC
2565@end deffn
2566
2567@noindent
2568Here's an example of a single-output derivation that creates a directory
2569containing one file:
2570
2571@lisp
2572(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 2573 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
2574 (call-with-output-file (string-append out "/test")
2575 (lambda (p)
2576 (display '(hello guix) p))))))
dd1a5a15 2577 (build-expression->derivation store "goo" builder))
874e6874 2578
834129e0 2579@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
2580@end lisp
2581
568717fd 2582
b860f382
LC
2583@node The Store Monad
2584@section The Store Monad
2585
2586@cindex monad
2587
2588The procedures that operate on the store described in the previous
2589sections all take an open connection to the build daemon as their first
2590argument. Although the underlying model is functional, they either have
2591side effects or depend on the current state of the store.
2592
2593The former is inconvenient: the connection to the build daemon has to be
2594carried around in all those functions, making it impossible to compose
2595functions that do not take that parameter with functions that do. The
2596latter can be problematic: since store operations have side effects
2597and/or depend on external state, they have to be properly sequenced.
2598
2599@cindex monadic values
2600@cindex monadic functions
2601This is where the @code{(guix monads)} module comes in. This module
2602provides a framework for working with @dfn{monads}, and a particularly
2603useful monad for our uses, the @dfn{store monad}. Monads are a
2604construct that allows two things: associating ``context'' with values
2605(in our case, the context is the store), and building sequences of
561fb6c3 2606computations (here computations include accesses to the store.) Values
b860f382
LC
2607in a monad---values that carry this additional context---are called
2608@dfn{monadic values}; procedures that return such values are called
2609@dfn{monadic procedures}.
2610
2611Consider this ``normal'' procedure:
2612
2613@example
45adbd62
LC
2614(define (sh-symlink store)
2615 ;; Return a derivation that symlinks the 'bash' executable.
2616 (let* ((drv (package-derivation store bash))
2617 (out (derivation->output-path drv))
2618 (sh (string-append out "/bin/bash")))
2619 (build-expression->derivation store "sh"
2620 `(symlink ,sh %output))))
b860f382
LC
2621@end example
2622
c6f30b81
LC
2623Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
2624as a monadic function:
b860f382
LC
2625
2626@example
45adbd62 2627(define (sh-symlink)
b860f382 2628 ;; Same, but return a monadic value.
c6f30b81
LC
2629 (mlet %store-monad ((drv (package->derivation bash)))
2630 (gexp->derivation "sh"
2631 #~(symlink (string-append #$drv "/bin/bash")
2632 #$output))))
b860f382
LC
2633@end example
2634
c6f30b81
LC
2635There several things to note in the second version: the @code{store}
2636parameter is now implicit and is ``threaded'' in the calls to the
2637@code{package->derivation} and @code{gexp->derivation} monadic
2638procedures, and the monadic value returned by @code{package->derivation}
2639is @dfn{bound} using @code{mlet} instead of plain @code{let}.
2640
2641As it turns out, the call to @code{package->derivation} can even be
2642omitted since it will take place implicitly, as we will see later
2643(@pxref{G-Expressions}):
2644
2645@example
2646(define (sh-symlink)
2647 (gexp->derivation "sh"
2648 #~(symlink (string-append #$bash "/bin/bash")
2649 #$output)))
2650@end example
b860f382 2651
8e9aa37f 2652Calling the monadic @code{sh-symlink} has no effect. To get the desired
b860f382
LC
2653effect, one must use @code{run-with-store}:
2654
2655@example
8e9aa37f
CAW
2656(run-with-store (open-connection) (sh-symlink))
2657@result{} /gnu/store/...-sh-symlink
b860f382
LC
2658@end example
2659
b9b86078
LC
2660Note that the @code{(guix monad-repl)} module extends Guile's REPL with
2661new ``meta-commands'' to make it easier to deal with monadic procedures:
2662@code{run-in-store}, and @code{enter-store-monad}. The former, is used
2663to ``run'' a single monadic value through the store:
2664
2665@example
2666scheme@@(guile-user)> ,run-in-store (package->derivation hello)
2667$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2668@end example
2669
2670The latter enters a recursive REPL, where all the return values are
2671automatically run through the store:
2672
2673@example
2674scheme@@(guile-user)> ,enter-store-monad
2675store-monad@@(guile-user) [1]> (package->derivation hello)
2676$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2677store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
2678$3 = "/gnu/store/@dots{}-foo"
2679store-monad@@(guile-user) [1]> ,q
2680scheme@@(guile-user)>
2681@end example
2682
2683@noindent
2684Note that non-monadic values cannot be returned in the
2685@code{store-monad} REPL.
2686
e87f0591
LC
2687The main syntactic forms to deal with monads in general are provided by
2688the @code{(guix monads)} module and are described below.
b860f382
LC
2689
2690@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
2691Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
2692in @var{monad}.
2693@end deffn
2694
2695@deffn {Scheme Syntax} return @var{val}
2696Return a monadic value that encapsulates @var{val}.
2697@end deffn
2698
2699@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
2700@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
2701procedure @var{mproc}@footnote{This operation is commonly referred to as
2702``bind'', but that name denotes an unrelated procedure in Guile. Thus
2703we use this somewhat cryptic symbol inherited from the Haskell
2704language.}.
2705@end deffn
2706
2707@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
2708 @var{body} ...
2709@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
2710 @var{body} ...
2711Bind the variables @var{var} to the monadic values @var{mval} in
2712@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2713``normal'' value @var{val}, as per @code{let}.
2714
2715@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2716(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2717@end deffn
2718
405a9d4e
LC
2719@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
2720Bind @var{mexp} and the following monadic expressions in sequence,
2721returning the result of the last expression.
2722
2723This is akin to @code{mlet}, except that the return values of the
2724monadic expressions are ignored. In that sense, it is analogous to
2725@code{begin}, but applied to monadic expressions.
2726@end deffn
2727
561fb6c3
LC
2728@cindex state monad
2729The @code{(guix monads)} module provides the @dfn{state monad}, which
2730allows an additional value---the state---to be @emph{threaded} through
2731monadic procedure calls.
2732
2733@defvr {Scheme Variable} %state-monad
2734The state monad. Procedures in the state monad can access and change
2735the state that is threaded.
2736
2737Consider the example below. The @code{square} procedure returns a value
2738in the state monad. It returns the square of its argument, but also
2739increments the current state value:
2740
2741@example
2742(define (square x)
2743 (mlet %state-monad ((count (current-state)))
2744 (mbegin %state-monad
2745 (set-current-state (+ 1 count))
2746 (return (* x x)))))
2747
2748(run-with-state (sequence %state-monad (map square (iota 3))) 0)
2749@result{} (0 1 4)
2750@result{} 3
2751@end example
2752
2753When ``run'' through @var{%state-monad}, we obtain that additional state
2754value, which is the number of @code{square} calls.
2755@end defvr
2756
2757@deffn {Monadic Procedure} current-state
2758Return the current state as a monadic value.
2759@end deffn
2760
2761@deffn {Monadic Procedure} set-current-state @var{value}
2762Set the current state to @var{value} and return the previous state as a
2763monadic value.
2764@end deffn
2765
2766@deffn {Monadic Procedure} state-push @var{value}
2767Push @var{value} to the current state, which is assumed to be a list,
2768and return the previous state as a monadic value.
2769@end deffn
2770
2771@deffn {Monadic Procedure} state-pop
2772Pop a value from the current state and return it as a monadic value.
2773The state is assumed to be a list.
2774@end deffn
2775
2776@deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
2777Run monadic value @var{mval} starting with @var{state} as the initial
2778state. Return two values: the resulting value, and the resulting state.
2779@end deffn
2780
e87f0591
LC
2781The main interface to the store monad, provided by the @code{(guix
2782store)} module, is as follows.
b860f382
LC
2783
2784@defvr {Scheme Variable} %store-monad
561fb6c3
LC
2785The store monad---an alias for @var{%state-monad}.
2786
2787Values in the store monad encapsulate accesses to the store. When its
2788effect is needed, a value of the store monad must be ``evaluated'' by
2789passing it to the @code{run-with-store} procedure (see below.)
b860f382
LC
2790@end defvr
2791
2792@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2793Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2794open store connection.
2795@end deffn
2796
ad372953 2797@deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
b860f382 2798Return as a monadic value the absolute file name in the store of the file
ad372953
LC
2799containing @var{text}, a string. @var{references} is a list of store items that the
2800resulting text file refers to; it defaults to the empty list.
45adbd62
LC
2801@end deffn
2802
0a90af15
LC
2803@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2804 [#:recursive? #t]
2805Return the name of @var{file} once interned in the store. Use
2806@var{name} as its store name, or the basename of @var{file} if
2807@var{name} is omitted.
2808
2809When @var{recursive?} is true, the contents of @var{file} are added
2810recursively; if @var{file} designates a flat file and @var{recursive?}
2811is true, its contents are added, and its permission bits are kept.
2812
2813The example below adds a file to the store, under two different names:
2814
2815@example
2816(run-with-store (open-connection)
2817 (mlet %store-monad ((a (interned-file "README"))
2818 (b (interned-file "README" "LEGU-MIN")))
2819 (return (list a b))))
2820
2821@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2822@end example
2823
2824@end deffn
2825
e87f0591
LC
2826The @code{(guix packages)} module exports the following package-related
2827monadic procedures:
2828
b860f382 2829@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
2830 [#:system (%current-system)] [#:target #f] @
2831 [#:output "out"] Return as a monadic
b860f382
LC
2832value in the absolute file name of @var{file} within the @var{output}
2833directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
2834of the @var{output} directory of @var{package}. When @var{target} is
2835true, use it as a cross-compilation target triplet.
b860f382
LC
2836@end deffn
2837
b860f382 2838@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
2839@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2840 @var{target} [@var{system}]
2841Monadic version of @code{package-derivation} and
2842@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
2843@end deffn
2844
2845
21b679f6
LC
2846@node G-Expressions
2847@section G-Expressions
2848
2849@cindex G-expression
2850@cindex build code quoting
2851So we have ``derivations'', which represent a sequence of build actions
2852to be performed to produce an item in the store (@pxref{Derivations}).
2853Those build actions are performed when asking the daemon to actually
2854build the derivations; they are run by the daemon in a container
2855(@pxref{Invoking guix-daemon}).
2856
2857@cindex strata of code
2858It should come as no surprise that we like to write those build actions
2859in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2860code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
2861Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2862Kiselyov, who has written insightful
2863@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2864on this topic}, refers to this kind of code generation as
2865@dfn{staging}.}: the ``host code''---code that defines packages, talks
2866to the daemon, etc.---and the ``build code''---code that actually
2867performs build actions, such as making directories, invoking
2868@command{make}, etc.
21b679f6
LC
2869
2870To describe a derivation and its build actions, one typically needs to
2871embed build code inside host code. It boils down to manipulating build
2872code as data, and Scheme's homoiconicity---code has a direct
2873representation as data---comes in handy for that. But we need more than
2874Scheme's normal @code{quasiquote} mechanism to construct build
2875expressions.
2876
2877The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2878S-expressions adapted to build expressions. G-expressions, or
2879@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2880@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2881@code{#$}, and @code{#$@@}), which are comparable respectively to
2882@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2883(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2884Reference Manual}). However, there are major differences:
2885
2886@itemize
2887@item
2888Gexps are meant to be written to a file and run or manipulated by other
2889processes.
2890
2891@item
b39fc6f7
LC
2892When a high-level object such as a package or derivation is unquoted
2893inside a gexp, the result is as if its output file name had been
2894introduced.
ff40e9b7 2895
21b679f6
LC
2896@item
2897Gexps carry information about the packages or derivations they refer to,
2898and these dependencies are automatically added as inputs to the build
2899processes that use them.
2900@end itemize
2901
b39fc6f7
LC
2902Actually this mechanism is not limited to package and derivation
2903objects; @dfn{compilers} able to ``lower'' other high-level objects to
2904derivations can be defined, such that these objects can also be inserted
d9ae938f
LC
2905into gexps. Another useful type of high-level object that can be
2906inserted in a gexp is @dfn{local files}, which allows files from the
2907local file system to be added to the store and referred to by
2908derivations and such (see @code{local-file} below.)
b39fc6f7 2909
21b679f6
LC
2910To illustrate the idea, here is an example of a gexp:
2911
2912@example
2913(define build-exp
2914 #~(begin
2915 (mkdir #$output)
2916 (chdir #$output)
aff8ce7c 2917 (symlink (string-append #$coreutils "/bin/ls")
21b679f6
LC
2918 "list-files")))
2919@end example
2920
2921This gexp can be passed to @code{gexp->derivation}; we obtain a
2922derivation that builds a directory containing exactly one symlink to
2923@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2924
2925@example
2926(gexp->derivation "the-thing" build-exp)
2927@end example
2928
e20fd1bf 2929As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
2930substituted to the reference to the @var{coreutils} package in the
2931actual build code, and @var{coreutils} is automatically made an input to
2932the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2933output)}) is replaced by a string containing the derivation's output
667b2508
LC
2934directory name.
2935
2936@cindex cross compilation
2937In a cross-compilation context, it is useful to distinguish between
2938references to the @emph{native} build of a package---that can run on the
2939host---versus references to cross builds of a package. To that end, the
2940@code{#+} plays the same role as @code{#$}, but is a reference to a
2941native package build:
2942
2943@example
2944(gexp->derivation "vi"
2945 #~(begin
2946 (mkdir #$output)
2947 (system* (string-append #+coreutils "/bin/ln")
2948 "-s"
2949 (string-append #$emacs "/bin/emacs")
2950 (string-append #$output "/bin/vi")))
2951 #:target "mips64el-linux")
2952@end example
2953
2954@noindent
2955In the example above, the native build of @var{coreutils} is used, so
2956that @command{ln} can actually run on the host; but then the
2957cross-compiled build of @var{emacs} is referenced.
2958
2959The syntactic form to construct gexps is summarized below.
21b679f6
LC
2960
2961@deffn {Scheme Syntax} #~@var{exp}
2962@deffnx {Scheme Syntax} (gexp @var{exp})
2963Return a G-expression containing @var{exp}. @var{exp} may contain one
2964or more of the following forms:
2965
2966@table @code
2967@item #$@var{obj}
2968@itemx (ungexp @var{obj})
b39fc6f7
LC
2969Introduce a reference to @var{obj}. @var{obj} may have one of the
2970supported types, for example a package or a
21b679f6
LC
2971derivation, in which case the @code{ungexp} form is replaced by its
2972output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2973
b39fc6f7
LC
2974If @var{obj} is a list, it is traversed and references to supported
2975objects are substituted similarly.
21b679f6
LC
2976
2977If @var{obj} is another gexp, its contents are inserted and its
2978dependencies are added to those of the containing gexp.
2979
2980If @var{obj} is another kind of object, it is inserted as is.
2981
b39fc6f7
LC
2982@item #$@var{obj}:@var{output}
2983@itemx (ungexp @var{obj} @var{output})
21b679f6 2984This is like the form above, but referring explicitly to the
b39fc6f7
LC
2985@var{output} of @var{obj}---this is useful when @var{obj} produces
2986multiple outputs (@pxref{Packages with Multiple Outputs}).
21b679f6 2987
667b2508
LC
2988@item #+@var{obj}
2989@itemx #+@var{obj}:output
2990@itemx (ungexp-native @var{obj})
2991@itemx (ungexp-native @var{obj} @var{output})
2992Same as @code{ungexp}, but produces a reference to the @emph{native}
2993build of @var{obj} when used in a cross compilation context.
2994
21b679f6
LC
2995@item #$output[:@var{output}]
2996@itemx (ungexp output [@var{output}])
2997Insert a reference to derivation output @var{output}, or to the main
2998output when @var{output} is omitted.
2999
3000This only makes sense for gexps passed to @code{gexp->derivation}.
3001
3002@item #$@@@var{lst}
3003@itemx (ungexp-splicing @var{lst})
3004Like the above, but splices the contents of @var{lst} inside the
3005containing list.
3006
667b2508
LC
3007@item #+@@@var{lst}
3008@itemx (ungexp-native-splicing @var{lst})
3009Like the above, but refers to native builds of the objects listed in
3010@var{lst}.
3011
21b679f6
LC
3012@end table
3013
3014G-expressions created by @code{gexp} or @code{#~} are run-time objects
3015of the @code{gexp?} type (see below.)
3016@end deffn
3017
3018@deffn {Scheme Procedure} gexp? @var{obj}
3019Return @code{#t} if @var{obj} is a G-expression.
3020@end deffn
3021
3022G-expressions are meant to be written to disk, either as code building
3023some derivation, or as plain files in the store. The monadic procedures
3024below allow you to do that (@pxref{The Store Monad}, for more
3025information about monads.)
3026
3027@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
ce45eb4c 3028 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
21b679f6
LC
3029 [#:hash #f] [#:hash-algo #f] @
3030 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 3031 [#:module-path @var{%load-path}] @
c8351d9a 3032 [#:references-graphs #f] [#:allowed-references #f] @
c0468155 3033 [#:leaked-env-vars #f] @
c8351d9a 3034 [#:local-build? #f] [#:guile-for-build #f]
21b679f6 3035Return a derivation @var{name} that runs @var{exp} (a gexp) with
68a61e9f
LC
3036@var{guile-for-build} (a derivation) on @var{system}. When @var{target}
3037is true, it is used as the cross-compilation target triplet for packages
3038referred to by @var{exp}.
21b679f6 3039
ce45eb4c
LC
3040Make @var{modules} available in the evaluation context of @var{exp};
3041@var{modules} is a list of names of Guile modules searched in
3042@var{module-path} to be copied in the store, compiled, and made available in
21b679f6
LC
3043the load path during the execution of @var{exp}---e.g., @code{((guix
3044build utils) (guix build gnu-build-system))}.
3045
ce45eb4c
LC
3046@var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3047applicable.
3048
b53833b2
LC
3049When @var{references-graphs} is true, it must be a list of tuples of one of the
3050following forms:
3051
3052@example
3053(@var{file-name} @var{package})
3054(@var{file-name} @var{package} @var{output})
3055(@var{file-name} @var{derivation})
3056(@var{file-name} @var{derivation} @var{output})
3057(@var{file-name} @var{store-item})
3058@end example
3059
3060The right-hand-side of each element of @var{references-graphs} is automatically made
3061an input of the build process of @var{exp}. In the build environment, each
3062@var{file-name} contains the reference graph of the corresponding item, in a simple
3063text format.
3064
c8351d9a
LC
3065@var{allowed-references} must be either @code{#f} or a list of output names and packages.
3066In the latter case, the list denotes store items that the result is allowed to
3067refer to. Any reference to another store item will lead to a build error.
3068
e20fd1bf 3069The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
3070@end deffn
3071
d9ae938f
LC
3072@deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
3073 [#:recursive? #t]
3074Return an object representing local file @var{file} to add to the store; this
3075object can be used in a gexp. @var{file} will be added to the store under @var{name}--by
3076default the base name of @var{file}.
3077
3078When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
3079designates a flat file and @var{recursive?} is true, its contents are added, and its
3080permission bits are kept.
3081
3082This is the declarative counterpart of the @code{interned-file} monadic
3083procedure (@pxref{The Store Monad, @code{interned-file}}).
3084@end deffn
3085
21b679f6
LC
3086@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
3087Return an executable script @var{name} that runs @var{exp} using
3088@var{guile} with @var{modules} in its search path.
3089
3090The example below builds a script that simply invokes the @command{ls}
3091command:
3092
3093@example
3094(use-modules (guix gexp) (gnu packages base))
3095
3096(gexp->script "list-files"
3097 #~(execl (string-append #$coreutils "/bin/ls")
3098 "ls"))
3099@end example
3100
3101When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 3102@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
3103executable file @file{/gnu/store/@dots{}-list-files} along these lines:
3104
3105@example
3106#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
3107!#
3108(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
3109 "ls")
3110@end example
3111@end deffn
3112
3113@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
3114Return a derivation that builds a file @var{name} containing @var{exp}.
3115
3116The resulting file holds references to all the dependencies of @var{exp}
3117or a subset thereof.
3118@end deffn
1ed19464
LC
3119
3120@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
3121Return as a monadic value a derivation that builds a text file
3122containing all of @var{text}. @var{text} may list, in addition to
d9ae938f
LC
3123strings, objects of any type that can be used in a gexp: packages,
3124derivations, local file objects, etc. The resulting store file holds
3125references to all these.
1ed19464
LC
3126
3127This variant should be preferred over @code{text-file} anytime the file
3128to create will reference items from the store. This is typically the
3129case when building a configuration file that embeds store file names,
3130like this:
3131
3132@example
3133(define (profile.sh)
3134 ;; Return the name of a shell script in the store that
3135 ;; initializes the 'PATH' environment variable.
3136 (text-file* "profile.sh"
3137 "export PATH=" coreutils "/bin:"
3138 grep "/bin:" sed "/bin\n"))
3139@end example
3140
3141In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
3142will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
3143preventing them from being garbage-collected during its lifetime.
3144@end deffn
21b679f6
LC
3145
3146Of course, in addition to gexps embedded in ``host'' code, there are
3147also modules containing build tools. To make it clear that they are
3148meant to be used in the build stratum, these modules are kept in the
3149@code{(guix build @dots{})} name space.
3150
3151
568717fd
LC
3152@c *********************************************************************
3153@node Utilities
3154@chapter Utilities
3155
210cc920
LC
3156This section describes tools primarily targeted at developers and users
3157who write new package definitions. They complement the Scheme
3158programming interface of Guix in a convenient way.
3159
568717fd 3160@menu
37166310 3161* Invoking guix build:: Building packages from the command line.
210cc920 3162* Invoking guix download:: Downloading a file and printing its hash.
37166310 3163* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 3164* Invoking guix import:: Importing package definitions.
37166310 3165* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 3166* Invoking guix lint:: Finding errors in package definitions.
372c4bbc 3167* Invoking guix environment:: Setting up development environments.
aff8ce7c 3168* Invoking guix publish:: Sharing substitutes.
568717fd
LC
3169@end menu
3170
e49951eb
MW
3171@node Invoking guix build
3172@section Invoking @command{guix build}
568717fd 3173
e49951eb 3174The @command{guix build} command builds packages or derivations and
6798a8e4
LC
3175their dependencies, and prints the resulting store paths. Note that it
3176does not modify the user's profile---this is the job of the
e49951eb 3177@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
3178it is mainly useful for distribution developers.
3179
3180The general syntax is:
c78bd12b
LC
3181
3182@example
e49951eb 3183guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
3184@end example
3185
3186@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
3187the software distribution such as @code{coreutils} or
3188@code{coreutils-8.20}, or a derivation such as
834129e0 3189@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
3190package with the corresponding name (and optionally version) is searched
3191for among the GNU distribution modules (@pxref{Package Modules}).
3192
3193Alternatively, the @code{--expression} option may be used to specify a
3194Scheme expression that evaluates to a package; this is useful when
3195disambiguation among several same-named packages or package variants is
3196needed.
c78bd12b
LC
3197
3198The @var{options} may be zero or more of the following:
3199
3200@table @code
3201
3202@item --expression=@var{expr}
3203@itemx -e @var{expr}
ac5de156 3204Build the package or derivation @var{expr} evaluates to.
c78bd12b 3205
5401dd75 3206For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
3207guile-1.8)}, which unambiguously designates this specific variant of
3208version 1.8 of Guile.
3209
56b82106
LC
3210Alternately, @var{expr} may be a G-expression, in which case it is used
3211as a build program passed to @code{gexp->derivation}
3212(@pxref{G-Expressions}).
3213
3214Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
3215(@pxref{The Store Monad}). The procedure must return a derivation as a
3216monadic value, which is then passed through @code{run-with-store}.
3217
c78bd12b
LC
3218@item --source
3219@itemx -S
3220Build the packages' source derivations, rather than the packages
3221themselves.
3222
e49951eb 3223For instance, @code{guix build -S gcc} returns something like
834129e0 3224@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 3225
f9cc8971
LC
3226The returned source tarball is the result of applying any patches and
3227code snippets specified in the package's @code{origin} (@pxref{Defining
3228Packages}).
3229
2cdfe13d
EB
3230@item --sources
3231Fetch and return the source of @var{package-or-derivation} and all their
3232dependencies, recursively. This is a handy way to obtain a local copy
3233of all the source code needed to build @var{packages}, allowing you to
3234eventually build them even without network access. It is an extension
3235of the @code{--source} option and can accept one of the following
3236optional argument values:
3237
3238@table @code
3239@item package
3240This value causes the @code{--sources} option to behave in the same way
3241as the @code{--source} option.
3242
3243@item all
3244Build all packages' source derivations, including any source that might
3245be listed as @code{inputs}. This is the default value.
3246
3247@example
3248$ guix build --sources tzdata
3249The following derivations will be built:
3250 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
3251 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3252@end example
3253
3254@item transitive
3255Build all packages' source derivations, as well as all source
3256derivations for packages' transitive inputs. This can be used e.g. to
3257prefetch package source for later offline building.
3258
3259@example
3260$ guix build --sources=transitive tzdata
3261The following derivations will be built:
3262 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3263 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
3264 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
3265 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
3266 /gnu/store/@dots{}-make-4.1.tar.xz.drv
3267 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
3268@dots{}
3269@end example
3270
3271@end table
3272
c78bd12b
LC
3273@item --system=@var{system}
3274@itemx -s @var{system}
3275Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
3276the host's system type.
3277
3278An example use of this is on Linux-based systems, which can emulate
3279different personalities. For instance, passing
3280@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
3281to build packages in a complete 32-bit environment.
3282
e55ec43d
LC
3283@item --target=@var{triplet}
3284@cindex cross-compilation
3285Cross-build for @var{triplet}, which must be a valid GNU triplet, such
3286as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
3287configuration triplets,, configure, GNU Configure and Build System}).
3288
7f3673f2
LC
3289@item --with-source=@var{source}
3290Use @var{source} as the source of the corresponding package.
3291@var{source} must be a file name or a URL, as for @command{guix
3292download} (@pxref{Invoking guix download}).
3293
3294The ``corresponding package'' is taken to be one specified on the
3295command line whose name matches the base of @var{source}---e.g., if
3296@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
3297package is @code{guile}. Likewise, the version string is inferred from
3298@var{source}; in the previous example, it's @code{2.0.10}.
3299
3300This option allows users to try out versions of packages other than the
3301one provided by the distribution. The example below downloads
3302@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
3303the @code{ed} package:
3304
3305@example
3306guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
3307@end example
3308
3309As a developer, @code{--with-source} makes it easy to test release
3310candidates:
3311
3312@example
3313guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
3314@end example
3315
05962f29
LC
3316@item --no-grafts
3317Do not ``graft'' packages. In practice, this means that package updates
3318available as grafts are not applied. @xref{Security Updates}, for more
3319information on grafts.
7f3673f2 3320
c78bd12b
LC
3321@item --derivations
3322@itemx -d
3323Return the derivation paths, not the output paths, of the given
3324packages.
3325
70ee5642
LC
3326@item --root=@var{file}
3327@itemx -r @var{file}
3328Make @var{file} a symlink to the result, and register it as a garbage
3329collector root.
3330
3331@item --log-file
3332Return the build log file names for the given
3333@var{package-or-derivation}s, or raise an error if build logs are
3334missing.
3335
3336This works regardless of how packages or derivations are specified. For
3337instance, the following invocations are equivalent:
3338
3339@example
3340guix build --log-file `guix build -d guile`
3341guix build --log-file `guix build guile`
3342guix build --log-file guile
3343guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
3344@end example
3345
3346
3347@end table
3348
3349@cindex common build options
3350In addition, a number of options that control the build process are
3351common to @command{guix build} and other commands that can spawn builds,
3352such as @command{guix package} or @command{guix archive}. These are the
3353following:
3354
3355@table @code
3356
300868ba
LC
3357@item --load-path=@var{directory}
3358@itemx -L @var{directory}
3359Add @var{directory} to the front of the package module search path
3360(@pxref{Package Modules}).
3361
3362This allows users to define their own packages and make them visible to
3363the command-line tools.
3364
c78bd12b
LC
3365@item --keep-failed
3366@itemx -K
3367Keep the build tree of failed builds. Thus, if a build fail, its build
3368tree is kept under @file{/tmp}, in a directory whose name is shown at
3369the end of the build log. This is useful when debugging build issues.
3370
3371@item --dry-run
3372@itemx -n
3373Do not build the derivations.
3374
56b1f4b7
LC
3375@item --fallback
3376When substituting a pre-built binary fails, fall back to building
3377packages locally.
3378
c78bd12b 3379@item --no-substitutes
b5385b52 3380Do not use substitutes for build products. That is, always build things
c4202d60
LC
3381locally instead of allowing downloads of pre-built binaries
3382(@pxref{Substitutes}).
c78bd12b 3383
425b0bfc 3384@item --no-build-hook
4ec2e92d
LC
3385Do not attempt to offload builds @i{via} the daemon's ``build hook''
3386(@pxref{Daemon Offload Setup}). That is, always build things locally
3387instead of offloading builds to remote machines.
425b0bfc 3388
969e678e
LC
3389@item --max-silent-time=@var{seconds}
3390When the build or substitution process remains silent for more than
3391@var{seconds}, terminate it and report a build failure.
3392
002622b6
LC
3393@item --timeout=@var{seconds}
3394Likewise, when the build or substitution process lasts for more than
3395@var{seconds}, terminate it and report a build failure.
3396
3397By default there is no timeout. This behavior can be restored with
3398@code{--timeout=0}.
3399
07ab4bf1
LC
3400@item --verbosity=@var{level}
3401Use the given verbosity level. @var{level} must be an integer between 0
3402and 5; higher means more verbose output. Setting a level of 4 or more
3403may be helpful when debugging setup issues with the build daemon.
3404
70ee5642
LC
3405@item --cores=@var{n}
3406@itemx -c @var{n}
3407Allow the use of up to @var{n} CPU cores for the build. The special
3408value @code{0} means to use as many CPU cores as available.
bf421152 3409
f6526eb3
LC
3410@item --max-jobs=@var{n}
3411@itemx -M @var{n}
3412Allow at most @var{n} build jobs in parallel. @xref{Invoking
3413guix-daemon, @code{--max-jobs}}, for details about this option and the
3414equivalent @command{guix-daemon} option.
3415
c78bd12b
LC
3416@end table
3417
e49951eb 3418Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
3419the @code{package-derivation} procedure of the @code{(guix packages)}
3420module, and to the @code{build-derivations} procedure of the @code{(guix
01d8ac64 3421derivations)} module.
c78bd12b 3422
16eb115e
DP
3423In addition to options explicitly passed on the command line,
3424@command{guix build} and other @command{guix} commands that support
3425building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
3426
3427@defvr {Environment Variable} GUIX_BUILD_OPTIONS
3428Users can define this variable to a list of command line options that
3429will automatically be used by @command{guix build} and other
3430@command{guix} commands that can perform builds, as in the example
3431below:
3432
3433@example
3434$ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
3435@end example
3436
847391fe
DP
3437These options are parsed independently, and the result is appended to
3438the parsed command-line options.
16eb115e
DP
3439@end defvr
3440
3441
210cc920
LC
3442@node Invoking guix download
3443@section Invoking @command{guix download}
3444
3445When writing a package definition, developers typically need to download
3446the package's source tarball, compute its SHA256 hash, and write that
3447hash in the package definition (@pxref{Defining Packages}). The
3448@command{guix download} tool helps with this task: it downloads a file
3449from the given URI, adds it to the store, and prints both its file name
3450in the store and its SHA256 hash.
3451
3452The fact that the downloaded file is added to the store saves bandwidth:
3453when the developer eventually tries to build the newly defined package
3454with @command{guix build}, the source tarball will not have to be
3455downloaded again because it is already in the store. It is also a
3456convenient way to temporarily stash files, which may be deleted
3457eventually (@pxref{Invoking guix gc}).
3458
3459The @command{guix download} command supports the same URIs as used in
3460package definitions. In particular, it supports @code{mirror://} URIs.
3461@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
3462Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
3463they are not available, an error is raised. @xref{Guile Preparations,
3464how to install the GnuTLS bindings for Guile,, gnutls-guile,
3465GnuTLS-Guile}, for more information.
210cc920
LC
3466
3467The following option is available:
3468
3469@table @code
3470@item --format=@var{fmt}
3471@itemx -f @var{fmt}
3472Write the hash in the format specified by @var{fmt}. For more
081145cf 3473information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
3474@end table
3475
6c365eca
NK
3476@node Invoking guix hash
3477@section Invoking @command{guix hash}
3478
210cc920 3479The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
3480It is primarily a convenience tool for anyone contributing to the
3481distribution: it computes the cryptographic hash of a file, which can be
3482used in the definition of a package (@pxref{Defining Packages}).
3483
3484The general syntax is:
3485
3486@example
3487guix hash @var{option} @var{file}
3488@end example
3489
3490@command{guix hash} has the following option:
3491
3492@table @code
3493
3494@item --format=@var{fmt}
3495@itemx -f @var{fmt}
210cc920 3496Write the hash in the format specified by @var{fmt}.
6c365eca
NK
3497
3498Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
3499(@code{hex} and @code{hexadecimal} can be used as well).
3500
3501If the @option{--format} option is not specified, @command{guix hash}
3502will output the hash in @code{nix-base32}. This representation is used
3503in the definitions of packages.
3504
3140f2df
LC
3505@item --recursive
3506@itemx -r
3507Compute the hash on @var{file} recursively.
3508
3509In this case, the hash is computed on an archive containing @var{file},
3510including its children if it is a directory. Some of @var{file}'s
3511meta-data is part of the archive; for instance, when @var{file} is a
3512regular file, the hash is different depending on whether @var{file} is
3513executable or not. Meta-data such as time stamps has no impact on the
3514hash (@pxref{Invoking guix archive}).
3515@c FIXME: Replace xref above with xref to an ``Archive'' section when
3516@c it exists.
3517
6c365eca
NK
3518@end table
3519
2f7d2d91
LC
3520@node Invoking guix import
3521@section Invoking @command{guix import}
3522
3523@cindex importing packages
3524@cindex package import
3525@cindex package conversion
3526The @command{guix import} command is useful for people willing to add a
3527package to the distribution but who'd rather do as little work as
3528possible to get there---a legitimate demand. The command knows of a few
3529repositories from which it can ``import'' package meta-data. The result
3530is a package definition, or a template thereof, in the format we know
3531(@pxref{Defining Packages}).
3532
3533The general syntax is:
3534
3535@example
3536guix import @var{importer} @var{options}@dots{}
3537@end example
3538
3539@var{importer} specifies the source from which to import package
3540meta-data, and @var{options} specifies a package identifier and other
3541options specific to @var{importer}. Currently, the available
3542``importers'' are:
3543
3544@table @code
3545@item gnu
3546Import meta-data for the given GNU package. This provides a template
3547for the latest version of that GNU package, including the hash of its
3548source tarball, and its canonical synopsis and description.
3549
3550Additional information such as the package's dependencies and its
3551license needs to be figured out manually.
3552
3553For example, the following command returns a package definition for
3554GNU@tie{}Hello:
3555
3556@example
3557guix import gnu hello
3558@end example
3559
3560Specific command-line options are:
3561
3562@table @code
3563@item --key-download=@var{policy}
3564As for @code{guix refresh}, specify the policy to handle missing OpenPGP
3565keys when verifying the package's signature. @xref{Invoking guix
3566refresh, @code{--key-download}}.
3567@end table
3568
3569@item pypi
3570@cindex pypi
3571Import meta-data from the @uref{https://pypi.python.org/, Python Package
3572Index}@footnote{This functionality requires Guile-JSON to be installed.
3573@xref{Requirements}.}. Information is taken from the JSON-formatted
3574description available at @code{pypi.python.org} and usually includes all
3575the relevant information, including package dependencies.
3576
3577The command below imports meta-data for the @code{itsdangerous} Python
3578package:
3579
3580@example
3581guix import pypi itsdangerous
3582@end example
3583
d45dc6da
EB
3584@item cpan
3585@cindex CPAN
3586Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}.
3587Information is taken from the JSON-formatted meta-data provided through
3588@uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
66392e47
EB
3589relevant information, such as module dependencies. License information
3590should be checked closely. If Perl is available in the store, then the
3591@code{corelist} utility will be used to filter core modules out of the
3592list of dependencies.
d45dc6da
EB
3593
3594The command command below imports meta-data for the @code{Acme::Boolean}
3595Perl module:
3596
3597@example
3598guix import cpan Acme::Boolean
3599@end example
3600
2f7d2d91
LC
3601@item nix
3602Import meta-data from a local copy of the source of the
3603@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
3604relies on the @command{nix-instantiate} command of
3605@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
3606typically written in a mixture of Nix-language and Bash code. This
3607command only imports the high-level package structure that is written in
3608the Nix language. It normally includes all the basic fields of a
3609package definition.
3610
3611When importing a GNU package, the synopsis and descriptions are replaced
3612by their canonical upstream variant.
3613
3614As an example, the command below imports the package definition of
3615LibreOffice (more precisely, it imports the definition of the package
3616bound to the @code{libreoffice} top-level attribute):
3617
3618@example
3619guix import nix ~/path/to/nixpkgs libreoffice
3620@end example
863af4e1
FB
3621
3622@item hackage
3623@cindex hackage
3624Import meta-data from Haskell community's central package archive
3625@uref{https://hackage.haskell.org/, Hackage}. Information is taken from
3626Cabal files and includes all the relevant information, including package
3627dependencies.
3628
3629Specific command-line options are:
3630
3631@table @code
3632@item --no-test-dependencies
3633@itemx -t
3634Do not include dependencies only required to run the test suite.
3635@end table
3636
3637The command below imports meta-data for the latest version of the
3638@code{HTTP} Haskell package without including test dependencies:
3639
3640@example
3641guix import hackage -t HTTP
3642@end example
3643
3644A specific package version may optionally be specified by following the
3645package name by a hyphen and a version number as in the following example:
3646
3647@example
3648guix import hackage mtl-2.1.3.1
3649@end example
3650
3651Currently only indentation structured Cabal files are supported.
2f7d2d91
LC
3652@end table
3653
3654The structure of the @command{guix import} code is modular. It would be
3655useful to have more importers for other package formats, and your help
3656is welcome here (@pxref{Contributing}).
3657
37166310
LC
3658@node Invoking guix refresh
3659@section Invoking @command{guix refresh}
3660
3661The primary audience of the @command{guix refresh} command is developers
3662of the GNU software distribution. By default, it reports any packages
3663provided by the distribution that are outdated compared to the latest
3664upstream version, like this:
3665
3666@example
3667$ guix refresh
3668gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
3669gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
3670@end example
3671
3672It does so by browsing each package's FTP directory and determining the
3673highest version number of the source tarballs
3674therein@footnote{Currently, this only works for GNU packages.}.
3675
3676When passed @code{--update}, it modifies distribution source files to
3677update the version numbers and source tarball hashes of those packages'
3678recipes (@pxref{Defining Packages}). This is achieved by downloading
3679each package's latest source tarball and its associated OpenPGP
3680signature, authenticating the downloaded tarball against its signature
3681using @command{gpg}, and finally computing its hash. When the public
3682key used to sign the tarball is missing from the user's keyring, an
3683attempt is made to automatically retrieve it from a public key server;
3684when it's successful, the key is added to the user's keyring; otherwise,
3685@command{guix refresh} reports an error.
3686
3687The following options are supported:
3688
3689@table @code
3690
3691@item --update
3692@itemx -u
3693Update distribution source files (package recipes) in place.
081145cf 3694@xref{Defining Packages}, for more information on package definitions.
37166310
LC
3695
3696@item --select=[@var{subset}]
3697@itemx -s @var{subset}
3698Select all the packages in @var{subset}, one of @code{core} or
3699@code{non-core}.
3700
3701The @code{core} subset refers to all the packages at the core of the
3702distribution---i.e., packages that are used to build ``everything
3703else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
3704changing one of these packages in the distribution entails a rebuild of
3705all the others. Thus, such updates are an inconvenience to users in
3706terms of build time or bandwidth used to achieve the upgrade.
3707
3708The @code{non-core} subset refers to the remaining packages. It is
3709typically useful in cases where an update of the core packages would be
3710inconvenient.
3711
3712@end table
3713
3714In addition, @command{guix refresh} can be passed one or more package
3715names, as in this example:
3716
3717@example
4b9b3cbb 3718guix refresh -u emacs idutils gcc-4.8.4
37166310
LC
3719@end example
3720
3721@noindent
3722The command above specifically updates the @code{emacs} and
3723@code{idutils} packages. The @code{--select} option would have no
3724effect in this case.
3725
7d193ec3
EB
3726When considering whether to upgrade a package, it is sometimes
3727convenient to know which packages would be affected by the upgrade and
3728should be checked for compatibility. For this the following option may
3729be used when passing @command{guix refresh} one or more package names:
3730
3731@table @code
3732
3733@item --list-dependent
3734@itemx -l
3735List top-level dependent packages that would need to be rebuilt as a
3736result of upgrading one or more packages.
3737
3738@end table
3739
3740Be aware that the @code{--list-dependent} option only
3741@emph{approximates} the rebuilds that would be required as a result of
3742an upgrade. More rebuilds might be required under some circumstances.
3743
3744@example
7779ab61
LC
3745$ guix refresh --list-dependent flex
3746Building the following 120 packages would ensure 213 dependent packages are rebuilt:
3747hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
3748@end example
3749
3750The command above lists a set of packages that could be built to check
3751for compatibility with an upgraded @code{flex} package.
3752
f9230085
LC
3753The following options can be used to customize GnuPG operation:
3754
3755@table @code
3756
f9230085
LC
3757@item --gpg=@var{command}
3758Use @var{command} as the GnuPG 2.x command. @var{command} is searched
3759for in @code{$PATH}.
3760
2bc53ba9
LC
3761@item --key-download=@var{policy}
3762Handle missing OpenPGP keys according to @var{policy}, which may be one
3763of:
3764
3765@table @code
3766@item always
3767Always download missing OpenPGP keys from the key server, and add them
3768to the user's GnuPG keyring.
3769
3770@item never
3771Never try to download missing OpenPGP keys. Instead just bail out.
3772
3773@item interactive
3774When a package signed with an unknown OpenPGP key is encountered, ask
3775the user whether to download it or not. This is the default behavior.
3776@end table
3777
3778@item --key-server=@var{host}
3779Use @var{host} as the OpenPGP key server when importing a public key.
3780
f9230085
LC
3781@end table
3782
b4f5e0e8
CR
3783@node Invoking guix lint
3784@section Invoking @command{guix lint}
3785The @command{guix lint} is meant to help package developers avoid common
873c4085
LC
3786errors and use a consistent style. It runs a number of checks on a
3787given set of packages in order to find common mistakes in their
3788definitions. Available @dfn{checkers} include (see
3789@code{--list-checkers} for a complete list):
3790
3791@table @code
3792@item synopsis
3793@itemx description
3794Validate certain typographical and stylistic rules about package
3795descriptions and synopses.
3796
3797@item inputs-should-be-native
3798Identify inputs that should most likely be native inputs.
3799
3800@item source
3801@itemx home-page
3802Probe @code{home-page} and @code{source} URLs and report those that are
3803invalid.
3804@end table
b4f5e0e8
CR
3805
3806The general syntax is:
3807
3808@example
3809guix lint @var{options} @var{package}@dots{}
3810@end example
3811
3812If no package is given on the command line, then all packages are checked.
3813The @var{options} may be zero or more of the following:
3814
3815@table @code
3816
dd7c013d
CR
3817@item --checkers
3818@itemx -c
3819Only enable the checkers specified in a comma-separated list using the
3820names returned by @code{--list-checkers}.
3821
b4f5e0e8
CR
3822@item --list-checkers
3823@itemx -l
3824List and describe all the available checkers that will be run on packages
3825and exit.
3826
3827@end table
37166310 3828
372c4bbc
DT
3829@node Invoking guix environment
3830@section Invoking @command{guix environment}
3831
f5fd4fd2 3832@cindex reproducible build environments
372c4bbc
DT
3833The purpose of @command{guix environment} is to assist hackers in
3834creating reproducible development environments without polluting their
3835package profile. The @command{guix environment} tool takes one or more
3836packages, builds all of the necessary inputs, and creates a shell
3837environment to use them.
3838
3839The general syntax is:
3840
3841@example
3842guix environment @var{options} @var{package}@dots{}
3843@end example
3844
3845The following examples spawns a new shell that is capable of building
3846the GNU Guile source code:
3847
3848@example
3849guix environment guile
3850@end example
3851
3852If the specified packages are not built yet, @command{guix environment}
3853automatically builds them. The new shell's environment is an augmented
3854version of the environment that @command{guix environment} was run in.
3855It contains the necessary search paths for building the given package
3856added to the existing environment variables. To create a ``pure''
3857environment in which the original environment variables have been unset,
3858use the @code{--pure} option.
3859
3860Additionally, more than one package may be specified, in which case the
3861union of the inputs for the given packages are used. For example, the
3862command below spawns a shell where all of the dependencies of both Guile
3863and Emacs are available:
3864
3865@example
3866guix environment guile emacs
3867@end example
3868
3869Sometimes an interactive shell session is not desired. The
3870@code{--exec} option can be used to specify the command to run instead.
3871
3872@example
3873guix environment guile --exec=make
3874@end example
3875
3876The following options are available:
3877
3878@table @code
3879@item --expression=@var{expr}
3880@itemx -e @var{expr}
3881Create an environment for the package that @var{expr} evaluates to.
3882
3883@item --load=@var{file}
3884@itemx -l @var{file}
3885Create an environment for the package that the code within @var{file}
3886evaluates to.
3887
3888@item --exec=@var{command}
3889@item -E @var{command}
3890Execute @var{command} in the new environment.
3891
3892@item --pure
3893Unset existing environment variables when building the new environment.
3894This has the effect of creating an environment in which search paths
3895only contain package inputs.
3896
3897@item --search-paths
3898Display the environment variable definitions that make up the
3899environment.
3900@end table
3901
3902It also supports all of the common build options that @command{guix
3903build} supports (@pxref{Invoking guix build, common build options}).
3904
aff8ce7c
DT
3905@node Invoking guix publish
3906@section Invoking @command{guix publish}
3907
3908The purpose of @command{guix publish} is to enable users to easily share
8ce229fc
LC
3909their store with others, which can then use it as a substitute server
3910(@pxref{Substitutes}).
3911
3912When @command{guix publish} runs, it spawns an HTTP server which allows
3913anyone with network access to obtain substitutes from it. This means
3914that any machine running Guix can also act as if it were a build farm,
3915since the HTTP interface is compatible with Hydra, the software behind
3916the @code{hydra.gnu.org} build farm.
aff8ce7c
DT
3917
3918For security, each substitute is signed, allowing recipients to check
3919their authenticity and integrity (@pxref{Substitutes}). Because
3920@command{guix publish} uses the system's signing key, which is only
5463fe51
LC
3921readable by the system administrator, it must be started as root; the
3922@code{--user} option makes it drop root privileges early on.
aff8ce7c
DT
3923
3924The general syntax is:
3925
3926@example
3927guix publish @var{options}@dots{}
3928@end example
3929
3930Running @command{guix publish} without any additional arguments will
3931spawn an HTTP server on port 8080:
3932
3933@example
3934guix publish
3935@end example
3936
3937Once a publishing server has been authorized (@pxref{Invoking guix
3938archive}), the daemon may download substitutes from it:
3939
3940@example
3941guix-daemon --substitute-urls=http://example.org:8080
3942@end example
3943
3944The following options are available:
3945
3946@table @code
3947@item --port=@var{port}
3948@itemx -p @var{port}
3949Listen for HTTP requests on @var{port}.
3950
9e2292ef
LC
3951@item --listen=@var{host}
3952Listen on the network interface for @var{host}. The default is to
3953accept connections from any interface.
3954
5463fe51
LC
3955@item --user=@var{user}
3956@itemx -u @var{user}
3957Change privileges to @var{user} as soon as possible---i.e., once the
3958server socket is open and the signing key has been read.
3959
aff8ce7c
DT
3960@item --repl[=@var{port}]
3961@itemx -r [@var{port}]
3962Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
8ce229fc
LC
3963Reference Manual}) on @var{port} (37146 by default). This is used
3964primarily for debugging a running @command{guix publish} server.
aff8ce7c
DT
3965@end table
3966
a1ba8475
LC
3967@c *********************************************************************
3968@node GNU Distribution
3969@chapter GNU Distribution
3970
3ca2731c 3971@cindex Guix System Distribution
4705641f 3972@cindex GuixSD
3ca2731c
LC
3973Guix comes with a distribution of the GNU system consisting entirely of
3974free software@footnote{The term ``free'' here refers to the
a1ba8475 3975@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
3ca2731c 3976users of that software}.}. The
35ed9306
LC
3977distribution can be installed on its own (@pxref{System Installation}),
3978but it is also possible to install Guix as a package manager on top of
3979an installed GNU/Linux system (@pxref{Installation}). To distinguish
3ca2731c 3980between the two, we refer to the standalone distribution as the Guix
4705641f 3981System Distribution, or GuixSD.
35ed9306
LC
3982
3983The distribution provides core GNU packages such as GNU libc, GCC, and
3984Binutils, as well as many GNU and non-GNU applications. The complete
3985list of available packages can be browsed
d03bb653
LC
3986@url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
3987running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
3988
3989@example
e49951eb 3990guix package --list-available
a1ba8475
LC
3991@end example
3992
35ed9306 3993Our goal has been to provide a practical 100% free software distribution of
401c53c4
LC
3994Linux-based and other variants of GNU, with a focus on the promotion and
3995tight integration of GNU components, and an emphasis on programs and
3996tools that help users exert that freedom.
3997
3ca2731c 3998Packages are currently available on the following platforms:
c320011d
LC
3999
4000@table @code
4001
4002@item x86_64-linux
4003Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
4004
4005@item i686-linux
4006Intel 32-bit architecture (IA32), Linux-Libre kernel;
4007
aa1e1947
MW
4008@item armhf-linux
4009ARMv7-A architecture with hard float, Thumb-2 and VFP3D16 coprocessor,
4010using the EABI hard-float ABI, and Linux-Libre kernel.
4011
c320011d
LC
4012@item mips64el-linux
4013little-endian 64-bit MIPS processors, specifically the Loongson series,
4014n32 application binary interface (ABI), and Linux-Libre kernel.
4015
4016@end table
4017
4705641f 4018GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
3ca2731c 4019
c320011d
LC
4020@noindent
4021For information on porting to other architectures or kernels,
4022@xref{Porting}.
4023
401c53c4 4024@menu
5af6de3e 4025* System Installation:: Installing the whole operating system.
35ed9306 4026* System Configuration:: Configuring the operating system.
91ef73d4 4027* Installing Debugging Files:: Feeding the debugger.
05962f29 4028* Security Updates:: Deploying security fixes quickly.
401c53c4 4029* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 4030* Packaging Guidelines:: Growing the distribution.
401c53c4 4031* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 4032* Porting:: Targeting another platform or kernel.
401c53c4
LC
4033@end menu
4034
4035Building this distribution is a cooperative effort, and you are invited
081145cf 4036to join! @xref{Contributing}, for information about how you can help.
401c53c4 4037
5af6de3e
LC
4038@node System Installation
4039@section System Installation
4040
3ca2731c
LC
4041@cindex Guix System Distribution
4042This section explains how to install the Guix System Distribution
4043on a machine. The Guix package manager can
35ed9306
LC
4044also be installed on top of a running GNU/Linux system,
4045@pxref{Installation}.
5af6de3e
LC
4046
4047@ifinfo
4048@c This paragraph is for people reading this from tty2 of the
4049@c installation image.
4050You're reading this documentation with an Info reader. For details on
4051how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 4052link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
4053@kbd{l} afterwards to come back here.
4054@end ifinfo
4055
8aaaae38
LC
4056@subsection Limitations
4057
4705641f 4058As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
3ca2731c 4059not production-ready. It may contain bugs and lack important
8aaaae38
LC
4060features. Thus, if you are looking for a stable production system that
4061respects your freedom as a computer user, a good solution at this point
4062is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
4063more established GNU/Linux distributions}. We hope you can soon switch
4705641f 4064to the GuixSD without fear, of course. In the meantime, you can
8aaaae38
LC
4065also keep using your distribution and try out the package manager on top
4066of it (@pxref{Installation}).
4067
4068Before you proceed with the installation, be aware of the following
4069noteworthy limitations applicable to version @value{VERSION}:
4070
4071@itemize
4072@item
4073The installation process does not include a graphical user interface and
4074requires familiarity with GNU/Linux (see the following subsections to
4075get a feel of what that means.)
4076
4077@item
b1e95eca
LC
4078The system does not yet provide GNOME and KDE; it provides Xfce, though,
4079if graphical desktop environments are your thing.
8aaaae38
LC
4080
4081@item
dbcb0ab1 4082Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
4083
4084@item
4085Few system services are currently supported out-of-the-box
4086(@pxref{Services}).
4087
4088@item
49607566 4089On the order of 1,900 packages are available, which means that you may
8aaaae38
LC
4090occasionally find that a useful package is missing.
4091@end itemize
4092
4093You've been warned. But more than a disclaimer, this is an invitation
4094to report issues (and success stories!), and join us in improving it.
4095@xref{Contributing}, for more info.
5af6de3e
LC
4096
4097@subsection USB Stick Installation
4098
4099An installation image for USB sticks can be downloaded from
4705641f 4100@indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
5af6de3e
LC
4101where @var{system} is one of:
4102
4103@table @code
4104@item x86_64-linux
4105for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
4106
4107@item i686-linux
4108for a 32-bit GNU/Linux system on Intel-compatible CPUs.
4109@end table
4110
4111This image contains a single partition with the tools necessary for an
4112installation. It is meant to be copied @emph{as is} to a large-enough
4113USB stick.
4114
4115To copy the image to a USB stick, follow these steps:
4116
4117@enumerate
4118@item
4119Decompress the image using the @command{xz} command:
4120
4121@example
4705641f 4122xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
5af6de3e
LC
4123@end example
4124
4125@item
4126Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
4127its device name. Assuming that USB stick is known as @file{/dev/sdX},
4128copy the image with:
4129
4130@example
4705641f 4131dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
4132@end example
4133
4134Access to @file{/dev/sdX} usually requires root privileges.
4135@end enumerate
4136
4137Once this is done, you should be able to reboot the system and boot from
4138the USB stick. The latter usually requires you to get in the BIOS' boot
4139menu, where you can choose to boot from the USB stick.
4140
4141@subsection Preparing for Installation
4142
4143Once you have successfully booted the image on the USB stick, you should
4144end up with a root prompt. Several console TTYs are configured and can
4145be used to run commands as root. TTY2 shows this documentation,
4146browsable using the Info reader commands (@pxref{Help,,, info, Info: An
4147Introduction}).
4148
4149To install the system, you would:
4150
4151@enumerate
4152
4153@item
152dd61c
LC
4154Configure the network, by running @command{ifconfig eno1 up && dhclient
4155eno1} (to get an automatically assigned IP address from the wired
4156network interface controller@footnote{
95c559c1
LC
4157@c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
4158The name @code{eno1} is for the first on-board Ethernet controller. The
4159interface name for an Ethernet controller that is in the first slot of
4160the first PCI bus, for instance, would be @code{enp1s0}. Use
4161@command{ifconfig -a} to list all the available network interfaces.}),
4162or using the @command{ifconfig} command.
5af6de3e
LC
4163
4164The system automatically loads drivers for your network interface
4165controllers.
4166
4167Setting up network access is almost always a requirement because the
4168image does not contain all the software and tools that may be needed.
4169
4170@item
4171Unless this has already been done, you must partition and format the
4172target partitions.
4173
7ab44369
LC
4174Preferably, assign partitions a label so that you can easily and
4175reliably refer to them in @code{file-system} declarations (@pxref{File
4176Systems}). This is typically done using the @code{-L} option of
4177@command{mkfs.ext4} and related commands.
4178
5af6de3e 4179The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
4180Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
4181encryption, and e2fsprogs, the suite of tools to manipulate
4182ext2/ext3/ext4 file systems.
5af6de3e 4183
83a17b62
LC
4184@item
4185Once that is done, mount the target root partition under @file{/mnt}.
4186
4187@item
4188Lastly, run @code{deco start cow-store /mnt}.
4189
4190This will make @file{/gnu/store} copy-on-write, such that packages added
4191to it during the installation phase will be written to the target disk
4192rather than kept in memory.
4193
5af6de3e
LC
4194@end enumerate
4195
5af6de3e
LC
4196
4197@subsection Proceeding with the Installation
4198
4199With the target partitions ready, you now have to edit a file and
4200provide the declaration of the operating system to be installed. To
4201that end, the installation system comes with two text editors: GNU nano
4202(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
4203It is better to store that file on the target root file system, say, as
4204@file{/mnt/etc/config.scm}.
4205
dd51caac
LC
4206@xref{Using the Configuration System}, for examples of operating system
4207configurations. These examples are available under
4208@file{/etc/configuration} in the installation image, so you can copy
4209them and use them as a starting point for your own configuration.
5af6de3e 4210
dd51caac
LC
4211Once you are done preparing the configuration file, the new system must
4212be initialized (remember that the target root file system is mounted
4213under @file{/mnt}):
5af6de3e
LC
4214
4215@example
4216guix system init /mnt/etc/config.scm /mnt
4217@end example
4218
4219@noindent
4220This will copy all the necessary files, and install GRUB on
4221@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 4222more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
4223downloads or builds of missing packages, which can take some time.
4224
4225Once that command has completed---and hopefully succeeded!---you can
ad14d9e7 4226run @command{reboot} and boot into the new system. Cross fingers, and
5af6de3e
LC
4227join us on @code{#guix} on the Freenode IRC network or on
4228@file{guix-devel@@gnu.org} to share your experience---good or not so
4229good.
4230
4231@subsection Building the Installation Image
4232
4233The installation image described above was built using the @command{guix
4234system} command, specifically:
4235
4236@example
8a225c66 4237guix system disk-image --image-size=850MiB gnu/system/install.scm
5af6de3e
LC
4238@end example
4239
4240@xref{Invoking guix system}, for more information. See
4241@file{gnu/system/install.scm} in the source tree for more information
4242about the installation image.
4243
cf4a9129
LC
4244@node System Configuration
4245@section System Configuration
b208a005 4246
cf4a9129 4247@cindex system configuration
3ca2731c 4248The Guix System Distribution supports a consistent whole-system configuration
cf4a9129
LC
4249mechanism. By that we mean that all aspects of the global system
4250configuration---such as the available system services, timezone and
4251locale settings, user accounts---are declared in a single place. Such
4252a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 4253
cf4a9129
LC
4254One of the advantages of putting all the system configuration under the
4255control of Guix is that it supports transactional system upgrades, and
4256makes it possible to roll-back to a previous system instantiation,
4257should something go wrong with the new one (@pxref{Features}). Another
4258one is that it makes it easy to replicate the exact same configuration
4259across different machines, or at different points in time, without
4260having to resort to additional administration tools layered on top of
4261the system's own tools.
4262@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 4263
cf4a9129
LC
4264This section describes this mechanism. First we focus on the system
4265administrator's viewpoint---explaining how the system is configured and
4266instantiated. Then we show how this mechanism can be extended, for
4267instance to support new system services.
91ef73d4 4268
cf4a9129
LC
4269@menu
4270* Using the Configuration System:: Customizing your GNU system.
7313a52e 4271* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 4272* File Systems:: Configuring file system mounts.
510f9d86 4273* Mapped Devices:: Block device extra processing.
cf4a9129 4274* User Accounts:: Specifying user accounts.
598e19dc 4275* Locales:: Language and cultural convention settings.
cf4a9129 4276* Services:: Specifying system services.
0ae8c15a 4277* Setuid Programs:: Programs running with root privileges.
efb5e833 4278* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 4279* Name Service Switch:: Configuring libc's name service switch.
fd1b1fa2 4280* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 4281* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
4282* Invoking guix system:: Instantiating a system configuration.
4283* Defining Services:: Adding new service definitions.
4284@end menu
91ef73d4 4285
cf4a9129
LC
4286@node Using the Configuration System
4287@subsection Using the Configuration System
64d76fa6 4288
cf4a9129
LC
4289The operating system is configured by providing an
4290@code{operating-system} declaration in a file that can then be passed to
4291the @command{guix system} command (@pxref{Invoking guix system}). A
4292simple setup, with the default system services, the default Linux-Libre
4293kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 4294
cf4a9129
LC
4295@findex operating-system
4296@lisp
dd51caac 4297@include os-config-bare-bones.texi
cf4a9129 4298@end lisp
401c53c4 4299
cf4a9129
LC
4300This example should be self-describing. Some of the fields defined
4301above, such as @code{host-name} and @code{bootloader}, are mandatory.
4302Others, such as @code{packages} and @code{services}, can be omitted, in
4303which case they get a default value.
e7f34eb0 4304
cf4a9129
LC
4305@vindex %base-packages
4306The @code{packages} field lists
4307packages that will be globally visible on the system, for all user
4308accounts---i.e., in every user's @code{PATH} environment variable---in
4309addition to the per-user profiles (@pxref{Invoking guix package}). The
4310@var{%base-packages} variable provides all the tools one would expect
4311for basic user and administrator tasks---including the GNU Core
4312Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
4313editor, @command{find}, @command{grep}, etc. The example above adds
4314Emacs to those, taken from the @code{(gnu packages emacs)} module
4315(@pxref{Package Modules}).
e7f34eb0 4316
cf4a9129
LC
4317@vindex %base-services
4318The @code{services} field lists @dfn{system services} to be made
4319available when the system starts (@pxref{Services}).
4320The @code{operating-system} declaration above specifies that, in
4321addition to the basic services, we want the @command{lshd} secure shell
4322daemon listening on port 2222, and allowing remote @code{root} logins
4323(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
4324@code{lsh-service} arranges so that @code{lshd} is started with the
4325right command-line options, possibly with supporting configuration files
7313a52e
LC
4326generated as needed (@pxref{Defining Services}). @xref{operating-system
4327Reference}, for details about the available @code{operating-system}
4328fields.
a1ba8475 4329
dd51caac
LC
4330The configuration for a typical ``desktop'' usage, with the X11 display
4331server, a desktop environment, network management, an SSH server, and
4332more, would look like this:
4333
4334@lisp
4335@include os-config-desktop.texi
4336@end lisp
4337
4338@xref{Desktop Services}, for the exact list of services provided by
efb5e833
LC
4339@var{%desktop-services}. @xref{X.509 Certificates}, for background
4340information about the @code{nss-certs} package that is used here.
dd51caac 4341
cf4a9129
LC
4342Assuming the above snippet is stored in the @file{my-system-config.scm}
4343file, the @command{guix system reconfigure my-system-config.scm} command
4344instantiates that configuration, and makes it the default GRUB boot
4345entry (@pxref{Invoking guix system}). The normal way to change the
4346system's configuration is by updating this file and re-running the
4347@command{guix system} command.
b81e1947 4348
cf4a9129
LC
4349At the Scheme level, the bulk of an @code{operating-system} declaration
4350is instantiated with the following monadic procedure (@pxref{The Store
4351Monad}):
b81e1947 4352
cf4a9129
LC
4353@deffn {Monadic Procedure} operating-system-derivation os
4354Return a derivation that builds @var{os}, an @code{operating-system}
4355object (@pxref{Derivations}).
b81e1947 4356
cf4a9129
LC
4357The output of the derivation is a single directory that refers to all
4358the packages, configuration files, and other supporting files needed to
4359instantiate @var{os}.
4360@end deffn
b81e1947 4361
7313a52e
LC
4362@node operating-system Reference
4363@subsection @code{operating-system} Reference
4364
4365This section summarizes all the options available in
4366@code{operating-system} declarations (@pxref{Using the Configuration
4367System}).
4368
4369@deftp {Data Type} operating-system
4370This is the data type representing an operating system configuration.
4371By that, we mean all the global system configuration, not per-user
4372configuration (@pxref{Using the Configuration System}).
4373
4374@table @asis
4375@item @code{kernel} (default: @var{linux-libre})
4376The package object of the operating system to use@footnote{Currently
4377only the Linux-libre kernel is supported. In the future, it will be
4378possible to use the GNU@tie{}Hurd.}.
4379
4380@item @code{bootloader}
88faf933 4381The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
4382
4383@item @code{initrd} (default: @code{base-initrd})
4384A two-argument monadic procedure that returns an initial RAM disk for
4385the Linux kernel. @xref{Initial RAM Disk}.
4386
f34c56be
LC
4387@item @code{firmware} (default: @var{%base-firmware})
4388@cindex firmware
4389List of firmware packages loadable by the operating system kernel.
4390
4391The default includes firmware needed for Atheros-based WiFi devices
4392(Linux-libre module @code{ath9k}.)
4393
7313a52e
LC
4394@item @code{host-name}
4395The host name.
4396
4397@item @code{hosts-file}
4398@cindex hosts file
4399A zero-argument monadic procedure that returns a text file for use as
4400@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
4401Reference Manual}). The default is to produce a file with entries for
4402@code{localhost} and @var{host-name}.
4403
4404@item @code{mapped-devices} (default: @code{'()})
4405A list of mapped devices. @xref{Mapped Devices}.
4406
4407@item @code{file-systems}
4408A list of file systems. @xref{File Systems}.
4409
4410@item @code{swap-devices} (default: @code{'()})
4411@cindex swap devices
4412A list of strings identifying devices to be used for ``swap space''
4413(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
4414For example, @code{'("/dev/sda3")}.
4415
4416@item @code{users} (default: @code{'()})
4417@itemx @code{groups} (default: @var{%base-groups})
4418List of user accounts and groups. @xref{User Accounts}.
4419
4420@item @code{skeletons} (default: @code{(default-skeletons)})
4421A monadic list of pairs of target file name and files. These are the
4422files that will be used as skeletons as new accounts are created.
4423
4424For instance, a valid value may look like this:
4425
4426@example
4427(mlet %store-monad ((bashrc (text-file "bashrc" "\
4428 export PATH=$HOME/.guix-profile/bin")))
4429 (return `((".bashrc" ,bashrc))))
4430@end example
4431
4432@item @code{issue} (default: @var{%default-issue})
4433A string denoting the contents of the @file{/etc/issue} file, which is
4434what displayed when users log in on a text console.
4435
4436@item @code{packages} (default: @var{%base-packages})
4437The set of packages installed in the global profile, which is accessible
4438at @file{/run/current-system/profile}.
4439
4440The default set includes core utilities, but it is good practice to
4441install non-core utilities in user profiles (@pxref{Invoking guix
4442package}).
4443
4444@item @code{timezone}
4445A timezone identifying string---e.g., @code{"Europe/Paris"}.
4446
598e19dc
LC
4447@item @code{locale} (default: @code{"en_US.utf8"})
4448The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
4449Library Reference Manual}). @xref{Locales}, for more information.
4450
4451@item @code{locale-definitions} (default: @var{%default-locale-definitions})
4452The list of locale definitions to be compiled and that may be used at
4453run time. @xref{Locales}.
7313a52e 4454
996ed739
LC
4455@item @code{name-service-switch} (default: @var{%default-nss})
4456Configuration of libc's name service switch (NSS)---a
4457@code{<name-service-switch>} object. @xref{Name Service Switch}, for
4458details.
4459
7313a52e
LC
4460@item @code{services} (default: @var{%base-services})
4461A list of monadic values denoting system services. @xref{Services}.
4462
4463@item @code{pam-services} (default: @code{(base-pam-services)})
4464@cindex PAM
4465@cindex pluggable authentication modules
4466Linux @dfn{pluggable authentication module} (PAM) services.
4467@c FIXME: Add xref to PAM services section.
4468
4469@item @code{setuid-programs} (default: @var{%setuid-programs})
4470List of string-valued G-expressions denoting setuid programs.
4471@xref{Setuid Programs}.
4472
4473@item @code{sudoers} (default: @var{%sudoers-specification})
4474@cindex sudoers
4475The contents of the @file{/etc/sudoers} file as a string.
4476
4477This file specifies which users can use the @command{sudo} command, what
4478they are allowed to do, and what privileges they may gain. The default
4479is that only @code{root} and members of the @code{wheel} group may use
4480@code{sudo}.
4481
4482@end table
4483@end deftp
4484
cf4a9129
LC
4485@node File Systems
4486@subsection File Systems
b81e1947 4487
cf4a9129
LC
4488The list of file systems to be mounted is specified in the
4489@code{file-systems} field of the operating system's declaration
4490(@pxref{Using the Configuration System}). Each file system is declared
4491using the @code{file-system} form, like this:
b81e1947
LC
4492
4493@example
cf4a9129
LC
4494(file-system
4495 (mount-point "/home")
4496 (device "/dev/sda3")
4497 (type "ext4"))
b81e1947
LC
4498@end example
4499
cf4a9129
LC
4500As usual, some of the fields are mandatory---those shown in the example
4501above---while others can be omitted. These are described below.
b81e1947 4502
cf4a9129
LC
4503@deftp {Data Type} file-system
4504Objects of this type represent file systems to be mounted. They
4505contain the following members:
5ff3c4b8 4506
cf4a9129
LC
4507@table @asis
4508@item @code{type}
4509This is a string specifying the type of the file system---e.g.,
4510@code{"ext4"}.
5ff3c4b8 4511
cf4a9129
LC
4512@item @code{mount-point}
4513This designates the place where the file system is to be mounted.
b81e1947 4514
cf4a9129
LC
4515@item @code{device}
4516This names the ``source'' of the file system. By default it is the name
4517of a node under @file{/dev}, but its meaning depends on the @code{title}
4518field described below.
401c53c4 4519
cf4a9129
LC
4520@item @code{title} (default: @code{'device})
4521This is a symbol that specifies how the @code{device} field is to be
4522interpreted.
401c53c4 4523
cf4a9129
LC
4524When it is the symbol @code{device}, then the @code{device} field is
4525interpreted as a file name; when it is @code{label}, then @code{device}
4526is interpreted as a partition label name; when it is @code{uuid},
4527@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 4528
cf4a9129
LC
4529The @code{label} and @code{uuid} options offer a way to refer to disk
4530partitions without having to hard-code their actual device name.
da7cabd4 4531
5f86a66e
LC
4532However, when a file system's source is a mapped device (@pxref{Mapped
4533Devices}), its @code{device} field @emph{must} refer to the mapped
4534device name---e.g., @file{/dev/mapper/root-partition}---and consequently
4535@code{title} must be set to @code{'device}. This is required so that
4536the system knows that mounting the file system depends on having the
4537corresponding device mapping established.
4538
cf4a9129
LC
4539@item @code{flags} (default: @code{'()})
4540This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
4541include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
4542access to special files), @code{no-suid} (ignore setuid and setgid
4543bits), and @code{no-exec} (disallow program execution.)
da7cabd4 4544
cf4a9129
LC
4545@item @code{options} (default: @code{#f})
4546This is either @code{#f}, or a string denoting mount options.
da7cabd4 4547
cf4a9129
LC
4548@item @code{needed-for-boot?} (default: @code{#f})
4549This Boolean value indicates whether the file system is needed when
4550booting. If that is true, then the file system is mounted when the
4551initial RAM disk (initrd) is loaded. This is always the case, for
4552instance, for the root file system.
da7cabd4 4553
cf4a9129
LC
4554@item @code{check?} (default: @code{#t})
4555This Boolean indicates whether the file system needs to be checked for
4556errors before being mounted.
f9cc8971 4557
4e469051
LC
4558@item @code{create-mount-point?} (default: @code{#f})
4559When true, the mount point is created if it does not exist yet.
4560
cf4a9129
LC
4561@end table
4562@end deftp
da7cabd4 4563
a69576ea
LC
4564The @code{(gnu system file-systems)} exports the following useful
4565variables.
4566
4567@defvr {Scheme Variable} %base-file-systems
4568These are essential file systems that are required on normal systems,
3392ce5d
LC
4569such as @var{%devtmpfs-file-system} and @var{%immutable-store} (see
4570below.) Operating system declarations should always contain at least
4571these.
a69576ea
LC
4572@end defvr
4573
4574@defvr {Scheme Variable} %devtmpfs-file-system
4575The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
4576requirement for udev (@pxref{Base Services, @code{udev-service}}).
4577@end defvr
4578
7f239fd3
LC
4579@defvr {Scheme Variable} %pseudo-terminal-file-system
4580This is the file system to be mounted as @file{/dev/pts}. It supports
4581@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
4582functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
4583Manual}). Pseudo-terminals are used by terminal emulators such as
4584@command{xterm}.
4585@end defvr
4586
db17ae5c
LC
4587@defvr {Scheme Variable} %shared-memory-file-system
4588This file system is mounted as @file{/dev/shm} and is used to support
4589memory sharing across processes (@pxref{Memory-mapped I/O,
4590@code{shm_open},, libc, The GNU C Library Reference Manual}).
4591@end defvr
4592
3392ce5d
LC
4593@defvr {Scheme Variable} %immutable-store
4594This file system performs a read-only ``bind mount'' of
4595@file{/gnu/store}, making it read-only for all the users including
4596@code{root}. This prevents against accidental modification by software
4597running as @code{root} or by system administrators.
4598
4599The daemon itself is still able to write to the store: it remounts it
4600read-write in its own ``name space.''
4601@end defvr
4602
a69576ea
LC
4603@defvr {Scheme Variable} %binary-format-file-system
4604The @code{binfmt_misc} file system, which allows handling of arbitrary
4605executable file types to be delegated to user space. This requires the
4606@code{binfmt.ko} kernel module to be loaded.
4607@end defvr
4608
4609@defvr {Scheme Variable} %fuse-control-file-system
4610The @code{fusectl} file system, which allows unprivileged users to mount
4611and unmount user-space FUSE file systems. This requires the
4612@code{fuse.ko} kernel module to be loaded.
4613@end defvr
4614
510f9d86
LC
4615@node Mapped Devices
4616@subsection Mapped Devices
4617
4618@cindex device mapping
4619@cindex mapped devices
4620The Linux kernel has a notion of @dfn{device mapping}: a block device,
4621such as a hard disk partition, can be @dfn{mapped} into another device,
4622with additional processing over the data that flows through
4623it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
4624concept of a ``mapped device'' and that of a file system: both boil down
4625to @emph{translating} input/output operations made on a file to
4626operations on its backing store. Thus, the Hurd implements mapped
4627devices, like file systems, using the generic @dfn{translator} mechanism
4628(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
4629typical example is encryption device mapping: all writes to the mapped
4630device are encrypted, and all reads are deciphered, transparently.
4631
4632Mapped devices are declared using the @code{mapped-device} form:
4633
4634@example
4635(mapped-device
4636 (source "/dev/sda3")
4637 (target "home")
4638 (type luks-device-mapping))
4639@end example
4640
4641@noindent
4642@cindex disk encryption
4643@cindex LUKS
4644This example specifies a mapping from @file{/dev/sda3} to
4645@file{/dev/mapper/home} using LUKS---the
4646@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
4647standard mechanism for disk encryption. The @file{/dev/mapper/home}
4648device can then be used as the @code{device} of a @code{file-system}
4649declaration (@pxref{File Systems}). The @code{mapped-device} form is
4650detailed below.
4651
4652@deftp {Data Type} mapped-device
4653Objects of this type represent device mappings that will be made when
4654the system boots up.
4655
9cb426b8
LC
4656@table @code
4657@item source
510f9d86
LC
4658This string specifies the name of the block device to be mapped, such as
4659@code{"/dev/sda3"}.
4660
9cb426b8 4661@item target
510f9d86
LC
4662This string specifies the name of the mapping to be established. For
4663example, specifying @code{"my-partition"} will lead to the creation of
4664the @code{"/dev/mapper/my-partition"} device.
4665
9cb426b8 4666@item type
510f9d86
LC
4667This must be a @code{mapped-device-kind} object, which specifies how
4668@var{source} is mapped to @var{target}.
4669@end table
4670@end deftp
4671
4672@defvr {Scheme Variable} luks-device-mapping
4673This defines LUKS block device encryption using the @command{cryptsetup}
4674command, from the same-named package. This relies on the
4675@code{dm-crypt} Linux kernel module.
4676@end defvr
4677
cf4a9129
LC
4678@node User Accounts
4679@subsection User Accounts
ee85f3db 4680
9bea87a5
LC
4681User accounts and groups are entirely managed through the
4682@code{operating-system} declaration. They are specified with the
4683@code{user-account} and @code{user-group} forms:
ee85f3db 4684
cf4a9129
LC
4685@example
4686(user-account
4687 (name "alice")
4688 (group "users")
24e752c0
LC
4689 (supplementary-groups '("wheel" ;allow use of sudo, etc.
4690 "audio" ;sound card
4691 "video" ;video devices such as webcams
4692 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
4693 (comment "Bob's sister")
4694 (home-directory "/home/alice"))
4695@end example
25083588 4696
9bea87a5
LC
4697When booting or upon completion of @command{guix system reconfigure},
4698the system ensures that only the user accounts and groups specified in
4699the @code{operating-system} declaration exist, and with the specified
4700properties. Thus, account or group creations or modifications made by
4701directly invoking commands such as @command{useradd} are lost upon
4702reconfiguration or reboot. This ensures that the system remains exactly
4703as declared.
4704
cf4a9129
LC
4705@deftp {Data Type} user-account
4706Objects of this type represent user accounts. The following members may
4707be specified:
ee85f3db 4708
cf4a9129
LC
4709@table @asis
4710@item @code{name}
4711The name of the user account.
ee85f3db 4712
cf4a9129
LC
4713@item @code{group}
4714This is the name (a string) or identifier (a number) of the user group
4715this account belongs to.
ee85f3db 4716
cf4a9129
LC
4717@item @code{supplementary-groups} (default: @code{'()})
4718Optionally, this can be defined as a list of group names that this
4719account belongs to.
ee85f3db 4720
cf4a9129
LC
4721@item @code{uid} (default: @code{#f})
4722This is the user ID for this account (a number), or @code{#f}. In the
4723latter case, a number is automatically chosen by the system when the
4724account is created.
ee85f3db 4725
cf4a9129
LC
4726@item @code{comment} (default: @code{""})
4727A comment about the account, such as the account's owner full name.
c8c871d1 4728
cf4a9129
LC
4729@item @code{home-directory}
4730This is the name of the home directory for the account.
ee85f3db 4731
cf4a9129
LC
4732@item @code{shell} (default: Bash)
4733This is a G-expression denoting the file name of a program to be used as
4734the shell (@pxref{G-Expressions}).
ee85f3db 4735
cf4a9129
LC
4736@item @code{system?} (default: @code{#f})
4737This Boolean value indicates whether the account is a ``system''
4738account. System accounts are sometimes treated specially; for instance,
4739graphical login managers do not list them.
ee85f3db 4740
cf4a9129 4741@item @code{password} (default: @code{#f})
eb59595c
LC
4742You would normally leave this field to @code{#f}, initialize user
4743passwords as @code{root} with the @command{passwd} command, and then let
9bea87a5
LC
4744users change it with @command{passwd}. Passwords set with
4745@command{passwd} are of course preserved across reboot and
4746reconfiguration.
eb59595c
LC
4747
4748If you @emph{do} want to have a preset password for an account, then
4749this field must contain the encrypted password, as a string.
5d1f1177
LC
4750@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
4751on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 4752Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 4753
cf4a9129
LC
4754@end table
4755@end deftp
ee85f3db 4756
cf4a9129 4757User group declarations are even simpler:
ee85f3db 4758
cf4a9129
LC
4759@example
4760(user-group (name "students"))
4761@end example
ee85f3db 4762
cf4a9129
LC
4763@deftp {Data Type} user-group
4764This type is for, well, user groups. There are just a few fields:
af8a56b8 4765
cf4a9129
LC
4766@table @asis
4767@item @code{name}
4768The group's name.
ee85f3db 4769
cf4a9129
LC
4770@item @code{id} (default: @code{#f})
4771The group identifier (a number). If @code{#f}, a new number is
4772automatically allocated when the group is created.
ee85f3db 4773
c8fa3426
LC
4774@item @code{system?} (default: @code{#f})
4775This Boolean value indicates whether the group is a ``system'' group.
4776System groups have low numerical IDs.
4777
cf4a9129
LC
4778@item @code{password} (default: @code{#f})
4779What, user groups can have a password? Well, apparently yes. Unless
4780@code{#f}, this field specifies the group's password.
ee85f3db 4781
cf4a9129
LC
4782@end table
4783@end deftp
401c53c4 4784
cf4a9129
LC
4785For convenience, a variable lists all the basic user groups one may
4786expect:
401c53c4 4787
cf4a9129
LC
4788@defvr {Scheme Variable} %base-groups
4789This is the list of basic user groups that users and/or packages expect
4790to be present on the system. This includes groups such as ``root'',
4791``wheel'', and ``users'', as well as groups used to control access to
4792specific devices such as ``audio'', ``disk'', and ``cdrom''.
4793@end defvr
401c53c4 4794
598e19dc
LC
4795@node Locales
4796@subsection Locales
4797
4798@cindex locale
4799A @dfn{locale} defines cultural conventions for a particular language
4800and region of the world (@pxref{Locales,,, libc, The GNU C Library
4801Reference Manual}). Each locale has a name that typically has the form
4802@code{@var{language}_@var{territory}.@var{charset}}---e.g.,
4803@code{fr_LU.utf8} designates the locale for the French language, with
4804cultural conventions from Luxembourg, and using the UTF-8 encoding.
4805
4806@cindex locale definition
4807Usually, you will want to specify the default locale for the machine
4808using the @code{locale} field of the @code{operating-system} declaration
4809(@pxref{operating-system Reference, @code{locale}}).
4810
4811That locale must be among the @dfn{locale definitions} that are known to
4812the system---and these are specified in the @code{locale-definitions}
4813slot of @code{operating-system}. The default value includes locale
4814definition for some widely used locales, but not for all the available
4815locales, in order to save space.
4816
4817If the locale specified in the @code{locale} field is not among the
4818definitions listed in @code{locale-definitions}, @command{guix system}
4819raises an error. In that case, you should add the locale definition to
4820the @code{locale-definitions} field. For instance, to add the North
4821Frisian locale for Germany, the value of that field may be:
4822
4823@example
4824(cons (locale-definition
4825 (name "fy_DE.utf8") (source "fy_DE"))
4826 %default-locale-definitions)
4827@end example
4828
4829Likewise, to save space, one might want @code{locale-definitions} to
4830list only the locales that are actually used, as in:
4831
4832@example
4833(list (locale-definition
4834 (name "ja_JP.eucjp") (source "ja_JP")
4835 (charset "EUC-JP")))
4836@end example
4837
4838The @code{locale-definition} form is provided by the @code{(gnu system
4839locale)} module. Details are given below.
4840
4841@deftp {Data Type} locale-definition
4842This is the data type of a locale definition.
4843
4844@table @asis
4845
4846@item @code{name}
4847The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
4848Reference Manual}, for more information on locale names.
4849
4850@item @code{source}
4851The name of the source for that locale. This is typically the
4852@code{@var{language}_@var{territory}} part of the locale name.
4853
4854@item @code{charset} (default: @code{"UTF-8"})
4855The ``character set'' or ``code set'' for that locale,
4856@uref{http://www.iana.org/assignments/character-sets, as defined by
4857IANA}.
4858
4859@end table
4860@end deftp
4861
4862@defvr {Scheme Variable} %default-locale-definitions
4863An arbitrary list of commonly used locales, used as the default value of
4864the @code{locale-definitions} field of @code{operating-system}
4865declarations.
4866@end defvr
401c53c4 4867
cf4a9129
LC
4868@node Services
4869@subsection Services
401c53c4 4870
cf4a9129
LC
4871@cindex system services
4872An important part of preparing an @code{operating-system} declaration is
4873listing @dfn{system services} and their configuration (@pxref{Using the
4874Configuration System}). System services are typically daemons launched
4875when the system boots, or other actions needed at that time---e.g.,
d8b94dbd
LC
4876configuring network access.
4877
4878Services are managed by GNU@tie{}dmd (@pxref{Introduction,,, dmd, GNU
4879dmd Manual}). On a running system, the @command{deco} command allows
4880you to list the available services, show their status, start and stop
4881them, or do other specific operations (@pxref{Jump Start,,, dmd, GNU dmd
4882Manual}). For example:
4883
4884@example
4885# deco status dmd
4886@end example
4887
4888The above command, run as @code{root}, lists the currently defined
4889services. The @command{deco doc} command shows a synopsis of the given
4890service:
4891
4892@example
4893# deco doc nscd
4894Run libc's name service cache daemon (nscd).
4895@end example
4896
4897The @command{start}, @command{stop}, and @command{restart} sub-commands
4898have the effect you would expect. For instance, the commands below stop
4899the nscd service and restart the Xorg display server:
4900
4901@example
4902# deco stop nscd
4903Service nscd has been stopped.
4904# deco restart xorg-server
4905Service xorg-server has been stopped.
4906Service xorg-server has been started.
4907@end example
401c53c4 4908
cf4a9129 4909The following sections document the available services, starting with
d8b94dbd
LC
4910the core services, that may be used in an @code{operating-system}
4911declaration.
401c53c4 4912
cf4a9129
LC
4913@menu
4914* Base Services:: Essential system services.
4915* Networking Services:: Network setup, SSH daemon, etc.
4916* X Window:: Graphical display.
fe1a39d3 4917* Desktop Services:: D-Bus and desktop services.
105369a4 4918* Database Services:: SQL databases.
aa4ed923 4919* Various Services:: Other services.
cf4a9129 4920@end menu
401c53c4 4921
cf4a9129
LC
4922@node Base Services
4923@subsubsection Base Services
a1ba8475 4924
cf4a9129
LC
4925The @code{(gnu services base)} module provides definitions for the basic
4926services that one expects from the system. The services exported by
4927this module are listed below.
401c53c4 4928
cf4a9129
LC
4929@defvr {Scheme Variable} %base-services
4930This variable contains a list of basic services@footnote{Technically,
4931this is a list of monadic services. @xref{The Store Monad}.} one would
4932expect from the system: a login service (mingetty) on each tty, syslogd,
4933libc's name service cache daemon (nscd), the udev device manager, and
4934more.
401c53c4 4935
cf4a9129
LC
4936This is the default value of the @code{services} field of
4937@code{operating-system} declarations. Usually, when customizing a
4938system, you will want to append services to @var{%base-services}, like
4939this:
401c53c4 4940
cf4a9129 4941@example
fa1e31b8 4942(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
4943@end example
4944@end defvr
401c53c4 4945
cf4a9129
LC
4946@deffn {Monadic Procedure} host-name-service @var{name}
4947Return a service that sets the host name to @var{name}.
4948@end deffn
401c53c4 4949
cf4a9129
LC
4950@deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
4951 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
4952 [#:allow-empty-passwords? #f]
4953Return a service to run mingetty on @var{tty}.
401c53c4 4954
cf4a9129
LC
4955When @var{allow-empty-passwords?} is true, allow empty log-in password. When
4956@var{auto-login} is true, it must be a user name under which to log-in
4957automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
4958@var{auto-login}, in which case the user will have to press a key before the
4959login shell is launched.
401c53c4 4960
cf4a9129
LC
4961When true, @var{login-program} is a gexp or a monadic gexp denoting the name
4962of the log-in program (the default is the @code{login} program from the Shadow
4963tool suite.)
401c53c4 4964
cf4a9129
LC
4965@var{motd} is a monadic value containing a text file to use as
4966the ``message of the day''.
4967@end deffn
401c53c4 4968
6454b333
LC
4969@cindex name service cache daemon
4970@cindex nscd
4aee6e60
LC
4971@deffn {Monadic Procedure} nscd-service [@var{config}] [#:glibc glibc] @
4972 [#:name-services '()]
4973Return a service that runs libc's name service cache daemon (nscd) with
4974the given @var{config}---an @code{<nscd-configuration>} object.
4975Optionally, @code{#:name-services} is a list of packages that provide
4c9050c6
LC
4976name service switch (NSS) modules needed by nscd. @xref{Name Service
4977Switch}, for an example.
cf4a9129 4978@end deffn
401c53c4 4979
6454b333
LC
4980@defvr {Scheme Variable} %nscd-default-configuration
4981This is the default @code{<nscd-configuration>} value (see below) used
4982by @code{nscd-service}. This uses the caches defined by
4983@var{%nscd-default-caches}; see below.
4984@end defvr
4985
4986@deftp {Data Type} nscd-configuration
4987This is the type representing the name service cache daemon (nscd)
4988configuration.
4989
4990@table @asis
4991
4992@item @code{log-file} (default: @code{"/var/log/nscd.log"})
4993Name of nscd's log file. This is where debugging output goes when
4994@code{debug-level} is strictly positive.
4995
4996@item @code{debug-level} (default: @code{0})
4997Integer denoting the debugging levels. Higher numbers mean more
4998debugging output is logged.
4999
5000@item @code{caches} (default: @var{%nscd-default-caches})
5001List of @code{<nscd-cache>} objects denoting things to be cached; see
5002below.
5003
5004@end table
5005@end deftp
5006
5007@deftp {Data Type} nscd-cache
5008Data type representing a cache database of nscd and its parameters.
5009
5010@table @asis
5011
5012@item @code{database}
5013This is a symbol representing the name of the database to be cached.
5014Valid values are @code{passwd}, @code{group}, @code{hosts}, and
5015@code{services}, which designate the corresponding NSS database
5016(@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
5017
5018@item @code{positive-time-to-live}
5019@itemx @code{negative-time-to-live} (default: @code{20})
5020A number representing the number of seconds during which a positive or
5021negative lookup result remains in cache.
5022
5023@item @code{check-files?} (default: @code{#t})
5024Whether to check for updates of the files corresponding to
5025@var{database}.
5026
5027For instance, when @var{database} is @code{hosts}, setting this flag
5028instructs nscd to check for updates in @file{/etc/hosts} and to take
5029them into account.
5030
5031@item @code{persistent?} (default: @code{#t})
5032Whether the cache should be stored persistently on disk.
5033
5034@item @code{shared?} (default: @code{#t})
5035Whether the cache should be shared among users.
5036
5037@item @code{max-database-size} (default: 32@tie{}MiB)
5038Maximum size in bytes of the database cache.
5039
5040@c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
5041@c settings, so leave them out.
5042
5043@end table
5044@end deftp
5045
5046@defvr {Scheme Variable} %nscd-default-caches
5047List of @code{<nscd-cache>} objects used by default by
5048@code{nscd-configuration} (see above.)
5049
5050It enables persistent and aggressive caching of service and host name
5051lookups. The latter provides better host name lookup performance,
5052resilience in the face of unreliable name servers, and also better
5053privacy---often the result of host name lookups is in local cache, so
5054external name servers do not even need to be queried.
5055@end defvr
5056
5057
1bb76f75
AK
5058@deffn {Monadic Procedure} syslog-service [#:config-file #f]
5059Return a service that runs @code{syslogd}. If configuration file name
5060@var{config-file} is not specified, use some reasonable default
cf4a9129
LC
5061settings.
5062@end deffn
401c53c4 5063
cf4a9129
LC
5064@deffn {Monadic Procedure} guix-service [#:guix guix] @
5065 [#:builder-group "guixbuild"] [#:build-accounts 10] @
02bb6b45 5066 [#:authorize-hydra-key? #t] [#:use-substitutes? #t] @
cf4a9129
LC
5067 [#:extra-options '()]
5068Return a service that runs the build daemon from @var{guix}, and has
5069@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 5070
cf4a9129
LC
5071When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
5072provided by @var{guix} is authorized upon activation, meaning that substitutes
5073from @code{hydra.gnu.org} are used by default.
401c53c4 5074
cf4a9129
LC
5075If @var{use-substitutes?} is false, the daemon is run with
5076@option{--no-substitutes} (@pxref{Invoking guix-daemon,
5077@option{--no-substitutes}}).
401c53c4 5078
cf4a9129
LC
5079Finally, @var{extra-options} is a list of additional command-line options
5080passed to @command{guix-daemon}.
5081@end deffn
a1ba8475 5082
cf4a9129
LC
5083@deffn {Monadic Procedure} udev-service [#:udev udev]
5084Run @var{udev}, which populates the @file{/dev} directory dynamically.
5085@end deffn
401c53c4 5086
5eca9459
AK
5087@deffn {Monadic Procedure} console-keymap-service @var{file}
5088Return a service to load console keymap from @var{file} using
5089@command{loadkeys} command.
5090@end deffn
5091
a69576ea 5092
cf4a9129
LC
5093@node Networking Services
5094@subsubsection Networking Services
401c53c4 5095
fa1e31b8 5096The @code{(gnu services networking)} module provides services to configure
cf4a9129 5097the network interface.
a1ba8475 5098
a023cca8
LC
5099@cindex DHCP, networking service
5100@deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
5101Return a service that runs @var{dhcp}, a Dynamic Host Configuration
5102Protocol (DHCP) client, on all the non-loopback network interfaces.
5103@end deffn
5104
cf4a9129
LC
5105@deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
5106 [#:gateway #f] [#:name-services @code{'()}]
5107Return a service that starts @var{interface} with address @var{ip}. If
5108@var{gateway} is true, it must be a string specifying the default network
5109gateway.
5110@end deffn
8b315a6d 5111
b7d0c494
MW
5112@cindex wicd
5113@deffn {Monadic Procedure} wicd-service [#:wicd @var{wicd}]
5114Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a
5115network manager that aims to simplify wired and wireless networking.
5116@end deffn
5117
63854bcb
LC
5118@deffn {Monadic Procedure} ntp-service [#:ntp @var{ntp}] @
5119 [#:name-service @var{%ntp-servers}]
5120Return a service that runs the daemon from @var{ntp}, the
5121@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
5122keep the system clock synchronized with that of @var{servers}.
5123@end deffn
5124
5125@defvr {Scheme Variable} %ntp-servers
5126List of host names used as the default NTP servers.
5127@end defvr
5128
cf4a9129
LC
5129@deffn {Monadic Procedure} tor-service [#:tor tor]
5130Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 5131
cf4a9129
LC
5132The daemon runs with the default settings (in particular the default exit
5133policy) as the @code{tor} unprivileged user.
5134@end deffn
8b315a6d 5135
4627a464
LC
5136@deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
5137 [#:interface "127.0.0.1"] [#:port 6667] @
5138 [#:extra-settings ""]
5139Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
5140acts as a gateway between IRC and chat networks.
5141
5142The daemon will listen to the interface corresponding to the IP address
5143specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
5144local clients can connect, whereas @code{0.0.0.0} means that connections can
5145come from any networking interface.
5146
5147In addition, @var{extra-settings} specifies a string to append to the
5148configuration file.
5149@end deffn
5150
f4391bec 5151Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 5152
cf4a9129 5153@deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
5833bf33 5154 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
cf4a9129
LC
5155 [#:allow-empty-passwords? #f] [#:root-login? #f] @
5156 [#:syslog-output? #t] [#:x11-forwarding? #t] @
5157 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
21cc905a 5158 [#:public-key-authentication? #t] [#:initialize? #t]
cf4a9129
LC
5159Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
5160@var{host-key} must designate a file containing the host key, and readable
5161only by root.
72e25e35 5162
5833bf33
DP
5163When @var{daemonic?} is true, @command{lshd} will detach from the
5164controlling terminal and log its output to syslogd, unless one sets
5165@var{syslog-output?} to false. Obviously, it also makes lsh-service
5166depend on existence of syslogd service. When @var{pid-file?} is true,
5167@command{lshd} writes its PID to the file called @var{pid-file}.
5168
cf4a9129
LC
5169When @var{initialize?} is true, automatically create the seed and host key
5170upon service activation if they do not exist yet. This may take long and
5171require interaction.
8b315a6d 5172
20dd519c
LC
5173When @var{initialize?} is false, it is up to the user to initialize the
5174randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
5175a key pair with the private key stored in file @var{host-key} (@pxref{lshd
5176basics,,, lsh, LSH Manual}).
5177
cf4a9129
LC
5178When @var{interfaces} is empty, lshd listens for connections on all the
5179network interfaces; otherwise, @var{interfaces} must be a list of host names
5180or addresses.
9bf3c1a7 5181
20dd519c
LC
5182@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
5183passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 5184root.
4af2447e 5185
cf4a9129
LC
5186The other options should be self-descriptive.
5187@end deffn
4af2447e 5188
fa0c1d61
LC
5189@defvr {Scheme Variable} %facebook-host-aliases
5190This variable contains a string for use in @file{/etc/hosts}
5191(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
5192line contains a entry that maps a known server name of the Facebook
5193on-line service---e.g., @code{www.facebook.com}---to the local
5194host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
5195
5196This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
5197@code{operating-system} declaration (@pxref{operating-system Reference,
5198@file{/etc/hosts}}):
fa0c1d61
LC
5199
5200@example
5201(use-modules (gnu) (guix))
5202
5203(operating-system
5204 (host-name "mymachine")
5205 ;; ...
5206 (hosts-file
5207 ;; Create a /etc/hosts file with aliases for "localhost"
5208 ;; and "mymachine", as well as for Facebook servers.
5209 (text-file "hosts"
5210 (string-append (local-host-aliases host-name)
5211 %facebook-host-aliases))))
5212@end example
5213
5214This mechanism can prevent programs running locally, such as Web
5215browsers, from accessing Facebook.
5216@end defvr
5217
965a7332
LC
5218The @code{(gnu services avahi)} provides the following definition.
5219
5220@deffn {Monadic Procedure} avahi-service [#:avahi @var{avahi}] @
5221 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
5222 [#:ipv6? #t] [#:wide-area? #f] @
5223 [#:domains-to-browse '()]
5224Return a service that runs @command{avahi-daemon}, a system-wide
5225mDNS/DNS-SD responder that allows for service discovery and
5226"zero-configuration" host name lookups (see @uref{http://avahi.org/}).
5227
5228If @var{host-name} is different from @code{#f}, use that as the host name to
5229publish for this machine; otherwise, use the machine's actual host name.
5230
5231When @var{publish?} is true, publishing of host names and services is allowed;
5232in particular, avahi-daemon will publish the machine's host name and IP
5233address via mDNS on the local network.
5234
5235When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
5236
5237Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
5238sockets.
5239@end deffn
5240
5241
cf4a9129
LC
5242@node X Window
5243@subsubsection X Window
68ad877c 5244
cf4a9129
LC
5245Support for the X Window graphical display system---specifically
5246Xorg---is provided by the @code{(gnu services xorg)} module. Note that
5247there is no @code{xorg-service} procedure. Instead, the X server is
5248started by the @dfn{login manager}, currently SLiM.
4af2447e 5249
cf4a9129 5250@deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
5251 [#:auto-login? #f] [#:default-user ""] [#:startx] @
5252 [#:theme @var{%default-slim-theme}] @
4bd43bbe 5253 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
5254Return a service that spawns the SLiM graphical login manager, which in
5255turn starts the X display server with @var{startx}, a command as returned by
5256@code{xorg-start-command}.
4af2447e 5257
04e4e6ab
LC
5258@cindex X session
5259
5260SLiM automatically looks for session types described by the @file{.desktop}
5261files in @file{/run/current-system/profile/share/xsessions} and allows users
5262to choose a session from the log-in screen using @kbd{F1}. Packages such as
5263@var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
5264adding them to the system-wide set of packages automatically makes them
5265available at the log-in screen.
5266
5267In addition, @file{~/.xsession} files are honored. When available,
5268@file{~/.xsession} must be an executable that starts a window manager
5269and/or other X clients.
5270
cf4a9129
LC
5271When @var{allow-empty-passwords?} is true, allow logins with an empty
5272password. When @var{auto-login?} is true, log in automatically as
5273@var{default-user}.
0ecc3bf3
LC
5274
5275If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
5276@var{theme} must be a gexp denoting the name of a directory containing the
5277theme to use. In that case, @var{theme-name} specifies the name of the
5278theme.
cf4a9129 5279@end deffn
4af2447e 5280
0ecc3bf3
LC
5281@defvr {Scheme Variable} %default-theme
5282@defvrx {Scheme Variable} %default-theme-name
5283The G-Expression denoting the default SLiM theme and its name.
5284@end defvr
5285
f703413e 5286@deffn {Monadic Procedure} xorg-start-command [#:guile] @
d1cdd7ba 5287 [#:configuration-file #f] [#:xorg-server @var{xorg-server}]
f703413e 5288Return a derivation that builds a @var{guile} script to start the X server
d1cdd7ba
LC
5289from @var{xorg-server}. @var{configuration-file} is the server configuration
5290file or a derivation that builds it; when omitted, the result of
5291@code{xorg-configuration-file} is used.
5292
5293Usually the X server is started by a login manager.
5294@end deffn
5295
5296@deffn {Monadic Procedure} xorg-configuration-file @
12422c9d 5297 [#:drivers '()] [#:resolutions '()] [#:extra-config '()]
d1cdd7ba
LC
5298Return a configuration file for the Xorg server containing search paths for
5299all the common drivers.
f703413e
LC
5300
5301@var{drivers} must be either the empty list, in which case Xorg chooses a
5302graphics driver automatically, or a list of driver names that will be tried in
d1cdd7ba 5303this order---e.g., @code{(\"modesetting\" \"vesa\")}.
d2e59637
LC
5304
5305Likewise, when @var{resolutions} is the empty list, Xorg chooses an
5306appropriate screen resolution; otherwise, it must be a list of
5307resolutions---e.g., @code{((1024 768) (640 480))}.
12422c9d
LC
5308
5309Last, @var{extra-config} is a list of strings or objects appended to the
5310@code{text-file*} argument list. It is used to pass extra text to be added
5311verbatim to the configuration file.
f703413e 5312@end deffn
4af2447e 5313
fe1a39d3
LC
5314@node Desktop Services
5315@subsubsection Desktop Services
aa4ed923 5316
fe1a39d3
LC
5317The @code{(gnu services desktop)} module provides services that are
5318usually useful in the context of a ``desktop'' setup---that is, on a
5319machine running a graphical display server, possibly with graphical user
5320interfaces, etc.
aa4ed923 5321
4467be21
LC
5322To simplify things, the module defines a variable containing the set of
5323services that users typically expect on a machine with a graphical
5324environment and networking:
5325
5326@defvr {Scheme Variable} %desktop-services
5327This is a list of services that builds upon @var{%base-services} and
5328adds or adjust services for a typical ``desktop'' setup.
5329
5330In particular, it adds a graphical login manager (@pxref{X Window,
5331@code{slim-service}}), a network management tool (@pxref{Networking
5332Services, @code{wicd-service}}), energy and color management services,
5333an NTP client and an SSH server (@pxref{Networking Services}), the Avahi
5334daemon, and has the name service switch service configured to be able to
5335use @code{nss-mdns} (@pxref{Name Service Switch, mDNS}).
5336@end defvr
5337
5338The @var{%desktop-services} variable can be used as the @code{services}
5339field of an @code{operating-system} declaration (@pxref{operating-system
5340Reference, @code{services}}).
5341
5342The actual service definitions provided by @code{(gnu services desktop)}
5343are described below.
5344
fe1a39d3
LC
5345@deffn {Monadic Procedure} dbus-service @var{services} @
5346 [#:dbus @var{dbus}]
5347Return a service that runs the ``system bus'', using @var{dbus}, with
5348support for @var{services}.
aa4ed923 5349
fe1a39d3
LC
5350@uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
5351facility. Its system bus is used to allow system services to communicate
5352and be notified of system-wide events.
aa4ed923 5353
fe1a39d3
LC
5354@var{services} must be a list of packages that provide an
5355@file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
5356and policy files. For example, to allow avahi-daemon to use the system bus,
5357@var{services} must be equal to @code{(list avahi)}.
aa4ed923
AK
5358@end deffn
5359
be234128
AW
5360@deffn {Monadic Procedure} upower-service [#:upower @var{upower}] @
5361 [#:watts-up-pro? #f] @
5362 [#:poll-batteries? #t] @
5363 [#:ignore-lid? #f] @
5364 [#:use-percentage-for-policy? #f] @
5365 [#:percentage-low 10] @
5366 [#:percentage-critical 3] @
5367 [#:percentage-action 2] @
5368 [#:time-low 1200] @
5369 [#:time-critical 300] @
5370 [#:time-action 120] @
5371 [#:critical-power-action 'hybrid-sleep]
5372Return a service that runs @uref{http://upower.freedesktop.org/,
5373@command{upowerd}}, a system-wide monitor for power consumption and battery
5374levels, with the given configuration settings. It implements the
5375@code{org.freedesktop.UPower} D-Bus interface, and is notably used by
5376GNOME.
5377@end deffn
5378
7ce597ff
AW
5379@deffn {Monadic Procedure} colord-service [#:colord @var{colord}]
5380Return a service that runs @command{colord}, a system service with a D-Bus
5381interface to manage the color profiles of input and output devices such as
5382screens and scanners. It is notably used by the GNOME Color Manager graphical
5383tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
5384site} for more information.
5385@end deffn
5386
105369a4
DT
5387@node Database Services
5388@subsubsection Database Services
5389
5390The @code{(gnu services databases)} module provides the following service.
5391
5392@deffn {Monadic Procedure} postgresql-service [#:postgresql postgresql] @
5393 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
5394Return a service that runs @var{postgresql}, the PostgreSQL database
5395server.
5396
5397The PostgreSQL daemon loads its runtime configuration from
5398@var{config-file} and stores the database cluster in
5399@var{data-directory}.
5400@end deffn
fe1a39d3
LC
5401
5402@node Various Services
5403@subsubsection Various Services
5404
5405The @code{(gnu services lirc)} module provides the following service.
5406
5407@deffn {Monadic Procedure} lirc-service [#:lirc lirc] @
5408 [#:device #f] [#:driver #f] [#:config-file #f] @
5409 [#:extra-options '()]
5410Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
5411decodes infrared signals from remote controls.
5412
5413Optionally, @var{device}, @var{driver} and @var{config-file}
5414(configuration file name) may be specified. See @command{lircd} manual
5415for details.
5416
5417Finally, @var{extra-options} is a list of additional command-line options
5418passed to @command{lircd}.
5419@end deffn
5420
5421
0ae8c15a
LC
5422@node Setuid Programs
5423@subsection Setuid Programs
5424
5425@cindex setuid programs
5426Some programs need to run with ``root'' privileges, even when they are
5427launched by unprivileged users. A notorious example is the
5428@command{passwd} programs, which can users can run to change their
5429password, and which requires write access to the @file{/etc/passwd} and
5430@file{/etc/shadow} files---something normally restricted to root, for
5431obvious security reasons. To address that, these executables are
5432@dfn{setuid-root}, meaning that they always run with root privileges
5433(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
5434for more info about the setuid mechanisms.)
5435
5436The store itself @emph{cannot} contain setuid programs: that would be a
5437security issue since any user on the system can write derivations that
5438populate the store (@pxref{The Store}). Thus, a different mechanism is
5439used: instead of changing the setuid bit directly on files that are in
5440the store, we let the system administrator @emph{declare} which programs
5441should be setuid root.
5442
5443The @code{setuid-programs} field of an @code{operating-system}
5444declaration contains a list of G-expressions denoting the names of
5445programs to be setuid-root (@pxref{Using the Configuration System}).
5446For instance, the @command{passwd} program, which is part of the Shadow
5447package, can be designated by this G-expression (@pxref{G-Expressions}):
5448
5449@example
5450#~(string-append #$shadow "/bin/passwd")
5451@end example
5452
5453A default set of setuid programs is defined by the
5454@code{%setuid-programs} variable of the @code{(gnu system)} module.
5455
5456@defvr {Scheme Variable} %setuid-programs
5457A list of G-expressions denoting common programs that are setuid-root.
5458
5459The list includes commands such as @command{passwd}, @command{ping},
5460@command{su}, and @command{sudo}.
5461@end defvr
5462
5463Under the hood, the actual setuid programs are created in the
5464@file{/run/setuid-programs} directory at system activation time. The
5465files in this directory refer to the ``real'' binaries, which are in the
5466store.
5467
efb5e833
LC
5468@node X.509 Certificates
5469@subsection X.509 Certificates
5470
5471@cindex HTTPS, certificates
5472@cindex X.509 certificates
5473@cindex TLS
5474Web servers available over HTTPS (that is, HTTP over the transport-layer
5475security mechanism, TLS) send client programs an @dfn{X.509 certificate}
5476that the client can then use to @emph{authenticate} the server. To do
5477that, clients verify that the server's certificate is signed by a
5478so-called @dfn{certificate authority} (CA). But to verify the CA's
5479signature, clients must have first acquired the CA's certificate.
5480
5481Web browsers such as GNU@tie{}IceCat include their own set of CA
5482certificates, such that they are able to verify CA signatures
5483out-of-the-box.
5484
5485However, most other programs that can talk HTTPS---@command{wget},
5486@command{git}, @command{w3m}, etc.---need to be told where CA
5487certificates can be found.
5488
5489@cindex @code{nss-certs}
5490In GuixSD, this is done by adding a package that provides certificates
5491to the @code{packages} field of the @code{operating-system} declaration
5492(@pxref{operating-system Reference}). GuixSD includes one such package,
5493@code{nss-certs}, which is a set of CA certificates provided as part of
5494Mozilla's Network Security Services.
5495
5496Note that it is @emph{not} part of @var{%base-packages}, so you need to
5497explicitly add it. The @file{/etc/ssl/certs} directory, which is where
5498most applications and libraries look for certificates by default, points
5499to the certificates installed globally.
5500
5501Unprivileged users can also install their own certificate package in
5502their profile. A number of environment variables need to be defined so
5503that applications and libraries know where to find them. Namely, the
5504OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
5505variables. Some applications add their own environment variables; for
5506instance, the Git version control system honors the certificate bundle
5507pointed to by the @code{GIT_SSL_CAINFO} environment variable.
5508
5509
996ed739
LC
5510@node Name Service Switch
5511@subsection Name Service Switch
5512
5513@cindex name service switch
5514@cindex NSS
5515The @code{(gnu system nss)} module provides bindings to the
5516configuration file of libc's @dfn{name service switch} or @dfn{NSS}
5517(@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
5518Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
5519extended with new ``name'' lookup methods for system databases, which
5520includes host names, service names, user accounts, and more (@pxref{Name
5521Service Switch, System Databases and Name Service Switch,, libc, The GNU
5522C Library Reference Manual}).
5523
5524The NSS configuration specifies, for each system database, which lookup
5525method is to be used, and how the various methods are chained
5526together---for instance, under which circumstances NSS should try the
5527next method in the list. The NSS configuration is given in the
5528@code{name-service-switch} field of @code{operating-system} declarations
5529(@pxref{operating-system Reference, @code{name-service-switch}}).
5530
4c9050c6
LC
5531@cindex nss-mdns
5532@cindex .local, host name lookup
996ed739 5533As an example, the declaration below configures the NSS to use the
4c9050c6
LC
5534@uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
5535back-end}, which supports host name lookups over multicast DNS (mDNS)
5536for host names ending in @code{.local}:
996ed739
LC
5537
5538@example
5539(name-service-switch
5540 (hosts (list %files ;first, check /etc/hosts
5541
5542 ;; If the above did not succeed, try
5543 ;; with 'mdns_minimal'.
5544 (name-service
5545 (name "mdns_minimal")
5546
5547 ;; 'mdns_minimal' is authoritative for
5548 ;; '.local'. When it returns "not found",
5549 ;; no need to try the next methods.
5550 (reaction (lookup-specification
5551 (not-found => return))))
5552
5553 ;; Then fall back to DNS.
5554 (name-service
5555 (name "dns"))
5556
5557 ;; Finally, try with the "full" 'mdns'.
5558 (name-service
5559 (name "mdns")))))
5560@end example
5561
15137a29
LC
5562Don't worry: the @code{%mdns-host-lookup-nss} variable (see below)
5563contains this configuration, so you won't have to type it if all you
5564want is to have @code{.local} host lookup working.
5565
4c9050c6
LC
5566Note that, in this case, in addition to setting the
5567@code{name-service-switch} of the @code{operating-system} declaration,
5568@code{nscd-service} must be told where to find the @code{nss-mdns}
5569shared library (@pxref{Base Services, @code{nscd-service}}). Since the
5570@code{nscd} service is part of @var{%base-services}, you may want to
5571customize it by adding this snippet in the operating system
5572configuration file:
5573
5574@example
5575(use-modules (guix) (gnu))
5576
5577(define %my-base-services
5578 ;; Replace the default nscd service with one that knows
5579 ;; about nss-mdns.
5580 (map (lambda (mservice)
5581 ;; "Bind" the MSERVICE monadic value to inspect it.
5582 (mlet %store-monad ((service mservice))
5583 (if (member 'nscd (service-provision service))
5584 (nscd-service (nscd-configuration)
5585 #:name-services (list nss-mdns))
5586 mservice)))
5587 %base-services))
5588@end example
5589
5590@noindent
5591@dots{} and then refer to @var{%my-base-services} instead of
5592@var{%base-services} in the @code{operating-system} declaration.
15137a29 5593Lastly, this relies on the availability of the Avahi service
965a7332 5594(@pxref{Networking Services, @code{avahi-service}}).
15137a29
LC
5595
5596For convenience, the following variables provide typical NSS
5597configurations.
5598
5599@defvr {Scheme Variable} %default-nss
5600This is the default name service switch configuration, a
5601@code{name-service-switch} object.
5602@end defvr
5603
5604@defvr {Scheme Variable} %mdns-host-lookup-nss
5605This is the name service switch configuration with support for host name
5606lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
5607@end defvr
4c9050c6 5608
996ed739
LC
5609The reference for name service switch configuration is given below. It
5610is a direct mapping of the C library's configuration file format, so
5611please refer to the C library manual for more information (@pxref{NSS
5612Configuration File,,, libc, The GNU C Library Reference Manual}).
5613Compared to libc's NSS configuration file format, it has the advantage
5614not only of adding this warm parenthetic feel that we like, but also
5615static checks: you'll know about syntax errors and typos as soon as you
5616run @command{guix system}.
5617
996ed739
LC
5618@deftp {Data Type} name-service-switch
5619
5620This is the data type representation the configuration of libc's name
5621service switch (NSS). Each field below represents one of the supported
5622system databases.
5623
5624@table @code
5625@item aliases
5626@itemx ethers
5627@itemx group
5628@itemx gshadow
5629@itemx hosts
5630@itemx initgroups
5631@itemx netgroup
5632@itemx networks
5633@itemx password
5634@itemx public-key
5635@itemx rpc
5636@itemx services
5637@itemx shadow
5638The system databases handled by the NSS. Each of these fields must be a
5639list of @code{<name-service>} objects (see below.)
5640@end table
5641@end deftp
5642
5643@deftp {Data Type} name-service
5644
5645This is the data type representing an actual name service and the
5646associated lookup action.
5647
5648@table @code
5649@item name
5650A string denoting the name service (@pxref{Services in the NSS
5651configuration,,, libc, The GNU C Library Reference Manual}).
5652
4aee6e60
LC
5653Note that name services listed here must be visible to nscd. This is
5654achieved by passing the @code{#:name-services} argument to
5655@code{nscd-service} the list of packages providing the needed name
5656services (@pxref{Base Services, @code{nscd-service}}).
5657
996ed739
LC
5658@item reaction
5659An action specified using the @code{lookup-specification} macro
5660(@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
5661Reference Manual}). For example:
5662
5663@example
5664(lookup-specification (unavailable => continue)
5665 (success => return))
5666@end example
5667@end table
5668@end deftp
0ae8c15a 5669
fd1b1fa2
LC
5670@node Initial RAM Disk
5671@subsection Initial RAM Disk
5672
5673@cindex initial RAM disk (initrd)
5674@cindex initrd (initial RAM disk)
5675For bootstrapping purposes, the Linux-Libre kernel is passed an
5676@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
5677root file system, as well as an initialization script. The latter is
5678responsible for mounting the real root file system, and for loading any
5679kernel modules that may be needed to achieve that.
5680
5681The @code{initrd} field of an @code{operating-system} declaration allows
5682you to specify which initrd you would like to use. The @code{(gnu
5683system linux-initrd)} module provides two ways to build an initrd: the
5684high-level @code{base-initrd} procedure, and the low-level
5685@code{expression->initrd} procedure.
5686
5687The @code{base-initrd} procedure is intended to cover most common uses.
5688For example, if you want to add a bunch of kernel modules to be loaded
5689at boot time, you can define the @code{initrd} field of the operating
5690system declaration like this:
5691
5692@example
52ac153e 5693(initrd (lambda (file-systems . rest)
027981d6
LC
5694 ;; Create a standard initrd that has modules "foo.ko"
5695 ;; and "bar.ko", as well as their dependencies, in
5696 ;; addition to the modules available by default.
52ac153e 5697 (apply base-initrd file-systems
027981d6 5698 #:extra-modules '("foo" "bar")
52ac153e 5699 rest)))
fd1b1fa2
LC
5700@end example
5701
52ac153e
LC
5702The @code{base-initrd} procedure also handles common use cases that
5703involves using the system as a QEMU guest, or as a ``live'' system whose
5704root file system is volatile.
fd1b1fa2
LC
5705
5706@deffn {Monadic Procedure} base-initrd @var{file-systems} @
5707 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 5708 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
5709Return a monadic derivation that builds a generic initrd. @var{file-systems} is
5710a list of file-systems to be mounted by the initrd, possibly in addition to
5711the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
5712@var{mapped-devices} is a list of device mappings to realize before
5713@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
5714
5715When @var{qemu-networking?} is true, set up networking with the standard QEMU
5716parameters. When @var{virtio?} is true, load additional modules so the initrd can
5717be used as a QEMU guest with para-virtualized I/O drivers.
5718
5719When @var{volatile-root?} is true, the root file system is writable but any changes
5720to it are lost.
5721
5722The initrd is automatically populated with all the kernel modules necessary
5723for @var{file-systems} and for the given options. However, additional kernel
5724modules can be listed in @var{extra-modules}. They will be added to the initrd, and
5725loaded at boot time in the order in which they appear.
5726@end deffn
5727
5728Needless to say, the initrds we produce and use embed a
5729statically-linked Guile, and the initialization program is a Guile
5730program. That gives a lot of flexibility. The
5731@code{expression->initrd} procedure builds such an initrd, given the
5732program to run in that initrd.
5733
5734@deffn {Monadic Procedure} expression->initrd @var{exp} @
5735 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 5736 [#:modules '()]
fd1b1fa2
LC
5737Return a derivation that builds a Linux initrd (a gzipped cpio archive)
5738containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
5739upon booting. All the derivations referenced by @var{exp} are
5740automatically copied to the initrd.
fd1b1fa2 5741
42d10464
LC
5742@var{modules} is a list of Guile module names to be embedded in the
5743initrd.
fd1b1fa2
LC
5744@end deffn
5745
88faf933
LC
5746@node GRUB Configuration
5747@subsection GRUB Configuration
5748
5749@cindex GRUB
5750@cindex boot loader
5751
5752The operating system uses GNU@tie{}GRUB as its boot loader
5753(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
5754configured using @code{grub-configuration} declarations. This data type
5755is exported by the @code{(gnu system grub)} module, and described below.
5756
5757@deftp {Data Type} grub-configuration
5758The type of a GRUB configuration declaration.
5759
5760@table @asis
5761
5762@item @code{device}
5763This is a string denoting the boot device. It must be a device name
5764understood by the @command{grub-install} command, such as
5765@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
5766GNU GRUB Manual}).
5767
5768@item @code{menu-entries} (default: @code{()})
5769A possibly empty list of @code{menu-entry} objects (see below), denoting
5770entries to appear in the GRUB boot menu, in addition to the current
5771system entry and the entry pointing to previous system generations.
5772
5773@item @code{default-entry} (default: @code{0})
5774The index of the default boot menu entry. Index 0 is for the current
5775system's entry.
5776
5777@item @code{timeout} (default: @code{5})
5778The number of seconds to wait for keyboard input before booting. Set to
57790 to boot immediately, and to -1 to wait indefinitely.
5780
5781@item @code{theme} (default: @var{%default-theme})
5782The @code{grub-theme} object describing the theme to use.
5783@end table
5784
5785@end deftp
5786
5787Should you want to list additional boot menu entries @i{via} the
5788@code{menu-entries} field above, you will need to create them with the
5789@code{menu-entry} form:
5790
5791@deftp {Data Type} menu-entry
5792The type of an entry in the GRUB boot menu.
5793
5794@table @asis
5795
5796@item @code{label}
35ed9306 5797The label to show in the menu---e.g., @code{"GNU"}.
88faf933
LC
5798
5799@item @code{linux}
5800The Linux kernel to boot.
5801
5802@item @code{linux-arguments} (default: @code{()})
5803The list of extra Linux kernel command-line arguments---e.g.,
5804@code{("console=ttyS0")}.
5805
5806@item @code{initrd}
5807A G-Expression or string denoting the file name of the initial RAM disk
5808to use (@pxref{G-Expressions}).
5809
5810@end table
5811@end deftp
5812
5813@c FIXME: Write documentation once it's stable.
5814Themes are created using the @code{grub-theme} form, which is not
5815documented yet.
5816
5817@defvr {Scheme Variable} %default-theme
5818This is the default GRUB theme used by the operating system, with a
5819fancy background image displaying the GNU and Guix logos.
5820@end defvr
5821
5822
cf4a9129
LC
5823@node Invoking guix system
5824@subsection Invoking @code{guix system}
0918e64a 5825
cf4a9129
LC
5826Once you have written an operating system declaration, as seen in the
5827previous section, it can be @dfn{instantiated} using the @command{guix
5828system} command. The synopsis is:
4af2447e 5829
cf4a9129
LC
5830@example
5831guix system @var{options}@dots{} @var{action} @var{file}
5832@end example
4af2447e 5833
cf4a9129
LC
5834@var{file} must be the name of a file containing an
5835@code{operating-system} declaration. @var{action} specifies how the
5836operating system is instantiate. Currently the following values are
5837supported:
4af2447e 5838
cf4a9129
LC
5839@table @code
5840@item reconfigure
5841Build the operating system described in @var{file}, activate it, and
5842switch to it@footnote{This action is usable only on systems already
5843running GNU.}.
4af2447e 5844
cf4a9129
LC
5845This effects all the configuration specified in @var{file}: user
5846accounts, system services, global package list, setuid programs, etc.
4af2447e 5847
cf4a9129
LC
5848It also adds a GRUB menu entry for the new OS configuration, and moves
5849entries for older configurations to a submenu---unless
5850@option{--no-grub} is passed.
4af2447e 5851
bf2479c7
LC
5852@c The paragraph below refers to the problem discussed at
5853@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
5854It is highly recommended to run @command{guix pull} once before you run
5855@command{guix system reconfigure} for the first time (@pxref{Invoking
5856guix pull}). Failing to do that you would see an older version of Guix
5857once @command{reconfigure} has completed.
5858
cf4a9129
LC
5859@item build
5860Build the operating system's derivation, which includes all the
5861configuration files and programs needed to boot and run the system.
5862This action does not actually install anything.
113daf62 5863
cf4a9129
LC
5864@item init
5865Populate the given directory with all the files necessary to run the
5866operating system specified in @var{file}. This is useful for first-time
4705641f 5867installations of GuixSD. For instance:
113daf62
LC
5868
5869@example
cf4a9129 5870guix system init my-os-config.scm /mnt
113daf62
LC
5871@end example
5872
cf4a9129
LC
5873copies to @file{/mnt} all the store items required by the configuration
5874specified in @file{my-os-config.scm}. This includes configuration
5875files, packages, and so on. It also creates other essential files
5876needed for the system to operate correctly---e.g., the @file{/etc},
5877@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 5878
cf4a9129
LC
5879This command also installs GRUB on the device specified in
5880@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 5881
cf4a9129
LC
5882@item vm
5883@cindex virtual machine
0276f697 5884@cindex VM
cf4a9129
LC
5885Build a virtual machine that contain the operating system declared in
5886@var{file}, and return a script to run that virtual machine (VM).
810568b3 5887Arguments given to the script are passed as is to QEMU.
113daf62 5888
cf4a9129 5889The VM shares its store with the host system.
113daf62 5890
0276f697
LC
5891Additional file systems can be shared between the host and the VM using
5892the @code{--share} and @code{--expose} command-line options: the former
5893specifies a directory to be shared with write access, while the latter
5894provides read-only access to the shared directory.
5895
5896The example below creates a VM in which the user's home directory is
5897accessible read-only, and where the @file{/exchange} directory is a
5898read-write mapping of the host's @file{$HOME/tmp}:
5899
5900@example
5901guix system vm my-config.scm \
5902 --expose=$HOME --share=$HOME/tmp=/exchange
5903@end example
5904
6aa260af
LC
5905On GNU/Linux, the default is to boot directly to the kernel; this has
5906the advantage of requiring only a very tiny root disk image since the
5907host's store can then be mounted.
5908
5909The @code{--full-boot} option forces a complete boot sequence, starting
5910with the bootloader. This requires more disk space since a root image
5911containing at least the kernel, initrd, and bootloader data files must
5912be created. The @code{--image-size} option can be used to specify the
5913image's size.
ab11f0be 5914
cf4a9129
LC
5915@item vm-image
5916@itemx disk-image
5917Return a virtual machine or disk image of the operating system declared
5918in @var{file} that stands alone. Use the @option{--image-size} option
5919to specify the size of the image.
113daf62 5920
cf4a9129
LC
5921When using @code{vm-image}, the returned image is in qcow2 format, which
5922the QEMU emulator can efficiently use.
113daf62 5923
cf4a9129
LC
5924When using @code{disk-image}, a raw disk image is produced; it can be
5925copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
5926the device corresponding to a USB stick, one can copy the image on it
5927using the following command:
113daf62 5928
cf4a9129
LC
5929@example
5930# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
5931@end example
113daf62 5932
cf4a9129 5933@end table
113daf62 5934
cf4a9129
LC
5935@var{options} can contain any of the common build options provided by
5936@command{guix build} (@pxref{Invoking guix build}). In addition,
5937@var{options} can contain one of the following:
113daf62 5938
cf4a9129
LC
5939@table @option
5940@item --system=@var{system}
5941@itemx -s @var{system}
5942Attempt to build for @var{system} instead of the host's system type.
5943This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 5944
cf4a9129
LC
5945@item --image-size=@var{size}
5946For the @code{vm-image} and @code{disk-image} actions, create an image
5947of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
5948include a unit as a suffix (@pxref{Block size, size specifications,,
5949coreutils, GNU Coreutils}).
113daf62 5950@end table
113daf62 5951
cf4a9129
LC
5952Note that all the actions above, except @code{build} and @code{init},
5953rely on KVM support in the Linux-Libre kernel. Specifically, the
5954machine should have hardware virtualization support, the corresponding
5955KVM kernel module should be loaded, and the @file{/dev/kvm} device node
5956must exist and be readable and writable by the user and by the daemon's
5957build users.
8451a568 5958
cf4a9129
LC
5959@node Defining Services
5960@subsection Defining Services
8451a568 5961
cf4a9129
LC
5962The @code{(gnu services @dots{})} modules define several procedures that allow
5963users to declare the operating system's services (@pxref{Using the
5964Configuration System}). These procedures are @emph{monadic
5965procedures}---i.e., procedures that return a monadic value in the store
5966monad (@pxref{The Store Monad}). For examples of such procedures,
5967@xref{Services}.
8451a568 5968
cf4a9129
LC
5969@cindex service definition
5970The monadic value returned by those procedures is a @dfn{service
5971definition}---a structure as returned by the @code{service} form.
5972Service definitions specifies the inputs the service depends on, and an
5973expression to start and stop the service. Behind the scenes, service
5974definitions are ``translated'' into the form suitable for the
5975configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
5976dmd Manual}).
8451a568 5977
cf4a9129
LC
5978As an example, here is what the @code{nscd-service} procedure looks
5979like:
8451a568 5980
cf4a9129
LC
5981@lisp
5982(define (nscd-service)
5983 (with-monad %store-monad
5984 (return (service
5985 (documentation "Run libc's name service cache daemon.")
5986 (provision '(nscd))
5987 (activate #~(begin
5988 (use-modules (guix build utils))
5989 (mkdir-p "/var/run/nscd")))
5990 (start #~(make-forkexec-constructor
5991 (string-append #$glibc "/sbin/nscd")
5992 "-f" "/dev/null" "--foreground"))
5993 (stop #~(make-kill-destructor))
5994 (respawn? #f)))))
5995@end lisp
8451a568 5996
cf4a9129
LC
5997@noindent
5998The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
5999(@pxref{G-Expressions}). The @code{activate} field contains a script to
6000run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
6001directory exists before @command{nscd} is started.
8451a568 6002
cf4a9129
LC
6003The @code{start} and @code{stop} fields refer to dmd's facilities to
6004start and stop processes (@pxref{Service De- and Constructors,,, dmd,
6005GNU dmd Manual}). The @code{provision} field specifies the name under
6006which this service is known to dmd, and @code{documentation} specifies
6007on-line documentation. Thus, the commands @command{deco start ncsd},
6008@command{deco stop nscd}, and @command{deco doc nscd} will do what you
6009would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 6010
8451a568 6011
cf4a9129
LC
6012@node Installing Debugging Files
6013@section Installing Debugging Files
8451a568 6014
cf4a9129
LC
6015@cindex debugging files
6016Program binaries, as produced by the GCC compilers for instance, are
6017typically written in the ELF format, with a section containing
6018@dfn{debugging information}. Debugging information is what allows the
6019debugger, GDB, to map binary code to source code; it is required to
6020debug a compiled program in good conditions.
8451a568 6021
cf4a9129
LC
6022The problem with debugging information is that is takes up a fair amount
6023of disk space. For example, debugging information for the GNU C Library
6024weighs in at more than 60 MiB. Thus, as a user, keeping all the
6025debugging info of all the installed programs is usually not an option.
6026Yet, space savings should not come at the cost of an impediment to
6027debugging---especially in the GNU system, which should make it easier
6028for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 6029
cf4a9129
LC
6030Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
6031mechanism that allows users to get the best of both worlds: debugging
6032information can be stripped from the binaries and stored in separate
6033files. GDB is then able to load debugging information from those files,
6034when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
6035with GDB}).
8451a568 6036
cf4a9129
LC
6037The GNU distribution takes advantage of this by storing debugging
6038information in the @code{lib/debug} sub-directory of a separate package
6039output unimaginatively called @code{debug} (@pxref{Packages with
6040Multiple Outputs}). Users can choose to install the @code{debug} output
6041of a package when they need it. For instance, the following command
6042installs the debugging information for the GNU C Library and for GNU
6043Guile:
8451a568
LC
6044
6045@example
cf4a9129 6046guix package -i glibc:debug guile:debug
8451a568
LC
6047@end example
6048
cf4a9129
LC
6049GDB must then be told to look for debug files in the user's profile, by
6050setting the @code{debug-file-directory} variable (consider setting it
6051from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
6052GDB}):
8451a568 6053
cf4a9129
LC
6054@example
6055(gdb) set debug-file-directory ~/.guix-profile/lib/debug
6056@end example
8451a568 6057
cf4a9129
LC
6058From there on, GDB will pick up debugging information from the
6059@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 6060
cf4a9129
LC
6061In addition, you will most likely want GDB to be able to show the source
6062code being debugged. To do that, you will have to unpack the source
6063code of the package of interest (obtained with @code{guix build
6064--source}, @pxref{Invoking guix build}), and to point GDB to that source
6065directory using the @code{directory} command (@pxref{Source Path,
6066@code{directory},, gdb, Debugging with GDB}).
8451a568 6067
cf4a9129
LC
6068@c XXX: keep me up-to-date
6069The @code{debug} output mechanism in Guix is implemented by the
6070@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
6071opt-in---debugging information is available only for those packages
6072whose definition explicitly declares a @code{debug} output. This may be
6073changed to opt-out in the future, if our build farm servers can handle
6074the load. To check whether a package has a @code{debug} output, use
6075@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 6076
8451a568 6077
05962f29
LC
6078@node Security Updates
6079@section Security Updates
6080
843858b8
LC
6081@quotation Note
6082As of version @value{VERSION}, the feature described in this section is
6083experimental.
6084@end quotation
05962f29
LC
6085
6086@cindex security updates
6087Occasionally, important security vulnerabilities are discovered in core
6088software packages and must be patched. Guix follows a functional
6089package management discipline (@pxref{Introduction}), which implies
6090that, when a package is changed, @emph{every package that depends on it}
6091must be rebuilt. This can significantly slow down the deployment of
6092fixes in core packages such as libc or Bash, since basically the whole
6093distribution would need to be rebuilt. Using pre-built binaries helps
6094(@pxref{Substitutes}), but deployment may still take more time than
6095desired.
6096
6097@cindex grafts
6098To address that, Guix implements @dfn{grafts}, a mechanism that allows
6099for fast deployment of critical updates without the costs associated
6100with a whole-distribution rebuild. The idea is to rebuild only the
6101package that needs to be patched, and then to ``graft'' it onto packages
6102explicitly installed by the user and that were previously referring to
6103the original package. The cost of grafting is typically very low, and
6104order of magnitudes lower than a full rebuild of the dependency chain.
6105
6106@cindex replacements of packages, for grafts
6107For instance, suppose a security update needs to be applied to Bash.
6108Guix developers will provide a package definition for the ``fixed''
6109Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
6110Packages}). Then, the original package definition is augmented with a
6111@code{replacement} field pointing to the package containing the bug fix:
6112
6113@example
6114(define bash
6115 (package
6116 (name "bash")
6117 ;; @dots{}
6118 (replacement bash-fixed)))
6119@end example
6120
6121From there on, any package depending directly or indirectly on Bash that
6122is installed will automatically be ``rewritten'' to refer to
6123@var{bash-fixed} instead of @var{bash}. This grafting process takes
6124time proportional to the size of the package, but expect less than a
6125minute for an ``average'' package on a recent machine.
6126
6127Currently, the graft and the package it replaces (@var{bash-fixed} and
6128@var{bash} in the example above) must have the exact same @code{name}
6129and @code{version} fields. This restriction mostly comes from the fact
6130that grafting works by patching files, including binary files, directly.
6131Other restrictions may apply: for instance, when adding a graft to a
6132package providing a shared library, the original shared library and its
6133replacement must have the same @code{SONAME} and be binary-compatible.
6134
6135
cf4a9129
LC
6136@node Package Modules
6137@section Package Modules
8451a568 6138
cf4a9129
LC
6139From a programming viewpoint, the package definitions of the
6140GNU distribution are provided by Guile modules in the @code{(gnu packages
6141@dots{})} name space@footnote{Note that packages under the @code{(gnu
6142packages @dots{})} module name space are not necessarily ``GNU
6143packages''. This module naming scheme follows the usual Guile module
6144naming convention: @code{gnu} means that these modules are distributed
6145as part of the GNU system, and @code{packages} identifies modules that
6146define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
6147Reference Manual}). For instance, the @code{(gnu packages emacs)}
6148module exports a variable named @code{emacs}, which is bound to a
6149@code{<package>} object (@pxref{Defining Packages}).
113daf62 6150
300868ba 6151The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
6152automatically scanned for packages by the command-line tools. For
6153instance, when running @code{guix package -i emacs}, all the @code{(gnu
6154packages @dots{})} modules are scanned until one that exports a package
6155object whose name is @code{emacs} is found. This package search
6156facility is implemented in the @code{(gnu packages)} module.
113daf62 6157
300868ba 6158@cindex customization, of packages
8689901f 6159@cindex package module search path
cf4a9129 6160Users can store package definitions in modules with different
60142854 6161names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
c95ded7e
LC
6162name and module name must match. For instance, the @code{(my-packages
6163emacs)} module must be stored in a @file{my-packages/emacs.scm} file
6164relative to the load path specified with @option{--load-path} or
6165@code{GUIX_PACKAGE_PATH}. @xref{Modules and the File System,,,
6166guile, GNU Guile Reference Manual}, for details.}. These package definitions
300868ba
LC
6167will not be visible by default. Thus, users can invoke commands such as
6168@command{guix package} and @command{guix build} have to be used with the
c95ded7e
LC
6169@code{-e} option so that they know where to find the package. Better
6170yet, they can use the
300868ba 6171@code{-L} option of these commands to make those modules visible
8689901f
LC
6172(@pxref{Invoking guix build, @code{--load-path}}), or define the
6173@code{GUIX_PACKAGE_PATH} environment variable. This environment
6174variable makes it easy to extend or customize the distribution and is
6175honored by all the user interfaces.
6176
6177@defvr {Environment Variable} GUIX_PACKAGE_PATH
6178This is a colon-separated list of directories to search for package
6179modules. Directories listed in this variable take precedence over the
6180distribution's own modules.
6181@end defvr
ef5dd60a 6182
cf4a9129
LC
6183The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
6184each package is built based solely on other packages in the
6185distribution. The root of this dependency graph is a small set of
6186@dfn{bootstrap binaries}, provided by the @code{(gnu packages
6187bootstrap)} module. For more information on bootstrapping,
081145cf 6188@pxref{Bootstrapping}.
ef5dd60a 6189
cf4a9129
LC
6190@node Packaging Guidelines
6191@section Packaging Guidelines
ef5dd60a 6192
cf4a9129
LC
6193The GNU distribution is nascent and may well lack some of your favorite
6194packages. This section describes how you can help make the distribution
6195grow. @xref{Contributing}, for additional information on how you can
6196help.
ef5dd60a 6197
cf4a9129
LC
6198Free software packages are usually distributed in the form of
6199@dfn{source code tarballs}---typically @file{tar.gz} files that contain
6200all the source files. Adding a package to the distribution means
6201essentially two things: adding a @dfn{recipe} that describes how to
6202build the package, including a list of other packages required to build
6203it, and adding @dfn{package meta-data} along with that recipe, such as a
6204description and licensing information.
ef5dd60a 6205
cf4a9129
LC
6206In Guix all this information is embodied in @dfn{package definitions}.
6207Package definitions provide a high-level view of the package. They are
6208written using the syntax of the Scheme programming language; in fact,
6209for each package we define a variable bound to the package definition,
6210and export that variable from a module (@pxref{Package Modules}).
6211However, in-depth Scheme knowledge is @emph{not} a prerequisite for
6212creating packages. For more information on package definitions,
081145cf 6213@pxref{Defining Packages}.
ef5dd60a 6214
cf4a9129
LC
6215Once a package definition is in place, stored in a file in the Guix
6216source tree, it can be tested using the @command{guix build} command
6217(@pxref{Invoking guix build}). For example, assuming the new package is
6218called @code{gnew}, you may run this command from the Guix build tree:
ef5dd60a
LC
6219
6220@example
cf4a9129 6221./pre-inst-env guix build gnew --keep-failed
ef5dd60a 6222@end example
ef5dd60a 6223
cf4a9129
LC
6224Using @code{--keep-failed} makes it easier to debug build failures since
6225it provides access to the failed build tree. Another useful
6226command-line option when debugging is @code{--log-file}, to access the
6227build log.
ef5dd60a 6228
cf4a9129
LC
6229If the package is unknown to the @command{guix} command, it may be that
6230the source file contains a syntax error, or lacks a @code{define-public}
6231clause to export the package variable. To figure it out, you may load
6232the module from Guile to get more information about the actual error:
ef5dd60a 6233
cf4a9129
LC
6234@example
6235./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
6236@end example
ef5dd60a 6237
cf4a9129
LC
6238Once your package builds correctly, please send us a patch
6239(@pxref{Contributing}). Well, if you need help, we will be happy to
6240help you too. Once the patch is committed in the Guix repository, the
6241new package automatically gets built on the supported platforms by
2b1cee21 6242@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 6243system}.
ef5dd60a 6244
cf4a9129
LC
6245@cindex substituter
6246Users can obtain the new package definition simply by running
6247@command{guix pull} (@pxref{Invoking guix pull}). When
6248@code{hydra.gnu.org} is done building the package, installing the
6249package automatically downloads binaries from there
6250(@pxref{Substitutes}). The only place where human intervention is
6251needed is to review and apply the patch.
ef5dd60a 6252
ef5dd60a 6253
cf4a9129 6254@menu
ec0339cd
LC
6255* Software Freedom:: What may go into the distribution.
6256* Package Naming:: What's in a name?
6257* Version Numbers:: When the name is not enough.
6258* Python Modules:: Taming the snake.
6259* Perl Modules:: Little pearls.
6260* Fonts:: Fond of fonts.
cf4a9129 6261@end menu
ef5dd60a 6262
cf4a9129
LC
6263@node Software Freedom
6264@subsection Software Freedom
ef5dd60a 6265
cf4a9129 6266@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 6267
cf4a9129
LC
6268The GNU operating system has been developed so that users can have
6269freedom in their computing. GNU is @dfn{free software}, meaning that
6270users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
6271essential freedoms}: to run the program, to study and change the program
6272in source code form, to redistribute exact copies, and to distribute
6273modified versions. Packages found in the GNU distribution provide only
6274software that conveys these four freedoms.
c11a6eb1 6275
cf4a9129
LC
6276In addition, the GNU distribution follow the
6277@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
6278software distribution guidelines}. Among other things, these guidelines
6279reject non-free firmware, recommendations of non-free software, and
6280discuss ways to deal with trademarks and patents.
ef5dd60a 6281
cf4a9129
LC
6282Some packages contain a small and optional subset that violates the
6283above guidelines, for instance because this subset is itself non-free
6284code. When that happens, the offending items are removed with
6285appropriate patches or code snippets in the package definition's
6286@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
6287build --source} returns the ``freed'' source rather than the unmodified
6288upstream source.
ef5dd60a 6289
ef5dd60a 6290
cf4a9129
LC
6291@node Package Naming
6292@subsection Package Naming
ef5dd60a 6293
cf4a9129
LC
6294A package has actually two names associated with it:
6295First, there is the name of the @emph{Scheme variable}, the one following
6296@code{define-public}. By this name, the package can be made known in the
6297Scheme code, for instance as input to another package. Second, there is
6298the string in the @code{name} field of a package definition. This name
6299is used by package management commands such as
6300@command{guix package} and @command{guix build}.
ef5dd60a 6301
cf4a9129
LC
6302Both are usually the same and correspond to the lowercase conversion of
6303the project name chosen upstream, with underscores replaced with
6304hyphens. For instance, GNUnet is available as @code{gnunet}, and
6305SDL_net as @code{sdl-net}.
927097ef 6306
cf4a9129 6307We do not add @code{lib} prefixes for library packages, unless these are
081145cf 6308already part of the official project name. But @pxref{Python
cf4a9129
LC
6309Modules} and @ref{Perl Modules} for special rules concerning modules for
6310the Python and Perl languages.
927097ef 6311
1b366ee4 6312Font package names are handled differently, @pxref{Fonts}.
7fec52b7 6313
ef5dd60a 6314
cf4a9129
LC
6315@node Version Numbers
6316@subsection Version Numbers
ef5dd60a 6317
cf4a9129
LC
6318We usually package only the latest version of a given free software
6319project. But sometimes, for instance for incompatible library versions,
6320two (or more) versions of the same package are needed. These require
6321different Scheme variable names. We use the name as defined
6322in @ref{Package Naming}
6323for the most recent version; previous versions use the same name, suffixed
6324by @code{-} and the smallest prefix of the version number that may
6325distinguish the two versions.
ef5dd60a 6326
cf4a9129
LC
6327The name inside the package definition is the same for all versions of a
6328package and does not contain any version number.
ef5dd60a 6329
cf4a9129 6330For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 6331
cf4a9129
LC
6332@example
6333(define-public gtk+
6334 (package
6335 (name "gtk+")
6336 (version "3.9.12")
6337 ...))
6338(define-public gtk+-2
6339 (package
6340 (name "gtk+")
6341 (version "2.24.20")
6342 ...))
6343@end example
6344If we also wanted GTK+ 3.8.2, this would be packaged as
6345@example
6346(define-public gtk+-3.8
6347 (package
6348 (name "gtk+")
6349 (version "3.8.2")
6350 ...))
6351@end example
ef5dd60a 6352
ef5dd60a 6353
cf4a9129
LC
6354@node Python Modules
6355@subsection Python Modules
ef5dd60a 6356
cf4a9129
LC
6357We currently package Python 2 and Python 3, under the Scheme variable names
6358@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
6359To avoid confusion and naming clashes with other programming languages, it
6360seems desirable that the name of a package for a Python module contains
6361the word @code{python}.
ef5dd60a 6362
cf4a9129
LC
6363Some modules are compatible with only one version of Python, others with both.
6364If the package Foo compiles only with Python 3, we name it
6365@code{python-foo}; if it compiles only with Python 2, we name it
6366@code{python2-foo}. If it is compatible with both versions, we create two
6367packages with the corresponding names.
ef5dd60a 6368
cf4a9129
LC
6369If a project already contains the word @code{python}, we drop this;
6370for instance, the module python-dateutil is packaged under the names
6371@code{python-dateutil} and @code{python2-dateutil}.
113daf62 6372
523e4896 6373
cf4a9129
LC
6374@node Perl Modules
6375@subsection Perl Modules
523e4896 6376
cf4a9129
LC
6377Perl programs standing for themselves are named as any other package,
6378using the lowercase upstream name.
6379For Perl packages containing a single class, we use the lowercase class name,
6380replace all occurrences of @code{::} by dashes and prepend the prefix
6381@code{perl-}.
6382So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
6383Modules containing several classes keep their lowercase upstream name and
6384are also prepended by @code{perl-}. Such modules tend to have the word
6385@code{perl} somewhere in their name, which gets dropped in favor of the
6386prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 6387
523e4896 6388
7fec52b7
AE
6389@node Fonts
6390@subsection Fonts
6391
6392For fonts that are in general not installed by a user for typesetting
6393purposes, or that are distributed as part of a larger software package,
6394we rely on the general packaging rules for software; for instance, this
6395applies to the fonts delivered as part of the X.Org system or fonts that
6396are part of TeX Live.
6397
6398To make it easier for a user to search for fonts, names for other packages
6399containing only fonts are constructed as follows, independently of the
6400upstream package name.
6401
6402The name of a package containing only one font family starts with
6403@code{font-}; it is followed by the foundry name and a dash @code{-}
6404if the foundry is known, and the font family name, in which spaces are
6405replaced by dashes (and as usual, all upper case letters are transformed
6406to lower case).
6407For example, the Gentium font family by SIL is packaged under the name
6408@code{font-sil-gentium}.
6409
6410For a package containing several font families, the name of the collection
6411is used in the place of the font family name.
6412For instance, the Liberation fonts consist of three families,
6413Liberation Sans, Liberation Serif and Liberation Mono.
6414These could be packaged separately under the names
6415@code{font-liberation-sans} and so on; but as they are distributed together
6416under a common name, we prefer to package them together as
6417@code{font-liberation}.
6418
6419In the case where several formats of the same font family or font collection
6420are packaged separately, a short form of the format, prepended by a dash,
6421is added to the package name. We use @code{-ttf} for TrueType fonts,
1b366ee4 6422@code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
7fec52b7
AE
6423fonts.
6424
6425
b25937e3 6426
cf4a9129
LC
6427@node Bootstrapping
6428@section Bootstrapping
b25937e3 6429
cf4a9129 6430@c Adapted from the ELS 2013 paper.
b25937e3 6431
cf4a9129 6432@cindex bootstrapping
7889394e 6433
cf4a9129
LC
6434Bootstrapping in our context refers to how the distribution gets built
6435``from nothing''. Remember that the build environment of a derivation
6436contains nothing but its declared inputs (@pxref{Introduction}). So
6437there's an obvious chicken-and-egg problem: how does the first package
6438get built? How does the first compiler get compiled? Note that this is
6439a question of interest only to the curious hacker, not to the regular
6440user, so you can shamelessly skip this section if you consider yourself
6441a ``regular user''.
72b9d60d 6442
cf4a9129
LC
6443@cindex bootstrap binaries
6444The GNU system is primarily made of C code, with libc at its core. The
6445GNU build system itself assumes the availability of a Bourne shell and
6446command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
6447`grep'. Furthermore, build programs---programs that run
6448@code{./configure}, @code{make}, etc.---are written in Guile Scheme
6449(@pxref{Derivations}). Consequently, to be able to build anything at
6450all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
6451Binutils, libc, and the other packages mentioned above---the
6452@dfn{bootstrap binaries}.
72b9d60d 6453
cf4a9129
LC
6454These bootstrap binaries are ``taken for granted'', though we can also
6455re-create them if needed (more on that later).
72b9d60d 6456
cf4a9129 6457@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 6458
cf4a9129
LC
6459@c As of Emacs 24.3, Info-mode displays the image, but since it's a
6460@c large image, it's hard to scroll. Oh well.
6461@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 6462
cf4a9129
LC
6463The figure above shows the very beginning of the dependency graph of the
6464distribution, corresponding to the package definitions of the @code{(gnu
6465packages bootstrap)} module. At this level of detail, things are
6466slightly complex. First, Guile itself consists of an ELF executable,
6467along with many source and compiled Scheme files that are dynamically
6468loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
6469tarball shown in this graph. This tarball is part of Guix's ``source''
6470distribution, and gets inserted into the store with @code{add-to-store}
6471(@pxref{The Store}).
2e7b5cea 6472
cf4a9129
LC
6473But how do we write a derivation that unpacks this tarball and adds it
6474to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
6475derivation---the first one that gets built---uses @code{bash} as its
6476builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
6477@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
6478@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
6479the Guix source distribution, whose sole purpose is to allow the Guile
6480tarball to be unpacked.
fb729425 6481
cf4a9129
LC
6482Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
6483Guile that can be used to run subsequent build programs. Its first task
6484is to download tarballs containing the other pre-built binaries---this
6485is what the @code{.tar.xz.drv} derivations do. Guix modules such as
6486@code{ftp-client.scm} are used for this purpose. The
6487@code{module-import.drv} derivations import those modules in a directory
6488in the store, using the original layout. The
6489@code{module-import-compiled.drv} derivations compile those modules, and
6490write them in an output directory with the right layout. This
6491corresponds to the @code{#:modules} argument of
6492@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 6493
cf4a9129
LC
6494Finally, the various tarballs are unpacked by the
6495derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
6496etc., at which point we have a working C tool chain.
fb729425 6497
fb729425 6498
cf4a9129 6499@unnumberedsubsec Building the Build Tools
523e4896 6500
cf4a9129
LC
6501@c TODO: Add a package-level dependency graph generated from (gnu
6502@c packages base).
df2ce343 6503
cf4a9129
LC
6504Bootstrapping is complete when we have a full tool chain that does not
6505depend on the pre-built bootstrap tools discussed above. This
6506no-dependency requirement is verified by checking whether the files of
6507the final tool chain contain references to the @file{/gnu/store}
6508directories of the bootstrap inputs. The process that leads to this
6509``final'' tool chain is described by the package definitions found in
1f6f57df 6510the @code{(gnu packages commencement)} module.
df2ce343 6511
cf4a9129
LC
6512@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
6513The first tool that gets built with the bootstrap binaries is
6514GNU Make, which is a prerequisite for all the following packages.
6515From there Findutils and Diffutils get built.
523e4896 6516
cf4a9129
LC
6517Then come the first-stage Binutils and GCC, built as pseudo cross
6518tools---i.e., with @code{--target} equal to @code{--host}. They are
6519used to build libc. Thanks to this cross-build trick, this libc is
6520guaranteed not to hold any reference to the initial tool chain.
4af2447e 6521
cf4a9129
LC
6522From there the final Binutils and GCC are built. GCC uses @code{ld}
6523from the final Binutils, and links programs against the just-built libc.
6524This tool chain is used to build the other packages used by Guix and by
6525the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 6526
cf4a9129
LC
6527And voilà! At this point we have the complete set of build tools that
6528the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
6529variable of the @code{(gnu packages commencement)} module, and are
6530implicitly used by any package that uses @code{gnu-build-system}
1f6f57df 6531(@pxref{Build Systems, @code{gnu-build-system}}).
4af2447e 6532
4af2447e 6533
cf4a9129 6534@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 6535
cf4a9129
LC
6536Because the final tool chain does not depend on the bootstrap binaries,
6537those rarely need to be updated. Nevertheless, it is useful to have an
6538automated way to produce them, should an update occur, and this is what
6539the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 6540
cf4a9129
LC
6541The following command builds the tarballs containing the bootstrap
6542binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
6543of Coreutils and other basic command-line tools):
4b2615e1 6544
cf4a9129
LC
6545@example
6546guix build bootstrap-tarballs
6547@end example
6548
6549The generated tarballs are those that should be referred to in the
6550@code{(gnu packages bootstrap)} module mentioned at the beginning of
6551this section.
6552
6553Still here? Then perhaps by now you've started to wonder: when do we
6554reach a fixed point? That is an interesting question! The answer is
6555unknown, but if you would like to investigate further (and have
6556significant computational and storage resources to do so), then let us
6557know.
6558
6559@node Porting
6560@section Porting to a New Platform
6561
6562As discussed above, the GNU distribution is self-contained, and
6563self-containment is achieved by relying on pre-built ``bootstrap
6564binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
6565operating system kernel, CPU architecture, and application binary
6566interface (ABI). Thus, to port the distribution to a platform that is
6567not yet supported, one must build those bootstrap binaries, and update
6568the @code{(gnu packages bootstrap)} module to use them on that platform.
6569
6570Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
6571When everything goes well, and assuming the GNU tool chain supports the
6572target platform, this can be as simple as running a command like this
6573one:
6574
6575@example
6576guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
6577@end example
6578
1c0c417d
LC
6579For this to work, the @code{glibc-dynamic-linker} procedure in
6580@code{(gnu packages bootstrap)} must be augmented to return the right
6581file name for libc's dynamic linker on that platform; likewise,
6582@code{system->linux-architecture} in @code{(gnu packages linux)} must be
6583taught about the new platform.
6584
cf4a9129 6585Once these are built, the @code{(gnu packages bootstrap)} module needs
1c0c417d
LC
6586to be updated to refer to these binaries on the target platform. That
6587is, the hashes and URLs of the bootstrap tarballs for the new platform
6588must be added alongside those of the currently supported platforms. The
6589bootstrap Guile tarball is treated specially: it is expected to be
6590available locally, and @file{gnu-system.am} has rules do download it for
6591the supported architectures; a rule for the new platform must be added
6592as well.
cf4a9129
LC
6593
6594In practice, there may be some complications. First, it may be that the
6595extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
6596above) is not recognized by all the GNU tools. Typically, glibc
6597recognizes some of these, whereas GCC uses an extra @code{--with-abi}
6598configure flag (see @code{gcc.scm} for examples of how to handle this).
6599Second, some of the required packages could fail to build for that
6600platform. Lastly, the generated binaries could be broken for some
6601reason.
4af2447e
LC
6602
6603
9bf3c1a7
LC
6604@c *********************************************************************
6605@node Contributing
6606@chapter Contributing
6607
6608This project is a cooperative effort, and we need your help to make it
5ff3c4b8
PAR
6609grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
6610@code{#guix} on the Freenode IRC network. We welcome ideas, bug
6611reports, patches, and anything that may be helpful to the project. We
6612particularly welcome help on packaging (@pxref{Packaging Guidelines}).
a1ba8475 6613
9bf3c1a7
LC
6614Please see the
6615@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
6616@file{HACKING} file} that comes with the Guix source code for practical
6617details about contributions.
6618
c78bd12b 6619
568717fd
LC
6620@c *********************************************************************
6621@node Acknowledgments
6622@chapter Acknowledgments
6623
6624Guix is based on the Nix package manager, which was designed and
4c7ac9aa
LC
6625implemented by Eelco Dolstra, with contributions from other people (see
6626the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
6627management, and promoted unprecedented features, such as transactional
6628package upgrades and rollbacks, per-user profiles, and referentially
6629transparent build processes. Without this work, Guix would not exist.
6630
6631The Nix-based software distributions, Nixpkgs and NixOS, have also been
6632an inspiration for Guix.
6633
4c7ac9aa
LC
6634GNU@tie{}Guix itself is a collective work with contributions from a
6635number of people. See the @file{AUTHORS} file in Guix for more
6636information on these fine people. The @file{THANKS} file lists people
6637who have helped by reporting bugs, taking care of the infrastructure,
6638providing artwork and themes, making suggestions, and more---thank you!
6639
6640
568717fd
LC
6641@c *********************************************************************
6642@node GNU Free Documentation License
6643@appendix GNU Free Documentation License
6644
6645@include fdl-1.3.texi
6646
6647@c *********************************************************************
6648@node Concept Index
6649@unnumbered Concept Index
6650@printindex cp
6651
a85b83d2
LC
6652@node Programming Index
6653@unnumbered Programming Index
6654@syncodeindex tp fn
6655@syncodeindex vr fn
568717fd
LC
6656@printindex fn
6657
6658@bye
6659
6660@c Local Variables:
6661@c ispell-local-dictionary: "american";
6662@c End: