guix package: Adjust --help message.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
4379c35b 13Copyright @copyright{} 2012, 2013, 2014, 2015 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
87eafdbd
TUBK
15Copyright @copyright{} 2013 Nikita Karetnikov@*
16Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer
7df7a74e
NK
17
18Permission is granted to copy, distribute and/or modify this document
19under the terms of the GNU Free Documentation License, Version 1.3 or
20any later version published by the Free Software Foundation; with no
21Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
22copy of the license is included in the section entitled ``GNU Free
23Documentation License''.
24@end copying
568717fd 25
eeaf4427 26@dircategory Package management
568717fd
LC
27@direntry
28* guix: (guix). Guix, the functional package manager.
e49951eb 29* guix package: (guix)Invoking guix package
eeaf4427 30 Managing packages with Guix.
e49951eb 31* guix build: (guix)Invoking guix build
568717fd 32 Building packages with Guix.
054e8576
LC
33* guix system: (guix)Invoking guix system
34 Managing the operating system configuration.
568717fd 35@end direntry
568717fd 36
372c4bbc
DT
37@dircategory Software development
38@direntry
39* guix environment: (guix)Invoking guix environment
40 Building development environments with Guix.
41@end direntry
42
568717fd 43@titlepage
7730d112
LC
44@title GNU Guix Reference Manual
45@subtitle Using the GNU Guix Functional Package Manager
568717fd 46@author Ludovic Courtès
da7cabd4 47@author Andreas Enge
acc08466 48@author Nikita Karetnikov
568717fd
LC
49
50@page
51@vskip 0pt plus 1filll
52Edition @value{EDITION} @*
53@value{UPDATED} @*
54
7df7a74e 55@insertcopying
568717fd
LC
56@end titlepage
57
568717fd
LC
58@contents
59
60@c *********************************************************************
61@node Top
f8348b91 62@top GNU Guix
568717fd 63
f8348b91
LC
64This document describes GNU Guix version @value{VERSION}, a functional
65package management tool written for the GNU system.
568717fd
LC
66
67@menu
68* Introduction:: What is Guix about?
bd5e766b 69* Installation:: Installing Guix.
eeaf4427 70* Package Management:: Package installation, upgrade, etc.
568717fd
LC
71* Programming Interface:: Using Guix in Scheme.
72* Utilities:: Package management commands.
a1ba8475 73* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 74* Contributing:: Your help needed!
568717fd
LC
75
76* Acknowledgments:: Thanks!
77* GNU Free Documentation License:: The license of this manual.
78* Concept Index:: Concepts.
a85b83d2 79* Programming Index:: Data types, functions, and variables.
aaa3eaa9
LC
80
81@detailmenu
82 --- The Detailed Node Listing ---
83
84Installation
85
1b2b8177 86* Binary Installation:: Getting Guix running in no time!
aaa3eaa9 87* Requirements:: Software needed to build and run Guix.
ec0339cd 88* Running the Test Suite:: Testing Guix.
aaa3eaa9
LC
89* Setting Up the Daemon:: Preparing the build daemon's environment.
90* Invoking guix-daemon:: Running the build daemon.
91
92Setting Up the Daemon
93
94* Build Environment Setup:: Preparing the isolated build environment.
95* Daemon Offload Setup:: Offloading builds to remote machines.
96
97Package Management
98
99* Features:: How Guix will make your life brighter.
100* Invoking guix package:: Package installation, removal, etc.
101* Emacs Interface:: Package management from Emacs.
102* Substitutes:: Downloading pre-built binaries.
103* Packages with Multiple Outputs:: Single source package, multiple outputs.
104* Invoking guix gc:: Running the garbage collector.
105* Invoking guix pull:: Fetching the latest Guix and distribution.
106* Invoking guix archive:: Exporting and importing store files.
107
108Programming Interface
109
110* Defining Packages:: Defining new packages.
111* Build Systems:: Specifying how packages are built.
112* The Store:: Manipulating the package store.
113* Derivations:: Low-level interface to package derivations.
114* The Store Monad:: Purely functional interface to the store.
115* G-Expressions:: Manipulating build expressions.
116
117Utilities
118
119* Invoking guix build:: Building packages from the command line.
120* Invoking guix download:: Downloading a file and printing its hash.
121* Invoking guix hash:: Computing the cryptographic hash of a file.
122* Invoking guix import:: Importing package definitions.
123* Invoking guix refresh:: Updating package definitions.
124* Invoking guix lint:: Finding errors in package definitions.
125* Invoking guix environment:: Setting up development environments.
aff8ce7c 126* Invoking guix publish:: Sharing substitutes.
aaa3eaa9
LC
127
128GNU Distribution
129
130* System Installation:: Installing the whole operating system.
35ed9306 131* System Configuration:: Configuring the operating system.
aaa3eaa9
LC
132* Installing Debugging Files:: Feeding the debugger.
133* Security Updates:: Deploying security fixes quickly.
134* Package Modules:: Packages from the programmer's viewpoint.
135* Packaging Guidelines:: Growing the distribution.
136* Bootstrapping:: GNU/Linux built from scratch.
137* Porting:: Targeting another platform or kernel.
138
139System Configuration
140
141* Using the Configuration System:: Customizing your GNU system.
142* operating-system Reference:: Detail of operating-system declarations.
143* File Systems:: Configuring file system mounts.
144* Mapped Devices:: Block device extra processing.
145* User Accounts:: Specifying user accounts.
598e19dc 146* Locales:: Language and cultural convention settings.
aaa3eaa9
LC
147* Services:: Specifying system services.
148* Setuid Programs:: Programs running with root privileges.
1b2b8177 149* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 150* Name Service Switch:: Configuring libc's name service switch.
aaa3eaa9
LC
151* Initial RAM Disk:: Linux-Libre bootstrapping.
152* GRUB Configuration:: Configuring the boot loader.
153* Invoking guix system:: Instantiating a system configuration.
154* Defining Services:: Adding new service definitions.
155
156Services
157
158* Base Services:: Essential system services.
159* Networking Services:: Network setup, SSH daemon, etc.
160* X Window:: Graphical display.
1b2b8177
LC
161* Desktop Services:: D-Bus and desktop services.
162* Database Services:: SQL databases.
aa4ed923 163* Various Services:: Other services.
aaa3eaa9
LC
164
165Packaging Guidelines
166
ec0339cd
LC
167* Software Freedom:: What may go into the distribution.
168* Package Naming:: What's in a name?
169* Version Numbers:: When the name is not enough.
170* Python Modules:: Taming the snake.
171* Perl Modules:: Little pearls.
172* Fonts:: Fond of fonts.
aaa3eaa9
LC
173
174@end detailmenu
568717fd
LC
175@end menu
176
177@c *********************************************************************
178@node Introduction
179@chapter Introduction
180
c80e7e55
LC
181GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
182using the international phonetic alphabet (IPA).} is a functional
183package management tool for the GNU system. Package management consists
4bfc4ea3
NK
184of all activities that relate to building packages from sources,
185honoring their build-time and run-time dependencies,
c80e7e55
LC
186installing packages in user environments, upgrading installed packages
187to new versions or rolling back to a previous set, removing unused
188software packages, etc.
568717fd
LC
189
190@cindex functional package management
191The term @dfn{functional} refers to a specific package management
192discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
193as a function, in the mathematical sense. That function takes inputs,
194such as build scripts, a compiler, and libraries, and
195returns an installed package. As a pure function, its result depends
568717fd
LC
196solely on its inputs---for instance, it cannot refer to software or
197scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
198always produces the same result when passed a given set of inputs. It
199cannot alter the system's environment in
568717fd
LC
200any way; for instance, it cannot create, modify, or delete files outside
201of its build and installation directories. This is achieved by running
e900c503 202build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 203explicit inputs are visible.
568717fd 204
e531ac2a 205@cindex store
568717fd 206The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
207system, in a special directory called @dfn{the store} (@pxref{The
208Store}). Each package is installed in a directory of its own, in the
834129e0 209store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
210a hash of all the inputs used to build that package; thus, changing an
211input yields a different directory name.
212
213This approach is the foundation of Guix's salient features: support for
4bfc4ea3 214transactional package upgrade and rollback, per-user installation, and
eeaf4427 215garbage collection of packages (@pxref{Features}).
568717fd 216
4bfc4ea3 217Guix has a command-line interface, which allows users to build, install,
568717fd 218upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 219
3ca2731c 220@cindex Guix System Distribution
4705641f 221@cindex GuixSD
a1ba8475 222Last but not least, Guix is used to build a distribution of the GNU
3ca2731c 223system, with many GNU and non-GNU free software packages. The Guix
4705641f
LC
224System Distribution, or GNU@tie{}GuixSD, takes advantage of the core
225properties of Guix at the system level. With GuixSD, users
3ca2731c
LC
226@emph{declare} all aspects of the operating system configuration, and
227Guix takes care of instantiating that configuration in a reproducible,
228stateless fashion. @xref{GNU Distribution}.
a1ba8475 229
bd5e766b
LC
230@c *********************************************************************
231@node Installation
232@chapter Installation
233
48febeb8
LC
234GNU Guix is available for download from its website at
235@url{http://www.gnu.org/software/guix/}. This section describes the
236software requirements of Guix, as well as how to install it and get
237ready to use it.
bd5e766b 238
5af6de3e
LC
239Note that this section is concerned with the installation of the package
240manager, which can be done on top of a running GNU/Linux system. If,
241instead, you want to install the complete GNU operating system,
6621cdb6 242@pxref{System Installation}.
5af6de3e 243
bd5e766b 244@menu
09722b11 245* Binary Installation:: Getting Guix running in no time!
bd5e766b 246* Requirements:: Software needed to build and run Guix.
ec0339cd 247* Running the Test Suite:: Testing Guix.
bd5e766b
LC
248* Setting Up the Daemon:: Preparing the build daemon's environment.
249* Invoking guix-daemon:: Running the build daemon.
250@end menu
251
09722b11
LC
252@node Binary Installation
253@section Binary Installation
254
255This section describes how to install Guix on an arbitrary system from a
256self-contained tarball providing binaries for Guix and for all its
257dependencies. This is often quicker than installing from source, which
258is described in the next sections. The only requirement is to have
259GNU@tie{}tar and Xz.
260
261Installing goes along these lines:
262
263@enumerate
264@item
265Download the binary tarball from
ae806096 266@indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz}@footnote{As
09722b11
LC
267usual, make sure to download the associated @file{.sig} file and to
268verify the authenticity of the tarball against it!}, where @var{system}
269is @code{x86_64-linux} for an @code{x86_64} machine already running the
270kernel Linux, and so on.
271
272@item
273As @code{root}, run:
274
275@example
276# cd /
b91d7f0f 277# tar xf guix-binary-@value{VERSION}.@var{system}.tar.xz
09722b11
LC
278@end example
279
280This creates @file{/gnu/store} (@pxref{The Store}), @file{/var/guix},
281and @file{/root/.guix-profile}. @file{/root/.guix-profile} is a
282ready-to-use profile for @code{root} where Guix is installed.
283
5dc3ce5f
LC
284Do @emph{not} unpack the tarball on a working Guix system since that
285would overwrite its own essential files.
286
09722b11 287@item
175ced41 288Run the daemon:
09722b11
LC
289
290@example
cfc149dc 291# /root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
09722b11
LC
292@end example
293
294@item
295Make the @command{guix} command available to other users on the machine,
296for instance with:
297
298@example
299# mkdir -p /usr/local/bin
300# cd /usr/local/bin
d72d05f9 301# ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
09722b11 302@end example
39f8ed14
LC
303
304@item
305To use substitutes from @code{hydra.gnu.org} (@pxref{Substitutes}),
306authorize them:
307
308@example
309# guix archive --authorize < /root/.guix-profile/share/guix/hydra.gnu.org.pub
310@end example
09722b11
LC
311@end enumerate
312
313And that's it!
314
5dc3ce5f 315The @code{guix} package must remain available in @code{root}'s
09722b11
LC
316profile, or it would become subject to garbage collection---in which
317case you would find yourself badly handicapped by the lack of the
318@command{guix} command.
319
39f8ed14
LC
320The tarball in question can be (re)produced and verified simply by
321running the following command in the Guix source tree:
09722b11
LC
322
323@example
324make guix-binary.@var{system}.tar.xz
325@end example
326
327
bd5e766b
LC
328@node Requirements
329@section Requirements
330
09722b11
LC
331This section lists requirements when building Guix from source. The
332build procedure for Guix is the same as for other GNU software, and is
333not covered here. Please see the files @file{README} and @file{INSTALL}
334in the Guix source tree for additional details.
335
bd5e766b
LC
336GNU Guix depends on the following packages:
337
338@itemize
47c66da0 339@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
288dca55 340@item @url{http://gnupg.org/, GNU libgcrypt};
f0b98b84 341@item @url{http://www.gnu.org/software/make/, GNU Make}.
8a96bd4b
ID
342@end itemize
343
344The following dependencies are optional:
345
346@itemize
288dca55 347@item
8a96bd4b 348Installing
288dca55 349@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
350allow you to use the @command{guix import pypi} command (@pxref{Invoking
351guix import}). It is of
288dca55 352interest primarily for developers and not for casual users.
8a96bd4b
ID
353@item
354Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
355allow you to access @code{https} URLs with the @command{guix download}
d45dc6da
EB
356command (@pxref{Invoking guix download}), the @command{guix import pypi}
357command, and the @command{guix import cpan} command. This is primarily
358of interest to developers. @xref{Guile Preparations, how to install the
359GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
360@end itemize
361
362Unless @code{--disable-daemon} was passed to @command{configure}, the
363following packages are also needed:
364
365@itemize
368d08f7
LC
366@item @url{http://sqlite.org, SQLite 3};
367@item @url{http://www.bzip.org, libbz2};
368@item @url{http://gcc.gnu.org, GCC's g++}, with support for the
369C++11 standard.
bd5e766b
LC
370@end itemize
371
4bfc4ea3
NK
372When a working installation of @url{http://nixos.org/nix/, the Nix package
373manager} is available, you
bd5e766b 374can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 375Nix replaces the three dependencies above.
bd5e766b 376
b22a12fd
LC
377Guix is compatible with Nix, so it is possible to share the same store
378between both. To do so, you must pass @command{configure} not only the
379same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
380@code{--localstatedir} value. The latter is essential because it
381specifies where the database that stores metadata about the store is
834129e0 382located, among other things. The default values for Nix are
b22a12fd 383@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
384Note that @code{--disable-daemon} is not required if
385your goal is to share the store with Nix.
b22a12fd 386
ec0339cd
LC
387@node Running the Test Suite
388@section Running the Test Suite
389
390After a successful @command{configure} and @code{make} run, it is a good
391idea to run the test suite. It can help catch issues with the setup or
392environment, or bugs in Guix itself---and really, reporting test
393failures is a good way to help improve the software. To run the test
394suite, type:
395
396@example
397make check
398@end example
399
400Test cases can run in parallel: you can use the @code{-j} option of
401GNU@tie{}make to speed things up. The first run may take a few minutes
402on a recent machine; subsequent runs will be faster because the store
403that is created for test purposes will already have various things in
404cache.
405
406Upon failure, please email @email{bug-guix@@gnu.org} and attach the
407@file{test-suite.log} file. When @file{tests/@var{something}.scm}
408fails, please also attach the @file{@var{something}.log} file available
409in the top-level build directory. Please specify the Guix version being
410used as well as version numbers of the dependencies
411(@pxref{Requirements}) in your message.
412
bd5e766b
LC
413@node Setting Up the Daemon
414@section Setting Up the Daemon
415
416@cindex daemon
417Operations such as building a package or running the garbage collector
49e6291a 418are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
419behalf of clients. Only the daemon may access the store and its
420associated database. Thus, any operation that manipulates the store
421goes through the daemon. For instance, command-line tools such as
e49951eb 422@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
423daemon (@i{via} remote procedure calls) to instruct it what to do.
424
49e6291a 425The following sections explain how to prepare the build daemon's
225dafde
LC
426environment. Also @ref{Substitutes}, for information on how to allow
427the daemon to download pre-built binaries.
49e6291a
LC
428
429@menu
430* Build Environment Setup:: Preparing the isolated build environment.
431* Daemon Offload Setup:: Offloading builds to remote machines.
432@end menu
433
434@node Build Environment Setup
435@subsection Build Environment Setup
436
bd5e766b
LC
437In a standard multi-user setup, Guix and its daemon---the
438@command{guix-daemon} program---are installed by the system
834129e0 439administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
440@command{guix-daemon} runs as @code{root}. Unprivileged users may use
441Guix tools to build packages or otherwise access the store, and the
442daemon will do it on their behalf, ensuring that the store is kept in a
443consistent state, and allowing built packages to be shared among users.
444
445@cindex build users
446When @command{guix-daemon} runs as @code{root}, you may not want package
447build processes themselves to run as @code{root} too, for obvious
448security reasons. To avoid that, a special pool of @dfn{build users}
449should be created for use by build processes started by the daemon.
450These build users need not have a shell and a home directory: they will
451just be used when the daemon drops @code{root} privileges in build
452processes. Having several such users allows the daemon to launch
453distinct build processes under separate UIDs, which guarantees that they
454do not interfere with each other---an essential feature since builds are
455regarded as pure functions (@pxref{Introduction}).
456
457On a GNU/Linux system, a build user pool may be created like this (using
458Bash syntax and the @code{shadow} commands):
459
091196b3
LC
460@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
461@c for why `-G' is needed.
bd5e766b 462@example
cfc149dc
LC
463# groupadd --system guixbuild
464# for i in `seq -w 1 10`;
bd5e766b 465 do
cfc149dc
LC
466 useradd -g guixbuild -G guixbuild \
467 -d /var/empty -s `which nologin` \
468 -c "Guix build user $i" --system \
469 guixbuilder$i;
bd5e766b
LC
470 done
471@end example
472
473@noindent
474The @code{guix-daemon} program may then be run as @code{root} with:
475
476@example
cfc149dc 477# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
478@end example
479
e900c503 480@cindex chroot
b095792f
LC
481@noindent
482This way, the daemon starts build processes in a chroot, under one of
cfc149dc 483the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
484environment contains nothing but:
485
486@c Keep this list in sync with libstore/build.cc! -----------------------
487@itemize
488@item
4743a4da
LC
489a minimal @code{/dev} directory, created mostly independently from the
490host @code{/dev}@footnote{``Mostly'', because while the set of files
491that appear in the chroot's @code{/dev} is fixed, most of these files
492can only be created if the host has them.};
493
494@item
495the @code{/proc} directory; it only shows the container's processes
496since a separate PID name space is used;
6dc99317
LC
497
498@item
499@file{/etc/passwd} with an entry for the current user and an entry for
500user @file{nobody};
501
502@item
503@file{/etc/group} with an entry for the user's group;
504
505@item
506@file{/etc/hosts} with an entry that maps @code{localhost} to
507@code{127.0.0.1};
508
509@item
510a writable @file{/tmp} directory.
511@end itemize
b095792f 512
d43eb499 513If you are installing Guix as an unprivileged user, it is still
bd5e766b
LC
514possible to run @command{guix-daemon}. However, build processes will
515not be isolated from one another, and not from the rest of the system.
516Thus, build processes may interfere with each other, and may access
517programs, libraries, and other files available on the system---making it
518much harder to view them as @emph{pure} functions.
519
49e6291a
LC
520
521@node Daemon Offload Setup
522@subsection Using the Offload Facility
523
524@cindex offloading
4ec2e92d
LC
525@cindex build hook
526When desired, the build daemon can @dfn{offload}
527derivation builds to other machines
49e6291a
LC
528running Guix, using the @code{offload} @dfn{build hook}. When that
529feature is enabled, a list of user-specified build machines is read from
530@file{/etc/guix/machines.scm}; anytime a build is requested, for
531instance via @code{guix build}, the daemon attempts to offload it to one
532of the machines that satisfies the derivation's constraints, in
533particular its system type---e.g., @file{x86_64-linux}. Missing
534prerequisites for the build are copied over SSH to the target machine,
535which then proceeds with the build; upon success the output(s) of the
536build are copied back to the initial machine.
537
4ec2e92d 538The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
539
540@example
541(list (build-machine
542 (name "eightysix.example.org")
543 (system "x86_64-linux")
544 (user "bob")
545 (speed 2.)) ; incredibly fast!
546
547 (build-machine
548 (name "meeps.example.org")
549 (system "mips64el-linux")
550 (user "alice")
551 (private-key
552 (string-append (getenv "HOME")
553 "/.ssh/id-rsa-for-guix"))))
554@end example
555
556@noindent
557In the example above we specify a list of two build machines, one for
558the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
559architecture.
560
561In fact, this file is---not surprisingly!---a Scheme file that is
562evaluated when the @code{offload} hook is started. Its return value
563must be a list of @code{build-machine} objects. While this example
564shows a fixed list of build machines, one could imagine, say, using
565DNS-SD to return a list of potential build machines discovered in the
566local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
567Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
568detailed below.
4ec2e92d 569
c678a4ee
LC
570@deftp {Data Type} build-machine
571This data type represents build machines the daemon may offload builds
572to. The important fields are:
49e6291a
LC
573
574@table @code
575
576@item name
577The remote machine's host name.
578
579@item system
c678a4ee 580The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
581
582@item user
583The user account to use when connecting to the remote machine over SSH.
584Note that the SSH key pair must @emph{not} be passphrase-protected, to
585allow non-interactive logins.
586
587@end table
588
4ec2e92d 589A number of optional fields may be specified:
49e6291a
LC
590
591@table @code
592
cecd72d5
LC
593@item port
594Port number of the machine's SSH server (default: 22).
595
49e6291a
LC
596@item private-key
597The SSH private key file to use when connecting to the machine.
598
599@item parallel-builds
600The number of builds that may run in parallel on the machine (1 by
601default.)
602
603@item speed
604A ``relative speed factor''. The offload scheduler will tend to prefer
605machines with a higher speed factor.
606
607@item features
608A list of strings denoting specific features supported by the machine.
609An example is @code{"kvm"} for machines that have the KVM Linux modules
610and corresponding hardware support. Derivations can request features by
611name, and they will be scheduled on matching build machines.
612
613@end table
c678a4ee 614@end deftp
49e6291a
LC
615
616The @code{guix} command must be in the search path on the build
617machines, since offloading works by invoking the @code{guix archive} and
618@code{guix build} commands.
619
620There's one last thing to do once @file{machines.scm} is in place. As
621explained above, when offloading, files are transferred back and forth
622between the machine stores. For this to work, you need to generate a
623key pair to allow the daemon to export signed archives of files from the
624store (@pxref{Invoking guix archive}):
625
626@example
627# guix archive --generate-key
628@end example
629
630@noindent
631Thus, when receiving files, a machine's build daemon can make sure they
632are genuine, have not been tampered with, and that they are signed by an
633authorized key.
634
635
bd5e766b
LC
636@node Invoking guix-daemon
637@section Invoking @command{guix-daemon}
638
639The @command{guix-daemon} program implements all the functionality to
640access the store. This includes launching build processes, running the
641garbage collector, querying the availability of a build result, etc. It
642is normally run as @code{root} like this:
643
644@example
cfc149dc 645# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
646@end example
647
648@noindent
081145cf 649For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 650
e900c503
LC
651@cindex chroot
652@cindex container, build environment
653@cindex build environment
654@cindex reproducible builds
bd5e766b
LC
655By default, @command{guix-daemon} launches build processes under
656different UIDs, taken from the build group specified with
657@code{--build-users-group}. In addition, each build process is run in a
658chroot environment that only contains the subset of the store that the
659build process depends on, as specified by its derivation
660(@pxref{Programming Interface, derivation}), plus a set of specific
661system directories. By default, the latter contains @file{/dev} and
e900c503
LC
662@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
663@dfn{container}: in addition to having its own file system tree, it has
664a separate mount name space, its own PID name space, network name space,
665etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b 666
cbc538fe
LC
667When the daemon performs a build on behalf of the user, it creates a
668build directory under @file{/tmp} or under the directory specified by
669its @code{TMPDIR} environment variable; this directory is shared with
670the container for the duration of the build. Be aware that using a
671directory other than @file{/tmp} can affect build results---for example,
672with a longer directory name, a build process that uses Unix-domain
673sockets might hit the name length limitation for @code{sun_path}, which
674it would otherwise not hit.
675
676The build directory is automatically deleted upon completion, unless the
677build failed and the client specified @option{--keep-failed}
678(@pxref{Invoking guix build, @option{--keep-failed}}).
679
bd5e766b
LC
680The following command-line options are supported:
681
682@table @code
683@item --build-users-group=@var{group}
684Take users from @var{group} to run build processes (@pxref{Setting Up
685the Daemon, build users}).
686
6858f9d1 687@item --no-substitutes
b5385b52 688@cindex substitutes
6858f9d1 689Do not use substitutes for build products. That is, always build things
c4202d60
LC
690locally instead of allowing downloads of pre-built binaries
691(@pxref{Substitutes}).
6858f9d1 692
b5385b52
LC
693By default substitutes are used, unless the client---such as the
694@command{guix package} command---is explicitly invoked with
695@code{--no-substitutes}.
696
697When the daemon runs with @code{--no-substitutes}, clients can still
698explicitly enable substitution @i{via} the @code{set-build-options}
699remote procedure call (@pxref{The Store}).
700
9176607e
LC
701@item --substitute-urls=@var{urls}
702Consider @var{urls} the default whitespace-separated list of substitute
ae806096 703source URLs. When this option is omitted, @indicateurl{http://hydra.gnu.org}
9176607e
LC
704is used.
705
706This means that substitutes may be downloaded from @var{urls}, as long
707as they are signed by a trusted signature (@pxref{Substitutes}).
708
4ec2e92d
LC
709@cindex build hook
710@item --no-build-hook
711Do not use the @dfn{build hook}.
712
713The build hook is a helper program that the daemon can start and to
714which it submits build requests. This mechanism is used to offload
715builds to other machines (@pxref{Daemon Offload Setup}).
716
bd5e766b
LC
717@item --cache-failures
718Cache build failures. By default, only successful builds are cached.
719
720@item --cores=@var{n}
721@itemx -c @var{n}
722Use @var{n} CPU cores to build each derivation; @code{0} means as many
723as available.
724
6efc160e 725The default value is @code{0}, but it may be overridden by clients, such
e49951eb
MW
726as the @code{--cores} option of @command{guix build} (@pxref{Invoking
727guix build}).
bd5e766b
LC
728
729The effect is to define the @code{NIX_BUILD_CORES} environment variable
730in the build process, which can then use it to exploit internal
731parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
732
733@item --max-jobs=@var{n}
734@itemx -M @var{n}
735Allow at most @var{n} build jobs in parallel. The default value is
f6526eb3
LC
736@code{1}. Setting it to @code{0} means that no builds will be performed
737locally; instead, the daemon will offload builds (@pxref{Daemon Offload
738Setup}), or simply fail.
bd5e766b
LC
739
740@item --debug
741Produce debugging output.
742
743This is useful to debug daemon start-up issues, but then it may be
744overridden by clients, for example the @code{--verbosity} option of
e49951eb 745@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
746
747@item --chroot-directory=@var{dir}
748Add @var{dir} to the build chroot.
749
750Doing this may change the result of build processes---for instance if
751they use optional dependencies found in @var{dir} when it is available,
752and not otherwise. For that reason, it is not recommended to do so.
753Instead, make sure that each derivation declares all the inputs that it
754needs.
755
756@item --disable-chroot
757Disable chroot builds.
758
759Using this option is not recommended since, again, it would allow build
760processes to gain access to undeclared dependencies.
761
762@item --disable-log-compression
763Disable compression of the build logs.
764
1da983b9
LC
765Unless @code{--lose-logs} is used, all the build logs are kept in the
766@var{localstatedir}. To save space, the daemon automatically compresses
767them with bzip2 by default. This option disables that.
768
ab3893d7
LC
769@item --disable-deduplication
770@cindex deduplication
bd5e766b
LC
771Disable automatic file ``deduplication'' in the store.
772
1da983b9 773By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
774if a newly added file is identical to another one found in the store,
775the daemon makes the new file a hard link to the other file. This can
776noticeably reduce disk usage, at the expense of slightly increasde
777input/output load at the end of a build process. This option disables
778this optimization.
1da983b9 779
6e37066e
LC
780@item --gc-keep-outputs[=yes|no]
781Tell whether the garbage collector (GC) must keep outputs of live
782derivations.
783
784When set to ``yes'', the GC will keep the outputs of any live derivation
785available in the store---the @code{.drv} files. The default is ``no'',
786meaning that derivation outputs are kept only if they are GC roots.
787
788@item --gc-keep-derivations[=yes|no]
789Tell whether the garbage collector (GC) must keep derivations
790corresponding to live outputs.
791
792When set to ``yes'', as is the case by default, the GC keeps
793derivations---i.e., @code{.drv} files---as long as at least one of their
794outputs is live. This allows users to keep track of the origins of
795items in their store. Setting it to ``no'' saves a bit of disk space.
796
797Note that when both @code{--gc-keep-derivations} and
798@code{--gc-keep-outputs} are used, the effect is to keep all the build
799prerequisites (the sources, compiler, libraries, and other build-time
800tools) of live objects in the store, regardless of whether these
801prerequisites are live. This is convenient for developers since it
802saves rebuilds or downloads.
803
bd5e766b
LC
804@item --impersonate-linux-2.6
805On Linux-based systems, impersonate Linux 2.6. This means that the
806kernel's @code{uname} system call will report 2.6 as the release number.
807
808This might be helpful to build programs that (usually wrongfully) depend
809on the kernel version number.
810
811@item --lose-logs
812Do not keep build logs. By default they are kept under
ce33631f 813@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
814
815@item --system=@var{system}
816Assume @var{system} as the current system type. By default it is the
817architecture/kernel pair found at configure time, such as
818@code{x86_64-linux}.
b8d2aa26
LC
819
820@item --listen=@var{socket}
821Listen for connections on @var{socket}, the file name of a Unix-domain
822socket. The default socket is
823@file{@var{localstatedir}/daemon-socket/socket}. This option is only
824useful in exceptional circumstances, such as if you need to run several
825daemons on the same machine.
bd5e766b
LC
826@end table
827
828
eeaf4427
LC
829@c *********************************************************************
830@node Package Management
831@chapter Package Management
832
f8348b91 833The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
834remove software packages, without having to know about their build
835procedure or dependencies. Guix also goes beyond this obvious set of
836features.
837
838This chapter describes the main features of Guix, as well as the package
c1941588
LC
839management tools it provides. Two user interfaces are provided for
840routine package management tasks: a command-line interface
841(@pxref{Invoking guix package, @code{guix package}}), and a visual user
842interface in Emacs (@pxref{Emacs Interface}).
eeaf4427
LC
843
844@menu
845* Features:: How Guix will make your life brighter.
e49951eb 846* Invoking guix package:: Package installation, removal, etc.
457f60fa 847* Emacs Interface:: Package management from Emacs.
c4202d60 848* Substitutes:: Downloading pre-built binaries.
760c60d6 849* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 850* Invoking guix gc:: Running the garbage collector.
f651b477 851* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 852* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
853@end menu
854
855@node Features
856@section Features
857
858When using Guix, each package ends up in the @dfn{package store}, in its
859own directory---something that resembles
9a130e19
AK
860@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
861(note that Guix comes with an Emacs extension to shorten those file
081145cf 862names, @pxref{Emacs Prettify}.)
eeaf4427
LC
863
864Instead of referring to these directories, users have their own
865@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
866use. These profiles are stored within each user's home directory, at
867@code{$HOME/.guix-profile}.
eeaf4427 868
821b0015 869For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 870@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 871@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
872@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
873simply continues to point to
834129e0 874@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 875coexist on the same system without any interference.
eeaf4427 876
e49951eb
MW
877The @command{guix package} command is the central tool to manage
878packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 879profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
880
881The command provides the obvious install, remove, and upgrade
882operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 883the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 884@command{guix package} process is terminated during the transaction,
eeaf4427
LC
885or if a power outage occurs during the transaction, then the user's
886profile remains in its previous state, and remains usable.
887
888In addition, any package transaction may be @emph{rolled back}. So, if,
889for example, an upgrade installs a new version of a package that turns
890out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
891of their profile, which was known to work well. Similarly, the global
892system configuration is subject to transactional upgrades and roll-back
893(@pxref{Using the Configuration System}).
eeaf4427
LC
894
895All those packages in the package store may be @emph{garbage-collected}.
896Guix can determine which packages are still referenced by the user
fe8ff028 897profiles, and remove those that are provably no longer referenced
e49951eb 898(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
899generations of their profile so that the packages they refer to can be
900collected.
eeaf4427 901
e900c503
LC
902@cindex reproducibility
903@cindex reproducible builds
eeaf4427
LC
904Finally, Guix takes a @dfn{purely functional} approach to package
905management, as described in the introduction (@pxref{Introduction}).
834129e0 906Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
907inputs that were used to build that package---compiler, libraries, build
908scripts, etc. This direct correspondence allows users to make sure a
909given package installation matches the current state of their
e900c503
LC
910distribution. It also helps maximize @dfn{build reproducibility}:
911thanks to the isolated build environments that are used, a given build
912is likely to yield bit-identical files when performed on different
913machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 914
c4202d60 915@cindex substitutes
eeaf4427 916This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 917deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 918available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
919downloads it and unpacks it;
920otherwise, it builds the package from source, locally
921(@pxref{Substitutes}).
eeaf4427 922
f5fd4fd2
LC
923Control over the build environment is a feature that is also useful for
924developers. The @command{guix environment} command allows developers of
925a package to quickly set up the right development environment for their
926package, without having to manually install the package's dependencies
927in their profile (@pxref{Invoking guix environment}).
928
e49951eb
MW
929@node Invoking guix package
930@section Invoking @command{guix package}
eeaf4427 931
e49951eb 932The @command{guix package} command is the tool that allows users to
eeaf4427
LC
933install, upgrade, and remove packages, as well as rolling back to
934previous configurations. It operates only on the user's own profile,
935and works with normal user privileges (@pxref{Features}). Its syntax
936is:
937
938@example
e49951eb 939guix package @var{options}
eeaf4427
LC
940@end example
941
ba55b1cb 942Primarily, @var{options} specifies the operations to be performed during
eeaf4427
LC
943the transaction. Upon completion, a new profile is created, but
944previous generations of the profile remain available, should the user
945want to roll back.
946
6447738c
MW
947For example, to remove @code{lua} and install @code{guile} and
948@code{guile-cairo} in a single transaction:
949
950@example
951guix package -r lua -i guile guile-cairo
952@end example
953
b9e5c0a9 954For each user, a symlink to the user's default profile is automatically
0ec1af59 955created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
956current generation of the user's default profile. Thus, users can add
957@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
958variable, and so on.
d664f1b4
LC
959@cindex search paths
960If you are not using the Guix System Distribution, consider adding the
961following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
962Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
963shells get all the right environment variable definitions:
964
965@example
966GUIX_PROFILE="$HOME/.guix-profile" \
967source "$HOME/.guix-profile/etc/profile"
968@end example
b9e5c0a9 969
4379c35b
LC
970In a multi-user setup, user profiles are stored in a place registered as
971a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
972to (@pxref{Invoking guix gc}). That directory is normally
0ec1af59
LC
973@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
974@var{localstatedir} is the value passed to @code{configure} as
4379c35b
LC
975@code{--localstatedir}, and @var{user} is the user name. The
976@file{per-user} directory is created when @command{guix-daemon} is
977started, and the @var{user} sub-directory is created by @command{guix
978package}.
0ec1af59
LC
979
980The @var{options} can be among the following:
981
eeaf4427
LC
982@table @code
983
6447738c
MW
984@item --install=@var{package} @dots{}
985@itemx -i @var{package} @dots{}
986Install the specified @var{package}s.
eeaf4427 987
6447738c 988Each @var{package} may specify either a simple package name, such as
eeaf4427 989@code{guile}, or a package name followed by a hyphen and version number,
724311a2
LC
990such as @code{guile-1.8.8} or simply @code{guile-1.8} (in the latter
991case, the newest version prefixed by @code{1.8} is selected.)
992
993If no version number is specified, the
dc5669cd
MW
994newest available version will be selected. In addition, @var{package}
995may contain a colon, followed by the name of one of the outputs of the
6e721c4d 996package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
997(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
998name (and optionally version) are searched for among the GNU
999distribution modules (@pxref{Package Modules}).
eeaf4427 1000
461572cc
LC
1001@cindex propagated inputs
1002Sometimes packages have @dfn{propagated inputs}: these are dependencies
1003that automatically get installed along with the required package.
1004
1005An example is the GNU MPC library: its C header files refer to those of
1006the GNU MPFR library, which in turn refer to those of the GMP library.
1007Thus, when installing MPC, the MPFR and GMP libraries also get installed
1008in the profile; removing MPC also removes MPFR and GMP---unless they had
1009also been explicitly installed independently.
1010
ba7ea5ce 1011Besides, packages sometimes rely on the definition of environment
5924080d 1012variables for their search paths (see explanation of
ba7ea5ce 1013@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
1014environment variable definitions are reported here.
1015
ef010c0f 1016@c XXX: keep me up-to-date
5924080d 1017Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
1018availability of a newer upstream version. In the future, it may provide
1019the option of installing directly from the upstream version, even if
1020that version is not yet in the distribution.
1021
5d4b411f
LC
1022@item --install-from-expression=@var{exp}
1023@itemx -e @var{exp}
1024Install the package @var{exp} evaluates to.
1025
1026@var{exp} must be a Scheme expression that evaluates to a
1027@code{<package>} object. This option is notably useful to disambiguate
1028between same-named variants of a package, with expressions such as
1029@code{(@@ (gnu packages base) guile-final)}.
1030
1031Note that this option installs the first output of the specified
1032package, which may be insufficient when needing a specific output of a
1033multiple-output package.
1034
6447738c
MW
1035@item --remove=@var{package} @dots{}
1036@itemx -r @var{package} @dots{}
1037Remove the specified @var{package}s.
eeaf4427 1038
6447738c 1039As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
1040and/or output name in addition to the package name. For instance,
1041@code{-r glibc:debug} would remove the @code{debug} output of
1042@code{glibc}.
1043
6447738c
MW
1044@item --upgrade[=@var{regexp} @dots{}]
1045@itemx -u [@var{regexp} @dots{}]
1046Upgrade all the installed packages. If one or more @var{regexp}s are
1047specified, upgrade only installed packages whose name matches a
d5f01e48 1048@var{regexp}. Also see the @code{--do-not-upgrade} option below.
eeaf4427 1049
f651b477
LC
1050Note that this upgrades package to the latest version of packages found
1051in the distribution currently installed. To update your distribution,
1052you should regularly run @command{guix pull} (@pxref{Invoking guix
1053pull}).
1054
d5f01e48
MW
1055@item --do-not-upgrade[=@var{regexp} @dots{}]
1056When used together with the @code{--upgrade} option, do @emph{not}
1057upgrade any packages whose name matches a @var{regexp}. For example, to
1058upgrade all packages in the current profile except those containing the
1059substring ``emacs'':
1060
1061@example
1062$ guix package --upgrade . --do-not-upgrade emacs
1063@end example
1064
1b676447
DT
1065@item --manifest=@var{file}
1066@itemx -m @var{file}
1067Create a new @dfn{generation} of the profile from the manifest object
1068returned by the Scheme code in @var{file}.
1069
1070A manifest file may look like this:
1071
1072@example
1073(use-package-modules guile emacs gcc)
1074
1075(packages->manifest
1076 (list guile-2.0
1077 emacs
1078 ;; Use a specific package output.
1079 (list gcc "debug")))
1080@end example
1081
24e262f0
LC
1082@item --roll-back
1083Roll back to the previous @dfn{generation} of the profile---i.e., undo
1084the last transaction.
1085
1086When combined with options such as @code{--install}, roll back occurs
1087before any other actions.
1088
d9307267 1089When rolling back from the first generation that actually contains
4b2bc804
NK
1090installed packages, the profile is made to point to the @dfn{zeroth
1091generation}, which contains no files apart from its own meta-data.
d9307267 1092
82fe08ed
LC
1093Installing, removing, or upgrading packages from a generation that has
1094been rolled back to overwrites previous future generations. Thus, the
1095history of a profile's generations is always linear.
1096
b3bb82f1
AK
1097@item --switch-generation=@var{pattern}
1098@itemx -S @var{pattern}
1099Switch to a particular generation defined by @var{pattern}.
1100
1101@var{pattern} may be either a generation number or a number prefixed
1102with ``+'' or ``-''. The latter means: move forward/backward by a
1103specified number of generations. For example, if you want to return to
1104the latest generation after @code{--roll-back}, use
1105@code{--switch-generation=+1}.
1106
1107The difference between @code{--roll-back} and
1108@code{--switch-generation=-1} is that @code{--switch-generation} will
1109not make a zeroth generation, so if a specified generation does not
1110exist, the current generation will not be changed.
1111
dbc31ab2 1112@item --search-paths[=@var{kind}]
5924080d
LC
1113@cindex search paths
1114Report environment variable definitions, in Bash syntax, that may be
1115needed in order to use the set of installed packages. These environment
1116variables are used to specify @dfn{search paths} for files used by some
1117of the installed packages.
1118
1119For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1120environment variables to be defined so it can look for headers and
1121libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1122Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1123library are installed in the profile, then @code{--search-paths} will
1124suggest setting these variables to @code{@var{profile}/include} and
1125@code{@var{profile}/lib}, respectively.
1126
dbc31ab2
LC
1127The typical use case is to define these environment variables in the
1128shell:
1129
1130@example
1131$ eval `guix package --search-paths`
1132@end example
1133
1134@var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1135meaning that the returned environment variable definitions will either
1136be exact settings, or prefixes or suffixes of the current value of these
1137variables. When omitted, @var{kind} defaults to @code{exact}.
1138
eeaf4427
LC
1139@item --profile=@var{profile}
1140@itemx -p @var{profile}
1141Use @var{profile} instead of the user's default profile.
1142
70915c1a
LC
1143@item --verbose
1144Produce verbose output. In particular, emit the environment's build log
1145on the standard error port.
1146
eeaf4427
LC
1147@item --bootstrap
1148Use the bootstrap Guile to build the profile. This option is only
1149useful to distribution developers.
1150
1151@end table
1152
e49951eb 1153In addition to these actions @command{guix package} supports the
733b4130
LC
1154following options to query the current state of a profile, or the
1155availability of packages:
eeaf4427 1156
733b4130
LC
1157@table @option
1158
acc08466
NK
1159@item --search=@var{regexp}
1160@itemx -s @var{regexp}
5763ad92 1161List the available packages whose name, synopsis, or description matches
299112d3
LC
1162@var{regexp}. Print all the meta-data of matching packages in
1163@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1164GNU recutils manual}).
acc08466 1165
299112d3
LC
1166This allows specific fields to be extracted using the @command{recsel}
1167command, for instance:
1168
1169@example
e49951eb 1170$ guix package -s malloc | recsel -p name,version
299112d3
LC
1171name: glibc
1172version: 2.17
1173
1174name: libgc
1175version: 7.2alpha6
1176@end example
acc08466 1177
a12d92f5
LC
1178Similarly, to show the name of all the packages available under the
1179terms of the GNU@tie{}LGPL version 3:
1180
1181@example
1182$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1183name: elfutils
1184
1185name: gmp
1186@dots{}
1187@end example
1188
2aa6efb0
CR
1189@item --show=@var{package}
1190Show details about @var{package}, taken from the list of available packages, in
1191@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1192recutils manual}).
1193
1194@example
1195$ guix package --show=python | recsel -p name,version
1196name: python
1197version: 2.7.6
1198
1199name: python
1200version: 3.3.5
1201@end example
1202
1203You may also specify the full name of a package to only get details about a
1204specific version of it:
1205@example
1206$ guix package --show=python-3.3.5 | recsel -p name,version
1207name: python
1208version: 3.3.5
1209@end example
1210
1211
1212
733b4130
LC
1213@item --list-installed[=@var{regexp}]
1214@itemx -I [@var{regexp}]
bd9bde1c
LC
1215List the currently installed packages in the specified profile, with the
1216most recently installed packages shown last. When @var{regexp} is
1217specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
1218
1219For each installed package, print the following items, separated by
1220tabs: the package name, its version string, the part of the package that
1221is installed (for instance, @code{out} for the default output,
1222@code{include} for its headers, etc.), and the path of this package in
1223the store.
1224
64fc89b6
LC
1225@item --list-available[=@var{regexp}]
1226@itemx -A [@var{regexp}]
5763ad92 1227List packages currently available in the distribution for this system
a1ba8475
LC
1228(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1229installed packages whose name matches @var{regexp}.
64fc89b6
LC
1230
1231For each package, print the following items separated by tabs: its name,
6e721c4d
LC
1232its version string, the parts of the package (@pxref{Packages with
1233Multiple Outputs}), and the source location of its definition.
64fc89b6 1234
f566d765
LC
1235@item --list-generations[=@var{pattern}]
1236@itemx -l [@var{pattern}]
1237Return a list of generations along with their creation dates; for each
1238generation, show the installed packages, with the most recently
4b2bc804
NK
1239installed packages shown last. Note that the zeroth generation is never
1240shown.
f566d765
LC
1241
1242For each installed package, print the following items, separated by
1243tabs: the name of a package, its version string, the part of the package
1244that is installed (@pxref{Packages with Multiple Outputs}), and the
1245location of this package in the store.
1246
1247When @var{pattern} is used, the command returns only matching
1248generations. Valid patterns include:
1249
1250@itemize
1251@item @emph{Integers and comma-separated integers}. Both patterns denote
1252generation numbers. For instance, @code{--list-generations=1} returns
1253the first one.
1254
1255And @code{--list-generations=1,8,2} outputs three generations in the
1256specified order. Neither spaces nor trailing commas are allowed.
1257
1258@item @emph{Ranges}. @code{--list-generations=2..9} prints the
1259specified generations and everything in between. Note that the start of
1260a range must be lesser than its end.
1261
1262It is also possible to omit the endpoint. For example,
1263@code{--list-generations=2..}, returns all generations starting from the
1264second one.
1265
1266@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1267or months by passing an integer along with the first letter of the
d7ddb257
LC
1268duration. For example, @code{--list-generations=20d} lists generations
1269that are up to 20 days old.
f566d765
LC
1270@end itemize
1271
b7884ca3
NK
1272@item --delete-generations[=@var{pattern}]
1273@itemx -d [@var{pattern}]
d7ddb257
LC
1274When @var{pattern} is omitted, delete all generations except the current
1275one.
b7884ca3
NK
1276
1277This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1278When @var{pattern} is specified, delete the matching generations. When
1279@var{pattern} specifies a duration, generations @emph{older} than the
1280specified duration match. For instance, @code{--delete-generations=1m}
1281deletes generations that are more than one month old.
1282
391bdd8f
LC
1283If the current generation matches, it is @emph{not} deleted. Also, the
1284zeroth generation is never deleted.
b7884ca3 1285
1bb9900a
LC
1286Note that deleting generations prevents roll-back to them.
1287Consequently, this command must be used with care.
1288
733b4130 1289@end table
eeaf4427 1290
70ee5642
LC
1291Finally, since @command{guix package} may actually start build
1292processes, it supports all the common build options that @command{guix
1293build} supports (@pxref{Invoking guix build, common build options}).
1294
457f60fa
AK
1295@include emacs.texi
1296
c4202d60
LC
1297@node Substitutes
1298@section Substitutes
1299
1300@cindex substitutes
1301@cindex pre-built binaries
1302Guix supports transparent source/binary deployment, which means that it
1303can either build things locally, or download pre-built items from a
1304server. We call these pre-built items @dfn{substitutes}---they are
1305substitutes for local build results. In many cases, downloading a
1306substitute is much faster than building things locally.
1307
1308Substitutes can be anything resulting from a derivation build
1309(@pxref{Derivations}). Of course, in the common case, they are
1310pre-built package binaries, but source tarballs, for instance, which
1311also result from derivation builds, can be available as substitutes.
1312
1313The @code{hydra.gnu.org} server is a front-end to a build farm that
1314builds packages from the GNU distribution continuously for some
9176607e
LC
1315architectures, and makes them available as substitutes. This is the
1316default source of substitutes; it can be overridden by passing
1317@command{guix-daemon} the @code{--substitute-urls} option
1318(@pxref{Invoking guix-daemon}).
c4202d60
LC
1319
1320@cindex security
1321@cindex digital signatures
1322To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1323must add its public key to the access control list (ACL) of archive
1324imports, using the @command{guix archive} command (@pxref{Invoking guix
1325archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1326be compromised and to serve genuine substitutes.
1327
1328This public key is installed along with Guix, in
1329@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1330the installation prefix of Guix. If you installed Guix from source,
1331make sure you checked the GPG signature of
1332@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1333Then, you can run something like this:
1334
1335@example
1336# guix archive --authorize < hydra.gnu.org.pub
1337@end example
1338
1339Once this is in place, the output of a command like @code{guix build}
1340should change from something like:
1341
1342@example
1343$ guix build emacs --dry-run
1344The following derivations would be built:
1345 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1346 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1347 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1348 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1349@dots{}
1350@end example
1351
1352@noindent
1353to something like:
1354
1355@example
1356$ guix build emacs --dry-run
1357The following files would be downloaded:
1358 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1359 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1360 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1361 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1362@dots{}
1363@end example
1364
1365@noindent
1366This indicates that substitutes from @code{hydra.gnu.org} are usable and
1367will be downloaded, when possible, for future builds.
1368
1369Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1370one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1371when attempting to use a substitute that has been tampered with.
1372
1373The substitute mechanism can be disabled globally by running
1374@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1375guix-daemon}). It can also be disabled temporarily by passing the
1376@code{--no-substitutes} option to @command{guix package}, @command{guix
1377build}, and other command-line tools.
1378
1379
1380Today, each individual's control over their own computing is at the
1381mercy of institutions, corporations, and groups with enough power and
1382determination to subvert the computing infrastructure and exploit its
1383weaknesses. While using @code{hydra.gnu.org} substitutes can be
1384convenient, we encourage users to also build on their own, or even run
1385their own build farm, such that @code{hydra.gnu.org} is less of an
8ce229fc
LC
1386interesting target. One way to help is by publishing the software you
1387build using @command{guix publish} so that others have one more choice
1388of server to download substitutes from (@pxref{Invoking guix publish}).
c4202d60
LC
1389
1390Guix has the foundations to maximize build reproducibility
1391(@pxref{Features}). In most cases, independent builds of a given
1392package or derivation should yield bit-identical results. Thus, through
1393a diverse set of independent package builds, we can strengthen the
1394integrity of our systems.
1395
1396In the future, we want Guix to have support to publish and retrieve
1397binaries to/from other users, in a peer-to-peer fashion. If you would
1398like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1399
1400
6e721c4d
LC
1401@node Packages with Multiple Outputs
1402@section Packages with Multiple Outputs
1403
1404@cindex multiple-output packages
1405@cindex package outputs
1406
1407Often, packages defined in Guix have a single @dfn{output}---i.e., the
1408source package leads exactly one directory in the store. When running
1409@command{guix package -i glibc}, one installs the default output of the
1410GNU libc package; the default output is called @code{out}, but its name
1411can be omitted as shown in this command. In this particular case, the
1412default output of @code{glibc} contains all the C header files, shared
1413libraries, static libraries, Info documentation, and other supporting
1414files.
1415
1416Sometimes it is more appropriate to separate the various types of files
1417produced from a single source package into separate outputs. For
1418instance, the GLib C library (used by GTK+ and related packages)
1419installs more than 20 MiB of reference documentation as HTML pages.
1420To save space for users who do not need it, the documentation goes to a
1421separate output, called @code{doc}. To install the main GLib output,
1422which contains everything but the documentation, one would run:
1423
1424@example
1425guix package -i glib
1426@end example
1427
1428The command to install its documentation is:
1429
1430@example
1431guix package -i glib:doc
1432@end example
1433
1434Some packages install programs with different ``dependency footprints''.
1435For instance, the WordNet package install both command-line tools and
1436graphical user interfaces (GUIs). The former depend solely on the C
1437library, whereas the latter depend on Tcl/Tk and the underlying X
1438libraries. In this case, we leave the command-line tools in the default
1439output, whereas the GUIs are in a separate output. This allows users
1440who do not need the GUIs to save space.
1441
1442There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1443Other conventional output names include @code{lib} for libraries and
1444possibly header files, @code{bin} for stand-alone programs, and
1445@code{debug} for debugging information (@pxref{Installing Debugging
1446Files}). The outputs of a packages are listed in the third column of
1447the output of @command{guix package --list-available} (@pxref{Invoking
1448guix package}).
6e721c4d 1449
eeaf4427 1450
e49951eb
MW
1451@node Invoking guix gc
1452@section Invoking @command{guix gc}
fe8ff028
LC
1453
1454@cindex garbage collector
1455Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1456The @command{guix gc} command allows users to explicitly run the garbage
c22eb992
LC
1457collector to reclaim space from the @file{/gnu/store} directory. It is
1458the @emph{only} way to remove files from @file{/gnu/store}---removing
1459files or directories manually may break it beyond repair!
fe8ff028
LC
1460
1461The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1462@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1463cannot be deleted; any other file is considered @dfn{dead} and may be
1464deleted. The set of garbage collector roots includes default user
e49951eb
MW
1465profiles, and may be augmented with @command{guix build --root}, for
1466example (@pxref{Invoking guix build}).
fe8ff028 1467
1bb9900a
LC
1468Prior to running @code{guix gc --collect-garbage} to make space, it is
1469often useful to remove old generations from user profiles; that way, old
1470package builds referenced by those generations can be reclaimed. This
1471is achieved by running @code{guix package --delete-generations}
1472(@pxref{Invoking guix package}).
1473
e49951eb 1474The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
1475used to garbage-collect any dead files (the default), to delete specific
1476files (the @code{--delete} option), or to print garbage-collector
1477information. The available options are listed below:
1478
1479@table @code
1480@item --collect-garbage[=@var{min}]
1481@itemx -C [@var{min}]
834129e0 1482Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1483sub-directories. This is the default operation when no option is
1484specified.
1485
1486When @var{min} is given, stop once @var{min} bytes have been collected.
1487@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1488suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1489(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1490
1491When @var{min} is omitted, collect all the garbage.
1492
1493@item --delete
1494@itemx -d
1495Attempt to delete all the store files and directories specified as
1496arguments. This fails if some of the files are not in the store, or if
1497they are still live.
1498
38d27786
LC
1499@item --optimize
1500@cindex deduplication
1501Optimize the store by hard-linking identical files---this is
1502@dfn{deduplication}.
1503
1504The daemon performs deduplication after each successful build or archive
1505import, unless it was started with @code{--disable-deduplication}
1506(@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
1507this option is primarily useful when the daemon was running with
1508@code{--disable-deduplication}.
1509
fe8ff028
LC
1510@item --list-dead
1511Show the list of dead files and directories still present in the
1512store---i.e., files and directories no longer reachable from any root.
1513
1514@item --list-live
1515Show the list of live store files and directories.
ba8b732d
LC
1516
1517@end table
1518
1519In addition, the references among existing store files can be queried:
1520
1521@table @code
1522
1523@item --references
1524@itemx --referrers
1525List the references (respectively, the referrers) of store files given
1526as arguments.
1527
8e59fdd5
LC
1528@item --requisites
1529@itemx -R
1530List the requisites of the store files passed as arguments. Requisites
1531include the store files themselves, their references, and the references
1532of these, recursively. In other words, the returned list is the
1533@dfn{transitive closure} of the store files.
1534
fe8ff028
LC
1535@end table
1536
eeaf4427 1537
f651b477
LC
1538@node Invoking guix pull
1539@section Invoking @command{guix pull}
1540
1541Packages are installed or upgraded to the latest version available in
1542the distribution currently available on your local machine. To update
1543that distribution, along with the Guix tools, you must run @command{guix
1544pull}: the command downloads the latest Guix source code and package
1545descriptions, and deploys it.
1546
1547On completion, @command{guix package} will use packages and package
1548versions from this just-retrieved copy of Guix. Not only that, but all
1549the Guix commands and Scheme modules will also be taken from that latest
1550version. New @command{guix} sub-commands added by the update also
1551become available.
1552
1553The @command{guix pull} command is usually invoked with no arguments,
1554but it supports the following options:
1555
1556@table @code
1557@item --verbose
1558Produce verbose output, writing build logs to the standard error output.
1559
ab5d72ad
LC
1560@item --url=@var{url}
1561Download the source tarball of Guix from @var{url}.
1562
1563By default, the tarball is taken from its canonical address at
1564@code{gnu.org}, for the stable branch of Guix.
1565
f651b477
LC
1566@item --bootstrap
1567Use the bootstrap Guile to build the latest Guix. This option is only
1568useful to Guix developers.
1569@end table
1570
760c60d6
LC
1571
1572@node Invoking guix archive
1573@section Invoking @command{guix archive}
1574
1575The @command{guix archive} command allows users to @dfn{export} files
1576from the store into a single archive, and to later @dfn{import} them.
1577In particular, it allows store files to be transferred from one machine
1578to another machine's store. For example, to transfer the @code{emacs}
1579package to a machine connected over SSH, one would run:
1580
1581@example
56607088 1582guix archive --export -r emacs | ssh the-machine guix archive --import
760c60d6
LC
1583@end example
1584
87236aed 1585@noindent
56607088
LC
1586Similarly, a complete user profile may be transferred from one machine
1587to another like this:
1588
1589@example
1590guix archive --export -r $(readlink -f ~/.guix-profile) | \
1591 ssh the-machine guix-archive --import
1592@end example
1593
1594@noindent
1595However, note that, in both examples, all of @code{emacs} and the
1596profile as well as all of their dependencies are transferred (due to
1597@code{-r}), regardless of what is already available in the target
1598machine's store. The @code{--missing} option can help figure out which
1599items are missing from the target's store.
87236aed 1600
760c60d6 1601Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1602comparable in spirit to `tar', but with a few noteworthy differences
1603that make it more appropriate for our purposes. First, rather than
1604recording all Unix meta-data for each file, the Nar format only mentions
1605the file type (regular, directory, or symbolic link); Unix permissions
1606and owner/group are dismissed. Second, the order in which directory
1607entries are stored always follows the order of file names according to
1608the C locale collation order. This makes archive production fully
1609deterministic.
1610
1611When exporting, the daemon digitally signs the contents of the archive,
1612and that digital signature is appended. When importing, the daemon
1613verifies the signature and rejects the import in case of an invalid
1614signature or if the signing key is not authorized.
760c60d6
LC
1615@c FIXME: Add xref to daemon doc about signatures.
1616
1617The main options are:
1618
1619@table @code
1620@item --export
1621Export the specified store files or packages (see below.) Write the
1622resulting archive to the standard output.
1623
56607088
LC
1624Dependencies are @emph{not} included in the output, unless
1625@code{--recursive} is passed.
1626
1627@item -r
1628@itemx --recursive
1629When combined with @code{--export}, this instructs @command{guix
1630archive} to include dependencies of the given items in the archive.
1631Thus, the resulting archive is self-contained: it contains the closure
1632of the exported store items.
1633
760c60d6
LC
1634@item --import
1635Read an archive from the standard input, and import the files listed
1636therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1637signature, or if it is signed by a public key not among the authorized
1638keys (see @code{--authorize} below.)
554f26ec 1639
87236aed
LC
1640@item --missing
1641Read a list of store file names from the standard input, one per line,
1642and write on the standard output the subset of these files missing from
1643the store.
1644
554f26ec 1645@item --generate-key[=@var{parameters}]
f82cc5fd 1646@cindex signing, archives
554f26ec
LC
1647Generate a new key pair for the daemons. This is a prerequisite before
1648archives can be exported with @code{--export}. Note that this operation
1649usually takes time, because it needs to gather enough entropy to
1650generate the key pair.
1651
1652The generated key pair is typically stored under @file{/etc/guix}, in
1653@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
867d8473
LC
1654key, which must be kept secret.) When @var{parameters} is omitted,
1655an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
1656versions before 1.6.0, it is a 4096-bit RSA key.
1657Alternately, @var{parameters} can specify
554f26ec
LC
1658@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1659public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1660Libgcrypt Reference Manual}).
f82cc5fd
LC
1661
1662@item --authorize
1663@cindex authorizing, archives
1664Authorize imports signed by the public key passed on standard input.
1665The public key must be in ``s-expression advanced format''---i.e., the
1666same format as the @file{signing-key.pub} file.
1667
1668The list of authorized keys is kept in the human-editable file
1669@file{/etc/guix/acl}. The file contains
1670@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1671s-expressions''} and is structured as an access-control list in the
1672@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1673(SPKI)}.
760c60d6
LC
1674@end table
1675
1676To export store files as an archive to the standard output, run:
1677
1678@example
1679guix archive --export @var{options} @var{specifications}...
1680@end example
1681
1682@var{specifications} may be either store file names or package
1683specifications, as for @command{guix package} (@pxref{Invoking guix
1684package}). For instance, the following command creates an archive
1685containing the @code{gui} output of the @code{git} package and the main
1686output of @code{emacs}:
1687
1688@example
834129e0 1689guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1690@end example
1691
1692If the specified packages are not built yet, @command{guix archive}
1693automatically builds them. The build process may be controlled with the
1694same options that can be passed to the @command{guix build} command
70ee5642 1695(@pxref{Invoking guix build, common build options}).
760c60d6
LC
1696
1697
568717fd
LC
1698@c *********************************************************************
1699@node Programming Interface
1700@chapter Programming Interface
1701
3dc1970d
LC
1702GNU Guix provides several Scheme programming interfaces (APIs) to
1703define, build, and query packages. The first interface allows users to
1704write high-level package definitions. These definitions refer to
1705familiar packaging concepts, such as the name and version of a package,
1706its build system, and its dependencies. These definitions can then be
1707turned into concrete build actions.
1708
ba55b1cb 1709Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1710standard setup, the daemon has write access to the store---the
834129e0 1711@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1712setup also has the daemon perform builds in chroots, under a specific
1713build users, to minimize interference with the rest of the system.
1714
1715@cindex derivation
1716Lower-level APIs are available to interact with the daemon and the
1717store. To instruct the daemon to perform a build action, users actually
1718provide it with a @dfn{derivation}. A derivation is a low-level
1719representation of the build actions to be taken, and the environment in
1720which they should occur---derivations are to package definitions what
49ad317a
LC
1721assembly is to C programs. The term ``derivation'' comes from the fact
1722that build results @emph{derive} from them.
3dc1970d
LC
1723
1724This chapter describes all these APIs in turn, starting from high-level
1725package definitions.
1726
568717fd 1727@menu
b860f382 1728* Defining Packages:: Defining new packages.
7458bd0a 1729* Build Systems:: Specifying how packages are built.
b860f382
LC
1730* The Store:: Manipulating the package store.
1731* Derivations:: Low-level interface to package derivations.
1732* The Store Monad:: Purely functional interface to the store.
21b679f6 1733* G-Expressions:: Manipulating build expressions.
568717fd
LC
1734@end menu
1735
1736@node Defining Packages
1737@section Defining Packages
1738
3dc1970d
LC
1739The high-level interface to package definitions is implemented in the
1740@code{(guix packages)} and @code{(guix build-system)} modules. As an
1741example, the package definition, or @dfn{recipe}, for the GNU Hello
1742package looks like this:
1743
1744@example
e7f34eb0
LC
1745(define-module (gnu packages hello)
1746 #:use-module (guix packages)
1747 #:use-module (guix download)
1748 #:use-module (guix build-system gnu)
1749 #:use-module (guix licenses))
b22a12fd 1750
79f5dd59 1751(define-public hello
3dc1970d
LC
1752 (package
1753 (name "hello")
1754 (version "2.8")
1755 (source (origin
1756 (method url-fetch)
1757 (uri (string-append "mirror://gnu/hello/hello-" version
1758 ".tar.gz"))
1759 (sha256
1760 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1761 (build-system gnu-build-system)
7458bd0a 1762 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1763 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1764 (synopsis "Hello, GNU world: An example GNU package")
1765 (description "Guess what GNU Hello prints!")
3dc1970d 1766 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 1767 (license gpl3+)))
3dc1970d
LC
1768@end example
1769
1770@noindent
1771Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 1772of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
1773to a @code{<package>} object, which is essentially a record
1774(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1775This package object can be inspected using procedures found in the
1776@code{(guix packages)} module; for instance, @code{(package-name hello)}
1777returns---surprise!---@code{"hello"}.
1778
2f7d2d91
LC
1779With luck, you may be able to import part or all of the definition of
1780the package you are interested in from another repository, using the
1781@code{guix import} command (@pxref{Invoking guix import}).
1782
e7f34eb0
LC
1783In the example above, @var{hello} is defined into a module of its own,
1784@code{(gnu packages hello)}. Technically, this is not strictly
1785necessary, but it is convenient to do so: all the packages defined in
1786modules under @code{(gnu packages @dots{})} are automatically known to
1787the command-line tools (@pxref{Package Modules}).
1788
3dc1970d
LC
1789There are a few points worth noting in the above package definition:
1790
1791@itemize
1792@item
1793The @code{source} field of the package is an @code{<origin>} object.
1794Here, the @code{url-fetch} method from @code{(guix download)} is used,
1795meaning that the source is a file to be downloaded over FTP or HTTP.
1796
1797The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1798the GNU mirrors defined in @code{(guix download)}.
1799
1800The @code{sha256} field specifies the expected SHA256 hash of the file
1801being downloaded. It is mandatory, and allows Guix to check the
1802integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 1803base32 representation of the hash. You can obtain this information with
210cc920
LC
1804@code{guix download} (@pxref{Invoking guix download}) and @code{guix
1805hash} (@pxref{Invoking guix hash}).
3dc1970d 1806
f9cc8971
LC
1807@cindex patches
1808When needed, the @code{origin} form can also have a @code{patches} field
1809listing patches to be applied, and a @code{snippet} field giving a
1810Scheme expression to modify the source code.
1811
3dc1970d
LC
1812@item
1813@cindex GNU Build System
7458bd0a
LC
1814The @code{build-system} field specifies the procedure to build the
1815package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1816represents the familiar GNU Build System, where packages may be
1817configured, built, and installed with the usual @code{./configure &&
1818make && make check && make install} command sequence.
1819
1820@item
1821The @code{arguments} field specifies options for the build system
1822(@pxref{Build Systems}). Here it is interpreted by
1823@var{gnu-build-system} as a request run @file{configure} with the
1824@code{--enable-silent-rules} flag.
3dc1970d
LC
1825
1826@item
1827The @code{inputs} field specifies inputs to the build process---i.e.,
1828build-time or run-time dependencies of the package. Here, we define an
1829input called @code{"gawk"} whose value is that of the @var{gawk}
1830variable; @var{gawk} is itself bound to a @code{<package>} object.
1831
1832Note that GCC, Coreutils, Bash, and other essential tools do not need to
1833be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 1834of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
1835
1836However, any other dependencies need to be specified in the
1837@code{inputs} field. Any dependency not specified here will simply be
1838unavailable to the build process, possibly leading to a build failure.
1839@end itemize
1840
87eafdbd
TUBK
1841@xref{package Reference}, for a full description of possible fields.
1842
2f7d2d91 1843Once a package definition is in place, the
e49951eb 1844package may actually be built using the @code{guix build} command-line
7458bd0a 1845tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
b4f5e0e8
CR
1846more information on how to test package definitions, and
1847@ref{Invoking guix lint}, for information on how to check a definition
1848for style conformance.
1849
7458bd0a
LC
1850Eventually, updating the package definition to a new upstream version
1851can be partly automated by the @command{guix refresh} command
1852(@pxref{Invoking guix refresh}).
3dc1970d
LC
1853
1854Behind the scenes, a derivation corresponding to the @code{<package>}
1855object is first computed by the @code{package-derivation} procedure.
834129e0 1856That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 1857The build actions it prescribes may then be realized by using the
3dc1970d
LC
1858@code{build-derivations} procedure (@pxref{The Store}).
1859
1860@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1861Return the @code{<derivation>} object of @var{package} for @var{system}
1862(@pxref{Derivations}).
3dc1970d
LC
1863
1864@var{package} must be a valid @code{<package>} object, and @var{system}
1865must be a string denoting the target system type---e.g.,
1866@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1867must be a connection to the daemon, which operates on the store
1868(@pxref{The Store}).
1869@end deffn
568717fd 1870
9c1edabd
LC
1871@noindent
1872@cindex cross-compilation
1873Similarly, it is possible to compute a derivation that cross-builds a
1874package for some other system:
1875
1876@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1877 @var{package} @var{target} [@var{system}]
59688fc4
LC
1878Return the @code{<derivation>} object of @var{package} cross-built from
1879@var{system} to @var{target}.
9c1edabd
LC
1880
1881@var{target} must be a valid GNU triplet denoting the target hardware
1882and operating system, such as @code{"mips64el-linux-gnu"}
1883(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1884Configure and Build System}).
1885@end deffn
1886
87eafdbd
TUBK
1887@menu
1888* package Reference :: The package data type.
1889* origin Reference:: The origin data type.
1890@end menu
1891
1892
1893@node package Reference
1894@subsection @code{package} Reference
1895
1896This section summarizes all the options available in @code{package}
1897declarations (@pxref{Defining Packages}).
1898
1899@deftp {Data Type} package
1900This is the data type representing a package recipe.
1901
1902@table @asis
1903@item @code{name}
1904The name of the package, as a string.
1905
1906@item @code{version}
1907The version of the package, as a string.
1908
1909@item @code{source}
1910An origin object telling how the source code for the package should be
1911acquired (@pxref{origin Reference}).
1912
1913@item @code{build-system}
1914The build system that should be used to build the package (@pxref{Build
1915Systems}).
1916
1917@item @code{arguments} (default: @code{'()})
1918The arguments that should be passed to the build system. This is a
1919list, typically containing sequential keyword-value pairs.
1920
1921@item @code{inputs} (default: @code{'()})
1922Package or derivation inputs to the build. This is a list of lists,
1923where each list has the name of the input (a string) as its first
1924element, a package or derivation object as its second element, and
1925optionally the name of the output of the package or derivation that
1926should be used, which defaults to @code{"out"}.
1927
1928@item @code{propagated-inputs} (default: @code{'()})
1929This field is like @code{inputs}, but the specified packages will be
1930force-installed alongside the package they belong to. For example this
1931is necessary when a library needs headers of another library to compile,
1932or needs another shared library to be linked alongside itself when a
1933program wants to link to it.
1934
1935@item @code{native-inputs} (default: @code{'()})
1936This field is like @code{inputs}, but in case of a cross-compilation it
1937will be ensured that packages for the architecture of the build machine
1938are present, such that executables from them can be used during the
1939build. For example, this is necessary for build tools such as Autoconf,
1940Libtool, pkg-config, or Gettext.
1941
1942@item @code{self-native-input?} (default: @code{#f})
1943This is a Boolean field telling whether the package should use itself as
1944a native input when cross-compiling.
1945
1946@item @code{outputs} (default: @code{'("out")})
1947The list of output names of the package. @xref{Packages with Multiple
1948Outputs}, for typical uses of additional outputs.
1949
1950@item @code{native-search-paths} (default: @code{'()})
1951@itemx @code{search-paths} (default: @code{'()})
1952A list of @code{search-path-specification} objects describing
1953search-path environment variables honored by the package.
1954
1955@item @code{replacement} (default: @code{#f})
1956This must either @code{#f} or a package object that will be used as a
1957@dfn{replacement} for this package. @xref{Security Updates, grafts},
1958for details.
1959
1960@item @code{synopsis}
1961A one-line description of the package.
1962
1963@item @code{description}
1964A more elaborate description of the package.
1965
1966@item @code{license}
1967The license of the package; a value from @code{(guix licenses)}.
1968
1969@item @code{home-page}
1970The URL to the home-page of the package, as a string.
1971
1972@item @code{supported-systems} (default: @var{%supported-systems})
1973The list of systems supported by the package, as strings of the form
1974@code{architecture-kernel}, for example @code{"x86_64-linux"}.
1975
1976@item @code{maintainers} (default: @code{'()})
1977The list of maintainers of the package, as @code{maintainer} objects.
1978
1979@item @code{location} (default: source location of the @code{package} form)
1980The source location of the package. It's useful to override this when
1981inheriting from another package, in which case this field is not
1982automatically corrected.
1983@end table
1984@end deftp
1985
1986
1987@node origin Reference
1988@subsection @code{origin} Reference
1989
1990This section summarizes all the options available in @code{origin}
1991declarations (@pxref{Defining Packages}).
1992
1993@deftp {Data Type} origin
1994This is the data type representing a source code origin.
1995
1996@table @asis
1997@item @code{uri}
1998An object containing the URI of the source. The object type depends on
1999the @code{method} (see below). For example, when using the
2000@var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
2001values are: a URL represented as a string, or a list thereof.
2002
2003@item @code{method}
2004A procedure that will handle the URI.
2005
2006Examples include:
2007
2008@table @asis
2009@item @var{url-fetch} from @code{(guix download)}
2010download a file the HTTP, HTTPS, or FTP URL specified in the
2011@code{uri} field;
2012
2013@item @var{git-fetch} from @code{(guix git-download)}
2014clone the Git version control repository, and check out the revision
2015specified in the @code{uri} field as a @code{git-reference} object; a
2016@code{git-reference} looks like this:
2017
2018@example
2019(git-reference
2020 (url "git://git.debian.org/git/pkg-shadow/shadow")
2021 (commit "v4.1.5.1"))
2022@end example
2023@end table
2024
2025@item @code{sha256}
2026A bytevector containing the SHA-256 hash of the source. Typically the
2027@code{base32} form is used here to generate the bytevector from a
2028base-32 string.
2029
2030@item @code{file-name} (default: @code{#f})
2031The file name under which the source code should be saved. When this is
2032@code{#f}, a sensible default value will be used in most cases. In case
2033the source is fetched from a URL, the file name from the URL will be
2034used. For version control checkouts, it's recommended to provide the
2035file name explicitly because the default is not very descriptive.
2036
2037@item @code{patches} (default: @code{'()})
2038A list of file names containing patches to be applied to the source.
2039
2040@item @code{snippet} (default: @code{#f})
2041A quoted piece of code that will be run in the source directory to make
2042any modifications, which is sometimes more convenient than a patch.
2043
2044@item @code{patch-flags} (default: @code{'("-p1")})
2045A list of command-line flags that should be passed to the @code{patch}
2046command.
2047
2048@item @code{patch-inputs} (default: @code{#f})
2049Input packages or derivations to the patching process. When this is
2050@code{#f}, the usual set of inputs necessary for patching are provided,
2051such as GNU@tie{}Patch.
2052
2053@item @code{modules} (default: @code{'()})
2054A list of Guile modules that should be loaded during the patching
2055process and while running the code in the @code{snippet} field.
2056
2057@item @code{imported-modules} (default: @code{'()})
2058The list of Guile modules to import in the patch derivation, for use by
2059the @code{snippet}.
2060
2061@item @code{patch-guile} (default: @code{#f})
2062The Guile package that should be used in the patching process. When
2063this is @code{#f}, a sensible default is used.
2064@end table
2065@end deftp
2066
9c1edabd 2067
7458bd0a
LC
2068@node Build Systems
2069@section Build Systems
2070
2071@cindex build system
2072Each package definition specifies a @dfn{build system} and arguments for
2073that build system (@pxref{Defining Packages}). This @code{build-system}
2074field represents the build procedure of the package, as well implicit
2075dependencies of that build procedure.
2076
2077Build systems are @code{<build-system>} objects. The interface to
2078create and manipulate them is provided by the @code{(guix build-system)}
2079module, and actual build systems are exported by specific modules.
2080
f5fd4fd2 2081@cindex bag (low-level package representation)
0d5a559f
LC
2082Under the hood, build systems first compile package objects to
2083@dfn{bags}. A @dfn{bag} is like a package, but with less
2084ornamentation---in other words, a bag is a lower-level representation of
2085a package, which includes all the inputs of that package, including some
2086that were implicitly added by the build system. This intermediate
2087representation is then compiled to a derivation (@pxref{Derivations}).
2088
7458bd0a
LC
2089Build systems accept an optional list of @dfn{arguments}. In package
2090definitions, these are passed @i{via} the @code{arguments} field
2091(@pxref{Defining Packages}). They are typically keyword arguments
2092(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2093Guile Reference Manual}). The value of these arguments is usually
2094evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2095by the daemon (@pxref{Derivations}).
2096
2097The main build system is @var{gnu-build-system}, which implements the
2098standard build procedure for GNU packages and many other packages. It
2099is provided by the @code{(guix build-system gnu)} module.
2100
2101@defvr {Scheme Variable} gnu-build-system
2102@var{gnu-build-system} represents the GNU Build System, and variants
2103thereof (@pxref{Configuration, configuration and makefile conventions,,
2104standards, GNU Coding Standards}).
2105
2106@cindex build phases
2107In a nutshell, packages using it configured, built, and installed with
2108the usual @code{./configure && make && make check && make install}
2109command sequence. In practice, a few additional steps are often needed.
2110All these steps are split up in separate @dfn{phases},
2111notably@footnote{Please see the @code{(guix build gnu-build-system)}
2112modules for more details about the build phases.}:
2113
2114@table @code
2115@item unpack
2116Unpack the source tarball, and change the current directory to the
2117extracted source tree. If the source is actually a directory, copy it
2118to the build tree, and enter that directory.
2119
2120@item patch-source-shebangs
2121Patch shebangs encountered in source files so they refer to the right
2122store file names. For instance, this changes @code{#!/bin/sh} to
2123@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2124
2125@item configure
2126Run the @file{configure} script with a number of default options, such
2127as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2128by the @code{#:configure-flags} argument.
2129
2130@item build
2131Run @code{make} with the list of flags specified with
2132@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
2133(the default), build with @code{make -j}.
2134
2135@item check
2136Run @code{make check}, or some other target specified with
2137@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2138@code{#:parallel-tests?} argument is true (the default), run @code{make
2139check -j}.
2140
2141@item install
2142Run @code{make install} with the flags listed in @code{#:make-flags}.
2143
2144@item patch-shebangs
2145Patch shebangs on the installed executable files.
2146
2147@item strip
2148Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2149is false), copying them to the @code{debug} output when available
2150(@pxref{Installing Debugging Files}).
2151@end table
2152
2153@vindex %standard-phases
2154The build-side module @code{(guix build gnu-build-system)} defines
2155@var{%standard-phases} as the default list of build phases.
2156@var{%standard-phases} is a list of symbol/procedure pairs, where the
2157procedure implements the actual phase.
2158
2159The list of phases used for a particular package can be changed with the
2160@code{#:phases} parameter. For instance, passing:
2161
2162@example
2163#:phases (alist-delete 'configure %standard-phases)
2164@end example
2165
9bf404e9 2166means that all the phases described above will be used, except the
7458bd0a
LC
2167@code{configure} phase.
2168
2169In addition, this build system ensures that the ``standard'' environment
2170for GNU packages is available. This includes tools such as GCC, libc,
2171Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2172build-system gnu)} module for a complete list.) We call these the
2173@dfn{implicit inputs} of a package, because package definitions don't
2174have to mention them.
2175@end defvr
2176
2177Other @code{<build-system>} objects are defined to support other
2178conventions and tools used by free software packages. They inherit most
2179of @var{gnu-build-system}, and differ mainly in the set of inputs
2180implicitly added to the build process, and in the list of phases
2181executed. Some of these build systems are listed below.
2182
2183@defvr {Scheme Variable} cmake-build-system
2184This variable is exported by @code{(guix build-system cmake)}. It
2185implements the build procedure for packages using the
2186@url{http://www.cmake.org, CMake build tool}.
2187
2188It automatically adds the @code{cmake} package to the set of inputs.
2189Which package is used can be specified with the @code{#:cmake}
2190parameter.
9849cfc1
LC
2191
2192The @code{#:configure-flags} parameter is taken as a list of flags
2193passed to the @command{cmake} command. The @code{#:build-type}
2194parameter specifies in abstract terms the flags passed to the compiler;
2195it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2196debugging information''), which roughly means that code is compiled with
2197@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
2198@end defvr
2199
3afcf52b
FB
2200@defvr {Scheme Variable} glib-or-gtk-build-system
2201This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2202is intended for use with packages making use of GLib or GTK+.
2203
2204This build system adds the following two phases to the ones defined by
2205@var{gnu-build-system}:
2206
2207@table @code
2208@item glib-or-gtk-wrap
2209The phase @code{glib-or-gtk-wrap} ensures that programs found under
2210@file{bin/} are able to find GLib's ``schemas'' and
2211@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2212modules}. This is achieved by wrapping the programs in launch scripts
2213that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2214environment variables.
2215
73aa8ddb
LC
2216It is possible to exclude specific package outputs from that wrapping
2217process by listing their names in the
2218@code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
2219when an output is known not to contain any GLib or GTK+ binaries, and
2220where wrapping would gratuitously add a dependency of that output on
2221GLib and GTK+.
2222
3afcf52b
FB
2223@item glib-or-gtk-compile-schemas
2224The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
2225@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
2226GSettings schemas} are compiled. Compilation is performed by the
2227@command{glib-compile-schemas} program. It is provided by the package
2228@code{glib:bin} which is automatically imported by the build system.
2229The @code{glib} package providing @command{glib-compile-schemas} can be
2230specified with the @code{#:glib} parameter.
2231@end table
2232
2233Both phases are executed after the @code{install} phase.
2234@end defvr
2235
7458bd0a
LC
2236@defvr {Scheme Variable} python-build-system
2237This variable is exported by @code{(guix build-system python)}. It
2238implements the more or less standard build procedure used by Python
2239packages, which consists in running @code{python setup.py build} and
2240then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
2241
2242For packages that install stand-alone Python programs under @code{bin/},
2243it takes care of wrapping these programs so their @code{PYTHONPATH}
2244environment variable points to all the Python libraries they depend on.
2245
2246Which Python package is used can be specified with the @code{#:python}
2247parameter.
2248@end defvr
2249
2250@defvr {Scheme Variable} perl-build-system
2251This variable is exported by @code{(guix build-system perl)}. It
2d2a53fc
EB
2252implements the standard build procedure for Perl packages, which either
2253consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
2254followed by @code{Build} and @code{Build install}; or in running
2255@code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
2256@code{make} and @code{make install}; depending on which of
2257@code{Build.PL} or @code{Makefile.PL} is present in the package
2258distribution. Preference is given to the former if both @code{Build.PL}
2259and @code{Makefile.PL} exist in the package distribution. This
2260preference can be reversed by specifying @code{#t} for the
2261@code{#:make-maker?} parameter.
2262
2263The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
2264passes flags specified by the @code{#:make-maker-flags} or
2265@code{#:module-build-flags} parameter, respectively.
7458bd0a
LC
2266
2267Which Perl package is used can be specified with @code{#:perl}.
2268@end defvr
2269
c08f9818
DT
2270@defvr {Scheme Variable} ruby-build-system
2271This variable is exported by @code{(guix build-system ruby)}. It
2272implements the RubyGems build procedure used by Ruby packages, which
2273involves running @code{gem build} followed by @code{gem install}.
2274
2275Which Ruby package is used can be specified with the @code{#:ruby}
2276parameter.
2277@end defvr
7458bd0a 2278
a677c726
RW
2279@defvr {Scheme Variable} waf-build-system
2280This variable is exported by @code{(guix build-system waf)}. It
2281implements a build procedure around the @code{waf} script. The common
2282phases---@code{configure}, @code{build}, and @code{install}---are
2283implemented by passing their names as arguments to the @code{waf}
2284script.
2285
2286The @code{waf} script is executed by the Python interpreter. Which
2287Python package is used to run the script can be specified with the
2288@code{#:python} parameter.
2289@end defvr
2290
14dfdf2e
FB
2291@defvr {Scheme Variable} haskell-build-system
2292This variable is exported by @code{(guix build-system haskell)}. It
2293implements the Cabal build procedure used by Haskell packages, which
2294involves running @code{runhaskell Setup.hs configure
2295--prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
2296Instead of installing the package by running @code{runhaskell Setup.hs
2297install}, to avoid trying to register libraries in the read-only
2298compiler store directory, the build system uses @code{runhaskell
2299Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
2300addition, the build system generates the package documentation by
2301running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
2302is passed. Optional Haddock parameters can be passed with the help of
2303the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
2304not found, the build system looks for @code{Setup.lhs} instead.
2305
2306Which Haskell compiler is used can be specified with the @code{#:haskell}
2307parameter which defaults to @code{ghc}.
2308@end defvr
2309
7458bd0a
LC
2310Lastly, for packages that do not need anything as sophisticated, a
2311``trivial'' build system is provided. It is trivial in the sense that
2312it provides basically no support: it does not pull any implicit inputs,
2313and does not have a notion of build phases.
2314
2315@defvr {Scheme Variable} trivial-build-system
2316This variable is exported by @code{(guix build-system trivial)}.
2317
2318This build system requires a @code{#:builder} argument. This argument
2319must be a Scheme expression that builds the package's output(s)---as
2320with @code{build-expression->derivation} (@pxref{Derivations,
2321@code{build-expression->derivation}}).
2322@end defvr
2323
568717fd
LC
2324@node The Store
2325@section The Store
2326
e531ac2a
LC
2327@cindex store
2328@cindex store paths
2329
2330Conceptually, the @dfn{store} is where derivations that have been
834129e0 2331successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a
LC
2332Sub-directories in the store are referred to as @dfn{store paths}. The
2333store has an associated database that contains information such has the
2334store paths referred to by each store path, and the list of @emph{valid}
2335store paths---paths that result from a successful build.
2336
2337The store is always accessed by the daemon on behalf of its clients
2338(@pxref{Invoking guix-daemon}). To manipulate the store, clients
2339connect to the daemon over a Unix-domain socket, send it requests, and
2340read the result---these are remote procedure calls, or RPCs.
2341
2342The @code{(guix store)} module provides procedures to connect to the
2343daemon, and to perform RPCs. These are described below.
2344
2345@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
2346Connect to the daemon over the Unix-domain socket at @var{file}. When
2347@var{reserve-space?} is true, instruct it to reserve a little bit of
2348extra space on the file system so that the garbage collector can still
2349operate, should the disk become full. Return a server object.
2350
2351@var{file} defaults to @var{%default-socket-path}, which is the normal
2352location given the options that were passed to @command{configure}.
2353@end deffn
2354
2355@deffn {Scheme Procedure} close-connection @var{server}
2356Close the connection to @var{server}.
2357@end deffn
2358
2359@defvr {Scheme Variable} current-build-output-port
2360This variable is bound to a SRFI-39 parameter, which refers to the port
2361where build and error logs sent by the daemon should be written.
2362@end defvr
2363
2364Procedures that make RPCs all take a server object as their first
2365argument.
2366
2367@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
2368Return @code{#t} when @var{path} is a valid store path.
2369@end deffn
2370
cfbf9160 2371@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
2372Add @var{text} under file @var{name} in the store, and return its store
2373path. @var{references} is the list of store paths referred to by the
2374resulting store path.
2375@end deffn
2376
874e6874 2377@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
2378Build @var{derivations} (a list of @code{<derivation>} objects or
2379derivation paths), and return when the worker is done building them.
2380Return @code{#t} on success.
874e6874
LC
2381@end deffn
2382
b860f382
LC
2383Note that the @code{(guix monads)} module provides a monad as well as
2384monadic versions of the above procedures, with the goal of making it
2385more convenient to work with code that accesses the store (@pxref{The
2386Store Monad}).
2387
e531ac2a
LC
2388@c FIXME
2389@i{This section is currently incomplete.}
568717fd
LC
2390
2391@node Derivations
2392@section Derivations
2393
874e6874
LC
2394@cindex derivations
2395Low-level build actions and the environment in which they are performed
2396are represented by @dfn{derivations}. A derivation contain the
2397following pieces of information:
2398
2399@itemize
2400@item
2401The outputs of the derivation---derivations produce at least one file or
2402directory in the store, but may produce more.
2403
2404@item
2405The inputs of the derivations, which may be other derivations or plain
2406files in the store (patches, build scripts, etc.)
2407
2408@item
2409The system type targeted by the derivation---e.g., @code{x86_64-linux}.
2410
2411@item
2412The file name of a build script in the store, along with the arguments
2413to be passed.
2414
2415@item
2416A list of environment variables to be defined.
2417
2418@end itemize
2419
2420@cindex derivation path
2421Derivations allow clients of the daemon to communicate build actions to
2422the store. They exist in two forms: as an in-memory representation,
2423both on the client- and daemon-side, and as files in the store whose
2424name end in @code{.drv}---these files are referred to as @dfn{derivation
2425paths}. Derivations paths can be passed to the @code{build-derivations}
2426procedure to perform the build actions they prescribe (@pxref{The
2427Store}).
2428
2429The @code{(guix derivations)} module provides a representation of
2430derivations as Scheme objects, along with procedures to create and
2431otherwise manipulate derivations. The lowest-level primitive to create
2432a derivation is the @code{derivation} procedure:
2433
1909431c
LC
2434@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
2435 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 2436 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 2437 [#:system (%current-system)] [#:references-graphs #f] @
c0468155 2438 [#:allowed-references #f] [#:leaked-env-vars #f] [#:local-build? #f]
59688fc4
LC
2439Build a derivation with the given arguments, and return the resulting
2440@code{<derivation>} object.
874e6874 2441
2096ef47 2442When @var{hash} and @var{hash-algo} are given, a
874e6874 2443@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
2444known in advance, such as a file download. If, in addition,
2445@var{recursive?} is true, then that fixed output may be an executable
2446file or a directory and @var{hash} must be the hash of an archive
2447containing this output.
5b0c9d16 2448
858e9282 2449When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
2450name/store path pairs. In that case, the reference graph of each store
2451path is exported in the build environment in the corresponding file, in
2452a simple text format.
1909431c 2453
b53be755
LC
2454When @var{allowed-references} is true, it must be a list of store items
2455or outputs that the derivation's output may refer to.
2456
c0468155
LC
2457When @var{leaked-env-vars} is true, it must be a list of strings
2458denoting environment variables that are allowed to ``leak'' from the
2459daemon's environment to the build environment. This is only applicable
2460to fixed-output derivations---i.e., when @var{hash} is true. The main
2461use is to allow variables such as @code{http_proxy} to be passed to
2462derivations that download files.
2463
1909431c
LC
2464When @var{local-build?} is true, declare that the derivation is not a
2465good candidate for offloading and should rather be built locally
2466(@pxref{Daemon Offload Setup}). This is the case for small derivations
2467where the costs of data transfers would outweigh the benefits.
874e6874
LC
2468@end deffn
2469
2470@noindent
2471Here's an example with a shell script as its builder, assuming
2472@var{store} is an open connection to the daemon, and @var{bash} points
2473to a Bash executable in the store:
2474
2475@lisp
2476(use-modules (guix utils)
2477 (guix store)
2478 (guix derivations))
2479
59688fc4
LC
2480(let ((builder ; add the Bash script to the store
2481 (add-text-to-store store "my-builder.sh"
2482 "echo hello world > $out\n" '())))
2483 (derivation store "foo"
2484 bash `("-e" ,builder)
21b679f6 2485 #:inputs `((,bash) (,builder))
59688fc4 2486 #:env-vars '(("HOME" . "/homeless"))))
834129e0 2487@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
2488@end lisp
2489
21b679f6
LC
2490As can be guessed, this primitive is cumbersome to use directly. A
2491better approach is to write build scripts in Scheme, of course! The
2492best course of action for that is to write the build code as a
2493``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 2494information, @pxref{G-Expressions}.
21b679f6
LC
2495
2496Once upon a time, @code{gexp->derivation} did not exist and constructing
2497derivations with build code written in Scheme was achieved with
2498@code{build-expression->derivation}, documented below. This procedure
2499is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 2500
dd1a5a15
LC
2501@deffn {Scheme Procedure} build-expression->derivation @var{store} @
2502 @var{name} @var{exp} @
2503 [#:system (%current-system)] [#:inputs '()] @
2504 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 2505 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824
LC
2506 [#:references-graphs #f] [#:allowed-references #f] @
2507 [#:local-build? #f] [#:guile-for-build #f]
874e6874
LC
2508Return a derivation that executes Scheme expression @var{exp} as a
2509builder for derivation @var{name}. @var{inputs} must be a list of
2510@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
2511@code{"out"} is assumed. @var{modules} is a list of names of Guile
2512modules from the current search path to be copied in the store,
2513compiled, and made available in the load path during the execution of
2514@var{exp}---e.g., @code{((guix build utils) (guix build
2515gnu-build-system))}.
2516
2517@var{exp} is evaluated in an environment where @code{%outputs} is bound
2518to a list of output/path pairs, and where @code{%build-inputs} is bound
2519to a list of string/output-path pairs made from @var{inputs}.
2520Optionally, @var{env-vars} is a list of string pairs specifying the name
2521and value of environment variables visible to the builder. The builder
2522terminates by passing the result of @var{exp} to @code{exit}; thus, when
2523@var{exp} returns @code{#f}, the build is considered to have failed.
2524
2525@var{exp} is built using @var{guile-for-build} (a derivation). When
2526@var{guile-for-build} is omitted or is @code{#f}, the value of the
2527@code{%guile-for-build} fluid is used instead.
9c629a27 2528
63a42824
LC
2529See the @code{derivation} procedure for the meaning of
2530@var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
874e6874
LC
2531@end deffn
2532
2533@noindent
2534Here's an example of a single-output derivation that creates a directory
2535containing one file:
2536
2537@lisp
2538(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 2539 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
2540 (call-with-output-file (string-append out "/test")
2541 (lambda (p)
2542 (display '(hello guix) p))))))
dd1a5a15 2543 (build-expression->derivation store "goo" builder))
874e6874 2544
834129e0 2545@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
2546@end lisp
2547
568717fd 2548
b860f382
LC
2549@node The Store Monad
2550@section The Store Monad
2551
2552@cindex monad
2553
2554The procedures that operate on the store described in the previous
2555sections all take an open connection to the build daemon as their first
2556argument. Although the underlying model is functional, they either have
2557side effects or depend on the current state of the store.
2558
2559The former is inconvenient: the connection to the build daemon has to be
2560carried around in all those functions, making it impossible to compose
2561functions that do not take that parameter with functions that do. The
2562latter can be problematic: since store operations have side effects
2563and/or depend on external state, they have to be properly sequenced.
2564
2565@cindex monadic values
2566@cindex monadic functions
2567This is where the @code{(guix monads)} module comes in. This module
2568provides a framework for working with @dfn{monads}, and a particularly
2569useful monad for our uses, the @dfn{store monad}. Monads are a
2570construct that allows two things: associating ``context'' with values
2571(in our case, the context is the store), and building sequences of
561fb6c3 2572computations (here computations include accesses to the store.) Values
b860f382
LC
2573in a monad---values that carry this additional context---are called
2574@dfn{monadic values}; procedures that return such values are called
2575@dfn{monadic procedures}.
2576
2577Consider this ``normal'' procedure:
2578
2579@example
45adbd62
LC
2580(define (sh-symlink store)
2581 ;; Return a derivation that symlinks the 'bash' executable.
2582 (let* ((drv (package-derivation store bash))
2583 (out (derivation->output-path drv))
2584 (sh (string-append out "/bin/bash")))
2585 (build-expression->derivation store "sh"
2586 `(symlink ,sh %output))))
b860f382
LC
2587@end example
2588
c6f30b81
LC
2589Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
2590as a monadic function:
b860f382
LC
2591
2592@example
45adbd62 2593(define (sh-symlink)
b860f382 2594 ;; Same, but return a monadic value.
c6f30b81
LC
2595 (mlet %store-monad ((drv (package->derivation bash)))
2596 (gexp->derivation "sh"
2597 #~(symlink (string-append #$drv "/bin/bash")
2598 #$output))))
b860f382
LC
2599@end example
2600
c6f30b81
LC
2601There several things to note in the second version: the @code{store}
2602parameter is now implicit and is ``threaded'' in the calls to the
2603@code{package->derivation} and @code{gexp->derivation} monadic
2604procedures, and the monadic value returned by @code{package->derivation}
2605is @dfn{bound} using @code{mlet} instead of plain @code{let}.
2606
2607As it turns out, the call to @code{package->derivation} can even be
2608omitted since it will take place implicitly, as we will see later
2609(@pxref{G-Expressions}):
2610
2611@example
2612(define (sh-symlink)
2613 (gexp->derivation "sh"
2614 #~(symlink (string-append #$bash "/bin/bash")
2615 #$output)))
2616@end example
b860f382 2617
8e9aa37f 2618Calling the monadic @code{sh-symlink} has no effect. To get the desired
b860f382
LC
2619effect, one must use @code{run-with-store}:
2620
2621@example
8e9aa37f
CAW
2622(run-with-store (open-connection) (sh-symlink))
2623@result{} /gnu/store/...-sh-symlink
b860f382
LC
2624@end example
2625
b9b86078
LC
2626Note that the @code{(guix monad-repl)} module extends Guile's REPL with
2627new ``meta-commands'' to make it easier to deal with monadic procedures:
2628@code{run-in-store}, and @code{enter-store-monad}. The former, is used
2629to ``run'' a single monadic value through the store:
2630
2631@example
2632scheme@@(guile-user)> ,run-in-store (package->derivation hello)
2633$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2634@end example
2635
2636The latter enters a recursive REPL, where all the return values are
2637automatically run through the store:
2638
2639@example
2640scheme@@(guile-user)> ,enter-store-monad
2641store-monad@@(guile-user) [1]> (package->derivation hello)
2642$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2643store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
2644$3 = "/gnu/store/@dots{}-foo"
2645store-monad@@(guile-user) [1]> ,q
2646scheme@@(guile-user)>
2647@end example
2648
2649@noindent
2650Note that non-monadic values cannot be returned in the
2651@code{store-monad} REPL.
2652
e87f0591
LC
2653The main syntactic forms to deal with monads in general are provided by
2654the @code{(guix monads)} module and are described below.
b860f382
LC
2655
2656@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
2657Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
2658in @var{monad}.
2659@end deffn
2660
2661@deffn {Scheme Syntax} return @var{val}
2662Return a monadic value that encapsulates @var{val}.
2663@end deffn
2664
2665@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
2666@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
2667procedure @var{mproc}@footnote{This operation is commonly referred to as
2668``bind'', but that name denotes an unrelated procedure in Guile. Thus
2669we use this somewhat cryptic symbol inherited from the Haskell
2670language.}.
2671@end deffn
2672
2673@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
2674 @var{body} ...
2675@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
2676 @var{body} ...
2677Bind the variables @var{var} to the monadic values @var{mval} in
2678@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2679``normal'' value @var{val}, as per @code{let}.
2680
2681@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2682(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2683@end deffn
2684
405a9d4e
LC
2685@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
2686Bind @var{mexp} and the following monadic expressions in sequence,
2687returning the result of the last expression.
2688
2689This is akin to @code{mlet}, except that the return values of the
2690monadic expressions are ignored. In that sense, it is analogous to
2691@code{begin}, but applied to monadic expressions.
2692@end deffn
2693
561fb6c3
LC
2694@cindex state monad
2695The @code{(guix monads)} module provides the @dfn{state monad}, which
2696allows an additional value---the state---to be @emph{threaded} through
2697monadic procedure calls.
2698
2699@defvr {Scheme Variable} %state-monad
2700The state monad. Procedures in the state monad can access and change
2701the state that is threaded.
2702
2703Consider the example below. The @code{square} procedure returns a value
2704in the state monad. It returns the square of its argument, but also
2705increments the current state value:
2706
2707@example
2708(define (square x)
2709 (mlet %state-monad ((count (current-state)))
2710 (mbegin %state-monad
2711 (set-current-state (+ 1 count))
2712 (return (* x x)))))
2713
2714(run-with-state (sequence %state-monad (map square (iota 3))) 0)
2715@result{} (0 1 4)
2716@result{} 3
2717@end example
2718
2719When ``run'' through @var{%state-monad}, we obtain that additional state
2720value, which is the number of @code{square} calls.
2721@end defvr
2722
2723@deffn {Monadic Procedure} current-state
2724Return the current state as a monadic value.
2725@end deffn
2726
2727@deffn {Monadic Procedure} set-current-state @var{value}
2728Set the current state to @var{value} and return the previous state as a
2729monadic value.
2730@end deffn
2731
2732@deffn {Monadic Procedure} state-push @var{value}
2733Push @var{value} to the current state, which is assumed to be a list,
2734and return the previous state as a monadic value.
2735@end deffn
2736
2737@deffn {Monadic Procedure} state-pop
2738Pop a value from the current state and return it as a monadic value.
2739The state is assumed to be a list.
2740@end deffn
2741
2742@deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
2743Run monadic value @var{mval} starting with @var{state} as the initial
2744state. Return two values: the resulting value, and the resulting state.
2745@end deffn
2746
e87f0591
LC
2747The main interface to the store monad, provided by the @code{(guix
2748store)} module, is as follows.
b860f382
LC
2749
2750@defvr {Scheme Variable} %store-monad
561fb6c3
LC
2751The store monad---an alias for @var{%state-monad}.
2752
2753Values in the store monad encapsulate accesses to the store. When its
2754effect is needed, a value of the store monad must be ``evaluated'' by
2755passing it to the @code{run-with-store} procedure (see below.)
b860f382
LC
2756@end defvr
2757
2758@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2759Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2760open store connection.
2761@end deffn
2762
ad372953 2763@deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
b860f382 2764Return as a monadic value the absolute file name in the store of the file
ad372953
LC
2765containing @var{text}, a string. @var{references} is a list of store items that the
2766resulting text file refers to; it defaults to the empty list.
45adbd62
LC
2767@end deffn
2768
0a90af15
LC
2769@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2770 [#:recursive? #t]
2771Return the name of @var{file} once interned in the store. Use
2772@var{name} as its store name, or the basename of @var{file} if
2773@var{name} is omitted.
2774
2775When @var{recursive?} is true, the contents of @var{file} are added
2776recursively; if @var{file} designates a flat file and @var{recursive?}
2777is true, its contents are added, and its permission bits are kept.
2778
2779The example below adds a file to the store, under two different names:
2780
2781@example
2782(run-with-store (open-connection)
2783 (mlet %store-monad ((a (interned-file "README"))
2784 (b (interned-file "README" "LEGU-MIN")))
2785 (return (list a b))))
2786
2787@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2788@end example
2789
2790@end deffn
2791
e87f0591
LC
2792The @code{(guix packages)} module exports the following package-related
2793monadic procedures:
2794
b860f382 2795@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
2796 [#:system (%current-system)] [#:target #f] @
2797 [#:output "out"] Return as a monadic
b860f382
LC
2798value in the absolute file name of @var{file} within the @var{output}
2799directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
2800of the @var{output} directory of @var{package}. When @var{target} is
2801true, use it as a cross-compilation target triplet.
b860f382
LC
2802@end deffn
2803
b860f382 2804@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
2805@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2806 @var{target} [@var{system}]
2807Monadic version of @code{package-derivation} and
2808@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
2809@end deffn
2810
2811
21b679f6
LC
2812@node G-Expressions
2813@section G-Expressions
2814
2815@cindex G-expression
2816@cindex build code quoting
2817So we have ``derivations'', which represent a sequence of build actions
2818to be performed to produce an item in the store (@pxref{Derivations}).
2819Those build actions are performed when asking the daemon to actually
2820build the derivations; they are run by the daemon in a container
2821(@pxref{Invoking guix-daemon}).
2822
2823@cindex strata of code
2824It should come as no surprise that we like to write those build actions
2825in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2826code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
2827Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2828Kiselyov, who has written insightful
2829@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2830on this topic}, refers to this kind of code generation as
2831@dfn{staging}.}: the ``host code''---code that defines packages, talks
2832to the daemon, etc.---and the ``build code''---code that actually
2833performs build actions, such as making directories, invoking
2834@command{make}, etc.
21b679f6
LC
2835
2836To describe a derivation and its build actions, one typically needs to
2837embed build code inside host code. It boils down to manipulating build
2838code as data, and Scheme's homoiconicity---code has a direct
2839representation as data---comes in handy for that. But we need more than
2840Scheme's normal @code{quasiquote} mechanism to construct build
2841expressions.
2842
2843The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2844S-expressions adapted to build expressions. G-expressions, or
2845@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2846@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2847@code{#$}, and @code{#$@@}), which are comparable respectively to
2848@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2849(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2850Reference Manual}). However, there are major differences:
2851
2852@itemize
2853@item
2854Gexps are meant to be written to a file and run or manipulated by other
2855processes.
2856
2857@item
b39fc6f7
LC
2858When a high-level object such as a package or derivation is unquoted
2859inside a gexp, the result is as if its output file name had been
2860introduced.
ff40e9b7 2861
21b679f6
LC
2862@item
2863Gexps carry information about the packages or derivations they refer to,
2864and these dependencies are automatically added as inputs to the build
2865processes that use them.
2866@end itemize
2867
b39fc6f7
LC
2868Actually this mechanism is not limited to package and derivation
2869objects; @dfn{compilers} able to ``lower'' other high-level objects to
2870derivations can be defined, such that these objects can also be inserted
d9ae938f
LC
2871into gexps. Another useful type of high-level object that can be
2872inserted in a gexp is @dfn{local files}, which allows files from the
2873local file system to be added to the store and referred to by
2874derivations and such (see @code{local-file} below.)
b39fc6f7 2875
21b679f6
LC
2876To illustrate the idea, here is an example of a gexp:
2877
2878@example
2879(define build-exp
2880 #~(begin
2881 (mkdir #$output)
2882 (chdir #$output)
aff8ce7c 2883 (symlink (string-append #$coreutils "/bin/ls")
21b679f6
LC
2884 "list-files")))
2885@end example
2886
2887This gexp can be passed to @code{gexp->derivation}; we obtain a
2888derivation that builds a directory containing exactly one symlink to
2889@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2890
2891@example
2892(gexp->derivation "the-thing" build-exp)
2893@end example
2894
e20fd1bf 2895As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
2896substituted to the reference to the @var{coreutils} package in the
2897actual build code, and @var{coreutils} is automatically made an input to
2898the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2899output)}) is replaced by a string containing the derivation's output
667b2508
LC
2900directory name.
2901
2902@cindex cross compilation
2903In a cross-compilation context, it is useful to distinguish between
2904references to the @emph{native} build of a package---that can run on the
2905host---versus references to cross builds of a package. To that end, the
2906@code{#+} plays the same role as @code{#$}, but is a reference to a
2907native package build:
2908
2909@example
2910(gexp->derivation "vi"
2911 #~(begin
2912 (mkdir #$output)
2913 (system* (string-append #+coreutils "/bin/ln")
2914 "-s"
2915 (string-append #$emacs "/bin/emacs")
2916 (string-append #$output "/bin/vi")))
2917 #:target "mips64el-linux")
2918@end example
2919
2920@noindent
2921In the example above, the native build of @var{coreutils} is used, so
2922that @command{ln} can actually run on the host; but then the
2923cross-compiled build of @var{emacs} is referenced.
2924
2925The syntactic form to construct gexps is summarized below.
21b679f6
LC
2926
2927@deffn {Scheme Syntax} #~@var{exp}
2928@deffnx {Scheme Syntax} (gexp @var{exp})
2929Return a G-expression containing @var{exp}. @var{exp} may contain one
2930or more of the following forms:
2931
2932@table @code
2933@item #$@var{obj}
2934@itemx (ungexp @var{obj})
b39fc6f7
LC
2935Introduce a reference to @var{obj}. @var{obj} may have one of the
2936supported types, for example a package or a
21b679f6
LC
2937derivation, in which case the @code{ungexp} form is replaced by its
2938output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2939
b39fc6f7
LC
2940If @var{obj} is a list, it is traversed and references to supported
2941objects are substituted similarly.
21b679f6
LC
2942
2943If @var{obj} is another gexp, its contents are inserted and its
2944dependencies are added to those of the containing gexp.
2945
2946If @var{obj} is another kind of object, it is inserted as is.
2947
b39fc6f7
LC
2948@item #$@var{obj}:@var{output}
2949@itemx (ungexp @var{obj} @var{output})
21b679f6 2950This is like the form above, but referring explicitly to the
b39fc6f7
LC
2951@var{output} of @var{obj}---this is useful when @var{obj} produces
2952multiple outputs (@pxref{Packages with Multiple Outputs}).
21b679f6 2953
667b2508
LC
2954@item #+@var{obj}
2955@itemx #+@var{obj}:output
2956@itemx (ungexp-native @var{obj})
2957@itemx (ungexp-native @var{obj} @var{output})
2958Same as @code{ungexp}, but produces a reference to the @emph{native}
2959build of @var{obj} when used in a cross compilation context.
2960
21b679f6
LC
2961@item #$output[:@var{output}]
2962@itemx (ungexp output [@var{output}])
2963Insert a reference to derivation output @var{output}, or to the main
2964output when @var{output} is omitted.
2965
2966This only makes sense for gexps passed to @code{gexp->derivation}.
2967
2968@item #$@@@var{lst}
2969@itemx (ungexp-splicing @var{lst})
2970Like the above, but splices the contents of @var{lst} inside the
2971containing list.
2972
667b2508
LC
2973@item #+@@@var{lst}
2974@itemx (ungexp-native-splicing @var{lst})
2975Like the above, but refers to native builds of the objects listed in
2976@var{lst}.
2977
21b679f6
LC
2978@end table
2979
2980G-expressions created by @code{gexp} or @code{#~} are run-time objects
2981of the @code{gexp?} type (see below.)
2982@end deffn
2983
2984@deffn {Scheme Procedure} gexp? @var{obj}
2985Return @code{#t} if @var{obj} is a G-expression.
2986@end deffn
2987
2988G-expressions are meant to be written to disk, either as code building
2989some derivation, or as plain files in the store. The monadic procedures
2990below allow you to do that (@pxref{The Store Monad}, for more
2991information about monads.)
2992
2993@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
ce45eb4c 2994 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
21b679f6
LC
2995 [#:hash #f] [#:hash-algo #f] @
2996 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 2997 [#:module-path @var{%load-path}] @
c8351d9a 2998 [#:references-graphs #f] [#:allowed-references #f] @
c0468155 2999 [#:leaked-env-vars #f] @
c8351d9a 3000 [#:local-build? #f] [#:guile-for-build #f]
21b679f6 3001Return a derivation @var{name} that runs @var{exp} (a gexp) with
68a61e9f
LC
3002@var{guile-for-build} (a derivation) on @var{system}. When @var{target}
3003is true, it is used as the cross-compilation target triplet for packages
3004referred to by @var{exp}.
21b679f6 3005
ce45eb4c
LC
3006Make @var{modules} available in the evaluation context of @var{exp};
3007@var{modules} is a list of names of Guile modules searched in
3008@var{module-path} to be copied in the store, compiled, and made available in
21b679f6
LC
3009the load path during the execution of @var{exp}---e.g., @code{((guix
3010build utils) (guix build gnu-build-system))}.
3011
ce45eb4c
LC
3012@var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3013applicable.
3014
b53833b2
LC
3015When @var{references-graphs} is true, it must be a list of tuples of one of the
3016following forms:
3017
3018@example
3019(@var{file-name} @var{package})
3020(@var{file-name} @var{package} @var{output})
3021(@var{file-name} @var{derivation})
3022(@var{file-name} @var{derivation} @var{output})
3023(@var{file-name} @var{store-item})
3024@end example
3025
3026The right-hand-side of each element of @var{references-graphs} is automatically made
3027an input of the build process of @var{exp}. In the build environment, each
3028@var{file-name} contains the reference graph of the corresponding item, in a simple
3029text format.
3030
c8351d9a
LC
3031@var{allowed-references} must be either @code{#f} or a list of output names and packages.
3032In the latter case, the list denotes store items that the result is allowed to
3033refer to. Any reference to another store item will lead to a build error.
3034
e20fd1bf 3035The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
3036@end deffn
3037
d9ae938f
LC
3038@deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
3039 [#:recursive? #t]
3040Return an object representing local file @var{file} to add to the store; this
3041object can be used in a gexp. @var{file} will be added to the store under @var{name}--by
3042default the base name of @var{file}.
3043
3044When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
3045designates a flat file and @var{recursive?} is true, its contents are added, and its
3046permission bits are kept.
3047
3048This is the declarative counterpart of the @code{interned-file} monadic
3049procedure (@pxref{The Store Monad, @code{interned-file}}).
3050@end deffn
3051
21b679f6
LC
3052@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
3053Return an executable script @var{name} that runs @var{exp} using
3054@var{guile} with @var{modules} in its search path.
3055
3056The example below builds a script that simply invokes the @command{ls}
3057command:
3058
3059@example
3060(use-modules (guix gexp) (gnu packages base))
3061
3062(gexp->script "list-files"
3063 #~(execl (string-append #$coreutils "/bin/ls")
3064 "ls"))
3065@end example
3066
3067When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 3068@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
3069executable file @file{/gnu/store/@dots{}-list-files} along these lines:
3070
3071@example
3072#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
3073!#
3074(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
3075 "ls")
3076@end example
3077@end deffn
3078
3079@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
3080Return a derivation that builds a file @var{name} containing @var{exp}.
3081
3082The resulting file holds references to all the dependencies of @var{exp}
3083or a subset thereof.
3084@end deffn
1ed19464
LC
3085
3086@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
3087Return as a monadic value a derivation that builds a text file
3088containing all of @var{text}. @var{text} may list, in addition to
d9ae938f
LC
3089strings, objects of any type that can be used in a gexp: packages,
3090derivations, local file objects, etc. The resulting store file holds
3091references to all these.
1ed19464
LC
3092
3093This variant should be preferred over @code{text-file} anytime the file
3094to create will reference items from the store. This is typically the
3095case when building a configuration file that embeds store file names,
3096like this:
3097
3098@example
3099(define (profile.sh)
3100 ;; Return the name of a shell script in the store that
3101 ;; initializes the 'PATH' environment variable.
3102 (text-file* "profile.sh"
3103 "export PATH=" coreutils "/bin:"
3104 grep "/bin:" sed "/bin\n"))
3105@end example
3106
3107In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
3108will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
3109preventing them from being garbage-collected during its lifetime.
3110@end deffn
21b679f6
LC
3111
3112Of course, in addition to gexps embedded in ``host'' code, there are
3113also modules containing build tools. To make it clear that they are
3114meant to be used in the build stratum, these modules are kept in the
3115@code{(guix build @dots{})} name space.
3116
3117
568717fd
LC
3118@c *********************************************************************
3119@node Utilities
3120@chapter Utilities
3121
210cc920
LC
3122This section describes tools primarily targeted at developers and users
3123who write new package definitions. They complement the Scheme
3124programming interface of Guix in a convenient way.
3125
568717fd 3126@menu
37166310 3127* Invoking guix build:: Building packages from the command line.
210cc920 3128* Invoking guix download:: Downloading a file and printing its hash.
37166310 3129* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 3130* Invoking guix import:: Importing package definitions.
37166310 3131* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 3132* Invoking guix lint:: Finding errors in package definitions.
372c4bbc 3133* Invoking guix environment:: Setting up development environments.
aff8ce7c 3134* Invoking guix publish:: Sharing substitutes.
568717fd
LC
3135@end menu
3136
e49951eb
MW
3137@node Invoking guix build
3138@section Invoking @command{guix build}
568717fd 3139
e49951eb 3140The @command{guix build} command builds packages or derivations and
6798a8e4
LC
3141their dependencies, and prints the resulting store paths. Note that it
3142does not modify the user's profile---this is the job of the
e49951eb 3143@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
3144it is mainly useful for distribution developers.
3145
3146The general syntax is:
c78bd12b
LC
3147
3148@example
e49951eb 3149guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
3150@end example
3151
3152@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
3153the software distribution such as @code{coreutils} or
3154@code{coreutils-8.20}, or a derivation such as
834129e0 3155@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
3156package with the corresponding name (and optionally version) is searched
3157for among the GNU distribution modules (@pxref{Package Modules}).
3158
3159Alternatively, the @code{--expression} option may be used to specify a
3160Scheme expression that evaluates to a package; this is useful when
3161disambiguation among several same-named packages or package variants is
3162needed.
c78bd12b
LC
3163
3164The @var{options} may be zero or more of the following:
3165
3166@table @code
3167
3168@item --expression=@var{expr}
3169@itemx -e @var{expr}
ac5de156 3170Build the package or derivation @var{expr} evaluates to.
c78bd12b 3171
5401dd75 3172For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
3173guile-1.8)}, which unambiguously designates this specific variant of
3174version 1.8 of Guile.
3175
56b82106
LC
3176Alternately, @var{expr} may be a G-expression, in which case it is used
3177as a build program passed to @code{gexp->derivation}
3178(@pxref{G-Expressions}).
3179
3180Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
3181(@pxref{The Store Monad}). The procedure must return a derivation as a
3182monadic value, which is then passed through @code{run-with-store}.
3183
c78bd12b
LC
3184@item --source
3185@itemx -S
3186Build the packages' source derivations, rather than the packages
3187themselves.
3188
e49951eb 3189For instance, @code{guix build -S gcc} returns something like
834129e0 3190@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 3191
f9cc8971
LC
3192The returned source tarball is the result of applying any patches and
3193code snippets specified in the package's @code{origin} (@pxref{Defining
3194Packages}).
3195
2cdfe13d
EB
3196@item --sources
3197Fetch and return the source of @var{package-or-derivation} and all their
3198dependencies, recursively. This is a handy way to obtain a local copy
3199of all the source code needed to build @var{packages}, allowing you to
3200eventually build them even without network access. It is an extension
3201of the @code{--source} option and can accept one of the following
3202optional argument values:
3203
3204@table @code
3205@item package
3206This value causes the @code{--sources} option to behave in the same way
3207as the @code{--source} option.
3208
3209@item all
3210Build all packages' source derivations, including any source that might
3211be listed as @code{inputs}. This is the default value.
3212
3213@example
3214$ guix build --sources tzdata
3215The following derivations will be built:
3216 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
3217 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3218@end example
3219
3220@item transitive
3221Build all packages' source derivations, as well as all source
3222derivations for packages' transitive inputs. This can be used e.g. to
3223prefetch package source for later offline building.
3224
3225@example
3226$ guix build --sources=transitive tzdata
3227The following derivations will be built:
3228 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3229 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
3230 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
3231 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
3232 /gnu/store/@dots{}-make-4.1.tar.xz.drv
3233 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
3234@dots{}
3235@end example
3236
3237@end table
3238
c78bd12b
LC
3239@item --system=@var{system}
3240@itemx -s @var{system}
3241Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
3242the host's system type.
3243
3244An example use of this is on Linux-based systems, which can emulate
3245different personalities. For instance, passing
3246@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
3247to build packages in a complete 32-bit environment.
3248
e55ec43d
LC
3249@item --target=@var{triplet}
3250@cindex cross-compilation
3251Cross-build for @var{triplet}, which must be a valid GNU triplet, such
3252as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
3253configuration triplets,, configure, GNU Configure and Build System}).
3254
7f3673f2
LC
3255@item --with-source=@var{source}
3256Use @var{source} as the source of the corresponding package.
3257@var{source} must be a file name or a URL, as for @command{guix
3258download} (@pxref{Invoking guix download}).
3259
3260The ``corresponding package'' is taken to be one specified on the
3261command line whose name matches the base of @var{source}---e.g., if
3262@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
3263package is @code{guile}. Likewise, the version string is inferred from
3264@var{source}; in the previous example, it's @code{2.0.10}.
3265
3266This option allows users to try out versions of packages other than the
3267one provided by the distribution. The example below downloads
3268@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
3269the @code{ed} package:
3270
3271@example
3272guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
3273@end example
3274
3275As a developer, @code{--with-source} makes it easy to test release
3276candidates:
3277
3278@example
3279guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
3280@end example
3281
05962f29
LC
3282@item --no-grafts
3283Do not ``graft'' packages. In practice, this means that package updates
3284available as grafts are not applied. @xref{Security Updates}, for more
3285information on grafts.
7f3673f2 3286
c78bd12b
LC
3287@item --derivations
3288@itemx -d
3289Return the derivation paths, not the output paths, of the given
3290packages.
3291
70ee5642
LC
3292@item --root=@var{file}
3293@itemx -r @var{file}
3294Make @var{file} a symlink to the result, and register it as a garbage
3295collector root.
3296
3297@item --log-file
3298Return the build log file names for the given
3299@var{package-or-derivation}s, or raise an error if build logs are
3300missing.
3301
3302This works regardless of how packages or derivations are specified. For
3303instance, the following invocations are equivalent:
3304
3305@example
3306guix build --log-file `guix build -d guile`
3307guix build --log-file `guix build guile`
3308guix build --log-file guile
3309guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
3310@end example
3311
3312
3313@end table
3314
3315@cindex common build options
3316In addition, a number of options that control the build process are
3317common to @command{guix build} and other commands that can spawn builds,
3318such as @command{guix package} or @command{guix archive}. These are the
3319following:
3320
3321@table @code
3322
300868ba
LC
3323@item --load-path=@var{directory}
3324@itemx -L @var{directory}
3325Add @var{directory} to the front of the package module search path
3326(@pxref{Package Modules}).
3327
3328This allows users to define their own packages and make them visible to
3329the command-line tools.
3330
c78bd12b
LC
3331@item --keep-failed
3332@itemx -K
3333Keep the build tree of failed builds. Thus, if a build fail, its build
3334tree is kept under @file{/tmp}, in a directory whose name is shown at
3335the end of the build log. This is useful when debugging build issues.
3336
3337@item --dry-run
3338@itemx -n
3339Do not build the derivations.
3340
56b1f4b7
LC
3341@item --fallback
3342When substituting a pre-built binary fails, fall back to building
3343packages locally.
3344
c78bd12b 3345@item --no-substitutes
b5385b52 3346Do not use substitutes for build products. That is, always build things
c4202d60
LC
3347locally instead of allowing downloads of pre-built binaries
3348(@pxref{Substitutes}).
c78bd12b 3349
425b0bfc 3350@item --no-build-hook
4ec2e92d
LC
3351Do not attempt to offload builds @i{via} the daemon's ``build hook''
3352(@pxref{Daemon Offload Setup}). That is, always build things locally
3353instead of offloading builds to remote machines.
425b0bfc 3354
969e678e
LC
3355@item --max-silent-time=@var{seconds}
3356When the build or substitution process remains silent for more than
3357@var{seconds}, terminate it and report a build failure.
3358
002622b6
LC
3359@item --timeout=@var{seconds}
3360Likewise, when the build or substitution process lasts for more than
3361@var{seconds}, terminate it and report a build failure.
3362
3363By default there is no timeout. This behavior can be restored with
3364@code{--timeout=0}.
3365
07ab4bf1
LC
3366@item --verbosity=@var{level}
3367Use the given verbosity level. @var{level} must be an integer between 0
3368and 5; higher means more verbose output. Setting a level of 4 or more
3369may be helpful when debugging setup issues with the build daemon.
3370
70ee5642
LC
3371@item --cores=@var{n}
3372@itemx -c @var{n}
3373Allow the use of up to @var{n} CPU cores for the build. The special
3374value @code{0} means to use as many CPU cores as available.
bf421152 3375
f6526eb3
LC
3376@item --max-jobs=@var{n}
3377@itemx -M @var{n}
3378Allow at most @var{n} build jobs in parallel. @xref{Invoking
3379guix-daemon, @code{--max-jobs}}, for details about this option and the
3380equivalent @command{guix-daemon} option.
3381
c78bd12b
LC
3382@end table
3383
e49951eb 3384Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
3385the @code{package-derivation} procedure of the @code{(guix packages)}
3386module, and to the @code{build-derivations} procedure of the @code{(guix
01d8ac64 3387derivations)} module.
c78bd12b 3388
16eb115e
DP
3389In addition to options explicitly passed on the command line,
3390@command{guix build} and other @command{guix} commands that support
3391building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
3392
3393@defvr {Environment Variable} GUIX_BUILD_OPTIONS
3394Users can define this variable to a list of command line options that
3395will automatically be used by @command{guix build} and other
3396@command{guix} commands that can perform builds, as in the example
3397below:
3398
3399@example
3400$ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
3401@end example
3402
847391fe
DP
3403These options are parsed independently, and the result is appended to
3404the parsed command-line options.
16eb115e
DP
3405@end defvr
3406
3407
210cc920
LC
3408@node Invoking guix download
3409@section Invoking @command{guix download}
3410
3411When writing a package definition, developers typically need to download
3412the package's source tarball, compute its SHA256 hash, and write that
3413hash in the package definition (@pxref{Defining Packages}). The
3414@command{guix download} tool helps with this task: it downloads a file
3415from the given URI, adds it to the store, and prints both its file name
3416in the store and its SHA256 hash.
3417
3418The fact that the downloaded file is added to the store saves bandwidth:
3419when the developer eventually tries to build the newly defined package
3420with @command{guix build}, the source tarball will not have to be
3421downloaded again because it is already in the store. It is also a
3422convenient way to temporarily stash files, which may be deleted
3423eventually (@pxref{Invoking guix gc}).
3424
3425The @command{guix download} command supports the same URIs as used in
3426package definitions. In particular, it supports @code{mirror://} URIs.
3427@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
3428Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
3429they are not available, an error is raised. @xref{Guile Preparations,
3430how to install the GnuTLS bindings for Guile,, gnutls-guile,
3431GnuTLS-Guile}, for more information.
210cc920
LC
3432
3433The following option is available:
3434
3435@table @code
3436@item --format=@var{fmt}
3437@itemx -f @var{fmt}
3438Write the hash in the format specified by @var{fmt}. For more
081145cf 3439information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
3440@end table
3441
6c365eca
NK
3442@node Invoking guix hash
3443@section Invoking @command{guix hash}
3444
210cc920 3445The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
3446It is primarily a convenience tool for anyone contributing to the
3447distribution: it computes the cryptographic hash of a file, which can be
3448used in the definition of a package (@pxref{Defining Packages}).
3449
3450The general syntax is:
3451
3452@example
3453guix hash @var{option} @var{file}
3454@end example
3455
3456@command{guix hash} has the following option:
3457
3458@table @code
3459
3460@item --format=@var{fmt}
3461@itemx -f @var{fmt}
210cc920 3462Write the hash in the format specified by @var{fmt}.
6c365eca
NK
3463
3464Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
3465(@code{hex} and @code{hexadecimal} can be used as well).
3466
3467If the @option{--format} option is not specified, @command{guix hash}
3468will output the hash in @code{nix-base32}. This representation is used
3469in the definitions of packages.
3470
3140f2df
LC
3471@item --recursive
3472@itemx -r
3473Compute the hash on @var{file} recursively.
3474
3475In this case, the hash is computed on an archive containing @var{file},
3476including its children if it is a directory. Some of @var{file}'s
3477meta-data is part of the archive; for instance, when @var{file} is a
3478regular file, the hash is different depending on whether @var{file} is
3479executable or not. Meta-data such as time stamps has no impact on the
3480hash (@pxref{Invoking guix archive}).
3481@c FIXME: Replace xref above with xref to an ``Archive'' section when
3482@c it exists.
3483
6c365eca
NK
3484@end table
3485
2f7d2d91
LC
3486@node Invoking guix import
3487@section Invoking @command{guix import}
3488
3489@cindex importing packages
3490@cindex package import
3491@cindex package conversion
3492The @command{guix import} command is useful for people willing to add a
3493package to the distribution but who'd rather do as little work as
3494possible to get there---a legitimate demand. The command knows of a few
3495repositories from which it can ``import'' package meta-data. The result
3496is a package definition, or a template thereof, in the format we know
3497(@pxref{Defining Packages}).
3498
3499The general syntax is:
3500
3501@example
3502guix import @var{importer} @var{options}@dots{}
3503@end example
3504
3505@var{importer} specifies the source from which to import package
3506meta-data, and @var{options} specifies a package identifier and other
3507options specific to @var{importer}. Currently, the available
3508``importers'' are:
3509
3510@table @code
3511@item gnu
3512Import meta-data for the given GNU package. This provides a template
3513for the latest version of that GNU package, including the hash of its
3514source tarball, and its canonical synopsis and description.
3515
3516Additional information such as the package's dependencies and its
3517license needs to be figured out manually.
3518
3519For example, the following command returns a package definition for
3520GNU@tie{}Hello:
3521
3522@example
3523guix import gnu hello
3524@end example
3525
3526Specific command-line options are:
3527
3528@table @code
3529@item --key-download=@var{policy}
3530As for @code{guix refresh}, specify the policy to handle missing OpenPGP
3531keys when verifying the package's signature. @xref{Invoking guix
3532refresh, @code{--key-download}}.
3533@end table
3534
3535@item pypi
3536@cindex pypi
3537Import meta-data from the @uref{https://pypi.python.org/, Python Package
3538Index}@footnote{This functionality requires Guile-JSON to be installed.
3539@xref{Requirements}.}. Information is taken from the JSON-formatted
3540description available at @code{pypi.python.org} and usually includes all
3541the relevant information, including package dependencies.
3542
3543The command below imports meta-data for the @code{itsdangerous} Python
3544package:
3545
3546@example
3547guix import pypi itsdangerous
3548@end example
3549
d45dc6da
EB
3550@item cpan
3551@cindex CPAN
3552Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}.
3553Information is taken from the JSON-formatted meta-data provided through
3554@uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
66392e47
EB
3555relevant information, such as module dependencies. License information
3556should be checked closely. If Perl is available in the store, then the
3557@code{corelist} utility will be used to filter core modules out of the
3558list of dependencies.
d45dc6da
EB
3559
3560The command command below imports meta-data for the @code{Acme::Boolean}
3561Perl module:
3562
3563@example
3564guix import cpan Acme::Boolean
3565@end example
3566
2f7d2d91
LC
3567@item nix
3568Import meta-data from a local copy of the source of the
3569@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
3570relies on the @command{nix-instantiate} command of
3571@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
3572typically written in a mixture of Nix-language and Bash code. This
3573command only imports the high-level package structure that is written in
3574the Nix language. It normally includes all the basic fields of a
3575package definition.
3576
3577When importing a GNU package, the synopsis and descriptions are replaced
3578by their canonical upstream variant.
3579
3580As an example, the command below imports the package definition of
3581LibreOffice (more precisely, it imports the definition of the package
3582bound to the @code{libreoffice} top-level attribute):
3583
3584@example
3585guix import nix ~/path/to/nixpkgs libreoffice
3586@end example
863af4e1
FB
3587
3588@item hackage
3589@cindex hackage
3590Import meta-data from Haskell community's central package archive
3591@uref{https://hackage.haskell.org/, Hackage}. Information is taken from
3592Cabal files and includes all the relevant information, including package
3593dependencies.
3594
3595Specific command-line options are:
3596
3597@table @code
3598@item --no-test-dependencies
3599@itemx -t
3600Do not include dependencies only required to run the test suite.
3601@end table
3602
3603The command below imports meta-data for the latest version of the
3604@code{HTTP} Haskell package without including test dependencies:
3605
3606@example
3607guix import hackage -t HTTP
3608@end example
3609
3610A specific package version may optionally be specified by following the
3611package name by a hyphen and a version number as in the following example:
3612
3613@example
3614guix import hackage mtl-2.1.3.1
3615@end example
3616
3617Currently only indentation structured Cabal files are supported.
2f7d2d91
LC
3618@end table
3619
3620The structure of the @command{guix import} code is modular. It would be
3621useful to have more importers for other package formats, and your help
3622is welcome here (@pxref{Contributing}).
3623
37166310
LC
3624@node Invoking guix refresh
3625@section Invoking @command{guix refresh}
3626
3627The primary audience of the @command{guix refresh} command is developers
3628of the GNU software distribution. By default, it reports any packages
3629provided by the distribution that are outdated compared to the latest
3630upstream version, like this:
3631
3632@example
3633$ guix refresh
3634gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
3635gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
3636@end example
3637
3638It does so by browsing each package's FTP directory and determining the
3639highest version number of the source tarballs
3640therein@footnote{Currently, this only works for GNU packages.}.
3641
3642When passed @code{--update}, it modifies distribution source files to
3643update the version numbers and source tarball hashes of those packages'
3644recipes (@pxref{Defining Packages}). This is achieved by downloading
3645each package's latest source tarball and its associated OpenPGP
3646signature, authenticating the downloaded tarball against its signature
3647using @command{gpg}, and finally computing its hash. When the public
3648key used to sign the tarball is missing from the user's keyring, an
3649attempt is made to automatically retrieve it from a public key server;
3650when it's successful, the key is added to the user's keyring; otherwise,
3651@command{guix refresh} reports an error.
3652
3653The following options are supported:
3654
3655@table @code
3656
3657@item --update
3658@itemx -u
3659Update distribution source files (package recipes) in place.
081145cf 3660@xref{Defining Packages}, for more information on package definitions.
37166310
LC
3661
3662@item --select=[@var{subset}]
3663@itemx -s @var{subset}
3664Select all the packages in @var{subset}, one of @code{core} or
3665@code{non-core}.
3666
3667The @code{core} subset refers to all the packages at the core of the
3668distribution---i.e., packages that are used to build ``everything
3669else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
3670changing one of these packages in the distribution entails a rebuild of
3671all the others. Thus, such updates are an inconvenience to users in
3672terms of build time or bandwidth used to achieve the upgrade.
3673
3674The @code{non-core} subset refers to the remaining packages. It is
3675typically useful in cases where an update of the core packages would be
3676inconvenient.
3677
3678@end table
3679
3680In addition, @command{guix refresh} can be passed one or more package
3681names, as in this example:
3682
3683@example
4b9b3cbb 3684guix refresh -u emacs idutils gcc-4.8.4
37166310
LC
3685@end example
3686
3687@noindent
3688The command above specifically updates the @code{emacs} and
3689@code{idutils} packages. The @code{--select} option would have no
3690effect in this case.
3691
7d193ec3
EB
3692When considering whether to upgrade a package, it is sometimes
3693convenient to know which packages would be affected by the upgrade and
3694should be checked for compatibility. For this the following option may
3695be used when passing @command{guix refresh} one or more package names:
3696
3697@table @code
3698
3699@item --list-dependent
3700@itemx -l
3701List top-level dependent packages that would need to be rebuilt as a
3702result of upgrading one or more packages.
3703
3704@end table
3705
3706Be aware that the @code{--list-dependent} option only
3707@emph{approximates} the rebuilds that would be required as a result of
3708an upgrade. More rebuilds might be required under some circumstances.
3709
3710@example
7779ab61
LC
3711$ guix refresh --list-dependent flex
3712Building the following 120 packages would ensure 213 dependent packages are rebuilt:
3713hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
3714@end example
3715
3716The command above lists a set of packages that could be built to check
3717for compatibility with an upgraded @code{flex} package.
3718
f9230085
LC
3719The following options can be used to customize GnuPG operation:
3720
3721@table @code
3722
f9230085
LC
3723@item --gpg=@var{command}
3724Use @var{command} as the GnuPG 2.x command. @var{command} is searched
3725for in @code{$PATH}.
3726
2bc53ba9
LC
3727@item --key-download=@var{policy}
3728Handle missing OpenPGP keys according to @var{policy}, which may be one
3729of:
3730
3731@table @code
3732@item always
3733Always download missing OpenPGP keys from the key server, and add them
3734to the user's GnuPG keyring.
3735
3736@item never
3737Never try to download missing OpenPGP keys. Instead just bail out.
3738
3739@item interactive
3740When a package signed with an unknown OpenPGP key is encountered, ask
3741the user whether to download it or not. This is the default behavior.
3742@end table
3743
3744@item --key-server=@var{host}
3745Use @var{host} as the OpenPGP key server when importing a public key.
3746
f9230085
LC
3747@end table
3748
b4f5e0e8
CR
3749@node Invoking guix lint
3750@section Invoking @command{guix lint}
3751The @command{guix lint} is meant to help package developers avoid common
873c4085
LC
3752errors and use a consistent style. It runs a number of checks on a
3753given set of packages in order to find common mistakes in their
3754definitions. Available @dfn{checkers} include (see
3755@code{--list-checkers} for a complete list):
3756
3757@table @code
3758@item synopsis
3759@itemx description
3760Validate certain typographical and stylistic rules about package
3761descriptions and synopses.
3762
3763@item inputs-should-be-native
3764Identify inputs that should most likely be native inputs.
3765
3766@item source
3767@itemx home-page
3768Probe @code{home-page} and @code{source} URLs and report those that are
3769invalid.
3770@end table
b4f5e0e8
CR
3771
3772The general syntax is:
3773
3774@example
3775guix lint @var{options} @var{package}@dots{}
3776@end example
3777
3778If no package is given on the command line, then all packages are checked.
3779The @var{options} may be zero or more of the following:
3780
3781@table @code
3782
dd7c013d
CR
3783@item --checkers
3784@itemx -c
3785Only enable the checkers specified in a comma-separated list using the
3786names returned by @code{--list-checkers}.
3787
b4f5e0e8
CR
3788@item --list-checkers
3789@itemx -l
3790List and describe all the available checkers that will be run on packages
3791and exit.
3792
3793@end table
37166310 3794
372c4bbc
DT
3795@node Invoking guix environment
3796@section Invoking @command{guix environment}
3797
f5fd4fd2 3798@cindex reproducible build environments
372c4bbc
DT
3799The purpose of @command{guix environment} is to assist hackers in
3800creating reproducible development environments without polluting their
3801package profile. The @command{guix environment} tool takes one or more
3802packages, builds all of the necessary inputs, and creates a shell
3803environment to use them.
3804
3805The general syntax is:
3806
3807@example
3808guix environment @var{options} @var{package}@dots{}
3809@end example
3810
3811The following examples spawns a new shell that is capable of building
3812the GNU Guile source code:
3813
3814@example
3815guix environment guile
3816@end example
3817
3818If the specified packages are not built yet, @command{guix environment}
3819automatically builds them. The new shell's environment is an augmented
3820version of the environment that @command{guix environment} was run in.
3821It contains the necessary search paths for building the given package
3822added to the existing environment variables. To create a ``pure''
3823environment in which the original environment variables have been unset,
3824use the @code{--pure} option.
3825
3826Additionally, more than one package may be specified, in which case the
3827union of the inputs for the given packages are used. For example, the
3828command below spawns a shell where all of the dependencies of both Guile
3829and Emacs are available:
3830
3831@example
3832guix environment guile emacs
3833@end example
3834
3835Sometimes an interactive shell session is not desired. The
3836@code{--exec} option can be used to specify the command to run instead.
3837
3838@example
3839guix environment guile --exec=make
3840@end example
3841
3842The following options are available:
3843
3844@table @code
3845@item --expression=@var{expr}
3846@itemx -e @var{expr}
3847Create an environment for the package that @var{expr} evaluates to.
3848
3849@item --load=@var{file}
3850@itemx -l @var{file}
3851Create an environment for the package that the code within @var{file}
3852evaluates to.
3853
3854@item --exec=@var{command}
3855@item -E @var{command}
3856Execute @var{command} in the new environment.
3857
3858@item --pure
3859Unset existing environment variables when building the new environment.
3860This has the effect of creating an environment in which search paths
3861only contain package inputs.
3862
3863@item --search-paths
3864Display the environment variable definitions that make up the
3865environment.
3866@end table
3867
3868It also supports all of the common build options that @command{guix
3869build} supports (@pxref{Invoking guix build, common build options}).
3870
aff8ce7c
DT
3871@node Invoking guix publish
3872@section Invoking @command{guix publish}
3873
3874The purpose of @command{guix publish} is to enable users to easily share
8ce229fc
LC
3875their store with others, which can then use it as a substitute server
3876(@pxref{Substitutes}).
3877
3878When @command{guix publish} runs, it spawns an HTTP server which allows
3879anyone with network access to obtain substitutes from it. This means
3880that any machine running Guix can also act as if it were a build farm,
3881since the HTTP interface is compatible with Hydra, the software behind
3882the @code{hydra.gnu.org} build farm.
aff8ce7c
DT
3883
3884For security, each substitute is signed, allowing recipients to check
3885their authenticity and integrity (@pxref{Substitutes}). Because
3886@command{guix publish} uses the system's signing key, which is only
5463fe51
LC
3887readable by the system administrator, it must be started as root; the
3888@code{--user} option makes it drop root privileges early on.
aff8ce7c
DT
3889
3890The general syntax is:
3891
3892@example
3893guix publish @var{options}@dots{}
3894@end example
3895
3896Running @command{guix publish} without any additional arguments will
3897spawn an HTTP server on port 8080:
3898
3899@example
3900guix publish
3901@end example
3902
3903Once a publishing server has been authorized (@pxref{Invoking guix
3904archive}), the daemon may download substitutes from it:
3905
3906@example
3907guix-daemon --substitute-urls=http://example.org:8080
3908@end example
3909
3910The following options are available:
3911
3912@table @code
3913@item --port=@var{port}
3914@itemx -p @var{port}
3915Listen for HTTP requests on @var{port}.
3916
9e2292ef
LC
3917@item --listen=@var{host}
3918Listen on the network interface for @var{host}. The default is to
3919accept connections from any interface.
3920
5463fe51
LC
3921@item --user=@var{user}
3922@itemx -u @var{user}
3923Change privileges to @var{user} as soon as possible---i.e., once the
3924server socket is open and the signing key has been read.
3925
aff8ce7c
DT
3926@item --repl[=@var{port}]
3927@itemx -r [@var{port}]
3928Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
8ce229fc
LC
3929Reference Manual}) on @var{port} (37146 by default). This is used
3930primarily for debugging a running @command{guix publish} server.
aff8ce7c
DT
3931@end table
3932
a1ba8475
LC
3933@c *********************************************************************
3934@node GNU Distribution
3935@chapter GNU Distribution
3936
3ca2731c 3937@cindex Guix System Distribution
4705641f 3938@cindex GuixSD
3ca2731c
LC
3939Guix comes with a distribution of the GNU system consisting entirely of
3940free software@footnote{The term ``free'' here refers to the
a1ba8475 3941@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
3ca2731c 3942users of that software}.}. The
35ed9306
LC
3943distribution can be installed on its own (@pxref{System Installation}),
3944but it is also possible to install Guix as a package manager on top of
3945an installed GNU/Linux system (@pxref{Installation}). To distinguish
3ca2731c 3946between the two, we refer to the standalone distribution as the Guix
4705641f 3947System Distribution, or GuixSD.
35ed9306
LC
3948
3949The distribution provides core GNU packages such as GNU libc, GCC, and
3950Binutils, as well as many GNU and non-GNU applications. The complete
3951list of available packages can be browsed
d03bb653
LC
3952@url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
3953running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
3954
3955@example
e49951eb 3956guix package --list-available
a1ba8475
LC
3957@end example
3958
35ed9306 3959Our goal has been to provide a practical 100% free software distribution of
401c53c4
LC
3960Linux-based and other variants of GNU, with a focus on the promotion and
3961tight integration of GNU components, and an emphasis on programs and
3962tools that help users exert that freedom.
3963
3ca2731c 3964Packages are currently available on the following platforms:
c320011d
LC
3965
3966@table @code
3967
3968@item x86_64-linux
3969Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
3970
3971@item i686-linux
3972Intel 32-bit architecture (IA32), Linux-Libre kernel;
3973
aa1e1947
MW
3974@item armhf-linux
3975ARMv7-A architecture with hard float, Thumb-2 and VFP3D16 coprocessor,
3976using the EABI hard-float ABI, and Linux-Libre kernel.
3977
c320011d
LC
3978@item mips64el-linux
3979little-endian 64-bit MIPS processors, specifically the Loongson series,
3980n32 application binary interface (ABI), and Linux-Libre kernel.
3981
3982@end table
3983
4705641f 3984GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
3ca2731c 3985
c320011d
LC
3986@noindent
3987For information on porting to other architectures or kernels,
3988@xref{Porting}.
3989
401c53c4 3990@menu
5af6de3e 3991* System Installation:: Installing the whole operating system.
35ed9306 3992* System Configuration:: Configuring the operating system.
91ef73d4 3993* Installing Debugging Files:: Feeding the debugger.
05962f29 3994* Security Updates:: Deploying security fixes quickly.
401c53c4 3995* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 3996* Packaging Guidelines:: Growing the distribution.
401c53c4 3997* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 3998* Porting:: Targeting another platform or kernel.
401c53c4
LC
3999@end menu
4000
4001Building this distribution is a cooperative effort, and you are invited
081145cf 4002to join! @xref{Contributing}, for information about how you can help.
401c53c4 4003
5af6de3e
LC
4004@node System Installation
4005@section System Installation
4006
3ca2731c
LC
4007@cindex Guix System Distribution
4008This section explains how to install the Guix System Distribution
4009on a machine. The Guix package manager can
35ed9306
LC
4010also be installed on top of a running GNU/Linux system,
4011@pxref{Installation}.
5af6de3e
LC
4012
4013@ifinfo
4014@c This paragraph is for people reading this from tty2 of the
4015@c installation image.
4016You're reading this documentation with an Info reader. For details on
4017how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 4018link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
4019@kbd{l} afterwards to come back here.
4020@end ifinfo
4021
8aaaae38
LC
4022@subsection Limitations
4023
4705641f 4024As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
3ca2731c 4025not production-ready. It may contain bugs and lack important
8aaaae38
LC
4026features. Thus, if you are looking for a stable production system that
4027respects your freedom as a computer user, a good solution at this point
4028is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
4029more established GNU/Linux distributions}. We hope you can soon switch
4705641f 4030to the GuixSD without fear, of course. In the meantime, you can
8aaaae38
LC
4031also keep using your distribution and try out the package manager on top
4032of it (@pxref{Installation}).
4033
4034Before you proceed with the installation, be aware of the following
4035noteworthy limitations applicable to version @value{VERSION}:
4036
4037@itemize
4038@item
4039The installation process does not include a graphical user interface and
4040requires familiarity with GNU/Linux (see the following subsections to
4041get a feel of what that means.)
4042
4043@item
b1e95eca
LC
4044The system does not yet provide GNOME and KDE; it provides Xfce, though,
4045if graphical desktop environments are your thing.
8aaaae38
LC
4046
4047@item
dbcb0ab1 4048Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
4049
4050@item
4051Few system services are currently supported out-of-the-box
4052(@pxref{Services}).
4053
4054@item
49607566 4055On the order of 1,900 packages are available, which means that you may
8aaaae38
LC
4056occasionally find that a useful package is missing.
4057@end itemize
4058
4059You've been warned. But more than a disclaimer, this is an invitation
4060to report issues (and success stories!), and join us in improving it.
4061@xref{Contributing}, for more info.
5af6de3e
LC
4062
4063@subsection USB Stick Installation
4064
4065An installation image for USB sticks can be downloaded from
4705641f 4066@indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
5af6de3e
LC
4067where @var{system} is one of:
4068
4069@table @code
4070@item x86_64-linux
4071for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
4072
4073@item i686-linux
4074for a 32-bit GNU/Linux system on Intel-compatible CPUs.
4075@end table
4076
4077This image contains a single partition with the tools necessary for an
4078installation. It is meant to be copied @emph{as is} to a large-enough
4079USB stick.
4080
4081To copy the image to a USB stick, follow these steps:
4082
4083@enumerate
4084@item
4085Decompress the image using the @command{xz} command:
4086
4087@example
4705641f 4088xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
5af6de3e
LC
4089@end example
4090
4091@item
4092Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
4093its device name. Assuming that USB stick is known as @file{/dev/sdX},
4094copy the image with:
4095
4096@example
4705641f 4097dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
4098@end example
4099
4100Access to @file{/dev/sdX} usually requires root privileges.
4101@end enumerate
4102
4103Once this is done, you should be able to reboot the system and boot from
4104the USB stick. The latter usually requires you to get in the BIOS' boot
4105menu, where you can choose to boot from the USB stick.
4106
4107@subsection Preparing for Installation
4108
4109Once you have successfully booted the image on the USB stick, you should
4110end up with a root prompt. Several console TTYs are configured and can
4111be used to run commands as root. TTY2 shows this documentation,
4112browsable using the Info reader commands (@pxref{Help,,, info, Info: An
4113Introduction}).
4114
4115To install the system, you would:
4116
4117@enumerate
4118
4119@item
152dd61c
LC
4120Configure the network, by running @command{ifconfig eno1 up && dhclient
4121eno1} (to get an automatically assigned IP address from the wired
4122network interface controller@footnote{
95c559c1
LC
4123@c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
4124The name @code{eno1} is for the first on-board Ethernet controller. The
4125interface name for an Ethernet controller that is in the first slot of
4126the first PCI bus, for instance, would be @code{enp1s0}. Use
4127@command{ifconfig -a} to list all the available network interfaces.}),
4128or using the @command{ifconfig} command.
5af6de3e
LC
4129
4130The system automatically loads drivers for your network interface
4131controllers.
4132
4133Setting up network access is almost always a requirement because the
4134image does not contain all the software and tools that may be needed.
4135
4136@item
4137Unless this has already been done, you must partition and format the
4138target partitions.
4139
7ab44369
LC
4140Preferably, assign partitions a label so that you can easily and
4141reliably refer to them in @code{file-system} declarations (@pxref{File
4142Systems}). This is typically done using the @code{-L} option of
4143@command{mkfs.ext4} and related commands.
4144
5af6de3e 4145The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
4146Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
4147encryption, and e2fsprogs, the suite of tools to manipulate
4148ext2/ext3/ext4 file systems.
5af6de3e 4149
83a17b62
LC
4150@item
4151Once that is done, mount the target root partition under @file{/mnt}.
4152
4153@item
4154Lastly, run @code{deco start cow-store /mnt}.
4155
4156This will make @file{/gnu/store} copy-on-write, such that packages added
4157to it during the installation phase will be written to the target disk
4158rather than kept in memory.
4159
5af6de3e
LC
4160@end enumerate
4161
5af6de3e
LC
4162
4163@subsection Proceeding with the Installation
4164
4165With the target partitions ready, you now have to edit a file and
4166provide the declaration of the operating system to be installed. To
4167that end, the installation system comes with two text editors: GNU nano
4168(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
4169It is better to store that file on the target root file system, say, as
4170@file{/mnt/etc/config.scm}.
4171
dd51caac
LC
4172@xref{Using the Configuration System}, for examples of operating system
4173configurations. These examples are available under
4174@file{/etc/configuration} in the installation image, so you can copy
4175them and use them as a starting point for your own configuration.
5af6de3e 4176
dd51caac
LC
4177Once you are done preparing the configuration file, the new system must
4178be initialized (remember that the target root file system is mounted
4179under @file{/mnt}):
5af6de3e
LC
4180
4181@example
4182guix system init /mnt/etc/config.scm /mnt
4183@end example
4184
4185@noindent
4186This will copy all the necessary files, and install GRUB on
4187@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 4188more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
4189downloads or builds of missing packages, which can take some time.
4190
4191Once that command has completed---and hopefully succeeded!---you can
ad14d9e7 4192run @command{reboot} and boot into the new system. Cross fingers, and
5af6de3e
LC
4193join us on @code{#guix} on the Freenode IRC network or on
4194@file{guix-devel@@gnu.org} to share your experience---good or not so
4195good.
4196
4197@subsection Building the Installation Image
4198
4199The installation image described above was built using the @command{guix
4200system} command, specifically:
4201
4202@example
8a225c66 4203guix system disk-image --image-size=850MiB gnu/system/install.scm
5af6de3e
LC
4204@end example
4205
4206@xref{Invoking guix system}, for more information. See
4207@file{gnu/system/install.scm} in the source tree for more information
4208about the installation image.
4209
cf4a9129
LC
4210@node System Configuration
4211@section System Configuration
b208a005 4212
cf4a9129 4213@cindex system configuration
3ca2731c 4214The Guix System Distribution supports a consistent whole-system configuration
cf4a9129
LC
4215mechanism. By that we mean that all aspects of the global system
4216configuration---such as the available system services, timezone and
4217locale settings, user accounts---are declared in a single place. Such
4218a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 4219
cf4a9129
LC
4220One of the advantages of putting all the system configuration under the
4221control of Guix is that it supports transactional system upgrades, and
4222makes it possible to roll-back to a previous system instantiation,
4223should something go wrong with the new one (@pxref{Features}). Another
4224one is that it makes it easy to replicate the exact same configuration
4225across different machines, or at different points in time, without
4226having to resort to additional administration tools layered on top of
4227the system's own tools.
4228@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 4229
cf4a9129
LC
4230This section describes this mechanism. First we focus on the system
4231administrator's viewpoint---explaining how the system is configured and
4232instantiated. Then we show how this mechanism can be extended, for
4233instance to support new system services.
91ef73d4 4234
cf4a9129
LC
4235@menu
4236* Using the Configuration System:: Customizing your GNU system.
7313a52e 4237* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 4238* File Systems:: Configuring file system mounts.
510f9d86 4239* Mapped Devices:: Block device extra processing.
cf4a9129 4240* User Accounts:: Specifying user accounts.
598e19dc 4241* Locales:: Language and cultural convention settings.
cf4a9129 4242* Services:: Specifying system services.
0ae8c15a 4243* Setuid Programs:: Programs running with root privileges.
efb5e833 4244* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 4245* Name Service Switch:: Configuring libc's name service switch.
fd1b1fa2 4246* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 4247* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
4248* Invoking guix system:: Instantiating a system configuration.
4249* Defining Services:: Adding new service definitions.
4250@end menu
91ef73d4 4251
cf4a9129
LC
4252@node Using the Configuration System
4253@subsection Using the Configuration System
64d76fa6 4254
cf4a9129
LC
4255The operating system is configured by providing an
4256@code{operating-system} declaration in a file that can then be passed to
4257the @command{guix system} command (@pxref{Invoking guix system}). A
4258simple setup, with the default system services, the default Linux-Libre
4259kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 4260
cf4a9129
LC
4261@findex operating-system
4262@lisp
dd51caac 4263@include os-config-bare-bones.texi
cf4a9129 4264@end lisp
401c53c4 4265
cf4a9129
LC
4266This example should be self-describing. Some of the fields defined
4267above, such as @code{host-name} and @code{bootloader}, are mandatory.
4268Others, such as @code{packages} and @code{services}, can be omitted, in
4269which case they get a default value.
e7f34eb0 4270
cf4a9129
LC
4271@vindex %base-packages
4272The @code{packages} field lists
4273packages that will be globally visible on the system, for all user
4274accounts---i.e., in every user's @code{PATH} environment variable---in
4275addition to the per-user profiles (@pxref{Invoking guix package}). The
4276@var{%base-packages} variable provides all the tools one would expect
4277for basic user and administrator tasks---including the GNU Core
4278Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
4279editor, @command{find}, @command{grep}, etc. The example above adds
4280Emacs to those, taken from the @code{(gnu packages emacs)} module
4281(@pxref{Package Modules}).
e7f34eb0 4282
cf4a9129
LC
4283@vindex %base-services
4284The @code{services} field lists @dfn{system services} to be made
4285available when the system starts (@pxref{Services}).
4286The @code{operating-system} declaration above specifies that, in
4287addition to the basic services, we want the @command{lshd} secure shell
4288daemon listening on port 2222, and allowing remote @code{root} logins
4289(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
4290@code{lsh-service} arranges so that @code{lshd} is started with the
4291right command-line options, possibly with supporting configuration files
7313a52e
LC
4292generated as needed (@pxref{Defining Services}). @xref{operating-system
4293Reference}, for details about the available @code{operating-system}
4294fields.
a1ba8475 4295
dd51caac
LC
4296The configuration for a typical ``desktop'' usage, with the X11 display
4297server, a desktop environment, network management, an SSH server, and
4298more, would look like this:
4299
4300@lisp
4301@include os-config-desktop.texi
4302@end lisp
4303
4304@xref{Desktop Services}, for the exact list of services provided by
efb5e833
LC
4305@var{%desktop-services}. @xref{X.509 Certificates}, for background
4306information about the @code{nss-certs} package that is used here.
dd51caac 4307
cf4a9129
LC
4308Assuming the above snippet is stored in the @file{my-system-config.scm}
4309file, the @command{guix system reconfigure my-system-config.scm} command
4310instantiates that configuration, and makes it the default GRUB boot
4311entry (@pxref{Invoking guix system}). The normal way to change the
4312system's configuration is by updating this file and re-running the
4313@command{guix system} command.
b81e1947 4314
cf4a9129
LC
4315At the Scheme level, the bulk of an @code{operating-system} declaration
4316is instantiated with the following monadic procedure (@pxref{The Store
4317Monad}):
b81e1947 4318
cf4a9129
LC
4319@deffn {Monadic Procedure} operating-system-derivation os
4320Return a derivation that builds @var{os}, an @code{operating-system}
4321object (@pxref{Derivations}).
b81e1947 4322
cf4a9129
LC
4323The output of the derivation is a single directory that refers to all
4324the packages, configuration files, and other supporting files needed to
4325instantiate @var{os}.
4326@end deffn
b81e1947 4327
7313a52e
LC
4328@node operating-system Reference
4329@subsection @code{operating-system} Reference
4330
4331This section summarizes all the options available in
4332@code{operating-system} declarations (@pxref{Using the Configuration
4333System}).
4334
4335@deftp {Data Type} operating-system
4336This is the data type representing an operating system configuration.
4337By that, we mean all the global system configuration, not per-user
4338configuration (@pxref{Using the Configuration System}).
4339
4340@table @asis
4341@item @code{kernel} (default: @var{linux-libre})
4342The package object of the operating system to use@footnote{Currently
4343only the Linux-libre kernel is supported. In the future, it will be
4344possible to use the GNU@tie{}Hurd.}.
4345
4346@item @code{bootloader}
88faf933 4347The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
4348
4349@item @code{initrd} (default: @code{base-initrd})
4350A two-argument monadic procedure that returns an initial RAM disk for
4351the Linux kernel. @xref{Initial RAM Disk}.
4352
f34c56be
LC
4353@item @code{firmware} (default: @var{%base-firmware})
4354@cindex firmware
4355List of firmware packages loadable by the operating system kernel.
4356
4357The default includes firmware needed for Atheros-based WiFi devices
4358(Linux-libre module @code{ath9k}.)
4359
7313a52e
LC
4360@item @code{host-name}
4361The host name.
4362
4363@item @code{hosts-file}
4364@cindex hosts file
4365A zero-argument monadic procedure that returns a text file for use as
4366@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
4367Reference Manual}). The default is to produce a file with entries for
4368@code{localhost} and @var{host-name}.
4369
4370@item @code{mapped-devices} (default: @code{'()})
4371A list of mapped devices. @xref{Mapped Devices}.
4372
4373@item @code{file-systems}
4374A list of file systems. @xref{File Systems}.
4375
4376@item @code{swap-devices} (default: @code{'()})
4377@cindex swap devices
4378A list of strings identifying devices to be used for ``swap space''
4379(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
4380For example, @code{'("/dev/sda3")}.
4381
4382@item @code{users} (default: @code{'()})
4383@itemx @code{groups} (default: @var{%base-groups})
4384List of user accounts and groups. @xref{User Accounts}.
4385
4386@item @code{skeletons} (default: @code{(default-skeletons)})
4387A monadic list of pairs of target file name and files. These are the
4388files that will be used as skeletons as new accounts are created.
4389
4390For instance, a valid value may look like this:
4391
4392@example
4393(mlet %store-monad ((bashrc (text-file "bashrc" "\
4394 export PATH=$HOME/.guix-profile/bin")))
4395 (return `((".bashrc" ,bashrc))))
4396@end example
4397
4398@item @code{issue} (default: @var{%default-issue})
4399A string denoting the contents of the @file{/etc/issue} file, which is
4400what displayed when users log in on a text console.
4401
4402@item @code{packages} (default: @var{%base-packages})
4403The set of packages installed in the global profile, which is accessible
4404at @file{/run/current-system/profile}.
4405
4406The default set includes core utilities, but it is good practice to
4407install non-core utilities in user profiles (@pxref{Invoking guix
4408package}).
4409
4410@item @code{timezone}
4411A timezone identifying string---e.g., @code{"Europe/Paris"}.
4412
598e19dc
LC
4413@item @code{locale} (default: @code{"en_US.utf8"})
4414The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
4415Library Reference Manual}). @xref{Locales}, for more information.
4416
4417@item @code{locale-definitions} (default: @var{%default-locale-definitions})
4418The list of locale definitions to be compiled and that may be used at
4419run time. @xref{Locales}.
7313a52e 4420
996ed739
LC
4421@item @code{name-service-switch} (default: @var{%default-nss})
4422Configuration of libc's name service switch (NSS)---a
4423@code{<name-service-switch>} object. @xref{Name Service Switch}, for
4424details.
4425
7313a52e
LC
4426@item @code{services} (default: @var{%base-services})
4427A list of monadic values denoting system services. @xref{Services}.
4428
4429@item @code{pam-services} (default: @code{(base-pam-services)})
4430@cindex PAM
4431@cindex pluggable authentication modules
4432Linux @dfn{pluggable authentication module} (PAM) services.
4433@c FIXME: Add xref to PAM services section.
4434
4435@item @code{setuid-programs} (default: @var{%setuid-programs})
4436List of string-valued G-expressions denoting setuid programs.
4437@xref{Setuid Programs}.
4438
4439@item @code{sudoers} (default: @var{%sudoers-specification})
4440@cindex sudoers
4441The contents of the @file{/etc/sudoers} file as a string.
4442
4443This file specifies which users can use the @command{sudo} command, what
4444they are allowed to do, and what privileges they may gain. The default
4445is that only @code{root} and members of the @code{wheel} group may use
4446@code{sudo}.
4447
4448@end table
4449@end deftp
4450
cf4a9129
LC
4451@node File Systems
4452@subsection File Systems
b81e1947 4453
cf4a9129
LC
4454The list of file systems to be mounted is specified in the
4455@code{file-systems} field of the operating system's declaration
4456(@pxref{Using the Configuration System}). Each file system is declared
4457using the @code{file-system} form, like this:
b81e1947
LC
4458
4459@example
cf4a9129
LC
4460(file-system
4461 (mount-point "/home")
4462 (device "/dev/sda3")
4463 (type "ext4"))
b81e1947
LC
4464@end example
4465
cf4a9129
LC
4466As usual, some of the fields are mandatory---those shown in the example
4467above---while others can be omitted. These are described below.
b81e1947 4468
cf4a9129
LC
4469@deftp {Data Type} file-system
4470Objects of this type represent file systems to be mounted. They
4471contain the following members:
5ff3c4b8 4472
cf4a9129
LC
4473@table @asis
4474@item @code{type}
4475This is a string specifying the type of the file system---e.g.,
4476@code{"ext4"}.
5ff3c4b8 4477
cf4a9129
LC
4478@item @code{mount-point}
4479This designates the place where the file system is to be mounted.
b81e1947 4480
cf4a9129
LC
4481@item @code{device}
4482This names the ``source'' of the file system. By default it is the name
4483of a node under @file{/dev}, but its meaning depends on the @code{title}
4484field described below.
401c53c4 4485
cf4a9129
LC
4486@item @code{title} (default: @code{'device})
4487This is a symbol that specifies how the @code{device} field is to be
4488interpreted.
401c53c4 4489
cf4a9129
LC
4490When it is the symbol @code{device}, then the @code{device} field is
4491interpreted as a file name; when it is @code{label}, then @code{device}
4492is interpreted as a partition label name; when it is @code{uuid},
4493@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 4494
cf4a9129
LC
4495The @code{label} and @code{uuid} options offer a way to refer to disk
4496partitions without having to hard-code their actual device name.
da7cabd4 4497
5f86a66e
LC
4498However, when a file system's source is a mapped device (@pxref{Mapped
4499Devices}), its @code{device} field @emph{must} refer to the mapped
4500device name---e.g., @file{/dev/mapper/root-partition}---and consequently
4501@code{title} must be set to @code{'device}. This is required so that
4502the system knows that mounting the file system depends on having the
4503corresponding device mapping established.
4504
cf4a9129
LC
4505@item @code{flags} (default: @code{'()})
4506This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
4507include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
4508access to special files), @code{no-suid} (ignore setuid and setgid
4509bits), and @code{no-exec} (disallow program execution.)
da7cabd4 4510
cf4a9129
LC
4511@item @code{options} (default: @code{#f})
4512This is either @code{#f}, or a string denoting mount options.
da7cabd4 4513
cf4a9129
LC
4514@item @code{needed-for-boot?} (default: @code{#f})
4515This Boolean value indicates whether the file system is needed when
4516booting. If that is true, then the file system is mounted when the
4517initial RAM disk (initrd) is loaded. This is always the case, for
4518instance, for the root file system.
da7cabd4 4519
cf4a9129
LC
4520@item @code{check?} (default: @code{#t})
4521This Boolean indicates whether the file system needs to be checked for
4522errors before being mounted.
f9cc8971 4523
4e469051
LC
4524@item @code{create-mount-point?} (default: @code{#f})
4525When true, the mount point is created if it does not exist yet.
4526
cf4a9129
LC
4527@end table
4528@end deftp
da7cabd4 4529
a69576ea
LC
4530The @code{(gnu system file-systems)} exports the following useful
4531variables.
4532
4533@defvr {Scheme Variable} %base-file-systems
4534These are essential file systems that are required on normal systems,
3392ce5d
LC
4535such as @var{%devtmpfs-file-system} and @var{%immutable-store} (see
4536below.) Operating system declarations should always contain at least
4537these.
a69576ea
LC
4538@end defvr
4539
4540@defvr {Scheme Variable} %devtmpfs-file-system
4541The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
4542requirement for udev (@pxref{Base Services, @code{udev-service}}).
4543@end defvr
4544
7f239fd3
LC
4545@defvr {Scheme Variable} %pseudo-terminal-file-system
4546This is the file system to be mounted as @file{/dev/pts}. It supports
4547@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
4548functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
4549Manual}). Pseudo-terminals are used by terminal emulators such as
4550@command{xterm}.
4551@end defvr
4552
db17ae5c
LC
4553@defvr {Scheme Variable} %shared-memory-file-system
4554This file system is mounted as @file{/dev/shm} and is used to support
4555memory sharing across processes (@pxref{Memory-mapped I/O,
4556@code{shm_open},, libc, The GNU C Library Reference Manual}).
4557@end defvr
4558
3392ce5d
LC
4559@defvr {Scheme Variable} %immutable-store
4560This file system performs a read-only ``bind mount'' of
4561@file{/gnu/store}, making it read-only for all the users including
4562@code{root}. This prevents against accidental modification by software
4563running as @code{root} or by system administrators.
4564
4565The daemon itself is still able to write to the store: it remounts it
4566read-write in its own ``name space.''
4567@end defvr
4568
a69576ea
LC
4569@defvr {Scheme Variable} %binary-format-file-system
4570The @code{binfmt_misc} file system, which allows handling of arbitrary
4571executable file types to be delegated to user space. This requires the
4572@code{binfmt.ko} kernel module to be loaded.
4573@end defvr
4574
4575@defvr {Scheme Variable} %fuse-control-file-system
4576The @code{fusectl} file system, which allows unprivileged users to mount
4577and unmount user-space FUSE file systems. This requires the
4578@code{fuse.ko} kernel module to be loaded.
4579@end defvr
4580
510f9d86
LC
4581@node Mapped Devices
4582@subsection Mapped Devices
4583
4584@cindex device mapping
4585@cindex mapped devices
4586The Linux kernel has a notion of @dfn{device mapping}: a block device,
4587such as a hard disk partition, can be @dfn{mapped} into another device,
4588with additional processing over the data that flows through
4589it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
4590concept of a ``mapped device'' and that of a file system: both boil down
4591to @emph{translating} input/output operations made on a file to
4592operations on its backing store. Thus, the Hurd implements mapped
4593devices, like file systems, using the generic @dfn{translator} mechanism
4594(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
4595typical example is encryption device mapping: all writes to the mapped
4596device are encrypted, and all reads are deciphered, transparently.
4597
4598Mapped devices are declared using the @code{mapped-device} form:
4599
4600@example
4601(mapped-device
4602 (source "/dev/sda3")
4603 (target "home")
4604 (type luks-device-mapping))
4605@end example
4606
4607@noindent
4608@cindex disk encryption
4609@cindex LUKS
4610This example specifies a mapping from @file{/dev/sda3} to
4611@file{/dev/mapper/home} using LUKS---the
4612@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
4613standard mechanism for disk encryption. The @file{/dev/mapper/home}
4614device can then be used as the @code{device} of a @code{file-system}
4615declaration (@pxref{File Systems}). The @code{mapped-device} form is
4616detailed below.
4617
4618@deftp {Data Type} mapped-device
4619Objects of this type represent device mappings that will be made when
4620the system boots up.
4621
9cb426b8
LC
4622@table @code
4623@item source
510f9d86
LC
4624This string specifies the name of the block device to be mapped, such as
4625@code{"/dev/sda3"}.
4626
9cb426b8 4627@item target
510f9d86
LC
4628This string specifies the name of the mapping to be established. For
4629example, specifying @code{"my-partition"} will lead to the creation of
4630the @code{"/dev/mapper/my-partition"} device.
4631
9cb426b8 4632@item type
510f9d86
LC
4633This must be a @code{mapped-device-kind} object, which specifies how
4634@var{source} is mapped to @var{target}.
4635@end table
4636@end deftp
4637
4638@defvr {Scheme Variable} luks-device-mapping
4639This defines LUKS block device encryption using the @command{cryptsetup}
4640command, from the same-named package. This relies on the
4641@code{dm-crypt} Linux kernel module.
4642@end defvr
4643
cf4a9129
LC
4644@node User Accounts
4645@subsection User Accounts
ee85f3db 4646
9bea87a5
LC
4647User accounts and groups are entirely managed through the
4648@code{operating-system} declaration. They are specified with the
4649@code{user-account} and @code{user-group} forms:
ee85f3db 4650
cf4a9129
LC
4651@example
4652(user-account
4653 (name "alice")
4654 (group "users")
24e752c0
LC
4655 (supplementary-groups '("wheel" ;allow use of sudo, etc.
4656 "audio" ;sound card
4657 "video" ;video devices such as webcams
4658 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
4659 (comment "Bob's sister")
4660 (home-directory "/home/alice"))
4661@end example
25083588 4662
9bea87a5
LC
4663When booting or upon completion of @command{guix system reconfigure},
4664the system ensures that only the user accounts and groups specified in
4665the @code{operating-system} declaration exist, and with the specified
4666properties. Thus, account or group creations or modifications made by
4667directly invoking commands such as @command{useradd} are lost upon
4668reconfiguration or reboot. This ensures that the system remains exactly
4669as declared.
4670
cf4a9129
LC
4671@deftp {Data Type} user-account
4672Objects of this type represent user accounts. The following members may
4673be specified:
ee85f3db 4674
cf4a9129
LC
4675@table @asis
4676@item @code{name}
4677The name of the user account.
ee85f3db 4678
cf4a9129
LC
4679@item @code{group}
4680This is the name (a string) or identifier (a number) of the user group
4681this account belongs to.
ee85f3db 4682
cf4a9129
LC
4683@item @code{supplementary-groups} (default: @code{'()})
4684Optionally, this can be defined as a list of group names that this
4685account belongs to.
ee85f3db 4686
cf4a9129
LC
4687@item @code{uid} (default: @code{#f})
4688This is the user ID for this account (a number), or @code{#f}. In the
4689latter case, a number is automatically chosen by the system when the
4690account is created.
ee85f3db 4691
cf4a9129
LC
4692@item @code{comment} (default: @code{""})
4693A comment about the account, such as the account's owner full name.
c8c871d1 4694
cf4a9129
LC
4695@item @code{home-directory}
4696This is the name of the home directory for the account.
ee85f3db 4697
cf4a9129
LC
4698@item @code{shell} (default: Bash)
4699This is a G-expression denoting the file name of a program to be used as
4700the shell (@pxref{G-Expressions}).
ee85f3db 4701
cf4a9129
LC
4702@item @code{system?} (default: @code{#f})
4703This Boolean value indicates whether the account is a ``system''
4704account. System accounts are sometimes treated specially; for instance,
4705graphical login managers do not list them.
ee85f3db 4706
cf4a9129 4707@item @code{password} (default: @code{#f})
eb59595c
LC
4708You would normally leave this field to @code{#f}, initialize user
4709passwords as @code{root} with the @command{passwd} command, and then let
9bea87a5
LC
4710users change it with @command{passwd}. Passwords set with
4711@command{passwd} are of course preserved across reboot and
4712reconfiguration.
eb59595c
LC
4713
4714If you @emph{do} want to have a preset password for an account, then
4715this field must contain the encrypted password, as a string.
5d1f1177
LC
4716@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
4717on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 4718Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 4719
cf4a9129
LC
4720@end table
4721@end deftp
ee85f3db 4722
cf4a9129 4723User group declarations are even simpler:
ee85f3db 4724
cf4a9129
LC
4725@example
4726(user-group (name "students"))
4727@end example
ee85f3db 4728
cf4a9129
LC
4729@deftp {Data Type} user-group
4730This type is for, well, user groups. There are just a few fields:
af8a56b8 4731
cf4a9129
LC
4732@table @asis
4733@item @code{name}
4734The group's name.
ee85f3db 4735
cf4a9129
LC
4736@item @code{id} (default: @code{#f})
4737The group identifier (a number). If @code{#f}, a new number is
4738automatically allocated when the group is created.
ee85f3db 4739
c8fa3426
LC
4740@item @code{system?} (default: @code{#f})
4741This Boolean value indicates whether the group is a ``system'' group.
4742System groups have low numerical IDs.
4743
cf4a9129
LC
4744@item @code{password} (default: @code{#f})
4745What, user groups can have a password? Well, apparently yes. Unless
4746@code{#f}, this field specifies the group's password.
ee85f3db 4747
cf4a9129
LC
4748@end table
4749@end deftp
401c53c4 4750
cf4a9129
LC
4751For convenience, a variable lists all the basic user groups one may
4752expect:
401c53c4 4753
cf4a9129
LC
4754@defvr {Scheme Variable} %base-groups
4755This is the list of basic user groups that users and/or packages expect
4756to be present on the system. This includes groups such as ``root'',
4757``wheel'', and ``users'', as well as groups used to control access to
4758specific devices such as ``audio'', ``disk'', and ``cdrom''.
4759@end defvr
401c53c4 4760
598e19dc
LC
4761@node Locales
4762@subsection Locales
4763
4764@cindex locale
4765A @dfn{locale} defines cultural conventions for a particular language
4766and region of the world (@pxref{Locales,,, libc, The GNU C Library
4767Reference Manual}). Each locale has a name that typically has the form
4768@code{@var{language}_@var{territory}.@var{charset}}---e.g.,
4769@code{fr_LU.utf8} designates the locale for the French language, with
4770cultural conventions from Luxembourg, and using the UTF-8 encoding.
4771
4772@cindex locale definition
4773Usually, you will want to specify the default locale for the machine
4774using the @code{locale} field of the @code{operating-system} declaration
4775(@pxref{operating-system Reference, @code{locale}}).
4776
4777That locale must be among the @dfn{locale definitions} that are known to
4778the system---and these are specified in the @code{locale-definitions}
4779slot of @code{operating-system}. The default value includes locale
4780definition for some widely used locales, but not for all the available
4781locales, in order to save space.
4782
4783If the locale specified in the @code{locale} field is not among the
4784definitions listed in @code{locale-definitions}, @command{guix system}
4785raises an error. In that case, you should add the locale definition to
4786the @code{locale-definitions} field. For instance, to add the North
4787Frisian locale for Germany, the value of that field may be:
4788
4789@example
4790(cons (locale-definition
4791 (name "fy_DE.utf8") (source "fy_DE"))
4792 %default-locale-definitions)
4793@end example
4794
4795Likewise, to save space, one might want @code{locale-definitions} to
4796list only the locales that are actually used, as in:
4797
4798@example
4799(list (locale-definition
4800 (name "ja_JP.eucjp") (source "ja_JP")
4801 (charset "EUC-JP")))
4802@end example
4803
4804The @code{locale-definition} form is provided by the @code{(gnu system
4805locale)} module. Details are given below.
4806
4807@deftp {Data Type} locale-definition
4808This is the data type of a locale definition.
4809
4810@table @asis
4811
4812@item @code{name}
4813The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
4814Reference Manual}, for more information on locale names.
4815
4816@item @code{source}
4817The name of the source for that locale. This is typically the
4818@code{@var{language}_@var{territory}} part of the locale name.
4819
4820@item @code{charset} (default: @code{"UTF-8"})
4821The ``character set'' or ``code set'' for that locale,
4822@uref{http://www.iana.org/assignments/character-sets, as defined by
4823IANA}.
4824
4825@end table
4826@end deftp
4827
4828@defvr {Scheme Variable} %default-locale-definitions
4829An arbitrary list of commonly used locales, used as the default value of
4830the @code{locale-definitions} field of @code{operating-system}
4831declarations.
4832@end defvr
401c53c4 4833
cf4a9129
LC
4834@node Services
4835@subsection Services
401c53c4 4836
cf4a9129
LC
4837@cindex system services
4838An important part of preparing an @code{operating-system} declaration is
4839listing @dfn{system services} and their configuration (@pxref{Using the
4840Configuration System}). System services are typically daemons launched
4841when the system boots, or other actions needed at that time---e.g.,
d8b94dbd
LC
4842configuring network access.
4843
4844Services are managed by GNU@tie{}dmd (@pxref{Introduction,,, dmd, GNU
4845dmd Manual}). On a running system, the @command{deco} command allows
4846you to list the available services, show their status, start and stop
4847them, or do other specific operations (@pxref{Jump Start,,, dmd, GNU dmd
4848Manual}). For example:
4849
4850@example
4851# deco status dmd
4852@end example
4853
4854The above command, run as @code{root}, lists the currently defined
4855services. The @command{deco doc} command shows a synopsis of the given
4856service:
4857
4858@example
4859# deco doc nscd
4860Run libc's name service cache daemon (nscd).
4861@end example
4862
4863The @command{start}, @command{stop}, and @command{restart} sub-commands
4864have the effect you would expect. For instance, the commands below stop
4865the nscd service and restart the Xorg display server:
4866
4867@example
4868# deco stop nscd
4869Service nscd has been stopped.
4870# deco restart xorg-server
4871Service xorg-server has been stopped.
4872Service xorg-server has been started.
4873@end example
401c53c4 4874
cf4a9129 4875The following sections document the available services, starting with
d8b94dbd
LC
4876the core services, that may be used in an @code{operating-system}
4877declaration.
401c53c4 4878
cf4a9129
LC
4879@menu
4880* Base Services:: Essential system services.
4881* Networking Services:: Network setup, SSH daemon, etc.
4882* X Window:: Graphical display.
fe1a39d3 4883* Desktop Services:: D-Bus and desktop services.
105369a4 4884* Database Services:: SQL databases.
aa4ed923 4885* Various Services:: Other services.
cf4a9129 4886@end menu
401c53c4 4887
cf4a9129
LC
4888@node Base Services
4889@subsubsection Base Services
a1ba8475 4890
cf4a9129
LC
4891The @code{(gnu services base)} module provides definitions for the basic
4892services that one expects from the system. The services exported by
4893this module are listed below.
401c53c4 4894
cf4a9129
LC
4895@defvr {Scheme Variable} %base-services
4896This variable contains a list of basic services@footnote{Technically,
4897this is a list of monadic services. @xref{The Store Monad}.} one would
4898expect from the system: a login service (mingetty) on each tty, syslogd,
4899libc's name service cache daemon (nscd), the udev device manager, and
4900more.
401c53c4 4901
cf4a9129
LC
4902This is the default value of the @code{services} field of
4903@code{operating-system} declarations. Usually, when customizing a
4904system, you will want to append services to @var{%base-services}, like
4905this:
401c53c4 4906
cf4a9129 4907@example
fa1e31b8 4908(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
4909@end example
4910@end defvr
401c53c4 4911
cf4a9129
LC
4912@deffn {Monadic Procedure} host-name-service @var{name}
4913Return a service that sets the host name to @var{name}.
4914@end deffn
401c53c4 4915
cf4a9129
LC
4916@deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
4917 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
4918 [#:allow-empty-passwords? #f]
4919Return a service to run mingetty on @var{tty}.
401c53c4 4920
cf4a9129
LC
4921When @var{allow-empty-passwords?} is true, allow empty log-in password. When
4922@var{auto-login} is true, it must be a user name under which to log-in
4923automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
4924@var{auto-login}, in which case the user will have to press a key before the
4925login shell is launched.
401c53c4 4926
cf4a9129
LC
4927When true, @var{login-program} is a gexp or a monadic gexp denoting the name
4928of the log-in program (the default is the @code{login} program from the Shadow
4929tool suite.)
401c53c4 4930
cf4a9129
LC
4931@var{motd} is a monadic value containing a text file to use as
4932the ``message of the day''.
4933@end deffn
401c53c4 4934
6454b333
LC
4935@cindex name service cache daemon
4936@cindex nscd
4aee6e60
LC
4937@deffn {Monadic Procedure} nscd-service [@var{config}] [#:glibc glibc] @
4938 [#:name-services '()]
4939Return a service that runs libc's name service cache daemon (nscd) with
4940the given @var{config}---an @code{<nscd-configuration>} object.
4941Optionally, @code{#:name-services} is a list of packages that provide
4c9050c6
LC
4942name service switch (NSS) modules needed by nscd. @xref{Name Service
4943Switch}, for an example.
cf4a9129 4944@end deffn
401c53c4 4945
6454b333
LC
4946@defvr {Scheme Variable} %nscd-default-configuration
4947This is the default @code{<nscd-configuration>} value (see below) used
4948by @code{nscd-service}. This uses the caches defined by
4949@var{%nscd-default-caches}; see below.
4950@end defvr
4951
4952@deftp {Data Type} nscd-configuration
4953This is the type representing the name service cache daemon (nscd)
4954configuration.
4955
4956@table @asis
4957
4958@item @code{log-file} (default: @code{"/var/log/nscd.log"})
4959Name of nscd's log file. This is where debugging output goes when
4960@code{debug-level} is strictly positive.
4961
4962@item @code{debug-level} (default: @code{0})
4963Integer denoting the debugging levels. Higher numbers mean more
4964debugging output is logged.
4965
4966@item @code{caches} (default: @var{%nscd-default-caches})
4967List of @code{<nscd-cache>} objects denoting things to be cached; see
4968below.
4969
4970@end table
4971@end deftp
4972
4973@deftp {Data Type} nscd-cache
4974Data type representing a cache database of nscd and its parameters.
4975
4976@table @asis
4977
4978@item @code{database}
4979This is a symbol representing the name of the database to be cached.
4980Valid values are @code{passwd}, @code{group}, @code{hosts}, and
4981@code{services}, which designate the corresponding NSS database
4982(@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
4983
4984@item @code{positive-time-to-live}
4985@itemx @code{negative-time-to-live} (default: @code{20})
4986A number representing the number of seconds during which a positive or
4987negative lookup result remains in cache.
4988
4989@item @code{check-files?} (default: @code{#t})
4990Whether to check for updates of the files corresponding to
4991@var{database}.
4992
4993For instance, when @var{database} is @code{hosts}, setting this flag
4994instructs nscd to check for updates in @file{/etc/hosts} and to take
4995them into account.
4996
4997@item @code{persistent?} (default: @code{#t})
4998Whether the cache should be stored persistently on disk.
4999
5000@item @code{shared?} (default: @code{#t})
5001Whether the cache should be shared among users.
5002
5003@item @code{max-database-size} (default: 32@tie{}MiB)
5004Maximum size in bytes of the database cache.
5005
5006@c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
5007@c settings, so leave them out.
5008
5009@end table
5010@end deftp
5011
5012@defvr {Scheme Variable} %nscd-default-caches
5013List of @code{<nscd-cache>} objects used by default by
5014@code{nscd-configuration} (see above.)
5015
5016It enables persistent and aggressive caching of service and host name
5017lookups. The latter provides better host name lookup performance,
5018resilience in the face of unreliable name servers, and also better
5019privacy---often the result of host name lookups is in local cache, so
5020external name servers do not even need to be queried.
5021@end defvr
5022
5023
1bb76f75
AK
5024@deffn {Monadic Procedure} syslog-service [#:config-file #f]
5025Return a service that runs @code{syslogd}. If configuration file name
5026@var{config-file} is not specified, use some reasonable default
cf4a9129
LC
5027settings.
5028@end deffn
401c53c4 5029
cf4a9129
LC
5030@deffn {Monadic Procedure} guix-service [#:guix guix] @
5031 [#:builder-group "guixbuild"] [#:build-accounts 10] @
02bb6b45 5032 [#:authorize-hydra-key? #t] [#:use-substitutes? #t] @
cf4a9129
LC
5033 [#:extra-options '()]
5034Return a service that runs the build daemon from @var{guix}, and has
5035@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 5036
cf4a9129
LC
5037When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
5038provided by @var{guix} is authorized upon activation, meaning that substitutes
5039from @code{hydra.gnu.org} are used by default.
401c53c4 5040
cf4a9129
LC
5041If @var{use-substitutes?} is false, the daemon is run with
5042@option{--no-substitutes} (@pxref{Invoking guix-daemon,
5043@option{--no-substitutes}}).
401c53c4 5044
cf4a9129
LC
5045Finally, @var{extra-options} is a list of additional command-line options
5046passed to @command{guix-daemon}.
5047@end deffn
a1ba8475 5048
cf4a9129
LC
5049@deffn {Monadic Procedure} udev-service [#:udev udev]
5050Run @var{udev}, which populates the @file{/dev} directory dynamically.
5051@end deffn
401c53c4 5052
5eca9459
AK
5053@deffn {Monadic Procedure} console-keymap-service @var{file}
5054Return a service to load console keymap from @var{file} using
5055@command{loadkeys} command.
5056@end deffn
5057
a69576ea 5058
cf4a9129
LC
5059@node Networking Services
5060@subsubsection Networking Services
401c53c4 5061
fa1e31b8 5062The @code{(gnu services networking)} module provides services to configure
cf4a9129 5063the network interface.
a1ba8475 5064
a023cca8
LC
5065@cindex DHCP, networking service
5066@deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
5067Return a service that runs @var{dhcp}, a Dynamic Host Configuration
5068Protocol (DHCP) client, on all the non-loopback network interfaces.
5069@end deffn
5070
cf4a9129
LC
5071@deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
5072 [#:gateway #f] [#:name-services @code{'()}]
5073Return a service that starts @var{interface} with address @var{ip}. If
5074@var{gateway} is true, it must be a string specifying the default network
5075gateway.
5076@end deffn
8b315a6d 5077
b7d0c494
MW
5078@cindex wicd
5079@deffn {Monadic Procedure} wicd-service [#:wicd @var{wicd}]
5080Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a
5081network manager that aims to simplify wired and wireless networking.
5082@end deffn
5083
63854bcb
LC
5084@deffn {Monadic Procedure} ntp-service [#:ntp @var{ntp}] @
5085 [#:name-service @var{%ntp-servers}]
5086Return a service that runs the daemon from @var{ntp}, the
5087@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
5088keep the system clock synchronized with that of @var{servers}.
5089@end deffn
5090
5091@defvr {Scheme Variable} %ntp-servers
5092List of host names used as the default NTP servers.
5093@end defvr
5094
cf4a9129
LC
5095@deffn {Monadic Procedure} tor-service [#:tor tor]
5096Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 5097
cf4a9129
LC
5098The daemon runs with the default settings (in particular the default exit
5099policy) as the @code{tor} unprivileged user.
5100@end deffn
8b315a6d 5101
4627a464
LC
5102@deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
5103 [#:interface "127.0.0.1"] [#:port 6667] @
5104 [#:extra-settings ""]
5105Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
5106acts as a gateway between IRC and chat networks.
5107
5108The daemon will listen to the interface corresponding to the IP address
5109specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
5110local clients can connect, whereas @code{0.0.0.0} means that connections can
5111come from any networking interface.
5112
5113In addition, @var{extra-settings} specifies a string to append to the
5114configuration file.
5115@end deffn
5116
f4391bec 5117Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 5118
cf4a9129 5119@deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
5833bf33 5120 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
cf4a9129
LC
5121 [#:allow-empty-passwords? #f] [#:root-login? #f] @
5122 [#:syslog-output? #t] [#:x11-forwarding? #t] @
5123 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
21cc905a 5124 [#:public-key-authentication? #t] [#:initialize? #t]
cf4a9129
LC
5125Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
5126@var{host-key} must designate a file containing the host key, and readable
5127only by root.
72e25e35 5128
5833bf33
DP
5129When @var{daemonic?} is true, @command{lshd} will detach from the
5130controlling terminal and log its output to syslogd, unless one sets
5131@var{syslog-output?} to false. Obviously, it also makes lsh-service
5132depend on existence of syslogd service. When @var{pid-file?} is true,
5133@command{lshd} writes its PID to the file called @var{pid-file}.
5134
cf4a9129
LC
5135When @var{initialize?} is true, automatically create the seed and host key
5136upon service activation if they do not exist yet. This may take long and
5137require interaction.
8b315a6d 5138
20dd519c
LC
5139When @var{initialize?} is false, it is up to the user to initialize the
5140randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
5141a key pair with the private key stored in file @var{host-key} (@pxref{lshd
5142basics,,, lsh, LSH Manual}).
5143
cf4a9129
LC
5144When @var{interfaces} is empty, lshd listens for connections on all the
5145network interfaces; otherwise, @var{interfaces} must be a list of host names
5146or addresses.
9bf3c1a7 5147
20dd519c
LC
5148@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
5149passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 5150root.
4af2447e 5151
cf4a9129
LC
5152The other options should be self-descriptive.
5153@end deffn
4af2447e 5154
fa0c1d61
LC
5155@defvr {Scheme Variable} %facebook-host-aliases
5156This variable contains a string for use in @file{/etc/hosts}
5157(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
5158line contains a entry that maps a known server name of the Facebook
5159on-line service---e.g., @code{www.facebook.com}---to the local
5160host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
5161
5162This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
5163@code{operating-system} declaration (@pxref{operating-system Reference,
5164@file{/etc/hosts}}):
fa0c1d61
LC
5165
5166@example
5167(use-modules (gnu) (guix))
5168
5169(operating-system
5170 (host-name "mymachine")
5171 ;; ...
5172 (hosts-file
5173 ;; Create a /etc/hosts file with aliases for "localhost"
5174 ;; and "mymachine", as well as for Facebook servers.
5175 (text-file "hosts"
5176 (string-append (local-host-aliases host-name)
5177 %facebook-host-aliases))))
5178@end example
5179
5180This mechanism can prevent programs running locally, such as Web
5181browsers, from accessing Facebook.
5182@end defvr
5183
965a7332
LC
5184The @code{(gnu services avahi)} provides the following definition.
5185
5186@deffn {Monadic Procedure} avahi-service [#:avahi @var{avahi}] @
5187 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
5188 [#:ipv6? #t] [#:wide-area? #f] @
5189 [#:domains-to-browse '()]
5190Return a service that runs @command{avahi-daemon}, a system-wide
5191mDNS/DNS-SD responder that allows for service discovery and
5192"zero-configuration" host name lookups (see @uref{http://avahi.org/}).
5193
5194If @var{host-name} is different from @code{#f}, use that as the host name to
5195publish for this machine; otherwise, use the machine's actual host name.
5196
5197When @var{publish?} is true, publishing of host names and services is allowed;
5198in particular, avahi-daemon will publish the machine's host name and IP
5199address via mDNS on the local network.
5200
5201When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
5202
5203Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
5204sockets.
5205@end deffn
5206
5207
cf4a9129
LC
5208@node X Window
5209@subsubsection X Window
68ad877c 5210
cf4a9129
LC
5211Support for the X Window graphical display system---specifically
5212Xorg---is provided by the @code{(gnu services xorg)} module. Note that
5213there is no @code{xorg-service} procedure. Instead, the X server is
5214started by the @dfn{login manager}, currently SLiM.
4af2447e 5215
cf4a9129 5216@deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
5217 [#:auto-login? #f] [#:default-user ""] [#:startx] @
5218 [#:theme @var{%default-slim-theme}] @
4bd43bbe 5219 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
5220Return a service that spawns the SLiM graphical login manager, which in
5221turn starts the X display server with @var{startx}, a command as returned by
5222@code{xorg-start-command}.
4af2447e 5223
04e4e6ab
LC
5224@cindex X session
5225
5226SLiM automatically looks for session types described by the @file{.desktop}
5227files in @file{/run/current-system/profile/share/xsessions} and allows users
5228to choose a session from the log-in screen using @kbd{F1}. Packages such as
5229@var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
5230adding them to the system-wide set of packages automatically makes them
5231available at the log-in screen.
5232
5233In addition, @file{~/.xsession} files are honored. When available,
5234@file{~/.xsession} must be an executable that starts a window manager
5235and/or other X clients.
5236
cf4a9129
LC
5237When @var{allow-empty-passwords?} is true, allow logins with an empty
5238password. When @var{auto-login?} is true, log in automatically as
5239@var{default-user}.
0ecc3bf3
LC
5240
5241If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
5242@var{theme} must be a gexp denoting the name of a directory containing the
5243theme to use. In that case, @var{theme-name} specifies the name of the
5244theme.
cf4a9129 5245@end deffn
4af2447e 5246
0ecc3bf3
LC
5247@defvr {Scheme Variable} %default-theme
5248@defvrx {Scheme Variable} %default-theme-name
5249The G-Expression denoting the default SLiM theme and its name.
5250@end defvr
5251
f703413e 5252@deffn {Monadic Procedure} xorg-start-command [#:guile] @
d2e59637 5253 [#:drivers '()] [#:resolutions '()] [#:xorg-server @var{xorg-server}]
f703413e
LC
5254Return a derivation that builds a @var{guile} script to start the X server
5255from @var{xorg-server}. Usually the X server is started by a login manager.
5256
5257@var{drivers} must be either the empty list, in which case Xorg chooses a
5258graphics driver automatically, or a list of driver names that will be tried in
5259this order---e.g., @code{("modesetting" "vesa")}.
d2e59637
LC
5260
5261Likewise, when @var{resolutions} is the empty list, Xorg chooses an
5262appropriate screen resolution; otherwise, it must be a list of
5263resolutions---e.g., @code{((1024 768) (640 480))}.
f703413e 5264@end deffn
4af2447e 5265
fe1a39d3
LC
5266@node Desktop Services
5267@subsubsection Desktop Services
aa4ed923 5268
fe1a39d3
LC
5269The @code{(gnu services desktop)} module provides services that are
5270usually useful in the context of a ``desktop'' setup---that is, on a
5271machine running a graphical display server, possibly with graphical user
5272interfaces, etc.
aa4ed923 5273
4467be21
LC
5274To simplify things, the module defines a variable containing the set of
5275services that users typically expect on a machine with a graphical
5276environment and networking:
5277
5278@defvr {Scheme Variable} %desktop-services
5279This is a list of services that builds upon @var{%base-services} and
5280adds or adjust services for a typical ``desktop'' setup.
5281
5282In particular, it adds a graphical login manager (@pxref{X Window,
5283@code{slim-service}}), a network management tool (@pxref{Networking
5284Services, @code{wicd-service}}), energy and color management services,
5285an NTP client and an SSH server (@pxref{Networking Services}), the Avahi
5286daemon, and has the name service switch service configured to be able to
5287use @code{nss-mdns} (@pxref{Name Service Switch, mDNS}).
5288@end defvr
5289
5290The @var{%desktop-services} variable can be used as the @code{services}
5291field of an @code{operating-system} declaration (@pxref{operating-system
5292Reference, @code{services}}).
5293
5294The actual service definitions provided by @code{(gnu services desktop)}
5295are described below.
5296
fe1a39d3
LC
5297@deffn {Monadic Procedure} dbus-service @var{services} @
5298 [#:dbus @var{dbus}]
5299Return a service that runs the ``system bus'', using @var{dbus}, with
5300support for @var{services}.
aa4ed923 5301
fe1a39d3
LC
5302@uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
5303facility. Its system bus is used to allow system services to communicate
5304and be notified of system-wide events.
aa4ed923 5305
fe1a39d3
LC
5306@var{services} must be a list of packages that provide an
5307@file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
5308and policy files. For example, to allow avahi-daemon to use the system bus,
5309@var{services} must be equal to @code{(list avahi)}.
aa4ed923
AK
5310@end deffn
5311
be234128
AW
5312@deffn {Monadic Procedure} upower-service [#:upower @var{upower}] @
5313 [#:watts-up-pro? #f] @
5314 [#:poll-batteries? #t] @
5315 [#:ignore-lid? #f] @
5316 [#:use-percentage-for-policy? #f] @
5317 [#:percentage-low 10] @
5318 [#:percentage-critical 3] @
5319 [#:percentage-action 2] @
5320 [#:time-low 1200] @
5321 [#:time-critical 300] @
5322 [#:time-action 120] @
5323 [#:critical-power-action 'hybrid-sleep]
5324Return a service that runs @uref{http://upower.freedesktop.org/,
5325@command{upowerd}}, a system-wide monitor for power consumption and battery
5326levels, with the given configuration settings. It implements the
5327@code{org.freedesktop.UPower} D-Bus interface, and is notably used by
5328GNOME.
5329@end deffn
5330
7ce597ff
AW
5331@deffn {Monadic Procedure} colord-service [#:colord @var{colord}]
5332Return a service that runs @command{colord}, a system service with a D-Bus
5333interface to manage the color profiles of input and output devices such as
5334screens and scanners. It is notably used by the GNOME Color Manager graphical
5335tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
5336site} for more information.
5337@end deffn
5338
105369a4
DT
5339@node Database Services
5340@subsubsection Database Services
5341
5342The @code{(gnu services databases)} module provides the following service.
5343
5344@deffn {Monadic Procedure} postgresql-service [#:postgresql postgresql] @
5345 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
5346Return a service that runs @var{postgresql}, the PostgreSQL database
5347server.
5348
5349The PostgreSQL daemon loads its runtime configuration from
5350@var{config-file} and stores the database cluster in
5351@var{data-directory}.
5352@end deffn
fe1a39d3
LC
5353
5354@node Various Services
5355@subsubsection Various Services
5356
5357The @code{(gnu services lirc)} module provides the following service.
5358
5359@deffn {Monadic Procedure} lirc-service [#:lirc lirc] @
5360 [#:device #f] [#:driver #f] [#:config-file #f] @
5361 [#:extra-options '()]
5362Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
5363decodes infrared signals from remote controls.
5364
5365Optionally, @var{device}, @var{driver} and @var{config-file}
5366(configuration file name) may be specified. See @command{lircd} manual
5367for details.
5368
5369Finally, @var{extra-options} is a list of additional command-line options
5370passed to @command{lircd}.
5371@end deffn
5372
5373
0ae8c15a
LC
5374@node Setuid Programs
5375@subsection Setuid Programs
5376
5377@cindex setuid programs
5378Some programs need to run with ``root'' privileges, even when they are
5379launched by unprivileged users. A notorious example is the
5380@command{passwd} programs, which can users can run to change their
5381password, and which requires write access to the @file{/etc/passwd} and
5382@file{/etc/shadow} files---something normally restricted to root, for
5383obvious security reasons. To address that, these executables are
5384@dfn{setuid-root}, meaning that they always run with root privileges
5385(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
5386for more info about the setuid mechanisms.)
5387
5388The store itself @emph{cannot} contain setuid programs: that would be a
5389security issue since any user on the system can write derivations that
5390populate the store (@pxref{The Store}). Thus, a different mechanism is
5391used: instead of changing the setuid bit directly on files that are in
5392the store, we let the system administrator @emph{declare} which programs
5393should be setuid root.
5394
5395The @code{setuid-programs} field of an @code{operating-system}
5396declaration contains a list of G-expressions denoting the names of
5397programs to be setuid-root (@pxref{Using the Configuration System}).
5398For instance, the @command{passwd} program, which is part of the Shadow
5399package, can be designated by this G-expression (@pxref{G-Expressions}):
5400
5401@example
5402#~(string-append #$shadow "/bin/passwd")
5403@end example
5404
5405A default set of setuid programs is defined by the
5406@code{%setuid-programs} variable of the @code{(gnu system)} module.
5407
5408@defvr {Scheme Variable} %setuid-programs
5409A list of G-expressions denoting common programs that are setuid-root.
5410
5411The list includes commands such as @command{passwd}, @command{ping},
5412@command{su}, and @command{sudo}.
5413@end defvr
5414
5415Under the hood, the actual setuid programs are created in the
5416@file{/run/setuid-programs} directory at system activation time. The
5417files in this directory refer to the ``real'' binaries, which are in the
5418store.
5419
efb5e833
LC
5420@node X.509 Certificates
5421@subsection X.509 Certificates
5422
5423@cindex HTTPS, certificates
5424@cindex X.509 certificates
5425@cindex TLS
5426Web servers available over HTTPS (that is, HTTP over the transport-layer
5427security mechanism, TLS) send client programs an @dfn{X.509 certificate}
5428that the client can then use to @emph{authenticate} the server. To do
5429that, clients verify that the server's certificate is signed by a
5430so-called @dfn{certificate authority} (CA). But to verify the CA's
5431signature, clients must have first acquired the CA's certificate.
5432
5433Web browsers such as GNU@tie{}IceCat include their own set of CA
5434certificates, such that they are able to verify CA signatures
5435out-of-the-box.
5436
5437However, most other programs that can talk HTTPS---@command{wget},
5438@command{git}, @command{w3m}, etc.---need to be told where CA
5439certificates can be found.
5440
5441@cindex @code{nss-certs}
5442In GuixSD, this is done by adding a package that provides certificates
5443to the @code{packages} field of the @code{operating-system} declaration
5444(@pxref{operating-system Reference}). GuixSD includes one such package,
5445@code{nss-certs}, which is a set of CA certificates provided as part of
5446Mozilla's Network Security Services.
5447
5448Note that it is @emph{not} part of @var{%base-packages}, so you need to
5449explicitly add it. The @file{/etc/ssl/certs} directory, which is where
5450most applications and libraries look for certificates by default, points
5451to the certificates installed globally.
5452
5453Unprivileged users can also install their own certificate package in
5454their profile. A number of environment variables need to be defined so
5455that applications and libraries know where to find them. Namely, the
5456OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
5457variables. Some applications add their own environment variables; for
5458instance, the Git version control system honors the certificate bundle
5459pointed to by the @code{GIT_SSL_CAINFO} environment variable.
5460
5461
996ed739
LC
5462@node Name Service Switch
5463@subsection Name Service Switch
5464
5465@cindex name service switch
5466@cindex NSS
5467The @code{(gnu system nss)} module provides bindings to the
5468configuration file of libc's @dfn{name service switch} or @dfn{NSS}
5469(@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
5470Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
5471extended with new ``name'' lookup methods for system databases, which
5472includes host names, service names, user accounts, and more (@pxref{Name
5473Service Switch, System Databases and Name Service Switch,, libc, The GNU
5474C Library Reference Manual}).
5475
5476The NSS configuration specifies, for each system database, which lookup
5477method is to be used, and how the various methods are chained
5478together---for instance, under which circumstances NSS should try the
5479next method in the list. The NSS configuration is given in the
5480@code{name-service-switch} field of @code{operating-system} declarations
5481(@pxref{operating-system Reference, @code{name-service-switch}}).
5482
4c9050c6
LC
5483@cindex nss-mdns
5484@cindex .local, host name lookup
996ed739 5485As an example, the declaration below configures the NSS to use the
4c9050c6
LC
5486@uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
5487back-end}, which supports host name lookups over multicast DNS (mDNS)
5488for host names ending in @code{.local}:
996ed739
LC
5489
5490@example
5491(name-service-switch
5492 (hosts (list %files ;first, check /etc/hosts
5493
5494 ;; If the above did not succeed, try
5495 ;; with 'mdns_minimal'.
5496 (name-service
5497 (name "mdns_minimal")
5498
5499 ;; 'mdns_minimal' is authoritative for
5500 ;; '.local'. When it returns "not found",
5501 ;; no need to try the next methods.
5502 (reaction (lookup-specification
5503 (not-found => return))))
5504
5505 ;; Then fall back to DNS.
5506 (name-service
5507 (name "dns"))
5508
5509 ;; Finally, try with the "full" 'mdns'.
5510 (name-service
5511 (name "mdns")))))
5512@end example
5513
15137a29
LC
5514Don't worry: the @code{%mdns-host-lookup-nss} variable (see below)
5515contains this configuration, so you won't have to type it if all you
5516want is to have @code{.local} host lookup working.
5517
4c9050c6
LC
5518Note that, in this case, in addition to setting the
5519@code{name-service-switch} of the @code{operating-system} declaration,
5520@code{nscd-service} must be told where to find the @code{nss-mdns}
5521shared library (@pxref{Base Services, @code{nscd-service}}). Since the
5522@code{nscd} service is part of @var{%base-services}, you may want to
5523customize it by adding this snippet in the operating system
5524configuration file:
5525
5526@example
5527(use-modules (guix) (gnu))
5528
5529(define %my-base-services
5530 ;; Replace the default nscd service with one that knows
5531 ;; about nss-mdns.
5532 (map (lambda (mservice)
5533 ;; "Bind" the MSERVICE monadic value to inspect it.
5534 (mlet %store-monad ((service mservice))
5535 (if (member 'nscd (service-provision service))
5536 (nscd-service (nscd-configuration)
5537 #:name-services (list nss-mdns))
5538 mservice)))
5539 %base-services))
5540@end example
5541
5542@noindent
5543@dots{} and then refer to @var{%my-base-services} instead of
5544@var{%base-services} in the @code{operating-system} declaration.
15137a29 5545Lastly, this relies on the availability of the Avahi service
965a7332 5546(@pxref{Networking Services, @code{avahi-service}}).
15137a29
LC
5547
5548For convenience, the following variables provide typical NSS
5549configurations.
5550
5551@defvr {Scheme Variable} %default-nss
5552This is the default name service switch configuration, a
5553@code{name-service-switch} object.
5554@end defvr
5555
5556@defvr {Scheme Variable} %mdns-host-lookup-nss
5557This is the name service switch configuration with support for host name
5558lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
5559@end defvr
4c9050c6 5560
996ed739
LC
5561The reference for name service switch configuration is given below. It
5562is a direct mapping of the C library's configuration file format, so
5563please refer to the C library manual for more information (@pxref{NSS
5564Configuration File,,, libc, The GNU C Library Reference Manual}).
5565Compared to libc's NSS configuration file format, it has the advantage
5566not only of adding this warm parenthetic feel that we like, but also
5567static checks: you'll know about syntax errors and typos as soon as you
5568run @command{guix system}.
5569
996ed739
LC
5570@deftp {Data Type} name-service-switch
5571
5572This is the data type representation the configuration of libc's name
5573service switch (NSS). Each field below represents one of the supported
5574system databases.
5575
5576@table @code
5577@item aliases
5578@itemx ethers
5579@itemx group
5580@itemx gshadow
5581@itemx hosts
5582@itemx initgroups
5583@itemx netgroup
5584@itemx networks
5585@itemx password
5586@itemx public-key
5587@itemx rpc
5588@itemx services
5589@itemx shadow
5590The system databases handled by the NSS. Each of these fields must be a
5591list of @code{<name-service>} objects (see below.)
5592@end table
5593@end deftp
5594
5595@deftp {Data Type} name-service
5596
5597This is the data type representing an actual name service and the
5598associated lookup action.
5599
5600@table @code
5601@item name
5602A string denoting the name service (@pxref{Services in the NSS
5603configuration,,, libc, The GNU C Library Reference Manual}).
5604
4aee6e60
LC
5605Note that name services listed here must be visible to nscd. This is
5606achieved by passing the @code{#:name-services} argument to
5607@code{nscd-service} the list of packages providing the needed name
5608services (@pxref{Base Services, @code{nscd-service}}).
5609
996ed739
LC
5610@item reaction
5611An action specified using the @code{lookup-specification} macro
5612(@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
5613Reference Manual}). For example:
5614
5615@example
5616(lookup-specification (unavailable => continue)
5617 (success => return))
5618@end example
5619@end table
5620@end deftp
0ae8c15a 5621
fd1b1fa2
LC
5622@node Initial RAM Disk
5623@subsection Initial RAM Disk
5624
5625@cindex initial RAM disk (initrd)
5626@cindex initrd (initial RAM disk)
5627For bootstrapping purposes, the Linux-Libre kernel is passed an
5628@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
5629root file system, as well as an initialization script. The latter is
5630responsible for mounting the real root file system, and for loading any
5631kernel modules that may be needed to achieve that.
5632
5633The @code{initrd} field of an @code{operating-system} declaration allows
5634you to specify which initrd you would like to use. The @code{(gnu
5635system linux-initrd)} module provides two ways to build an initrd: the
5636high-level @code{base-initrd} procedure, and the low-level
5637@code{expression->initrd} procedure.
5638
5639The @code{base-initrd} procedure is intended to cover most common uses.
5640For example, if you want to add a bunch of kernel modules to be loaded
5641at boot time, you can define the @code{initrd} field of the operating
5642system declaration like this:
5643
5644@example
52ac153e 5645(initrd (lambda (file-systems . rest)
027981d6
LC
5646 ;; Create a standard initrd that has modules "foo.ko"
5647 ;; and "bar.ko", as well as their dependencies, in
5648 ;; addition to the modules available by default.
52ac153e 5649 (apply base-initrd file-systems
027981d6 5650 #:extra-modules '("foo" "bar")
52ac153e 5651 rest)))
fd1b1fa2
LC
5652@end example
5653
52ac153e
LC
5654The @code{base-initrd} procedure also handles common use cases that
5655involves using the system as a QEMU guest, or as a ``live'' system whose
5656root file system is volatile.
fd1b1fa2
LC
5657
5658@deffn {Monadic Procedure} base-initrd @var{file-systems} @
5659 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 5660 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
5661Return a monadic derivation that builds a generic initrd. @var{file-systems} is
5662a list of file-systems to be mounted by the initrd, possibly in addition to
5663the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
5664@var{mapped-devices} is a list of device mappings to realize before
5665@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
5666
5667When @var{qemu-networking?} is true, set up networking with the standard QEMU
5668parameters. When @var{virtio?} is true, load additional modules so the initrd can
5669be used as a QEMU guest with para-virtualized I/O drivers.
5670
5671When @var{volatile-root?} is true, the root file system is writable but any changes
5672to it are lost.
5673
5674The initrd is automatically populated with all the kernel modules necessary
5675for @var{file-systems} and for the given options. However, additional kernel
5676modules can be listed in @var{extra-modules}. They will be added to the initrd, and
5677loaded at boot time in the order in which they appear.
5678@end deffn
5679
5680Needless to say, the initrds we produce and use embed a
5681statically-linked Guile, and the initialization program is a Guile
5682program. That gives a lot of flexibility. The
5683@code{expression->initrd} procedure builds such an initrd, given the
5684program to run in that initrd.
5685
5686@deffn {Monadic Procedure} expression->initrd @var{exp} @
5687 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 5688 [#:modules '()]
fd1b1fa2
LC
5689Return a derivation that builds a Linux initrd (a gzipped cpio archive)
5690containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
5691upon booting. All the derivations referenced by @var{exp} are
5692automatically copied to the initrd.
fd1b1fa2 5693
42d10464
LC
5694@var{modules} is a list of Guile module names to be embedded in the
5695initrd.
fd1b1fa2
LC
5696@end deffn
5697
88faf933
LC
5698@node GRUB Configuration
5699@subsection GRUB Configuration
5700
5701@cindex GRUB
5702@cindex boot loader
5703
5704The operating system uses GNU@tie{}GRUB as its boot loader
5705(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
5706configured using @code{grub-configuration} declarations. This data type
5707is exported by the @code{(gnu system grub)} module, and described below.
5708
5709@deftp {Data Type} grub-configuration
5710The type of a GRUB configuration declaration.
5711
5712@table @asis
5713
5714@item @code{device}
5715This is a string denoting the boot device. It must be a device name
5716understood by the @command{grub-install} command, such as
5717@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
5718GNU GRUB Manual}).
5719
5720@item @code{menu-entries} (default: @code{()})
5721A possibly empty list of @code{menu-entry} objects (see below), denoting
5722entries to appear in the GRUB boot menu, in addition to the current
5723system entry and the entry pointing to previous system generations.
5724
5725@item @code{default-entry} (default: @code{0})
5726The index of the default boot menu entry. Index 0 is for the current
5727system's entry.
5728
5729@item @code{timeout} (default: @code{5})
5730The number of seconds to wait for keyboard input before booting. Set to
57310 to boot immediately, and to -1 to wait indefinitely.
5732
5733@item @code{theme} (default: @var{%default-theme})
5734The @code{grub-theme} object describing the theme to use.
5735@end table
5736
5737@end deftp
5738
5739Should you want to list additional boot menu entries @i{via} the
5740@code{menu-entries} field above, you will need to create them with the
5741@code{menu-entry} form:
5742
5743@deftp {Data Type} menu-entry
5744The type of an entry in the GRUB boot menu.
5745
5746@table @asis
5747
5748@item @code{label}
35ed9306 5749The label to show in the menu---e.g., @code{"GNU"}.
88faf933
LC
5750
5751@item @code{linux}
5752The Linux kernel to boot.
5753
5754@item @code{linux-arguments} (default: @code{()})
5755The list of extra Linux kernel command-line arguments---e.g.,
5756@code{("console=ttyS0")}.
5757
5758@item @code{initrd}
5759A G-Expression or string denoting the file name of the initial RAM disk
5760to use (@pxref{G-Expressions}).
5761
5762@end table
5763@end deftp
5764
5765@c FIXME: Write documentation once it's stable.
5766Themes are created using the @code{grub-theme} form, which is not
5767documented yet.
5768
5769@defvr {Scheme Variable} %default-theme
5770This is the default GRUB theme used by the operating system, with a
5771fancy background image displaying the GNU and Guix logos.
5772@end defvr
5773
5774
cf4a9129
LC
5775@node Invoking guix system
5776@subsection Invoking @code{guix system}
0918e64a 5777
cf4a9129
LC
5778Once you have written an operating system declaration, as seen in the
5779previous section, it can be @dfn{instantiated} using the @command{guix
5780system} command. The synopsis is:
4af2447e 5781
cf4a9129
LC
5782@example
5783guix system @var{options}@dots{} @var{action} @var{file}
5784@end example
4af2447e 5785
cf4a9129
LC
5786@var{file} must be the name of a file containing an
5787@code{operating-system} declaration. @var{action} specifies how the
5788operating system is instantiate. Currently the following values are
5789supported:
4af2447e 5790
cf4a9129
LC
5791@table @code
5792@item reconfigure
5793Build the operating system described in @var{file}, activate it, and
5794switch to it@footnote{This action is usable only on systems already
5795running GNU.}.
4af2447e 5796
cf4a9129
LC
5797This effects all the configuration specified in @var{file}: user
5798accounts, system services, global package list, setuid programs, etc.
4af2447e 5799
cf4a9129
LC
5800It also adds a GRUB menu entry for the new OS configuration, and moves
5801entries for older configurations to a submenu---unless
5802@option{--no-grub} is passed.
4af2447e 5803
bf2479c7
LC
5804@c The paragraph below refers to the problem discussed at
5805@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
5806It is highly recommended to run @command{guix pull} once before you run
5807@command{guix system reconfigure} for the first time (@pxref{Invoking
5808guix pull}). Failing to do that you would see an older version of Guix
5809once @command{reconfigure} has completed.
5810
cf4a9129
LC
5811@item build
5812Build the operating system's derivation, which includes all the
5813configuration files and programs needed to boot and run the system.
5814This action does not actually install anything.
113daf62 5815
cf4a9129
LC
5816@item init
5817Populate the given directory with all the files necessary to run the
5818operating system specified in @var{file}. This is useful for first-time
4705641f 5819installations of GuixSD. For instance:
113daf62
LC
5820
5821@example
cf4a9129 5822guix system init my-os-config.scm /mnt
113daf62
LC
5823@end example
5824
cf4a9129
LC
5825copies to @file{/mnt} all the store items required by the configuration
5826specified in @file{my-os-config.scm}. This includes configuration
5827files, packages, and so on. It also creates other essential files
5828needed for the system to operate correctly---e.g., the @file{/etc},
5829@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 5830
cf4a9129
LC
5831This command also installs GRUB on the device specified in
5832@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 5833
cf4a9129
LC
5834@item vm
5835@cindex virtual machine
0276f697 5836@cindex VM
cf4a9129
LC
5837Build a virtual machine that contain the operating system declared in
5838@var{file}, and return a script to run that virtual machine (VM).
810568b3 5839Arguments given to the script are passed as is to QEMU.
113daf62 5840
cf4a9129 5841The VM shares its store with the host system.
113daf62 5842
0276f697
LC
5843Additional file systems can be shared between the host and the VM using
5844the @code{--share} and @code{--expose} command-line options: the former
5845specifies a directory to be shared with write access, while the latter
5846provides read-only access to the shared directory.
5847
5848The example below creates a VM in which the user's home directory is
5849accessible read-only, and where the @file{/exchange} directory is a
5850read-write mapping of the host's @file{$HOME/tmp}:
5851
5852@example
5853guix system vm my-config.scm \
5854 --expose=$HOME --share=$HOME/tmp=/exchange
5855@end example
5856
6aa260af
LC
5857On GNU/Linux, the default is to boot directly to the kernel; this has
5858the advantage of requiring only a very tiny root disk image since the
5859host's store can then be mounted.
5860
5861The @code{--full-boot} option forces a complete boot sequence, starting
5862with the bootloader. This requires more disk space since a root image
5863containing at least the kernel, initrd, and bootloader data files must
5864be created. The @code{--image-size} option can be used to specify the
5865image's size.
ab11f0be 5866
cf4a9129
LC
5867@item vm-image
5868@itemx disk-image
5869Return a virtual machine or disk image of the operating system declared
5870in @var{file} that stands alone. Use the @option{--image-size} option
5871to specify the size of the image.
113daf62 5872
cf4a9129
LC
5873When using @code{vm-image}, the returned image is in qcow2 format, which
5874the QEMU emulator can efficiently use.
113daf62 5875
cf4a9129
LC
5876When using @code{disk-image}, a raw disk image is produced; it can be
5877copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
5878the device corresponding to a USB stick, one can copy the image on it
5879using the following command:
113daf62 5880
cf4a9129
LC
5881@example
5882# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
5883@end example
113daf62 5884
cf4a9129 5885@end table
113daf62 5886
cf4a9129
LC
5887@var{options} can contain any of the common build options provided by
5888@command{guix build} (@pxref{Invoking guix build}). In addition,
5889@var{options} can contain one of the following:
113daf62 5890
cf4a9129
LC
5891@table @option
5892@item --system=@var{system}
5893@itemx -s @var{system}
5894Attempt to build for @var{system} instead of the host's system type.
5895This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 5896
cf4a9129
LC
5897@item --image-size=@var{size}
5898For the @code{vm-image} and @code{disk-image} actions, create an image
5899of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
5900include a unit as a suffix (@pxref{Block size, size specifications,,
5901coreutils, GNU Coreutils}).
113daf62 5902@end table
113daf62 5903
cf4a9129
LC
5904Note that all the actions above, except @code{build} and @code{init},
5905rely on KVM support in the Linux-Libre kernel. Specifically, the
5906machine should have hardware virtualization support, the corresponding
5907KVM kernel module should be loaded, and the @file{/dev/kvm} device node
5908must exist and be readable and writable by the user and by the daemon's
5909build users.
8451a568 5910
cf4a9129
LC
5911@node Defining Services
5912@subsection Defining Services
8451a568 5913
cf4a9129
LC
5914The @code{(gnu services @dots{})} modules define several procedures that allow
5915users to declare the operating system's services (@pxref{Using the
5916Configuration System}). These procedures are @emph{monadic
5917procedures}---i.e., procedures that return a monadic value in the store
5918monad (@pxref{The Store Monad}). For examples of such procedures,
5919@xref{Services}.
8451a568 5920
cf4a9129
LC
5921@cindex service definition
5922The monadic value returned by those procedures is a @dfn{service
5923definition}---a structure as returned by the @code{service} form.
5924Service definitions specifies the inputs the service depends on, and an
5925expression to start and stop the service. Behind the scenes, service
5926definitions are ``translated'' into the form suitable for the
5927configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
5928dmd Manual}).
8451a568 5929
cf4a9129
LC
5930As an example, here is what the @code{nscd-service} procedure looks
5931like:
8451a568 5932
cf4a9129
LC
5933@lisp
5934(define (nscd-service)
5935 (with-monad %store-monad
5936 (return (service
5937 (documentation "Run libc's name service cache daemon.")
5938 (provision '(nscd))
5939 (activate #~(begin
5940 (use-modules (guix build utils))
5941 (mkdir-p "/var/run/nscd")))
5942 (start #~(make-forkexec-constructor
5943 (string-append #$glibc "/sbin/nscd")
5944 "-f" "/dev/null" "--foreground"))
5945 (stop #~(make-kill-destructor))
5946 (respawn? #f)))))
5947@end lisp
8451a568 5948
cf4a9129
LC
5949@noindent
5950The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
5951(@pxref{G-Expressions}). The @code{activate} field contains a script to
5952run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
5953directory exists before @command{nscd} is started.
8451a568 5954
cf4a9129
LC
5955The @code{start} and @code{stop} fields refer to dmd's facilities to
5956start and stop processes (@pxref{Service De- and Constructors,,, dmd,
5957GNU dmd Manual}). The @code{provision} field specifies the name under
5958which this service is known to dmd, and @code{documentation} specifies
5959on-line documentation. Thus, the commands @command{deco start ncsd},
5960@command{deco stop nscd}, and @command{deco doc nscd} will do what you
5961would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 5962
8451a568 5963
cf4a9129
LC
5964@node Installing Debugging Files
5965@section Installing Debugging Files
8451a568 5966
cf4a9129
LC
5967@cindex debugging files
5968Program binaries, as produced by the GCC compilers for instance, are
5969typically written in the ELF format, with a section containing
5970@dfn{debugging information}. Debugging information is what allows the
5971debugger, GDB, to map binary code to source code; it is required to
5972debug a compiled program in good conditions.
8451a568 5973
cf4a9129
LC
5974The problem with debugging information is that is takes up a fair amount
5975of disk space. For example, debugging information for the GNU C Library
5976weighs in at more than 60 MiB. Thus, as a user, keeping all the
5977debugging info of all the installed programs is usually not an option.
5978Yet, space savings should not come at the cost of an impediment to
5979debugging---especially in the GNU system, which should make it easier
5980for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 5981
cf4a9129
LC
5982Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
5983mechanism that allows users to get the best of both worlds: debugging
5984information can be stripped from the binaries and stored in separate
5985files. GDB is then able to load debugging information from those files,
5986when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
5987with GDB}).
8451a568 5988
cf4a9129
LC
5989The GNU distribution takes advantage of this by storing debugging
5990information in the @code{lib/debug} sub-directory of a separate package
5991output unimaginatively called @code{debug} (@pxref{Packages with
5992Multiple Outputs}). Users can choose to install the @code{debug} output
5993of a package when they need it. For instance, the following command
5994installs the debugging information for the GNU C Library and for GNU
5995Guile:
8451a568
LC
5996
5997@example
cf4a9129 5998guix package -i glibc:debug guile:debug
8451a568
LC
5999@end example
6000
cf4a9129
LC
6001GDB must then be told to look for debug files in the user's profile, by
6002setting the @code{debug-file-directory} variable (consider setting it
6003from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
6004GDB}):
8451a568 6005
cf4a9129
LC
6006@example
6007(gdb) set debug-file-directory ~/.guix-profile/lib/debug
6008@end example
8451a568 6009
cf4a9129
LC
6010From there on, GDB will pick up debugging information from the
6011@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 6012
cf4a9129
LC
6013In addition, you will most likely want GDB to be able to show the source
6014code being debugged. To do that, you will have to unpack the source
6015code of the package of interest (obtained with @code{guix build
6016--source}, @pxref{Invoking guix build}), and to point GDB to that source
6017directory using the @code{directory} command (@pxref{Source Path,
6018@code{directory},, gdb, Debugging with GDB}).
8451a568 6019
cf4a9129
LC
6020@c XXX: keep me up-to-date
6021The @code{debug} output mechanism in Guix is implemented by the
6022@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
6023opt-in---debugging information is available only for those packages
6024whose definition explicitly declares a @code{debug} output. This may be
6025changed to opt-out in the future, if our build farm servers can handle
6026the load. To check whether a package has a @code{debug} output, use
6027@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 6028
8451a568 6029
05962f29
LC
6030@node Security Updates
6031@section Security Updates
6032
843858b8
LC
6033@quotation Note
6034As of version @value{VERSION}, the feature described in this section is
6035experimental.
6036@end quotation
05962f29
LC
6037
6038@cindex security updates
6039Occasionally, important security vulnerabilities are discovered in core
6040software packages and must be patched. Guix follows a functional
6041package management discipline (@pxref{Introduction}), which implies
6042that, when a package is changed, @emph{every package that depends on it}
6043must be rebuilt. This can significantly slow down the deployment of
6044fixes in core packages such as libc or Bash, since basically the whole
6045distribution would need to be rebuilt. Using pre-built binaries helps
6046(@pxref{Substitutes}), but deployment may still take more time than
6047desired.
6048
6049@cindex grafts
6050To address that, Guix implements @dfn{grafts}, a mechanism that allows
6051for fast deployment of critical updates without the costs associated
6052with a whole-distribution rebuild. The idea is to rebuild only the
6053package that needs to be patched, and then to ``graft'' it onto packages
6054explicitly installed by the user and that were previously referring to
6055the original package. The cost of grafting is typically very low, and
6056order of magnitudes lower than a full rebuild of the dependency chain.
6057
6058@cindex replacements of packages, for grafts
6059For instance, suppose a security update needs to be applied to Bash.
6060Guix developers will provide a package definition for the ``fixed''
6061Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
6062Packages}). Then, the original package definition is augmented with a
6063@code{replacement} field pointing to the package containing the bug fix:
6064
6065@example
6066(define bash
6067 (package
6068 (name "bash")
6069 ;; @dots{}
6070 (replacement bash-fixed)))
6071@end example
6072
6073From there on, any package depending directly or indirectly on Bash that
6074is installed will automatically be ``rewritten'' to refer to
6075@var{bash-fixed} instead of @var{bash}. This grafting process takes
6076time proportional to the size of the package, but expect less than a
6077minute for an ``average'' package on a recent machine.
6078
6079Currently, the graft and the package it replaces (@var{bash-fixed} and
6080@var{bash} in the example above) must have the exact same @code{name}
6081and @code{version} fields. This restriction mostly comes from the fact
6082that grafting works by patching files, including binary files, directly.
6083Other restrictions may apply: for instance, when adding a graft to a
6084package providing a shared library, the original shared library and its
6085replacement must have the same @code{SONAME} and be binary-compatible.
6086
6087
cf4a9129
LC
6088@node Package Modules
6089@section Package Modules
8451a568 6090
cf4a9129
LC
6091From a programming viewpoint, the package definitions of the
6092GNU distribution are provided by Guile modules in the @code{(gnu packages
6093@dots{})} name space@footnote{Note that packages under the @code{(gnu
6094packages @dots{})} module name space are not necessarily ``GNU
6095packages''. This module naming scheme follows the usual Guile module
6096naming convention: @code{gnu} means that these modules are distributed
6097as part of the GNU system, and @code{packages} identifies modules that
6098define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
6099Reference Manual}). For instance, the @code{(gnu packages emacs)}
6100module exports a variable named @code{emacs}, which is bound to a
6101@code{<package>} object (@pxref{Defining Packages}).
113daf62 6102
300868ba 6103The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
6104automatically scanned for packages by the command-line tools. For
6105instance, when running @code{guix package -i emacs}, all the @code{(gnu
6106packages @dots{})} modules are scanned until one that exports a package
6107object whose name is @code{emacs} is found. This package search
6108facility is implemented in the @code{(gnu packages)} module.
113daf62 6109
300868ba 6110@cindex customization, of packages
8689901f 6111@cindex package module search path
cf4a9129 6112Users can store package definitions in modules with different
60142854
LC
6113names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
6114name and module name must match. @xref{Modules and the File System,,,
6115guile, GNU Guile Reference Manual}, for details.} These package definitions
300868ba
LC
6116will not be visible by default. Thus, users can invoke commands such as
6117@command{guix package} and @command{guix build} have to be used with the
6118@code{-e} option so that they know where to find the package, or use the
6119@code{-L} option of these commands to make those modules visible
8689901f
LC
6120(@pxref{Invoking guix build, @code{--load-path}}), or define the
6121@code{GUIX_PACKAGE_PATH} environment variable. This environment
6122variable makes it easy to extend or customize the distribution and is
6123honored by all the user interfaces.
6124
6125@defvr {Environment Variable} GUIX_PACKAGE_PATH
6126This is a colon-separated list of directories to search for package
6127modules. Directories listed in this variable take precedence over the
6128distribution's own modules.
6129@end defvr
ef5dd60a 6130
cf4a9129
LC
6131The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
6132each package is built based solely on other packages in the
6133distribution. The root of this dependency graph is a small set of
6134@dfn{bootstrap binaries}, provided by the @code{(gnu packages
6135bootstrap)} module. For more information on bootstrapping,
081145cf 6136@pxref{Bootstrapping}.
ef5dd60a 6137
cf4a9129
LC
6138@node Packaging Guidelines
6139@section Packaging Guidelines
ef5dd60a 6140
cf4a9129
LC
6141The GNU distribution is nascent and may well lack some of your favorite
6142packages. This section describes how you can help make the distribution
6143grow. @xref{Contributing}, for additional information on how you can
6144help.
ef5dd60a 6145
cf4a9129
LC
6146Free software packages are usually distributed in the form of
6147@dfn{source code tarballs}---typically @file{tar.gz} files that contain
6148all the source files. Adding a package to the distribution means
6149essentially two things: adding a @dfn{recipe} that describes how to
6150build the package, including a list of other packages required to build
6151it, and adding @dfn{package meta-data} along with that recipe, such as a
6152description and licensing information.
ef5dd60a 6153
cf4a9129
LC
6154In Guix all this information is embodied in @dfn{package definitions}.
6155Package definitions provide a high-level view of the package. They are
6156written using the syntax of the Scheme programming language; in fact,
6157for each package we define a variable bound to the package definition,
6158and export that variable from a module (@pxref{Package Modules}).
6159However, in-depth Scheme knowledge is @emph{not} a prerequisite for
6160creating packages. For more information on package definitions,
081145cf 6161@pxref{Defining Packages}.
ef5dd60a 6162
cf4a9129
LC
6163Once a package definition is in place, stored in a file in the Guix
6164source tree, it can be tested using the @command{guix build} command
6165(@pxref{Invoking guix build}). For example, assuming the new package is
6166called @code{gnew}, you may run this command from the Guix build tree:
ef5dd60a
LC
6167
6168@example
cf4a9129 6169./pre-inst-env guix build gnew --keep-failed
ef5dd60a 6170@end example
ef5dd60a 6171
cf4a9129
LC
6172Using @code{--keep-failed} makes it easier to debug build failures since
6173it provides access to the failed build tree. Another useful
6174command-line option when debugging is @code{--log-file}, to access the
6175build log.
ef5dd60a 6176
cf4a9129
LC
6177If the package is unknown to the @command{guix} command, it may be that
6178the source file contains a syntax error, or lacks a @code{define-public}
6179clause to export the package variable. To figure it out, you may load
6180the module from Guile to get more information about the actual error:
ef5dd60a 6181
cf4a9129
LC
6182@example
6183./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
6184@end example
ef5dd60a 6185
cf4a9129
LC
6186Once your package builds correctly, please send us a patch
6187(@pxref{Contributing}). Well, if you need help, we will be happy to
6188help you too. Once the patch is committed in the Guix repository, the
6189new package automatically gets built on the supported platforms by
2b1cee21 6190@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 6191system}.
ef5dd60a 6192
cf4a9129
LC
6193@cindex substituter
6194Users can obtain the new package definition simply by running
6195@command{guix pull} (@pxref{Invoking guix pull}). When
6196@code{hydra.gnu.org} is done building the package, installing the
6197package automatically downloads binaries from there
6198(@pxref{Substitutes}). The only place where human intervention is
6199needed is to review and apply the patch.
ef5dd60a 6200
ef5dd60a 6201
cf4a9129 6202@menu
ec0339cd
LC
6203* Software Freedom:: What may go into the distribution.
6204* Package Naming:: What's in a name?
6205* Version Numbers:: When the name is not enough.
6206* Python Modules:: Taming the snake.
6207* Perl Modules:: Little pearls.
6208* Fonts:: Fond of fonts.
cf4a9129 6209@end menu
ef5dd60a 6210
cf4a9129
LC
6211@node Software Freedom
6212@subsection Software Freedom
ef5dd60a 6213
cf4a9129 6214@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 6215
cf4a9129
LC
6216The GNU operating system has been developed so that users can have
6217freedom in their computing. GNU is @dfn{free software}, meaning that
6218users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
6219essential freedoms}: to run the program, to study and change the program
6220in source code form, to redistribute exact copies, and to distribute
6221modified versions. Packages found in the GNU distribution provide only
6222software that conveys these four freedoms.
c11a6eb1 6223
cf4a9129
LC
6224In addition, the GNU distribution follow the
6225@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
6226software distribution guidelines}. Among other things, these guidelines
6227reject non-free firmware, recommendations of non-free software, and
6228discuss ways to deal with trademarks and patents.
ef5dd60a 6229
cf4a9129
LC
6230Some packages contain a small and optional subset that violates the
6231above guidelines, for instance because this subset is itself non-free
6232code. When that happens, the offending items are removed with
6233appropriate patches or code snippets in the package definition's
6234@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
6235build --source} returns the ``freed'' source rather than the unmodified
6236upstream source.
ef5dd60a 6237
ef5dd60a 6238
cf4a9129
LC
6239@node Package Naming
6240@subsection Package Naming
ef5dd60a 6241
cf4a9129
LC
6242A package has actually two names associated with it:
6243First, there is the name of the @emph{Scheme variable}, the one following
6244@code{define-public}. By this name, the package can be made known in the
6245Scheme code, for instance as input to another package. Second, there is
6246the string in the @code{name} field of a package definition. This name
6247is used by package management commands such as
6248@command{guix package} and @command{guix build}.
ef5dd60a 6249
cf4a9129
LC
6250Both are usually the same and correspond to the lowercase conversion of
6251the project name chosen upstream, with underscores replaced with
6252hyphens. For instance, GNUnet is available as @code{gnunet}, and
6253SDL_net as @code{sdl-net}.
927097ef 6254
cf4a9129 6255We do not add @code{lib} prefixes for library packages, unless these are
081145cf 6256already part of the official project name. But @pxref{Python
cf4a9129
LC
6257Modules} and @ref{Perl Modules} for special rules concerning modules for
6258the Python and Perl languages.
927097ef 6259
1b366ee4 6260Font package names are handled differently, @pxref{Fonts}.
7fec52b7 6261
ef5dd60a 6262
cf4a9129
LC
6263@node Version Numbers
6264@subsection Version Numbers
ef5dd60a 6265
cf4a9129
LC
6266We usually package only the latest version of a given free software
6267project. But sometimes, for instance for incompatible library versions,
6268two (or more) versions of the same package are needed. These require
6269different Scheme variable names. We use the name as defined
6270in @ref{Package Naming}
6271for the most recent version; previous versions use the same name, suffixed
6272by @code{-} and the smallest prefix of the version number that may
6273distinguish the two versions.
ef5dd60a 6274
cf4a9129
LC
6275The name inside the package definition is the same for all versions of a
6276package and does not contain any version number.
ef5dd60a 6277
cf4a9129 6278For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 6279
cf4a9129
LC
6280@example
6281(define-public gtk+
6282 (package
6283 (name "gtk+")
6284 (version "3.9.12")
6285 ...))
6286(define-public gtk+-2
6287 (package
6288 (name "gtk+")
6289 (version "2.24.20")
6290 ...))
6291@end example
6292If we also wanted GTK+ 3.8.2, this would be packaged as
6293@example
6294(define-public gtk+-3.8
6295 (package
6296 (name "gtk+")
6297 (version "3.8.2")
6298 ...))
6299@end example
ef5dd60a 6300
ef5dd60a 6301
cf4a9129
LC
6302@node Python Modules
6303@subsection Python Modules
ef5dd60a 6304
cf4a9129
LC
6305We currently package Python 2 and Python 3, under the Scheme variable names
6306@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
6307To avoid confusion and naming clashes with other programming languages, it
6308seems desirable that the name of a package for a Python module contains
6309the word @code{python}.
ef5dd60a 6310
cf4a9129
LC
6311Some modules are compatible with only one version of Python, others with both.
6312If the package Foo compiles only with Python 3, we name it
6313@code{python-foo}; if it compiles only with Python 2, we name it
6314@code{python2-foo}. If it is compatible with both versions, we create two
6315packages with the corresponding names.
ef5dd60a 6316
cf4a9129
LC
6317If a project already contains the word @code{python}, we drop this;
6318for instance, the module python-dateutil is packaged under the names
6319@code{python-dateutil} and @code{python2-dateutil}.
113daf62 6320
523e4896 6321
cf4a9129
LC
6322@node Perl Modules
6323@subsection Perl Modules
523e4896 6324
cf4a9129
LC
6325Perl programs standing for themselves are named as any other package,
6326using the lowercase upstream name.
6327For Perl packages containing a single class, we use the lowercase class name,
6328replace all occurrences of @code{::} by dashes and prepend the prefix
6329@code{perl-}.
6330So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
6331Modules containing several classes keep their lowercase upstream name and
6332are also prepended by @code{perl-}. Such modules tend to have the word
6333@code{perl} somewhere in their name, which gets dropped in favor of the
6334prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 6335
523e4896 6336
7fec52b7
AE
6337@node Fonts
6338@subsection Fonts
6339
6340For fonts that are in general not installed by a user for typesetting
6341purposes, or that are distributed as part of a larger software package,
6342we rely on the general packaging rules for software; for instance, this
6343applies to the fonts delivered as part of the X.Org system or fonts that
6344are part of TeX Live.
6345
6346To make it easier for a user to search for fonts, names for other packages
6347containing only fonts are constructed as follows, independently of the
6348upstream package name.
6349
6350The name of a package containing only one font family starts with
6351@code{font-}; it is followed by the foundry name and a dash @code{-}
6352if the foundry is known, and the font family name, in which spaces are
6353replaced by dashes (and as usual, all upper case letters are transformed
6354to lower case).
6355For example, the Gentium font family by SIL is packaged under the name
6356@code{font-sil-gentium}.
6357
6358For a package containing several font families, the name of the collection
6359is used in the place of the font family name.
6360For instance, the Liberation fonts consist of three families,
6361Liberation Sans, Liberation Serif and Liberation Mono.
6362These could be packaged separately under the names
6363@code{font-liberation-sans} and so on; but as they are distributed together
6364under a common name, we prefer to package them together as
6365@code{font-liberation}.
6366
6367In the case where several formats of the same font family or font collection
6368are packaged separately, a short form of the format, prepended by a dash,
6369is added to the package name. We use @code{-ttf} for TrueType fonts,
1b366ee4 6370@code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
7fec52b7
AE
6371fonts.
6372
6373
b25937e3 6374
cf4a9129
LC
6375@node Bootstrapping
6376@section Bootstrapping
b25937e3 6377
cf4a9129 6378@c Adapted from the ELS 2013 paper.
b25937e3 6379
cf4a9129 6380@cindex bootstrapping
7889394e 6381
cf4a9129
LC
6382Bootstrapping in our context refers to how the distribution gets built
6383``from nothing''. Remember that the build environment of a derivation
6384contains nothing but its declared inputs (@pxref{Introduction}). So
6385there's an obvious chicken-and-egg problem: how does the first package
6386get built? How does the first compiler get compiled? Note that this is
6387a question of interest only to the curious hacker, not to the regular
6388user, so you can shamelessly skip this section if you consider yourself
6389a ``regular user''.
72b9d60d 6390
cf4a9129
LC
6391@cindex bootstrap binaries
6392The GNU system is primarily made of C code, with libc at its core. The
6393GNU build system itself assumes the availability of a Bourne shell and
6394command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
6395`grep'. Furthermore, build programs---programs that run
6396@code{./configure}, @code{make}, etc.---are written in Guile Scheme
6397(@pxref{Derivations}). Consequently, to be able to build anything at
6398all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
6399Binutils, libc, and the other packages mentioned above---the
6400@dfn{bootstrap binaries}.
72b9d60d 6401
cf4a9129
LC
6402These bootstrap binaries are ``taken for granted'', though we can also
6403re-create them if needed (more on that later).
72b9d60d 6404
cf4a9129 6405@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 6406
cf4a9129
LC
6407@c As of Emacs 24.3, Info-mode displays the image, but since it's a
6408@c large image, it's hard to scroll. Oh well.
6409@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 6410
cf4a9129
LC
6411The figure above shows the very beginning of the dependency graph of the
6412distribution, corresponding to the package definitions of the @code{(gnu
6413packages bootstrap)} module. At this level of detail, things are
6414slightly complex. First, Guile itself consists of an ELF executable,
6415along with many source and compiled Scheme files that are dynamically
6416loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
6417tarball shown in this graph. This tarball is part of Guix's ``source''
6418distribution, and gets inserted into the store with @code{add-to-store}
6419(@pxref{The Store}).
2e7b5cea 6420
cf4a9129
LC
6421But how do we write a derivation that unpacks this tarball and adds it
6422to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
6423derivation---the first one that gets built---uses @code{bash} as its
6424builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
6425@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
6426@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
6427the Guix source distribution, whose sole purpose is to allow the Guile
6428tarball to be unpacked.
fb729425 6429
cf4a9129
LC
6430Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
6431Guile that can be used to run subsequent build programs. Its first task
6432is to download tarballs containing the other pre-built binaries---this
6433is what the @code{.tar.xz.drv} derivations do. Guix modules such as
6434@code{ftp-client.scm} are used for this purpose. The
6435@code{module-import.drv} derivations import those modules in a directory
6436in the store, using the original layout. The
6437@code{module-import-compiled.drv} derivations compile those modules, and
6438write them in an output directory with the right layout. This
6439corresponds to the @code{#:modules} argument of
6440@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 6441
cf4a9129
LC
6442Finally, the various tarballs are unpacked by the
6443derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
6444etc., at which point we have a working C tool chain.
fb729425 6445
fb729425 6446
cf4a9129 6447@unnumberedsubsec Building the Build Tools
523e4896 6448
cf4a9129
LC
6449@c TODO: Add a package-level dependency graph generated from (gnu
6450@c packages base).
df2ce343 6451
cf4a9129
LC
6452Bootstrapping is complete when we have a full tool chain that does not
6453depend on the pre-built bootstrap tools discussed above. This
6454no-dependency requirement is verified by checking whether the files of
6455the final tool chain contain references to the @file{/gnu/store}
6456directories of the bootstrap inputs. The process that leads to this
6457``final'' tool chain is described by the package definitions found in
1f6f57df 6458the @code{(gnu packages commencement)} module.
df2ce343 6459
cf4a9129
LC
6460@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
6461The first tool that gets built with the bootstrap binaries is
6462GNU Make, which is a prerequisite for all the following packages.
6463From there Findutils and Diffutils get built.
523e4896 6464
cf4a9129
LC
6465Then come the first-stage Binutils and GCC, built as pseudo cross
6466tools---i.e., with @code{--target} equal to @code{--host}. They are
6467used to build libc. Thanks to this cross-build trick, this libc is
6468guaranteed not to hold any reference to the initial tool chain.
4af2447e 6469
cf4a9129
LC
6470From there the final Binutils and GCC are built. GCC uses @code{ld}
6471from the final Binutils, and links programs against the just-built libc.
6472This tool chain is used to build the other packages used by Guix and by
6473the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 6474
cf4a9129
LC
6475And voilà! At this point we have the complete set of build tools that
6476the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
6477variable of the @code{(gnu packages commencement)} module, and are
6478implicitly used by any package that uses @code{gnu-build-system}
1f6f57df 6479(@pxref{Build Systems, @code{gnu-build-system}}).
4af2447e 6480
4af2447e 6481
cf4a9129 6482@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 6483
cf4a9129
LC
6484Because the final tool chain does not depend on the bootstrap binaries,
6485those rarely need to be updated. Nevertheless, it is useful to have an
6486automated way to produce them, should an update occur, and this is what
6487the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 6488
cf4a9129
LC
6489The following command builds the tarballs containing the bootstrap
6490binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
6491of Coreutils and other basic command-line tools):
4b2615e1 6492
cf4a9129
LC
6493@example
6494guix build bootstrap-tarballs
6495@end example
6496
6497The generated tarballs are those that should be referred to in the
6498@code{(gnu packages bootstrap)} module mentioned at the beginning of
6499this section.
6500
6501Still here? Then perhaps by now you've started to wonder: when do we
6502reach a fixed point? That is an interesting question! The answer is
6503unknown, but if you would like to investigate further (and have
6504significant computational and storage resources to do so), then let us
6505know.
6506
6507@node Porting
6508@section Porting to a New Platform
6509
6510As discussed above, the GNU distribution is self-contained, and
6511self-containment is achieved by relying on pre-built ``bootstrap
6512binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
6513operating system kernel, CPU architecture, and application binary
6514interface (ABI). Thus, to port the distribution to a platform that is
6515not yet supported, one must build those bootstrap binaries, and update
6516the @code{(gnu packages bootstrap)} module to use them on that platform.
6517
6518Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
6519When everything goes well, and assuming the GNU tool chain supports the
6520target platform, this can be as simple as running a command like this
6521one:
6522
6523@example
6524guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
6525@end example
6526
1c0c417d
LC
6527For this to work, the @code{glibc-dynamic-linker} procedure in
6528@code{(gnu packages bootstrap)} must be augmented to return the right
6529file name for libc's dynamic linker on that platform; likewise,
6530@code{system->linux-architecture} in @code{(gnu packages linux)} must be
6531taught about the new platform.
6532
cf4a9129 6533Once these are built, the @code{(gnu packages bootstrap)} module needs
1c0c417d
LC
6534to be updated to refer to these binaries on the target platform. That
6535is, the hashes and URLs of the bootstrap tarballs for the new platform
6536must be added alongside those of the currently supported platforms. The
6537bootstrap Guile tarball is treated specially: it is expected to be
6538available locally, and @file{gnu-system.am} has rules do download it for
6539the supported architectures; a rule for the new platform must be added
6540as well.
cf4a9129
LC
6541
6542In practice, there may be some complications. First, it may be that the
6543extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
6544above) is not recognized by all the GNU tools. Typically, glibc
6545recognizes some of these, whereas GCC uses an extra @code{--with-abi}
6546configure flag (see @code{gcc.scm} for examples of how to handle this).
6547Second, some of the required packages could fail to build for that
6548platform. Lastly, the generated binaries could be broken for some
6549reason.
4af2447e
LC
6550
6551
9bf3c1a7
LC
6552@c *********************************************************************
6553@node Contributing
6554@chapter Contributing
6555
6556This project is a cooperative effort, and we need your help to make it
5ff3c4b8
PAR
6557grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
6558@code{#guix} on the Freenode IRC network. We welcome ideas, bug
6559reports, patches, and anything that may be helpful to the project. We
6560particularly welcome help on packaging (@pxref{Packaging Guidelines}).
a1ba8475 6561
9bf3c1a7
LC
6562Please see the
6563@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
6564@file{HACKING} file} that comes with the Guix source code for practical
6565details about contributions.
6566
c78bd12b 6567
568717fd
LC
6568@c *********************************************************************
6569@node Acknowledgments
6570@chapter Acknowledgments
6571
6572Guix is based on the Nix package manager, which was designed and
4c7ac9aa
LC
6573implemented by Eelco Dolstra, with contributions from other people (see
6574the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
6575management, and promoted unprecedented features, such as transactional
6576package upgrades and rollbacks, per-user profiles, and referentially
6577transparent build processes. Without this work, Guix would not exist.
6578
6579The Nix-based software distributions, Nixpkgs and NixOS, have also been
6580an inspiration for Guix.
6581
4c7ac9aa
LC
6582GNU@tie{}Guix itself is a collective work with contributions from a
6583number of people. See the @file{AUTHORS} file in Guix for more
6584information on these fine people. The @file{THANKS} file lists people
6585who have helped by reporting bugs, taking care of the infrastructure,
6586providing artwork and themes, making suggestions, and more---thank you!
6587
6588
568717fd
LC
6589@c *********************************************************************
6590@node GNU Free Documentation License
6591@appendix GNU Free Documentation License
6592
6593@include fdl-1.3.texi
6594
6595@c *********************************************************************
6596@node Concept Index
6597@unnumbered Concept Index
6598@printindex cp
6599
a85b83d2
LC
6600@node Programming Index
6601@unnumbered Programming Index
6602@syncodeindex tp fn
6603@syncodeindex vr fn
568717fd
LC
6604@printindex fn
6605
6606@bye
6607
6608@c Local Variables:
6609@c ispell-local-dictionary: "american";
6610@c End: