gnu: Add getmail.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
425b0bfc 13Copyright @copyright{} 2012, 2013, 2014 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
7df7a74e
NK
15Copyright @copyright{} 2013 Nikita Karetnikov
16
17Permission is granted to copy, distribute and/or modify this document
18under the terms of the GNU Free Documentation License, Version 1.3 or
19any later version published by the Free Software Foundation; with no
20Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
21copy of the license is included in the section entitled ``GNU Free
22Documentation License''.
23@end copying
568717fd 24
eeaf4427 25@dircategory Package management
568717fd
LC
26@direntry
27* guix: (guix). Guix, the functional package manager.
e49951eb 28* guix package: (guix)Invoking guix package
eeaf4427 29 Managing packages with Guix.
e49951eb 30* guix build: (guix)Invoking guix build
568717fd 31 Building packages with Guix.
054e8576
LC
32* guix system: (guix)Invoking guix system
33 Managing the operating system configuration.
568717fd 34@end direntry
568717fd 35
372c4bbc
DT
36@dircategory Software development
37@direntry
38* guix environment: (guix)Invoking guix environment
39 Building development environments with Guix.
40@end direntry
41
568717fd 42@titlepage
7730d112
LC
43@title GNU Guix Reference Manual
44@subtitle Using the GNU Guix Functional Package Manager
568717fd 45@author Ludovic Courtès
da7cabd4 46@author Andreas Enge
acc08466 47@author Nikita Karetnikov
568717fd
LC
48
49@page
50@vskip 0pt plus 1filll
51Edition @value{EDITION} @*
52@value{UPDATED} @*
53
7df7a74e 54@insertcopying
568717fd
LC
55@end titlepage
56
568717fd
LC
57@contents
58
59@c *********************************************************************
60@node Top
f8348b91 61@top GNU Guix
568717fd 62
f8348b91
LC
63This document describes GNU Guix version @value{VERSION}, a functional
64package management tool written for the GNU system.
568717fd
LC
65
66@menu
67* Introduction:: What is Guix about?
bd5e766b 68* Installation:: Installing Guix.
eeaf4427 69* Package Management:: Package installation, upgrade, etc.
568717fd
LC
70* Programming Interface:: Using Guix in Scheme.
71* Utilities:: Package management commands.
a1ba8475 72* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 73* Contributing:: Your help needed!
568717fd
LC
74
75* Acknowledgments:: Thanks!
76* GNU Free Documentation License:: The license of this manual.
77* Concept Index:: Concepts.
a85b83d2 78* Programming Index:: Data types, functions, and variables.
568717fd
LC
79@end menu
80
81@c *********************************************************************
82@node Introduction
83@chapter Introduction
84
c80e7e55
LC
85GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
86using the international phonetic alphabet (IPA).} is a functional
87package management tool for the GNU system. Package management consists
4bfc4ea3
NK
88of all activities that relate to building packages from sources,
89honoring their build-time and run-time dependencies,
c80e7e55
LC
90installing packages in user environments, upgrading installed packages
91to new versions or rolling back to a previous set, removing unused
92software packages, etc.
568717fd
LC
93
94@cindex functional package management
95The term @dfn{functional} refers to a specific package management
96discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
97as a function, in the mathematical sense. That function takes inputs,
98such as build scripts, a compiler, and libraries, and
99returns an installed package. As a pure function, its result depends
568717fd
LC
100solely on its inputs---for instance, it cannot refer to software or
101scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
102always produces the same result when passed a given set of inputs. It
103cannot alter the system's environment in
568717fd
LC
104any way; for instance, it cannot create, modify, or delete files outside
105of its build and installation directories. This is achieved by running
e900c503 106build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 107explicit inputs are visible.
568717fd 108
e531ac2a 109@cindex store
568717fd 110The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
111system, in a special directory called @dfn{the store} (@pxref{The
112Store}). Each package is installed in a directory of its own, in the
834129e0 113store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
114a hash of all the inputs used to build that package; thus, changing an
115input yields a different directory name.
116
117This approach is the foundation of Guix's salient features: support for
4bfc4ea3 118transactional package upgrade and rollback, per-user installation, and
eeaf4427 119garbage collection of packages (@pxref{Features}).
568717fd 120
4bfc4ea3 121Guix has a command-line interface, which allows users to build, install,
568717fd 122upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 123
a1ba8475
LC
124Last but not least, Guix is used to build a distribution of the GNU
125system, with many GNU and non-GNU free software packages. @xref{GNU
126Distribution}.
127
bd5e766b
LC
128@c *********************************************************************
129@node Installation
130@chapter Installation
131
48febeb8
LC
132GNU Guix is available for download from its website at
133@url{http://www.gnu.org/software/guix/}. This section describes the
134software requirements of Guix, as well as how to install it and get
135ready to use it.
bd5e766b 136
5af6de3e
LC
137Note that this section is concerned with the installation of the package
138manager, which can be done on top of a running GNU/Linux system. If,
139instead, you want to install the complete GNU operating system,
6621cdb6 140@pxref{System Installation}.
5af6de3e 141
b22a12fd 142The build procedure for Guix is the same as for other GNU software, and
1da983b9 143is not covered here. Please see the files @file{README} and
b22a12fd
LC
144@file{INSTALL} in the Guix source tree for additional details.
145
bd5e766b
LC
146@menu
147* Requirements:: Software needed to build and run Guix.
148* Setting Up the Daemon:: Preparing the build daemon's environment.
149* Invoking guix-daemon:: Running the build daemon.
150@end menu
151
152@node Requirements
153@section Requirements
154
155GNU Guix depends on the following packages:
156
157@itemize
4a328f73 158@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.5 or later;
288dca55 159@item @url{http://gnupg.org/, GNU libgcrypt};
8a96bd4b
ID
160@end itemize
161
162The following dependencies are optional:
163
164@itemize
288dca55 165@item
8a96bd4b 166Installing
288dca55 167@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
168allow you to use the @command{guix import pypi} command (@pxref{Invoking
169guix import}). It is of
288dca55 170interest primarily for developers and not for casual users.
8a96bd4b
ID
171@item
172Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
173allow you to access @code{https} URLs with the @command{guix download}
174command (@pxref{Invoking guix download}) and the @command{guix import
175pypi} command. This is primarily of interest to developers.
176@xref{Guile Preparations, how to install the GnuTLS bindings for Guile,,
177gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
178@end itemize
179
180Unless @code{--disable-daemon} was passed to @command{configure}, the
181following packages are also needed:
182
183@itemize
184@item @url{http://sqlite.org, SQLite 3}
185@item @url{http://www.bzip.org, libbz2}
186@item @url{http://gcc.gnu.org, GCC's g++}
187@end itemize
188
4bfc4ea3
NK
189When a working installation of @url{http://nixos.org/nix/, the Nix package
190manager} is available, you
bd5e766b 191can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 192Nix replaces the three dependencies above.
bd5e766b 193
b22a12fd
LC
194Guix is compatible with Nix, so it is possible to share the same store
195between both. To do so, you must pass @command{configure} not only the
196same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
197@code{--localstatedir} value. The latter is essential because it
198specifies where the database that stores metadata about the store is
834129e0 199located, among other things. The default values for Nix are
b22a12fd 200@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
201Note that @code{--disable-daemon} is not required if
202your goal is to share the store with Nix.
b22a12fd 203
bd5e766b
LC
204@node Setting Up the Daemon
205@section Setting Up the Daemon
206
207@cindex daemon
208Operations such as building a package or running the garbage collector
49e6291a 209are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
210behalf of clients. Only the daemon may access the store and its
211associated database. Thus, any operation that manipulates the store
212goes through the daemon. For instance, command-line tools such as
e49951eb 213@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
214daemon (@i{via} remote procedure calls) to instruct it what to do.
215
49e6291a
LC
216The following sections explain how to prepare the build daemon's
217environment.
218
219@menu
220* Build Environment Setup:: Preparing the isolated build environment.
221* Daemon Offload Setup:: Offloading builds to remote machines.
222@end menu
223
224@node Build Environment Setup
225@subsection Build Environment Setup
226
bd5e766b
LC
227In a standard multi-user setup, Guix and its daemon---the
228@command{guix-daemon} program---are installed by the system
834129e0 229administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
230@command{guix-daemon} runs as @code{root}. Unprivileged users may use
231Guix tools to build packages or otherwise access the store, and the
232daemon will do it on their behalf, ensuring that the store is kept in a
233consistent state, and allowing built packages to be shared among users.
234
235@cindex build users
236When @command{guix-daemon} runs as @code{root}, you may not want package
237build processes themselves to run as @code{root} too, for obvious
238security reasons. To avoid that, a special pool of @dfn{build users}
239should be created for use by build processes started by the daemon.
240These build users need not have a shell and a home directory: they will
241just be used when the daemon drops @code{root} privileges in build
242processes. Having several such users allows the daemon to launch
243distinct build processes under separate UIDs, which guarantees that they
244do not interfere with each other---an essential feature since builds are
245regarded as pure functions (@pxref{Introduction}).
246
247On a GNU/Linux system, a build user pool may be created like this (using
248Bash syntax and the @code{shadow} commands):
249
091196b3
LC
250@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
251@c for why `-G' is needed.
bd5e766b
LC
252@example
253# groupadd guix-builder
254# for i in `seq 1 10`;
255 do
091196b3
LC
256 useradd -g guix-builder -G guix-builder \
257 -d /var/empty -s `which nologin` \
4d1a2b50
LC
258 -c "Guix build user $i" --system \
259 guix-builder$i;
bd5e766b
LC
260 done
261@end example
262
263@noindent
264The @code{guix-daemon} program may then be run as @code{root} with:
265
266@example
267# guix-daemon --build-users-group=guix-builder
268@end example
269
e900c503 270@cindex chroot
b095792f
LC
271@noindent
272This way, the daemon starts build processes in a chroot, under one of
273the @code{guix-builder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
274environment contains nothing but:
275
276@c Keep this list in sync with libstore/build.cc! -----------------------
277@itemize
278@item
4743a4da
LC
279a minimal @code{/dev} directory, created mostly independently from the
280host @code{/dev}@footnote{``Mostly'', because while the set of files
281that appear in the chroot's @code{/dev} is fixed, most of these files
282can only be created if the host has them.};
283
284@item
285the @code{/proc} directory; it only shows the container's processes
286since a separate PID name space is used;
6dc99317
LC
287
288@item
289@file{/etc/passwd} with an entry for the current user and an entry for
290user @file{nobody};
291
292@item
293@file{/etc/group} with an entry for the user's group;
294
295@item
296@file{/etc/hosts} with an entry that maps @code{localhost} to
297@code{127.0.0.1};
298
299@item
300a writable @file{/tmp} directory.
301@end itemize
b095792f 302
d43eb499 303If you are installing Guix as an unprivileged user, it is still
bd5e766b
LC
304possible to run @command{guix-daemon}. However, build processes will
305not be isolated from one another, and not from the rest of the system.
306Thus, build processes may interfere with each other, and may access
307programs, libraries, and other files available on the system---making it
308much harder to view them as @emph{pure} functions.
309
49e6291a
LC
310
311@node Daemon Offload Setup
312@subsection Using the Offload Facility
313
314@cindex offloading
4ec2e92d
LC
315@cindex build hook
316When desired, the build daemon can @dfn{offload}
317derivation builds to other machines
49e6291a
LC
318running Guix, using the @code{offload} @dfn{build hook}. When that
319feature is enabled, a list of user-specified build machines is read from
320@file{/etc/guix/machines.scm}; anytime a build is requested, for
321instance via @code{guix build}, the daemon attempts to offload it to one
322of the machines that satisfies the derivation's constraints, in
323particular its system type---e.g., @file{x86_64-linux}. Missing
324prerequisites for the build are copied over SSH to the target machine,
325which then proceeds with the build; upon success the output(s) of the
326build are copied back to the initial machine.
327
4ec2e92d 328The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
329
330@example
331(list (build-machine
332 (name "eightysix.example.org")
333 (system "x86_64-linux")
334 (user "bob")
335 (speed 2.)) ; incredibly fast!
336
337 (build-machine
338 (name "meeps.example.org")
339 (system "mips64el-linux")
340 (user "alice")
341 (private-key
342 (string-append (getenv "HOME")
343 "/.ssh/id-rsa-for-guix"))))
344@end example
345
346@noindent
347In the example above we specify a list of two build machines, one for
348the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
349architecture.
350
351In fact, this file is---not surprisingly!---a Scheme file that is
352evaluated when the @code{offload} hook is started. Its return value
353must be a list of @code{build-machine} objects. While this example
354shows a fixed list of build machines, one could imagine, say, using
355DNS-SD to return a list of potential build machines discovered in the
356local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
357Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
358detailed below.
4ec2e92d 359
c678a4ee
LC
360@deftp {Data Type} build-machine
361This data type represents build machines the daemon may offload builds
362to. The important fields are:
49e6291a
LC
363
364@table @code
365
366@item name
367The remote machine's host name.
368
369@item system
c678a4ee 370The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
371
372@item user
373The user account to use when connecting to the remote machine over SSH.
374Note that the SSH key pair must @emph{not} be passphrase-protected, to
375allow non-interactive logins.
376
377@end table
378
4ec2e92d 379A number of optional fields may be specified:
49e6291a
LC
380
381@table @code
382
cecd72d5
LC
383@item port
384Port number of the machine's SSH server (default: 22).
385
49e6291a
LC
386@item private-key
387The SSH private key file to use when connecting to the machine.
388
389@item parallel-builds
390The number of builds that may run in parallel on the machine (1 by
391default.)
392
393@item speed
394A ``relative speed factor''. The offload scheduler will tend to prefer
395machines with a higher speed factor.
396
397@item features
398A list of strings denoting specific features supported by the machine.
399An example is @code{"kvm"} for machines that have the KVM Linux modules
400and corresponding hardware support. Derivations can request features by
401name, and they will be scheduled on matching build machines.
402
403@end table
c678a4ee 404@end deftp
49e6291a
LC
405
406The @code{guix} command must be in the search path on the build
407machines, since offloading works by invoking the @code{guix archive} and
408@code{guix build} commands.
409
410There's one last thing to do once @file{machines.scm} is in place. As
411explained above, when offloading, files are transferred back and forth
412between the machine stores. For this to work, you need to generate a
413key pair to allow the daemon to export signed archives of files from the
414store (@pxref{Invoking guix archive}):
415
416@example
417# guix archive --generate-key
418@end example
419
420@noindent
421Thus, when receiving files, a machine's build daemon can make sure they
422are genuine, have not been tampered with, and that they are signed by an
423authorized key.
424
425
bd5e766b
LC
426@node Invoking guix-daemon
427@section Invoking @command{guix-daemon}
428
429The @command{guix-daemon} program implements all the functionality to
430access the store. This includes launching build processes, running the
431garbage collector, querying the availability of a build result, etc. It
432is normally run as @code{root} like this:
433
434@example
435# guix-daemon --build-users-group=guix-builder
436@end example
437
438@noindent
081145cf 439For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 440
e900c503
LC
441@cindex chroot
442@cindex container, build environment
443@cindex build environment
444@cindex reproducible builds
bd5e766b
LC
445By default, @command{guix-daemon} launches build processes under
446different UIDs, taken from the build group specified with
447@code{--build-users-group}. In addition, each build process is run in a
448chroot environment that only contains the subset of the store that the
449build process depends on, as specified by its derivation
450(@pxref{Programming Interface, derivation}), plus a set of specific
451system directories. By default, the latter contains @file{/dev} and
e900c503
LC
452@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
453@dfn{container}: in addition to having its own file system tree, it has
454a separate mount name space, its own PID name space, network name space,
455etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b
LC
456
457The following command-line options are supported:
458
459@table @code
460@item --build-users-group=@var{group}
461Take users from @var{group} to run build processes (@pxref{Setting Up
462the Daemon, build users}).
463
6858f9d1 464@item --no-substitutes
b5385b52 465@cindex substitutes
6858f9d1 466Do not use substitutes for build products. That is, always build things
c4202d60
LC
467locally instead of allowing downloads of pre-built binaries
468(@pxref{Substitutes}).
6858f9d1 469
b5385b52
LC
470By default substitutes are used, unless the client---such as the
471@command{guix package} command---is explicitly invoked with
472@code{--no-substitutes}.
473
474When the daemon runs with @code{--no-substitutes}, clients can still
475explicitly enable substitution @i{via} the @code{set-build-options}
476remote procedure call (@pxref{The Store}).
477
9176607e
LC
478@item --substitute-urls=@var{urls}
479Consider @var{urls} the default whitespace-separated list of substitute
480source URLs. When this option is omitted, @code{http://hydra.gnu.org}
481is used.
482
483This means that substitutes may be downloaded from @var{urls}, as long
484as they are signed by a trusted signature (@pxref{Substitutes}).
485
4ec2e92d
LC
486@cindex build hook
487@item --no-build-hook
488Do not use the @dfn{build hook}.
489
490The build hook is a helper program that the daemon can start and to
491which it submits build requests. This mechanism is used to offload
492builds to other machines (@pxref{Daemon Offload Setup}).
493
bd5e766b
LC
494@item --cache-failures
495Cache build failures. By default, only successful builds are cached.
496
497@item --cores=@var{n}
498@itemx -c @var{n}
499Use @var{n} CPU cores to build each derivation; @code{0} means as many
500as available.
501
502The default value is @code{1}, but it may be overridden by clients, such
e49951eb
MW
503as the @code{--cores} option of @command{guix build} (@pxref{Invoking
504guix build}).
bd5e766b
LC
505
506The effect is to define the @code{NIX_BUILD_CORES} environment variable
507in the build process, which can then use it to exploit internal
508parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
509
510@item --max-jobs=@var{n}
511@itemx -M @var{n}
512Allow at most @var{n} build jobs in parallel. The default value is
513@code{1}.
514
515@item --debug
516Produce debugging output.
517
518This is useful to debug daemon start-up issues, but then it may be
519overridden by clients, for example the @code{--verbosity} option of
e49951eb 520@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
521
522@item --chroot-directory=@var{dir}
523Add @var{dir} to the build chroot.
524
525Doing this may change the result of build processes---for instance if
526they use optional dependencies found in @var{dir} when it is available,
527and not otherwise. For that reason, it is not recommended to do so.
528Instead, make sure that each derivation declares all the inputs that it
529needs.
530
531@item --disable-chroot
532Disable chroot builds.
533
534Using this option is not recommended since, again, it would allow build
535processes to gain access to undeclared dependencies.
536
537@item --disable-log-compression
538Disable compression of the build logs.
539
1da983b9
LC
540Unless @code{--lose-logs} is used, all the build logs are kept in the
541@var{localstatedir}. To save space, the daemon automatically compresses
542them with bzip2 by default. This option disables that.
543
ab3893d7
LC
544@item --disable-deduplication
545@cindex deduplication
bd5e766b
LC
546Disable automatic file ``deduplication'' in the store.
547
1da983b9 548By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
549if a newly added file is identical to another one found in the store,
550the daemon makes the new file a hard link to the other file. This can
551noticeably reduce disk usage, at the expense of slightly increasde
552input/output load at the end of a build process. This option disables
553this optimization.
1da983b9 554
6e37066e
LC
555@item --gc-keep-outputs[=yes|no]
556Tell whether the garbage collector (GC) must keep outputs of live
557derivations.
558
559When set to ``yes'', the GC will keep the outputs of any live derivation
560available in the store---the @code{.drv} files. The default is ``no'',
561meaning that derivation outputs are kept only if they are GC roots.
562
563@item --gc-keep-derivations[=yes|no]
564Tell whether the garbage collector (GC) must keep derivations
565corresponding to live outputs.
566
567When set to ``yes'', as is the case by default, the GC keeps
568derivations---i.e., @code{.drv} files---as long as at least one of their
569outputs is live. This allows users to keep track of the origins of
570items in their store. Setting it to ``no'' saves a bit of disk space.
571
572Note that when both @code{--gc-keep-derivations} and
573@code{--gc-keep-outputs} are used, the effect is to keep all the build
574prerequisites (the sources, compiler, libraries, and other build-time
575tools) of live objects in the store, regardless of whether these
576prerequisites are live. This is convenient for developers since it
577saves rebuilds or downloads.
578
bd5e766b
LC
579@item --impersonate-linux-2.6
580On Linux-based systems, impersonate Linux 2.6. This means that the
581kernel's @code{uname} system call will report 2.6 as the release number.
582
583This might be helpful to build programs that (usually wrongfully) depend
584on the kernel version number.
585
586@item --lose-logs
587Do not keep build logs. By default they are kept under
ce33631f 588@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
589
590@item --system=@var{system}
591Assume @var{system} as the current system type. By default it is the
592architecture/kernel pair found at configure time, such as
593@code{x86_64-linux}.
b8d2aa26
LC
594
595@item --listen=@var{socket}
596Listen for connections on @var{socket}, the file name of a Unix-domain
597socket. The default socket is
598@file{@var{localstatedir}/daemon-socket/socket}. This option is only
599useful in exceptional circumstances, such as if you need to run several
600daemons on the same machine.
bd5e766b
LC
601@end table
602
603
eeaf4427
LC
604@c *********************************************************************
605@node Package Management
606@chapter Package Management
607
f8348b91 608The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
609remove software packages, without having to know about their build
610procedure or dependencies. Guix also goes beyond this obvious set of
611features.
612
613This chapter describes the main features of Guix, as well as the package
c1941588
LC
614management tools it provides. Two user interfaces are provided for
615routine package management tasks: a command-line interface
616(@pxref{Invoking guix package, @code{guix package}}), and a visual user
617interface in Emacs (@pxref{Emacs Interface}).
eeaf4427
LC
618
619@menu
620* Features:: How Guix will make your life brighter.
e49951eb 621* Invoking guix package:: Package installation, removal, etc.
457f60fa 622* Emacs Interface:: Package management from Emacs.
c4202d60 623* Substitutes:: Downloading pre-built binaries.
760c60d6 624* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 625* Invoking guix gc:: Running the garbage collector.
f651b477 626* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 627* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
628@end menu
629
630@node Features
631@section Features
632
633When using Guix, each package ends up in the @dfn{package store}, in its
634own directory---something that resembles
9a130e19
AK
635@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
636(note that Guix comes with an Emacs extension to shorten those file
081145cf 637names, @pxref{Emacs Prettify}.)
eeaf4427
LC
638
639Instead of referring to these directories, users have their own
640@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
641use. These profiles are stored within each user's home directory, at
642@code{$HOME/.guix-profile}.
eeaf4427 643
821b0015 644For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 645@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 646@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
647@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
648simply continues to point to
834129e0 649@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 650coexist on the same system without any interference.
eeaf4427 651
e49951eb
MW
652The @command{guix package} command is the central tool to manage
653packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 654profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
655
656The command provides the obvious install, remove, and upgrade
657operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 658the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 659@command{guix package} process is terminated during the transaction,
eeaf4427
LC
660or if a power outage occurs during the transaction, then the user's
661profile remains in its previous state, and remains usable.
662
663In addition, any package transaction may be @emph{rolled back}. So, if,
664for example, an upgrade installs a new version of a package that turns
665out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
666of their profile, which was known to work well. Similarly, the global
667system configuration is subject to transactional upgrades and roll-back
668(@pxref{Using the Configuration System}).
eeaf4427
LC
669
670All those packages in the package store may be @emph{garbage-collected}.
671Guix can determine which packages are still referenced by the user
fe8ff028 672profiles, and remove those that are provably no longer referenced
e49951eb 673(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
674generations of their profile so that the packages they refer to can be
675collected.
eeaf4427 676
e900c503
LC
677@cindex reproducibility
678@cindex reproducible builds
eeaf4427
LC
679Finally, Guix takes a @dfn{purely functional} approach to package
680management, as described in the introduction (@pxref{Introduction}).
834129e0 681Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
682inputs that were used to build that package---compiler, libraries, build
683scripts, etc. This direct correspondence allows users to make sure a
684given package installation matches the current state of their
e900c503
LC
685distribution. It also helps maximize @dfn{build reproducibility}:
686thanks to the isolated build environments that are used, a given build
687is likely to yield bit-identical files when performed on different
688machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 689
c4202d60 690@cindex substitutes
eeaf4427 691This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 692deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 693available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
694downloads it and unpacks it;
695otherwise, it builds the package from source, locally
696(@pxref{Substitutes}).
eeaf4427 697
f5fd4fd2
LC
698Control over the build environment is a feature that is also useful for
699developers. The @command{guix environment} command allows developers of
700a package to quickly set up the right development environment for their
701package, without having to manually install the package's dependencies
702in their profile (@pxref{Invoking guix environment}).
703
e49951eb
MW
704@node Invoking guix package
705@section Invoking @command{guix package}
eeaf4427 706
e49951eb 707The @command{guix package} command is the tool that allows users to
eeaf4427
LC
708install, upgrade, and remove packages, as well as rolling back to
709previous configurations. It operates only on the user's own profile,
710and works with normal user privileges (@pxref{Features}). Its syntax
711is:
712
713@example
e49951eb 714guix package @var{options}
eeaf4427
LC
715@end example
716
ba55b1cb 717Primarily, @var{options} specifies the operations to be performed during
eeaf4427
LC
718the transaction. Upon completion, a new profile is created, but
719previous generations of the profile remain available, should the user
720want to roll back.
721
6447738c
MW
722For example, to remove @code{lua} and install @code{guile} and
723@code{guile-cairo} in a single transaction:
724
725@example
726guix package -r lua -i guile guile-cairo
727@end example
728
b9e5c0a9 729For each user, a symlink to the user's default profile is automatically
0ec1af59 730created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
731current generation of the user's default profile. Thus, users can add
732@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
733variable, and so on.
734
0ec1af59
LC
735In a multi-user setup, user profiles must be stored in a place
736registered as a @dfn{garbage-collector root}, which
e49951eb 737@file{$HOME/.guix-profile} points to (@pxref{Invoking guix gc}). That
0ec1af59
LC
738directory is normally
739@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
740@var{localstatedir} is the value passed to @code{configure} as
741@code{--localstatedir}, and @var{user} is the user name. It must be
742created by @code{root}, with @var{user} as the owner. When it does not
70c43291
LC
743exist, or is not owned by @var{user}, @command{guix package} emits an
744error about it.
0ec1af59
LC
745
746The @var{options} can be among the following:
747
eeaf4427
LC
748@table @code
749
6447738c
MW
750@item --install=@var{package} @dots{}
751@itemx -i @var{package} @dots{}
752Install the specified @var{package}s.
eeaf4427 753
6447738c 754Each @var{package} may specify either a simple package name, such as
eeaf4427 755@code{guile}, or a package name followed by a hyphen and version number,
dc5669cd
MW
756such as @code{guile-1.8.8}. If no version number is specified, the
757newest available version will be selected. In addition, @var{package}
758may contain a colon, followed by the name of one of the outputs of the
6e721c4d 759package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
760(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
761name (and optionally version) are searched for among the GNU
762distribution modules (@pxref{Package Modules}).
eeaf4427 763
461572cc
LC
764@cindex propagated inputs
765Sometimes packages have @dfn{propagated inputs}: these are dependencies
766that automatically get installed along with the required package.
767
768An example is the GNU MPC library: its C header files refer to those of
769the GNU MPFR library, which in turn refer to those of the GMP library.
770Thus, when installing MPC, the MPFR and GMP libraries also get installed
771in the profile; removing MPC also removes MPFR and GMP---unless they had
772also been explicitly installed independently.
773
ba7ea5ce 774Besides, packages sometimes rely on the definition of environment
5924080d 775variables for their search paths (see explanation of
ba7ea5ce 776@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
777environment variable definitions are reported here.
778
ef010c0f 779@c XXX: keep me up-to-date
5924080d 780Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
781availability of a newer upstream version. In the future, it may provide
782the option of installing directly from the upstream version, even if
783that version is not yet in the distribution.
784
5d4b411f
LC
785@item --install-from-expression=@var{exp}
786@itemx -e @var{exp}
787Install the package @var{exp} evaluates to.
788
789@var{exp} must be a Scheme expression that evaluates to a
790@code{<package>} object. This option is notably useful to disambiguate
791between same-named variants of a package, with expressions such as
792@code{(@@ (gnu packages base) guile-final)}.
793
794Note that this option installs the first output of the specified
795package, which may be insufficient when needing a specific output of a
796multiple-output package.
797
6447738c
MW
798@item --remove=@var{package} @dots{}
799@itemx -r @var{package} @dots{}
800Remove the specified @var{package}s.
eeaf4427 801
6447738c 802As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
803and/or output name in addition to the package name. For instance,
804@code{-r glibc:debug} would remove the @code{debug} output of
805@code{glibc}.
806
6447738c
MW
807@item --upgrade[=@var{regexp} @dots{}]
808@itemx -u [@var{regexp} @dots{}]
809Upgrade all the installed packages. If one or more @var{regexp}s are
810specified, upgrade only installed packages whose name matches a
811@var{regexp}.
eeaf4427 812
f651b477
LC
813Note that this upgrades package to the latest version of packages found
814in the distribution currently installed. To update your distribution,
815you should regularly run @command{guix pull} (@pxref{Invoking guix
816pull}).
817
24e262f0
LC
818@item --roll-back
819Roll back to the previous @dfn{generation} of the profile---i.e., undo
820the last transaction.
821
822When combined with options such as @code{--install}, roll back occurs
823before any other actions.
824
d9307267 825When rolling back from the first generation that actually contains
4b2bc804
NK
826installed packages, the profile is made to point to the @dfn{zeroth
827generation}, which contains no files apart from its own meta-data.
d9307267 828
82fe08ed
LC
829Installing, removing, or upgrading packages from a generation that has
830been rolled back to overwrites previous future generations. Thus, the
831history of a profile's generations is always linear.
832
b3bb82f1
AK
833@item --switch-generation=@var{pattern}
834@itemx -S @var{pattern}
835Switch to a particular generation defined by @var{pattern}.
836
837@var{pattern} may be either a generation number or a number prefixed
838with ``+'' or ``-''. The latter means: move forward/backward by a
839specified number of generations. For example, if you want to return to
840the latest generation after @code{--roll-back}, use
841@code{--switch-generation=+1}.
842
843The difference between @code{--roll-back} and
844@code{--switch-generation=-1} is that @code{--switch-generation} will
845not make a zeroth generation, so if a specified generation does not
846exist, the current generation will not be changed.
847
5924080d
LC
848@item --search-paths
849@cindex search paths
850Report environment variable definitions, in Bash syntax, that may be
851needed in order to use the set of installed packages. These environment
852variables are used to specify @dfn{search paths} for files used by some
853of the installed packages.
854
855For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
856environment variables to be defined so it can look for headers and
857libraries in the user's profile (@pxref{Environment Variables,,, gcc,
858Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
859library are installed in the profile, then @code{--search-paths} will
860suggest setting these variables to @code{@var{profile}/include} and
861@code{@var{profile}/lib}, respectively.
862
eeaf4427
LC
863@item --profile=@var{profile}
864@itemx -p @var{profile}
865Use @var{profile} instead of the user's default profile.
866
70915c1a
LC
867@item --verbose
868Produce verbose output. In particular, emit the environment's build log
869on the standard error port.
870
eeaf4427
LC
871@item --bootstrap
872Use the bootstrap Guile to build the profile. This option is only
873useful to distribution developers.
874
875@end table
876
e49951eb 877In addition to these actions @command{guix package} supports the
733b4130
LC
878following options to query the current state of a profile, or the
879availability of packages:
eeaf4427 880
733b4130
LC
881@table @option
882
acc08466
NK
883@item --search=@var{regexp}
884@itemx -s @var{regexp}
885List the available packages whose synopsis or description matches
299112d3
LC
886@var{regexp}. Print all the meta-data of matching packages in
887@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
888GNU recutils manual}).
acc08466 889
299112d3
LC
890This allows specific fields to be extracted using the @command{recsel}
891command, for instance:
892
893@example
e49951eb 894$ guix package -s malloc | recsel -p name,version
299112d3
LC
895name: glibc
896version: 2.17
897
898name: libgc
899version: 7.2alpha6
900@end example
acc08466 901
a12d92f5
LC
902Similarly, to show the name of all the packages available under the
903terms of the GNU@tie{}LGPL version 3:
904
905@example
906$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
907name: elfutils
908
909name: gmp
910@dots{}
911@end example
912
2aa6efb0
CR
913@item --show=@var{package}
914Show details about @var{package}, taken from the list of available packages, in
915@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
916recutils manual}).
917
918@example
919$ guix package --show=python | recsel -p name,version
920name: python
921version: 2.7.6
922
923name: python
924version: 3.3.5
925@end example
926
927You may also specify the full name of a package to only get details about a
928specific version of it:
929@example
930$ guix package --show=python-3.3.5 | recsel -p name,version
931name: python
932version: 3.3.5
933@end example
934
935
936
733b4130
LC
937@item --list-installed[=@var{regexp}]
938@itemx -I [@var{regexp}]
bd9bde1c
LC
939List the currently installed packages in the specified profile, with the
940most recently installed packages shown last. When @var{regexp} is
941specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
942
943For each installed package, print the following items, separated by
944tabs: the package name, its version string, the part of the package that
945is installed (for instance, @code{out} for the default output,
946@code{include} for its headers, etc.), and the path of this package in
947the store.
948
64fc89b6
LC
949@item --list-available[=@var{regexp}]
950@itemx -A [@var{regexp}]
a1ba8475
LC
951List packages currently available in the software distribution
952(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
953installed packages whose name matches @var{regexp}.
64fc89b6
LC
954
955For each package, print the following items separated by tabs: its name,
6e721c4d
LC
956its version string, the parts of the package (@pxref{Packages with
957Multiple Outputs}), and the source location of its definition.
64fc89b6 958
f566d765
LC
959@item --list-generations[=@var{pattern}]
960@itemx -l [@var{pattern}]
961Return a list of generations along with their creation dates; for each
962generation, show the installed packages, with the most recently
4b2bc804
NK
963installed packages shown last. Note that the zeroth generation is never
964shown.
f566d765
LC
965
966For each installed package, print the following items, separated by
967tabs: the name of a package, its version string, the part of the package
968that is installed (@pxref{Packages with Multiple Outputs}), and the
969location of this package in the store.
970
971When @var{pattern} is used, the command returns only matching
972generations. Valid patterns include:
973
974@itemize
975@item @emph{Integers and comma-separated integers}. Both patterns denote
976generation numbers. For instance, @code{--list-generations=1} returns
977the first one.
978
979And @code{--list-generations=1,8,2} outputs three generations in the
980specified order. Neither spaces nor trailing commas are allowed.
981
982@item @emph{Ranges}. @code{--list-generations=2..9} prints the
983specified generations and everything in between. Note that the start of
984a range must be lesser than its end.
985
986It is also possible to omit the endpoint. For example,
987@code{--list-generations=2..}, returns all generations starting from the
988second one.
989
990@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
991or months by passing an integer along with the first letter of the
d7ddb257
LC
992duration. For example, @code{--list-generations=20d} lists generations
993that are up to 20 days old.
f566d765
LC
994@end itemize
995
b7884ca3
NK
996@item --delete-generations[=@var{pattern}]
997@itemx -d [@var{pattern}]
d7ddb257
LC
998When @var{pattern} is omitted, delete all generations except the current
999one.
b7884ca3
NK
1000
1001This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1002When @var{pattern} is specified, delete the matching generations. When
1003@var{pattern} specifies a duration, generations @emph{older} than the
1004specified duration match. For instance, @code{--delete-generations=1m}
1005deletes generations that are more than one month old.
1006
1007If the current generation matches, it is deleted atomically---i.e., by
1008switching to the previous available generation. Note that the zeroth
1009generation is never deleted.
b7884ca3 1010
1bb9900a
LC
1011Note that deleting generations prevents roll-back to them.
1012Consequently, this command must be used with care.
1013
733b4130 1014@end table
eeaf4427 1015
70ee5642
LC
1016Finally, since @command{guix package} may actually start build
1017processes, it supports all the common build options that @command{guix
1018build} supports (@pxref{Invoking guix build, common build options}).
1019
457f60fa
AK
1020@include emacs.texi
1021
c4202d60
LC
1022@node Substitutes
1023@section Substitutes
1024
1025@cindex substitutes
1026@cindex pre-built binaries
1027Guix supports transparent source/binary deployment, which means that it
1028can either build things locally, or download pre-built items from a
1029server. We call these pre-built items @dfn{substitutes}---they are
1030substitutes for local build results. In many cases, downloading a
1031substitute is much faster than building things locally.
1032
1033Substitutes can be anything resulting from a derivation build
1034(@pxref{Derivations}). Of course, in the common case, they are
1035pre-built package binaries, but source tarballs, for instance, which
1036also result from derivation builds, can be available as substitutes.
1037
1038The @code{hydra.gnu.org} server is a front-end to a build farm that
1039builds packages from the GNU distribution continuously for some
9176607e
LC
1040architectures, and makes them available as substitutes. This is the
1041default source of substitutes; it can be overridden by passing
1042@command{guix-daemon} the @code{--substitute-urls} option
1043(@pxref{Invoking guix-daemon}).
c4202d60
LC
1044
1045@cindex security
1046@cindex digital signatures
1047To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1048must add its public key to the access control list (ACL) of archive
1049imports, using the @command{guix archive} command (@pxref{Invoking guix
1050archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1051be compromised and to serve genuine substitutes.
1052
1053This public key is installed along with Guix, in
1054@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1055the installation prefix of Guix. If you installed Guix from source,
1056make sure you checked the GPG signature of
1057@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1058Then, you can run something like this:
1059
1060@example
1061# guix archive --authorize < hydra.gnu.org.pub
1062@end example
1063
1064Once this is in place, the output of a command like @code{guix build}
1065should change from something like:
1066
1067@example
1068$ guix build emacs --dry-run
1069The following derivations would be built:
1070 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1071 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1072 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1073 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1074@dots{}
1075@end example
1076
1077@noindent
1078to something like:
1079
1080@example
1081$ guix build emacs --dry-run
1082The following files would be downloaded:
1083 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1084 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1085 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1086 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1087@dots{}
1088@end example
1089
1090@noindent
1091This indicates that substitutes from @code{hydra.gnu.org} are usable and
1092will be downloaded, when possible, for future builds.
1093
1094Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1095one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1096when attempting to use a substitute that has been tampered with.
1097
1098The substitute mechanism can be disabled globally by running
1099@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1100guix-daemon}). It can also be disabled temporarily by passing the
1101@code{--no-substitutes} option to @command{guix package}, @command{guix
1102build}, and other command-line tools.
1103
1104
1105Today, each individual's control over their own computing is at the
1106mercy of institutions, corporations, and groups with enough power and
1107determination to subvert the computing infrastructure and exploit its
1108weaknesses. While using @code{hydra.gnu.org} substitutes can be
1109convenient, we encourage users to also build on their own, or even run
1110their own build farm, such that @code{hydra.gnu.org} is less of an
1111interesting target.
1112
1113Guix has the foundations to maximize build reproducibility
1114(@pxref{Features}). In most cases, independent builds of a given
1115package or derivation should yield bit-identical results. Thus, through
1116a diverse set of independent package builds, we can strengthen the
1117integrity of our systems.
1118
1119In the future, we want Guix to have support to publish and retrieve
1120binaries to/from other users, in a peer-to-peer fashion. If you would
1121like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1122
1123
6e721c4d
LC
1124@node Packages with Multiple Outputs
1125@section Packages with Multiple Outputs
1126
1127@cindex multiple-output packages
1128@cindex package outputs
1129
1130Often, packages defined in Guix have a single @dfn{output}---i.e., the
1131source package leads exactly one directory in the store. When running
1132@command{guix package -i glibc}, one installs the default output of the
1133GNU libc package; the default output is called @code{out}, but its name
1134can be omitted as shown in this command. In this particular case, the
1135default output of @code{glibc} contains all the C header files, shared
1136libraries, static libraries, Info documentation, and other supporting
1137files.
1138
1139Sometimes it is more appropriate to separate the various types of files
1140produced from a single source package into separate outputs. For
1141instance, the GLib C library (used by GTK+ and related packages)
1142installs more than 20 MiB of reference documentation as HTML pages.
1143To save space for users who do not need it, the documentation goes to a
1144separate output, called @code{doc}. To install the main GLib output,
1145which contains everything but the documentation, one would run:
1146
1147@example
1148guix package -i glib
1149@end example
1150
1151The command to install its documentation is:
1152
1153@example
1154guix package -i glib:doc
1155@end example
1156
1157Some packages install programs with different ``dependency footprints''.
1158For instance, the WordNet package install both command-line tools and
1159graphical user interfaces (GUIs). The former depend solely on the C
1160library, whereas the latter depend on Tcl/Tk and the underlying X
1161libraries. In this case, we leave the command-line tools in the default
1162output, whereas the GUIs are in a separate output. This allows users
1163who do not need the GUIs to save space.
1164
1165There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1166Other conventional output names include @code{lib} for libraries and
1167possibly header files, @code{bin} for stand-alone programs, and
1168@code{debug} for debugging information (@pxref{Installing Debugging
1169Files}). The outputs of a packages are listed in the third column of
1170the output of @command{guix package --list-available} (@pxref{Invoking
1171guix package}).
6e721c4d 1172
eeaf4427 1173
e49951eb
MW
1174@node Invoking guix gc
1175@section Invoking @command{guix gc}
fe8ff028
LC
1176
1177@cindex garbage collector
1178Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1179The @command{guix gc} command allows users to explicitly run the garbage
834129e0 1180collector to reclaim space from the @file{/gnu/store} directory.
fe8ff028
LC
1181
1182The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1183@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1184cannot be deleted; any other file is considered @dfn{dead} and may be
1185deleted. The set of garbage collector roots includes default user
e49951eb
MW
1186profiles, and may be augmented with @command{guix build --root}, for
1187example (@pxref{Invoking guix build}).
fe8ff028 1188
1bb9900a
LC
1189Prior to running @code{guix gc --collect-garbage} to make space, it is
1190often useful to remove old generations from user profiles; that way, old
1191package builds referenced by those generations can be reclaimed. This
1192is achieved by running @code{guix package --delete-generations}
1193(@pxref{Invoking guix package}).
1194
e49951eb 1195The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
1196used to garbage-collect any dead files (the default), to delete specific
1197files (the @code{--delete} option), or to print garbage-collector
1198information. The available options are listed below:
1199
1200@table @code
1201@item --collect-garbage[=@var{min}]
1202@itemx -C [@var{min}]
834129e0 1203Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1204sub-directories. This is the default operation when no option is
1205specified.
1206
1207When @var{min} is given, stop once @var{min} bytes have been collected.
1208@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1209suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1210(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1211
1212When @var{min} is omitted, collect all the garbage.
1213
1214@item --delete
1215@itemx -d
1216Attempt to delete all the store files and directories specified as
1217arguments. This fails if some of the files are not in the store, or if
1218they are still live.
1219
1220@item --list-dead
1221Show the list of dead files and directories still present in the
1222store---i.e., files and directories no longer reachable from any root.
1223
1224@item --list-live
1225Show the list of live store files and directories.
ba8b732d
LC
1226
1227@end table
1228
1229In addition, the references among existing store files can be queried:
1230
1231@table @code
1232
1233@item --references
1234@itemx --referrers
1235List the references (respectively, the referrers) of store files given
1236as arguments.
1237
8e59fdd5
LC
1238@item --requisites
1239@itemx -R
1240List the requisites of the store files passed as arguments. Requisites
1241include the store files themselves, their references, and the references
1242of these, recursively. In other words, the returned list is the
1243@dfn{transitive closure} of the store files.
1244
fe8ff028
LC
1245@end table
1246
eeaf4427 1247
f651b477
LC
1248@node Invoking guix pull
1249@section Invoking @command{guix pull}
1250
1251Packages are installed or upgraded to the latest version available in
1252the distribution currently available on your local machine. To update
1253that distribution, along with the Guix tools, you must run @command{guix
1254pull}: the command downloads the latest Guix source code and package
1255descriptions, and deploys it.
1256
1257On completion, @command{guix package} will use packages and package
1258versions from this just-retrieved copy of Guix. Not only that, but all
1259the Guix commands and Scheme modules will also be taken from that latest
1260version. New @command{guix} sub-commands added by the update also
1261become available.
1262
1263The @command{guix pull} command is usually invoked with no arguments,
1264but it supports the following options:
1265
1266@table @code
1267@item --verbose
1268Produce verbose output, writing build logs to the standard error output.
1269
ab5d72ad
LC
1270@item --url=@var{url}
1271Download the source tarball of Guix from @var{url}.
1272
1273By default, the tarball is taken from its canonical address at
1274@code{gnu.org}, for the stable branch of Guix.
1275
f651b477
LC
1276@item --bootstrap
1277Use the bootstrap Guile to build the latest Guix. This option is only
1278useful to Guix developers.
1279@end table
1280
760c60d6
LC
1281
1282@node Invoking guix archive
1283@section Invoking @command{guix archive}
1284
1285The @command{guix archive} command allows users to @dfn{export} files
1286from the store into a single archive, and to later @dfn{import} them.
1287In particular, it allows store files to be transferred from one machine
1288to another machine's store. For example, to transfer the @code{emacs}
1289package to a machine connected over SSH, one would run:
1290
1291@example
1292guix archive --export emacs | ssh the-machine guix archive --import
1293@end example
1294
87236aed
LC
1295@noindent
1296However, note that, in this example, all of @code{emacs} and its
1297dependencies are transferred, regardless of what is already available in
1298the target machine's store. The @code{--missing} option can help figure
1299out which items are missing from the target's store.
1300
760c60d6 1301Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1302comparable in spirit to `tar', but with a few noteworthy differences
1303that make it more appropriate for our purposes. First, rather than
1304recording all Unix meta-data for each file, the Nar format only mentions
1305the file type (regular, directory, or symbolic link); Unix permissions
1306and owner/group are dismissed. Second, the order in which directory
1307entries are stored always follows the order of file names according to
1308the C locale collation order. This makes archive production fully
1309deterministic.
1310
1311When exporting, the daemon digitally signs the contents of the archive,
1312and that digital signature is appended. When importing, the daemon
1313verifies the signature and rejects the import in case of an invalid
1314signature or if the signing key is not authorized.
760c60d6
LC
1315@c FIXME: Add xref to daemon doc about signatures.
1316
1317The main options are:
1318
1319@table @code
1320@item --export
1321Export the specified store files or packages (see below.) Write the
1322resulting archive to the standard output.
1323
1324@item --import
1325Read an archive from the standard input, and import the files listed
1326therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1327signature, or if it is signed by a public key not among the authorized
1328keys (see @code{--authorize} below.)
554f26ec 1329
87236aed
LC
1330@item --missing
1331Read a list of store file names from the standard input, one per line,
1332and write on the standard output the subset of these files missing from
1333the store.
1334
554f26ec 1335@item --generate-key[=@var{parameters}]
f82cc5fd 1336@cindex signing, archives
554f26ec
LC
1337Generate a new key pair for the daemons. This is a prerequisite before
1338archives can be exported with @code{--export}. Note that this operation
1339usually takes time, because it needs to gather enough entropy to
1340generate the key pair.
1341
1342The generated key pair is typically stored under @file{/etc/guix}, in
1343@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
1344key, which must be kept secret.) When @var{parameters} is omitted, it
1345is a 4096-bit RSA key. Alternately, @var{parameters} can specify
1346@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1347public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1348Libgcrypt Reference Manual}).
f82cc5fd
LC
1349
1350@item --authorize
1351@cindex authorizing, archives
1352Authorize imports signed by the public key passed on standard input.
1353The public key must be in ``s-expression advanced format''---i.e., the
1354same format as the @file{signing-key.pub} file.
1355
1356The list of authorized keys is kept in the human-editable file
1357@file{/etc/guix/acl}. The file contains
1358@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1359s-expressions''} and is structured as an access-control list in the
1360@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1361(SPKI)}.
760c60d6
LC
1362@end table
1363
1364To export store files as an archive to the standard output, run:
1365
1366@example
1367guix archive --export @var{options} @var{specifications}...
1368@end example
1369
1370@var{specifications} may be either store file names or package
1371specifications, as for @command{guix package} (@pxref{Invoking guix
1372package}). For instance, the following command creates an archive
1373containing the @code{gui} output of the @code{git} package and the main
1374output of @code{emacs}:
1375
1376@example
834129e0 1377guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1378@end example
1379
1380If the specified packages are not built yet, @command{guix archive}
1381automatically builds them. The build process may be controlled with the
1382same options that can be passed to the @command{guix build} command
70ee5642 1383(@pxref{Invoking guix build, common build options}).
760c60d6
LC
1384
1385
568717fd
LC
1386@c *********************************************************************
1387@node Programming Interface
1388@chapter Programming Interface
1389
3dc1970d
LC
1390GNU Guix provides several Scheme programming interfaces (APIs) to
1391define, build, and query packages. The first interface allows users to
1392write high-level package definitions. These definitions refer to
1393familiar packaging concepts, such as the name and version of a package,
1394its build system, and its dependencies. These definitions can then be
1395turned into concrete build actions.
1396
ba55b1cb 1397Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1398standard setup, the daemon has write access to the store---the
834129e0 1399@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1400setup also has the daemon perform builds in chroots, under a specific
1401build users, to minimize interference with the rest of the system.
1402
1403@cindex derivation
1404Lower-level APIs are available to interact with the daemon and the
1405store. To instruct the daemon to perform a build action, users actually
1406provide it with a @dfn{derivation}. A derivation is a low-level
1407representation of the build actions to be taken, and the environment in
1408which they should occur---derivations are to package definitions what
49ad317a
LC
1409assembly is to C programs. The term ``derivation'' comes from the fact
1410that build results @emph{derive} from them.
3dc1970d
LC
1411
1412This chapter describes all these APIs in turn, starting from high-level
1413package definitions.
1414
568717fd 1415@menu
b860f382 1416* Defining Packages:: Defining new packages.
7458bd0a 1417* Build Systems:: Specifying how packages are built.
b860f382
LC
1418* The Store:: Manipulating the package store.
1419* Derivations:: Low-level interface to package derivations.
1420* The Store Monad:: Purely functional interface to the store.
21b679f6 1421* G-Expressions:: Manipulating build expressions.
568717fd
LC
1422@end menu
1423
1424@node Defining Packages
1425@section Defining Packages
1426
3dc1970d
LC
1427The high-level interface to package definitions is implemented in the
1428@code{(guix packages)} and @code{(guix build-system)} modules. As an
1429example, the package definition, or @dfn{recipe}, for the GNU Hello
1430package looks like this:
1431
1432@example
e7f34eb0
LC
1433(define-module (gnu packages hello)
1434 #:use-module (guix packages)
1435 #:use-module (guix download)
1436 #:use-module (guix build-system gnu)
1437 #:use-module (guix licenses))
b22a12fd 1438
79f5dd59 1439(define-public hello
3dc1970d
LC
1440 (package
1441 (name "hello")
1442 (version "2.8")
1443 (source (origin
1444 (method url-fetch)
1445 (uri (string-append "mirror://gnu/hello/hello-" version
1446 ".tar.gz"))
1447 (sha256
1448 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1449 (build-system gnu-build-system)
7458bd0a 1450 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1451 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1452 (synopsis "Hello, GNU world: An example GNU package")
1453 (description "Guess what GNU Hello prints!")
3dc1970d 1454 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 1455 (license gpl3+)))
3dc1970d
LC
1456@end example
1457
1458@noindent
1459Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 1460of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
1461to a @code{<package>} object, which is essentially a record
1462(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1463This package object can be inspected using procedures found in the
1464@code{(guix packages)} module; for instance, @code{(package-name hello)}
1465returns---surprise!---@code{"hello"}.
1466
2f7d2d91
LC
1467With luck, you may be able to import part or all of the definition of
1468the package you are interested in from another repository, using the
1469@code{guix import} command (@pxref{Invoking guix import}).
1470
e7f34eb0
LC
1471In the example above, @var{hello} is defined into a module of its own,
1472@code{(gnu packages hello)}. Technically, this is not strictly
1473necessary, but it is convenient to do so: all the packages defined in
1474modules under @code{(gnu packages @dots{})} are automatically known to
1475the command-line tools (@pxref{Package Modules}).
1476
3dc1970d
LC
1477There are a few points worth noting in the above package definition:
1478
1479@itemize
1480@item
1481The @code{source} field of the package is an @code{<origin>} object.
1482Here, the @code{url-fetch} method from @code{(guix download)} is used,
1483meaning that the source is a file to be downloaded over FTP or HTTP.
1484
1485The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1486the GNU mirrors defined in @code{(guix download)}.
1487
1488The @code{sha256} field specifies the expected SHA256 hash of the file
1489being downloaded. It is mandatory, and allows Guix to check the
1490integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 1491base32 representation of the hash. You can obtain this information with
210cc920
LC
1492@code{guix download} (@pxref{Invoking guix download}) and @code{guix
1493hash} (@pxref{Invoking guix hash}).
3dc1970d 1494
f9cc8971
LC
1495@cindex patches
1496When needed, the @code{origin} form can also have a @code{patches} field
1497listing patches to be applied, and a @code{snippet} field giving a
1498Scheme expression to modify the source code.
1499
3dc1970d
LC
1500@item
1501@cindex GNU Build System
7458bd0a
LC
1502The @code{build-system} field specifies the procedure to build the
1503package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1504represents the familiar GNU Build System, where packages may be
1505configured, built, and installed with the usual @code{./configure &&
1506make && make check && make install} command sequence.
1507
1508@item
1509The @code{arguments} field specifies options for the build system
1510(@pxref{Build Systems}). Here it is interpreted by
1511@var{gnu-build-system} as a request run @file{configure} with the
1512@code{--enable-silent-rules} flag.
3dc1970d
LC
1513
1514@item
1515The @code{inputs} field specifies inputs to the build process---i.e.,
1516build-time or run-time dependencies of the package. Here, we define an
1517input called @code{"gawk"} whose value is that of the @var{gawk}
1518variable; @var{gawk} is itself bound to a @code{<package>} object.
1519
1520Note that GCC, Coreutils, Bash, and other essential tools do not need to
1521be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 1522of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
1523
1524However, any other dependencies need to be specified in the
1525@code{inputs} field. Any dependency not specified here will simply be
1526unavailable to the build process, possibly leading to a build failure.
1527@end itemize
1528
2f7d2d91 1529Once a package definition is in place, the
e49951eb 1530package may actually be built using the @code{guix build} command-line
7458bd0a 1531tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
b4f5e0e8
CR
1532more information on how to test package definitions, and
1533@ref{Invoking guix lint}, for information on how to check a definition
1534for style conformance.
1535
7458bd0a
LC
1536Eventually, updating the package definition to a new upstream version
1537can be partly automated by the @command{guix refresh} command
1538(@pxref{Invoking guix refresh}).
3dc1970d
LC
1539
1540Behind the scenes, a derivation corresponding to the @code{<package>}
1541object is first computed by the @code{package-derivation} procedure.
834129e0 1542That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 1543The build actions it prescribes may then be realized by using the
3dc1970d
LC
1544@code{build-derivations} procedure (@pxref{The Store}).
1545
1546@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1547Return the @code{<derivation>} object of @var{package} for @var{system}
1548(@pxref{Derivations}).
3dc1970d
LC
1549
1550@var{package} must be a valid @code{<package>} object, and @var{system}
1551must be a string denoting the target system type---e.g.,
1552@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1553must be a connection to the daemon, which operates on the store
1554(@pxref{The Store}).
1555@end deffn
568717fd 1556
9c1edabd
LC
1557@noindent
1558@cindex cross-compilation
1559Similarly, it is possible to compute a derivation that cross-builds a
1560package for some other system:
1561
1562@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1563 @var{package} @var{target} [@var{system}]
59688fc4
LC
1564Return the @code{<derivation>} object of @var{package} cross-built from
1565@var{system} to @var{target}.
9c1edabd
LC
1566
1567@var{target} must be a valid GNU triplet denoting the target hardware
1568and operating system, such as @code{"mips64el-linux-gnu"}
1569(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1570Configure and Build System}).
1571@end deffn
1572
1573
7458bd0a
LC
1574@node Build Systems
1575@section Build Systems
1576
1577@cindex build system
1578Each package definition specifies a @dfn{build system} and arguments for
1579that build system (@pxref{Defining Packages}). This @code{build-system}
1580field represents the build procedure of the package, as well implicit
1581dependencies of that build procedure.
1582
1583Build systems are @code{<build-system>} objects. The interface to
1584create and manipulate them is provided by the @code{(guix build-system)}
1585module, and actual build systems are exported by specific modules.
1586
f5fd4fd2 1587@cindex bag (low-level package representation)
0d5a559f
LC
1588Under the hood, build systems first compile package objects to
1589@dfn{bags}. A @dfn{bag} is like a package, but with less
1590ornamentation---in other words, a bag is a lower-level representation of
1591a package, which includes all the inputs of that package, including some
1592that were implicitly added by the build system. This intermediate
1593representation is then compiled to a derivation (@pxref{Derivations}).
1594
7458bd0a
LC
1595Build systems accept an optional list of @dfn{arguments}. In package
1596definitions, these are passed @i{via} the @code{arguments} field
1597(@pxref{Defining Packages}). They are typically keyword arguments
1598(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
1599Guile Reference Manual}). The value of these arguments is usually
1600evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
1601by the daemon (@pxref{Derivations}).
1602
1603The main build system is @var{gnu-build-system}, which implements the
1604standard build procedure for GNU packages and many other packages. It
1605is provided by the @code{(guix build-system gnu)} module.
1606
1607@defvr {Scheme Variable} gnu-build-system
1608@var{gnu-build-system} represents the GNU Build System, and variants
1609thereof (@pxref{Configuration, configuration and makefile conventions,,
1610standards, GNU Coding Standards}).
1611
1612@cindex build phases
1613In a nutshell, packages using it configured, built, and installed with
1614the usual @code{./configure && make && make check && make install}
1615command sequence. In practice, a few additional steps are often needed.
1616All these steps are split up in separate @dfn{phases},
1617notably@footnote{Please see the @code{(guix build gnu-build-system)}
1618modules for more details about the build phases.}:
1619
1620@table @code
1621@item unpack
1622Unpack the source tarball, and change the current directory to the
1623extracted source tree. If the source is actually a directory, copy it
1624to the build tree, and enter that directory.
1625
1626@item patch-source-shebangs
1627Patch shebangs encountered in source files so they refer to the right
1628store file names. For instance, this changes @code{#!/bin/sh} to
1629@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
1630
1631@item configure
1632Run the @file{configure} script with a number of default options, such
1633as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
1634by the @code{#:configure-flags} argument.
1635
1636@item build
1637Run @code{make} with the list of flags specified with
1638@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
1639(the default), build with @code{make -j}.
1640
1641@item check
1642Run @code{make check}, or some other target specified with
1643@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
1644@code{#:parallel-tests?} argument is true (the default), run @code{make
1645check -j}.
1646
1647@item install
1648Run @code{make install} with the flags listed in @code{#:make-flags}.
1649
1650@item patch-shebangs
1651Patch shebangs on the installed executable files.
1652
1653@item strip
1654Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
1655is false), copying them to the @code{debug} output when available
1656(@pxref{Installing Debugging Files}).
1657@end table
1658
1659@vindex %standard-phases
1660The build-side module @code{(guix build gnu-build-system)} defines
1661@var{%standard-phases} as the default list of build phases.
1662@var{%standard-phases} is a list of symbol/procedure pairs, where the
1663procedure implements the actual phase.
1664
1665The list of phases used for a particular package can be changed with the
1666@code{#:phases} parameter. For instance, passing:
1667
1668@example
1669#:phases (alist-delete 'configure %standard-phases)
1670@end example
1671
9bf404e9 1672means that all the phases described above will be used, except the
7458bd0a
LC
1673@code{configure} phase.
1674
1675In addition, this build system ensures that the ``standard'' environment
1676for GNU packages is available. This includes tools such as GCC, libc,
1677Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
1678build-system gnu)} module for a complete list.) We call these the
1679@dfn{implicit inputs} of a package, because package definitions don't
1680have to mention them.
1681@end defvr
1682
1683Other @code{<build-system>} objects are defined to support other
1684conventions and tools used by free software packages. They inherit most
1685of @var{gnu-build-system}, and differ mainly in the set of inputs
1686implicitly added to the build process, and in the list of phases
1687executed. Some of these build systems are listed below.
1688
1689@defvr {Scheme Variable} cmake-build-system
1690This variable is exported by @code{(guix build-system cmake)}. It
1691implements the build procedure for packages using the
1692@url{http://www.cmake.org, CMake build tool}.
1693
1694It automatically adds the @code{cmake} package to the set of inputs.
1695Which package is used can be specified with the @code{#:cmake}
1696parameter.
9849cfc1
LC
1697
1698The @code{#:configure-flags} parameter is taken as a list of flags
1699passed to the @command{cmake} command. The @code{#:build-type}
1700parameter specifies in abstract terms the flags passed to the compiler;
1701it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
1702debugging information''), which roughly means that code is compiled with
1703@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
1704@end defvr
1705
3afcf52b
FB
1706@defvr {Scheme Variable} glib-or-gtk-build-system
1707This variable is exported by @code{(guix build-system glib-or-gtk)}. It
1708is intended for use with packages making use of GLib or GTK+.
1709
1710This build system adds the following two phases to the ones defined by
1711@var{gnu-build-system}:
1712
1713@table @code
1714@item glib-or-gtk-wrap
1715The phase @code{glib-or-gtk-wrap} ensures that programs found under
1716@file{bin/} are able to find GLib's ``schemas'' and
1717@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
1718modules}. This is achieved by wrapping the programs in launch scripts
1719that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
1720environment variables.
1721
1722@item glib-or-gtk-compile-schemas
1723The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
1724@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
1725GSettings schemas} are compiled. Compilation is performed by the
1726@command{glib-compile-schemas} program. It is provided by the package
1727@code{glib:bin} which is automatically imported by the build system.
1728The @code{glib} package providing @command{glib-compile-schemas} can be
1729specified with the @code{#:glib} parameter.
1730@end table
1731
1732Both phases are executed after the @code{install} phase.
1733@end defvr
1734
7458bd0a
LC
1735@defvr {Scheme Variable} python-build-system
1736This variable is exported by @code{(guix build-system python)}. It
1737implements the more or less standard build procedure used by Python
1738packages, which consists in running @code{python setup.py build} and
1739then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
1740
1741For packages that install stand-alone Python programs under @code{bin/},
1742it takes care of wrapping these programs so their @code{PYTHONPATH}
1743environment variable points to all the Python libraries they depend on.
1744
1745Which Python package is used can be specified with the @code{#:python}
1746parameter.
1747@end defvr
1748
1749@defvr {Scheme Variable} perl-build-system
1750This variable is exported by @code{(guix build-system perl)}. It
1751implements the standard build procedure for Perl packages, which
1752consists in running @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}},
1753followed by @code{make} and @code{make install}.
1754
1755The initial @code{perl Makefile.PL} invocation passes flags specified by
1756the @code{#:make-maker-flags} parameter.
1757
1758Which Perl package is used can be specified with @code{#:perl}.
1759@end defvr
1760
c08f9818
DT
1761@defvr {Scheme Variable} ruby-build-system
1762This variable is exported by @code{(guix build-system ruby)}. It
1763implements the RubyGems build procedure used by Ruby packages, which
1764involves running @code{gem build} followed by @code{gem install}.
1765
1766Which Ruby package is used can be specified with the @code{#:ruby}
1767parameter.
1768@end defvr
7458bd0a
LC
1769
1770Lastly, for packages that do not need anything as sophisticated, a
1771``trivial'' build system is provided. It is trivial in the sense that
1772it provides basically no support: it does not pull any implicit inputs,
1773and does not have a notion of build phases.
1774
1775@defvr {Scheme Variable} trivial-build-system
1776This variable is exported by @code{(guix build-system trivial)}.
1777
1778This build system requires a @code{#:builder} argument. This argument
1779must be a Scheme expression that builds the package's output(s)---as
1780with @code{build-expression->derivation} (@pxref{Derivations,
1781@code{build-expression->derivation}}).
1782@end defvr
1783
568717fd
LC
1784@node The Store
1785@section The Store
1786
e531ac2a
LC
1787@cindex store
1788@cindex store paths
1789
1790Conceptually, the @dfn{store} is where derivations that have been
834129e0 1791successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a
LC
1792Sub-directories in the store are referred to as @dfn{store paths}. The
1793store has an associated database that contains information such has the
1794store paths referred to by each store path, and the list of @emph{valid}
1795store paths---paths that result from a successful build.
1796
1797The store is always accessed by the daemon on behalf of its clients
1798(@pxref{Invoking guix-daemon}). To manipulate the store, clients
1799connect to the daemon over a Unix-domain socket, send it requests, and
1800read the result---these are remote procedure calls, or RPCs.
1801
1802The @code{(guix store)} module provides procedures to connect to the
1803daemon, and to perform RPCs. These are described below.
1804
1805@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
1806Connect to the daemon over the Unix-domain socket at @var{file}. When
1807@var{reserve-space?} is true, instruct it to reserve a little bit of
1808extra space on the file system so that the garbage collector can still
1809operate, should the disk become full. Return a server object.
1810
1811@var{file} defaults to @var{%default-socket-path}, which is the normal
1812location given the options that were passed to @command{configure}.
1813@end deffn
1814
1815@deffn {Scheme Procedure} close-connection @var{server}
1816Close the connection to @var{server}.
1817@end deffn
1818
1819@defvr {Scheme Variable} current-build-output-port
1820This variable is bound to a SRFI-39 parameter, which refers to the port
1821where build and error logs sent by the daemon should be written.
1822@end defvr
1823
1824Procedures that make RPCs all take a server object as their first
1825argument.
1826
1827@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
1828Return @code{#t} when @var{path} is a valid store path.
1829@end deffn
1830
cfbf9160 1831@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
1832Add @var{text} under file @var{name} in the store, and return its store
1833path. @var{references} is the list of store paths referred to by the
1834resulting store path.
1835@end deffn
1836
874e6874 1837@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
1838Build @var{derivations} (a list of @code{<derivation>} objects or
1839derivation paths), and return when the worker is done building them.
1840Return @code{#t} on success.
874e6874
LC
1841@end deffn
1842
b860f382
LC
1843Note that the @code{(guix monads)} module provides a monad as well as
1844monadic versions of the above procedures, with the goal of making it
1845more convenient to work with code that accesses the store (@pxref{The
1846Store Monad}).
1847
e531ac2a
LC
1848@c FIXME
1849@i{This section is currently incomplete.}
568717fd
LC
1850
1851@node Derivations
1852@section Derivations
1853
874e6874
LC
1854@cindex derivations
1855Low-level build actions and the environment in which they are performed
1856are represented by @dfn{derivations}. A derivation contain the
1857following pieces of information:
1858
1859@itemize
1860@item
1861The outputs of the derivation---derivations produce at least one file or
1862directory in the store, but may produce more.
1863
1864@item
1865The inputs of the derivations, which may be other derivations or plain
1866files in the store (patches, build scripts, etc.)
1867
1868@item
1869The system type targeted by the derivation---e.g., @code{x86_64-linux}.
1870
1871@item
1872The file name of a build script in the store, along with the arguments
1873to be passed.
1874
1875@item
1876A list of environment variables to be defined.
1877
1878@end itemize
1879
1880@cindex derivation path
1881Derivations allow clients of the daemon to communicate build actions to
1882the store. They exist in two forms: as an in-memory representation,
1883both on the client- and daemon-side, and as files in the store whose
1884name end in @code{.drv}---these files are referred to as @dfn{derivation
1885paths}. Derivations paths can be passed to the @code{build-derivations}
1886procedure to perform the build actions they prescribe (@pxref{The
1887Store}).
1888
1889The @code{(guix derivations)} module provides a representation of
1890derivations as Scheme objects, along with procedures to create and
1891otherwise manipulate derivations. The lowest-level primitive to create
1892a derivation is the @code{derivation} procedure:
1893
1909431c
LC
1894@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
1895 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 1896 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 1897 [#:system (%current-system)] [#:references-graphs #f] @
b53be755 1898 [#:allowed-references #f] [#:local-build? #f]
59688fc4
LC
1899Build a derivation with the given arguments, and return the resulting
1900@code{<derivation>} object.
874e6874 1901
2096ef47 1902When @var{hash} and @var{hash-algo} are given, a
874e6874 1903@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
1904known in advance, such as a file download. If, in addition,
1905@var{recursive?} is true, then that fixed output may be an executable
1906file or a directory and @var{hash} must be the hash of an archive
1907containing this output.
5b0c9d16 1908
858e9282 1909When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
1910name/store path pairs. In that case, the reference graph of each store
1911path is exported in the build environment in the corresponding file, in
1912a simple text format.
1909431c 1913
b53be755
LC
1914When @var{allowed-references} is true, it must be a list of store items
1915or outputs that the derivation's output may refer to.
1916
1909431c
LC
1917When @var{local-build?} is true, declare that the derivation is not a
1918good candidate for offloading and should rather be built locally
1919(@pxref{Daemon Offload Setup}). This is the case for small derivations
1920where the costs of data transfers would outweigh the benefits.
874e6874
LC
1921@end deffn
1922
1923@noindent
1924Here's an example with a shell script as its builder, assuming
1925@var{store} is an open connection to the daemon, and @var{bash} points
1926to a Bash executable in the store:
1927
1928@lisp
1929(use-modules (guix utils)
1930 (guix store)
1931 (guix derivations))
1932
59688fc4
LC
1933(let ((builder ; add the Bash script to the store
1934 (add-text-to-store store "my-builder.sh"
1935 "echo hello world > $out\n" '())))
1936 (derivation store "foo"
1937 bash `("-e" ,builder)
21b679f6 1938 #:inputs `((,bash) (,builder))
59688fc4 1939 #:env-vars '(("HOME" . "/homeless"))))
834129e0 1940@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
1941@end lisp
1942
21b679f6
LC
1943As can be guessed, this primitive is cumbersome to use directly. A
1944better approach is to write build scripts in Scheme, of course! The
1945best course of action for that is to write the build code as a
1946``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 1947information, @pxref{G-Expressions}.
21b679f6
LC
1948
1949Once upon a time, @code{gexp->derivation} did not exist and constructing
1950derivations with build code written in Scheme was achieved with
1951@code{build-expression->derivation}, documented below. This procedure
1952is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 1953
dd1a5a15
LC
1954@deffn {Scheme Procedure} build-expression->derivation @var{store} @
1955 @var{name} @var{exp} @
1956 [#:system (%current-system)] [#:inputs '()] @
1957 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 1958 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824
LC
1959 [#:references-graphs #f] [#:allowed-references #f] @
1960 [#:local-build? #f] [#:guile-for-build #f]
874e6874
LC
1961Return a derivation that executes Scheme expression @var{exp} as a
1962builder for derivation @var{name}. @var{inputs} must be a list of
1963@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
1964@code{"out"} is assumed. @var{modules} is a list of names of Guile
1965modules from the current search path to be copied in the store,
1966compiled, and made available in the load path during the execution of
1967@var{exp}---e.g., @code{((guix build utils) (guix build
1968gnu-build-system))}.
1969
1970@var{exp} is evaluated in an environment where @code{%outputs} is bound
1971to a list of output/path pairs, and where @code{%build-inputs} is bound
1972to a list of string/output-path pairs made from @var{inputs}.
1973Optionally, @var{env-vars} is a list of string pairs specifying the name
1974and value of environment variables visible to the builder. The builder
1975terminates by passing the result of @var{exp} to @code{exit}; thus, when
1976@var{exp} returns @code{#f}, the build is considered to have failed.
1977
1978@var{exp} is built using @var{guile-for-build} (a derivation). When
1979@var{guile-for-build} is omitted or is @code{#f}, the value of the
1980@code{%guile-for-build} fluid is used instead.
9c629a27 1981
63a42824
LC
1982See the @code{derivation} procedure for the meaning of
1983@var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
874e6874
LC
1984@end deffn
1985
1986@noindent
1987Here's an example of a single-output derivation that creates a directory
1988containing one file:
1989
1990@lisp
1991(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 1992 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
1993 (call-with-output-file (string-append out "/test")
1994 (lambda (p)
1995 (display '(hello guix) p))))))
dd1a5a15 1996 (build-expression->derivation store "goo" builder))
874e6874 1997
834129e0 1998@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
1999@end lisp
2000
568717fd 2001
b860f382
LC
2002@node The Store Monad
2003@section The Store Monad
2004
2005@cindex monad
2006
2007The procedures that operate on the store described in the previous
2008sections all take an open connection to the build daemon as their first
2009argument. Although the underlying model is functional, they either have
2010side effects or depend on the current state of the store.
2011
2012The former is inconvenient: the connection to the build daemon has to be
2013carried around in all those functions, making it impossible to compose
2014functions that do not take that parameter with functions that do. The
2015latter can be problematic: since store operations have side effects
2016and/or depend on external state, they have to be properly sequenced.
2017
2018@cindex monadic values
2019@cindex monadic functions
2020This is where the @code{(guix monads)} module comes in. This module
2021provides a framework for working with @dfn{monads}, and a particularly
2022useful monad for our uses, the @dfn{store monad}. Monads are a
2023construct that allows two things: associating ``context'' with values
2024(in our case, the context is the store), and building sequences of
2025computations (here computations includes accesses to the store.) Values
2026in a monad---values that carry this additional context---are called
2027@dfn{monadic values}; procedures that return such values are called
2028@dfn{monadic procedures}.
2029
2030Consider this ``normal'' procedure:
2031
2032@example
45adbd62
LC
2033(define (sh-symlink store)
2034 ;; Return a derivation that symlinks the 'bash' executable.
2035 (let* ((drv (package-derivation store bash))
2036 (out (derivation->output-path drv))
2037 (sh (string-append out "/bin/bash")))
2038 (build-expression->derivation store "sh"
2039 `(symlink ,sh %output))))
b860f382
LC
2040@end example
2041
2042Using @code{(guix monads)}, it may be rewritten as a monadic function:
2043
ada3df03 2044@c FIXME: Find a better example, one that uses 'mlet'.
b860f382 2045@example
45adbd62 2046(define (sh-symlink)
b860f382 2047 ;; Same, but return a monadic value.
ada3df03
LC
2048 (gexp->derivation "sh"
2049 #~(symlink (string-append #$bash "/bin/bash") #$output)))
b860f382
LC
2050@end example
2051
2052There are two things to note in the second version: the @code{store}
2053parameter is now implicit, and the monadic value returned by
2054@code{package-file}---a wrapper around @code{package-derivation} and
2055@code{derivation->output-path}---is @dfn{bound} using @code{mlet}
2056instead of plain @code{let}.
2057
2058Calling the monadic @code{profile.sh} has no effect. To get the desired
2059effect, one must use @code{run-with-store}:
2060
2061@example
2062(run-with-store (open-connection) (profile.sh))
834129e0 2063@result{} /gnu/store/...-profile.sh
b860f382
LC
2064@end example
2065
b9b86078
LC
2066Note that the @code{(guix monad-repl)} module extends Guile's REPL with
2067new ``meta-commands'' to make it easier to deal with monadic procedures:
2068@code{run-in-store}, and @code{enter-store-monad}. The former, is used
2069to ``run'' a single monadic value through the store:
2070
2071@example
2072scheme@@(guile-user)> ,run-in-store (package->derivation hello)
2073$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2074@end example
2075
2076The latter enters a recursive REPL, where all the return values are
2077automatically run through the store:
2078
2079@example
2080scheme@@(guile-user)> ,enter-store-monad
2081store-monad@@(guile-user) [1]> (package->derivation hello)
2082$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2083store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
2084$3 = "/gnu/store/@dots{}-foo"
2085store-monad@@(guile-user) [1]> ,q
2086scheme@@(guile-user)>
2087@end example
2088
2089@noindent
2090Note that non-monadic values cannot be returned in the
2091@code{store-monad} REPL.
2092
b860f382
LC
2093The main syntactic forms to deal with monads in general are described
2094below.
2095
2096@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
2097Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
2098in @var{monad}.
2099@end deffn
2100
2101@deffn {Scheme Syntax} return @var{val}
2102Return a monadic value that encapsulates @var{val}.
2103@end deffn
2104
2105@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
2106@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
2107procedure @var{mproc}@footnote{This operation is commonly referred to as
2108``bind'', but that name denotes an unrelated procedure in Guile. Thus
2109we use this somewhat cryptic symbol inherited from the Haskell
2110language.}.
2111@end deffn
2112
2113@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
2114 @var{body} ...
2115@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
2116 @var{body} ...
2117Bind the variables @var{var} to the monadic values @var{mval} in
2118@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2119``normal'' value @var{val}, as per @code{let}.
2120
2121@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2122(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2123@end deffn
2124
405a9d4e
LC
2125@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
2126Bind @var{mexp} and the following monadic expressions in sequence,
2127returning the result of the last expression.
2128
2129This is akin to @code{mlet}, except that the return values of the
2130monadic expressions are ignored. In that sense, it is analogous to
2131@code{begin}, but applied to monadic expressions.
2132@end deffn
2133
b860f382
LC
2134The interface to the store monad provided by @code{(guix monads)} is as
2135follows.
2136
2137@defvr {Scheme Variable} %store-monad
2138The store monad. Values in the store monad encapsulate accesses to the
2139store. When its effect is needed, a value of the store monad must be
2140``evaluated'' by passing it to the @code{run-with-store} procedure (see
2141below.)
2142@end defvr
2143
2144@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2145Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2146open store connection.
2147@end deffn
2148
2149@deffn {Monadic Procedure} text-file @var{name} @var{text}
2150Return as a monadic value the absolute file name in the store of the file
45adbd62
LC
2151containing @var{text}, a string.
2152@end deffn
2153
2154@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
2155Return as a monadic value a derivation that builds a text file
2156containing all of @var{text}. @var{text} may list, in addition to
2157strings, packages, derivations, and store file names; the resulting
2158store file holds references to all these.
2159
2160This variant should be preferred over @code{text-file} anytime the file
2161to create will reference items from the store. This is typically the
2162case when building a configuration file that embeds store file names,
2163like this:
2164
2165@example
2166(define (profile.sh)
2167 ;; Return the name of a shell script in the store that
2168 ;; initializes the 'PATH' environment variable.
2169 (text-file* "profile.sh"
2170 "export PATH=" coreutils "/bin:"
2171 grep "/bin:" sed "/bin\n"))
2172@end example
2173
834129e0 2174In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
45adbd62
LC
2175will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
2176preventing them from being garbage-collected during its lifetime.
b860f382
LC
2177@end deffn
2178
0a90af15
LC
2179@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2180 [#:recursive? #t]
2181Return the name of @var{file} once interned in the store. Use
2182@var{name} as its store name, or the basename of @var{file} if
2183@var{name} is omitted.
2184
2185When @var{recursive?} is true, the contents of @var{file} are added
2186recursively; if @var{file} designates a flat file and @var{recursive?}
2187is true, its contents are added, and its permission bits are kept.
2188
2189The example below adds a file to the store, under two different names:
2190
2191@example
2192(run-with-store (open-connection)
2193 (mlet %store-monad ((a (interned-file "README"))
2194 (b (interned-file "README" "LEGU-MIN")))
2195 (return (list a b))))
2196
2197@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2198@end example
2199
2200@end deffn
2201
b860f382 2202@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
2203 [#:system (%current-system)] [#:target #f] @
2204 [#:output "out"] Return as a monadic
b860f382
LC
2205value in the absolute file name of @var{file} within the @var{output}
2206directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
2207of the @var{output} directory of @var{package}. When @var{target} is
2208true, use it as a cross-compilation target triplet.
b860f382
LC
2209@end deffn
2210
b860f382 2211@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
2212@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2213 @var{target} [@var{system}]
2214Monadic version of @code{package-derivation} and
2215@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
2216@end deffn
2217
2218
21b679f6
LC
2219@node G-Expressions
2220@section G-Expressions
2221
2222@cindex G-expression
2223@cindex build code quoting
2224So we have ``derivations'', which represent a sequence of build actions
2225to be performed to produce an item in the store (@pxref{Derivations}).
2226Those build actions are performed when asking the daemon to actually
2227build the derivations; they are run by the daemon in a container
2228(@pxref{Invoking guix-daemon}).
2229
2230@cindex strata of code
2231It should come as no surprise that we like to write those build actions
2232in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2233code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
2234Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2235Kiselyov, who has written insightful
2236@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2237on this topic}, refers to this kind of code generation as
2238@dfn{staging}.}: the ``host code''---code that defines packages, talks
2239to the daemon, etc.---and the ``build code''---code that actually
2240performs build actions, such as making directories, invoking
2241@command{make}, etc.
21b679f6
LC
2242
2243To describe a derivation and its build actions, one typically needs to
2244embed build code inside host code. It boils down to manipulating build
2245code as data, and Scheme's homoiconicity---code has a direct
2246representation as data---comes in handy for that. But we need more than
2247Scheme's normal @code{quasiquote} mechanism to construct build
2248expressions.
2249
2250The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2251S-expressions adapted to build expressions. G-expressions, or
2252@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2253@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2254@code{#$}, and @code{#$@@}), which are comparable respectively to
2255@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2256(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2257Reference Manual}). However, there are major differences:
2258
2259@itemize
2260@item
2261Gexps are meant to be written to a file and run or manipulated by other
2262processes.
2263
2264@item
2265When a package or derivation is unquoted inside a gexp, the result is as
2266if its output file name had been introduced.
2267
2268@item
2269Gexps carry information about the packages or derivations they refer to,
2270and these dependencies are automatically added as inputs to the build
2271processes that use them.
2272@end itemize
2273
2274To illustrate the idea, here is an example of a gexp:
2275
2276@example
2277(define build-exp
2278 #~(begin
2279 (mkdir #$output)
2280 (chdir #$output)
2281 (symlink (string-append #$coreutils "/bin/ls")
2282 "list-files")))
2283@end example
2284
2285This gexp can be passed to @code{gexp->derivation}; we obtain a
2286derivation that builds a directory containing exactly one symlink to
2287@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2288
2289@example
2290(gexp->derivation "the-thing" build-exp)
2291@end example
2292
e20fd1bf 2293As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
2294substituted to the reference to the @var{coreutils} package in the
2295actual build code, and @var{coreutils} is automatically made an input to
2296the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2297output)}) is replaced by a string containing the derivation's output
667b2508
LC
2298directory name.
2299
2300@cindex cross compilation
2301In a cross-compilation context, it is useful to distinguish between
2302references to the @emph{native} build of a package---that can run on the
2303host---versus references to cross builds of a package. To that end, the
2304@code{#+} plays the same role as @code{#$}, but is a reference to a
2305native package build:
2306
2307@example
2308(gexp->derivation "vi"
2309 #~(begin
2310 (mkdir #$output)
2311 (system* (string-append #+coreutils "/bin/ln")
2312 "-s"
2313 (string-append #$emacs "/bin/emacs")
2314 (string-append #$output "/bin/vi")))
2315 #:target "mips64el-linux")
2316@end example
2317
2318@noindent
2319In the example above, the native build of @var{coreutils} is used, so
2320that @command{ln} can actually run on the host; but then the
2321cross-compiled build of @var{emacs} is referenced.
2322
2323The syntactic form to construct gexps is summarized below.
21b679f6
LC
2324
2325@deffn {Scheme Syntax} #~@var{exp}
2326@deffnx {Scheme Syntax} (gexp @var{exp})
2327Return a G-expression containing @var{exp}. @var{exp} may contain one
2328or more of the following forms:
2329
2330@table @code
2331@item #$@var{obj}
2332@itemx (ungexp @var{obj})
2333Introduce a reference to @var{obj}. @var{obj} may be a package or a
2334derivation, in which case the @code{ungexp} form is replaced by its
2335output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2336
2337If @var{obj} is a list, it is traversed and any package or derivation
2338references are substituted similarly.
2339
2340If @var{obj} is another gexp, its contents are inserted and its
2341dependencies are added to those of the containing gexp.
2342
2343If @var{obj} is another kind of object, it is inserted as is.
2344
2345@item #$@var{package-or-derivation}:@var{output}
2346@itemx (ungexp @var{package-or-derivation} @var{output})
2347This is like the form above, but referring explicitly to the
2348@var{output} of @var{package-or-derivation}---this is useful when
2349@var{package-or-derivation} produces multiple outputs (@pxref{Packages
2350with Multiple Outputs}).
2351
667b2508
LC
2352@item #+@var{obj}
2353@itemx #+@var{obj}:output
2354@itemx (ungexp-native @var{obj})
2355@itemx (ungexp-native @var{obj} @var{output})
2356Same as @code{ungexp}, but produces a reference to the @emph{native}
2357build of @var{obj} when used in a cross compilation context.
2358
21b679f6
LC
2359@item #$output[:@var{output}]
2360@itemx (ungexp output [@var{output}])
2361Insert a reference to derivation output @var{output}, or to the main
2362output when @var{output} is omitted.
2363
2364This only makes sense for gexps passed to @code{gexp->derivation}.
2365
2366@item #$@@@var{lst}
2367@itemx (ungexp-splicing @var{lst})
2368Like the above, but splices the contents of @var{lst} inside the
2369containing list.
2370
667b2508
LC
2371@item #+@@@var{lst}
2372@itemx (ungexp-native-splicing @var{lst})
2373Like the above, but refers to native builds of the objects listed in
2374@var{lst}.
2375
21b679f6
LC
2376@end table
2377
2378G-expressions created by @code{gexp} or @code{#~} are run-time objects
2379of the @code{gexp?} type (see below.)
2380@end deffn
2381
2382@deffn {Scheme Procedure} gexp? @var{obj}
2383Return @code{#t} if @var{obj} is a G-expression.
2384@end deffn
2385
2386G-expressions are meant to be written to disk, either as code building
2387some derivation, or as plain files in the store. The monadic procedures
2388below allow you to do that (@pxref{The Store Monad}, for more
2389information about monads.)
2390
2391@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
68a61e9f 2392 [#:system (%current-system)] [#:target #f] [#:inputs '()] @
21b679f6
LC
2393 [#:hash #f] [#:hash-algo #f] @
2394 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 2395 [#:module-path @var{%load-path}] @
21b679f6
LC
2396 [#:references-graphs #f] [#:local-build? #f] @
2397 [#:guile-for-build #f]
2398Return a derivation @var{name} that runs @var{exp} (a gexp) with
68a61e9f
LC
2399@var{guile-for-build} (a derivation) on @var{system}. When @var{target}
2400is true, it is used as the cross-compilation target triplet for packages
2401referred to by @var{exp}.
21b679f6
LC
2402
2403Make @var{modules} available in the evaluation context of @var{EXP};
4684f301
LC
2404@var{MODULES} is a list of names of Guile modules searched in
2405@var{MODULE-PATH} to be copied in the store, compiled, and made available in
21b679f6
LC
2406the load path during the execution of @var{exp}---e.g., @code{((guix
2407build utils) (guix build gnu-build-system))}.
2408
b53833b2
LC
2409When @var{references-graphs} is true, it must be a list of tuples of one of the
2410following forms:
2411
2412@example
2413(@var{file-name} @var{package})
2414(@var{file-name} @var{package} @var{output})
2415(@var{file-name} @var{derivation})
2416(@var{file-name} @var{derivation} @var{output})
2417(@var{file-name} @var{store-item})
2418@end example
2419
2420The right-hand-side of each element of @var{references-graphs} is automatically made
2421an input of the build process of @var{exp}. In the build environment, each
2422@var{file-name} contains the reference graph of the corresponding item, in a simple
2423text format.
2424
e20fd1bf 2425The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
2426@end deffn
2427
2428@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
2429Return an executable script @var{name} that runs @var{exp} using
2430@var{guile} with @var{modules} in its search path.
2431
2432The example below builds a script that simply invokes the @command{ls}
2433command:
2434
2435@example
2436(use-modules (guix gexp) (gnu packages base))
2437
2438(gexp->script "list-files"
2439 #~(execl (string-append #$coreutils "/bin/ls")
2440 "ls"))
2441@end example
2442
2443When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 2444@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
2445executable file @file{/gnu/store/@dots{}-list-files} along these lines:
2446
2447@example
2448#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
2449!#
2450(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
2451 "ls")
2452@end example
2453@end deffn
2454
2455@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
2456Return a derivation that builds a file @var{name} containing @var{exp}.
2457
2458The resulting file holds references to all the dependencies of @var{exp}
2459or a subset thereof.
2460@end deffn
2461
2462Of course, in addition to gexps embedded in ``host'' code, there are
2463also modules containing build tools. To make it clear that they are
2464meant to be used in the build stratum, these modules are kept in the
2465@code{(guix build @dots{})} name space.
2466
2467
568717fd
LC
2468@c *********************************************************************
2469@node Utilities
2470@chapter Utilities
2471
210cc920
LC
2472This section describes tools primarily targeted at developers and users
2473who write new package definitions. They complement the Scheme
2474programming interface of Guix in a convenient way.
2475
568717fd 2476@menu
37166310 2477* Invoking guix build:: Building packages from the command line.
210cc920 2478* Invoking guix download:: Downloading a file and printing its hash.
37166310 2479* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 2480* Invoking guix import:: Importing package definitions.
37166310 2481* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 2482* Invoking guix lint:: Finding errors in package definitions.
372c4bbc 2483* Invoking guix environment:: Setting up development environments.
568717fd
LC
2484@end menu
2485
e49951eb
MW
2486@node Invoking guix build
2487@section Invoking @command{guix build}
568717fd 2488
e49951eb 2489The @command{guix build} command builds packages or derivations and
6798a8e4
LC
2490their dependencies, and prints the resulting store paths. Note that it
2491does not modify the user's profile---this is the job of the
e49951eb 2492@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
2493it is mainly useful for distribution developers.
2494
2495The general syntax is:
c78bd12b
LC
2496
2497@example
e49951eb 2498guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
2499@end example
2500
2501@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
2502the software distribution such as @code{coreutils} or
2503@code{coreutils-8.20}, or a derivation such as
834129e0 2504@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
2505package with the corresponding name (and optionally version) is searched
2506for among the GNU distribution modules (@pxref{Package Modules}).
2507
2508Alternatively, the @code{--expression} option may be used to specify a
2509Scheme expression that evaluates to a package; this is useful when
2510disambiguation among several same-named packages or package variants is
2511needed.
c78bd12b
LC
2512
2513The @var{options} may be zero or more of the following:
2514
2515@table @code
2516
2517@item --expression=@var{expr}
2518@itemx -e @var{expr}
ac5de156 2519Build the package or derivation @var{expr} evaluates to.
c78bd12b 2520
5401dd75 2521For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
2522guile-1.8)}, which unambiguously designates this specific variant of
2523version 1.8 of Guile.
2524
56b82106
LC
2525Alternately, @var{expr} may be a G-expression, in which case it is used
2526as a build program passed to @code{gexp->derivation}
2527(@pxref{G-Expressions}).
2528
2529Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
2530(@pxref{The Store Monad}). The procedure must return a derivation as a
2531monadic value, which is then passed through @code{run-with-store}.
2532
c78bd12b
LC
2533@item --source
2534@itemx -S
2535Build the packages' source derivations, rather than the packages
2536themselves.
2537
e49951eb 2538For instance, @code{guix build -S gcc} returns something like
834129e0 2539@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 2540
f9cc8971
LC
2541The returned source tarball is the result of applying any patches and
2542code snippets specified in the package's @code{origin} (@pxref{Defining
2543Packages}).
2544
c78bd12b
LC
2545@item --system=@var{system}
2546@itemx -s @var{system}
2547Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
2548the host's system type.
2549
2550An example use of this is on Linux-based systems, which can emulate
2551different personalities. For instance, passing
2552@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
2553to build packages in a complete 32-bit environment.
2554
e55ec43d
LC
2555@item --target=@var{triplet}
2556@cindex cross-compilation
2557Cross-build for @var{triplet}, which must be a valid GNU triplet, such
2558as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
2559configuration triplets,, configure, GNU Configure and Build System}).
2560
7f3673f2
LC
2561@item --with-source=@var{source}
2562Use @var{source} as the source of the corresponding package.
2563@var{source} must be a file name or a URL, as for @command{guix
2564download} (@pxref{Invoking guix download}).
2565
2566The ``corresponding package'' is taken to be one specified on the
2567command line whose name matches the base of @var{source}---e.g., if
2568@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
2569package is @code{guile}. Likewise, the version string is inferred from
2570@var{source}; in the previous example, it's @code{2.0.10}.
2571
2572This option allows users to try out versions of packages other than the
2573one provided by the distribution. The example below downloads
2574@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
2575the @code{ed} package:
2576
2577@example
2578guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
2579@end example
2580
2581As a developer, @code{--with-source} makes it easy to test release
2582candidates:
2583
2584@example
2585guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
2586@end example
2587
05962f29
LC
2588@item --no-grafts
2589Do not ``graft'' packages. In practice, this means that package updates
2590available as grafts are not applied. @xref{Security Updates}, for more
2591information on grafts.
7f3673f2 2592
c78bd12b
LC
2593@item --derivations
2594@itemx -d
2595Return the derivation paths, not the output paths, of the given
2596packages.
2597
70ee5642
LC
2598@item --root=@var{file}
2599@itemx -r @var{file}
2600Make @var{file} a symlink to the result, and register it as a garbage
2601collector root.
2602
2603@item --log-file
2604Return the build log file names for the given
2605@var{package-or-derivation}s, or raise an error if build logs are
2606missing.
2607
2608This works regardless of how packages or derivations are specified. For
2609instance, the following invocations are equivalent:
2610
2611@example
2612guix build --log-file `guix build -d guile`
2613guix build --log-file `guix build guile`
2614guix build --log-file guile
2615guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
2616@end example
2617
2618
2619@end table
2620
2621@cindex common build options
2622In addition, a number of options that control the build process are
2623common to @command{guix build} and other commands that can spawn builds,
2624such as @command{guix package} or @command{guix archive}. These are the
2625following:
2626
2627@table @code
2628
300868ba
LC
2629@item --load-path=@var{directory}
2630@itemx -L @var{directory}
2631Add @var{directory} to the front of the package module search path
2632(@pxref{Package Modules}).
2633
2634This allows users to define their own packages and make them visible to
2635the command-line tools.
2636
c78bd12b
LC
2637@item --keep-failed
2638@itemx -K
2639Keep the build tree of failed builds. Thus, if a build fail, its build
2640tree is kept under @file{/tmp}, in a directory whose name is shown at
2641the end of the build log. This is useful when debugging build issues.
2642
2643@item --dry-run
2644@itemx -n
2645Do not build the derivations.
2646
56b1f4b7
LC
2647@item --fallback
2648When substituting a pre-built binary fails, fall back to building
2649packages locally.
2650
c78bd12b 2651@item --no-substitutes
b5385b52 2652Do not use substitutes for build products. That is, always build things
c4202d60
LC
2653locally instead of allowing downloads of pre-built binaries
2654(@pxref{Substitutes}).
c78bd12b 2655
425b0bfc 2656@item --no-build-hook
4ec2e92d
LC
2657Do not attempt to offload builds @i{via} the daemon's ``build hook''
2658(@pxref{Daemon Offload Setup}). That is, always build things locally
2659instead of offloading builds to remote machines.
425b0bfc 2660
969e678e
LC
2661@item --max-silent-time=@var{seconds}
2662When the build or substitution process remains silent for more than
2663@var{seconds}, terminate it and report a build failure.
2664
002622b6
LC
2665@item --timeout=@var{seconds}
2666Likewise, when the build or substitution process lasts for more than
2667@var{seconds}, terminate it and report a build failure.
2668
2669By default there is no timeout. This behavior can be restored with
2670@code{--timeout=0}.
2671
07ab4bf1
LC
2672@item --verbosity=@var{level}
2673Use the given verbosity level. @var{level} must be an integer between 0
2674and 5; higher means more verbose output. Setting a level of 4 or more
2675may be helpful when debugging setup issues with the build daemon.
2676
70ee5642
LC
2677@item --cores=@var{n}
2678@itemx -c @var{n}
2679Allow the use of up to @var{n} CPU cores for the build. The special
2680value @code{0} means to use as many CPU cores as available.
bf421152 2681
c78bd12b
LC
2682@end table
2683
e49951eb 2684Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
2685the @code{package-derivation} procedure of the @code{(guix packages)}
2686module, and to the @code{build-derivations} procedure of the @code{(guix
2687store)} module.
2688
210cc920
LC
2689@node Invoking guix download
2690@section Invoking @command{guix download}
2691
2692When writing a package definition, developers typically need to download
2693the package's source tarball, compute its SHA256 hash, and write that
2694hash in the package definition (@pxref{Defining Packages}). The
2695@command{guix download} tool helps with this task: it downloads a file
2696from the given URI, adds it to the store, and prints both its file name
2697in the store and its SHA256 hash.
2698
2699The fact that the downloaded file is added to the store saves bandwidth:
2700when the developer eventually tries to build the newly defined package
2701with @command{guix build}, the source tarball will not have to be
2702downloaded again because it is already in the store. It is also a
2703convenient way to temporarily stash files, which may be deleted
2704eventually (@pxref{Invoking guix gc}).
2705
2706The @command{guix download} command supports the same URIs as used in
2707package definitions. In particular, it supports @code{mirror://} URIs.
2708@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
2709Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
2710they are not available, an error is raised. @xref{Guile Preparations,
2711how to install the GnuTLS bindings for Guile,, gnutls-guile,
2712GnuTLS-Guile}, for more information.
210cc920
LC
2713
2714The following option is available:
2715
2716@table @code
2717@item --format=@var{fmt}
2718@itemx -f @var{fmt}
2719Write the hash in the format specified by @var{fmt}. For more
081145cf 2720information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
2721@end table
2722
6c365eca
NK
2723@node Invoking guix hash
2724@section Invoking @command{guix hash}
2725
210cc920 2726The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
2727It is primarily a convenience tool for anyone contributing to the
2728distribution: it computes the cryptographic hash of a file, which can be
2729used in the definition of a package (@pxref{Defining Packages}).
2730
2731The general syntax is:
2732
2733@example
2734guix hash @var{option} @var{file}
2735@end example
2736
2737@command{guix hash} has the following option:
2738
2739@table @code
2740
2741@item --format=@var{fmt}
2742@itemx -f @var{fmt}
210cc920 2743Write the hash in the format specified by @var{fmt}.
6c365eca
NK
2744
2745Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
2746(@code{hex} and @code{hexadecimal} can be used as well).
2747
2748If the @option{--format} option is not specified, @command{guix hash}
2749will output the hash in @code{nix-base32}. This representation is used
2750in the definitions of packages.
2751
3140f2df
LC
2752@item --recursive
2753@itemx -r
2754Compute the hash on @var{file} recursively.
2755
2756In this case, the hash is computed on an archive containing @var{file},
2757including its children if it is a directory. Some of @var{file}'s
2758meta-data is part of the archive; for instance, when @var{file} is a
2759regular file, the hash is different depending on whether @var{file} is
2760executable or not. Meta-data such as time stamps has no impact on the
2761hash (@pxref{Invoking guix archive}).
2762@c FIXME: Replace xref above with xref to an ``Archive'' section when
2763@c it exists.
2764
6c365eca
NK
2765@end table
2766
2f7d2d91
LC
2767@node Invoking guix import
2768@section Invoking @command{guix import}
2769
2770@cindex importing packages
2771@cindex package import
2772@cindex package conversion
2773The @command{guix import} command is useful for people willing to add a
2774package to the distribution but who'd rather do as little work as
2775possible to get there---a legitimate demand. The command knows of a few
2776repositories from which it can ``import'' package meta-data. The result
2777is a package definition, or a template thereof, in the format we know
2778(@pxref{Defining Packages}).
2779
2780The general syntax is:
2781
2782@example
2783guix import @var{importer} @var{options}@dots{}
2784@end example
2785
2786@var{importer} specifies the source from which to import package
2787meta-data, and @var{options} specifies a package identifier and other
2788options specific to @var{importer}. Currently, the available
2789``importers'' are:
2790
2791@table @code
2792@item gnu
2793Import meta-data for the given GNU package. This provides a template
2794for the latest version of that GNU package, including the hash of its
2795source tarball, and its canonical synopsis and description.
2796
2797Additional information such as the package's dependencies and its
2798license needs to be figured out manually.
2799
2800For example, the following command returns a package definition for
2801GNU@tie{}Hello:
2802
2803@example
2804guix import gnu hello
2805@end example
2806
2807Specific command-line options are:
2808
2809@table @code
2810@item --key-download=@var{policy}
2811As for @code{guix refresh}, specify the policy to handle missing OpenPGP
2812keys when verifying the package's signature. @xref{Invoking guix
2813refresh, @code{--key-download}}.
2814@end table
2815
2816@item pypi
2817@cindex pypi
2818Import meta-data from the @uref{https://pypi.python.org/, Python Package
2819Index}@footnote{This functionality requires Guile-JSON to be installed.
2820@xref{Requirements}.}. Information is taken from the JSON-formatted
2821description available at @code{pypi.python.org} and usually includes all
2822the relevant information, including package dependencies.
2823
2824The command below imports meta-data for the @code{itsdangerous} Python
2825package:
2826
2827@example
2828guix import pypi itsdangerous
2829@end example
2830
2831@item nix
2832Import meta-data from a local copy of the source of the
2833@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
2834relies on the @command{nix-instantiate} command of
2835@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
2836typically written in a mixture of Nix-language and Bash code. This
2837command only imports the high-level package structure that is written in
2838the Nix language. It normally includes all the basic fields of a
2839package definition.
2840
2841When importing a GNU package, the synopsis and descriptions are replaced
2842by their canonical upstream variant.
2843
2844As an example, the command below imports the package definition of
2845LibreOffice (more precisely, it imports the definition of the package
2846bound to the @code{libreoffice} top-level attribute):
2847
2848@example
2849guix import nix ~/path/to/nixpkgs libreoffice
2850@end example
2851@end table
2852
2853The structure of the @command{guix import} code is modular. It would be
2854useful to have more importers for other package formats, and your help
2855is welcome here (@pxref{Contributing}).
2856
37166310
LC
2857@node Invoking guix refresh
2858@section Invoking @command{guix refresh}
2859
2860The primary audience of the @command{guix refresh} command is developers
2861of the GNU software distribution. By default, it reports any packages
2862provided by the distribution that are outdated compared to the latest
2863upstream version, like this:
2864
2865@example
2866$ guix refresh
2867gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
2868gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
2869@end example
2870
2871It does so by browsing each package's FTP directory and determining the
2872highest version number of the source tarballs
2873therein@footnote{Currently, this only works for GNU packages.}.
2874
2875When passed @code{--update}, it modifies distribution source files to
2876update the version numbers and source tarball hashes of those packages'
2877recipes (@pxref{Defining Packages}). This is achieved by downloading
2878each package's latest source tarball and its associated OpenPGP
2879signature, authenticating the downloaded tarball against its signature
2880using @command{gpg}, and finally computing its hash. When the public
2881key used to sign the tarball is missing from the user's keyring, an
2882attempt is made to automatically retrieve it from a public key server;
2883when it's successful, the key is added to the user's keyring; otherwise,
2884@command{guix refresh} reports an error.
2885
2886The following options are supported:
2887
2888@table @code
2889
2890@item --update
2891@itemx -u
2892Update distribution source files (package recipes) in place.
081145cf 2893@xref{Defining Packages}, for more information on package definitions.
37166310
LC
2894
2895@item --select=[@var{subset}]
2896@itemx -s @var{subset}
2897Select all the packages in @var{subset}, one of @code{core} or
2898@code{non-core}.
2899
2900The @code{core} subset refers to all the packages at the core of the
2901distribution---i.e., packages that are used to build ``everything
2902else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
2903changing one of these packages in the distribution entails a rebuild of
2904all the others. Thus, such updates are an inconvenience to users in
2905terms of build time or bandwidth used to achieve the upgrade.
2906
2907The @code{non-core} subset refers to the remaining packages. It is
2908typically useful in cases where an update of the core packages would be
2909inconvenient.
2910
2911@end table
2912
2913In addition, @command{guix refresh} can be passed one or more package
2914names, as in this example:
2915
2916@example
2917guix refresh -u emacs idutils
2918@end example
2919
2920@noindent
2921The command above specifically updates the @code{emacs} and
2922@code{idutils} packages. The @code{--select} option would have no
2923effect in this case.
2924
7d193ec3
EB
2925When considering whether to upgrade a package, it is sometimes
2926convenient to know which packages would be affected by the upgrade and
2927should be checked for compatibility. For this the following option may
2928be used when passing @command{guix refresh} one or more package names:
2929
2930@table @code
2931
2932@item --list-dependent
2933@itemx -l
2934List top-level dependent packages that would need to be rebuilt as a
2935result of upgrading one or more packages.
2936
2937@end table
2938
2939Be aware that the @code{--list-dependent} option only
2940@emph{approximates} the rebuilds that would be required as a result of
2941an upgrade. More rebuilds might be required under some circumstances.
2942
2943@example
7779ab61
LC
2944$ guix refresh --list-dependent flex
2945Building the following 120 packages would ensure 213 dependent packages are rebuilt:
2946hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
2947@end example
2948
2949The command above lists a set of packages that could be built to check
2950for compatibility with an upgraded @code{flex} package.
2951
f9230085
LC
2952The following options can be used to customize GnuPG operation:
2953
2954@table @code
2955
f9230085
LC
2956@item --gpg=@var{command}
2957Use @var{command} as the GnuPG 2.x command. @var{command} is searched
2958for in @code{$PATH}.
2959
2bc53ba9
LC
2960@item --key-download=@var{policy}
2961Handle missing OpenPGP keys according to @var{policy}, which may be one
2962of:
2963
2964@table @code
2965@item always
2966Always download missing OpenPGP keys from the key server, and add them
2967to the user's GnuPG keyring.
2968
2969@item never
2970Never try to download missing OpenPGP keys. Instead just bail out.
2971
2972@item interactive
2973When a package signed with an unknown OpenPGP key is encountered, ask
2974the user whether to download it or not. This is the default behavior.
2975@end table
2976
2977@item --key-server=@var{host}
2978Use @var{host} as the OpenPGP key server when importing a public key.
2979
f9230085
LC
2980@end table
2981
b4f5e0e8
CR
2982@node Invoking guix lint
2983@section Invoking @command{guix lint}
2984The @command{guix lint} is meant to help package developers avoid common
2985errors and use a consistent style. It runs a few checks on a given set of
2986packages in order to find common mistakes in their definitions.
2987
2988The general syntax is:
2989
2990@example
2991guix lint @var{options} @var{package}@dots{}
2992@end example
2993
2994If no package is given on the command line, then all packages are checked.
2995The @var{options} may be zero or more of the following:
2996
2997@table @code
2998
dd7c013d
CR
2999@item --checkers
3000@itemx -c
3001Only enable the checkers specified in a comma-separated list using the
3002names returned by @code{--list-checkers}.
3003
b4f5e0e8
CR
3004@item --list-checkers
3005@itemx -l
3006List and describe all the available checkers that will be run on packages
3007and exit.
3008
3009@end table
37166310 3010
372c4bbc
DT
3011@node Invoking guix environment
3012@section Invoking @command{guix environment}
3013
f5fd4fd2 3014@cindex reproducible build environments
372c4bbc
DT
3015The purpose of @command{guix environment} is to assist hackers in
3016creating reproducible development environments without polluting their
3017package profile. The @command{guix environment} tool takes one or more
3018packages, builds all of the necessary inputs, and creates a shell
3019environment to use them.
3020
3021The general syntax is:
3022
3023@example
3024guix environment @var{options} @var{package}@dots{}
3025@end example
3026
3027The following examples spawns a new shell that is capable of building
3028the GNU Guile source code:
3029
3030@example
3031guix environment guile
3032@end example
3033
3034If the specified packages are not built yet, @command{guix environment}
3035automatically builds them. The new shell's environment is an augmented
3036version of the environment that @command{guix environment} was run in.
3037It contains the necessary search paths for building the given package
3038added to the existing environment variables. To create a ``pure''
3039environment in which the original environment variables have been unset,
3040use the @code{--pure} option.
3041
3042Additionally, more than one package may be specified, in which case the
3043union of the inputs for the given packages are used. For example, the
3044command below spawns a shell where all of the dependencies of both Guile
3045and Emacs are available:
3046
3047@example
3048guix environment guile emacs
3049@end example
3050
3051Sometimes an interactive shell session is not desired. The
3052@code{--exec} option can be used to specify the command to run instead.
3053
3054@example
3055guix environment guile --exec=make
3056@end example
3057
3058The following options are available:
3059
3060@table @code
3061@item --expression=@var{expr}
3062@itemx -e @var{expr}
3063Create an environment for the package that @var{expr} evaluates to.
3064
3065@item --load=@var{file}
3066@itemx -l @var{file}
3067Create an environment for the package that the code within @var{file}
3068evaluates to.
3069
3070@item --exec=@var{command}
3071@item -E @var{command}
3072Execute @var{command} in the new environment.
3073
3074@item --pure
3075Unset existing environment variables when building the new environment.
3076This has the effect of creating an environment in which search paths
3077only contain package inputs.
3078
3079@item --search-paths
3080Display the environment variable definitions that make up the
3081environment.
3082@end table
3083
3084It also supports all of the common build options that @command{guix
3085build} supports (@pxref{Invoking guix build, common build options}).
3086
a1ba8475
LC
3087@c *********************************************************************
3088@node GNU Distribution
3089@chapter GNU Distribution
3090
3091Guix comes with a distribution of free software@footnote{The term
3092``free'' here refers to the
3093@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
c320011d 3094users of that software}.} that forms the basis of the GNU system. This
a1ba8475
LC
3095includes core GNU packages such as GNU libc, GCC, and Binutils, as well
3096as many GNU and non-GNU applications. The complete list of available
d03bb653
LC
3097packages can be browsed
3098@url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
3099running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
3100
3101@example
e49951eb 3102guix package --list-available
a1ba8475
LC
3103@end example
3104
401c53c4
LC
3105Our goal is to build a practical 100% free software distribution of
3106Linux-based and other variants of GNU, with a focus on the promotion and
3107tight integration of GNU components, and an emphasis on programs and
3108tools that help users exert that freedom.
3109
c320011d
LC
3110The GNU distribution is currently available on the following platforms:
3111
3112@table @code
3113
3114@item x86_64-linux
3115Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
3116
3117@item i686-linux
3118Intel 32-bit architecture (IA32), Linux-Libre kernel;
3119
3120@item mips64el-linux
3121little-endian 64-bit MIPS processors, specifically the Loongson series,
3122n32 application binary interface (ABI), and Linux-Libre kernel.
3123
3124@end table
3125
3126@noindent
3127For information on porting to other architectures or kernels,
3128@xref{Porting}.
3129
401c53c4 3130@menu
5af6de3e 3131* System Installation:: Installing the whole operating system.
cf4a9129 3132* System Configuration:: Configuring a GNU system.
91ef73d4 3133* Installing Debugging Files:: Feeding the debugger.
05962f29 3134* Security Updates:: Deploying security fixes quickly.
401c53c4 3135* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 3136* Packaging Guidelines:: Growing the distribution.
401c53c4 3137* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 3138* Porting:: Targeting another platform or kernel.
401c53c4
LC
3139@end menu
3140
3141Building this distribution is a cooperative effort, and you are invited
081145cf 3142to join! @xref{Contributing}, for information about how you can help.
401c53c4 3143
5af6de3e
LC
3144@node System Installation
3145@section System Installation
3146
3147This section explains how to install the complete GNU operating system
3148on a machine. The Guix package manager can also be installed on top of
6621cdb6 3149a running GNU/Linux system, @pxref{Installation}.
5af6de3e
LC
3150
3151@ifinfo
3152@c This paragraph is for people reading this from tty2 of the
3153@c installation image.
3154You're reading this documentation with an Info reader. For details on
3155how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 3156link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
3157@kbd{l} afterwards to come back here.
3158@end ifinfo
3159
8aaaae38
LC
3160@subsection Limitations
3161
3162As of version @value{VERSION}, GNU@tie{}Guix and the GNU system
3163distribution are alpha software. It may contain bugs and lack important
3164features. Thus, if you are looking for a stable production system that
3165respects your freedom as a computer user, a good solution at this point
3166is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
3167more established GNU/Linux distributions}. We hope you can soon switch
3168to the GNU system without fear, of course. In the meantime, you can
3169also keep using your distribution and try out the package manager on top
3170of it (@pxref{Installation}).
3171
3172Before you proceed with the installation, be aware of the following
3173noteworthy limitations applicable to version @value{VERSION}:
3174
3175@itemize
3176@item
3177The installation process does not include a graphical user interface and
3178requires familiarity with GNU/Linux (see the following subsections to
3179get a feel of what that means.)
3180
3181@item
3182The system does not yet provide graphical desktop environments such as
3183GNOME and KDE.
3184
3185@item
dbcb0ab1 3186Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
3187
3188@item
3189Few system services are currently supported out-of-the-box
3190(@pxref{Services}).
3191
3192@item
3193On the order of 1,000 packages are available, which means that you may
3194occasionally find that a useful package is missing.
3195@end itemize
3196
3197You've been warned. But more than a disclaimer, this is an invitation
3198to report issues (and success stories!), and join us in improving it.
3199@xref{Contributing}, for more info.
5af6de3e
LC
3200
3201@subsection USB Stick Installation
3202
3203An installation image for USB sticks can be downloaded from
3204@url{ftp://alpha.gnu.org/gnu/guix/gnu-usb-install-@value{VERSION}.@var{system}.xz},
3205where @var{system} is one of:
3206
3207@table @code
3208@item x86_64-linux
3209for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
3210
3211@item i686-linux
3212for a 32-bit GNU/Linux system on Intel-compatible CPUs.
3213@end table
3214
3215This image contains a single partition with the tools necessary for an
3216installation. It is meant to be copied @emph{as is} to a large-enough
3217USB stick.
3218
3219To copy the image to a USB stick, follow these steps:
3220
3221@enumerate
3222@item
3223Decompress the image using the @command{xz} command:
3224
3225@example
3226xz -d gnu-usb-install-@value{VERSION}.@var{system}.xz
3227@end example
3228
3229@item
3230Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
3231its device name. Assuming that USB stick is known as @file{/dev/sdX},
3232copy the image with:
3233
3234@example
445d6529 3235dd if=gnu-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
3236@end example
3237
3238Access to @file{/dev/sdX} usually requires root privileges.
3239@end enumerate
3240
3241Once this is done, you should be able to reboot the system and boot from
3242the USB stick. The latter usually requires you to get in the BIOS' boot
3243menu, where you can choose to boot from the USB stick.
3244
3245@subsection Preparing for Installation
3246
3247Once you have successfully booted the image on the USB stick, you should
3248end up with a root prompt. Several console TTYs are configured and can
3249be used to run commands as root. TTY2 shows this documentation,
3250browsable using the Info reader commands (@pxref{Help,,, info, Info: An
3251Introduction}).
3252
3253To install the system, you would:
3254
3255@enumerate
3256
3257@item
3258Configure the network, by running @command{dhclient eth0} (to get an
3259automatically assigned IP address from the wired network interface
3260controller), or using the @command{ifconfig} command.
3261
3262The system automatically loads drivers for your network interface
3263controllers.
3264
3265Setting up network access is almost always a requirement because the
3266image does not contain all the software and tools that may be needed.
3267
3268@item
3269Unless this has already been done, you must partition and format the
3270target partitions.
3271
7ab44369
LC
3272Preferably, assign partitions a label so that you can easily and
3273reliably refer to them in @code{file-system} declarations (@pxref{File
3274Systems}). This is typically done using the @code{-L} option of
3275@command{mkfs.ext4} and related commands.
3276
5af6de3e 3277The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
3278Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
3279encryption, and e2fsprogs, the suite of tools to manipulate
3280ext2/ext3/ext4 file systems.
5af6de3e 3281
83a17b62
LC
3282@item
3283Once that is done, mount the target root partition under @file{/mnt}.
3284
3285@item
3286Lastly, run @code{deco start cow-store /mnt}.
3287
3288This will make @file{/gnu/store} copy-on-write, such that packages added
3289to it during the installation phase will be written to the target disk
3290rather than kept in memory.
3291
5af6de3e
LC
3292@end enumerate
3293
5af6de3e
LC
3294
3295@subsection Proceeding with the Installation
3296
3297With the target partitions ready, you now have to edit a file and
3298provide the declaration of the operating system to be installed. To
3299that end, the installation system comes with two text editors: GNU nano
3300(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
3301It is better to store that file on the target root file system, say, as
3302@file{/mnt/etc/config.scm}.
3303
3304A minimal operating system configuration, with just the bare minimum and
1dac8566
LC
3305only a root account would look like this (on the installation system,
3306this example is available as @file{/etc/configuration-template.scm}):
5af6de3e
LC
3307
3308@example
931c132a 3309@include os-config.texi
5af6de3e
LC
3310@end example
3311
3312@noindent
3313For more information on @code{operating-system} declarations,
6621cdb6 3314@pxref{Using the Configuration System}.
5af6de3e
LC
3315
3316Once that is done, the new system must be initialized (remember that the
3317target root file system is mounted under @file{/mnt}):
3318
3319@example
3320guix system init /mnt/etc/config.scm /mnt
3321@end example
3322
3323@noindent
3324This will copy all the necessary files, and install GRUB on
3325@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 3326more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
3327downloads or builds of missing packages, which can take some time.
3328
3329Once that command has completed---and hopefully succeeded!---you can
ad14d9e7 3330run @command{reboot} and boot into the new system. Cross fingers, and
5af6de3e
LC
3331join us on @code{#guix} on the Freenode IRC network or on
3332@file{guix-devel@@gnu.org} to share your experience---good or not so
3333good.
3334
3335@subsection Building the Installation Image
3336
3337The installation image described above was built using the @command{guix
3338system} command, specifically:
3339
3340@example
3341guix system disk-image --image-size=800MiB gnu/system/install.scm
3342@end example
3343
3344@xref{Invoking guix system}, for more information. See
3345@file{gnu/system/install.scm} in the source tree for more information
3346about the installation image.
3347
cf4a9129
LC
3348@node System Configuration
3349@section System Configuration
b208a005 3350
cf4a9129
LC
3351@cindex system configuration
3352The GNU system supports a consistent whole-system configuration
3353mechanism. By that we mean that all aspects of the global system
3354configuration---such as the available system services, timezone and
3355locale settings, user accounts---are declared in a single place. Such
3356a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 3357
cf4a9129
LC
3358One of the advantages of putting all the system configuration under the
3359control of Guix is that it supports transactional system upgrades, and
3360makes it possible to roll-back to a previous system instantiation,
3361should something go wrong with the new one (@pxref{Features}). Another
3362one is that it makes it easy to replicate the exact same configuration
3363across different machines, or at different points in time, without
3364having to resort to additional administration tools layered on top of
3365the system's own tools.
3366@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 3367
cf4a9129
LC
3368This section describes this mechanism. First we focus on the system
3369administrator's viewpoint---explaining how the system is configured and
3370instantiated. Then we show how this mechanism can be extended, for
3371instance to support new system services.
91ef73d4 3372
cf4a9129
LC
3373@menu
3374* Using the Configuration System:: Customizing your GNU system.
7313a52e 3375* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 3376* File Systems:: Configuring file system mounts.
510f9d86 3377* Mapped Devices:: Block device extra processing.
cf4a9129
LC
3378* User Accounts:: Specifying user accounts.
3379* Services:: Specifying system services.
0ae8c15a 3380* Setuid Programs:: Programs running with root privileges.
fd1b1fa2 3381* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 3382* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
3383* Invoking guix system:: Instantiating a system configuration.
3384* Defining Services:: Adding new service definitions.
3385@end menu
91ef73d4 3386
cf4a9129
LC
3387@node Using the Configuration System
3388@subsection Using the Configuration System
64d76fa6 3389
cf4a9129
LC
3390The operating system is configured by providing an
3391@code{operating-system} declaration in a file that can then be passed to
3392the @command{guix system} command (@pxref{Invoking guix system}). A
3393simple setup, with the default system services, the default Linux-Libre
3394kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 3395
cf4a9129
LC
3396@findex operating-system
3397@lisp
3398(use-modules (gnu) ; for 'user-account', '%base-services', etc.
3399 (gnu packages emacs) ; for 'emacs'
3400 (gnu services ssh)) ; for 'lsh-service'
91ef73d4 3401
cf4a9129
LC
3402(operating-system
3403 (host-name "komputilo")
3404 (timezone "Europe/Paris")
3405 (locale "fr_FR.UTF-8")
3406 (bootloader (grub-configuration
3407 (device "/dev/sda")))
a69576ea 3408 (file-systems (cons (file-system
cf4a9129
LC
3409 (device "/dev/sda1") ; or partition label
3410 (mount-point "/")
a69576ea
LC
3411 (type "ext3"))
3412 %base-file-systems))
cf4a9129
LC
3413 (users (list (user-account
3414 (name "alice")
1c00f836 3415 (uid 1000) (group 100)
cf4a9129
LC
3416 (comment "Bob's sister")
3417 (home-directory "/home/alice"))))
3418 (packages (cons emacs %base-packages))
f4391bec 3419 (services (cons (lsh-service #:port 2222 #:root-login? #t)
cf4a9129
LC
3420 %base-services)))
3421@end lisp
401c53c4 3422
cf4a9129
LC
3423This example should be self-describing. Some of the fields defined
3424above, such as @code{host-name} and @code{bootloader}, are mandatory.
3425Others, such as @code{packages} and @code{services}, can be omitted, in
3426which case they get a default value.
e7f34eb0 3427
cf4a9129
LC
3428@vindex %base-packages
3429The @code{packages} field lists
3430packages that will be globally visible on the system, for all user
3431accounts---i.e., in every user's @code{PATH} environment variable---in
3432addition to the per-user profiles (@pxref{Invoking guix package}). The
3433@var{%base-packages} variable provides all the tools one would expect
3434for basic user and administrator tasks---including the GNU Core
3435Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
3436editor, @command{find}, @command{grep}, etc. The example above adds
3437Emacs to those, taken from the @code{(gnu packages emacs)} module
3438(@pxref{Package Modules}).
e7f34eb0 3439
cf4a9129
LC
3440@vindex %base-services
3441The @code{services} field lists @dfn{system services} to be made
3442available when the system starts (@pxref{Services}).
3443The @code{operating-system} declaration above specifies that, in
3444addition to the basic services, we want the @command{lshd} secure shell
3445daemon listening on port 2222, and allowing remote @code{root} logins
3446(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
3447@code{lsh-service} arranges so that @code{lshd} is started with the
3448right command-line options, possibly with supporting configuration files
7313a52e
LC
3449generated as needed (@pxref{Defining Services}). @xref{operating-system
3450Reference}, for details about the available @code{operating-system}
3451fields.
a1ba8475 3452
cf4a9129
LC
3453Assuming the above snippet is stored in the @file{my-system-config.scm}
3454file, the @command{guix system reconfigure my-system-config.scm} command
3455instantiates that configuration, and makes it the default GRUB boot
3456entry (@pxref{Invoking guix system}). The normal way to change the
3457system's configuration is by updating this file and re-running the
3458@command{guix system} command.
b81e1947 3459
cf4a9129
LC
3460At the Scheme level, the bulk of an @code{operating-system} declaration
3461is instantiated with the following monadic procedure (@pxref{The Store
3462Monad}):
b81e1947 3463
cf4a9129
LC
3464@deffn {Monadic Procedure} operating-system-derivation os
3465Return a derivation that builds @var{os}, an @code{operating-system}
3466object (@pxref{Derivations}).
b81e1947 3467
cf4a9129
LC
3468The output of the derivation is a single directory that refers to all
3469the packages, configuration files, and other supporting files needed to
3470instantiate @var{os}.
3471@end deffn
b81e1947 3472
7313a52e
LC
3473@node operating-system Reference
3474@subsection @code{operating-system} Reference
3475
3476This section summarizes all the options available in
3477@code{operating-system} declarations (@pxref{Using the Configuration
3478System}).
3479
3480@deftp {Data Type} operating-system
3481This is the data type representing an operating system configuration.
3482By that, we mean all the global system configuration, not per-user
3483configuration (@pxref{Using the Configuration System}).
3484
3485@table @asis
3486@item @code{kernel} (default: @var{linux-libre})
3487The package object of the operating system to use@footnote{Currently
3488only the Linux-libre kernel is supported. In the future, it will be
3489possible to use the GNU@tie{}Hurd.}.
3490
3491@item @code{bootloader}
88faf933 3492The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
3493
3494@item @code{initrd} (default: @code{base-initrd})
3495A two-argument monadic procedure that returns an initial RAM disk for
3496the Linux kernel. @xref{Initial RAM Disk}.
3497
f34c56be
LC
3498@item @code{firmware} (default: @var{%base-firmware})
3499@cindex firmware
3500List of firmware packages loadable by the operating system kernel.
3501
3502The default includes firmware needed for Atheros-based WiFi devices
3503(Linux-libre module @code{ath9k}.)
3504
7313a52e
LC
3505@item @code{host-name}
3506The host name.
3507
3508@item @code{hosts-file}
3509@cindex hosts file
3510A zero-argument monadic procedure that returns a text file for use as
3511@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
3512Reference Manual}). The default is to produce a file with entries for
3513@code{localhost} and @var{host-name}.
3514
3515@item @code{mapped-devices} (default: @code{'()})
3516A list of mapped devices. @xref{Mapped Devices}.
3517
3518@item @code{file-systems}
3519A list of file systems. @xref{File Systems}.
3520
3521@item @code{swap-devices} (default: @code{'()})
3522@cindex swap devices
3523A list of strings identifying devices to be used for ``swap space''
3524(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
3525For example, @code{'("/dev/sda3")}.
3526
3527@item @code{users} (default: @code{'()})
3528@itemx @code{groups} (default: @var{%base-groups})
3529List of user accounts and groups. @xref{User Accounts}.
3530
3531@item @code{skeletons} (default: @code{(default-skeletons)})
3532A monadic list of pairs of target file name and files. These are the
3533files that will be used as skeletons as new accounts are created.
3534
3535For instance, a valid value may look like this:
3536
3537@example
3538(mlet %store-monad ((bashrc (text-file "bashrc" "\
3539 export PATH=$HOME/.guix-profile/bin")))
3540 (return `((".bashrc" ,bashrc))))
3541@end example
3542
3543@item @code{issue} (default: @var{%default-issue})
3544A string denoting the contents of the @file{/etc/issue} file, which is
3545what displayed when users log in on a text console.
3546
3547@item @code{packages} (default: @var{%base-packages})
3548The set of packages installed in the global profile, which is accessible
3549at @file{/run/current-system/profile}.
3550
3551The default set includes core utilities, but it is good practice to
3552install non-core utilities in user profiles (@pxref{Invoking guix
3553package}).
3554
3555@item @code{timezone}
3556A timezone identifying string---e.g., @code{"Europe/Paris"}.
3557
3558@item @code{locale} (default: @code{"en_US.UTF-8"})
3559The name of the default locale (@pxref{Locales,,, libc, The GNU C
3560Library Reference Manual}).
3561
3562@item @code{services} (default: @var{%base-services})
3563A list of monadic values denoting system services. @xref{Services}.
3564
3565@item @code{pam-services} (default: @code{(base-pam-services)})
3566@cindex PAM
3567@cindex pluggable authentication modules
3568Linux @dfn{pluggable authentication module} (PAM) services.
3569@c FIXME: Add xref to PAM services section.
3570
3571@item @code{setuid-programs} (default: @var{%setuid-programs})
3572List of string-valued G-expressions denoting setuid programs.
3573@xref{Setuid Programs}.
3574
3575@item @code{sudoers} (default: @var{%sudoers-specification})
3576@cindex sudoers
3577The contents of the @file{/etc/sudoers} file as a string.
3578
3579This file specifies which users can use the @command{sudo} command, what
3580they are allowed to do, and what privileges they may gain. The default
3581is that only @code{root} and members of the @code{wheel} group may use
3582@code{sudo}.
3583
3584@end table
3585@end deftp
3586
cf4a9129
LC
3587@node File Systems
3588@subsection File Systems
b81e1947 3589
cf4a9129
LC
3590The list of file systems to be mounted is specified in the
3591@code{file-systems} field of the operating system's declaration
3592(@pxref{Using the Configuration System}). Each file system is declared
3593using the @code{file-system} form, like this:
b81e1947
LC
3594
3595@example
cf4a9129
LC
3596(file-system
3597 (mount-point "/home")
3598 (device "/dev/sda3")
3599 (type "ext4"))
b81e1947
LC
3600@end example
3601
cf4a9129
LC
3602As usual, some of the fields are mandatory---those shown in the example
3603above---while others can be omitted. These are described below.
b81e1947 3604
cf4a9129
LC
3605@deftp {Data Type} file-system
3606Objects of this type represent file systems to be mounted. They
3607contain the following members:
5ff3c4b8 3608
cf4a9129
LC
3609@table @asis
3610@item @code{type}
3611This is a string specifying the type of the file system---e.g.,
3612@code{"ext4"}.
5ff3c4b8 3613
cf4a9129
LC
3614@item @code{mount-point}
3615This designates the place where the file system is to be mounted.
b81e1947 3616
cf4a9129
LC
3617@item @code{device}
3618This names the ``source'' of the file system. By default it is the name
3619of a node under @file{/dev}, but its meaning depends on the @code{title}
3620field described below.
401c53c4 3621
cf4a9129
LC
3622@item @code{title} (default: @code{'device})
3623This is a symbol that specifies how the @code{device} field is to be
3624interpreted.
401c53c4 3625
cf4a9129
LC
3626When it is the symbol @code{device}, then the @code{device} field is
3627interpreted as a file name; when it is @code{label}, then @code{device}
3628is interpreted as a partition label name; when it is @code{uuid},
3629@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 3630
cf4a9129
LC
3631The @code{label} and @code{uuid} options offer a way to refer to disk
3632partitions without having to hard-code their actual device name.
da7cabd4 3633
cf4a9129
LC
3634@item @code{flags} (default: @code{'()})
3635This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
3636include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
3637access to special files), @code{no-suid} (ignore setuid and setgid
3638bits), and @code{no-exec} (disallow program execution.)
da7cabd4 3639
cf4a9129
LC
3640@item @code{options} (default: @code{#f})
3641This is either @code{#f}, or a string denoting mount options.
da7cabd4 3642
cf4a9129
LC
3643@item @code{needed-for-boot?} (default: @code{#f})
3644This Boolean value indicates whether the file system is needed when
3645booting. If that is true, then the file system is mounted when the
3646initial RAM disk (initrd) is loaded. This is always the case, for
3647instance, for the root file system.
da7cabd4 3648
cf4a9129
LC
3649@item @code{check?} (default: @code{#t})
3650This Boolean indicates whether the file system needs to be checked for
3651errors before being mounted.
f9cc8971 3652
4e469051
LC
3653@item @code{create-mount-point?} (default: @code{#f})
3654When true, the mount point is created if it does not exist yet.
3655
cf4a9129
LC
3656@end table
3657@end deftp
da7cabd4 3658
a69576ea
LC
3659The @code{(gnu system file-systems)} exports the following useful
3660variables.
3661
3662@defvr {Scheme Variable} %base-file-systems
3663These are essential file systems that are required on normal systems,
3664such as @var{%devtmpfs-file-system} (see below.) Operating system
3665declarations should always contain at least these.
3666@end defvr
3667
3668@defvr {Scheme Variable} %devtmpfs-file-system
3669The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
3670requirement for udev (@pxref{Base Services, @code{udev-service}}).
3671@end defvr
3672
7f239fd3
LC
3673@defvr {Scheme Variable} %pseudo-terminal-file-system
3674This is the file system to be mounted as @file{/dev/pts}. It supports
3675@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
3676functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
3677Manual}). Pseudo-terminals are used by terminal emulators such as
3678@command{xterm}.
3679@end defvr
3680
db17ae5c
LC
3681@defvr {Scheme Variable} %shared-memory-file-system
3682This file system is mounted as @file{/dev/shm} and is used to support
3683memory sharing across processes (@pxref{Memory-mapped I/O,
3684@code{shm_open},, libc, The GNU C Library Reference Manual}).
3685@end defvr
3686
a69576ea
LC
3687@defvr {Scheme Variable} %binary-format-file-system
3688The @code{binfmt_misc} file system, which allows handling of arbitrary
3689executable file types to be delegated to user space. This requires the
3690@code{binfmt.ko} kernel module to be loaded.
3691@end defvr
3692
3693@defvr {Scheme Variable} %fuse-control-file-system
3694The @code{fusectl} file system, which allows unprivileged users to mount
3695and unmount user-space FUSE file systems. This requires the
3696@code{fuse.ko} kernel module to be loaded.
3697@end defvr
3698
510f9d86
LC
3699@node Mapped Devices
3700@subsection Mapped Devices
3701
3702@cindex device mapping
3703@cindex mapped devices
3704The Linux kernel has a notion of @dfn{device mapping}: a block device,
3705such as a hard disk partition, can be @dfn{mapped} into another device,
3706with additional processing over the data that flows through
3707it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
3708concept of a ``mapped device'' and that of a file system: both boil down
3709to @emph{translating} input/output operations made on a file to
3710operations on its backing store. Thus, the Hurd implements mapped
3711devices, like file systems, using the generic @dfn{translator} mechanism
3712(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
3713typical example is encryption device mapping: all writes to the mapped
3714device are encrypted, and all reads are deciphered, transparently.
3715
3716Mapped devices are declared using the @code{mapped-device} form:
3717
3718@example
3719(mapped-device
3720 (source "/dev/sda3")
3721 (target "home")
3722 (type luks-device-mapping))
3723@end example
3724
3725@noindent
3726@cindex disk encryption
3727@cindex LUKS
3728This example specifies a mapping from @file{/dev/sda3} to
3729@file{/dev/mapper/home} using LUKS---the
3730@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
3731standard mechanism for disk encryption. The @file{/dev/mapper/home}
3732device can then be used as the @code{device} of a @code{file-system}
3733declaration (@pxref{File Systems}). The @code{mapped-device} form is
3734detailed below.
3735
3736@deftp {Data Type} mapped-device
3737Objects of this type represent device mappings that will be made when
3738the system boots up.
3739
3740@table @code
3741@item source
3742This string specifies the name of the block device to be mapped, such as
3743@code{"/dev/sda3"}.
3744
3745@item target
3746This string specifies the name of the mapping to be established. For
3747example, specifying @code{"my-partition"} will lead to the creation of
3748the @code{"/dev/mapper/my-partition"} device.
3749
3750@item type
3751This must be a @code{mapped-device-kind} object, which specifies how
3752@var{source} is mapped to @var{target}.
3753@end table
3754@end deftp
3755
3756@defvr {Scheme Variable} luks-device-mapping
3757This defines LUKS block device encryption using the @command{cryptsetup}
3758command, from the same-named package. This relies on the
3759@code{dm-crypt} Linux kernel module.
3760@end defvr
3761
cf4a9129
LC
3762@node User Accounts
3763@subsection User Accounts
ee85f3db 3764
cf4a9129 3765User accounts are specified with the @code{user-account} form:
ee85f3db 3766
cf4a9129
LC
3767@example
3768(user-account
3769 (name "alice")
3770 (group "users")
24e752c0
LC
3771 (supplementary-groups '("wheel" ;allow use of sudo, etc.
3772 "audio" ;sound card
3773 "video" ;video devices such as webcams
3774 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
3775 (comment "Bob's sister")
3776 (home-directory "/home/alice"))
3777@end example
25083588 3778
cf4a9129
LC
3779@deftp {Data Type} user-account
3780Objects of this type represent user accounts. The following members may
3781be specified:
ee85f3db 3782
cf4a9129
LC
3783@table @asis
3784@item @code{name}
3785The name of the user account.
ee85f3db 3786
cf4a9129
LC
3787@item @code{group}
3788This is the name (a string) or identifier (a number) of the user group
3789this account belongs to.
ee85f3db 3790
cf4a9129
LC
3791@item @code{supplementary-groups} (default: @code{'()})
3792Optionally, this can be defined as a list of group names that this
3793account belongs to.
ee85f3db 3794
cf4a9129
LC
3795@item @code{uid} (default: @code{#f})
3796This is the user ID for this account (a number), or @code{#f}. In the
3797latter case, a number is automatically chosen by the system when the
3798account is created.
ee85f3db 3799
cf4a9129
LC
3800@item @code{comment} (default: @code{""})
3801A comment about the account, such as the account's owner full name.
c8c871d1 3802
cf4a9129
LC
3803@item @code{home-directory}
3804This is the name of the home directory for the account.
ee85f3db 3805
cf4a9129
LC
3806@item @code{shell} (default: Bash)
3807This is a G-expression denoting the file name of a program to be used as
3808the shell (@pxref{G-Expressions}).
ee85f3db 3809
cf4a9129
LC
3810@item @code{system?} (default: @code{#f})
3811This Boolean value indicates whether the account is a ``system''
3812account. System accounts are sometimes treated specially; for instance,
3813graphical login managers do not list them.
ee85f3db 3814
cf4a9129 3815@item @code{password} (default: @code{#f})
eb59595c
LC
3816You would normally leave this field to @code{#f}, initialize user
3817passwords as @code{root} with the @command{passwd} command, and then let
3818users change it with @command{passwd}.
3819
3820If you @emph{do} want to have a preset password for an account, then
3821this field must contain the encrypted password, as a string.
5d1f1177
LC
3822@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
3823on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 3824Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 3825
cf4a9129
LC
3826@end table
3827@end deftp
ee85f3db 3828
cf4a9129 3829User group declarations are even simpler:
ee85f3db 3830
cf4a9129
LC
3831@example
3832(user-group (name "students"))
3833@end example
ee85f3db 3834
cf4a9129
LC
3835@deftp {Data Type} user-group
3836This type is for, well, user groups. There are just a few fields:
af8a56b8 3837
cf4a9129
LC
3838@table @asis
3839@item @code{name}
3840The group's name.
ee85f3db 3841
cf4a9129
LC
3842@item @code{id} (default: @code{#f})
3843The group identifier (a number). If @code{#f}, a new number is
3844automatically allocated when the group is created.
ee85f3db 3845
c8fa3426
LC
3846@item @code{system?} (default: @code{#f})
3847This Boolean value indicates whether the group is a ``system'' group.
3848System groups have low numerical IDs.
3849
cf4a9129
LC
3850@item @code{password} (default: @code{#f})
3851What, user groups can have a password? Well, apparently yes. Unless
3852@code{#f}, this field specifies the group's password.
ee85f3db 3853
cf4a9129
LC
3854@end table
3855@end deftp
401c53c4 3856
cf4a9129
LC
3857For convenience, a variable lists all the basic user groups one may
3858expect:
401c53c4 3859
cf4a9129
LC
3860@defvr {Scheme Variable} %base-groups
3861This is the list of basic user groups that users and/or packages expect
3862to be present on the system. This includes groups such as ``root'',
3863``wheel'', and ``users'', as well as groups used to control access to
3864specific devices such as ``audio'', ``disk'', and ``cdrom''.
3865@end defvr
401c53c4 3866
401c53c4 3867
cf4a9129
LC
3868@node Services
3869@subsection Services
401c53c4 3870
cf4a9129
LC
3871@cindex system services
3872An important part of preparing an @code{operating-system} declaration is
3873listing @dfn{system services} and their configuration (@pxref{Using the
3874Configuration System}). System services are typically daemons launched
3875when the system boots, or other actions needed at that time---e.g.,
3876configuring network access. They are managed by GNU@tie{}dmd
3877(@pxref{Introduction,,, dmd, GNU dmd Manual}).
401c53c4 3878
cf4a9129
LC
3879The following sections document the available services, starting with
3880the core services.
401c53c4 3881
cf4a9129
LC
3882@menu
3883* Base Services:: Essential system services.
3884* Networking Services:: Network setup, SSH daemon, etc.
3885* X Window:: Graphical display.
3886@end menu
401c53c4 3887
cf4a9129
LC
3888@node Base Services
3889@subsubsection Base Services
a1ba8475 3890
cf4a9129
LC
3891The @code{(gnu services base)} module provides definitions for the basic
3892services that one expects from the system. The services exported by
3893this module are listed below.
401c53c4 3894
cf4a9129
LC
3895@defvr {Scheme Variable} %base-services
3896This variable contains a list of basic services@footnote{Technically,
3897this is a list of monadic services. @xref{The Store Monad}.} one would
3898expect from the system: a login service (mingetty) on each tty, syslogd,
3899libc's name service cache daemon (nscd), the udev device manager, and
3900more.
401c53c4 3901
cf4a9129
LC
3902This is the default value of the @code{services} field of
3903@code{operating-system} declarations. Usually, when customizing a
3904system, you will want to append services to @var{%base-services}, like
3905this:
401c53c4 3906
cf4a9129 3907@example
fa1e31b8 3908(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
3909@end example
3910@end defvr
401c53c4 3911
cf4a9129
LC
3912@deffn {Monadic Procedure} host-name-service @var{name}
3913Return a service that sets the host name to @var{name}.
3914@end deffn
401c53c4 3915
cf4a9129
LC
3916@deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
3917 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
3918 [#:allow-empty-passwords? #f]
3919Return a service to run mingetty on @var{tty}.
401c53c4 3920
cf4a9129
LC
3921When @var{allow-empty-passwords?} is true, allow empty log-in password. When
3922@var{auto-login} is true, it must be a user name under which to log-in
3923automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
3924@var{auto-login}, in which case the user will have to press a key before the
3925login shell is launched.
401c53c4 3926
cf4a9129
LC
3927When true, @var{login-program} is a gexp or a monadic gexp denoting the name
3928of the log-in program (the default is the @code{login} program from the Shadow
3929tool suite.)
401c53c4 3930
cf4a9129
LC
3931@var{motd} is a monadic value containing a text file to use as
3932the ``message of the day''.
3933@end deffn
401c53c4 3934
cf4a9129
LC
3935@deffn {Monadic Procedure} nscd-service [#:glibc glibc]
3936Return a service that runs libc's name service cache daemon (nscd).
3937@end deffn
401c53c4 3938
cf4a9129
LC
3939@deffn {Monadic Procedure} syslog-service
3940Return a service that runs @code{syslogd} with reasonable default
3941settings.
3942@end deffn
401c53c4 3943
cf4a9129
LC
3944@deffn {Monadic Procedure} guix-service [#:guix guix] @
3945 [#:builder-group "guixbuild"] [#:build-accounts 10] @
3946 [#:authorize-hydra-key? #f] [#:use-substitutes? #t] @
3947 [#:extra-options '()]
3948Return a service that runs the build daemon from @var{guix}, and has
3949@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 3950
cf4a9129
LC
3951When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
3952provided by @var{guix} is authorized upon activation, meaning that substitutes
3953from @code{hydra.gnu.org} are used by default.
401c53c4 3954
cf4a9129
LC
3955If @var{use-substitutes?} is false, the daemon is run with
3956@option{--no-substitutes} (@pxref{Invoking guix-daemon,
3957@option{--no-substitutes}}).
401c53c4 3958
cf4a9129
LC
3959Finally, @var{extra-options} is a list of additional command-line options
3960passed to @command{guix-daemon}.
3961@end deffn
a1ba8475 3962
cf4a9129
LC
3963@deffn {Monadic Procedure} udev-service [#:udev udev]
3964Run @var{udev}, which populates the @file{/dev} directory dynamically.
3965@end deffn
401c53c4 3966
a69576ea 3967
cf4a9129
LC
3968@node Networking Services
3969@subsubsection Networking Services
401c53c4 3970
fa1e31b8 3971The @code{(gnu services networking)} module provides services to configure
cf4a9129 3972the network interface.
a1ba8475 3973
a023cca8
LC
3974@cindex DHCP, networking service
3975@deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
3976Return a service that runs @var{dhcp}, a Dynamic Host Configuration
3977Protocol (DHCP) client, on all the non-loopback network interfaces.
3978@end deffn
3979
cf4a9129
LC
3980@deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
3981 [#:gateway #f] [#:name-services @code{'()}]
3982Return a service that starts @var{interface} with address @var{ip}. If
3983@var{gateway} is true, it must be a string specifying the default network
3984gateway.
3985@end deffn
8b315a6d 3986
63854bcb
LC
3987@deffn {Monadic Procedure} ntp-service [#:ntp @var{ntp}] @
3988 [#:name-service @var{%ntp-servers}]
3989Return a service that runs the daemon from @var{ntp}, the
3990@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
3991keep the system clock synchronized with that of @var{servers}.
3992@end deffn
3993
3994@defvr {Scheme Variable} %ntp-servers
3995List of host names used as the default NTP servers.
3996@end defvr
3997
cf4a9129
LC
3998@deffn {Monadic Procedure} tor-service [#:tor tor]
3999Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 4000
cf4a9129
LC
4001The daemon runs with the default settings (in particular the default exit
4002policy) as the @code{tor} unprivileged user.
4003@end deffn
8b315a6d 4004
4627a464
LC
4005@deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
4006 [#:interface "127.0.0.1"] [#:port 6667] @
4007 [#:extra-settings ""]
4008Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
4009acts as a gateway between IRC and chat networks.
4010
4011The daemon will listen to the interface corresponding to the IP address
4012specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
4013local clients can connect, whereas @code{0.0.0.0} means that connections can
4014come from any networking interface.
4015
4016In addition, @var{extra-settings} specifies a string to append to the
4017configuration file.
4018@end deffn
4019
f4391bec 4020Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 4021
cf4a9129
LC
4022@deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
4023 [#:interfaces '()] [#:port-number 22] @
4024 [#:allow-empty-passwords? #f] [#:root-login? #f] @
4025 [#:syslog-output? #t] [#:x11-forwarding? #t] @
4026 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
4027 [public-key-authentication? #t] [#:initialize? #f]
4028Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
4029@var{host-key} must designate a file containing the host key, and readable
4030only by root.
72e25e35 4031
cf4a9129
LC
4032When @var{initialize?} is true, automatically create the seed and host key
4033upon service activation if they do not exist yet. This may take long and
4034require interaction.
8b315a6d 4035
20dd519c
LC
4036When @var{initialize?} is false, it is up to the user to initialize the
4037randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
4038a key pair with the private key stored in file @var{host-key} (@pxref{lshd
4039basics,,, lsh, LSH Manual}).
4040
cf4a9129
LC
4041When @var{interfaces} is empty, lshd listens for connections on all the
4042network interfaces; otherwise, @var{interfaces} must be a list of host names
4043or addresses.
9bf3c1a7 4044
20dd519c
LC
4045@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
4046passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 4047root.
4af2447e 4048
cf4a9129
LC
4049The other options should be self-descriptive.
4050@end deffn
4af2447e 4051
fa0c1d61
LC
4052@defvr {Scheme Variable} %facebook-host-aliases
4053This variable contains a string for use in @file{/etc/hosts}
4054(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
4055line contains a entry that maps a known server name of the Facebook
4056on-line service---e.g., @code{www.facebook.com}---to the local
4057host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
4058
4059This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
4060@code{operating-system} declaration (@pxref{operating-system Reference,
4061@file{/etc/hosts}}):
fa0c1d61
LC
4062
4063@example
4064(use-modules (gnu) (guix))
4065
4066(operating-system
4067 (host-name "mymachine")
4068 ;; ...
4069 (hosts-file
4070 ;; Create a /etc/hosts file with aliases for "localhost"
4071 ;; and "mymachine", as well as for Facebook servers.
4072 (text-file "hosts"
4073 (string-append (local-host-aliases host-name)
4074 %facebook-host-aliases))))
4075@end example
4076
4077This mechanism can prevent programs running locally, such as Web
4078browsers, from accessing Facebook.
4079@end defvr
4080
cf4a9129
LC
4081@node X Window
4082@subsubsection X Window
68ad877c 4083
cf4a9129
LC
4084Support for the X Window graphical display system---specifically
4085Xorg---is provided by the @code{(gnu services xorg)} module. Note that
4086there is no @code{xorg-service} procedure. Instead, the X server is
4087started by the @dfn{login manager}, currently SLiM.
4af2447e 4088
cf4a9129 4089@deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
4090 [#:auto-login? #f] [#:default-user ""] [#:startx] @
4091 [#:theme @var{%default-slim-theme}] @
4092 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
4093Return a service that spawns the SLiM graphical login manager, which in
4094turn starts the X display server with @var{startx}, a command as returned by
4095@code{xorg-start-command}.
4af2447e 4096
cf4a9129
LC
4097When @var{allow-empty-passwords?} is true, allow logins with an empty
4098password. When @var{auto-login?} is true, log in automatically as
4099@var{default-user}.
0ecc3bf3
LC
4100
4101If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
4102@var{theme} must be a gexp denoting the name of a directory containing the
4103theme to use. In that case, @var{theme-name} specifies the name of the
4104theme.
cf4a9129 4105@end deffn
4af2447e 4106
0ecc3bf3
LC
4107@defvr {Scheme Variable} %default-theme
4108@defvrx {Scheme Variable} %default-theme-name
4109The G-Expression denoting the default SLiM theme and its name.
4110@end defvr
4111
f703413e 4112@deffn {Monadic Procedure} xorg-start-command [#:guile] @
d2e59637 4113 [#:drivers '()] [#:resolutions '()] [#:xorg-server @var{xorg-server}]
f703413e
LC
4114Return a derivation that builds a @var{guile} script to start the X server
4115from @var{xorg-server}. Usually the X server is started by a login manager.
4116
4117@var{drivers} must be either the empty list, in which case Xorg chooses a
4118graphics driver automatically, or a list of driver names that will be tried in
4119this order---e.g., @code{("modesetting" "vesa")}.
d2e59637
LC
4120
4121Likewise, when @var{resolutions} is the empty list, Xorg chooses an
4122appropriate screen resolution; otherwise, it must be a list of
4123resolutions---e.g., @code{((1024 768) (640 480))}.
f703413e 4124@end deffn
4af2447e 4125
0ae8c15a
LC
4126@node Setuid Programs
4127@subsection Setuid Programs
4128
4129@cindex setuid programs
4130Some programs need to run with ``root'' privileges, even when they are
4131launched by unprivileged users. A notorious example is the
4132@command{passwd} programs, which can users can run to change their
4133password, and which requires write access to the @file{/etc/passwd} and
4134@file{/etc/shadow} files---something normally restricted to root, for
4135obvious security reasons. To address that, these executables are
4136@dfn{setuid-root}, meaning that they always run with root privileges
4137(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
4138for more info about the setuid mechanisms.)
4139
4140The store itself @emph{cannot} contain setuid programs: that would be a
4141security issue since any user on the system can write derivations that
4142populate the store (@pxref{The Store}). Thus, a different mechanism is
4143used: instead of changing the setuid bit directly on files that are in
4144the store, we let the system administrator @emph{declare} which programs
4145should be setuid root.
4146
4147The @code{setuid-programs} field of an @code{operating-system}
4148declaration contains a list of G-expressions denoting the names of
4149programs to be setuid-root (@pxref{Using the Configuration System}).
4150For instance, the @command{passwd} program, which is part of the Shadow
4151package, can be designated by this G-expression (@pxref{G-Expressions}):
4152
4153@example
4154#~(string-append #$shadow "/bin/passwd")
4155@end example
4156
4157A default set of setuid programs is defined by the
4158@code{%setuid-programs} variable of the @code{(gnu system)} module.
4159
4160@defvr {Scheme Variable} %setuid-programs
4161A list of G-expressions denoting common programs that are setuid-root.
4162
4163The list includes commands such as @command{passwd}, @command{ping},
4164@command{su}, and @command{sudo}.
4165@end defvr
4166
4167Under the hood, the actual setuid programs are created in the
4168@file{/run/setuid-programs} directory at system activation time. The
4169files in this directory refer to the ``real'' binaries, which are in the
4170store.
4171
4172
fd1b1fa2
LC
4173@node Initial RAM Disk
4174@subsection Initial RAM Disk
4175
4176@cindex initial RAM disk (initrd)
4177@cindex initrd (initial RAM disk)
4178For bootstrapping purposes, the Linux-Libre kernel is passed an
4179@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
4180root file system, as well as an initialization script. The latter is
4181responsible for mounting the real root file system, and for loading any
4182kernel modules that may be needed to achieve that.
4183
4184The @code{initrd} field of an @code{operating-system} declaration allows
4185you to specify which initrd you would like to use. The @code{(gnu
4186system linux-initrd)} module provides two ways to build an initrd: the
4187high-level @code{base-initrd} procedure, and the low-level
4188@code{expression->initrd} procedure.
4189
4190The @code{base-initrd} procedure is intended to cover most common uses.
4191For example, if you want to add a bunch of kernel modules to be loaded
4192at boot time, you can define the @code{initrd} field of the operating
4193system declaration like this:
4194
4195@example
52ac153e
LC
4196(initrd (lambda (file-systems . rest)
4197 (apply base-initrd file-systems
4198 #:extra-modules '("my.ko" "modules.ko")
4199 rest)))
fd1b1fa2
LC
4200@end example
4201
52ac153e
LC
4202The @code{base-initrd} procedure also handles common use cases that
4203involves using the system as a QEMU guest, or as a ``live'' system whose
4204root file system is volatile.
fd1b1fa2
LC
4205
4206@deffn {Monadic Procedure} base-initrd @var{file-systems} @
4207 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 4208 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
4209Return a monadic derivation that builds a generic initrd. @var{file-systems} is
4210a list of file-systems to be mounted by the initrd, possibly in addition to
4211the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
4212@var{mapped-devices} is a list of device mappings to realize before
4213@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
4214
4215When @var{qemu-networking?} is true, set up networking with the standard QEMU
4216parameters. When @var{virtio?} is true, load additional modules so the initrd can
4217be used as a QEMU guest with para-virtualized I/O drivers.
4218
4219When @var{volatile-root?} is true, the root file system is writable but any changes
4220to it are lost.
4221
4222The initrd is automatically populated with all the kernel modules necessary
4223for @var{file-systems} and for the given options. However, additional kernel
4224modules can be listed in @var{extra-modules}. They will be added to the initrd, and
4225loaded at boot time in the order in which they appear.
4226@end deffn
4227
4228Needless to say, the initrds we produce and use embed a
4229statically-linked Guile, and the initialization program is a Guile
4230program. That gives a lot of flexibility. The
4231@code{expression->initrd} procedure builds such an initrd, given the
4232program to run in that initrd.
4233
4234@deffn {Monadic Procedure} expression->initrd @var{exp} @
4235 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 4236 [#:modules '()]
fd1b1fa2
LC
4237Return a derivation that builds a Linux initrd (a gzipped cpio archive)
4238containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
4239upon booting. All the derivations referenced by @var{exp} are
4240automatically copied to the initrd.
fd1b1fa2 4241
42d10464
LC
4242@var{modules} is a list of Guile module names to be embedded in the
4243initrd.
fd1b1fa2
LC
4244@end deffn
4245
88faf933
LC
4246@node GRUB Configuration
4247@subsection GRUB Configuration
4248
4249@cindex GRUB
4250@cindex boot loader
4251
4252The operating system uses GNU@tie{}GRUB as its boot loader
4253(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
4254configured using @code{grub-configuration} declarations. This data type
4255is exported by the @code{(gnu system grub)} module, and described below.
4256
4257@deftp {Data Type} grub-configuration
4258The type of a GRUB configuration declaration.
4259
4260@table @asis
4261
4262@item @code{device}
4263This is a string denoting the boot device. It must be a device name
4264understood by the @command{grub-install} command, such as
4265@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
4266GNU GRUB Manual}).
4267
4268@item @code{menu-entries} (default: @code{()})
4269A possibly empty list of @code{menu-entry} objects (see below), denoting
4270entries to appear in the GRUB boot menu, in addition to the current
4271system entry and the entry pointing to previous system generations.
4272
4273@item @code{default-entry} (default: @code{0})
4274The index of the default boot menu entry. Index 0 is for the current
4275system's entry.
4276
4277@item @code{timeout} (default: @code{5})
4278The number of seconds to wait for keyboard input before booting. Set to
42790 to boot immediately, and to -1 to wait indefinitely.
4280
4281@item @code{theme} (default: @var{%default-theme})
4282The @code{grub-theme} object describing the theme to use.
4283@end table
4284
4285@end deftp
4286
4287Should you want to list additional boot menu entries @i{via} the
4288@code{menu-entries} field above, you will need to create them with the
4289@code{menu-entry} form:
4290
4291@deftp {Data Type} menu-entry
4292The type of an entry in the GRUB boot menu.
4293
4294@table @asis
4295
4296@item @code{label}
4297The label to show in the menu---e.g., @code{"GNU System"}.
4298
4299@item @code{linux}
4300The Linux kernel to boot.
4301
4302@item @code{linux-arguments} (default: @code{()})
4303The list of extra Linux kernel command-line arguments---e.g.,
4304@code{("console=ttyS0")}.
4305
4306@item @code{initrd}
4307A G-Expression or string denoting the file name of the initial RAM disk
4308to use (@pxref{G-Expressions}).
4309
4310@end table
4311@end deftp
4312
4313@c FIXME: Write documentation once it's stable.
4314Themes are created using the @code{grub-theme} form, which is not
4315documented yet.
4316
4317@defvr {Scheme Variable} %default-theme
4318This is the default GRUB theme used by the operating system, with a
4319fancy background image displaying the GNU and Guix logos.
4320@end defvr
4321
4322
cf4a9129
LC
4323@node Invoking guix system
4324@subsection Invoking @code{guix system}
0918e64a 4325
cf4a9129
LC
4326Once you have written an operating system declaration, as seen in the
4327previous section, it can be @dfn{instantiated} using the @command{guix
4328system} command. The synopsis is:
4af2447e 4329
cf4a9129
LC
4330@example
4331guix system @var{options}@dots{} @var{action} @var{file}
4332@end example
4af2447e 4333
cf4a9129
LC
4334@var{file} must be the name of a file containing an
4335@code{operating-system} declaration. @var{action} specifies how the
4336operating system is instantiate. Currently the following values are
4337supported:
4af2447e 4338
cf4a9129
LC
4339@table @code
4340@item reconfigure
4341Build the operating system described in @var{file}, activate it, and
4342switch to it@footnote{This action is usable only on systems already
4343running GNU.}.
4af2447e 4344
cf4a9129
LC
4345This effects all the configuration specified in @var{file}: user
4346accounts, system services, global package list, setuid programs, etc.
4af2447e 4347
cf4a9129
LC
4348It also adds a GRUB menu entry for the new OS configuration, and moves
4349entries for older configurations to a submenu---unless
4350@option{--no-grub} is passed.
4af2447e 4351
bf2479c7
LC
4352@c The paragraph below refers to the problem discussed at
4353@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
4354It is highly recommended to run @command{guix pull} once before you run
4355@command{guix system reconfigure} for the first time (@pxref{Invoking
4356guix pull}). Failing to do that you would see an older version of Guix
4357once @command{reconfigure} has completed.
4358
cf4a9129
LC
4359@item build
4360Build the operating system's derivation, which includes all the
4361configuration files and programs needed to boot and run the system.
4362This action does not actually install anything.
113daf62 4363
cf4a9129
LC
4364@item init
4365Populate the given directory with all the files necessary to run the
4366operating system specified in @var{file}. This is useful for first-time
4367installations of the GNU system. For instance:
113daf62
LC
4368
4369@example
cf4a9129 4370guix system init my-os-config.scm /mnt
113daf62
LC
4371@end example
4372
cf4a9129
LC
4373copies to @file{/mnt} all the store items required by the configuration
4374specified in @file{my-os-config.scm}. This includes configuration
4375files, packages, and so on. It also creates other essential files
4376needed for the system to operate correctly---e.g., the @file{/etc},
4377@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 4378
cf4a9129
LC
4379This command also installs GRUB on the device specified in
4380@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 4381
cf4a9129
LC
4382@item vm
4383@cindex virtual machine
0276f697 4384@cindex VM
cf4a9129
LC
4385Build a virtual machine that contain the operating system declared in
4386@var{file}, and return a script to run that virtual machine (VM).
810568b3 4387Arguments given to the script are passed as is to QEMU.
113daf62 4388
cf4a9129 4389The VM shares its store with the host system.
113daf62 4390
0276f697
LC
4391Additional file systems can be shared between the host and the VM using
4392the @code{--share} and @code{--expose} command-line options: the former
4393specifies a directory to be shared with write access, while the latter
4394provides read-only access to the shared directory.
4395
4396The example below creates a VM in which the user's home directory is
4397accessible read-only, and where the @file{/exchange} directory is a
4398read-write mapping of the host's @file{$HOME/tmp}:
4399
4400@example
4401guix system vm my-config.scm \
4402 --expose=$HOME --share=$HOME/tmp=/exchange
4403@end example
4404
6aa260af
LC
4405On GNU/Linux, the default is to boot directly to the kernel; this has
4406the advantage of requiring only a very tiny root disk image since the
4407host's store can then be mounted.
4408
4409The @code{--full-boot} option forces a complete boot sequence, starting
4410with the bootloader. This requires more disk space since a root image
4411containing at least the kernel, initrd, and bootloader data files must
4412be created. The @code{--image-size} option can be used to specify the
4413image's size.
ab11f0be 4414
cf4a9129
LC
4415@item vm-image
4416@itemx disk-image
4417Return a virtual machine or disk image of the operating system declared
4418in @var{file} that stands alone. Use the @option{--image-size} option
4419to specify the size of the image.
113daf62 4420
cf4a9129
LC
4421When using @code{vm-image}, the returned image is in qcow2 format, which
4422the QEMU emulator can efficiently use.
113daf62 4423
cf4a9129
LC
4424When using @code{disk-image}, a raw disk image is produced; it can be
4425copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
4426the device corresponding to a USB stick, one can copy the image on it
4427using the following command:
113daf62 4428
cf4a9129
LC
4429@example
4430# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
4431@end example
113daf62 4432
cf4a9129 4433@end table
113daf62 4434
cf4a9129
LC
4435@var{options} can contain any of the common build options provided by
4436@command{guix build} (@pxref{Invoking guix build}). In addition,
4437@var{options} can contain one of the following:
113daf62 4438
cf4a9129
LC
4439@table @option
4440@item --system=@var{system}
4441@itemx -s @var{system}
4442Attempt to build for @var{system} instead of the host's system type.
4443This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 4444
cf4a9129
LC
4445@item --image-size=@var{size}
4446For the @code{vm-image} and @code{disk-image} actions, create an image
4447of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
4448include a unit as a suffix (@pxref{Block size, size specifications,,
4449coreutils, GNU Coreutils}).
113daf62 4450@end table
113daf62 4451
cf4a9129
LC
4452Note that all the actions above, except @code{build} and @code{init},
4453rely on KVM support in the Linux-Libre kernel. Specifically, the
4454machine should have hardware virtualization support, the corresponding
4455KVM kernel module should be loaded, and the @file{/dev/kvm} device node
4456must exist and be readable and writable by the user and by the daemon's
4457build users.
8451a568 4458
cf4a9129
LC
4459@node Defining Services
4460@subsection Defining Services
8451a568 4461
cf4a9129
LC
4462The @code{(gnu services @dots{})} modules define several procedures that allow
4463users to declare the operating system's services (@pxref{Using the
4464Configuration System}). These procedures are @emph{monadic
4465procedures}---i.e., procedures that return a monadic value in the store
4466monad (@pxref{The Store Monad}). For examples of such procedures,
4467@xref{Services}.
8451a568 4468
cf4a9129
LC
4469@cindex service definition
4470The monadic value returned by those procedures is a @dfn{service
4471definition}---a structure as returned by the @code{service} form.
4472Service definitions specifies the inputs the service depends on, and an
4473expression to start and stop the service. Behind the scenes, service
4474definitions are ``translated'' into the form suitable for the
4475configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
4476dmd Manual}).
8451a568 4477
cf4a9129
LC
4478As an example, here is what the @code{nscd-service} procedure looks
4479like:
8451a568 4480
cf4a9129
LC
4481@lisp
4482(define (nscd-service)
4483 (with-monad %store-monad
4484 (return (service
4485 (documentation "Run libc's name service cache daemon.")
4486 (provision '(nscd))
4487 (activate #~(begin
4488 (use-modules (guix build utils))
4489 (mkdir-p "/var/run/nscd")))
4490 (start #~(make-forkexec-constructor
4491 (string-append #$glibc "/sbin/nscd")
4492 "-f" "/dev/null" "--foreground"))
4493 (stop #~(make-kill-destructor))
4494 (respawn? #f)))))
4495@end lisp
8451a568 4496
cf4a9129
LC
4497@noindent
4498The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
4499(@pxref{G-Expressions}). The @code{activate} field contains a script to
4500run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
4501directory exists before @command{nscd} is started.
8451a568 4502
cf4a9129
LC
4503The @code{start} and @code{stop} fields refer to dmd's facilities to
4504start and stop processes (@pxref{Service De- and Constructors,,, dmd,
4505GNU dmd Manual}). The @code{provision} field specifies the name under
4506which this service is known to dmd, and @code{documentation} specifies
4507on-line documentation. Thus, the commands @command{deco start ncsd},
4508@command{deco stop nscd}, and @command{deco doc nscd} will do what you
4509would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 4510
8451a568 4511
cf4a9129
LC
4512@node Installing Debugging Files
4513@section Installing Debugging Files
8451a568 4514
cf4a9129
LC
4515@cindex debugging files
4516Program binaries, as produced by the GCC compilers for instance, are
4517typically written in the ELF format, with a section containing
4518@dfn{debugging information}. Debugging information is what allows the
4519debugger, GDB, to map binary code to source code; it is required to
4520debug a compiled program in good conditions.
8451a568 4521
cf4a9129
LC
4522The problem with debugging information is that is takes up a fair amount
4523of disk space. For example, debugging information for the GNU C Library
4524weighs in at more than 60 MiB. Thus, as a user, keeping all the
4525debugging info of all the installed programs is usually not an option.
4526Yet, space savings should not come at the cost of an impediment to
4527debugging---especially in the GNU system, which should make it easier
4528for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 4529
cf4a9129
LC
4530Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
4531mechanism that allows users to get the best of both worlds: debugging
4532information can be stripped from the binaries and stored in separate
4533files. GDB is then able to load debugging information from those files,
4534when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
4535with GDB}).
8451a568 4536
cf4a9129
LC
4537The GNU distribution takes advantage of this by storing debugging
4538information in the @code{lib/debug} sub-directory of a separate package
4539output unimaginatively called @code{debug} (@pxref{Packages with
4540Multiple Outputs}). Users can choose to install the @code{debug} output
4541of a package when they need it. For instance, the following command
4542installs the debugging information for the GNU C Library and for GNU
4543Guile:
8451a568
LC
4544
4545@example
cf4a9129 4546guix package -i glibc:debug guile:debug
8451a568
LC
4547@end example
4548
cf4a9129
LC
4549GDB must then be told to look for debug files in the user's profile, by
4550setting the @code{debug-file-directory} variable (consider setting it
4551from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
4552GDB}):
8451a568 4553
cf4a9129
LC
4554@example
4555(gdb) set debug-file-directory ~/.guix-profile/lib/debug
4556@end example
8451a568 4557
cf4a9129
LC
4558From there on, GDB will pick up debugging information from the
4559@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 4560
cf4a9129
LC
4561In addition, you will most likely want GDB to be able to show the source
4562code being debugged. To do that, you will have to unpack the source
4563code of the package of interest (obtained with @code{guix build
4564--source}, @pxref{Invoking guix build}), and to point GDB to that source
4565directory using the @code{directory} command (@pxref{Source Path,
4566@code{directory},, gdb, Debugging with GDB}).
8451a568 4567
cf4a9129
LC
4568@c XXX: keep me up-to-date
4569The @code{debug} output mechanism in Guix is implemented by the
4570@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
4571opt-in---debugging information is available only for those packages
4572whose definition explicitly declares a @code{debug} output. This may be
4573changed to opt-out in the future, if our build farm servers can handle
4574the load. To check whether a package has a @code{debug} output, use
4575@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 4576
8451a568 4577
05962f29
LC
4578@node Security Updates
4579@section Security Updates
4580
843858b8
LC
4581@quotation Note
4582As of version @value{VERSION}, the feature described in this section is
4583experimental.
4584@end quotation
05962f29
LC
4585
4586@cindex security updates
4587Occasionally, important security vulnerabilities are discovered in core
4588software packages and must be patched. Guix follows a functional
4589package management discipline (@pxref{Introduction}), which implies
4590that, when a package is changed, @emph{every package that depends on it}
4591must be rebuilt. This can significantly slow down the deployment of
4592fixes in core packages such as libc or Bash, since basically the whole
4593distribution would need to be rebuilt. Using pre-built binaries helps
4594(@pxref{Substitutes}), but deployment may still take more time than
4595desired.
4596
4597@cindex grafts
4598To address that, Guix implements @dfn{grafts}, a mechanism that allows
4599for fast deployment of critical updates without the costs associated
4600with a whole-distribution rebuild. The idea is to rebuild only the
4601package that needs to be patched, and then to ``graft'' it onto packages
4602explicitly installed by the user and that were previously referring to
4603the original package. The cost of grafting is typically very low, and
4604order of magnitudes lower than a full rebuild of the dependency chain.
4605
4606@cindex replacements of packages, for grafts
4607For instance, suppose a security update needs to be applied to Bash.
4608Guix developers will provide a package definition for the ``fixed''
4609Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
4610Packages}). Then, the original package definition is augmented with a
4611@code{replacement} field pointing to the package containing the bug fix:
4612
4613@example
4614(define bash
4615 (package
4616 (name "bash")
4617 ;; @dots{}
4618 (replacement bash-fixed)))
4619@end example
4620
4621From there on, any package depending directly or indirectly on Bash that
4622is installed will automatically be ``rewritten'' to refer to
4623@var{bash-fixed} instead of @var{bash}. This grafting process takes
4624time proportional to the size of the package, but expect less than a
4625minute for an ``average'' package on a recent machine.
4626
4627Currently, the graft and the package it replaces (@var{bash-fixed} and
4628@var{bash} in the example above) must have the exact same @code{name}
4629and @code{version} fields. This restriction mostly comes from the fact
4630that grafting works by patching files, including binary files, directly.
4631Other restrictions may apply: for instance, when adding a graft to a
4632package providing a shared library, the original shared library and its
4633replacement must have the same @code{SONAME} and be binary-compatible.
4634
4635
cf4a9129
LC
4636@node Package Modules
4637@section Package Modules
8451a568 4638
cf4a9129
LC
4639From a programming viewpoint, the package definitions of the
4640GNU distribution are provided by Guile modules in the @code{(gnu packages
4641@dots{})} name space@footnote{Note that packages under the @code{(gnu
4642packages @dots{})} module name space are not necessarily ``GNU
4643packages''. This module naming scheme follows the usual Guile module
4644naming convention: @code{gnu} means that these modules are distributed
4645as part of the GNU system, and @code{packages} identifies modules that
4646define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
4647Reference Manual}). For instance, the @code{(gnu packages emacs)}
4648module exports a variable named @code{emacs}, which is bound to a
4649@code{<package>} object (@pxref{Defining Packages}).
113daf62 4650
300868ba 4651The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
4652automatically scanned for packages by the command-line tools. For
4653instance, when running @code{guix package -i emacs}, all the @code{(gnu
4654packages @dots{})} modules are scanned until one that exports a package
4655object whose name is @code{emacs} is found. This package search
4656facility is implemented in the @code{(gnu packages)} module.
113daf62 4657
300868ba 4658@cindex customization, of packages
8689901f 4659@cindex package module search path
cf4a9129 4660Users can store package definitions in modules with different
300868ba
LC
4661names---e.g., @code{(my-packages emacs)}. These package definitions
4662will not be visible by default. Thus, users can invoke commands such as
4663@command{guix package} and @command{guix build} have to be used with the
4664@code{-e} option so that they know where to find the package, or use the
4665@code{-L} option of these commands to make those modules visible
8689901f
LC
4666(@pxref{Invoking guix build, @code{--load-path}}), or define the
4667@code{GUIX_PACKAGE_PATH} environment variable. This environment
4668variable makes it easy to extend or customize the distribution and is
4669honored by all the user interfaces.
4670
4671@defvr {Environment Variable} GUIX_PACKAGE_PATH
4672This is a colon-separated list of directories to search for package
4673modules. Directories listed in this variable take precedence over the
4674distribution's own modules.
4675@end defvr
ef5dd60a 4676
cf4a9129
LC
4677The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
4678each package is built based solely on other packages in the
4679distribution. The root of this dependency graph is a small set of
4680@dfn{bootstrap binaries}, provided by the @code{(gnu packages
4681bootstrap)} module. For more information on bootstrapping,
081145cf 4682@pxref{Bootstrapping}.
ef5dd60a 4683
cf4a9129
LC
4684@node Packaging Guidelines
4685@section Packaging Guidelines
ef5dd60a 4686
cf4a9129
LC
4687The GNU distribution is nascent and may well lack some of your favorite
4688packages. This section describes how you can help make the distribution
4689grow. @xref{Contributing}, for additional information on how you can
4690help.
ef5dd60a 4691
cf4a9129
LC
4692Free software packages are usually distributed in the form of
4693@dfn{source code tarballs}---typically @file{tar.gz} files that contain
4694all the source files. Adding a package to the distribution means
4695essentially two things: adding a @dfn{recipe} that describes how to
4696build the package, including a list of other packages required to build
4697it, and adding @dfn{package meta-data} along with that recipe, such as a
4698description and licensing information.
ef5dd60a 4699
cf4a9129
LC
4700In Guix all this information is embodied in @dfn{package definitions}.
4701Package definitions provide a high-level view of the package. They are
4702written using the syntax of the Scheme programming language; in fact,
4703for each package we define a variable bound to the package definition,
4704and export that variable from a module (@pxref{Package Modules}).
4705However, in-depth Scheme knowledge is @emph{not} a prerequisite for
4706creating packages. For more information on package definitions,
081145cf 4707@pxref{Defining Packages}.
ef5dd60a 4708
cf4a9129
LC
4709Once a package definition is in place, stored in a file in the Guix
4710source tree, it can be tested using the @command{guix build} command
4711(@pxref{Invoking guix build}). For example, assuming the new package is
4712called @code{gnew}, you may run this command from the Guix build tree:
ef5dd60a
LC
4713
4714@example
cf4a9129 4715./pre-inst-env guix build gnew --keep-failed
ef5dd60a 4716@end example
ef5dd60a 4717
cf4a9129
LC
4718Using @code{--keep-failed} makes it easier to debug build failures since
4719it provides access to the failed build tree. Another useful
4720command-line option when debugging is @code{--log-file}, to access the
4721build log.
ef5dd60a 4722
cf4a9129
LC
4723If the package is unknown to the @command{guix} command, it may be that
4724the source file contains a syntax error, or lacks a @code{define-public}
4725clause to export the package variable. To figure it out, you may load
4726the module from Guile to get more information about the actual error:
ef5dd60a 4727
cf4a9129
LC
4728@example
4729./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
4730@end example
ef5dd60a 4731
cf4a9129
LC
4732Once your package builds correctly, please send us a patch
4733(@pxref{Contributing}). Well, if you need help, we will be happy to
4734help you too. Once the patch is committed in the Guix repository, the
4735new package automatically gets built on the supported platforms by
2b1cee21 4736@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 4737system}.
ef5dd60a 4738
cf4a9129
LC
4739@cindex substituter
4740Users can obtain the new package definition simply by running
4741@command{guix pull} (@pxref{Invoking guix pull}). When
4742@code{hydra.gnu.org} is done building the package, installing the
4743package automatically downloads binaries from there
4744(@pxref{Substitutes}). The only place where human intervention is
4745needed is to review and apply the patch.
ef5dd60a 4746
ef5dd60a 4747
cf4a9129
LC
4748@menu
4749* Software Freedom:: What may go into the distribution.
4750* Package Naming:: What's in a name?
4751* Version Numbers:: When the name is not enough.
4752* Python Modules:: Taming the snake.
4753* Perl Modules:: Little pearls.
7fec52b7 4754* Fonts:: Fond of fonts.
cf4a9129 4755@end menu
ef5dd60a 4756
cf4a9129
LC
4757@node Software Freedom
4758@subsection Software Freedom
ef5dd60a 4759
cf4a9129 4760@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 4761
cf4a9129
LC
4762The GNU operating system has been developed so that users can have
4763freedom in their computing. GNU is @dfn{free software}, meaning that
4764users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
4765essential freedoms}: to run the program, to study and change the program
4766in source code form, to redistribute exact copies, and to distribute
4767modified versions. Packages found in the GNU distribution provide only
4768software that conveys these four freedoms.
c11a6eb1 4769
cf4a9129
LC
4770In addition, the GNU distribution follow the
4771@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
4772software distribution guidelines}. Among other things, these guidelines
4773reject non-free firmware, recommendations of non-free software, and
4774discuss ways to deal with trademarks and patents.
ef5dd60a 4775
cf4a9129
LC
4776Some packages contain a small and optional subset that violates the
4777above guidelines, for instance because this subset is itself non-free
4778code. When that happens, the offending items are removed with
4779appropriate patches or code snippets in the package definition's
4780@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
4781build --source} returns the ``freed'' source rather than the unmodified
4782upstream source.
ef5dd60a 4783
ef5dd60a 4784
cf4a9129
LC
4785@node Package Naming
4786@subsection Package Naming
ef5dd60a 4787
cf4a9129
LC
4788A package has actually two names associated with it:
4789First, there is the name of the @emph{Scheme variable}, the one following
4790@code{define-public}. By this name, the package can be made known in the
4791Scheme code, for instance as input to another package. Second, there is
4792the string in the @code{name} field of a package definition. This name
4793is used by package management commands such as
4794@command{guix package} and @command{guix build}.
ef5dd60a 4795
cf4a9129
LC
4796Both are usually the same and correspond to the lowercase conversion of
4797the project name chosen upstream, with underscores replaced with
4798hyphens. For instance, GNUnet is available as @code{gnunet}, and
4799SDL_net as @code{sdl-net}.
927097ef 4800
cf4a9129 4801We do not add @code{lib} prefixes for library packages, unless these are
081145cf 4802already part of the official project name. But @pxref{Python
cf4a9129
LC
4803Modules} and @ref{Perl Modules} for special rules concerning modules for
4804the Python and Perl languages.
927097ef 4805
7fec52b7
AE
4806Font package names are handled differently, @pxref {Fonts}.
4807
ef5dd60a 4808
cf4a9129
LC
4809@node Version Numbers
4810@subsection Version Numbers
ef5dd60a 4811
cf4a9129
LC
4812We usually package only the latest version of a given free software
4813project. But sometimes, for instance for incompatible library versions,
4814two (or more) versions of the same package are needed. These require
4815different Scheme variable names. We use the name as defined
4816in @ref{Package Naming}
4817for the most recent version; previous versions use the same name, suffixed
4818by @code{-} and the smallest prefix of the version number that may
4819distinguish the two versions.
ef5dd60a 4820
cf4a9129
LC
4821The name inside the package definition is the same for all versions of a
4822package and does not contain any version number.
ef5dd60a 4823
cf4a9129 4824For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 4825
cf4a9129
LC
4826@example
4827(define-public gtk+
4828 (package
4829 (name "gtk+")
4830 (version "3.9.12")
4831 ...))
4832(define-public gtk+-2
4833 (package
4834 (name "gtk+")
4835 (version "2.24.20")
4836 ...))
4837@end example
4838If we also wanted GTK+ 3.8.2, this would be packaged as
4839@example
4840(define-public gtk+-3.8
4841 (package
4842 (name "gtk+")
4843 (version "3.8.2")
4844 ...))
4845@end example
ef5dd60a 4846
ef5dd60a 4847
cf4a9129
LC
4848@node Python Modules
4849@subsection Python Modules
ef5dd60a 4850
cf4a9129
LC
4851We currently package Python 2 and Python 3, under the Scheme variable names
4852@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
4853To avoid confusion and naming clashes with other programming languages, it
4854seems desirable that the name of a package for a Python module contains
4855the word @code{python}.
ef5dd60a 4856
cf4a9129
LC
4857Some modules are compatible with only one version of Python, others with both.
4858If the package Foo compiles only with Python 3, we name it
4859@code{python-foo}; if it compiles only with Python 2, we name it
4860@code{python2-foo}. If it is compatible with both versions, we create two
4861packages with the corresponding names.
ef5dd60a 4862
cf4a9129
LC
4863If a project already contains the word @code{python}, we drop this;
4864for instance, the module python-dateutil is packaged under the names
4865@code{python-dateutil} and @code{python2-dateutil}.
113daf62 4866
523e4896 4867
cf4a9129
LC
4868@node Perl Modules
4869@subsection Perl Modules
523e4896 4870
cf4a9129
LC
4871Perl programs standing for themselves are named as any other package,
4872using the lowercase upstream name.
4873For Perl packages containing a single class, we use the lowercase class name,
4874replace all occurrences of @code{::} by dashes and prepend the prefix
4875@code{perl-}.
4876So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
4877Modules containing several classes keep their lowercase upstream name and
4878are also prepended by @code{perl-}. Such modules tend to have the word
4879@code{perl} somewhere in their name, which gets dropped in favor of the
4880prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 4881
523e4896 4882
7fec52b7
AE
4883@node Fonts
4884@subsection Fonts
4885
4886For fonts that are in general not installed by a user for typesetting
4887purposes, or that are distributed as part of a larger software package,
4888we rely on the general packaging rules for software; for instance, this
4889applies to the fonts delivered as part of the X.Org system or fonts that
4890are part of TeX Live.
4891
4892To make it easier for a user to search for fonts, names for other packages
4893containing only fonts are constructed as follows, independently of the
4894upstream package name.
4895
4896The name of a package containing only one font family starts with
4897@code{font-}; it is followed by the foundry name and a dash @code{-}
4898if the foundry is known, and the font family name, in which spaces are
4899replaced by dashes (and as usual, all upper case letters are transformed
4900to lower case).
4901For example, the Gentium font family by SIL is packaged under the name
4902@code{font-sil-gentium}.
4903
4904For a package containing several font families, the name of the collection
4905is used in the place of the font family name.
4906For instance, the Liberation fonts consist of three families,
4907Liberation Sans, Liberation Serif and Liberation Mono.
4908These could be packaged separately under the names
4909@code{font-liberation-sans} and so on; but as they are distributed together
4910under a common name, we prefer to package them together as
4911@code{font-liberation}.
4912
4913In the case where several formats of the same font family or font collection
4914are packaged separately, a short form of the format, prepended by a dash,
4915is added to the package name. We use @code{-ttf} for TrueType fonts,
4916@code {-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
4917fonts.
4918
4919
b25937e3 4920
cf4a9129
LC
4921@node Bootstrapping
4922@section Bootstrapping
b25937e3 4923
cf4a9129 4924@c Adapted from the ELS 2013 paper.
b25937e3 4925
cf4a9129 4926@cindex bootstrapping
7889394e 4927
cf4a9129
LC
4928Bootstrapping in our context refers to how the distribution gets built
4929``from nothing''. Remember that the build environment of a derivation
4930contains nothing but its declared inputs (@pxref{Introduction}). So
4931there's an obvious chicken-and-egg problem: how does the first package
4932get built? How does the first compiler get compiled? Note that this is
4933a question of interest only to the curious hacker, not to the regular
4934user, so you can shamelessly skip this section if you consider yourself
4935a ``regular user''.
72b9d60d 4936
cf4a9129
LC
4937@cindex bootstrap binaries
4938The GNU system is primarily made of C code, with libc at its core. The
4939GNU build system itself assumes the availability of a Bourne shell and
4940command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
4941`grep'. Furthermore, build programs---programs that run
4942@code{./configure}, @code{make}, etc.---are written in Guile Scheme
4943(@pxref{Derivations}). Consequently, to be able to build anything at
4944all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
4945Binutils, libc, and the other packages mentioned above---the
4946@dfn{bootstrap binaries}.
72b9d60d 4947
cf4a9129
LC
4948These bootstrap binaries are ``taken for granted'', though we can also
4949re-create them if needed (more on that later).
72b9d60d 4950
cf4a9129 4951@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 4952
cf4a9129
LC
4953@c As of Emacs 24.3, Info-mode displays the image, but since it's a
4954@c large image, it's hard to scroll. Oh well.
4955@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 4956
cf4a9129
LC
4957The figure above shows the very beginning of the dependency graph of the
4958distribution, corresponding to the package definitions of the @code{(gnu
4959packages bootstrap)} module. At this level of detail, things are
4960slightly complex. First, Guile itself consists of an ELF executable,
4961along with many source and compiled Scheme files that are dynamically
4962loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
4963tarball shown in this graph. This tarball is part of Guix's ``source''
4964distribution, and gets inserted into the store with @code{add-to-store}
4965(@pxref{The Store}).
2e7b5cea 4966
cf4a9129
LC
4967But how do we write a derivation that unpacks this tarball and adds it
4968to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
4969derivation---the first one that gets built---uses @code{bash} as its
4970builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
4971@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
4972@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
4973the Guix source distribution, whose sole purpose is to allow the Guile
4974tarball to be unpacked.
fb729425 4975
cf4a9129
LC
4976Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
4977Guile that can be used to run subsequent build programs. Its first task
4978is to download tarballs containing the other pre-built binaries---this
4979is what the @code{.tar.xz.drv} derivations do. Guix modules such as
4980@code{ftp-client.scm} are used for this purpose. The
4981@code{module-import.drv} derivations import those modules in a directory
4982in the store, using the original layout. The
4983@code{module-import-compiled.drv} derivations compile those modules, and
4984write them in an output directory with the right layout. This
4985corresponds to the @code{#:modules} argument of
4986@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 4987
cf4a9129
LC
4988Finally, the various tarballs are unpacked by the
4989derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
4990etc., at which point we have a working C tool chain.
fb729425 4991
fb729425 4992
cf4a9129 4993@unnumberedsubsec Building the Build Tools
523e4896 4994
cf4a9129
LC
4995@c TODO: Add a package-level dependency graph generated from (gnu
4996@c packages base).
df2ce343 4997
cf4a9129
LC
4998Bootstrapping is complete when we have a full tool chain that does not
4999depend on the pre-built bootstrap tools discussed above. This
5000no-dependency requirement is verified by checking whether the files of
5001the final tool chain contain references to the @file{/gnu/store}
5002directories of the bootstrap inputs. The process that leads to this
5003``final'' tool chain is described by the package definitions found in
5004the @code{(gnu packages base)} module.
df2ce343 5005
cf4a9129
LC
5006@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
5007The first tool that gets built with the bootstrap binaries is
5008GNU Make, which is a prerequisite for all the following packages.
5009From there Findutils and Diffutils get built.
523e4896 5010
cf4a9129
LC
5011Then come the first-stage Binutils and GCC, built as pseudo cross
5012tools---i.e., with @code{--target} equal to @code{--host}. They are
5013used to build libc. Thanks to this cross-build trick, this libc is
5014guaranteed not to hold any reference to the initial tool chain.
4af2447e 5015
cf4a9129
LC
5016From there the final Binutils and GCC are built. GCC uses @code{ld}
5017from the final Binutils, and links programs against the just-built libc.
5018This tool chain is used to build the other packages used by Guix and by
5019the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 5020
cf4a9129
LC
5021And voilà! At this point we have the complete set of build tools that
5022the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
5023variable of the @code{(gnu packages commencement)} module, and are
5024implicitly used by any package that uses @code{gnu-build-system}
5025(@pxref{Defining Packages}).
4af2447e 5026
4af2447e 5027
cf4a9129 5028@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 5029
cf4a9129
LC
5030Because the final tool chain does not depend on the bootstrap binaries,
5031those rarely need to be updated. Nevertheless, it is useful to have an
5032automated way to produce them, should an update occur, and this is what
5033the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 5034
cf4a9129
LC
5035The following command builds the tarballs containing the bootstrap
5036binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
5037of Coreutils and other basic command-line tools):
4b2615e1 5038
cf4a9129
LC
5039@example
5040guix build bootstrap-tarballs
5041@end example
5042
5043The generated tarballs are those that should be referred to in the
5044@code{(gnu packages bootstrap)} module mentioned at the beginning of
5045this section.
5046
5047Still here? Then perhaps by now you've started to wonder: when do we
5048reach a fixed point? That is an interesting question! The answer is
5049unknown, but if you would like to investigate further (and have
5050significant computational and storage resources to do so), then let us
5051know.
5052
5053@node Porting
5054@section Porting to a New Platform
5055
5056As discussed above, the GNU distribution is self-contained, and
5057self-containment is achieved by relying on pre-built ``bootstrap
5058binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
5059operating system kernel, CPU architecture, and application binary
5060interface (ABI). Thus, to port the distribution to a platform that is
5061not yet supported, one must build those bootstrap binaries, and update
5062the @code{(gnu packages bootstrap)} module to use them on that platform.
5063
5064Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
5065When everything goes well, and assuming the GNU tool chain supports the
5066target platform, this can be as simple as running a command like this
5067one:
5068
5069@example
5070guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
5071@end example
5072
5073Once these are built, the @code{(gnu packages bootstrap)} module needs
5074to be updated to refer to these binaries on the target platform. In
5075addition, the @code{glibc-dynamic-linker} procedure in that module must
5076be augmented to return the right file name for libc's dynamic linker on
5077that platform; likewise, @code{system->linux-architecture} in @code{(gnu
5078packages linux)} must be taught about the new platform.
5079
5080In practice, there may be some complications. First, it may be that the
5081extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
5082above) is not recognized by all the GNU tools. Typically, glibc
5083recognizes some of these, whereas GCC uses an extra @code{--with-abi}
5084configure flag (see @code{gcc.scm} for examples of how to handle this).
5085Second, some of the required packages could fail to build for that
5086platform. Lastly, the generated binaries could be broken for some
5087reason.
4af2447e
LC
5088
5089
9bf3c1a7
LC
5090@c *********************************************************************
5091@node Contributing
5092@chapter Contributing
5093
5094This project is a cooperative effort, and we need your help to make it
5ff3c4b8
PAR
5095grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
5096@code{#guix} on the Freenode IRC network. We welcome ideas, bug
5097reports, patches, and anything that may be helpful to the project. We
5098particularly welcome help on packaging (@pxref{Packaging Guidelines}).
a1ba8475 5099
9bf3c1a7
LC
5100Please see the
5101@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
5102@file{HACKING} file} that comes with the Guix source code for practical
5103details about contributions.
5104
c78bd12b 5105
568717fd
LC
5106@c *********************************************************************
5107@node Acknowledgments
5108@chapter Acknowledgments
5109
5110Guix is based on the Nix package manager, which was designed and
4c7ac9aa
LC
5111implemented by Eelco Dolstra, with contributions from other people (see
5112the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
5113management, and promoted unprecedented features, such as transactional
5114package upgrades and rollbacks, per-user profiles, and referentially
5115transparent build processes. Without this work, Guix would not exist.
5116
5117The Nix-based software distributions, Nixpkgs and NixOS, have also been
5118an inspiration for Guix.
5119
4c7ac9aa
LC
5120GNU@tie{}Guix itself is a collective work with contributions from a
5121number of people. See the @file{AUTHORS} file in Guix for more
5122information on these fine people. The @file{THANKS} file lists people
5123who have helped by reporting bugs, taking care of the infrastructure,
5124providing artwork and themes, making suggestions, and more---thank you!
5125
5126
568717fd
LC
5127@c *********************************************************************
5128@node GNU Free Documentation License
5129@appendix GNU Free Documentation License
5130
5131@include fdl-1.3.texi
5132
5133@c *********************************************************************
5134@node Concept Index
5135@unnumbered Concept Index
5136@printindex cp
5137
a85b83d2
LC
5138@node Programming Index
5139@unnumbered Programming Index
5140@syncodeindex tp fn
5141@syncodeindex vr fn
568717fd
LC
5142@printindex fn
5143
5144@bye
5145
5146@c Local Variables:
5147@c ispell-local-dictionary: "american";
5148@c End: