gnu: Add ruby.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
425b0bfc 13Copyright @copyright{} 2012, 2013, 2014 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
7df7a74e
NK
15Copyright @copyright{} 2013 Nikita Karetnikov
16
17Permission is granted to copy, distribute and/or modify this document
18under the terms of the GNU Free Documentation License, Version 1.3 or
19any later version published by the Free Software Foundation; with no
20Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
21copy of the license is included in the section entitled ``GNU Free
22Documentation License''.
23@end copying
568717fd 24
eeaf4427 25@dircategory Package management
568717fd
LC
26@direntry
27* guix: (guix). Guix, the functional package manager.
e49951eb 28* guix package: (guix)Invoking guix package
eeaf4427 29 Managing packages with Guix.
e49951eb 30* guix build: (guix)Invoking guix build
568717fd 31 Building packages with Guix.
054e8576
LC
32* guix system: (guix)Invoking guix system
33 Managing the operating system configuration.
568717fd 34@end direntry
568717fd
LC
35
36@titlepage
7730d112
LC
37@title GNU Guix Reference Manual
38@subtitle Using the GNU Guix Functional Package Manager
568717fd 39@author Ludovic Courtès
da7cabd4 40@author Andreas Enge
acc08466 41@author Nikita Karetnikov
568717fd
LC
42
43@page
44@vskip 0pt plus 1filll
45Edition @value{EDITION} @*
46@value{UPDATED} @*
47
7df7a74e 48@insertcopying
568717fd
LC
49@end titlepage
50
568717fd
LC
51@contents
52
53@c *********************************************************************
54@node Top
f8348b91 55@top GNU Guix
568717fd 56
f8348b91
LC
57This document describes GNU Guix version @value{VERSION}, a functional
58package management tool written for the GNU system.
568717fd
LC
59
60@menu
61* Introduction:: What is Guix about?
bd5e766b 62* Installation:: Installing Guix.
eeaf4427 63* Package Management:: Package installation, upgrade, etc.
568717fd
LC
64* Programming Interface:: Using Guix in Scheme.
65* Utilities:: Package management commands.
a1ba8475 66* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 67* Contributing:: Your help needed!
568717fd
LC
68
69* Acknowledgments:: Thanks!
70* GNU Free Documentation License:: The license of this manual.
71* Concept Index:: Concepts.
a85b83d2 72* Programming Index:: Data types, functions, and variables.
568717fd
LC
73@end menu
74
75@c *********************************************************************
76@node Introduction
77@chapter Introduction
78
c80e7e55
LC
79GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
80using the international phonetic alphabet (IPA).} is a functional
81package management tool for the GNU system. Package management consists
4bfc4ea3
NK
82of all activities that relate to building packages from sources,
83honoring their build-time and run-time dependencies,
c80e7e55
LC
84installing packages in user environments, upgrading installed packages
85to new versions or rolling back to a previous set, removing unused
86software packages, etc.
568717fd
LC
87
88@cindex functional package management
89The term @dfn{functional} refers to a specific package management
90discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
91as a function, in the mathematical sense. That function takes inputs,
92such as build scripts, a compiler, and libraries, and
93returns an installed package. As a pure function, its result depends
568717fd
LC
94solely on its inputs---for instance, it cannot refer to software or
95scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
96always produces the same result when passed a given set of inputs. It
97cannot alter the system's environment in
568717fd
LC
98any way; for instance, it cannot create, modify, or delete files outside
99of its build and installation directories. This is achieved by running
e900c503 100build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 101explicit inputs are visible.
568717fd 102
e531ac2a 103@cindex store
568717fd 104The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
105system, in a special directory called @dfn{the store} (@pxref{The
106Store}). Each package is installed in a directory of its own, in the
834129e0 107store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
108a hash of all the inputs used to build that package; thus, changing an
109input yields a different directory name.
110
111This approach is the foundation of Guix's salient features: support for
4bfc4ea3 112transactional package upgrade and rollback, per-user installation, and
eeaf4427 113garbage collection of packages (@pxref{Features}).
568717fd 114
4bfc4ea3 115Guix has a command-line interface, which allows users to build, install,
568717fd 116upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 117
a1ba8475
LC
118Last but not least, Guix is used to build a distribution of the GNU
119system, with many GNU and non-GNU free software packages. @xref{GNU
120Distribution}.
121
bd5e766b
LC
122@c *********************************************************************
123@node Installation
124@chapter Installation
125
48febeb8
LC
126GNU Guix is available for download from its website at
127@url{http://www.gnu.org/software/guix/}. This section describes the
128software requirements of Guix, as well as how to install it and get
129ready to use it.
bd5e766b 130
5af6de3e
LC
131Note that this section is concerned with the installation of the package
132manager, which can be done on top of a running GNU/Linux system. If,
133instead, you want to install the complete GNU operating system,
6621cdb6 134@pxref{System Installation}.
5af6de3e 135
b22a12fd 136The build procedure for Guix is the same as for other GNU software, and
1da983b9 137is not covered here. Please see the files @file{README} and
b22a12fd
LC
138@file{INSTALL} in the Guix source tree for additional details.
139
bd5e766b
LC
140@menu
141* Requirements:: Software needed to build and run Guix.
142* Setting Up the Daemon:: Preparing the build daemon's environment.
143* Invoking guix-daemon:: Running the build daemon.
144@end menu
145
146@node Requirements
147@section Requirements
148
149GNU Guix depends on the following packages:
150
151@itemize
4a328f73 152@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.5 or later;
bd5e766b
LC
153@item @url{http://gnupg.org/, GNU libgcrypt}
154@end itemize
155
156Unless @code{--disable-daemon} was passed to @command{configure}, the
157following packages are also needed:
158
159@itemize
160@item @url{http://sqlite.org, SQLite 3}
161@item @url{http://www.bzip.org, libbz2}
162@item @url{http://gcc.gnu.org, GCC's g++}
163@end itemize
164
4bfc4ea3
NK
165When a working installation of @url{http://nixos.org/nix/, the Nix package
166manager} is available, you
bd5e766b 167can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 168Nix replaces the three dependencies above.
bd5e766b 169
b22a12fd
LC
170Guix is compatible with Nix, so it is possible to share the same store
171between both. To do so, you must pass @command{configure} not only the
172same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
173@code{--localstatedir} value. The latter is essential because it
174specifies where the database that stores metadata about the store is
834129e0 175located, among other things. The default values for Nix are
b22a12fd 176@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
177Note that @code{--disable-daemon} is not required if
178your goal is to share the store with Nix.
b22a12fd 179
bd5e766b
LC
180@node Setting Up the Daemon
181@section Setting Up the Daemon
182
183@cindex daemon
184Operations such as building a package or running the garbage collector
49e6291a 185are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
186behalf of clients. Only the daemon may access the store and its
187associated database. Thus, any operation that manipulates the store
188goes through the daemon. For instance, command-line tools such as
e49951eb 189@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
190daemon (@i{via} remote procedure calls) to instruct it what to do.
191
49e6291a
LC
192The following sections explain how to prepare the build daemon's
193environment.
194
195@menu
196* Build Environment Setup:: Preparing the isolated build environment.
197* Daemon Offload Setup:: Offloading builds to remote machines.
198@end menu
199
200@node Build Environment Setup
201@subsection Build Environment Setup
202
bd5e766b
LC
203In a standard multi-user setup, Guix and its daemon---the
204@command{guix-daemon} program---are installed by the system
834129e0 205administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
206@command{guix-daemon} runs as @code{root}. Unprivileged users may use
207Guix tools to build packages or otherwise access the store, and the
208daemon will do it on their behalf, ensuring that the store is kept in a
209consistent state, and allowing built packages to be shared among users.
210
211@cindex build users
212When @command{guix-daemon} runs as @code{root}, you may not want package
213build processes themselves to run as @code{root} too, for obvious
214security reasons. To avoid that, a special pool of @dfn{build users}
215should be created for use by build processes started by the daemon.
216These build users need not have a shell and a home directory: they will
217just be used when the daemon drops @code{root} privileges in build
218processes. Having several such users allows the daemon to launch
219distinct build processes under separate UIDs, which guarantees that they
220do not interfere with each other---an essential feature since builds are
221regarded as pure functions (@pxref{Introduction}).
222
223On a GNU/Linux system, a build user pool may be created like this (using
224Bash syntax and the @code{shadow} commands):
225
091196b3
LC
226@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
227@c for why `-G' is needed.
bd5e766b
LC
228@example
229# groupadd guix-builder
230# for i in `seq 1 10`;
231 do
091196b3
LC
232 useradd -g guix-builder -G guix-builder \
233 -d /var/empty -s `which nologin` \
4d1a2b50
LC
234 -c "Guix build user $i" --system \
235 guix-builder$i;
bd5e766b
LC
236 done
237@end example
238
239@noindent
240The @code{guix-daemon} program may then be run as @code{root} with:
241
242@example
243# guix-daemon --build-users-group=guix-builder
244@end example
245
e900c503 246@cindex chroot
b095792f
LC
247@noindent
248This way, the daemon starts build processes in a chroot, under one of
249the @code{guix-builder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
250environment contains nothing but:
251
252@c Keep this list in sync with libstore/build.cc! -----------------------
253@itemize
254@item
4743a4da
LC
255a minimal @code{/dev} directory, created mostly independently from the
256host @code{/dev}@footnote{``Mostly'', because while the set of files
257that appear in the chroot's @code{/dev} is fixed, most of these files
258can only be created if the host has them.};
259
260@item
261the @code{/proc} directory; it only shows the container's processes
262since a separate PID name space is used;
6dc99317
LC
263
264@item
265@file{/etc/passwd} with an entry for the current user and an entry for
266user @file{nobody};
267
268@item
269@file{/etc/group} with an entry for the user's group;
270
271@item
272@file{/etc/hosts} with an entry that maps @code{localhost} to
273@code{127.0.0.1};
274
275@item
276a writable @file{/tmp} directory.
277@end itemize
b095792f 278
d43eb499 279If you are installing Guix as an unprivileged user, it is still
bd5e766b
LC
280possible to run @command{guix-daemon}. However, build processes will
281not be isolated from one another, and not from the rest of the system.
282Thus, build processes may interfere with each other, and may access
283programs, libraries, and other files available on the system---making it
284much harder to view them as @emph{pure} functions.
285
49e6291a
LC
286
287@node Daemon Offload Setup
288@subsection Using the Offload Facility
289
290@cindex offloading
4ec2e92d
LC
291@cindex build hook
292When desired, the build daemon can @dfn{offload}
293derivation builds to other machines
49e6291a
LC
294running Guix, using the @code{offload} @dfn{build hook}. When that
295feature is enabled, a list of user-specified build machines is read from
296@file{/etc/guix/machines.scm}; anytime a build is requested, for
297instance via @code{guix build}, the daemon attempts to offload it to one
298of the machines that satisfies the derivation's constraints, in
299particular its system type---e.g., @file{x86_64-linux}. Missing
300prerequisites for the build are copied over SSH to the target machine,
301which then proceeds with the build; upon success the output(s) of the
302build are copied back to the initial machine.
303
4ec2e92d 304The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
305
306@example
307(list (build-machine
308 (name "eightysix.example.org")
309 (system "x86_64-linux")
310 (user "bob")
311 (speed 2.)) ; incredibly fast!
312
313 (build-machine
314 (name "meeps.example.org")
315 (system "mips64el-linux")
316 (user "alice")
317 (private-key
318 (string-append (getenv "HOME")
319 "/.ssh/id-rsa-for-guix"))))
320@end example
321
322@noindent
323In the example above we specify a list of two build machines, one for
324the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
325architecture.
326
327In fact, this file is---not surprisingly!---a Scheme file that is
328evaluated when the @code{offload} hook is started. Its return value
329must be a list of @code{build-machine} objects. While this example
330shows a fixed list of build machines, one could imagine, say, using
331DNS-SD to return a list of potential build machines discovered in the
332local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
333Avahi in Guile Scheme Programs}).
334
335The compulsory fields for a @code{build-machine} declaration are:
49e6291a
LC
336
337@table @code
338
339@item name
340The remote machine's host name.
341
342@item system
343The remote machine's system type.
344
345@item user
346The user account to use when connecting to the remote machine over SSH.
347Note that the SSH key pair must @emph{not} be passphrase-protected, to
348allow non-interactive logins.
349
350@end table
351
352@noindent
4ec2e92d 353A number of optional fields may be specified:
49e6291a
LC
354
355@table @code
356
cecd72d5
LC
357@item port
358Port number of the machine's SSH server (default: 22).
359
49e6291a
LC
360@item private-key
361The SSH private key file to use when connecting to the machine.
362
363@item parallel-builds
364The number of builds that may run in parallel on the machine (1 by
365default.)
366
367@item speed
368A ``relative speed factor''. The offload scheduler will tend to prefer
369machines with a higher speed factor.
370
371@item features
372A list of strings denoting specific features supported by the machine.
373An example is @code{"kvm"} for machines that have the KVM Linux modules
374and corresponding hardware support. Derivations can request features by
375name, and they will be scheduled on matching build machines.
376
377@end table
378
379The @code{guix} command must be in the search path on the build
380machines, since offloading works by invoking the @code{guix archive} and
381@code{guix build} commands.
382
383There's one last thing to do once @file{machines.scm} is in place. As
384explained above, when offloading, files are transferred back and forth
385between the machine stores. For this to work, you need to generate a
386key pair to allow the daemon to export signed archives of files from the
387store (@pxref{Invoking guix archive}):
388
389@example
390# guix archive --generate-key
391@end example
392
393@noindent
394Thus, when receiving files, a machine's build daemon can make sure they
395are genuine, have not been tampered with, and that they are signed by an
396authorized key.
397
398
bd5e766b
LC
399@node Invoking guix-daemon
400@section Invoking @command{guix-daemon}
401
402The @command{guix-daemon} program implements all the functionality to
403access the store. This includes launching build processes, running the
404garbage collector, querying the availability of a build result, etc. It
405is normally run as @code{root} like this:
406
407@example
408# guix-daemon --build-users-group=guix-builder
409@end example
410
411@noindent
412For details on how to set it up, @ref{Setting Up the Daemon}.
413
e900c503
LC
414@cindex chroot
415@cindex container, build environment
416@cindex build environment
417@cindex reproducible builds
bd5e766b
LC
418By default, @command{guix-daemon} launches build processes under
419different UIDs, taken from the build group specified with
420@code{--build-users-group}. In addition, each build process is run in a
421chroot environment that only contains the subset of the store that the
422build process depends on, as specified by its derivation
423(@pxref{Programming Interface, derivation}), plus a set of specific
424system directories. By default, the latter contains @file{/dev} and
e900c503
LC
425@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
426@dfn{container}: in addition to having its own file system tree, it has
427a separate mount name space, its own PID name space, network name space,
428etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b
LC
429
430The following command-line options are supported:
431
432@table @code
433@item --build-users-group=@var{group}
434Take users from @var{group} to run build processes (@pxref{Setting Up
435the Daemon, build users}).
436
6858f9d1 437@item --no-substitutes
b5385b52 438@cindex substitutes
6858f9d1 439Do not use substitutes for build products. That is, always build things
c4202d60
LC
440locally instead of allowing downloads of pre-built binaries
441(@pxref{Substitutes}).
6858f9d1 442
b5385b52
LC
443By default substitutes are used, unless the client---such as the
444@command{guix package} command---is explicitly invoked with
445@code{--no-substitutes}.
446
447When the daemon runs with @code{--no-substitutes}, clients can still
448explicitly enable substitution @i{via} the @code{set-build-options}
449remote procedure call (@pxref{The Store}).
450
4ec2e92d
LC
451@cindex build hook
452@item --no-build-hook
453Do not use the @dfn{build hook}.
454
455The build hook is a helper program that the daemon can start and to
456which it submits build requests. This mechanism is used to offload
457builds to other machines (@pxref{Daemon Offload Setup}).
458
bd5e766b
LC
459@item --cache-failures
460Cache build failures. By default, only successful builds are cached.
461
462@item --cores=@var{n}
463@itemx -c @var{n}
464Use @var{n} CPU cores to build each derivation; @code{0} means as many
465as available.
466
467The default value is @code{1}, but it may be overridden by clients, such
e49951eb
MW
468as the @code{--cores} option of @command{guix build} (@pxref{Invoking
469guix build}).
bd5e766b
LC
470
471The effect is to define the @code{NIX_BUILD_CORES} environment variable
472in the build process, which can then use it to exploit internal
473parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
474
475@item --max-jobs=@var{n}
476@itemx -M @var{n}
477Allow at most @var{n} build jobs in parallel. The default value is
478@code{1}.
479
480@item --debug
481Produce debugging output.
482
483This is useful to debug daemon start-up issues, but then it may be
484overridden by clients, for example the @code{--verbosity} option of
e49951eb 485@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
486
487@item --chroot-directory=@var{dir}
488Add @var{dir} to the build chroot.
489
490Doing this may change the result of build processes---for instance if
491they use optional dependencies found in @var{dir} when it is available,
492and not otherwise. For that reason, it is not recommended to do so.
493Instead, make sure that each derivation declares all the inputs that it
494needs.
495
496@item --disable-chroot
497Disable chroot builds.
498
499Using this option is not recommended since, again, it would allow build
500processes to gain access to undeclared dependencies.
501
502@item --disable-log-compression
503Disable compression of the build logs.
504
1da983b9
LC
505Unless @code{--lose-logs} is used, all the build logs are kept in the
506@var{localstatedir}. To save space, the daemon automatically compresses
507them with bzip2 by default. This option disables that.
508
ab3893d7
LC
509@item --disable-deduplication
510@cindex deduplication
bd5e766b
LC
511Disable automatic file ``deduplication'' in the store.
512
1da983b9 513By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
514if a newly added file is identical to another one found in the store,
515the daemon makes the new file a hard link to the other file. This can
516noticeably reduce disk usage, at the expense of slightly increasde
517input/output load at the end of a build process. This option disables
518this optimization.
1da983b9 519
6e37066e
LC
520@item --gc-keep-outputs[=yes|no]
521Tell whether the garbage collector (GC) must keep outputs of live
522derivations.
523
524When set to ``yes'', the GC will keep the outputs of any live derivation
525available in the store---the @code{.drv} files. The default is ``no'',
526meaning that derivation outputs are kept only if they are GC roots.
527
528@item --gc-keep-derivations[=yes|no]
529Tell whether the garbage collector (GC) must keep derivations
530corresponding to live outputs.
531
532When set to ``yes'', as is the case by default, the GC keeps
533derivations---i.e., @code{.drv} files---as long as at least one of their
534outputs is live. This allows users to keep track of the origins of
535items in their store. Setting it to ``no'' saves a bit of disk space.
536
537Note that when both @code{--gc-keep-derivations} and
538@code{--gc-keep-outputs} are used, the effect is to keep all the build
539prerequisites (the sources, compiler, libraries, and other build-time
540tools) of live objects in the store, regardless of whether these
541prerequisites are live. This is convenient for developers since it
542saves rebuilds or downloads.
543
bd5e766b
LC
544@item --impersonate-linux-2.6
545On Linux-based systems, impersonate Linux 2.6. This means that the
546kernel's @code{uname} system call will report 2.6 as the release number.
547
548This might be helpful to build programs that (usually wrongfully) depend
549on the kernel version number.
550
551@item --lose-logs
552Do not keep build logs. By default they are kept under
ce33631f 553@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
554
555@item --system=@var{system}
556Assume @var{system} as the current system type. By default it is the
557architecture/kernel pair found at configure time, such as
558@code{x86_64-linux}.
b8d2aa26
LC
559
560@item --listen=@var{socket}
561Listen for connections on @var{socket}, the file name of a Unix-domain
562socket. The default socket is
563@file{@var{localstatedir}/daemon-socket/socket}. This option is only
564useful in exceptional circumstances, such as if you need to run several
565daemons on the same machine.
bd5e766b
LC
566@end table
567
568
eeaf4427
LC
569@c *********************************************************************
570@node Package Management
571@chapter Package Management
572
f8348b91 573The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
574remove software packages, without having to know about their build
575procedure or dependencies. Guix also goes beyond this obvious set of
576features.
577
578This chapter describes the main features of Guix, as well as the package
579management tools it provides.
580
581@menu
582* Features:: How Guix will make your life brighter.
e49951eb 583* Invoking guix package:: Package installation, removal, etc.
457f60fa 584* Emacs Interface:: Package management from Emacs.
c4202d60 585* Substitutes:: Downloading pre-built binaries.
760c60d6 586* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 587* Invoking guix gc:: Running the garbage collector.
f651b477 588* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 589* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
590@end menu
591
592@node Features
593@section Features
594
595When using Guix, each package ends up in the @dfn{package store}, in its
596own directory---something that resembles
834129e0 597@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string.
eeaf4427
LC
598
599Instead of referring to these directories, users have their own
600@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
601use. These profiles are stored within each user's home directory, at
602@code{$HOME/.guix-profile}.
eeaf4427 603
821b0015 604For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 605@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 606@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
607@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
608simply continues to point to
834129e0 609@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 610coexist on the same system without any interference.
eeaf4427 611
e49951eb
MW
612The @command{guix package} command is the central tool to manage
613packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 614profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
615
616The command provides the obvious install, remove, and upgrade
617operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 618the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 619@command{guix package} process is terminated during the transaction,
eeaf4427
LC
620or if a power outage occurs during the transaction, then the user's
621profile remains in its previous state, and remains usable.
622
623In addition, any package transaction may be @emph{rolled back}. So, if,
624for example, an upgrade installs a new version of a package that turns
625out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
626of their profile, which was known to work well. Similarly, the global
627system configuration is subject to transactional upgrades and roll-back
628(@pxref{Using the Configuration System}).
eeaf4427
LC
629
630All those packages in the package store may be @emph{garbage-collected}.
631Guix can determine which packages are still referenced by the user
fe8ff028 632profiles, and remove those that are provably no longer referenced
e49951eb 633(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
634generations of their profile so that the packages they refer to can be
635collected.
eeaf4427 636
e900c503
LC
637@cindex reproducibility
638@cindex reproducible builds
eeaf4427
LC
639Finally, Guix takes a @dfn{purely functional} approach to package
640management, as described in the introduction (@pxref{Introduction}).
834129e0 641Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
642inputs that were used to build that package---compiler, libraries, build
643scripts, etc. This direct correspondence allows users to make sure a
644given package installation matches the current state of their
e900c503
LC
645distribution. It also helps maximize @dfn{build reproducibility}:
646thanks to the isolated build environments that are used, a given build
647is likely to yield bit-identical files when performed on different
648machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 649
c4202d60 650@cindex substitutes
eeaf4427 651This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 652deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 653available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
654downloads it and unpacks it;
655otherwise, it builds the package from source, locally
656(@pxref{Substitutes}).
eeaf4427 657
e49951eb
MW
658@node Invoking guix package
659@section Invoking @command{guix package}
eeaf4427 660
e49951eb 661The @command{guix package} command is the tool that allows users to
eeaf4427
LC
662install, upgrade, and remove packages, as well as rolling back to
663previous configurations. It operates only on the user's own profile,
664and works with normal user privileges (@pxref{Features}). Its syntax
665is:
666
667@example
e49951eb 668guix package @var{options}
eeaf4427
LC
669@end example
670
ba55b1cb 671Primarily, @var{options} specifies the operations to be performed during
eeaf4427
LC
672the transaction. Upon completion, a new profile is created, but
673previous generations of the profile remain available, should the user
674want to roll back.
675
6447738c
MW
676For example, to remove @code{lua} and install @code{guile} and
677@code{guile-cairo} in a single transaction:
678
679@example
680guix package -r lua -i guile guile-cairo
681@end example
682
b9e5c0a9 683For each user, a symlink to the user's default profile is automatically
0ec1af59 684created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
685current generation of the user's default profile. Thus, users can add
686@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
687variable, and so on.
688
0ec1af59
LC
689In a multi-user setup, user profiles must be stored in a place
690registered as a @dfn{garbage-collector root}, which
e49951eb 691@file{$HOME/.guix-profile} points to (@pxref{Invoking guix gc}). That
0ec1af59
LC
692directory is normally
693@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
694@var{localstatedir} is the value passed to @code{configure} as
695@code{--localstatedir}, and @var{user} is the user name. It must be
696created by @code{root}, with @var{user} as the owner. When it does not
70c43291
LC
697exist, or is not owned by @var{user}, @command{guix package} emits an
698error about it.
0ec1af59
LC
699
700The @var{options} can be among the following:
701
eeaf4427
LC
702@table @code
703
6447738c
MW
704@item --install=@var{package} @dots{}
705@itemx -i @var{package} @dots{}
706Install the specified @var{package}s.
eeaf4427 707
6447738c 708Each @var{package} may specify either a simple package name, such as
eeaf4427 709@code{guile}, or a package name followed by a hyphen and version number,
dc5669cd
MW
710such as @code{guile-1.8.8}. If no version number is specified, the
711newest available version will be selected. In addition, @var{package}
712may contain a colon, followed by the name of one of the outputs of the
6e721c4d 713package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
714(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
715name (and optionally version) are searched for among the GNU
716distribution modules (@pxref{Package Modules}).
eeaf4427 717
461572cc
LC
718@cindex propagated inputs
719Sometimes packages have @dfn{propagated inputs}: these are dependencies
720that automatically get installed along with the required package.
721
722An example is the GNU MPC library: its C header files refer to those of
723the GNU MPFR library, which in turn refer to those of the GMP library.
724Thus, when installing MPC, the MPFR and GMP libraries also get installed
725in the profile; removing MPC also removes MPFR and GMP---unless they had
726also been explicitly installed independently.
727
ba7ea5ce 728Besides, packages sometimes rely on the definition of environment
5924080d 729variables for their search paths (see explanation of
ba7ea5ce 730@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
731environment variable definitions are reported here.
732
ef010c0f 733@c XXX: keep me up-to-date
5924080d 734Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
735availability of a newer upstream version. In the future, it may provide
736the option of installing directly from the upstream version, even if
737that version is not yet in the distribution.
738
5d4b411f
LC
739@item --install-from-expression=@var{exp}
740@itemx -e @var{exp}
741Install the package @var{exp} evaluates to.
742
743@var{exp} must be a Scheme expression that evaluates to a
744@code{<package>} object. This option is notably useful to disambiguate
745between same-named variants of a package, with expressions such as
746@code{(@@ (gnu packages base) guile-final)}.
747
748Note that this option installs the first output of the specified
749package, which may be insufficient when needing a specific output of a
750multiple-output package.
751
6447738c
MW
752@item --remove=@var{package} @dots{}
753@itemx -r @var{package} @dots{}
754Remove the specified @var{package}s.
eeaf4427 755
6447738c 756As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
757and/or output name in addition to the package name. For instance,
758@code{-r glibc:debug} would remove the @code{debug} output of
759@code{glibc}.
760
6447738c
MW
761@item --upgrade[=@var{regexp} @dots{}]
762@itemx -u [@var{regexp} @dots{}]
763Upgrade all the installed packages. If one or more @var{regexp}s are
764specified, upgrade only installed packages whose name matches a
765@var{regexp}.
eeaf4427 766
f651b477
LC
767Note that this upgrades package to the latest version of packages found
768in the distribution currently installed. To update your distribution,
769you should regularly run @command{guix pull} (@pxref{Invoking guix
770pull}).
771
24e262f0
LC
772@item --roll-back
773Roll back to the previous @dfn{generation} of the profile---i.e., undo
774the last transaction.
775
776When combined with options such as @code{--install}, roll back occurs
777before any other actions.
778
d9307267 779When rolling back from the first generation that actually contains
4b2bc804
NK
780installed packages, the profile is made to point to the @dfn{zeroth
781generation}, which contains no files apart from its own meta-data.
d9307267 782
82fe08ed
LC
783Installing, removing, or upgrading packages from a generation that has
784been rolled back to overwrites previous future generations. Thus, the
785history of a profile's generations is always linear.
786
5924080d
LC
787@item --search-paths
788@cindex search paths
789Report environment variable definitions, in Bash syntax, that may be
790needed in order to use the set of installed packages. These environment
791variables are used to specify @dfn{search paths} for files used by some
792of the installed packages.
793
794For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
795environment variables to be defined so it can look for headers and
796libraries in the user's profile (@pxref{Environment Variables,,, gcc,
797Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
798library are installed in the profile, then @code{--search-paths} will
799suggest setting these variables to @code{@var{profile}/include} and
800@code{@var{profile}/lib}, respectively.
801
eeaf4427
LC
802@item --profile=@var{profile}
803@itemx -p @var{profile}
804Use @var{profile} instead of the user's default profile.
805
70915c1a
LC
806@item --verbose
807Produce verbose output. In particular, emit the environment's build log
808on the standard error port.
809
eeaf4427
LC
810@item --bootstrap
811Use the bootstrap Guile to build the profile. This option is only
812useful to distribution developers.
813
814@end table
815
e49951eb 816In addition to these actions @command{guix package} supports the
733b4130
LC
817following options to query the current state of a profile, or the
818availability of packages:
eeaf4427 819
733b4130
LC
820@table @option
821
acc08466
NK
822@item --search=@var{regexp}
823@itemx -s @var{regexp}
824List the available packages whose synopsis or description matches
299112d3
LC
825@var{regexp}. Print all the meta-data of matching packages in
826@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
827GNU recutils manual}).
acc08466 828
299112d3
LC
829This allows specific fields to be extracted using the @command{recsel}
830command, for instance:
831
832@example
e49951eb 833$ guix package -s malloc | recsel -p name,version
299112d3
LC
834name: glibc
835version: 2.17
836
837name: libgc
838version: 7.2alpha6
839@end example
acc08466 840
a12d92f5
LC
841Similarly, to show the name of all the packages available under the
842terms of the GNU@tie{}LGPL version 3:
843
844@example
845$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
846name: elfutils
847
848name: gmp
849@dots{}
850@end example
851
2aa6efb0
CR
852@item --show=@var{package}
853Show details about @var{package}, taken from the list of available packages, in
854@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
855recutils manual}).
856
857@example
858$ guix package --show=python | recsel -p name,version
859name: python
860version: 2.7.6
861
862name: python
863version: 3.3.5
864@end example
865
866You may also specify the full name of a package to only get details about a
867specific version of it:
868@example
869$ guix package --show=python-3.3.5 | recsel -p name,version
870name: python
871version: 3.3.5
872@end example
873
874
875
733b4130
LC
876@item --list-installed[=@var{regexp}]
877@itemx -I [@var{regexp}]
bd9bde1c
LC
878List the currently installed packages in the specified profile, with the
879most recently installed packages shown last. When @var{regexp} is
880specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
881
882For each installed package, print the following items, separated by
883tabs: the package name, its version string, the part of the package that
884is installed (for instance, @code{out} for the default output,
885@code{include} for its headers, etc.), and the path of this package in
886the store.
887
64fc89b6
LC
888@item --list-available[=@var{regexp}]
889@itemx -A [@var{regexp}]
a1ba8475
LC
890List packages currently available in the software distribution
891(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
892installed packages whose name matches @var{regexp}.
64fc89b6
LC
893
894For each package, print the following items separated by tabs: its name,
6e721c4d
LC
895its version string, the parts of the package (@pxref{Packages with
896Multiple Outputs}), and the source location of its definition.
64fc89b6 897
f566d765
LC
898@item --list-generations[=@var{pattern}]
899@itemx -l [@var{pattern}]
900Return a list of generations along with their creation dates; for each
901generation, show the installed packages, with the most recently
4b2bc804
NK
902installed packages shown last. Note that the zeroth generation is never
903shown.
f566d765
LC
904
905For each installed package, print the following items, separated by
906tabs: the name of a package, its version string, the part of the package
907that is installed (@pxref{Packages with Multiple Outputs}), and the
908location of this package in the store.
909
910When @var{pattern} is used, the command returns only matching
911generations. Valid patterns include:
912
913@itemize
914@item @emph{Integers and comma-separated integers}. Both patterns denote
915generation numbers. For instance, @code{--list-generations=1} returns
916the first one.
917
918And @code{--list-generations=1,8,2} outputs three generations in the
919specified order. Neither spaces nor trailing commas are allowed.
920
921@item @emph{Ranges}. @code{--list-generations=2..9} prints the
922specified generations and everything in between. Note that the start of
923a range must be lesser than its end.
924
925It is also possible to omit the endpoint. For example,
926@code{--list-generations=2..}, returns all generations starting from the
927second one.
928
929@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
930or months by passing an integer along with the first letter of the
d7ddb257
LC
931duration. For example, @code{--list-generations=20d} lists generations
932that are up to 20 days old.
f566d765
LC
933@end itemize
934
b7884ca3
NK
935@item --delete-generations[=@var{pattern}]
936@itemx -d [@var{pattern}]
d7ddb257
LC
937When @var{pattern} is omitted, delete all generations except the current
938one.
b7884ca3
NK
939
940This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
941When @var{pattern} is specified, delete the matching generations. When
942@var{pattern} specifies a duration, generations @emph{older} than the
943specified duration match. For instance, @code{--delete-generations=1m}
944deletes generations that are more than one month old.
945
946If the current generation matches, it is deleted atomically---i.e., by
947switching to the previous available generation. Note that the zeroth
948generation is never deleted.
b7884ca3 949
1bb9900a
LC
950Note that deleting generations prevents roll-back to them.
951Consequently, this command must be used with care.
952
733b4130 953@end table
eeaf4427 954
70ee5642
LC
955Finally, since @command{guix package} may actually start build
956processes, it supports all the common build options that @command{guix
957build} supports (@pxref{Invoking guix build, common build options}).
958
457f60fa
AK
959@include emacs.texi
960
c4202d60
LC
961@node Substitutes
962@section Substitutes
963
964@cindex substitutes
965@cindex pre-built binaries
966Guix supports transparent source/binary deployment, which means that it
967can either build things locally, or download pre-built items from a
968server. We call these pre-built items @dfn{substitutes}---they are
969substitutes for local build results. In many cases, downloading a
970substitute is much faster than building things locally.
971
972Substitutes can be anything resulting from a derivation build
973(@pxref{Derivations}). Of course, in the common case, they are
974pre-built package binaries, but source tarballs, for instance, which
975also result from derivation builds, can be available as substitutes.
976
977The @code{hydra.gnu.org} server is a front-end to a build farm that
978builds packages from the GNU distribution continuously for some
979architectures, and makes them available as substitutes.
980
981@cindex security
982@cindex digital signatures
983To allow Guix to download substitutes from @code{hydra.gnu.org}, you
984must add its public key to the access control list (ACL) of archive
985imports, using the @command{guix archive} command (@pxref{Invoking guix
986archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
987be compromised and to serve genuine substitutes.
988
989This public key is installed along with Guix, in
990@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
991the installation prefix of Guix. If you installed Guix from source,
992make sure you checked the GPG signature of
993@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
994Then, you can run something like this:
995
996@example
997# guix archive --authorize < hydra.gnu.org.pub
998@end example
999
1000Once this is in place, the output of a command like @code{guix build}
1001should change from something like:
1002
1003@example
1004$ guix build emacs --dry-run
1005The following derivations would be built:
1006 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1007 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1008 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1009 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1010@dots{}
1011@end example
1012
1013@noindent
1014to something like:
1015
1016@example
1017$ guix build emacs --dry-run
1018The following files would be downloaded:
1019 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1020 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1021 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1022 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1023@dots{}
1024@end example
1025
1026@noindent
1027This indicates that substitutes from @code{hydra.gnu.org} are usable and
1028will be downloaded, when possible, for future builds.
1029
1030Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1031one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1032when attempting to use a substitute that has been tampered with.
1033
1034The substitute mechanism can be disabled globally by running
1035@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1036guix-daemon}). It can also be disabled temporarily by passing the
1037@code{--no-substitutes} option to @command{guix package}, @command{guix
1038build}, and other command-line tools.
1039
1040
1041Today, each individual's control over their own computing is at the
1042mercy of institutions, corporations, and groups with enough power and
1043determination to subvert the computing infrastructure and exploit its
1044weaknesses. While using @code{hydra.gnu.org} substitutes can be
1045convenient, we encourage users to also build on their own, or even run
1046their own build farm, such that @code{hydra.gnu.org} is less of an
1047interesting target.
1048
1049Guix has the foundations to maximize build reproducibility
1050(@pxref{Features}). In most cases, independent builds of a given
1051package or derivation should yield bit-identical results. Thus, through
1052a diverse set of independent package builds, we can strengthen the
1053integrity of our systems.
1054
1055In the future, we want Guix to have support to publish and retrieve
1056binaries to/from other users, in a peer-to-peer fashion. If you would
1057like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1058
1059
6e721c4d
LC
1060@node Packages with Multiple Outputs
1061@section Packages with Multiple Outputs
1062
1063@cindex multiple-output packages
1064@cindex package outputs
1065
1066Often, packages defined in Guix have a single @dfn{output}---i.e., the
1067source package leads exactly one directory in the store. When running
1068@command{guix package -i glibc}, one installs the default output of the
1069GNU libc package; the default output is called @code{out}, but its name
1070can be omitted as shown in this command. In this particular case, the
1071default output of @code{glibc} contains all the C header files, shared
1072libraries, static libraries, Info documentation, and other supporting
1073files.
1074
1075Sometimes it is more appropriate to separate the various types of files
1076produced from a single source package into separate outputs. For
1077instance, the GLib C library (used by GTK+ and related packages)
1078installs more than 20 MiB of reference documentation as HTML pages.
1079To save space for users who do not need it, the documentation goes to a
1080separate output, called @code{doc}. To install the main GLib output,
1081which contains everything but the documentation, one would run:
1082
1083@example
1084guix package -i glib
1085@end example
1086
1087The command to install its documentation is:
1088
1089@example
1090guix package -i glib:doc
1091@end example
1092
1093Some packages install programs with different ``dependency footprints''.
1094For instance, the WordNet package install both command-line tools and
1095graphical user interfaces (GUIs). The former depend solely on the C
1096library, whereas the latter depend on Tcl/Tk and the underlying X
1097libraries. In this case, we leave the command-line tools in the default
1098output, whereas the GUIs are in a separate output. This allows users
1099who do not need the GUIs to save space.
1100
1101There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1102Other conventional output names include @code{lib} for libraries and
1103possibly header files, @code{bin} for stand-alone programs, and
1104@code{debug} for debugging information (@pxref{Installing Debugging
1105Files}). The outputs of a packages are listed in the third column of
1106the output of @command{guix package --list-available} (@pxref{Invoking
1107guix package}).
6e721c4d 1108
eeaf4427 1109
e49951eb
MW
1110@node Invoking guix gc
1111@section Invoking @command{guix gc}
fe8ff028
LC
1112
1113@cindex garbage collector
1114Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1115The @command{guix gc} command allows users to explicitly run the garbage
834129e0 1116collector to reclaim space from the @file{/gnu/store} directory.
fe8ff028
LC
1117
1118The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1119@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1120cannot be deleted; any other file is considered @dfn{dead} and may be
1121deleted. The set of garbage collector roots includes default user
e49951eb
MW
1122profiles, and may be augmented with @command{guix build --root}, for
1123example (@pxref{Invoking guix build}).
fe8ff028 1124
1bb9900a
LC
1125Prior to running @code{guix gc --collect-garbage} to make space, it is
1126often useful to remove old generations from user profiles; that way, old
1127package builds referenced by those generations can be reclaimed. This
1128is achieved by running @code{guix package --delete-generations}
1129(@pxref{Invoking guix package}).
1130
e49951eb 1131The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
1132used to garbage-collect any dead files (the default), to delete specific
1133files (the @code{--delete} option), or to print garbage-collector
1134information. The available options are listed below:
1135
1136@table @code
1137@item --collect-garbage[=@var{min}]
1138@itemx -C [@var{min}]
834129e0 1139Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1140sub-directories. This is the default operation when no option is
1141specified.
1142
1143When @var{min} is given, stop once @var{min} bytes have been collected.
1144@var{min} may be a number of bytes, or it may include a unit as a
1145suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes.
1146
1147When @var{min} is omitted, collect all the garbage.
1148
1149@item --delete
1150@itemx -d
1151Attempt to delete all the store files and directories specified as
1152arguments. This fails if some of the files are not in the store, or if
1153they are still live.
1154
1155@item --list-dead
1156Show the list of dead files and directories still present in the
1157store---i.e., files and directories no longer reachable from any root.
1158
1159@item --list-live
1160Show the list of live store files and directories.
ba8b732d
LC
1161
1162@end table
1163
1164In addition, the references among existing store files can be queried:
1165
1166@table @code
1167
1168@item --references
1169@itemx --referrers
1170List the references (respectively, the referrers) of store files given
1171as arguments.
1172
8e59fdd5
LC
1173@item --requisites
1174@itemx -R
1175List the requisites of the store files passed as arguments. Requisites
1176include the store files themselves, their references, and the references
1177of these, recursively. In other words, the returned list is the
1178@dfn{transitive closure} of the store files.
1179
fe8ff028
LC
1180@end table
1181
eeaf4427 1182
f651b477
LC
1183@node Invoking guix pull
1184@section Invoking @command{guix pull}
1185
1186Packages are installed or upgraded to the latest version available in
1187the distribution currently available on your local machine. To update
1188that distribution, along with the Guix tools, you must run @command{guix
1189pull}: the command downloads the latest Guix source code and package
1190descriptions, and deploys it.
1191
1192On completion, @command{guix package} will use packages and package
1193versions from this just-retrieved copy of Guix. Not only that, but all
1194the Guix commands and Scheme modules will also be taken from that latest
1195version. New @command{guix} sub-commands added by the update also
1196become available.
1197
1198The @command{guix pull} command is usually invoked with no arguments,
1199but it supports the following options:
1200
1201@table @code
1202@item --verbose
1203Produce verbose output, writing build logs to the standard error output.
1204
ab5d72ad
LC
1205@item --url=@var{url}
1206Download the source tarball of Guix from @var{url}.
1207
1208By default, the tarball is taken from its canonical address at
1209@code{gnu.org}, for the stable branch of Guix.
1210
f651b477
LC
1211@item --bootstrap
1212Use the bootstrap Guile to build the latest Guix. This option is only
1213useful to Guix developers.
1214@end table
1215
760c60d6
LC
1216
1217@node Invoking guix archive
1218@section Invoking @command{guix archive}
1219
1220The @command{guix archive} command allows users to @dfn{export} files
1221from the store into a single archive, and to later @dfn{import} them.
1222In particular, it allows store files to be transferred from one machine
1223to another machine's store. For example, to transfer the @code{emacs}
1224package to a machine connected over SSH, one would run:
1225
1226@example
1227guix archive --export emacs | ssh the-machine guix archive --import
1228@end example
1229
87236aed
LC
1230@noindent
1231However, note that, in this example, all of @code{emacs} and its
1232dependencies are transferred, regardless of what is already available in
1233the target machine's store. The @code{--missing} option can help figure
1234out which items are missing from the target's store.
1235
760c60d6 1236Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1237comparable in spirit to `tar', but with a few noteworthy differences
1238that make it more appropriate for our purposes. First, rather than
1239recording all Unix meta-data for each file, the Nar format only mentions
1240the file type (regular, directory, or symbolic link); Unix permissions
1241and owner/group are dismissed. Second, the order in which directory
1242entries are stored always follows the order of file names according to
1243the C locale collation order. This makes archive production fully
1244deterministic.
1245
1246When exporting, the daemon digitally signs the contents of the archive,
1247and that digital signature is appended. When importing, the daemon
1248verifies the signature and rejects the import in case of an invalid
1249signature or if the signing key is not authorized.
760c60d6
LC
1250@c FIXME: Add xref to daemon doc about signatures.
1251
1252The main options are:
1253
1254@table @code
1255@item --export
1256Export the specified store files or packages (see below.) Write the
1257resulting archive to the standard output.
1258
1259@item --import
1260Read an archive from the standard input, and import the files listed
1261therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1262signature, or if it is signed by a public key not among the authorized
1263keys (see @code{--authorize} below.)
554f26ec 1264
87236aed
LC
1265@item --missing
1266Read a list of store file names from the standard input, one per line,
1267and write on the standard output the subset of these files missing from
1268the store.
1269
554f26ec 1270@item --generate-key[=@var{parameters}]
f82cc5fd 1271@cindex signing, archives
554f26ec
LC
1272Generate a new key pair for the daemons. This is a prerequisite before
1273archives can be exported with @code{--export}. Note that this operation
1274usually takes time, because it needs to gather enough entropy to
1275generate the key pair.
1276
1277The generated key pair is typically stored under @file{/etc/guix}, in
1278@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
1279key, which must be kept secret.) When @var{parameters} is omitted, it
1280is a 4096-bit RSA key. Alternately, @var{parameters} can specify
1281@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1282public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1283Libgcrypt Reference Manual}).
f82cc5fd
LC
1284
1285@item --authorize
1286@cindex authorizing, archives
1287Authorize imports signed by the public key passed on standard input.
1288The public key must be in ``s-expression advanced format''---i.e., the
1289same format as the @file{signing-key.pub} file.
1290
1291The list of authorized keys is kept in the human-editable file
1292@file{/etc/guix/acl}. The file contains
1293@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1294s-expressions''} and is structured as an access-control list in the
1295@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1296(SPKI)}.
760c60d6
LC
1297@end table
1298
1299To export store files as an archive to the standard output, run:
1300
1301@example
1302guix archive --export @var{options} @var{specifications}...
1303@end example
1304
1305@var{specifications} may be either store file names or package
1306specifications, as for @command{guix package} (@pxref{Invoking guix
1307package}). For instance, the following command creates an archive
1308containing the @code{gui} output of the @code{git} package and the main
1309output of @code{emacs}:
1310
1311@example
834129e0 1312guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1313@end example
1314
1315If the specified packages are not built yet, @command{guix archive}
1316automatically builds them. The build process may be controlled with the
1317same options that can be passed to the @command{guix build} command
70ee5642 1318(@pxref{Invoking guix build, common build options}).
760c60d6
LC
1319
1320
568717fd
LC
1321@c *********************************************************************
1322@node Programming Interface
1323@chapter Programming Interface
1324
3dc1970d
LC
1325GNU Guix provides several Scheme programming interfaces (APIs) to
1326define, build, and query packages. The first interface allows users to
1327write high-level package definitions. These definitions refer to
1328familiar packaging concepts, such as the name and version of a package,
1329its build system, and its dependencies. These definitions can then be
1330turned into concrete build actions.
1331
ba55b1cb 1332Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1333standard setup, the daemon has write access to the store---the
834129e0 1334@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1335setup also has the daemon perform builds in chroots, under a specific
1336build users, to minimize interference with the rest of the system.
1337
1338@cindex derivation
1339Lower-level APIs are available to interact with the daemon and the
1340store. To instruct the daemon to perform a build action, users actually
1341provide it with a @dfn{derivation}. A derivation is a low-level
1342representation of the build actions to be taken, and the environment in
1343which they should occur---derivations are to package definitions what
49ad317a
LC
1344assembly is to C programs. The term ``derivation'' comes from the fact
1345that build results @emph{derive} from them.
3dc1970d
LC
1346
1347This chapter describes all these APIs in turn, starting from high-level
1348package definitions.
1349
568717fd 1350@menu
b860f382 1351* Defining Packages:: Defining new packages.
7458bd0a 1352* Build Systems:: Specifying how packages are built.
b860f382
LC
1353* The Store:: Manipulating the package store.
1354* Derivations:: Low-level interface to package derivations.
1355* The Store Monad:: Purely functional interface to the store.
21b679f6 1356* G-Expressions:: Manipulating build expressions.
568717fd
LC
1357@end menu
1358
1359@node Defining Packages
1360@section Defining Packages
1361
3dc1970d
LC
1362The high-level interface to package definitions is implemented in the
1363@code{(guix packages)} and @code{(guix build-system)} modules. As an
1364example, the package definition, or @dfn{recipe}, for the GNU Hello
1365package looks like this:
1366
1367@example
e7f34eb0
LC
1368(define-module (gnu packages hello)
1369 #:use-module (guix packages)
1370 #:use-module (guix download)
1371 #:use-module (guix build-system gnu)
1372 #:use-module (guix licenses))
b22a12fd 1373
79f5dd59 1374(define-public hello
3dc1970d
LC
1375 (package
1376 (name "hello")
1377 (version "2.8")
1378 (source (origin
1379 (method url-fetch)
1380 (uri (string-append "mirror://gnu/hello/hello-" version
1381 ".tar.gz"))
1382 (sha256
1383 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1384 (build-system gnu-build-system)
7458bd0a 1385 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1386 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1387 (synopsis "Hello, GNU world: An example GNU package")
1388 (description "Guess what GNU Hello prints!")
3dc1970d 1389 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 1390 (license gpl3+)))
3dc1970d
LC
1391@end example
1392
1393@noindent
1394Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 1395of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
1396to a @code{<package>} object, which is essentially a record
1397(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1398This package object can be inspected using procedures found in the
1399@code{(guix packages)} module; for instance, @code{(package-name hello)}
1400returns---surprise!---@code{"hello"}.
1401
e7f34eb0
LC
1402In the example above, @var{hello} is defined into a module of its own,
1403@code{(gnu packages hello)}. Technically, this is not strictly
1404necessary, but it is convenient to do so: all the packages defined in
1405modules under @code{(gnu packages @dots{})} are automatically known to
1406the command-line tools (@pxref{Package Modules}).
1407
3dc1970d
LC
1408There are a few points worth noting in the above package definition:
1409
1410@itemize
1411@item
1412The @code{source} field of the package is an @code{<origin>} object.
1413Here, the @code{url-fetch} method from @code{(guix download)} is used,
1414meaning that the source is a file to be downloaded over FTP or HTTP.
1415
1416The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1417the GNU mirrors defined in @code{(guix download)}.
1418
1419The @code{sha256} field specifies the expected SHA256 hash of the file
1420being downloaded. It is mandatory, and allows Guix to check the
1421integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 1422base32 representation of the hash. You can obtain this information with
210cc920
LC
1423@code{guix download} (@pxref{Invoking guix download}) and @code{guix
1424hash} (@pxref{Invoking guix hash}).
3dc1970d 1425
f9cc8971
LC
1426@cindex patches
1427When needed, the @code{origin} form can also have a @code{patches} field
1428listing patches to be applied, and a @code{snippet} field giving a
1429Scheme expression to modify the source code.
1430
3dc1970d
LC
1431@item
1432@cindex GNU Build System
7458bd0a
LC
1433The @code{build-system} field specifies the procedure to build the
1434package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1435represents the familiar GNU Build System, where packages may be
1436configured, built, and installed with the usual @code{./configure &&
1437make && make check && make install} command sequence.
1438
1439@item
1440The @code{arguments} field specifies options for the build system
1441(@pxref{Build Systems}). Here it is interpreted by
1442@var{gnu-build-system} as a request run @file{configure} with the
1443@code{--enable-silent-rules} flag.
3dc1970d
LC
1444
1445@item
1446The @code{inputs} field specifies inputs to the build process---i.e.,
1447build-time or run-time dependencies of the package. Here, we define an
1448input called @code{"gawk"} whose value is that of the @var{gawk}
1449variable; @var{gawk} is itself bound to a @code{<package>} object.
1450
1451Note that GCC, Coreutils, Bash, and other essential tools do not need to
1452be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 1453of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
1454
1455However, any other dependencies need to be specified in the
1456@code{inputs} field. Any dependency not specified here will simply be
1457unavailable to the build process, possibly leading to a build failure.
1458@end itemize
1459
3dc1970d
LC
1460Once a package definition is in place@footnote{Simple package
1461definitions like the one above may be automatically converted from the
e49951eb
MW
1462Nixpkgs distribution using the @command{guix import} command.}, the
1463package may actually be built using the @code{guix build} command-line
7458bd0a 1464tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
b4f5e0e8
CR
1465more information on how to test package definitions, and
1466@ref{Invoking guix lint}, for information on how to check a definition
1467for style conformance.
1468
7458bd0a
LC
1469
1470Eventually, updating the package definition to a new upstream version
1471can be partly automated by the @command{guix refresh} command
1472(@pxref{Invoking guix refresh}).
3dc1970d
LC
1473
1474Behind the scenes, a derivation corresponding to the @code{<package>}
1475object is first computed by the @code{package-derivation} procedure.
834129e0 1476That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 1477The build actions it prescribes may then be realized by using the
3dc1970d
LC
1478@code{build-derivations} procedure (@pxref{The Store}).
1479
1480@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1481Return the @code{<derivation>} object of @var{package} for @var{system}
1482(@pxref{Derivations}).
3dc1970d
LC
1483
1484@var{package} must be a valid @code{<package>} object, and @var{system}
1485must be a string denoting the target system type---e.g.,
1486@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1487must be a connection to the daemon, which operates on the store
1488(@pxref{The Store}).
1489@end deffn
568717fd 1490
9c1edabd
LC
1491@noindent
1492@cindex cross-compilation
1493Similarly, it is possible to compute a derivation that cross-builds a
1494package for some other system:
1495
1496@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1497 @var{package} @var{target} [@var{system}]
59688fc4
LC
1498Return the @code{<derivation>} object of @var{package} cross-built from
1499@var{system} to @var{target}.
9c1edabd
LC
1500
1501@var{target} must be a valid GNU triplet denoting the target hardware
1502and operating system, such as @code{"mips64el-linux-gnu"}
1503(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1504Configure and Build System}).
1505@end deffn
1506
1507
7458bd0a
LC
1508@node Build Systems
1509@section Build Systems
1510
1511@cindex build system
1512Each package definition specifies a @dfn{build system} and arguments for
1513that build system (@pxref{Defining Packages}). This @code{build-system}
1514field represents the build procedure of the package, as well implicit
1515dependencies of that build procedure.
1516
1517Build systems are @code{<build-system>} objects. The interface to
1518create and manipulate them is provided by the @code{(guix build-system)}
1519module, and actual build systems are exported by specific modules.
1520
1521Build systems accept an optional list of @dfn{arguments}. In package
1522definitions, these are passed @i{via} the @code{arguments} field
1523(@pxref{Defining Packages}). They are typically keyword arguments
1524(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
1525Guile Reference Manual}). The value of these arguments is usually
1526evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
1527by the daemon (@pxref{Derivations}).
1528
1529The main build system is @var{gnu-build-system}, which implements the
1530standard build procedure for GNU packages and many other packages. It
1531is provided by the @code{(guix build-system gnu)} module.
1532
1533@defvr {Scheme Variable} gnu-build-system
1534@var{gnu-build-system} represents the GNU Build System, and variants
1535thereof (@pxref{Configuration, configuration and makefile conventions,,
1536standards, GNU Coding Standards}).
1537
1538@cindex build phases
1539In a nutshell, packages using it configured, built, and installed with
1540the usual @code{./configure && make && make check && make install}
1541command sequence. In practice, a few additional steps are often needed.
1542All these steps are split up in separate @dfn{phases},
1543notably@footnote{Please see the @code{(guix build gnu-build-system)}
1544modules for more details about the build phases.}:
1545
1546@table @code
1547@item unpack
1548Unpack the source tarball, and change the current directory to the
1549extracted source tree. If the source is actually a directory, copy it
1550to the build tree, and enter that directory.
1551
1552@item patch-source-shebangs
1553Patch shebangs encountered in source files so they refer to the right
1554store file names. For instance, this changes @code{#!/bin/sh} to
1555@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
1556
1557@item configure
1558Run the @file{configure} script with a number of default options, such
1559as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
1560by the @code{#:configure-flags} argument.
1561
1562@item build
1563Run @code{make} with the list of flags specified with
1564@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
1565(the default), build with @code{make -j}.
1566
1567@item check
1568Run @code{make check}, or some other target specified with
1569@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
1570@code{#:parallel-tests?} argument is true (the default), run @code{make
1571check -j}.
1572
1573@item install
1574Run @code{make install} with the flags listed in @code{#:make-flags}.
1575
1576@item patch-shebangs
1577Patch shebangs on the installed executable files.
1578
1579@item strip
1580Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
1581is false), copying them to the @code{debug} output when available
1582(@pxref{Installing Debugging Files}).
1583@end table
1584
1585@vindex %standard-phases
1586The build-side module @code{(guix build gnu-build-system)} defines
1587@var{%standard-phases} as the default list of build phases.
1588@var{%standard-phases} is a list of symbol/procedure pairs, where the
1589procedure implements the actual phase.
1590
1591The list of phases used for a particular package can be changed with the
1592@code{#:phases} parameter. For instance, passing:
1593
1594@example
1595#:phases (alist-delete 'configure %standard-phases)
1596@end example
1597
9bf404e9 1598means that all the phases described above will be used, except the
7458bd0a
LC
1599@code{configure} phase.
1600
1601In addition, this build system ensures that the ``standard'' environment
1602for GNU packages is available. This includes tools such as GCC, libc,
1603Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
1604build-system gnu)} module for a complete list.) We call these the
1605@dfn{implicit inputs} of a package, because package definitions don't
1606have to mention them.
1607@end defvr
1608
1609Other @code{<build-system>} objects are defined to support other
1610conventions and tools used by free software packages. They inherit most
1611of @var{gnu-build-system}, and differ mainly in the set of inputs
1612implicitly added to the build process, and in the list of phases
1613executed. Some of these build systems are listed below.
1614
1615@defvr {Scheme Variable} cmake-build-system
1616This variable is exported by @code{(guix build-system cmake)}. It
1617implements the build procedure for packages using the
1618@url{http://www.cmake.org, CMake build tool}.
1619
1620It automatically adds the @code{cmake} package to the set of inputs.
1621Which package is used can be specified with the @code{#:cmake}
1622parameter.
1623@end defvr
1624
1625@defvr {Scheme Variable} python-build-system
1626This variable is exported by @code{(guix build-system python)}. It
1627implements the more or less standard build procedure used by Python
1628packages, which consists in running @code{python setup.py build} and
1629then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
1630
1631For packages that install stand-alone Python programs under @code{bin/},
1632it takes care of wrapping these programs so their @code{PYTHONPATH}
1633environment variable points to all the Python libraries they depend on.
1634
1635Which Python package is used can be specified with the @code{#:python}
1636parameter.
1637@end defvr
1638
1639@defvr {Scheme Variable} perl-build-system
1640This variable is exported by @code{(guix build-system perl)}. It
1641implements the standard build procedure for Perl packages, which
1642consists in running @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}},
1643followed by @code{make} and @code{make install}.
1644
1645The initial @code{perl Makefile.PL} invocation passes flags specified by
1646the @code{#:make-maker-flags} parameter.
1647
1648Which Perl package is used can be specified with @code{#:perl}.
1649@end defvr
1650
1651
1652Lastly, for packages that do not need anything as sophisticated, a
1653``trivial'' build system is provided. It is trivial in the sense that
1654it provides basically no support: it does not pull any implicit inputs,
1655and does not have a notion of build phases.
1656
1657@defvr {Scheme Variable} trivial-build-system
1658This variable is exported by @code{(guix build-system trivial)}.
1659
1660This build system requires a @code{#:builder} argument. This argument
1661must be a Scheme expression that builds the package's output(s)---as
1662with @code{build-expression->derivation} (@pxref{Derivations,
1663@code{build-expression->derivation}}).
1664@end defvr
1665
568717fd
LC
1666@node The Store
1667@section The Store
1668
e531ac2a
LC
1669@cindex store
1670@cindex store paths
1671
1672Conceptually, the @dfn{store} is where derivations that have been
834129e0 1673successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a
LC
1674Sub-directories in the store are referred to as @dfn{store paths}. The
1675store has an associated database that contains information such has the
1676store paths referred to by each store path, and the list of @emph{valid}
1677store paths---paths that result from a successful build.
1678
1679The store is always accessed by the daemon on behalf of its clients
1680(@pxref{Invoking guix-daemon}). To manipulate the store, clients
1681connect to the daemon over a Unix-domain socket, send it requests, and
1682read the result---these are remote procedure calls, or RPCs.
1683
1684The @code{(guix store)} module provides procedures to connect to the
1685daemon, and to perform RPCs. These are described below.
1686
1687@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
1688Connect to the daemon over the Unix-domain socket at @var{file}. When
1689@var{reserve-space?} is true, instruct it to reserve a little bit of
1690extra space on the file system so that the garbage collector can still
1691operate, should the disk become full. Return a server object.
1692
1693@var{file} defaults to @var{%default-socket-path}, which is the normal
1694location given the options that were passed to @command{configure}.
1695@end deffn
1696
1697@deffn {Scheme Procedure} close-connection @var{server}
1698Close the connection to @var{server}.
1699@end deffn
1700
1701@defvr {Scheme Variable} current-build-output-port
1702This variable is bound to a SRFI-39 parameter, which refers to the port
1703where build and error logs sent by the daemon should be written.
1704@end defvr
1705
1706Procedures that make RPCs all take a server object as their first
1707argument.
1708
1709@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
1710Return @code{#t} when @var{path} is a valid store path.
1711@end deffn
1712
cfbf9160 1713@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
1714Add @var{text} under file @var{name} in the store, and return its store
1715path. @var{references} is the list of store paths referred to by the
1716resulting store path.
1717@end deffn
1718
874e6874 1719@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
1720Build @var{derivations} (a list of @code{<derivation>} objects or
1721derivation paths), and return when the worker is done building them.
1722Return @code{#t} on success.
874e6874
LC
1723@end deffn
1724
b860f382
LC
1725Note that the @code{(guix monads)} module provides a monad as well as
1726monadic versions of the above procedures, with the goal of making it
1727more convenient to work with code that accesses the store (@pxref{The
1728Store Monad}).
1729
e531ac2a
LC
1730@c FIXME
1731@i{This section is currently incomplete.}
568717fd
LC
1732
1733@node Derivations
1734@section Derivations
1735
874e6874
LC
1736@cindex derivations
1737Low-level build actions and the environment in which they are performed
1738are represented by @dfn{derivations}. A derivation contain the
1739following pieces of information:
1740
1741@itemize
1742@item
1743The outputs of the derivation---derivations produce at least one file or
1744directory in the store, but may produce more.
1745
1746@item
1747The inputs of the derivations, which may be other derivations or plain
1748files in the store (patches, build scripts, etc.)
1749
1750@item
1751The system type targeted by the derivation---e.g., @code{x86_64-linux}.
1752
1753@item
1754The file name of a build script in the store, along with the arguments
1755to be passed.
1756
1757@item
1758A list of environment variables to be defined.
1759
1760@end itemize
1761
1762@cindex derivation path
1763Derivations allow clients of the daemon to communicate build actions to
1764the store. They exist in two forms: as an in-memory representation,
1765both on the client- and daemon-side, and as files in the store whose
1766name end in @code{.drv}---these files are referred to as @dfn{derivation
1767paths}. Derivations paths can be passed to the @code{build-derivations}
1768procedure to perform the build actions they prescribe (@pxref{The
1769Store}).
1770
1771The @code{(guix derivations)} module provides a representation of
1772derivations as Scheme objects, along with procedures to create and
1773otherwise manipulate derivations. The lowest-level primitive to create
1774a derivation is the @code{derivation} procedure:
1775
1909431c
LC
1776@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
1777 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 1778 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 1779 [#:system (%current-system)] [#:references-graphs #f] @
b53be755 1780 [#:allowed-references #f] [#:local-build? #f]
59688fc4
LC
1781Build a derivation with the given arguments, and return the resulting
1782@code{<derivation>} object.
874e6874 1783
2096ef47 1784When @var{hash} and @var{hash-algo} are given, a
874e6874 1785@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
1786known in advance, such as a file download. If, in addition,
1787@var{recursive?} is true, then that fixed output may be an executable
1788file or a directory and @var{hash} must be the hash of an archive
1789containing this output.
5b0c9d16 1790
858e9282 1791When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
1792name/store path pairs. In that case, the reference graph of each store
1793path is exported in the build environment in the corresponding file, in
1794a simple text format.
1909431c 1795
b53be755
LC
1796When @var{allowed-references} is true, it must be a list of store items
1797or outputs that the derivation's output may refer to.
1798
1909431c
LC
1799When @var{local-build?} is true, declare that the derivation is not a
1800good candidate for offloading and should rather be built locally
1801(@pxref{Daemon Offload Setup}). This is the case for small derivations
1802where the costs of data transfers would outweigh the benefits.
874e6874
LC
1803@end deffn
1804
1805@noindent
1806Here's an example with a shell script as its builder, assuming
1807@var{store} is an open connection to the daemon, and @var{bash} points
1808to a Bash executable in the store:
1809
1810@lisp
1811(use-modules (guix utils)
1812 (guix store)
1813 (guix derivations))
1814
59688fc4
LC
1815(let ((builder ; add the Bash script to the store
1816 (add-text-to-store store "my-builder.sh"
1817 "echo hello world > $out\n" '())))
1818 (derivation store "foo"
1819 bash `("-e" ,builder)
21b679f6 1820 #:inputs `((,bash) (,builder))
59688fc4 1821 #:env-vars '(("HOME" . "/homeless"))))
834129e0 1822@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
1823@end lisp
1824
21b679f6
LC
1825As can be guessed, this primitive is cumbersome to use directly. A
1826better approach is to write build scripts in Scheme, of course! The
1827best course of action for that is to write the build code as a
1828``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 1829information, @pxref{G-Expressions}.
21b679f6
LC
1830
1831Once upon a time, @code{gexp->derivation} did not exist and constructing
1832derivations with build code written in Scheme was achieved with
1833@code{build-expression->derivation}, documented below. This procedure
1834is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 1835
dd1a5a15
LC
1836@deffn {Scheme Procedure} build-expression->derivation @var{store} @
1837 @var{name} @var{exp} @
1838 [#:system (%current-system)] [#:inputs '()] @
1839 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 1840 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824
LC
1841 [#:references-graphs #f] [#:allowed-references #f] @
1842 [#:local-build? #f] [#:guile-for-build #f]
874e6874
LC
1843Return a derivation that executes Scheme expression @var{exp} as a
1844builder for derivation @var{name}. @var{inputs} must be a list of
1845@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
1846@code{"out"} is assumed. @var{modules} is a list of names of Guile
1847modules from the current search path to be copied in the store,
1848compiled, and made available in the load path during the execution of
1849@var{exp}---e.g., @code{((guix build utils) (guix build
1850gnu-build-system))}.
1851
1852@var{exp} is evaluated in an environment where @code{%outputs} is bound
1853to a list of output/path pairs, and where @code{%build-inputs} is bound
1854to a list of string/output-path pairs made from @var{inputs}.
1855Optionally, @var{env-vars} is a list of string pairs specifying the name
1856and value of environment variables visible to the builder. The builder
1857terminates by passing the result of @var{exp} to @code{exit}; thus, when
1858@var{exp} returns @code{#f}, the build is considered to have failed.
1859
1860@var{exp} is built using @var{guile-for-build} (a derivation). When
1861@var{guile-for-build} is omitted or is @code{#f}, the value of the
1862@code{%guile-for-build} fluid is used instead.
9c629a27 1863
63a42824
LC
1864See the @code{derivation} procedure for the meaning of
1865@var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
874e6874
LC
1866@end deffn
1867
1868@noindent
1869Here's an example of a single-output derivation that creates a directory
1870containing one file:
1871
1872@lisp
1873(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 1874 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
1875 (call-with-output-file (string-append out "/test")
1876 (lambda (p)
1877 (display '(hello guix) p))))))
dd1a5a15 1878 (build-expression->derivation store "goo" builder))
874e6874 1879
834129e0 1880@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
1881@end lisp
1882
568717fd 1883
b860f382
LC
1884@node The Store Monad
1885@section The Store Monad
1886
1887@cindex monad
1888
1889The procedures that operate on the store described in the previous
1890sections all take an open connection to the build daemon as their first
1891argument. Although the underlying model is functional, they either have
1892side effects or depend on the current state of the store.
1893
1894The former is inconvenient: the connection to the build daemon has to be
1895carried around in all those functions, making it impossible to compose
1896functions that do not take that parameter with functions that do. The
1897latter can be problematic: since store operations have side effects
1898and/or depend on external state, they have to be properly sequenced.
1899
1900@cindex monadic values
1901@cindex monadic functions
1902This is where the @code{(guix monads)} module comes in. This module
1903provides a framework for working with @dfn{monads}, and a particularly
1904useful monad for our uses, the @dfn{store monad}. Monads are a
1905construct that allows two things: associating ``context'' with values
1906(in our case, the context is the store), and building sequences of
1907computations (here computations includes accesses to the store.) Values
1908in a monad---values that carry this additional context---are called
1909@dfn{monadic values}; procedures that return such values are called
1910@dfn{monadic procedures}.
1911
1912Consider this ``normal'' procedure:
1913
1914@example
45adbd62
LC
1915(define (sh-symlink store)
1916 ;; Return a derivation that symlinks the 'bash' executable.
1917 (let* ((drv (package-derivation store bash))
1918 (out (derivation->output-path drv))
1919 (sh (string-append out "/bin/bash")))
1920 (build-expression->derivation store "sh"
1921 `(symlink ,sh %output))))
b860f382
LC
1922@end example
1923
1924Using @code{(guix monads)}, it may be rewritten as a monadic function:
1925
ada3df03 1926@c FIXME: Find a better example, one that uses 'mlet'.
b860f382 1927@example
45adbd62 1928(define (sh-symlink)
b860f382 1929 ;; Same, but return a monadic value.
ada3df03
LC
1930 (gexp->derivation "sh"
1931 #~(symlink (string-append #$bash "/bin/bash") #$output)))
b860f382
LC
1932@end example
1933
1934There are two things to note in the second version: the @code{store}
1935parameter is now implicit, and the monadic value returned by
1936@code{package-file}---a wrapper around @code{package-derivation} and
1937@code{derivation->output-path}---is @dfn{bound} using @code{mlet}
1938instead of plain @code{let}.
1939
1940Calling the monadic @code{profile.sh} has no effect. To get the desired
1941effect, one must use @code{run-with-store}:
1942
1943@example
1944(run-with-store (open-connection) (profile.sh))
834129e0 1945@result{} /gnu/store/...-profile.sh
b860f382
LC
1946@end example
1947
b9b86078
LC
1948Note that the @code{(guix monad-repl)} module extends Guile's REPL with
1949new ``meta-commands'' to make it easier to deal with monadic procedures:
1950@code{run-in-store}, and @code{enter-store-monad}. The former, is used
1951to ``run'' a single monadic value through the store:
1952
1953@example
1954scheme@@(guile-user)> ,run-in-store (package->derivation hello)
1955$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
1956@end example
1957
1958The latter enters a recursive REPL, where all the return values are
1959automatically run through the store:
1960
1961@example
1962scheme@@(guile-user)> ,enter-store-monad
1963store-monad@@(guile-user) [1]> (package->derivation hello)
1964$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
1965store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
1966$3 = "/gnu/store/@dots{}-foo"
1967store-monad@@(guile-user) [1]> ,q
1968scheme@@(guile-user)>
1969@end example
1970
1971@noindent
1972Note that non-monadic values cannot be returned in the
1973@code{store-monad} REPL.
1974
b860f382
LC
1975The main syntactic forms to deal with monads in general are described
1976below.
1977
1978@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
1979Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
1980in @var{monad}.
1981@end deffn
1982
1983@deffn {Scheme Syntax} return @var{val}
1984Return a monadic value that encapsulates @var{val}.
1985@end deffn
1986
1987@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
1988@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
1989procedure @var{mproc}@footnote{This operation is commonly referred to as
1990``bind'', but that name denotes an unrelated procedure in Guile. Thus
1991we use this somewhat cryptic symbol inherited from the Haskell
1992language.}.
1993@end deffn
1994
1995@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
1996 @var{body} ...
1997@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
1998 @var{body} ...
1999Bind the variables @var{var} to the monadic values @var{mval} in
2000@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2001``normal'' value @var{val}, as per @code{let}.
2002
2003@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2004(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2005@end deffn
2006
2007The interface to the store monad provided by @code{(guix monads)} is as
2008follows.
2009
2010@defvr {Scheme Variable} %store-monad
2011The store monad. Values in the store monad encapsulate accesses to the
2012store. When its effect is needed, a value of the store monad must be
2013``evaluated'' by passing it to the @code{run-with-store} procedure (see
2014below.)
2015@end defvr
2016
2017@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2018Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2019open store connection.
2020@end deffn
2021
2022@deffn {Monadic Procedure} text-file @var{name} @var{text}
2023Return as a monadic value the absolute file name in the store of the file
45adbd62
LC
2024containing @var{text}, a string.
2025@end deffn
2026
2027@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
2028Return as a monadic value a derivation that builds a text file
2029containing all of @var{text}. @var{text} may list, in addition to
2030strings, packages, derivations, and store file names; the resulting
2031store file holds references to all these.
2032
2033This variant should be preferred over @code{text-file} anytime the file
2034to create will reference items from the store. This is typically the
2035case when building a configuration file that embeds store file names,
2036like this:
2037
2038@example
2039(define (profile.sh)
2040 ;; Return the name of a shell script in the store that
2041 ;; initializes the 'PATH' environment variable.
2042 (text-file* "profile.sh"
2043 "export PATH=" coreutils "/bin:"
2044 grep "/bin:" sed "/bin\n"))
2045@end example
2046
834129e0 2047In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
45adbd62
LC
2048will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
2049preventing them from being garbage-collected during its lifetime.
b860f382
LC
2050@end deffn
2051
0a90af15
LC
2052@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2053 [#:recursive? #t]
2054Return the name of @var{file} once interned in the store. Use
2055@var{name} as its store name, or the basename of @var{file} if
2056@var{name} is omitted.
2057
2058When @var{recursive?} is true, the contents of @var{file} are added
2059recursively; if @var{file} designates a flat file and @var{recursive?}
2060is true, its contents are added, and its permission bits are kept.
2061
2062The example below adds a file to the store, under two different names:
2063
2064@example
2065(run-with-store (open-connection)
2066 (mlet %store-monad ((a (interned-file "README"))
2067 (b (interned-file "README" "LEGU-MIN")))
2068 (return (list a b))))
2069
2070@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2071@end example
2072
2073@end deffn
2074
b860f382 2075@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
2076 [#:system (%current-system)] [#:target #f] @
2077 [#:output "out"] Return as a monadic
b860f382
LC
2078value in the absolute file name of @var{file} within the @var{output}
2079directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
2080of the @var{output} directory of @var{package}. When @var{target} is
2081true, use it as a cross-compilation target triplet.
b860f382
LC
2082@end deffn
2083
b860f382 2084@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
2085@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2086 @var{target} [@var{system}]
2087Monadic version of @code{package-derivation} and
2088@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
2089@end deffn
2090
2091
21b679f6
LC
2092@node G-Expressions
2093@section G-Expressions
2094
2095@cindex G-expression
2096@cindex build code quoting
2097So we have ``derivations'', which represent a sequence of build actions
2098to be performed to produce an item in the store (@pxref{Derivations}).
2099Those build actions are performed when asking the daemon to actually
2100build the derivations; they are run by the daemon in a container
2101(@pxref{Invoking guix-daemon}).
2102
2103@cindex strata of code
2104It should come as no surprise that we like to write those build actions
2105in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2106code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
2107Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2108Kiselyov, who has written insightful
2109@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2110on this topic}, refers to this kind of code generation as
2111@dfn{staging}.}: the ``host code''---code that defines packages, talks
2112to the daemon, etc.---and the ``build code''---code that actually
2113performs build actions, such as making directories, invoking
2114@command{make}, etc.
21b679f6
LC
2115
2116To describe a derivation and its build actions, one typically needs to
2117embed build code inside host code. It boils down to manipulating build
2118code as data, and Scheme's homoiconicity---code has a direct
2119representation as data---comes in handy for that. But we need more than
2120Scheme's normal @code{quasiquote} mechanism to construct build
2121expressions.
2122
2123The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2124S-expressions adapted to build expressions. G-expressions, or
2125@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2126@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2127@code{#$}, and @code{#$@@}), which are comparable respectively to
2128@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2129(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2130Reference Manual}). However, there are major differences:
2131
2132@itemize
2133@item
2134Gexps are meant to be written to a file and run or manipulated by other
2135processes.
2136
2137@item
2138When a package or derivation is unquoted inside a gexp, the result is as
2139if its output file name had been introduced.
2140
2141@item
2142Gexps carry information about the packages or derivations they refer to,
2143and these dependencies are automatically added as inputs to the build
2144processes that use them.
2145@end itemize
2146
2147To illustrate the idea, here is an example of a gexp:
2148
2149@example
2150(define build-exp
2151 #~(begin
2152 (mkdir #$output)
2153 (chdir #$output)
2154 (symlink (string-append #$coreutils "/bin/ls")
2155 "list-files")))
2156@end example
2157
2158This gexp can be passed to @code{gexp->derivation}; we obtain a
2159derivation that builds a directory containing exactly one symlink to
2160@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2161
2162@example
2163(gexp->derivation "the-thing" build-exp)
2164@end example
2165
e20fd1bf 2166As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
2167substituted to the reference to the @var{coreutils} package in the
2168actual build code, and @var{coreutils} is automatically made an input to
2169the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2170output)}) is replaced by a string containing the derivation's output
667b2508
LC
2171directory name.
2172
2173@cindex cross compilation
2174In a cross-compilation context, it is useful to distinguish between
2175references to the @emph{native} build of a package---that can run on the
2176host---versus references to cross builds of a package. To that end, the
2177@code{#+} plays the same role as @code{#$}, but is a reference to a
2178native package build:
2179
2180@example
2181(gexp->derivation "vi"
2182 #~(begin
2183 (mkdir #$output)
2184 (system* (string-append #+coreutils "/bin/ln")
2185 "-s"
2186 (string-append #$emacs "/bin/emacs")
2187 (string-append #$output "/bin/vi")))
2188 #:target "mips64el-linux")
2189@end example
2190
2191@noindent
2192In the example above, the native build of @var{coreutils} is used, so
2193that @command{ln} can actually run on the host; but then the
2194cross-compiled build of @var{emacs} is referenced.
2195
2196The syntactic form to construct gexps is summarized below.
21b679f6
LC
2197
2198@deffn {Scheme Syntax} #~@var{exp}
2199@deffnx {Scheme Syntax} (gexp @var{exp})
2200Return a G-expression containing @var{exp}. @var{exp} may contain one
2201or more of the following forms:
2202
2203@table @code
2204@item #$@var{obj}
2205@itemx (ungexp @var{obj})
2206Introduce a reference to @var{obj}. @var{obj} may be a package or a
2207derivation, in which case the @code{ungexp} form is replaced by its
2208output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2209
2210If @var{obj} is a list, it is traversed and any package or derivation
2211references are substituted similarly.
2212
2213If @var{obj} is another gexp, its contents are inserted and its
2214dependencies are added to those of the containing gexp.
2215
2216If @var{obj} is another kind of object, it is inserted as is.
2217
2218@item #$@var{package-or-derivation}:@var{output}
2219@itemx (ungexp @var{package-or-derivation} @var{output})
2220This is like the form above, but referring explicitly to the
2221@var{output} of @var{package-or-derivation}---this is useful when
2222@var{package-or-derivation} produces multiple outputs (@pxref{Packages
2223with Multiple Outputs}).
2224
667b2508
LC
2225@item #+@var{obj}
2226@itemx #+@var{obj}:output
2227@itemx (ungexp-native @var{obj})
2228@itemx (ungexp-native @var{obj} @var{output})
2229Same as @code{ungexp}, but produces a reference to the @emph{native}
2230build of @var{obj} when used in a cross compilation context.
2231
21b679f6
LC
2232@item #$output[:@var{output}]
2233@itemx (ungexp output [@var{output}])
2234Insert a reference to derivation output @var{output}, or to the main
2235output when @var{output} is omitted.
2236
2237This only makes sense for gexps passed to @code{gexp->derivation}.
2238
2239@item #$@@@var{lst}
2240@itemx (ungexp-splicing @var{lst})
2241Like the above, but splices the contents of @var{lst} inside the
2242containing list.
2243
667b2508
LC
2244@item #+@@@var{lst}
2245@itemx (ungexp-native-splicing @var{lst})
2246Like the above, but refers to native builds of the objects listed in
2247@var{lst}.
2248
21b679f6
LC
2249@end table
2250
2251G-expressions created by @code{gexp} or @code{#~} are run-time objects
2252of the @code{gexp?} type (see below.)
2253@end deffn
2254
2255@deffn {Scheme Procedure} gexp? @var{obj}
2256Return @code{#t} if @var{obj} is a G-expression.
2257@end deffn
2258
2259G-expressions are meant to be written to disk, either as code building
2260some derivation, or as plain files in the store. The monadic procedures
2261below allow you to do that (@pxref{The Store Monad}, for more
2262information about monads.)
2263
2264@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
68a61e9f 2265 [#:system (%current-system)] [#:target #f] [#:inputs '()] @
21b679f6
LC
2266 [#:hash #f] [#:hash-algo #f] @
2267 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
2268 [#:references-graphs #f] [#:local-build? #f] @
2269 [#:guile-for-build #f]
2270Return a derivation @var{name} that runs @var{exp} (a gexp) with
68a61e9f
LC
2271@var{guile-for-build} (a derivation) on @var{system}. When @var{target}
2272is true, it is used as the cross-compilation target triplet for packages
2273referred to by @var{exp}.
21b679f6
LC
2274
2275Make @var{modules} available in the evaluation context of @var{EXP};
2276@var{MODULES} is a list of names of Guile modules from the current
2277search path to be copied in the store, compiled, and made available in
2278the load path during the execution of @var{exp}---e.g., @code{((guix
2279build utils) (guix build gnu-build-system))}.
2280
b53833b2
LC
2281When @var{references-graphs} is true, it must be a list of tuples of one of the
2282following forms:
2283
2284@example
2285(@var{file-name} @var{package})
2286(@var{file-name} @var{package} @var{output})
2287(@var{file-name} @var{derivation})
2288(@var{file-name} @var{derivation} @var{output})
2289(@var{file-name} @var{store-item})
2290@end example
2291
2292The right-hand-side of each element of @var{references-graphs} is automatically made
2293an input of the build process of @var{exp}. In the build environment, each
2294@var{file-name} contains the reference graph of the corresponding item, in a simple
2295text format.
2296
e20fd1bf 2297The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
2298@end deffn
2299
2300@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
2301Return an executable script @var{name} that runs @var{exp} using
2302@var{guile} with @var{modules} in its search path.
2303
2304The example below builds a script that simply invokes the @command{ls}
2305command:
2306
2307@example
2308(use-modules (guix gexp) (gnu packages base))
2309
2310(gexp->script "list-files"
2311 #~(execl (string-append #$coreutils "/bin/ls")
2312 "ls"))
2313@end example
2314
2315When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 2316@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
2317executable file @file{/gnu/store/@dots{}-list-files} along these lines:
2318
2319@example
2320#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
2321!#
2322(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
2323 "ls")
2324@end example
2325@end deffn
2326
2327@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
2328Return a derivation that builds a file @var{name} containing @var{exp}.
2329
2330The resulting file holds references to all the dependencies of @var{exp}
2331or a subset thereof.
2332@end deffn
2333
2334Of course, in addition to gexps embedded in ``host'' code, there are
2335also modules containing build tools. To make it clear that they are
2336meant to be used in the build stratum, these modules are kept in the
2337@code{(guix build @dots{})} name space.
2338
2339
568717fd
LC
2340@c *********************************************************************
2341@node Utilities
2342@chapter Utilities
2343
210cc920
LC
2344This section describes tools primarily targeted at developers and users
2345who write new package definitions. They complement the Scheme
2346programming interface of Guix in a convenient way.
2347
568717fd 2348@menu
37166310 2349* Invoking guix build:: Building packages from the command line.
210cc920 2350* Invoking guix download:: Downloading a file and printing its hash.
37166310
LC
2351* Invoking guix hash:: Computing the cryptographic hash of a file.
2352* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 2353* Invoking guix lint:: Finding errors in package definitions.
568717fd
LC
2354@end menu
2355
e49951eb
MW
2356@node Invoking guix build
2357@section Invoking @command{guix build}
568717fd 2358
e49951eb 2359The @command{guix build} command builds packages or derivations and
6798a8e4
LC
2360their dependencies, and prints the resulting store paths. Note that it
2361does not modify the user's profile---this is the job of the
e49951eb 2362@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
2363it is mainly useful for distribution developers.
2364
2365The general syntax is:
c78bd12b
LC
2366
2367@example
e49951eb 2368guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
2369@end example
2370
2371@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
2372the software distribution such as @code{coreutils} or
2373@code{coreutils-8.20}, or a derivation such as
834129e0 2374@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
2375package with the corresponding name (and optionally version) is searched
2376for among the GNU distribution modules (@pxref{Package Modules}).
2377
2378Alternatively, the @code{--expression} option may be used to specify a
2379Scheme expression that evaluates to a package; this is useful when
2380disambiguation among several same-named packages or package variants is
2381needed.
c78bd12b
LC
2382
2383The @var{options} may be zero or more of the following:
2384
2385@table @code
2386
2387@item --expression=@var{expr}
2388@itemx -e @var{expr}
ac5de156 2389Build the package or derivation @var{expr} evaluates to.
c78bd12b 2390
5401dd75 2391For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
2392guile-1.8)}, which unambiguously designates this specific variant of
2393version 1.8 of Guile.
2394
56b82106
LC
2395Alternately, @var{expr} may be a G-expression, in which case it is used
2396as a build program passed to @code{gexp->derivation}
2397(@pxref{G-Expressions}).
2398
2399Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
2400(@pxref{The Store Monad}). The procedure must return a derivation as a
2401monadic value, which is then passed through @code{run-with-store}.
2402
c78bd12b
LC
2403@item --source
2404@itemx -S
2405Build the packages' source derivations, rather than the packages
2406themselves.
2407
e49951eb 2408For instance, @code{guix build -S gcc} returns something like
834129e0 2409@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 2410
f9cc8971
LC
2411The returned source tarball is the result of applying any patches and
2412code snippets specified in the package's @code{origin} (@pxref{Defining
2413Packages}).
2414
c78bd12b
LC
2415@item --system=@var{system}
2416@itemx -s @var{system}
2417Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
2418the host's system type.
2419
2420An example use of this is on Linux-based systems, which can emulate
2421different personalities. For instance, passing
2422@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
2423to build packages in a complete 32-bit environment.
2424
e55ec43d
LC
2425@item --target=@var{triplet}
2426@cindex cross-compilation
2427Cross-build for @var{triplet}, which must be a valid GNU triplet, such
2428as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
2429configuration triplets,, configure, GNU Configure and Build System}).
2430
7f3673f2
LC
2431@item --with-source=@var{source}
2432Use @var{source} as the source of the corresponding package.
2433@var{source} must be a file name or a URL, as for @command{guix
2434download} (@pxref{Invoking guix download}).
2435
2436The ``corresponding package'' is taken to be one specified on the
2437command line whose name matches the base of @var{source}---e.g., if
2438@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
2439package is @code{guile}. Likewise, the version string is inferred from
2440@var{source}; in the previous example, it's @code{2.0.10}.
2441
2442This option allows users to try out versions of packages other than the
2443one provided by the distribution. The example below downloads
2444@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
2445the @code{ed} package:
2446
2447@example
2448guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
2449@end example
2450
2451As a developer, @code{--with-source} makes it easy to test release
2452candidates:
2453
2454@example
2455guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
2456@end example
2457
2458
c78bd12b
LC
2459@item --derivations
2460@itemx -d
2461Return the derivation paths, not the output paths, of the given
2462packages.
2463
70ee5642
LC
2464@item --root=@var{file}
2465@itemx -r @var{file}
2466Make @var{file} a symlink to the result, and register it as a garbage
2467collector root.
2468
2469@item --log-file
2470Return the build log file names for the given
2471@var{package-or-derivation}s, or raise an error if build logs are
2472missing.
2473
2474This works regardless of how packages or derivations are specified. For
2475instance, the following invocations are equivalent:
2476
2477@example
2478guix build --log-file `guix build -d guile`
2479guix build --log-file `guix build guile`
2480guix build --log-file guile
2481guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
2482@end example
2483
2484
2485@end table
2486
2487@cindex common build options
2488In addition, a number of options that control the build process are
2489common to @command{guix build} and other commands that can spawn builds,
2490such as @command{guix package} or @command{guix archive}. These are the
2491following:
2492
2493@table @code
2494
300868ba
LC
2495@item --load-path=@var{directory}
2496@itemx -L @var{directory}
2497Add @var{directory} to the front of the package module search path
2498(@pxref{Package Modules}).
2499
2500This allows users to define their own packages and make them visible to
2501the command-line tools.
2502
c78bd12b
LC
2503@item --keep-failed
2504@itemx -K
2505Keep the build tree of failed builds. Thus, if a build fail, its build
2506tree is kept under @file{/tmp}, in a directory whose name is shown at
2507the end of the build log. This is useful when debugging build issues.
2508
2509@item --dry-run
2510@itemx -n
2511Do not build the derivations.
2512
56b1f4b7
LC
2513@item --fallback
2514When substituting a pre-built binary fails, fall back to building
2515packages locally.
2516
c78bd12b 2517@item --no-substitutes
b5385b52 2518Do not use substitutes for build products. That is, always build things
c4202d60
LC
2519locally instead of allowing downloads of pre-built binaries
2520(@pxref{Substitutes}).
c78bd12b 2521
425b0bfc 2522@item --no-build-hook
4ec2e92d
LC
2523Do not attempt to offload builds @i{via} the daemon's ``build hook''
2524(@pxref{Daemon Offload Setup}). That is, always build things locally
2525instead of offloading builds to remote machines.
425b0bfc 2526
969e678e
LC
2527@item --max-silent-time=@var{seconds}
2528When the build or substitution process remains silent for more than
2529@var{seconds}, terminate it and report a build failure.
2530
002622b6
LC
2531@item --timeout=@var{seconds}
2532Likewise, when the build or substitution process lasts for more than
2533@var{seconds}, terminate it and report a build failure.
2534
2535By default there is no timeout. This behavior can be restored with
2536@code{--timeout=0}.
2537
07ab4bf1
LC
2538@item --verbosity=@var{level}
2539Use the given verbosity level. @var{level} must be an integer between 0
2540and 5; higher means more verbose output. Setting a level of 4 or more
2541may be helpful when debugging setup issues with the build daemon.
2542
70ee5642
LC
2543@item --cores=@var{n}
2544@itemx -c @var{n}
2545Allow the use of up to @var{n} CPU cores for the build. The special
2546value @code{0} means to use as many CPU cores as available.
bf421152 2547
c78bd12b
LC
2548@end table
2549
e49951eb 2550Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
2551the @code{package-derivation} procedure of the @code{(guix packages)}
2552module, and to the @code{build-derivations} procedure of the @code{(guix
2553store)} module.
2554
210cc920
LC
2555@node Invoking guix download
2556@section Invoking @command{guix download}
2557
2558When writing a package definition, developers typically need to download
2559the package's source tarball, compute its SHA256 hash, and write that
2560hash in the package definition (@pxref{Defining Packages}). The
2561@command{guix download} tool helps with this task: it downloads a file
2562from the given URI, adds it to the store, and prints both its file name
2563in the store and its SHA256 hash.
2564
2565The fact that the downloaded file is added to the store saves bandwidth:
2566when the developer eventually tries to build the newly defined package
2567with @command{guix build}, the source tarball will not have to be
2568downloaded again because it is already in the store. It is also a
2569convenient way to temporarily stash files, which may be deleted
2570eventually (@pxref{Invoking guix gc}).
2571
2572The @command{guix download} command supports the same URIs as used in
2573package definitions. In particular, it supports @code{mirror://} URIs.
2574@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
2575Guile bindings for GnuTLS are available in the user's environment; when
2576they are not available, an error is raised.
2577
2578The following option is available:
2579
2580@table @code
2581@item --format=@var{fmt}
2582@itemx -f @var{fmt}
2583Write the hash in the format specified by @var{fmt}. For more
2584information on the valid values for @var{fmt}, @ref{Invoking guix hash}.
2585@end table
2586
6c365eca
NK
2587@node Invoking guix hash
2588@section Invoking @command{guix hash}
2589
210cc920 2590The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
2591It is primarily a convenience tool for anyone contributing to the
2592distribution: it computes the cryptographic hash of a file, which can be
2593used in the definition of a package (@pxref{Defining Packages}).
2594
2595The general syntax is:
2596
2597@example
2598guix hash @var{option} @var{file}
2599@end example
2600
2601@command{guix hash} has the following option:
2602
2603@table @code
2604
2605@item --format=@var{fmt}
2606@itemx -f @var{fmt}
210cc920 2607Write the hash in the format specified by @var{fmt}.
6c365eca
NK
2608
2609Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
2610(@code{hex} and @code{hexadecimal} can be used as well).
2611
2612If the @option{--format} option is not specified, @command{guix hash}
2613will output the hash in @code{nix-base32}. This representation is used
2614in the definitions of packages.
2615
3140f2df
LC
2616@item --recursive
2617@itemx -r
2618Compute the hash on @var{file} recursively.
2619
2620In this case, the hash is computed on an archive containing @var{file},
2621including its children if it is a directory. Some of @var{file}'s
2622meta-data is part of the archive; for instance, when @var{file} is a
2623regular file, the hash is different depending on whether @var{file} is
2624executable or not. Meta-data such as time stamps has no impact on the
2625hash (@pxref{Invoking guix archive}).
2626@c FIXME: Replace xref above with xref to an ``Archive'' section when
2627@c it exists.
2628
6c365eca
NK
2629@end table
2630
37166310
LC
2631@node Invoking guix refresh
2632@section Invoking @command{guix refresh}
2633
2634The primary audience of the @command{guix refresh} command is developers
2635of the GNU software distribution. By default, it reports any packages
2636provided by the distribution that are outdated compared to the latest
2637upstream version, like this:
2638
2639@example
2640$ guix refresh
2641gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
2642gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
2643@end example
2644
2645It does so by browsing each package's FTP directory and determining the
2646highest version number of the source tarballs
2647therein@footnote{Currently, this only works for GNU packages.}.
2648
2649When passed @code{--update}, it modifies distribution source files to
2650update the version numbers and source tarball hashes of those packages'
2651recipes (@pxref{Defining Packages}). This is achieved by downloading
2652each package's latest source tarball and its associated OpenPGP
2653signature, authenticating the downloaded tarball against its signature
2654using @command{gpg}, and finally computing its hash. When the public
2655key used to sign the tarball is missing from the user's keyring, an
2656attempt is made to automatically retrieve it from a public key server;
2657when it's successful, the key is added to the user's keyring; otherwise,
2658@command{guix refresh} reports an error.
2659
2660The following options are supported:
2661
2662@table @code
2663
2664@item --update
2665@itemx -u
2666Update distribution source files (package recipes) in place.
2667@ref{Defining Packages}, for more information on package definitions.
2668
2669@item --select=[@var{subset}]
2670@itemx -s @var{subset}
2671Select all the packages in @var{subset}, one of @code{core} or
2672@code{non-core}.
2673
2674The @code{core} subset refers to all the packages at the core of the
2675distribution---i.e., packages that are used to build ``everything
2676else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
2677changing one of these packages in the distribution entails a rebuild of
2678all the others. Thus, such updates are an inconvenience to users in
2679terms of build time or bandwidth used to achieve the upgrade.
2680
2681The @code{non-core} subset refers to the remaining packages. It is
2682typically useful in cases where an update of the core packages would be
2683inconvenient.
2684
2685@end table
2686
2687In addition, @command{guix refresh} can be passed one or more package
2688names, as in this example:
2689
2690@example
2691guix refresh -u emacs idutils
2692@end example
2693
2694@noindent
2695The command above specifically updates the @code{emacs} and
2696@code{idutils} packages. The @code{--select} option would have no
2697effect in this case.
2698
7d193ec3
EB
2699When considering whether to upgrade a package, it is sometimes
2700convenient to know which packages would be affected by the upgrade and
2701should be checked for compatibility. For this the following option may
2702be used when passing @command{guix refresh} one or more package names:
2703
2704@table @code
2705
2706@item --list-dependent
2707@itemx -l
2708List top-level dependent packages that would need to be rebuilt as a
2709result of upgrading one or more packages.
2710
2711@end table
2712
2713Be aware that the @code{--list-dependent} option only
2714@emph{approximates} the rebuilds that would be required as a result of
2715an upgrade. More rebuilds might be required under some circumstances.
2716
2717@example
7779ab61
LC
2718$ guix refresh --list-dependent flex
2719Building the following 120 packages would ensure 213 dependent packages are rebuilt:
2720hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
2721@end example
2722
2723The command above lists a set of packages that could be built to check
2724for compatibility with an upgraded @code{flex} package.
2725
f9230085
LC
2726The following options can be used to customize GnuPG operation:
2727
2728@table @code
2729
2730@item --key-server=@var{host}
2731Use @var{host} as the OpenPGP key server when importing a public key.
2732
2733@item --gpg=@var{command}
2734Use @var{command} as the GnuPG 2.x command. @var{command} is searched
2735for in @code{$PATH}.
2736
2737@end table
2738
b4f5e0e8
CR
2739@node Invoking guix lint
2740@section Invoking @command{guix lint}
2741The @command{guix lint} is meant to help package developers avoid common
2742errors and use a consistent style. It runs a few checks on a given set of
2743packages in order to find common mistakes in their definitions.
2744
2745The general syntax is:
2746
2747@example
2748guix lint @var{options} @var{package}@dots{}
2749@end example
2750
2751If no package is given on the command line, then all packages are checked.
2752The @var{options} may be zero or more of the following:
2753
2754@table @code
2755
2756@item --list-checkers
2757@itemx -l
2758List and describe all the available checkers that will be run on packages
2759and exit.
2760
2761@end table
37166310 2762
a1ba8475
LC
2763@c *********************************************************************
2764@node GNU Distribution
2765@chapter GNU Distribution
2766
2767Guix comes with a distribution of free software@footnote{The term
2768``free'' here refers to the
2769@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
c320011d 2770users of that software}.} that forms the basis of the GNU system. This
a1ba8475
LC
2771includes core GNU packages such as GNU libc, GCC, and Binutils, as well
2772as many GNU and non-GNU applications. The complete list of available
d03bb653
LC
2773packages can be browsed
2774@url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
2775running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
2776
2777@example
e49951eb 2778guix package --list-available
a1ba8475
LC
2779@end example
2780
401c53c4
LC
2781Our goal is to build a practical 100% free software distribution of
2782Linux-based and other variants of GNU, with a focus on the promotion and
2783tight integration of GNU components, and an emphasis on programs and
2784tools that help users exert that freedom.
2785
c320011d
LC
2786The GNU distribution is currently available on the following platforms:
2787
2788@table @code
2789
2790@item x86_64-linux
2791Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
2792
2793@item i686-linux
2794Intel 32-bit architecture (IA32), Linux-Libre kernel;
2795
2796@item mips64el-linux
2797little-endian 64-bit MIPS processors, specifically the Loongson series,
2798n32 application binary interface (ABI), and Linux-Libre kernel.
2799
2800@end table
2801
2802@noindent
2803For information on porting to other architectures or kernels,
2804@xref{Porting}.
2805
401c53c4 2806@menu
5af6de3e 2807* System Installation:: Installing the whole operating system.
cf4a9129 2808* System Configuration:: Configuring a GNU system.
91ef73d4 2809* Installing Debugging Files:: Feeding the debugger.
401c53c4 2810* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 2811* Packaging Guidelines:: Growing the distribution.
401c53c4 2812* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 2813* Porting:: Targeting another platform or kernel.
401c53c4
LC
2814@end menu
2815
2816Building this distribution is a cooperative effort, and you are invited
2817to join! @ref{Contributing}, for information about how you can help.
2818
5af6de3e
LC
2819@node System Installation
2820@section System Installation
2821
2822This section explains how to install the complete GNU operating system
2823on a machine. The Guix package manager can also be installed on top of
6621cdb6 2824a running GNU/Linux system, @pxref{Installation}.
5af6de3e
LC
2825
2826@ifinfo
2827@c This paragraph is for people reading this from tty2 of the
2828@c installation image.
2829You're reading this documentation with an Info reader. For details on
2830how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 2831link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
2832@kbd{l} afterwards to come back here.
2833@end ifinfo
2834
8aaaae38
LC
2835@subsection Limitations
2836
2837As of version @value{VERSION}, GNU@tie{}Guix and the GNU system
2838distribution are alpha software. It may contain bugs and lack important
2839features. Thus, if you are looking for a stable production system that
2840respects your freedom as a computer user, a good solution at this point
2841is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
2842more established GNU/Linux distributions}. We hope you can soon switch
2843to the GNU system without fear, of course. In the meantime, you can
2844also keep using your distribution and try out the package manager on top
2845of it (@pxref{Installation}).
2846
2847Before you proceed with the installation, be aware of the following
2848noteworthy limitations applicable to version @value{VERSION}:
2849
2850@itemize
2851@item
2852The installation process does not include a graphical user interface and
2853requires familiarity with GNU/Linux (see the following subsections to
2854get a feel of what that means.)
2855
2856@item
2857The system does not yet provide graphical desktop environments such as
2858GNOME and KDE.
2859
2860@item
dbcb0ab1 2861Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
2862
2863@item
2864Few system services are currently supported out-of-the-box
2865(@pxref{Services}).
2866
2867@item
2868On the order of 1,000 packages are available, which means that you may
2869occasionally find that a useful package is missing.
2870@end itemize
2871
2872You've been warned. But more than a disclaimer, this is an invitation
2873to report issues (and success stories!), and join us in improving it.
2874@xref{Contributing}, for more info.
5af6de3e
LC
2875
2876@subsection USB Stick Installation
2877
2878An installation image for USB sticks can be downloaded from
2879@url{ftp://alpha.gnu.org/gnu/guix/gnu-usb-install-@value{VERSION}.@var{system}.xz},
2880where @var{system} is one of:
2881
2882@table @code
2883@item x86_64-linux
2884for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
2885
2886@item i686-linux
2887for a 32-bit GNU/Linux system on Intel-compatible CPUs.
2888@end table
2889
2890This image contains a single partition with the tools necessary for an
2891installation. It is meant to be copied @emph{as is} to a large-enough
2892USB stick.
2893
2894To copy the image to a USB stick, follow these steps:
2895
2896@enumerate
2897@item
2898Decompress the image using the @command{xz} command:
2899
2900@example
2901xz -d gnu-usb-install-@value{VERSION}.@var{system}.xz
2902@end example
2903
2904@item
2905Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
2906its device name. Assuming that USB stick is known as @file{/dev/sdX},
2907copy the image with:
2908
2909@example
445d6529 2910dd if=gnu-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
2911@end example
2912
2913Access to @file{/dev/sdX} usually requires root privileges.
2914@end enumerate
2915
2916Once this is done, you should be able to reboot the system and boot from
2917the USB stick. The latter usually requires you to get in the BIOS' boot
2918menu, where you can choose to boot from the USB stick.
2919
2920@subsection Preparing for Installation
2921
2922Once you have successfully booted the image on the USB stick, you should
2923end up with a root prompt. Several console TTYs are configured and can
2924be used to run commands as root. TTY2 shows this documentation,
2925browsable using the Info reader commands (@pxref{Help,,, info, Info: An
2926Introduction}).
2927
2928To install the system, you would:
2929
2930@enumerate
2931
2932@item
2933Configure the network, by running @command{dhclient eth0} (to get an
2934automatically assigned IP address from the wired network interface
2935controller), or using the @command{ifconfig} command.
2936
2937The system automatically loads drivers for your network interface
2938controllers.
2939
2940Setting up network access is almost always a requirement because the
2941image does not contain all the software and tools that may be needed.
2942
2943@item
2944Unless this has already been done, you must partition and format the
2945target partitions.
2946
7ab44369
LC
2947Preferably, assign partitions a label so that you can easily and
2948reliably refer to them in @code{file-system} declarations (@pxref{File
2949Systems}). This is typically done using the @code{-L} option of
2950@command{mkfs.ext4} and related commands.
2951
5af6de3e
LC
2952The installation image includes Parted (@pxref{Overview,,, parted, GNU
2953Parted User Manual}), @command{fdisk}, and e2fsprogs, the suite of tools
2954to manipulate ext2/ext3/ext4 file systems.
2955
83a17b62
LC
2956@item
2957Once that is done, mount the target root partition under @file{/mnt}.
2958
2959@item
2960Lastly, run @code{deco start cow-store /mnt}.
2961
2962This will make @file{/gnu/store} copy-on-write, such that packages added
2963to it during the installation phase will be written to the target disk
2964rather than kept in memory.
2965
5af6de3e
LC
2966@end enumerate
2967
5af6de3e
LC
2968
2969@subsection Proceeding with the Installation
2970
2971With the target partitions ready, you now have to edit a file and
2972provide the declaration of the operating system to be installed. To
2973that end, the installation system comes with two text editors: GNU nano
2974(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
2975It is better to store that file on the target root file system, say, as
2976@file{/mnt/etc/config.scm}.
2977
2978A minimal operating system configuration, with just the bare minimum and
1dac8566
LC
2979only a root account would look like this (on the installation system,
2980this example is available as @file{/etc/configuration-template.scm}):
5af6de3e
LC
2981
2982@example
931c132a 2983@include os-config.texi
5af6de3e
LC
2984@end example
2985
2986@noindent
2987For more information on @code{operating-system} declarations,
6621cdb6 2988@pxref{Using the Configuration System}.
5af6de3e
LC
2989
2990Once that is done, the new system must be initialized (remember that the
2991target root file system is mounted under @file{/mnt}):
2992
2993@example
2994guix system init /mnt/etc/config.scm /mnt
2995@end example
2996
2997@noindent
2998This will copy all the necessary files, and install GRUB on
2999@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 3000more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
3001downloads or builds of missing packages, which can take some time.
3002
3003Once that command has completed---and hopefully succeeded!---you can
ad14d9e7 3004run @command{reboot} and boot into the new system. Cross fingers, and
5af6de3e
LC
3005join us on @code{#guix} on the Freenode IRC network or on
3006@file{guix-devel@@gnu.org} to share your experience---good or not so
3007good.
3008
3009@subsection Building the Installation Image
3010
3011The installation image described above was built using the @command{guix
3012system} command, specifically:
3013
3014@example
3015guix system disk-image --image-size=800MiB gnu/system/install.scm
3016@end example
3017
3018@xref{Invoking guix system}, for more information. See
3019@file{gnu/system/install.scm} in the source tree for more information
3020about the installation image.
3021
cf4a9129
LC
3022@node System Configuration
3023@section System Configuration
b208a005 3024
cf4a9129
LC
3025@cindex system configuration
3026The GNU system supports a consistent whole-system configuration
3027mechanism. By that we mean that all aspects of the global system
3028configuration---such as the available system services, timezone and
3029locale settings, user accounts---are declared in a single place. Such
3030a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 3031
cf4a9129
LC
3032One of the advantages of putting all the system configuration under the
3033control of Guix is that it supports transactional system upgrades, and
3034makes it possible to roll-back to a previous system instantiation,
3035should something go wrong with the new one (@pxref{Features}). Another
3036one is that it makes it easy to replicate the exact same configuration
3037across different machines, or at different points in time, without
3038having to resort to additional administration tools layered on top of
3039the system's own tools.
3040@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 3041
cf4a9129
LC
3042This section describes this mechanism. First we focus on the system
3043administrator's viewpoint---explaining how the system is configured and
3044instantiated. Then we show how this mechanism can be extended, for
3045instance to support new system services.
91ef73d4 3046
cf4a9129
LC
3047@menu
3048* Using the Configuration System:: Customizing your GNU system.
3049* File Systems:: Configuring file system mounts.
510f9d86 3050* Mapped Devices:: Block device extra processing.
cf4a9129
LC
3051* User Accounts:: Specifying user accounts.
3052* Services:: Specifying system services.
0ae8c15a 3053* Setuid Programs:: Programs running with root privileges.
fd1b1fa2 3054* Initial RAM Disk:: Linux-Libre bootstrapping.
cf4a9129
LC
3055* Invoking guix system:: Instantiating a system configuration.
3056* Defining Services:: Adding new service definitions.
3057@end menu
91ef73d4 3058
cf4a9129
LC
3059@node Using the Configuration System
3060@subsection Using the Configuration System
64d76fa6 3061
cf4a9129
LC
3062The operating system is configured by providing an
3063@code{operating-system} declaration in a file that can then be passed to
3064the @command{guix system} command (@pxref{Invoking guix system}). A
3065simple setup, with the default system services, the default Linux-Libre
3066kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 3067
cf4a9129
LC
3068@findex operating-system
3069@lisp
3070(use-modules (gnu) ; for 'user-account', '%base-services', etc.
3071 (gnu packages emacs) ; for 'emacs'
3072 (gnu services ssh)) ; for 'lsh-service'
91ef73d4 3073
cf4a9129
LC
3074(operating-system
3075 (host-name "komputilo")
3076 (timezone "Europe/Paris")
3077 (locale "fr_FR.UTF-8")
3078 (bootloader (grub-configuration
3079 (device "/dev/sda")))
a69576ea 3080 (file-systems (cons (file-system
cf4a9129
LC
3081 (device "/dev/sda1") ; or partition label
3082 (mount-point "/")
a69576ea
LC
3083 (type "ext3"))
3084 %base-file-systems))
cf4a9129
LC
3085 (users (list (user-account
3086 (name "alice")
3087 (password "")
1c00f836 3088 (uid 1000) (group 100)
cf4a9129
LC
3089 (comment "Bob's sister")
3090 (home-directory "/home/alice"))))
3091 (packages (cons emacs %base-packages))
3092 (services (cons (lsh-service #:port 2222 #:allow-root-login? #t)
3093 %base-services)))
3094@end lisp
401c53c4 3095
cf4a9129
LC
3096This example should be self-describing. Some of the fields defined
3097above, such as @code{host-name} and @code{bootloader}, are mandatory.
3098Others, such as @code{packages} and @code{services}, can be omitted, in
3099which case they get a default value.
e7f34eb0 3100
cf4a9129
LC
3101@vindex %base-packages
3102The @code{packages} field lists
3103packages that will be globally visible on the system, for all user
3104accounts---i.e., in every user's @code{PATH} environment variable---in
3105addition to the per-user profiles (@pxref{Invoking guix package}). The
3106@var{%base-packages} variable provides all the tools one would expect
3107for basic user and administrator tasks---including the GNU Core
3108Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
3109editor, @command{find}, @command{grep}, etc. The example above adds
3110Emacs to those, taken from the @code{(gnu packages emacs)} module
3111(@pxref{Package Modules}).
e7f34eb0 3112
cf4a9129
LC
3113@vindex %base-services
3114The @code{services} field lists @dfn{system services} to be made
3115available when the system starts (@pxref{Services}).
3116The @code{operating-system} declaration above specifies that, in
3117addition to the basic services, we want the @command{lshd} secure shell
3118daemon listening on port 2222, and allowing remote @code{root} logins
3119(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
3120@code{lsh-service} arranges so that @code{lshd} is started with the
3121right command-line options, possibly with supporting configuration files
3122generated as needed (@pxref{Defining Services}).
a1ba8475 3123
cf4a9129
LC
3124Assuming the above snippet is stored in the @file{my-system-config.scm}
3125file, the @command{guix system reconfigure my-system-config.scm} command
3126instantiates that configuration, and makes it the default GRUB boot
3127entry (@pxref{Invoking guix system}). The normal way to change the
3128system's configuration is by updating this file and re-running the
3129@command{guix system} command.
b81e1947 3130
cf4a9129
LC
3131At the Scheme level, the bulk of an @code{operating-system} declaration
3132is instantiated with the following monadic procedure (@pxref{The Store
3133Monad}):
b81e1947 3134
cf4a9129
LC
3135@deffn {Monadic Procedure} operating-system-derivation os
3136Return a derivation that builds @var{os}, an @code{operating-system}
3137object (@pxref{Derivations}).
b81e1947 3138
cf4a9129
LC
3139The output of the derivation is a single directory that refers to all
3140the packages, configuration files, and other supporting files needed to
3141instantiate @var{os}.
3142@end deffn
b81e1947 3143
cf4a9129
LC
3144@node File Systems
3145@subsection File Systems
b81e1947 3146
cf4a9129
LC
3147The list of file systems to be mounted is specified in the
3148@code{file-systems} field of the operating system's declaration
3149(@pxref{Using the Configuration System}). Each file system is declared
3150using the @code{file-system} form, like this:
b81e1947
LC
3151
3152@example
cf4a9129
LC
3153(file-system
3154 (mount-point "/home")
3155 (device "/dev/sda3")
3156 (type "ext4"))
b81e1947
LC
3157@end example
3158
cf4a9129
LC
3159As usual, some of the fields are mandatory---those shown in the example
3160above---while others can be omitted. These are described below.
b81e1947 3161
cf4a9129
LC
3162@deftp {Data Type} file-system
3163Objects of this type represent file systems to be mounted. They
3164contain the following members:
5ff3c4b8 3165
cf4a9129
LC
3166@table @asis
3167@item @code{type}
3168This is a string specifying the type of the file system---e.g.,
3169@code{"ext4"}.
5ff3c4b8 3170
cf4a9129
LC
3171@item @code{mount-point}
3172This designates the place where the file system is to be mounted.
b81e1947 3173
cf4a9129
LC
3174@item @code{device}
3175This names the ``source'' of the file system. By default it is the name
3176of a node under @file{/dev}, but its meaning depends on the @code{title}
3177field described below.
401c53c4 3178
cf4a9129
LC
3179@item @code{title} (default: @code{'device})
3180This is a symbol that specifies how the @code{device} field is to be
3181interpreted.
401c53c4 3182
cf4a9129
LC
3183When it is the symbol @code{device}, then the @code{device} field is
3184interpreted as a file name; when it is @code{label}, then @code{device}
3185is interpreted as a partition label name; when it is @code{uuid},
3186@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 3187
cf4a9129
LC
3188The @code{label} and @code{uuid} options offer a way to refer to disk
3189partitions without having to hard-code their actual device name.
da7cabd4 3190
cf4a9129
LC
3191@item @code{flags} (default: @code{'()})
3192This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
3193include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
3194access to special files), @code{no-suid} (ignore setuid and setgid
3195bits), and @code{no-exec} (disallow program execution.)
da7cabd4 3196
cf4a9129
LC
3197@item @code{options} (default: @code{#f})
3198This is either @code{#f}, or a string denoting mount options.
da7cabd4 3199
cf4a9129
LC
3200@item @code{needed-for-boot?} (default: @code{#f})
3201This Boolean value indicates whether the file system is needed when
3202booting. If that is true, then the file system is mounted when the
3203initial RAM disk (initrd) is loaded. This is always the case, for
3204instance, for the root file system.
da7cabd4 3205
cf4a9129
LC
3206@item @code{check?} (default: @code{#t})
3207This Boolean indicates whether the file system needs to be checked for
3208errors before being mounted.
f9cc8971 3209
4e469051
LC
3210@item @code{create-mount-point?} (default: @code{#f})
3211When true, the mount point is created if it does not exist yet.
3212
cf4a9129
LC
3213@end table
3214@end deftp
da7cabd4 3215
a69576ea
LC
3216The @code{(gnu system file-systems)} exports the following useful
3217variables.
3218
3219@defvr {Scheme Variable} %base-file-systems
3220These are essential file systems that are required on normal systems,
3221such as @var{%devtmpfs-file-system} (see below.) Operating system
3222declarations should always contain at least these.
3223@end defvr
3224
3225@defvr {Scheme Variable} %devtmpfs-file-system
3226The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
3227requirement for udev (@pxref{Base Services, @code{udev-service}}).
3228@end defvr
3229
7f239fd3
LC
3230@defvr {Scheme Variable} %pseudo-terminal-file-system
3231This is the file system to be mounted as @file{/dev/pts}. It supports
3232@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
3233functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
3234Manual}). Pseudo-terminals are used by terminal emulators such as
3235@command{xterm}.
3236@end defvr
3237
db17ae5c
LC
3238@defvr {Scheme Variable} %shared-memory-file-system
3239This file system is mounted as @file{/dev/shm} and is used to support
3240memory sharing across processes (@pxref{Memory-mapped I/O,
3241@code{shm_open},, libc, The GNU C Library Reference Manual}).
3242@end defvr
3243
a69576ea
LC
3244@defvr {Scheme Variable} %binary-format-file-system
3245The @code{binfmt_misc} file system, which allows handling of arbitrary
3246executable file types to be delegated to user space. This requires the
3247@code{binfmt.ko} kernel module to be loaded.
3248@end defvr
3249
3250@defvr {Scheme Variable} %fuse-control-file-system
3251The @code{fusectl} file system, which allows unprivileged users to mount
3252and unmount user-space FUSE file systems. This requires the
3253@code{fuse.ko} kernel module to be loaded.
3254@end defvr
3255
510f9d86
LC
3256@node Mapped Devices
3257@subsection Mapped Devices
3258
3259@cindex device mapping
3260@cindex mapped devices
3261The Linux kernel has a notion of @dfn{device mapping}: a block device,
3262such as a hard disk partition, can be @dfn{mapped} into another device,
3263with additional processing over the data that flows through
3264it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
3265concept of a ``mapped device'' and that of a file system: both boil down
3266to @emph{translating} input/output operations made on a file to
3267operations on its backing store. Thus, the Hurd implements mapped
3268devices, like file systems, using the generic @dfn{translator} mechanism
3269(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
3270typical example is encryption device mapping: all writes to the mapped
3271device are encrypted, and all reads are deciphered, transparently.
3272
3273Mapped devices are declared using the @code{mapped-device} form:
3274
3275@example
3276(mapped-device
3277 (source "/dev/sda3")
3278 (target "home")
3279 (type luks-device-mapping))
3280@end example
3281
3282@noindent
3283@cindex disk encryption
3284@cindex LUKS
3285This example specifies a mapping from @file{/dev/sda3} to
3286@file{/dev/mapper/home} using LUKS---the
3287@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
3288standard mechanism for disk encryption. The @file{/dev/mapper/home}
3289device can then be used as the @code{device} of a @code{file-system}
3290declaration (@pxref{File Systems}). The @code{mapped-device} form is
3291detailed below.
3292
3293@deftp {Data Type} mapped-device
3294Objects of this type represent device mappings that will be made when
3295the system boots up.
3296
3297@table @code
3298@item source
3299This string specifies the name of the block device to be mapped, such as
3300@code{"/dev/sda3"}.
3301
3302@item target
3303This string specifies the name of the mapping to be established. For
3304example, specifying @code{"my-partition"} will lead to the creation of
3305the @code{"/dev/mapper/my-partition"} device.
3306
3307@item type
3308This must be a @code{mapped-device-kind} object, which specifies how
3309@var{source} is mapped to @var{target}.
3310@end table
3311@end deftp
3312
3313@defvr {Scheme Variable} luks-device-mapping
3314This defines LUKS block device encryption using the @command{cryptsetup}
3315command, from the same-named package. This relies on the
3316@code{dm-crypt} Linux kernel module.
3317@end defvr
3318
cf4a9129
LC
3319@node User Accounts
3320@subsection User Accounts
ee85f3db 3321
cf4a9129 3322User accounts are specified with the @code{user-account} form:
ee85f3db 3323
cf4a9129
LC
3324@example
3325(user-account
3326 (name "alice")
3327 (group "users")
24e752c0
LC
3328 (supplementary-groups '("wheel" ;allow use of sudo, etc.
3329 "audio" ;sound card
3330 "video" ;video devices such as webcams
3331 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
3332 (comment "Bob's sister")
3333 (home-directory "/home/alice"))
3334@end example
25083588 3335
cf4a9129
LC
3336@deftp {Data Type} user-account
3337Objects of this type represent user accounts. The following members may
3338be specified:
ee85f3db 3339
cf4a9129
LC
3340@table @asis
3341@item @code{name}
3342The name of the user account.
ee85f3db 3343
cf4a9129
LC
3344@item @code{group}
3345This is the name (a string) or identifier (a number) of the user group
3346this account belongs to.
ee85f3db 3347
cf4a9129
LC
3348@item @code{supplementary-groups} (default: @code{'()})
3349Optionally, this can be defined as a list of group names that this
3350account belongs to.
ee85f3db 3351
cf4a9129
LC
3352@item @code{uid} (default: @code{#f})
3353This is the user ID for this account (a number), or @code{#f}. In the
3354latter case, a number is automatically chosen by the system when the
3355account is created.
ee85f3db 3356
cf4a9129
LC
3357@item @code{comment} (default: @code{""})
3358A comment about the account, such as the account's owner full name.
c8c871d1 3359
cf4a9129
LC
3360@item @code{home-directory}
3361This is the name of the home directory for the account.
ee85f3db 3362
cf4a9129
LC
3363@item @code{shell} (default: Bash)
3364This is a G-expression denoting the file name of a program to be used as
3365the shell (@pxref{G-Expressions}).
ee85f3db 3366
cf4a9129
LC
3367@item @code{system?} (default: @code{#f})
3368This Boolean value indicates whether the account is a ``system''
3369account. System accounts are sometimes treated specially; for instance,
3370graphical login managers do not list them.
ee85f3db 3371
cf4a9129
LC
3372@item @code{password} (default: @code{#f})
3373Unless @code{#f}, this is the password to be used for the account.
c8c871d1 3374
cf4a9129
LC
3375@end table
3376@end deftp
ee85f3db 3377
cf4a9129 3378User group declarations are even simpler:
ee85f3db 3379
cf4a9129
LC
3380@example
3381(user-group (name "students"))
3382@end example
ee85f3db 3383
cf4a9129
LC
3384@deftp {Data Type} user-group
3385This type is for, well, user groups. There are just a few fields:
af8a56b8 3386
cf4a9129
LC
3387@table @asis
3388@item @code{name}
3389The group's name.
ee85f3db 3390
cf4a9129
LC
3391@item @code{id} (default: @code{#f})
3392The group identifier (a number). If @code{#f}, a new number is
3393automatically allocated when the group is created.
ee85f3db 3394
c8fa3426
LC
3395@item @code{system?} (default: @code{#f})
3396This Boolean value indicates whether the group is a ``system'' group.
3397System groups have low numerical IDs.
3398
cf4a9129
LC
3399@item @code{password} (default: @code{#f})
3400What, user groups can have a password? Well, apparently yes. Unless
3401@code{#f}, this field specifies the group's password.
ee85f3db 3402
cf4a9129
LC
3403@end table
3404@end deftp
401c53c4 3405
cf4a9129
LC
3406For convenience, a variable lists all the basic user groups one may
3407expect:
401c53c4 3408
cf4a9129
LC
3409@defvr {Scheme Variable} %base-groups
3410This is the list of basic user groups that users and/or packages expect
3411to be present on the system. This includes groups such as ``root'',
3412``wheel'', and ``users'', as well as groups used to control access to
3413specific devices such as ``audio'', ``disk'', and ``cdrom''.
3414@end defvr
401c53c4 3415
401c53c4 3416
cf4a9129
LC
3417@node Services
3418@subsection Services
401c53c4 3419
cf4a9129
LC
3420@cindex system services
3421An important part of preparing an @code{operating-system} declaration is
3422listing @dfn{system services} and their configuration (@pxref{Using the
3423Configuration System}). System services are typically daemons launched
3424when the system boots, or other actions needed at that time---e.g.,
3425configuring network access. They are managed by GNU@tie{}dmd
3426(@pxref{Introduction,,, dmd, GNU dmd Manual}).
401c53c4 3427
cf4a9129
LC
3428The following sections document the available services, starting with
3429the core services.
401c53c4 3430
cf4a9129
LC
3431@menu
3432* Base Services:: Essential system services.
3433* Networking Services:: Network setup, SSH daemon, etc.
3434* X Window:: Graphical display.
3435@end menu
401c53c4 3436
cf4a9129
LC
3437@node Base Services
3438@subsubsection Base Services
a1ba8475 3439
cf4a9129
LC
3440The @code{(gnu services base)} module provides definitions for the basic
3441services that one expects from the system. The services exported by
3442this module are listed below.
401c53c4 3443
cf4a9129
LC
3444@defvr {Scheme Variable} %base-services
3445This variable contains a list of basic services@footnote{Technically,
3446this is a list of monadic services. @xref{The Store Monad}.} one would
3447expect from the system: a login service (mingetty) on each tty, syslogd,
3448libc's name service cache daemon (nscd), the udev device manager, and
3449more.
401c53c4 3450
cf4a9129
LC
3451This is the default value of the @code{services} field of
3452@code{operating-system} declarations. Usually, when customizing a
3453system, you will want to append services to @var{%base-services}, like
3454this:
401c53c4 3455
cf4a9129
LC
3456@example
3457(cons* (avahi-service) (lshd-service) %base-services)
3458@end example
3459@end defvr
401c53c4 3460
cf4a9129
LC
3461@deffn {Monadic Procedure} host-name-service @var{name}
3462Return a service that sets the host name to @var{name}.
3463@end deffn
401c53c4 3464
cf4a9129
LC
3465@deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
3466 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
3467 [#:allow-empty-passwords? #f]
3468Return a service to run mingetty on @var{tty}.
401c53c4 3469
cf4a9129
LC
3470When @var{allow-empty-passwords?} is true, allow empty log-in password. When
3471@var{auto-login} is true, it must be a user name under which to log-in
3472automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
3473@var{auto-login}, in which case the user will have to press a key before the
3474login shell is launched.
401c53c4 3475
cf4a9129
LC
3476When true, @var{login-program} is a gexp or a monadic gexp denoting the name
3477of the log-in program (the default is the @code{login} program from the Shadow
3478tool suite.)
401c53c4 3479
cf4a9129
LC
3480@var{motd} is a monadic value containing a text file to use as
3481the ``message of the day''.
3482@end deffn
401c53c4 3483
cf4a9129
LC
3484@deffn {Monadic Procedure} nscd-service [#:glibc glibc]
3485Return a service that runs libc's name service cache daemon (nscd).
3486@end deffn
401c53c4 3487
cf4a9129
LC
3488@deffn {Monadic Procedure} syslog-service
3489Return a service that runs @code{syslogd} with reasonable default
3490settings.
3491@end deffn
401c53c4 3492
cf4a9129
LC
3493@deffn {Monadic Procedure} guix-service [#:guix guix] @
3494 [#:builder-group "guixbuild"] [#:build-accounts 10] @
3495 [#:authorize-hydra-key? #f] [#:use-substitutes? #t] @
3496 [#:extra-options '()]
3497Return a service that runs the build daemon from @var{guix}, and has
3498@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 3499
cf4a9129
LC
3500When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
3501provided by @var{guix} is authorized upon activation, meaning that substitutes
3502from @code{hydra.gnu.org} are used by default.
401c53c4 3503
cf4a9129
LC
3504If @var{use-substitutes?} is false, the daemon is run with
3505@option{--no-substitutes} (@pxref{Invoking guix-daemon,
3506@option{--no-substitutes}}).
401c53c4 3507
cf4a9129
LC
3508Finally, @var{extra-options} is a list of additional command-line options
3509passed to @command{guix-daemon}.
3510@end deffn
a1ba8475 3511
cf4a9129
LC
3512@deffn {Monadic Procedure} udev-service [#:udev udev]
3513Run @var{udev}, which populates the @file{/dev} directory dynamically.
3514@end deffn
401c53c4 3515
a69576ea 3516
cf4a9129
LC
3517@node Networking Services
3518@subsubsection Networking Services
401c53c4 3519
cf4a9129
LC
3520The @code{(gnu system networking)} module provides services to configure
3521the network interface.
a1ba8475 3522
a023cca8
LC
3523@cindex DHCP, networking service
3524@deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
3525Return a service that runs @var{dhcp}, a Dynamic Host Configuration
3526Protocol (DHCP) client, on all the non-loopback network interfaces.
3527@end deffn
3528
cf4a9129
LC
3529@deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
3530 [#:gateway #f] [#:name-services @code{'()}]
3531Return a service that starts @var{interface} with address @var{ip}. If
3532@var{gateway} is true, it must be a string specifying the default network
3533gateway.
3534@end deffn
8b315a6d 3535
cf4a9129
LC
3536@deffn {Monadic Procedure} tor-service [#:tor tor]
3537Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 3538
cf4a9129
LC
3539The daemon runs with the default settings (in particular the default exit
3540policy) as the @code{tor} unprivileged user.
3541@end deffn
8b315a6d 3542
4627a464
LC
3543@deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
3544 [#:interface "127.0.0.1"] [#:port 6667] @
3545 [#:extra-settings ""]
3546Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
3547acts as a gateway between IRC and chat networks.
3548
3549The daemon will listen to the interface corresponding to the IP address
3550specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
3551local clients can connect, whereas @code{0.0.0.0} means that connections can
3552come from any networking interface.
3553
3554In addition, @var{extra-settings} specifies a string to append to the
3555configuration file.
3556@end deffn
3557
3558Furthermore, @code{(gnu system ssh)} provides the following service.
8b315a6d 3559
cf4a9129
LC
3560@deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
3561 [#:interfaces '()] [#:port-number 22] @
3562 [#:allow-empty-passwords? #f] [#:root-login? #f] @
3563 [#:syslog-output? #t] [#:x11-forwarding? #t] @
3564 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
3565 [public-key-authentication? #t] [#:initialize? #f]
3566Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
3567@var{host-key} must designate a file containing the host key, and readable
3568only by root.
72e25e35 3569
cf4a9129
LC
3570When @var{initialize?} is true, automatically create the seed and host key
3571upon service activation if they do not exist yet. This may take long and
3572require interaction.
8b315a6d 3573
cf4a9129
LC
3574When @var{interfaces} is empty, lshd listens for connections on all the
3575network interfaces; otherwise, @var{interfaces} must be a list of host names
3576or addresses.
9bf3c1a7 3577
cf4a9129
LC
3578@var{allow-empty-passwords?} specifies whether to accepts log-ins with empty
3579passwords, and @var{root-login?} specifies whether to accepts log-ins as
3580root.
4af2447e 3581
cf4a9129
LC
3582The other options should be self-descriptive.
3583@end deffn
4af2447e 3584
cf4a9129
LC
3585@node X Window
3586@subsubsection X Window
68ad877c 3587
cf4a9129
LC
3588Support for the X Window graphical display system---specifically
3589Xorg---is provided by the @code{(gnu services xorg)} module. Note that
3590there is no @code{xorg-service} procedure. Instead, the X server is
3591started by the @dfn{login manager}, currently SLiM.
4af2447e 3592
cf4a9129
LC
3593@deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
3594 [#:auto-login? #f] [#:default-user ""] [#:startx]
3595Return a service that spawns the SLiM graphical login manager, which in
3596turn starts the X display server with @var{startx}, a command as returned by
3597@code{xorg-start-command}.
4af2447e 3598
cf4a9129
LC
3599When @var{allow-empty-passwords?} is true, allow logins with an empty
3600password. When @var{auto-login?} is true, log in automatically as
3601@var{default-user}.
3602@end deffn
4af2447e 3603
4af2447e 3604
0ae8c15a
LC
3605@node Setuid Programs
3606@subsection Setuid Programs
3607
3608@cindex setuid programs
3609Some programs need to run with ``root'' privileges, even when they are
3610launched by unprivileged users. A notorious example is the
3611@command{passwd} programs, which can users can run to change their
3612password, and which requires write access to the @file{/etc/passwd} and
3613@file{/etc/shadow} files---something normally restricted to root, for
3614obvious security reasons. To address that, these executables are
3615@dfn{setuid-root}, meaning that they always run with root privileges
3616(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
3617for more info about the setuid mechanisms.)
3618
3619The store itself @emph{cannot} contain setuid programs: that would be a
3620security issue since any user on the system can write derivations that
3621populate the store (@pxref{The Store}). Thus, a different mechanism is
3622used: instead of changing the setuid bit directly on files that are in
3623the store, we let the system administrator @emph{declare} which programs
3624should be setuid root.
3625
3626The @code{setuid-programs} field of an @code{operating-system}
3627declaration contains a list of G-expressions denoting the names of
3628programs to be setuid-root (@pxref{Using the Configuration System}).
3629For instance, the @command{passwd} program, which is part of the Shadow
3630package, can be designated by this G-expression (@pxref{G-Expressions}):
3631
3632@example
3633#~(string-append #$shadow "/bin/passwd")
3634@end example
3635
3636A default set of setuid programs is defined by the
3637@code{%setuid-programs} variable of the @code{(gnu system)} module.
3638
3639@defvr {Scheme Variable} %setuid-programs
3640A list of G-expressions denoting common programs that are setuid-root.
3641
3642The list includes commands such as @command{passwd}, @command{ping},
3643@command{su}, and @command{sudo}.
3644@end defvr
3645
3646Under the hood, the actual setuid programs are created in the
3647@file{/run/setuid-programs} directory at system activation time. The
3648files in this directory refer to the ``real'' binaries, which are in the
3649store.
3650
3651
fd1b1fa2
LC
3652@node Initial RAM Disk
3653@subsection Initial RAM Disk
3654
3655@cindex initial RAM disk (initrd)
3656@cindex initrd (initial RAM disk)
3657For bootstrapping purposes, the Linux-Libre kernel is passed an
3658@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
3659root file system, as well as an initialization script. The latter is
3660responsible for mounting the real root file system, and for loading any
3661kernel modules that may be needed to achieve that.
3662
3663The @code{initrd} field of an @code{operating-system} declaration allows
3664you to specify which initrd you would like to use. The @code{(gnu
3665system linux-initrd)} module provides two ways to build an initrd: the
3666high-level @code{base-initrd} procedure, and the low-level
3667@code{expression->initrd} procedure.
3668
3669The @code{base-initrd} procedure is intended to cover most common uses.
3670For example, if you want to add a bunch of kernel modules to be loaded
3671at boot time, you can define the @code{initrd} field of the operating
3672system declaration like this:
3673
3674@example
52ac153e
LC
3675(initrd (lambda (file-systems . rest)
3676 (apply base-initrd file-systems
3677 #:extra-modules '("my.ko" "modules.ko")
3678 rest)))
fd1b1fa2
LC
3679@end example
3680
52ac153e
LC
3681The @code{base-initrd} procedure also handles common use cases that
3682involves using the system as a QEMU guest, or as a ``live'' system whose
3683root file system is volatile.
fd1b1fa2
LC
3684
3685@deffn {Monadic Procedure} base-initrd @var{file-systems} @
3686 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 3687 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
3688Return a monadic derivation that builds a generic initrd. @var{file-systems} is
3689a list of file-systems to be mounted by the initrd, possibly in addition to
3690the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
3691@var{mapped-devices} is a list of device mappings to realize before
3692@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
3693
3694When @var{qemu-networking?} is true, set up networking with the standard QEMU
3695parameters. When @var{virtio?} is true, load additional modules so the initrd can
3696be used as a QEMU guest with para-virtualized I/O drivers.
3697
3698When @var{volatile-root?} is true, the root file system is writable but any changes
3699to it are lost.
3700
3701The initrd is automatically populated with all the kernel modules necessary
3702for @var{file-systems} and for the given options. However, additional kernel
3703modules can be listed in @var{extra-modules}. They will be added to the initrd, and
3704loaded at boot time in the order in which they appear.
3705@end deffn
3706
3707Needless to say, the initrds we produce and use embed a
3708statically-linked Guile, and the initialization program is a Guile
3709program. That gives a lot of flexibility. The
3710@code{expression->initrd} procedure builds such an initrd, given the
3711program to run in that initrd.
3712
3713@deffn {Monadic Procedure} expression->initrd @var{exp} @
3714 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 3715 [#:modules '()]
fd1b1fa2
LC
3716Return a derivation that builds a Linux initrd (a gzipped cpio archive)
3717containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
3718upon booting. All the derivations referenced by @var{exp} are
3719automatically copied to the initrd.
fd1b1fa2 3720
42d10464
LC
3721@var{modules} is a list of Guile module names to be embedded in the
3722initrd.
fd1b1fa2
LC
3723@end deffn
3724
cf4a9129
LC
3725@node Invoking guix system
3726@subsection Invoking @code{guix system}
0918e64a 3727
cf4a9129
LC
3728Once you have written an operating system declaration, as seen in the
3729previous section, it can be @dfn{instantiated} using the @command{guix
3730system} command. The synopsis is:
4af2447e 3731
cf4a9129
LC
3732@example
3733guix system @var{options}@dots{} @var{action} @var{file}
3734@end example
4af2447e 3735
cf4a9129
LC
3736@var{file} must be the name of a file containing an
3737@code{operating-system} declaration. @var{action} specifies how the
3738operating system is instantiate. Currently the following values are
3739supported:
4af2447e 3740
cf4a9129
LC
3741@table @code
3742@item reconfigure
3743Build the operating system described in @var{file}, activate it, and
3744switch to it@footnote{This action is usable only on systems already
3745running GNU.}.
4af2447e 3746
cf4a9129
LC
3747This effects all the configuration specified in @var{file}: user
3748accounts, system services, global package list, setuid programs, etc.
4af2447e 3749
cf4a9129
LC
3750It also adds a GRUB menu entry for the new OS configuration, and moves
3751entries for older configurations to a submenu---unless
3752@option{--no-grub} is passed.
4af2447e 3753
cf4a9129
LC
3754@item build
3755Build the operating system's derivation, which includes all the
3756configuration files and programs needed to boot and run the system.
3757This action does not actually install anything.
113daf62 3758
cf4a9129
LC
3759@item init
3760Populate the given directory with all the files necessary to run the
3761operating system specified in @var{file}. This is useful for first-time
3762installations of the GNU system. For instance:
113daf62
LC
3763
3764@example
cf4a9129 3765guix system init my-os-config.scm /mnt
113daf62
LC
3766@end example
3767
cf4a9129
LC
3768copies to @file{/mnt} all the store items required by the configuration
3769specified in @file{my-os-config.scm}. This includes configuration
3770files, packages, and so on. It also creates other essential files
3771needed for the system to operate correctly---e.g., the @file{/etc},
3772@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 3773
cf4a9129
LC
3774This command also installs GRUB on the device specified in
3775@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 3776
cf4a9129
LC
3777@item vm
3778@cindex virtual machine
3779Build a virtual machine that contain the operating system declared in
3780@var{file}, and return a script to run that virtual machine (VM).
113daf62 3781
cf4a9129 3782The VM shares its store with the host system.
113daf62 3783
cf4a9129
LC
3784@item vm-image
3785@itemx disk-image
3786Return a virtual machine or disk image of the operating system declared
3787in @var{file} that stands alone. Use the @option{--image-size} option
3788to specify the size of the image.
113daf62 3789
cf4a9129
LC
3790When using @code{vm-image}, the returned image is in qcow2 format, which
3791the QEMU emulator can efficiently use.
113daf62 3792
cf4a9129
LC
3793When using @code{disk-image}, a raw disk image is produced; it can be
3794copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
3795the device corresponding to a USB stick, one can copy the image on it
3796using the following command:
113daf62 3797
cf4a9129
LC
3798@example
3799# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
3800@end example
113daf62 3801
cf4a9129 3802@end table
113daf62 3803
cf4a9129
LC
3804@var{options} can contain any of the common build options provided by
3805@command{guix build} (@pxref{Invoking guix build}). In addition,
3806@var{options} can contain one of the following:
113daf62 3807
cf4a9129
LC
3808@table @option
3809@item --system=@var{system}
3810@itemx -s @var{system}
3811Attempt to build for @var{system} instead of the host's system type.
3812This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 3813
cf4a9129
LC
3814@item --image-size=@var{size}
3815For the @code{vm-image} and @code{disk-image} actions, create an image
3816of the given @var{size}. @var{size} may be a number of bytes, or it may
3817include a unit as a suffix, such as @code{MiB} for mebibytes and
3818@code{GB} for gigabytes.
113daf62 3819@end table
113daf62 3820
cf4a9129
LC
3821Note that all the actions above, except @code{build} and @code{init},
3822rely on KVM support in the Linux-Libre kernel. Specifically, the
3823machine should have hardware virtualization support, the corresponding
3824KVM kernel module should be loaded, and the @file{/dev/kvm} device node
3825must exist and be readable and writable by the user and by the daemon's
3826build users.
8451a568 3827
cf4a9129
LC
3828@node Defining Services
3829@subsection Defining Services
8451a568 3830
cf4a9129
LC
3831The @code{(gnu services @dots{})} modules define several procedures that allow
3832users to declare the operating system's services (@pxref{Using the
3833Configuration System}). These procedures are @emph{monadic
3834procedures}---i.e., procedures that return a monadic value in the store
3835monad (@pxref{The Store Monad}). For examples of such procedures,
3836@xref{Services}.
8451a568 3837
cf4a9129
LC
3838@cindex service definition
3839The monadic value returned by those procedures is a @dfn{service
3840definition}---a structure as returned by the @code{service} form.
3841Service definitions specifies the inputs the service depends on, and an
3842expression to start and stop the service. Behind the scenes, service
3843definitions are ``translated'' into the form suitable for the
3844configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
3845dmd Manual}).
8451a568 3846
cf4a9129
LC
3847As an example, here is what the @code{nscd-service} procedure looks
3848like:
8451a568 3849
cf4a9129
LC
3850@lisp
3851(define (nscd-service)
3852 (with-monad %store-monad
3853 (return (service
3854 (documentation "Run libc's name service cache daemon.")
3855 (provision '(nscd))
3856 (activate #~(begin
3857 (use-modules (guix build utils))
3858 (mkdir-p "/var/run/nscd")))
3859 (start #~(make-forkexec-constructor
3860 (string-append #$glibc "/sbin/nscd")
3861 "-f" "/dev/null" "--foreground"))
3862 (stop #~(make-kill-destructor))
3863 (respawn? #f)))))
3864@end lisp
8451a568 3865
cf4a9129
LC
3866@noindent
3867The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
3868(@pxref{G-Expressions}). The @code{activate} field contains a script to
3869run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
3870directory exists before @command{nscd} is started.
8451a568 3871
cf4a9129
LC
3872The @code{start} and @code{stop} fields refer to dmd's facilities to
3873start and stop processes (@pxref{Service De- and Constructors,,, dmd,
3874GNU dmd Manual}). The @code{provision} field specifies the name under
3875which this service is known to dmd, and @code{documentation} specifies
3876on-line documentation. Thus, the commands @command{deco start ncsd},
3877@command{deco stop nscd}, and @command{deco doc nscd} will do what you
3878would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 3879
8451a568 3880
cf4a9129
LC
3881@node Installing Debugging Files
3882@section Installing Debugging Files
8451a568 3883
cf4a9129
LC
3884@cindex debugging files
3885Program binaries, as produced by the GCC compilers for instance, are
3886typically written in the ELF format, with a section containing
3887@dfn{debugging information}. Debugging information is what allows the
3888debugger, GDB, to map binary code to source code; it is required to
3889debug a compiled program in good conditions.
8451a568 3890
cf4a9129
LC
3891The problem with debugging information is that is takes up a fair amount
3892of disk space. For example, debugging information for the GNU C Library
3893weighs in at more than 60 MiB. Thus, as a user, keeping all the
3894debugging info of all the installed programs is usually not an option.
3895Yet, space savings should not come at the cost of an impediment to
3896debugging---especially in the GNU system, which should make it easier
3897for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 3898
cf4a9129
LC
3899Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
3900mechanism that allows users to get the best of both worlds: debugging
3901information can be stripped from the binaries and stored in separate
3902files. GDB is then able to load debugging information from those files,
3903when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
3904with GDB}).
8451a568 3905
cf4a9129
LC
3906The GNU distribution takes advantage of this by storing debugging
3907information in the @code{lib/debug} sub-directory of a separate package
3908output unimaginatively called @code{debug} (@pxref{Packages with
3909Multiple Outputs}). Users can choose to install the @code{debug} output
3910of a package when they need it. For instance, the following command
3911installs the debugging information for the GNU C Library and for GNU
3912Guile:
8451a568
LC
3913
3914@example
cf4a9129 3915guix package -i glibc:debug guile:debug
8451a568
LC
3916@end example
3917
cf4a9129
LC
3918GDB must then be told to look for debug files in the user's profile, by
3919setting the @code{debug-file-directory} variable (consider setting it
3920from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
3921GDB}):
8451a568 3922
cf4a9129
LC
3923@example
3924(gdb) set debug-file-directory ~/.guix-profile/lib/debug
3925@end example
8451a568 3926
cf4a9129
LC
3927From there on, GDB will pick up debugging information from the
3928@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 3929
cf4a9129
LC
3930In addition, you will most likely want GDB to be able to show the source
3931code being debugged. To do that, you will have to unpack the source
3932code of the package of interest (obtained with @code{guix build
3933--source}, @pxref{Invoking guix build}), and to point GDB to that source
3934directory using the @code{directory} command (@pxref{Source Path,
3935@code{directory},, gdb, Debugging with GDB}).
8451a568 3936
cf4a9129
LC
3937@c XXX: keep me up-to-date
3938The @code{debug} output mechanism in Guix is implemented by the
3939@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
3940opt-in---debugging information is available only for those packages
3941whose definition explicitly declares a @code{debug} output. This may be
3942changed to opt-out in the future, if our build farm servers can handle
3943the load. To check whether a package has a @code{debug} output, use
3944@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 3945
8451a568 3946
cf4a9129
LC
3947@node Package Modules
3948@section Package Modules
8451a568 3949
cf4a9129
LC
3950From a programming viewpoint, the package definitions of the
3951GNU distribution are provided by Guile modules in the @code{(gnu packages
3952@dots{})} name space@footnote{Note that packages under the @code{(gnu
3953packages @dots{})} module name space are not necessarily ``GNU
3954packages''. This module naming scheme follows the usual Guile module
3955naming convention: @code{gnu} means that these modules are distributed
3956as part of the GNU system, and @code{packages} identifies modules that
3957define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
3958Reference Manual}). For instance, the @code{(gnu packages emacs)}
3959module exports a variable named @code{emacs}, which is bound to a
3960@code{<package>} object (@pxref{Defining Packages}).
113daf62 3961
300868ba 3962The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
3963automatically scanned for packages by the command-line tools. For
3964instance, when running @code{guix package -i emacs}, all the @code{(gnu
3965packages @dots{})} modules are scanned until one that exports a package
3966object whose name is @code{emacs} is found. This package search
3967facility is implemented in the @code{(gnu packages)} module.
113daf62 3968
300868ba 3969@cindex customization, of packages
8689901f 3970@cindex package module search path
cf4a9129 3971Users can store package definitions in modules with different
300868ba
LC
3972names---e.g., @code{(my-packages emacs)}. These package definitions
3973will not be visible by default. Thus, users can invoke commands such as
3974@command{guix package} and @command{guix build} have to be used with the
3975@code{-e} option so that they know where to find the package, or use the
3976@code{-L} option of these commands to make those modules visible
8689901f
LC
3977(@pxref{Invoking guix build, @code{--load-path}}), or define the
3978@code{GUIX_PACKAGE_PATH} environment variable. This environment
3979variable makes it easy to extend or customize the distribution and is
3980honored by all the user interfaces.
3981
3982@defvr {Environment Variable} GUIX_PACKAGE_PATH
3983This is a colon-separated list of directories to search for package
3984modules. Directories listed in this variable take precedence over the
3985distribution's own modules.
3986@end defvr
ef5dd60a 3987
cf4a9129
LC
3988The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
3989each package is built based solely on other packages in the
3990distribution. The root of this dependency graph is a small set of
3991@dfn{bootstrap binaries}, provided by the @code{(gnu packages
3992bootstrap)} module. For more information on bootstrapping,
3993@ref{Bootstrapping}.
ef5dd60a 3994
cf4a9129
LC
3995@node Packaging Guidelines
3996@section Packaging Guidelines
ef5dd60a 3997
cf4a9129
LC
3998The GNU distribution is nascent and may well lack some of your favorite
3999packages. This section describes how you can help make the distribution
4000grow. @xref{Contributing}, for additional information on how you can
4001help.
ef5dd60a 4002
cf4a9129
LC
4003Free software packages are usually distributed in the form of
4004@dfn{source code tarballs}---typically @file{tar.gz} files that contain
4005all the source files. Adding a package to the distribution means
4006essentially two things: adding a @dfn{recipe} that describes how to
4007build the package, including a list of other packages required to build
4008it, and adding @dfn{package meta-data} along with that recipe, such as a
4009description and licensing information.
ef5dd60a 4010
cf4a9129
LC
4011In Guix all this information is embodied in @dfn{package definitions}.
4012Package definitions provide a high-level view of the package. They are
4013written using the syntax of the Scheme programming language; in fact,
4014for each package we define a variable bound to the package definition,
4015and export that variable from a module (@pxref{Package Modules}).
4016However, in-depth Scheme knowledge is @emph{not} a prerequisite for
4017creating packages. For more information on package definitions,
4018@ref{Defining Packages}.
ef5dd60a 4019
cf4a9129
LC
4020Once a package definition is in place, stored in a file in the Guix
4021source tree, it can be tested using the @command{guix build} command
4022(@pxref{Invoking guix build}). For example, assuming the new package is
4023called @code{gnew}, you may run this command from the Guix build tree:
ef5dd60a
LC
4024
4025@example
cf4a9129 4026./pre-inst-env guix build gnew --keep-failed
ef5dd60a 4027@end example
ef5dd60a 4028
cf4a9129
LC
4029Using @code{--keep-failed} makes it easier to debug build failures since
4030it provides access to the failed build tree. Another useful
4031command-line option when debugging is @code{--log-file}, to access the
4032build log.
ef5dd60a 4033
cf4a9129
LC
4034If the package is unknown to the @command{guix} command, it may be that
4035the source file contains a syntax error, or lacks a @code{define-public}
4036clause to export the package variable. To figure it out, you may load
4037the module from Guile to get more information about the actual error:
ef5dd60a 4038
cf4a9129
LC
4039@example
4040./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
4041@end example
ef5dd60a 4042
cf4a9129
LC
4043Once your package builds correctly, please send us a patch
4044(@pxref{Contributing}). Well, if you need help, we will be happy to
4045help you too. Once the patch is committed in the Guix repository, the
4046new package automatically gets built on the supported platforms by
4047@url{http://hydra.gnu.org/gnu/master, our continuous integration
4048system}.
ef5dd60a 4049
cf4a9129
LC
4050@cindex substituter
4051Users can obtain the new package definition simply by running
4052@command{guix pull} (@pxref{Invoking guix pull}). When
4053@code{hydra.gnu.org} is done building the package, installing the
4054package automatically downloads binaries from there
4055(@pxref{Substitutes}). The only place where human intervention is
4056needed is to review and apply the patch.
ef5dd60a 4057
ef5dd60a 4058
cf4a9129
LC
4059@menu
4060* Software Freedom:: What may go into the distribution.
4061* Package Naming:: What's in a name?
4062* Version Numbers:: When the name is not enough.
4063* Python Modules:: Taming the snake.
4064* Perl Modules:: Little pearls.
4065@end menu
ef5dd60a 4066
cf4a9129
LC
4067@node Software Freedom
4068@subsection Software Freedom
ef5dd60a 4069
cf4a9129 4070@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 4071
cf4a9129
LC
4072The GNU operating system has been developed so that users can have
4073freedom in their computing. GNU is @dfn{free software}, meaning that
4074users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
4075essential freedoms}: to run the program, to study and change the program
4076in source code form, to redistribute exact copies, and to distribute
4077modified versions. Packages found in the GNU distribution provide only
4078software that conveys these four freedoms.
c11a6eb1 4079
cf4a9129
LC
4080In addition, the GNU distribution follow the
4081@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
4082software distribution guidelines}. Among other things, these guidelines
4083reject non-free firmware, recommendations of non-free software, and
4084discuss ways to deal with trademarks and patents.
ef5dd60a 4085
cf4a9129
LC
4086Some packages contain a small and optional subset that violates the
4087above guidelines, for instance because this subset is itself non-free
4088code. When that happens, the offending items are removed with
4089appropriate patches or code snippets in the package definition's
4090@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
4091build --source} returns the ``freed'' source rather than the unmodified
4092upstream source.
ef5dd60a 4093
ef5dd60a 4094
cf4a9129
LC
4095@node Package Naming
4096@subsection Package Naming
ef5dd60a 4097
cf4a9129
LC
4098A package has actually two names associated with it:
4099First, there is the name of the @emph{Scheme variable}, the one following
4100@code{define-public}. By this name, the package can be made known in the
4101Scheme code, for instance as input to another package. Second, there is
4102the string in the @code{name} field of a package definition. This name
4103is used by package management commands such as
4104@command{guix package} and @command{guix build}.
ef5dd60a 4105
cf4a9129
LC
4106Both are usually the same and correspond to the lowercase conversion of
4107the project name chosen upstream, with underscores replaced with
4108hyphens. For instance, GNUnet is available as @code{gnunet}, and
4109SDL_net as @code{sdl-net}.
927097ef 4110
cf4a9129
LC
4111We do not add @code{lib} prefixes for library packages, unless these are
4112already part of the official project name. But see @pxref{Python
4113Modules} and @ref{Perl Modules} for special rules concerning modules for
4114the Python and Perl languages.
927097ef 4115
ef5dd60a 4116
cf4a9129
LC
4117@node Version Numbers
4118@subsection Version Numbers
ef5dd60a 4119
cf4a9129
LC
4120We usually package only the latest version of a given free software
4121project. But sometimes, for instance for incompatible library versions,
4122two (or more) versions of the same package are needed. These require
4123different Scheme variable names. We use the name as defined
4124in @ref{Package Naming}
4125for the most recent version; previous versions use the same name, suffixed
4126by @code{-} and the smallest prefix of the version number that may
4127distinguish the two versions.
ef5dd60a 4128
cf4a9129
LC
4129The name inside the package definition is the same for all versions of a
4130package and does not contain any version number.
ef5dd60a 4131
cf4a9129 4132For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 4133
cf4a9129
LC
4134@example
4135(define-public gtk+
4136 (package
4137 (name "gtk+")
4138 (version "3.9.12")
4139 ...))
4140(define-public gtk+-2
4141 (package
4142 (name "gtk+")
4143 (version "2.24.20")
4144 ...))
4145@end example
4146If we also wanted GTK+ 3.8.2, this would be packaged as
4147@example
4148(define-public gtk+-3.8
4149 (package
4150 (name "gtk+")
4151 (version "3.8.2")
4152 ...))
4153@end example
ef5dd60a 4154
ef5dd60a 4155
cf4a9129
LC
4156@node Python Modules
4157@subsection Python Modules
ef5dd60a 4158
cf4a9129
LC
4159We currently package Python 2 and Python 3, under the Scheme variable names
4160@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
4161To avoid confusion and naming clashes with other programming languages, it
4162seems desirable that the name of a package for a Python module contains
4163the word @code{python}.
ef5dd60a 4164
cf4a9129
LC
4165Some modules are compatible with only one version of Python, others with both.
4166If the package Foo compiles only with Python 3, we name it
4167@code{python-foo}; if it compiles only with Python 2, we name it
4168@code{python2-foo}. If it is compatible with both versions, we create two
4169packages with the corresponding names.
ef5dd60a 4170
cf4a9129
LC
4171If a project already contains the word @code{python}, we drop this;
4172for instance, the module python-dateutil is packaged under the names
4173@code{python-dateutil} and @code{python2-dateutil}.
113daf62 4174
523e4896 4175
cf4a9129
LC
4176@node Perl Modules
4177@subsection Perl Modules
523e4896 4178
cf4a9129
LC
4179Perl programs standing for themselves are named as any other package,
4180using the lowercase upstream name.
4181For Perl packages containing a single class, we use the lowercase class name,
4182replace all occurrences of @code{::} by dashes and prepend the prefix
4183@code{perl-}.
4184So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
4185Modules containing several classes keep their lowercase upstream name and
4186are also prepended by @code{perl-}. Such modules tend to have the word
4187@code{perl} somewhere in their name, which gets dropped in favor of the
4188prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 4189
523e4896 4190
b25937e3 4191
cf4a9129
LC
4192@node Bootstrapping
4193@section Bootstrapping
b25937e3 4194
cf4a9129 4195@c Adapted from the ELS 2013 paper.
b25937e3 4196
cf4a9129 4197@cindex bootstrapping
7889394e 4198
cf4a9129
LC
4199Bootstrapping in our context refers to how the distribution gets built
4200``from nothing''. Remember that the build environment of a derivation
4201contains nothing but its declared inputs (@pxref{Introduction}). So
4202there's an obvious chicken-and-egg problem: how does the first package
4203get built? How does the first compiler get compiled? Note that this is
4204a question of interest only to the curious hacker, not to the regular
4205user, so you can shamelessly skip this section if you consider yourself
4206a ``regular user''.
72b9d60d 4207
cf4a9129
LC
4208@cindex bootstrap binaries
4209The GNU system is primarily made of C code, with libc at its core. The
4210GNU build system itself assumes the availability of a Bourne shell and
4211command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
4212`grep'. Furthermore, build programs---programs that run
4213@code{./configure}, @code{make}, etc.---are written in Guile Scheme
4214(@pxref{Derivations}). Consequently, to be able to build anything at
4215all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
4216Binutils, libc, and the other packages mentioned above---the
4217@dfn{bootstrap binaries}.
72b9d60d 4218
cf4a9129
LC
4219These bootstrap binaries are ``taken for granted'', though we can also
4220re-create them if needed (more on that later).
72b9d60d 4221
cf4a9129 4222@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 4223
cf4a9129
LC
4224@c As of Emacs 24.3, Info-mode displays the image, but since it's a
4225@c large image, it's hard to scroll. Oh well.
4226@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 4227
cf4a9129
LC
4228The figure above shows the very beginning of the dependency graph of the
4229distribution, corresponding to the package definitions of the @code{(gnu
4230packages bootstrap)} module. At this level of detail, things are
4231slightly complex. First, Guile itself consists of an ELF executable,
4232along with many source and compiled Scheme files that are dynamically
4233loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
4234tarball shown in this graph. This tarball is part of Guix's ``source''
4235distribution, and gets inserted into the store with @code{add-to-store}
4236(@pxref{The Store}).
2e7b5cea 4237
cf4a9129
LC
4238But how do we write a derivation that unpacks this tarball and adds it
4239to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
4240derivation---the first one that gets built---uses @code{bash} as its
4241builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
4242@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
4243@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
4244the Guix source distribution, whose sole purpose is to allow the Guile
4245tarball to be unpacked.
fb729425 4246
cf4a9129
LC
4247Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
4248Guile that can be used to run subsequent build programs. Its first task
4249is to download tarballs containing the other pre-built binaries---this
4250is what the @code{.tar.xz.drv} derivations do. Guix modules such as
4251@code{ftp-client.scm} are used for this purpose. The
4252@code{module-import.drv} derivations import those modules in a directory
4253in the store, using the original layout. The
4254@code{module-import-compiled.drv} derivations compile those modules, and
4255write them in an output directory with the right layout. This
4256corresponds to the @code{#:modules} argument of
4257@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 4258
cf4a9129
LC
4259Finally, the various tarballs are unpacked by the
4260derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
4261etc., at which point we have a working C tool chain.
fb729425 4262
fb729425 4263
cf4a9129 4264@unnumberedsubsec Building the Build Tools
523e4896 4265
cf4a9129
LC
4266@c TODO: Add a package-level dependency graph generated from (gnu
4267@c packages base).
df2ce343 4268
cf4a9129
LC
4269Bootstrapping is complete when we have a full tool chain that does not
4270depend on the pre-built bootstrap tools discussed above. This
4271no-dependency requirement is verified by checking whether the files of
4272the final tool chain contain references to the @file{/gnu/store}
4273directories of the bootstrap inputs. The process that leads to this
4274``final'' tool chain is described by the package definitions found in
4275the @code{(gnu packages base)} module.
df2ce343 4276
cf4a9129
LC
4277@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
4278The first tool that gets built with the bootstrap binaries is
4279GNU Make, which is a prerequisite for all the following packages.
4280From there Findutils and Diffutils get built.
523e4896 4281
cf4a9129
LC
4282Then come the first-stage Binutils and GCC, built as pseudo cross
4283tools---i.e., with @code{--target} equal to @code{--host}. They are
4284used to build libc. Thanks to this cross-build trick, this libc is
4285guaranteed not to hold any reference to the initial tool chain.
4af2447e 4286
cf4a9129
LC
4287From there the final Binutils and GCC are built. GCC uses @code{ld}
4288from the final Binutils, and links programs against the just-built libc.
4289This tool chain is used to build the other packages used by Guix and by
4290the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 4291
cf4a9129
LC
4292And voilà! At this point we have the complete set of build tools that
4293the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
4294variable of the @code{(gnu packages commencement)} module, and are
4295implicitly used by any package that uses @code{gnu-build-system}
4296(@pxref{Defining Packages}).
4af2447e 4297
4af2447e 4298
cf4a9129 4299@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 4300
cf4a9129
LC
4301Because the final tool chain does not depend on the bootstrap binaries,
4302those rarely need to be updated. Nevertheless, it is useful to have an
4303automated way to produce them, should an update occur, and this is what
4304the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 4305
cf4a9129
LC
4306The following command builds the tarballs containing the bootstrap
4307binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
4308of Coreutils and other basic command-line tools):
4b2615e1 4309
cf4a9129
LC
4310@example
4311guix build bootstrap-tarballs
4312@end example
4313
4314The generated tarballs are those that should be referred to in the
4315@code{(gnu packages bootstrap)} module mentioned at the beginning of
4316this section.
4317
4318Still here? Then perhaps by now you've started to wonder: when do we
4319reach a fixed point? That is an interesting question! The answer is
4320unknown, but if you would like to investigate further (and have
4321significant computational and storage resources to do so), then let us
4322know.
4323
4324@node Porting
4325@section Porting to a New Platform
4326
4327As discussed above, the GNU distribution is self-contained, and
4328self-containment is achieved by relying on pre-built ``bootstrap
4329binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
4330operating system kernel, CPU architecture, and application binary
4331interface (ABI). Thus, to port the distribution to a platform that is
4332not yet supported, one must build those bootstrap binaries, and update
4333the @code{(gnu packages bootstrap)} module to use them on that platform.
4334
4335Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
4336When everything goes well, and assuming the GNU tool chain supports the
4337target platform, this can be as simple as running a command like this
4338one:
4339
4340@example
4341guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
4342@end example
4343
4344Once these are built, the @code{(gnu packages bootstrap)} module needs
4345to be updated to refer to these binaries on the target platform. In
4346addition, the @code{glibc-dynamic-linker} procedure in that module must
4347be augmented to return the right file name for libc's dynamic linker on
4348that platform; likewise, @code{system->linux-architecture} in @code{(gnu
4349packages linux)} must be taught about the new platform.
4350
4351In practice, there may be some complications. First, it may be that the
4352extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
4353above) is not recognized by all the GNU tools. Typically, glibc
4354recognizes some of these, whereas GCC uses an extra @code{--with-abi}
4355configure flag (see @code{gcc.scm} for examples of how to handle this).
4356Second, some of the required packages could fail to build for that
4357platform. Lastly, the generated binaries could be broken for some
4358reason.
4af2447e
LC
4359
4360
9bf3c1a7
LC
4361@c *********************************************************************
4362@node Contributing
4363@chapter Contributing
4364
4365This project is a cooperative effort, and we need your help to make it
5ff3c4b8
PAR
4366grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
4367@code{#guix} on the Freenode IRC network. We welcome ideas, bug
4368reports, patches, and anything that may be helpful to the project. We
4369particularly welcome help on packaging (@pxref{Packaging Guidelines}).
a1ba8475 4370
9bf3c1a7
LC
4371Please see the
4372@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
4373@file{HACKING} file} that comes with the Guix source code for practical
4374details about contributions.
4375
c78bd12b 4376
568717fd
LC
4377@c *********************************************************************
4378@node Acknowledgments
4379@chapter Acknowledgments
4380
4381Guix is based on the Nix package manager, which was designed and
4382implemented by Eelco Dolstra. Nix pioneered functional package
4383management, and promoted unprecedented features, such as transactional
4384package upgrades and rollbacks, per-user profiles, and referentially
4385transparent build processes. Without this work, Guix would not exist.
4386
4387The Nix-based software distributions, Nixpkgs and NixOS, have also been
4388an inspiration for Guix.
4389
4390@c *********************************************************************
4391@node GNU Free Documentation License
4392@appendix GNU Free Documentation License
4393
4394@include fdl-1.3.texi
4395
4396@c *********************************************************************
4397@node Concept Index
4398@unnumbered Concept Index
4399@printindex cp
4400
a85b83d2
LC
4401@node Programming Index
4402@unnumbered Programming Index
4403@syncodeindex tp fn
4404@syncodeindex vr fn
568717fd
LC
4405@printindex fn
4406
4407@bye
4408
4409@c Local Variables:
4410@c ispell-local-dictionary: "american";
4411@c End: