gnu: Add giblib.
[jackhill/guix/guix.git] / doc / guix.texi
1 \input texinfo
2 @c -*-texinfo-*-
3
4 @c %**start of header
5 @setfilename guix.info
6 @documentencoding UTF-8
7 @settitle GNU Guix Reference Manual
8 @c %**end of header
9
10 @include version.texi
11
12 @copying
13 Copyright @copyright{} 2012, 2013, 2014 Ludovic Courtès@*
14 Copyright @copyright{} 2013, 2014 Andreas Enge@*
15 Copyright @copyright{} 2013 Nikita Karetnikov
16
17 Permission is granted to copy, distribute and/or modify this document
18 under the terms of the GNU Free Documentation License, Version 1.3 or
19 any later version published by the Free Software Foundation; with no
20 Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
21 copy of the license is included in the section entitled ``GNU Free
22 Documentation License''.
23 @end copying
24
25 @dircategory Package management
26 @direntry
27 * guix: (guix). Guix, the functional package manager.
28 * guix package: (guix)Invoking guix package
29 Managing packages with Guix.
30 * guix build: (guix)Invoking guix build
31 Building packages with Guix.
32 * guix system: (guix)Invoking guix system
33 Managing the operating system configuration.
34 @end direntry
35
36 @titlepage
37 @title GNU Guix Reference Manual
38 @subtitle Using the GNU Guix Functional Package Manager
39 @author Ludovic Courtès
40 @author Andreas Enge
41 @author Nikita Karetnikov
42
43 @page
44 @vskip 0pt plus 1filll
45 Edition @value{EDITION} @*
46 @value{UPDATED} @*
47
48 @insertcopying
49 @end titlepage
50
51 @contents
52
53 @c *********************************************************************
54 @node Top
55 @top GNU Guix
56
57 This document describes GNU Guix version @value{VERSION}, a functional
58 package management tool written for the GNU system.
59
60 @menu
61 * Introduction:: What is Guix about?
62 * Installation:: Installing Guix.
63 * Package Management:: Package installation, upgrade, etc.
64 * Programming Interface:: Using Guix in Scheme.
65 * Utilities:: Package management commands.
66 * GNU Distribution:: Software for your friendly GNU system.
67 * Contributing:: Your help needed!
68
69 * Acknowledgments:: Thanks!
70 * GNU Free Documentation License:: The license of this manual.
71 * Concept Index:: Concepts.
72 * Programming Index:: Data types, functions, and variables.
73 @end menu
74
75 @c *********************************************************************
76 @node Introduction
77 @chapter Introduction
78
79 GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
80 using the international phonetic alphabet (IPA).} is a functional
81 package management tool for the GNU system. Package management consists
82 of all activities that relate to building packages from sources,
83 honoring their build-time and run-time dependencies,
84 installing packages in user environments, upgrading installed packages
85 to new versions or rolling back to a previous set, removing unused
86 software packages, etc.
87
88 @cindex functional package management
89 The term @dfn{functional} refers to a specific package management
90 discipline. In Guix, the package build and installation process is seen
91 as a function, in the mathematical sense. That function takes inputs,
92 such as build scripts, a compiler, and libraries, and
93 returns an installed package. As a pure function, its result depends
94 solely on its inputs---for instance, it cannot refer to software or
95 scripts that were not explicitly passed as inputs. A build function
96 always produces the same result when passed a given set of inputs. It
97 cannot alter the system's environment in
98 any way; for instance, it cannot create, modify, or delete files outside
99 of its build and installation directories. This is achieved by running
100 build processes in isolated environments (or @dfn{containers}), where only their
101 explicit inputs are visible.
102
103 @cindex store
104 The result of package build functions is @dfn{cached} in the file
105 system, in a special directory called @dfn{the store} (@pxref{The
106 Store}). Each package is installed in a directory of its own, in the
107 store---by default under @file{/gnu/store}. The directory name contains
108 a hash of all the inputs used to build that package; thus, changing an
109 input yields a different directory name.
110
111 This approach is the foundation of Guix's salient features: support for
112 transactional package upgrade and rollback, per-user installation, and
113 garbage collection of packages (@pxref{Features}).
114
115 Guix has a command-line interface, which allows users to build, install,
116 upgrade, and remove packages, as well as a Scheme programming interface.
117
118 Last but not least, Guix is used to build a distribution of the GNU
119 system, with many GNU and non-GNU free software packages. @xref{GNU
120 Distribution}.
121
122 @c *********************************************************************
123 @node Installation
124 @chapter Installation
125
126 GNU Guix is available for download from its website at
127 @url{http://www.gnu.org/software/guix/}. This section describes the
128 software requirements of Guix, as well as how to install it and get
129 ready to use it.
130
131 Note that this section is concerned with the installation of the package
132 manager, which can be done on top of a running GNU/Linux system. If,
133 instead, you want to install the complete GNU operating system,
134 @pxref{System Installation}.
135
136 The build procedure for Guix is the same as for other GNU software, and
137 is not covered here. Please see the files @file{README} and
138 @file{INSTALL} in the Guix source tree for additional details.
139
140 @menu
141 * Requirements:: Software needed to build and run Guix.
142 * Setting Up the Daemon:: Preparing the build daemon's environment.
143 * Invoking guix-daemon:: Running the build daemon.
144 @end menu
145
146 @node Requirements
147 @section Requirements
148
149 GNU Guix depends on the following packages:
150
151 @itemize
152 @item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.5 or later;
153 @item @url{http://gnupg.org/, GNU libgcrypt}
154 @end itemize
155
156 Unless @code{--disable-daemon} was passed to @command{configure}, the
157 following packages are also needed:
158
159 @itemize
160 @item @url{http://sqlite.org, SQLite 3}
161 @item @url{http://www.bzip.org, libbz2}
162 @item @url{http://gcc.gnu.org, GCC's g++}
163 @end itemize
164
165 When a working installation of @url{http://nixos.org/nix/, the Nix package
166 manager} is available, you
167 can instead configure Guix with @code{--disable-daemon}. In that case,
168 Nix replaces the three dependencies above.
169
170 Guix is compatible with Nix, so it is possible to share the same store
171 between both. To do so, you must pass @command{configure} not only the
172 same @code{--with-store-dir} value, but also the same
173 @code{--localstatedir} value. The latter is essential because it
174 specifies where the database that stores metadata about the store is
175 located, among other things. The default values for Nix are
176 @code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
177 Note that @code{--disable-daemon} is not required if
178 your goal is to share the store with Nix.
179
180 @node Setting Up the Daemon
181 @section Setting Up the Daemon
182
183 @cindex daemon
184 Operations such as building a package or running the garbage collector
185 are all performed by a specialized process, the @dfn{build daemon}, on
186 behalf of clients. Only the daemon may access the store and its
187 associated database. Thus, any operation that manipulates the store
188 goes through the daemon. For instance, command-line tools such as
189 @command{guix package} and @command{guix build} communicate with the
190 daemon (@i{via} remote procedure calls) to instruct it what to do.
191
192 The following sections explain how to prepare the build daemon's
193 environment.
194
195 @menu
196 * Build Environment Setup:: Preparing the isolated build environment.
197 * Daemon Offload Setup:: Offloading builds to remote machines.
198 @end menu
199
200 @node Build Environment Setup
201 @subsection Build Environment Setup
202
203 In a standard multi-user setup, Guix and its daemon---the
204 @command{guix-daemon} program---are installed by the system
205 administrator; @file{/gnu/store} is owned by @code{root} and
206 @command{guix-daemon} runs as @code{root}. Unprivileged users may use
207 Guix tools to build packages or otherwise access the store, and the
208 daemon will do it on their behalf, ensuring that the store is kept in a
209 consistent state, and allowing built packages to be shared among users.
210
211 @cindex build users
212 When @command{guix-daemon} runs as @code{root}, you may not want package
213 build processes themselves to run as @code{root} too, for obvious
214 security reasons. To avoid that, a special pool of @dfn{build users}
215 should be created for use by build processes started by the daemon.
216 These build users need not have a shell and a home directory: they will
217 just be used when the daemon drops @code{root} privileges in build
218 processes. Having several such users allows the daemon to launch
219 distinct build processes under separate UIDs, which guarantees that they
220 do not interfere with each other---an essential feature since builds are
221 regarded as pure functions (@pxref{Introduction}).
222
223 On a GNU/Linux system, a build user pool may be created like this (using
224 Bash syntax and the @code{shadow} commands):
225
226 @c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
227 @c for why `-G' is needed.
228 @example
229 # groupadd guix-builder
230 # for i in `seq 1 10`;
231 do
232 useradd -g guix-builder -G guix-builder \
233 -d /var/empty -s `which nologin` \
234 -c "Guix build user $i" --system \
235 guix-builder$i;
236 done
237 @end example
238
239 @noindent
240 The @code{guix-daemon} program may then be run as @code{root} with:
241
242 @example
243 # guix-daemon --build-users-group=guix-builder
244 @end example
245
246 @cindex chroot
247 @noindent
248 This way, the daemon starts build processes in a chroot, under one of
249 the @code{guix-builder} users. On GNU/Linux, by default, the chroot
250 environment contains nothing but:
251
252 @c Keep this list in sync with libstore/build.cc! -----------------------
253 @itemize
254 @item
255 a minimal @code{/dev} directory, created mostly independently from the
256 host @code{/dev}@footnote{``Mostly'', because while the set of files
257 that appear in the chroot's @code{/dev} is fixed, most of these files
258 can only be created if the host has them.};
259
260 @item
261 the @code{/proc} directory; it only shows the container's processes
262 since a separate PID name space is used;
263
264 @item
265 @file{/etc/passwd} with an entry for the current user and an entry for
266 user @file{nobody};
267
268 @item
269 @file{/etc/group} with an entry for the user's group;
270
271 @item
272 @file{/etc/hosts} with an entry that maps @code{localhost} to
273 @code{127.0.0.1};
274
275 @item
276 a writable @file{/tmp} directory.
277 @end itemize
278
279 If you are installing Guix as an unprivileged user, it is still
280 possible to run @command{guix-daemon}. However, build processes will
281 not be isolated from one another, and not from the rest of the system.
282 Thus, build processes may interfere with each other, and may access
283 programs, libraries, and other files available on the system---making it
284 much harder to view them as @emph{pure} functions.
285
286
287 @node Daemon Offload Setup
288 @subsection Using the Offload Facility
289
290 @cindex offloading
291 @cindex build hook
292 When desired, the build daemon can @dfn{offload}
293 derivation builds to other machines
294 running Guix, using the @code{offload} @dfn{build hook}. When that
295 feature is enabled, a list of user-specified build machines is read from
296 @file{/etc/guix/machines.scm}; anytime a build is requested, for
297 instance via @code{guix build}, the daemon attempts to offload it to one
298 of the machines that satisfies the derivation's constraints, in
299 particular its system type---e.g., @file{x86_64-linux}. Missing
300 prerequisites for the build are copied over SSH to the target machine,
301 which then proceeds with the build; upon success the output(s) of the
302 build are copied back to the initial machine.
303
304 The @file{/etc/guix/machines.scm} file typically looks like this:
305
306 @example
307 (list (build-machine
308 (name "eightysix.example.org")
309 (system "x86_64-linux")
310 (user "bob")
311 (speed 2.)) ; incredibly fast!
312
313 (build-machine
314 (name "meeps.example.org")
315 (system "mips64el-linux")
316 (user "alice")
317 (private-key
318 (string-append (getenv "HOME")
319 "/.ssh/id-rsa-for-guix"))))
320 @end example
321
322 @noindent
323 In the example above we specify a list of two build machines, one for
324 the @code{x86_64} architecture and one for the @code{mips64el}
325 architecture.
326
327 In fact, this file is---not surprisingly!---a Scheme file that is
328 evaluated when the @code{offload} hook is started. Its return value
329 must be a list of @code{build-machine} objects. While this example
330 shows a fixed list of build machines, one could imagine, say, using
331 DNS-SD to return a list of potential build machines discovered in the
332 local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
333 Avahi in Guile Scheme Programs}).
334
335 The compulsory fields for a @code{build-machine} declaration are:
336
337 @table @code
338
339 @item name
340 The remote machine's host name.
341
342 @item system
343 The remote machine's system type.
344
345 @item user
346 The user account to use when connecting to the remote machine over SSH.
347 Note that the SSH key pair must @emph{not} be passphrase-protected, to
348 allow non-interactive logins.
349
350 @end table
351
352 @noindent
353 A number of optional fields may be specified:
354
355 @table @code
356
357 @item port
358 Port number of the machine's SSH server (default: 22).
359
360 @item private-key
361 The SSH private key file to use when connecting to the machine.
362
363 @item parallel-builds
364 The number of builds that may run in parallel on the machine (1 by
365 default.)
366
367 @item speed
368 A ``relative speed factor''. The offload scheduler will tend to prefer
369 machines with a higher speed factor.
370
371 @item features
372 A list of strings denoting specific features supported by the machine.
373 An example is @code{"kvm"} for machines that have the KVM Linux modules
374 and corresponding hardware support. Derivations can request features by
375 name, and they will be scheduled on matching build machines.
376
377 @end table
378
379 The @code{guix} command must be in the search path on the build
380 machines, since offloading works by invoking the @code{guix archive} and
381 @code{guix build} commands.
382
383 There's one last thing to do once @file{machines.scm} is in place. As
384 explained above, when offloading, files are transferred back and forth
385 between the machine stores. For this to work, you need to generate a
386 key pair to allow the daemon to export signed archives of files from the
387 store (@pxref{Invoking guix archive}):
388
389 @example
390 # guix archive --generate-key
391 @end example
392
393 @noindent
394 Thus, when receiving files, a machine's build daemon can make sure they
395 are genuine, have not been tampered with, and that they are signed by an
396 authorized key.
397
398
399 @node Invoking guix-daemon
400 @section Invoking @command{guix-daemon}
401
402 The @command{guix-daemon} program implements all the functionality to
403 access the store. This includes launching build processes, running the
404 garbage collector, querying the availability of a build result, etc. It
405 is normally run as @code{root} like this:
406
407 @example
408 # guix-daemon --build-users-group=guix-builder
409 @end example
410
411 @noindent
412 For details on how to set it up, @ref{Setting Up the Daemon}.
413
414 @cindex chroot
415 @cindex container, build environment
416 @cindex build environment
417 @cindex reproducible builds
418 By default, @command{guix-daemon} launches build processes under
419 different UIDs, taken from the build group specified with
420 @code{--build-users-group}. In addition, each build process is run in a
421 chroot environment that only contains the subset of the store that the
422 build process depends on, as specified by its derivation
423 (@pxref{Programming Interface, derivation}), plus a set of specific
424 system directories. By default, the latter contains @file{/dev} and
425 @file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
426 @dfn{container}: in addition to having its own file system tree, it has
427 a separate mount name space, its own PID name space, network name space,
428 etc. This helps achieve reproducible builds (@pxref{Features}).
429
430 The following command-line options are supported:
431
432 @table @code
433 @item --build-users-group=@var{group}
434 Take users from @var{group} to run build processes (@pxref{Setting Up
435 the Daemon, build users}).
436
437 @item --no-substitutes
438 @cindex substitutes
439 Do not use substitutes for build products. That is, always build things
440 locally instead of allowing downloads of pre-built binaries
441 (@pxref{Substitutes}).
442
443 By default substitutes are used, unless the client---such as the
444 @command{guix package} command---is explicitly invoked with
445 @code{--no-substitutes}.
446
447 When the daemon runs with @code{--no-substitutes}, clients can still
448 explicitly enable substitution @i{via} the @code{set-build-options}
449 remote procedure call (@pxref{The Store}).
450
451 @cindex build hook
452 @item --no-build-hook
453 Do not use the @dfn{build hook}.
454
455 The build hook is a helper program that the daemon can start and to
456 which it submits build requests. This mechanism is used to offload
457 builds to other machines (@pxref{Daemon Offload Setup}).
458
459 @item --cache-failures
460 Cache build failures. By default, only successful builds are cached.
461
462 @item --cores=@var{n}
463 @itemx -c @var{n}
464 Use @var{n} CPU cores to build each derivation; @code{0} means as many
465 as available.
466
467 The default value is @code{1}, but it may be overridden by clients, such
468 as the @code{--cores} option of @command{guix build} (@pxref{Invoking
469 guix build}).
470
471 The effect is to define the @code{NIX_BUILD_CORES} environment variable
472 in the build process, which can then use it to exploit internal
473 parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
474
475 @item --max-jobs=@var{n}
476 @itemx -M @var{n}
477 Allow at most @var{n} build jobs in parallel. The default value is
478 @code{1}.
479
480 @item --debug
481 Produce debugging output.
482
483 This is useful to debug daemon start-up issues, but then it may be
484 overridden by clients, for example the @code{--verbosity} option of
485 @command{guix build} (@pxref{Invoking guix build}).
486
487 @item --chroot-directory=@var{dir}
488 Add @var{dir} to the build chroot.
489
490 Doing this may change the result of build processes---for instance if
491 they use optional dependencies found in @var{dir} when it is available,
492 and not otherwise. For that reason, it is not recommended to do so.
493 Instead, make sure that each derivation declares all the inputs that it
494 needs.
495
496 @item --disable-chroot
497 Disable chroot builds.
498
499 Using this option is not recommended since, again, it would allow build
500 processes to gain access to undeclared dependencies.
501
502 @item --disable-log-compression
503 Disable compression of the build logs.
504
505 Unless @code{--lose-logs} is used, all the build logs are kept in the
506 @var{localstatedir}. To save space, the daemon automatically compresses
507 them with bzip2 by default. This option disables that.
508
509 @item --disable-deduplication
510 @cindex deduplication
511 Disable automatic file ``deduplication'' in the store.
512
513 By default, files added to the store are automatically ``deduplicated'':
514 if a newly added file is identical to another one found in the store,
515 the daemon makes the new file a hard link to the other file. This can
516 noticeably reduce disk usage, at the expense of slightly increasde
517 input/output load at the end of a build process. This option disables
518 this optimization.
519
520 @item --gc-keep-outputs[=yes|no]
521 Tell whether the garbage collector (GC) must keep outputs of live
522 derivations.
523
524 When set to ``yes'', the GC will keep the outputs of any live derivation
525 available in the store---the @code{.drv} files. The default is ``no'',
526 meaning that derivation outputs are kept only if they are GC roots.
527
528 @item --gc-keep-derivations[=yes|no]
529 Tell whether the garbage collector (GC) must keep derivations
530 corresponding to live outputs.
531
532 When set to ``yes'', as is the case by default, the GC keeps
533 derivations---i.e., @code{.drv} files---as long as at least one of their
534 outputs is live. This allows users to keep track of the origins of
535 items in their store. Setting it to ``no'' saves a bit of disk space.
536
537 Note that when both @code{--gc-keep-derivations} and
538 @code{--gc-keep-outputs} are used, the effect is to keep all the build
539 prerequisites (the sources, compiler, libraries, and other build-time
540 tools) of live objects in the store, regardless of whether these
541 prerequisites are live. This is convenient for developers since it
542 saves rebuilds or downloads.
543
544 @item --impersonate-linux-2.6
545 On Linux-based systems, impersonate Linux 2.6. This means that the
546 kernel's @code{uname} system call will report 2.6 as the release number.
547
548 This might be helpful to build programs that (usually wrongfully) depend
549 on the kernel version number.
550
551 @item --lose-logs
552 Do not keep build logs. By default they are kept under
553 @code{@var{localstatedir}/guix/log}.
554
555 @item --system=@var{system}
556 Assume @var{system} as the current system type. By default it is the
557 architecture/kernel pair found at configure time, such as
558 @code{x86_64-linux}.
559
560 @item --listen=@var{socket}
561 Listen for connections on @var{socket}, the file name of a Unix-domain
562 socket. The default socket is
563 @file{@var{localstatedir}/daemon-socket/socket}. This option is only
564 useful in exceptional circumstances, such as if you need to run several
565 daemons on the same machine.
566 @end table
567
568
569 @c *********************************************************************
570 @node Package Management
571 @chapter Package Management
572
573 The purpose of GNU Guix is to allow users to easily install, upgrade, and
574 remove software packages, without having to know about their build
575 procedure or dependencies. Guix also goes beyond this obvious set of
576 features.
577
578 This chapter describes the main features of Guix, as well as the package
579 management tools it provides.
580
581 @menu
582 * Features:: How Guix will make your life brighter.
583 * Invoking guix package:: Package installation, removal, etc.
584 * Emacs Interface:: Package management from Emacs.
585 * Substitutes:: Downloading pre-built binaries.
586 * Packages with Multiple Outputs:: Single source package, multiple outputs.
587 * Invoking guix gc:: Running the garbage collector.
588 * Invoking guix pull:: Fetching the latest Guix and distribution.
589 * Invoking guix archive:: Exporting and importing store files.
590 @end menu
591
592 @node Features
593 @section Features
594
595 When using Guix, each package ends up in the @dfn{package store}, in its
596 own directory---something that resembles
597 @file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string.
598
599 Instead of referring to these directories, users have their own
600 @dfn{profile}, which points to the packages that they actually want to
601 use. These profiles are stored within each user's home directory, at
602 @code{$HOME/.guix-profile}.
603
604 For example, @code{alice} installs GCC 4.7.2. As a result,
605 @file{/home/alice/.guix-profile/bin/gcc} points to
606 @file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
607 @code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
608 simply continues to point to
609 @file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
610 coexist on the same system without any interference.
611
612 The @command{guix package} command is the central tool to manage
613 packages (@pxref{Invoking guix package}). It operates on those per-user
614 profiles, and can be used @emph{with normal user privileges}.
615
616 The command provides the obvious install, remove, and upgrade
617 operations. Each invocation is actually a @emph{transaction}: either
618 the specified operation succeeds, or nothing happens. Thus, if the
619 @command{guix package} process is terminated during the transaction,
620 or if a power outage occurs during the transaction, then the user's
621 profile remains in its previous state, and remains usable.
622
623 In addition, any package transaction may be @emph{rolled back}. So, if,
624 for example, an upgrade installs a new version of a package that turns
625 out to have a serious bug, users may roll back to the previous instance
626 of their profile, which was known to work well. Similarly, the global
627 system configuration is subject to transactional upgrades and roll-back
628 (@pxref{Using the Configuration System}).
629
630 All those packages in the package store may be @emph{garbage-collected}.
631 Guix can determine which packages are still referenced by the user
632 profiles, and remove those that are provably no longer referenced
633 (@pxref{Invoking guix gc}). Users may also explicitly remove old
634 generations of their profile so that the packages they refer to can be
635 collected.
636
637 @cindex reproducibility
638 @cindex reproducible builds
639 Finally, Guix takes a @dfn{purely functional} approach to package
640 management, as described in the introduction (@pxref{Introduction}).
641 Each @file{/gnu/store} package directory name contains a hash of all the
642 inputs that were used to build that package---compiler, libraries, build
643 scripts, etc. This direct correspondence allows users to make sure a
644 given package installation matches the current state of their
645 distribution. It also helps maximize @dfn{build reproducibility}:
646 thanks to the isolated build environments that are used, a given build
647 is likely to yield bit-identical files when performed on different
648 machines (@pxref{Invoking guix-daemon, container}).
649
650 @cindex substitutes
651 This foundation allows Guix to support @dfn{transparent binary/source
652 deployment}. When a pre-built binary for a @file{/gnu/store} item is
653 available from an external source---a @dfn{substitute}, Guix just
654 downloads it and unpacks it;
655 otherwise, it builds the package from source, locally
656 (@pxref{Substitutes}).
657
658 @node Invoking guix package
659 @section Invoking @command{guix package}
660
661 The @command{guix package} command is the tool that allows users to
662 install, upgrade, and remove packages, as well as rolling back to
663 previous configurations. It operates only on the user's own profile,
664 and works with normal user privileges (@pxref{Features}). Its syntax
665 is:
666
667 @example
668 guix package @var{options}
669 @end example
670
671 Primarily, @var{options} specifies the operations to be performed during
672 the transaction. Upon completion, a new profile is created, but
673 previous generations of the profile remain available, should the user
674 want to roll back.
675
676 For example, to remove @code{lua} and install @code{guile} and
677 @code{guile-cairo} in a single transaction:
678
679 @example
680 guix package -r lua -i guile guile-cairo
681 @end example
682
683 For each user, a symlink to the user's default profile is automatically
684 created in @file{$HOME/.guix-profile}. This symlink always points to the
685 current generation of the user's default profile. Thus, users can add
686 @file{$HOME/.guix-profile/bin} to their @code{PATH} environment
687 variable, and so on.
688
689 In a multi-user setup, user profiles must be stored in a place
690 registered as a @dfn{garbage-collector root}, which
691 @file{$HOME/.guix-profile} points to (@pxref{Invoking guix gc}). That
692 directory is normally
693 @code{@var{localstatedir}/profiles/per-user/@var{user}}, where
694 @var{localstatedir} is the value passed to @code{configure} as
695 @code{--localstatedir}, and @var{user} is the user name. It must be
696 created by @code{root}, with @var{user} as the owner. When it does not
697 exist, or is not owned by @var{user}, @command{guix package} emits an
698 error about it.
699
700 The @var{options} can be among the following:
701
702 @table @code
703
704 @item --install=@var{package} @dots{}
705 @itemx -i @var{package} @dots{}
706 Install the specified @var{package}s.
707
708 Each @var{package} may specify either a simple package name, such as
709 @code{guile}, or a package name followed by a hyphen and version number,
710 such as @code{guile-1.8.8}. If no version number is specified, the
711 newest available version will be selected. In addition, @var{package}
712 may contain a colon, followed by the name of one of the outputs of the
713 package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
714 (@pxref{Packages with Multiple Outputs}). Packages with a corresponding
715 name (and optionally version) are searched for among the GNU
716 distribution modules (@pxref{Package Modules}).
717
718 @cindex propagated inputs
719 Sometimes packages have @dfn{propagated inputs}: these are dependencies
720 that automatically get installed along with the required package.
721
722 An example is the GNU MPC library: its C header files refer to those of
723 the GNU MPFR library, which in turn refer to those of the GMP library.
724 Thus, when installing MPC, the MPFR and GMP libraries also get installed
725 in the profile; removing MPC also removes MPFR and GMP---unless they had
726 also been explicitly installed independently.
727
728 Besides, packages sometimes rely on the definition of environment
729 variables for their search paths (see explanation of
730 @code{--search-paths} below). Any missing or possibly incorrect
731 environment variable definitions are reported here.
732
733 @c XXX: keep me up-to-date
734 Finally, when installing a GNU package, the tool reports the
735 availability of a newer upstream version. In the future, it may provide
736 the option of installing directly from the upstream version, even if
737 that version is not yet in the distribution.
738
739 @item --install-from-expression=@var{exp}
740 @itemx -e @var{exp}
741 Install the package @var{exp} evaluates to.
742
743 @var{exp} must be a Scheme expression that evaluates to a
744 @code{<package>} object. This option is notably useful to disambiguate
745 between same-named variants of a package, with expressions such as
746 @code{(@@ (gnu packages base) guile-final)}.
747
748 Note that this option installs the first output of the specified
749 package, which may be insufficient when needing a specific output of a
750 multiple-output package.
751
752 @item --remove=@var{package} @dots{}
753 @itemx -r @var{package} @dots{}
754 Remove the specified @var{package}s.
755
756 As for @code{--install}, each @var{package} may specify a version number
757 and/or output name in addition to the package name. For instance,
758 @code{-r glibc:debug} would remove the @code{debug} output of
759 @code{glibc}.
760
761 @item --upgrade[=@var{regexp} @dots{}]
762 @itemx -u [@var{regexp} @dots{}]
763 Upgrade all the installed packages. If one or more @var{regexp}s are
764 specified, upgrade only installed packages whose name matches a
765 @var{regexp}.
766
767 Note that this upgrades package to the latest version of packages found
768 in the distribution currently installed. To update your distribution,
769 you should regularly run @command{guix pull} (@pxref{Invoking guix
770 pull}).
771
772 @item --roll-back
773 Roll back to the previous @dfn{generation} of the profile---i.e., undo
774 the last transaction.
775
776 When combined with options such as @code{--install}, roll back occurs
777 before any other actions.
778
779 When rolling back from the first generation that actually contains
780 installed packages, the profile is made to point to the @dfn{zeroth
781 generation}, which contains no files apart from its own meta-data.
782
783 Installing, removing, or upgrading packages from a generation that has
784 been rolled back to overwrites previous future generations. Thus, the
785 history of a profile's generations is always linear.
786
787 @item --search-paths
788 @cindex search paths
789 Report environment variable definitions, in Bash syntax, that may be
790 needed in order to use the set of installed packages. These environment
791 variables are used to specify @dfn{search paths} for files used by some
792 of the installed packages.
793
794 For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
795 environment variables to be defined so it can look for headers and
796 libraries in the user's profile (@pxref{Environment Variables,,, gcc,
797 Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
798 library are installed in the profile, then @code{--search-paths} will
799 suggest setting these variables to @code{@var{profile}/include} and
800 @code{@var{profile}/lib}, respectively.
801
802 @item --profile=@var{profile}
803 @itemx -p @var{profile}
804 Use @var{profile} instead of the user's default profile.
805
806 @item --verbose
807 Produce verbose output. In particular, emit the environment's build log
808 on the standard error port.
809
810 @item --bootstrap
811 Use the bootstrap Guile to build the profile. This option is only
812 useful to distribution developers.
813
814 @end table
815
816 In addition to these actions @command{guix package} supports the
817 following options to query the current state of a profile, or the
818 availability of packages:
819
820 @table @option
821
822 @item --search=@var{regexp}
823 @itemx -s @var{regexp}
824 List the available packages whose synopsis or description matches
825 @var{regexp}. Print all the meta-data of matching packages in
826 @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
827 GNU recutils manual}).
828
829 This allows specific fields to be extracted using the @command{recsel}
830 command, for instance:
831
832 @example
833 $ guix package -s malloc | recsel -p name,version
834 name: glibc
835 version: 2.17
836
837 name: libgc
838 version: 7.2alpha6
839 @end example
840
841 Similarly, to show the name of all the packages available under the
842 terms of the GNU@tie{}LGPL version 3:
843
844 @example
845 $ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
846 name: elfutils
847
848 name: gmp
849 @dots{}
850 @end example
851
852 @item --show=@var{package}
853 Show details about @var{package}, taken from the list of available packages, in
854 @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
855 recutils manual}).
856
857 @example
858 $ guix package --show=python | recsel -p name,version
859 name: python
860 version: 2.7.6
861
862 name: python
863 version: 3.3.5
864 @end example
865
866 You may also specify the full name of a package to only get details about a
867 specific version of it:
868 @example
869 $ guix package --show=python-3.3.5 | recsel -p name,version
870 name: python
871 version: 3.3.5
872 @end example
873
874
875
876 @item --list-installed[=@var{regexp}]
877 @itemx -I [@var{regexp}]
878 List the currently installed packages in the specified profile, with the
879 most recently installed packages shown last. When @var{regexp} is
880 specified, list only installed packages whose name matches @var{regexp}.
881
882 For each installed package, print the following items, separated by
883 tabs: the package name, its version string, the part of the package that
884 is installed (for instance, @code{out} for the default output,
885 @code{include} for its headers, etc.), and the path of this package in
886 the store.
887
888 @item --list-available[=@var{regexp}]
889 @itemx -A [@var{regexp}]
890 List packages currently available in the software distribution
891 (@pxref{GNU Distribution}). When @var{regexp} is specified, list only
892 installed packages whose name matches @var{regexp}.
893
894 For each package, print the following items separated by tabs: its name,
895 its version string, the parts of the package (@pxref{Packages with
896 Multiple Outputs}), and the source location of its definition.
897
898 @item --list-generations[=@var{pattern}]
899 @itemx -l [@var{pattern}]
900 Return a list of generations along with their creation dates; for each
901 generation, show the installed packages, with the most recently
902 installed packages shown last. Note that the zeroth generation is never
903 shown.
904
905 For each installed package, print the following items, separated by
906 tabs: the name of a package, its version string, the part of the package
907 that is installed (@pxref{Packages with Multiple Outputs}), and the
908 location of this package in the store.
909
910 When @var{pattern} is used, the command returns only matching
911 generations. Valid patterns include:
912
913 @itemize
914 @item @emph{Integers and comma-separated integers}. Both patterns denote
915 generation numbers. For instance, @code{--list-generations=1} returns
916 the first one.
917
918 And @code{--list-generations=1,8,2} outputs three generations in the
919 specified order. Neither spaces nor trailing commas are allowed.
920
921 @item @emph{Ranges}. @code{--list-generations=2..9} prints the
922 specified generations and everything in between. Note that the start of
923 a range must be lesser than its end.
924
925 It is also possible to omit the endpoint. For example,
926 @code{--list-generations=2..}, returns all generations starting from the
927 second one.
928
929 @item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
930 or months by passing an integer along with the first letter of the
931 duration. For example, @code{--list-generations=20d} lists generations
932 that are up to 20 days old.
933 @end itemize
934
935 @item --delete-generations[=@var{pattern}]
936 @itemx -d [@var{pattern}]
937 When @var{pattern} is omitted, delete all generations except the current
938 one.
939
940 This command accepts the same patterns as @option{--list-generations}.
941 When @var{pattern} is specified, delete the matching generations. When
942 @var{pattern} specifies a duration, generations @emph{older} than the
943 specified duration match. For instance, @code{--delete-generations=1m}
944 deletes generations that are more than one month old.
945
946 If the current generation matches, it is deleted atomically---i.e., by
947 switching to the previous available generation. Note that the zeroth
948 generation is never deleted.
949
950 Note that deleting generations prevents roll-back to them.
951 Consequently, this command must be used with care.
952
953 @end table
954
955 Finally, since @command{guix package} may actually start build
956 processes, it supports all the common build options that @command{guix
957 build} supports (@pxref{Invoking guix build, common build options}).
958
959 @include emacs.texi
960
961 @node Substitutes
962 @section Substitutes
963
964 @cindex substitutes
965 @cindex pre-built binaries
966 Guix supports transparent source/binary deployment, which means that it
967 can either build things locally, or download pre-built items from a
968 server. We call these pre-built items @dfn{substitutes}---they are
969 substitutes for local build results. In many cases, downloading a
970 substitute is much faster than building things locally.
971
972 Substitutes can be anything resulting from a derivation build
973 (@pxref{Derivations}). Of course, in the common case, they are
974 pre-built package binaries, but source tarballs, for instance, which
975 also result from derivation builds, can be available as substitutes.
976
977 The @code{hydra.gnu.org} server is a front-end to a build farm that
978 builds packages from the GNU distribution continuously for some
979 architectures, and makes them available as substitutes.
980
981 @cindex security
982 @cindex digital signatures
983 To allow Guix to download substitutes from @code{hydra.gnu.org}, you
984 must add its public key to the access control list (ACL) of archive
985 imports, using the @command{guix archive} command (@pxref{Invoking guix
986 archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
987 be compromised and to serve genuine substitutes.
988
989 This public key is installed along with Guix, in
990 @code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
991 the installation prefix of Guix. If you installed Guix from source,
992 make sure you checked the GPG signature of
993 @file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
994 Then, you can run something like this:
995
996 @example
997 # guix archive --authorize < hydra.gnu.org.pub
998 @end example
999
1000 Once this is in place, the output of a command like @code{guix build}
1001 should change from something like:
1002
1003 @example
1004 $ guix build emacs --dry-run
1005 The following derivations would be built:
1006 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1007 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1008 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1009 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1010 @dots{}
1011 @end example
1012
1013 @noindent
1014 to something like:
1015
1016 @example
1017 $ guix build emacs --dry-run
1018 The following files would be downloaded:
1019 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1020 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1021 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1022 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1023 @dots{}
1024 @end example
1025
1026 @noindent
1027 This indicates that substitutes from @code{hydra.gnu.org} are usable and
1028 will be downloaded, when possible, for future builds.
1029
1030 Guix ignores substitutes that are not signed, or that are not signed by
1031 one of the keys listed in the ACL. It also detects and raises an error
1032 when attempting to use a substitute that has been tampered with.
1033
1034 The substitute mechanism can be disabled globally by running
1035 @code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1036 guix-daemon}). It can also be disabled temporarily by passing the
1037 @code{--no-substitutes} option to @command{guix package}, @command{guix
1038 build}, and other command-line tools.
1039
1040
1041 Today, each individual's control over their own computing is at the
1042 mercy of institutions, corporations, and groups with enough power and
1043 determination to subvert the computing infrastructure and exploit its
1044 weaknesses. While using @code{hydra.gnu.org} substitutes can be
1045 convenient, we encourage users to also build on their own, or even run
1046 their own build farm, such that @code{hydra.gnu.org} is less of an
1047 interesting target.
1048
1049 Guix has the foundations to maximize build reproducibility
1050 (@pxref{Features}). In most cases, independent builds of a given
1051 package or derivation should yield bit-identical results. Thus, through
1052 a diverse set of independent package builds, we can strengthen the
1053 integrity of our systems.
1054
1055 In the future, we want Guix to have support to publish and retrieve
1056 binaries to/from other users, in a peer-to-peer fashion. If you would
1057 like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1058
1059
1060 @node Packages with Multiple Outputs
1061 @section Packages with Multiple Outputs
1062
1063 @cindex multiple-output packages
1064 @cindex package outputs
1065
1066 Often, packages defined in Guix have a single @dfn{output}---i.e., the
1067 source package leads exactly one directory in the store. When running
1068 @command{guix package -i glibc}, one installs the default output of the
1069 GNU libc package; the default output is called @code{out}, but its name
1070 can be omitted as shown in this command. In this particular case, the
1071 default output of @code{glibc} contains all the C header files, shared
1072 libraries, static libraries, Info documentation, and other supporting
1073 files.
1074
1075 Sometimes it is more appropriate to separate the various types of files
1076 produced from a single source package into separate outputs. For
1077 instance, the GLib C library (used by GTK+ and related packages)
1078 installs more than 20 MiB of reference documentation as HTML pages.
1079 To save space for users who do not need it, the documentation goes to a
1080 separate output, called @code{doc}. To install the main GLib output,
1081 which contains everything but the documentation, one would run:
1082
1083 @example
1084 guix package -i glib
1085 @end example
1086
1087 The command to install its documentation is:
1088
1089 @example
1090 guix package -i glib:doc
1091 @end example
1092
1093 Some packages install programs with different ``dependency footprints''.
1094 For instance, the WordNet package install both command-line tools and
1095 graphical user interfaces (GUIs). The former depend solely on the C
1096 library, whereas the latter depend on Tcl/Tk and the underlying X
1097 libraries. In this case, we leave the command-line tools in the default
1098 output, whereas the GUIs are in a separate output. This allows users
1099 who do not need the GUIs to save space.
1100
1101 There are several such multiple-output packages in the GNU distribution.
1102 Other conventional output names include @code{lib} for libraries and
1103 possibly header files, @code{bin} for stand-alone programs, and
1104 @code{debug} for debugging information (@pxref{Installing Debugging
1105 Files}). The outputs of a packages are listed in the third column of
1106 the output of @command{guix package --list-available} (@pxref{Invoking
1107 guix package}).
1108
1109
1110 @node Invoking guix gc
1111 @section Invoking @command{guix gc}
1112
1113 @cindex garbage collector
1114 Packages that are installed but not used may be @dfn{garbage-collected}.
1115 The @command{guix gc} command allows users to explicitly run the garbage
1116 collector to reclaim space from the @file{/gnu/store} directory.
1117
1118 The garbage collector has a set of known @dfn{roots}: any file under
1119 @file{/gnu/store} reachable from a root is considered @dfn{live} and
1120 cannot be deleted; any other file is considered @dfn{dead} and may be
1121 deleted. The set of garbage collector roots includes default user
1122 profiles, and may be augmented with @command{guix build --root}, for
1123 example (@pxref{Invoking guix build}).
1124
1125 Prior to running @code{guix gc --collect-garbage} to make space, it is
1126 often useful to remove old generations from user profiles; that way, old
1127 package builds referenced by those generations can be reclaimed. This
1128 is achieved by running @code{guix package --delete-generations}
1129 (@pxref{Invoking guix package}).
1130
1131 The @command{guix gc} command has three modes of operation: it can be
1132 used to garbage-collect any dead files (the default), to delete specific
1133 files (the @code{--delete} option), or to print garbage-collector
1134 information. The available options are listed below:
1135
1136 @table @code
1137 @item --collect-garbage[=@var{min}]
1138 @itemx -C [@var{min}]
1139 Collect garbage---i.e., unreachable @file{/gnu/store} files and
1140 sub-directories. This is the default operation when no option is
1141 specified.
1142
1143 When @var{min} is given, stop once @var{min} bytes have been collected.
1144 @var{min} may be a number of bytes, or it may include a unit as a
1145 suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes.
1146
1147 When @var{min} is omitted, collect all the garbage.
1148
1149 @item --delete
1150 @itemx -d
1151 Attempt to delete all the store files and directories specified as
1152 arguments. This fails if some of the files are not in the store, or if
1153 they are still live.
1154
1155 @item --list-dead
1156 Show the list of dead files and directories still present in the
1157 store---i.e., files and directories no longer reachable from any root.
1158
1159 @item --list-live
1160 Show the list of live store files and directories.
1161
1162 @end table
1163
1164 In addition, the references among existing store files can be queried:
1165
1166 @table @code
1167
1168 @item --references
1169 @itemx --referrers
1170 List the references (respectively, the referrers) of store files given
1171 as arguments.
1172
1173 @item --requisites
1174 @itemx -R
1175 List the requisites of the store files passed as arguments. Requisites
1176 include the store files themselves, their references, and the references
1177 of these, recursively. In other words, the returned list is the
1178 @dfn{transitive closure} of the store files.
1179
1180 @end table
1181
1182
1183 @node Invoking guix pull
1184 @section Invoking @command{guix pull}
1185
1186 Packages are installed or upgraded to the latest version available in
1187 the distribution currently available on your local machine. To update
1188 that distribution, along with the Guix tools, you must run @command{guix
1189 pull}: the command downloads the latest Guix source code and package
1190 descriptions, and deploys it.
1191
1192 On completion, @command{guix package} will use packages and package
1193 versions from this just-retrieved copy of Guix. Not only that, but all
1194 the Guix commands and Scheme modules will also be taken from that latest
1195 version. New @command{guix} sub-commands added by the update also
1196 become available.
1197
1198 The @command{guix pull} command is usually invoked with no arguments,
1199 but it supports the following options:
1200
1201 @table @code
1202 @item --verbose
1203 Produce verbose output, writing build logs to the standard error output.
1204
1205 @item --url=@var{url}
1206 Download the source tarball of Guix from @var{url}.
1207
1208 By default, the tarball is taken from its canonical address at
1209 @code{gnu.org}, for the stable branch of Guix.
1210
1211 @item --bootstrap
1212 Use the bootstrap Guile to build the latest Guix. This option is only
1213 useful to Guix developers.
1214 @end table
1215
1216
1217 @node Invoking guix archive
1218 @section Invoking @command{guix archive}
1219
1220 The @command{guix archive} command allows users to @dfn{export} files
1221 from the store into a single archive, and to later @dfn{import} them.
1222 In particular, it allows store files to be transferred from one machine
1223 to another machine's store. For example, to transfer the @code{emacs}
1224 package to a machine connected over SSH, one would run:
1225
1226 @example
1227 guix archive --export emacs | ssh the-machine guix archive --import
1228 @end example
1229
1230 @noindent
1231 However, note that, in this example, all of @code{emacs} and its
1232 dependencies are transferred, regardless of what is already available in
1233 the target machine's store. The @code{--missing} option can help figure
1234 out which items are missing from the target's store.
1235
1236 Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
1237 comparable in spirit to `tar', but with a few noteworthy differences
1238 that make it more appropriate for our purposes. First, rather than
1239 recording all Unix meta-data for each file, the Nar format only mentions
1240 the file type (regular, directory, or symbolic link); Unix permissions
1241 and owner/group are dismissed. Second, the order in which directory
1242 entries are stored always follows the order of file names according to
1243 the C locale collation order. This makes archive production fully
1244 deterministic.
1245
1246 When exporting, the daemon digitally signs the contents of the archive,
1247 and that digital signature is appended. When importing, the daemon
1248 verifies the signature and rejects the import in case of an invalid
1249 signature or if the signing key is not authorized.
1250 @c FIXME: Add xref to daemon doc about signatures.
1251
1252 The main options are:
1253
1254 @table @code
1255 @item --export
1256 Export the specified store files or packages (see below.) Write the
1257 resulting archive to the standard output.
1258
1259 @item --import
1260 Read an archive from the standard input, and import the files listed
1261 therein into the store. Abort if the archive has an invalid digital
1262 signature, or if it is signed by a public key not among the authorized
1263 keys (see @code{--authorize} below.)
1264
1265 @item --missing
1266 Read a list of store file names from the standard input, one per line,
1267 and write on the standard output the subset of these files missing from
1268 the store.
1269
1270 @item --generate-key[=@var{parameters}]
1271 @cindex signing, archives
1272 Generate a new key pair for the daemons. This is a prerequisite before
1273 archives can be exported with @code{--export}. Note that this operation
1274 usually takes time, because it needs to gather enough entropy to
1275 generate the key pair.
1276
1277 The generated key pair is typically stored under @file{/etc/guix}, in
1278 @file{signing-key.pub} (public key) and @file{signing-key.sec} (private
1279 key, which must be kept secret.) When @var{parameters} is omitted, it
1280 is a 4096-bit RSA key. Alternately, @var{parameters} can specify
1281 @code{genkey} parameters suitable for Libgcrypt (@pxref{General
1282 public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1283 Libgcrypt Reference Manual}).
1284
1285 @item --authorize
1286 @cindex authorizing, archives
1287 Authorize imports signed by the public key passed on standard input.
1288 The public key must be in ``s-expression advanced format''---i.e., the
1289 same format as the @file{signing-key.pub} file.
1290
1291 The list of authorized keys is kept in the human-editable file
1292 @file{/etc/guix/acl}. The file contains
1293 @url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1294 s-expressions''} and is structured as an access-control list in the
1295 @url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1296 (SPKI)}.
1297 @end table
1298
1299 To export store files as an archive to the standard output, run:
1300
1301 @example
1302 guix archive --export @var{options} @var{specifications}...
1303 @end example
1304
1305 @var{specifications} may be either store file names or package
1306 specifications, as for @command{guix package} (@pxref{Invoking guix
1307 package}). For instance, the following command creates an archive
1308 containing the @code{gui} output of the @code{git} package and the main
1309 output of @code{emacs}:
1310
1311 @example
1312 guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
1313 @end example
1314
1315 If the specified packages are not built yet, @command{guix archive}
1316 automatically builds them. The build process may be controlled with the
1317 same options that can be passed to the @command{guix build} command
1318 (@pxref{Invoking guix build, common build options}).
1319
1320
1321 @c *********************************************************************
1322 @node Programming Interface
1323 @chapter Programming Interface
1324
1325 GNU Guix provides several Scheme programming interfaces (APIs) to
1326 define, build, and query packages. The first interface allows users to
1327 write high-level package definitions. These definitions refer to
1328 familiar packaging concepts, such as the name and version of a package,
1329 its build system, and its dependencies. These definitions can then be
1330 turned into concrete build actions.
1331
1332 Build actions are performed by the Guix daemon, on behalf of users. In a
1333 standard setup, the daemon has write access to the store---the
1334 @file{/gnu/store} directory---whereas users do not. The recommended
1335 setup also has the daemon perform builds in chroots, under a specific
1336 build users, to minimize interference with the rest of the system.
1337
1338 @cindex derivation
1339 Lower-level APIs are available to interact with the daemon and the
1340 store. To instruct the daemon to perform a build action, users actually
1341 provide it with a @dfn{derivation}. A derivation is a low-level
1342 representation of the build actions to be taken, and the environment in
1343 which they should occur---derivations are to package definitions what
1344 assembly is to C programs. The term ``derivation'' comes from the fact
1345 that build results @emph{derive} from them.
1346
1347 This chapter describes all these APIs in turn, starting from high-level
1348 package definitions.
1349
1350 @menu
1351 * Defining Packages:: Defining new packages.
1352 * Build Systems:: Specifying how packages are built.
1353 * The Store:: Manipulating the package store.
1354 * Derivations:: Low-level interface to package derivations.
1355 * The Store Monad:: Purely functional interface to the store.
1356 * G-Expressions:: Manipulating build expressions.
1357 @end menu
1358
1359 @node Defining Packages
1360 @section Defining Packages
1361
1362 The high-level interface to package definitions is implemented in the
1363 @code{(guix packages)} and @code{(guix build-system)} modules. As an
1364 example, the package definition, or @dfn{recipe}, for the GNU Hello
1365 package looks like this:
1366
1367 @example
1368 (define-module (gnu packages hello)
1369 #:use-module (guix packages)
1370 #:use-module (guix download)
1371 #:use-module (guix build-system gnu)
1372 #:use-module (guix licenses))
1373
1374 (define hello
1375 (package
1376 (name "hello")
1377 (version "2.8")
1378 (source (origin
1379 (method url-fetch)
1380 (uri (string-append "mirror://gnu/hello/hello-" version
1381 ".tar.gz"))
1382 (sha256
1383 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1384 (build-system gnu-build-system)
1385 (arguments `(#:configure-flags '("--enable-silent-rules")))
1386 (inputs `(("gawk" ,gawk)))
1387 (synopsis "Hello, GNU world: An example GNU package")
1388 (description "Guess what GNU Hello prints!")
1389 (home-page "http://www.gnu.org/software/hello/")
1390 (license gpl3+)))
1391 @end example
1392
1393 @noindent
1394 Without being a Scheme expert, the reader may have guessed the meaning
1395 of the various fields here. This expression binds variable @code{hello}
1396 to a @code{<package>} object, which is essentially a record
1397 (@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1398 This package object can be inspected using procedures found in the
1399 @code{(guix packages)} module; for instance, @code{(package-name hello)}
1400 returns---surprise!---@code{"hello"}.
1401
1402 In the example above, @var{hello} is defined into a module of its own,
1403 @code{(gnu packages hello)}. Technically, this is not strictly
1404 necessary, but it is convenient to do so: all the packages defined in
1405 modules under @code{(gnu packages @dots{})} are automatically known to
1406 the command-line tools (@pxref{Package Modules}).
1407
1408 There are a few points worth noting in the above package definition:
1409
1410 @itemize
1411 @item
1412 The @code{source} field of the package is an @code{<origin>} object.
1413 Here, the @code{url-fetch} method from @code{(guix download)} is used,
1414 meaning that the source is a file to be downloaded over FTP or HTTP.
1415
1416 The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1417 the GNU mirrors defined in @code{(guix download)}.
1418
1419 The @code{sha256} field specifies the expected SHA256 hash of the file
1420 being downloaded. It is mandatory, and allows Guix to check the
1421 integrity of the file. The @code{(base32 @dots{})} form introduces the
1422 base32 representation of the hash. You can obtain this information with
1423 @code{guix download} (@pxref{Invoking guix download}) and @code{guix
1424 hash} (@pxref{Invoking guix hash}).
1425
1426 @cindex patches
1427 When needed, the @code{origin} form can also have a @code{patches} field
1428 listing patches to be applied, and a @code{snippet} field giving a
1429 Scheme expression to modify the source code.
1430
1431 @item
1432 @cindex GNU Build System
1433 The @code{build-system} field specifies the procedure to build the
1434 package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1435 represents the familiar GNU Build System, where packages may be
1436 configured, built, and installed with the usual @code{./configure &&
1437 make && make check && make install} command sequence.
1438
1439 @item
1440 The @code{arguments} field specifies options for the build system
1441 (@pxref{Build Systems}). Here it is interpreted by
1442 @var{gnu-build-system} as a request run @file{configure} with the
1443 @code{--enable-silent-rules} flag.
1444
1445 @item
1446 The @code{inputs} field specifies inputs to the build process---i.e.,
1447 build-time or run-time dependencies of the package. Here, we define an
1448 input called @code{"gawk"} whose value is that of the @var{gawk}
1449 variable; @var{gawk} is itself bound to a @code{<package>} object.
1450
1451 Note that GCC, Coreutils, Bash, and other essential tools do not need to
1452 be specified as inputs here. Instead, @var{gnu-build-system} takes care
1453 of ensuring that they are present (@pxref{Build Systems}).
1454
1455 However, any other dependencies need to be specified in the
1456 @code{inputs} field. Any dependency not specified here will simply be
1457 unavailable to the build process, possibly leading to a build failure.
1458 @end itemize
1459
1460 Once a package definition is in place@footnote{Simple package
1461 definitions like the one above may be automatically converted from the
1462 Nixpkgs distribution using the @command{guix import} command.}, the
1463 package may actually be built using the @code{guix build} command-line
1464 tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
1465 more information on how to test package definitions, and
1466 @ref{Invoking guix lint}, for information on how to check a definition
1467 for style conformance.
1468
1469
1470 Eventually, updating the package definition to a new upstream version
1471 can be partly automated by the @command{guix refresh} command
1472 (@pxref{Invoking guix refresh}).
1473
1474 Behind the scenes, a derivation corresponding to the @code{<package>}
1475 object is first computed by the @code{package-derivation} procedure.
1476 That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
1477 The build actions it prescribes may then be realized by using the
1478 @code{build-derivations} procedure (@pxref{The Store}).
1479
1480 @deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
1481 Return the @code{<derivation>} object of @var{package} for @var{system}
1482 (@pxref{Derivations}).
1483
1484 @var{package} must be a valid @code{<package>} object, and @var{system}
1485 must be a string denoting the target system type---e.g.,
1486 @code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1487 must be a connection to the daemon, which operates on the store
1488 (@pxref{The Store}).
1489 @end deffn
1490
1491 @noindent
1492 @cindex cross-compilation
1493 Similarly, it is possible to compute a derivation that cross-builds a
1494 package for some other system:
1495
1496 @deffn {Scheme Procedure} package-cross-derivation @var{store} @
1497 @var{package} @var{target} [@var{system}]
1498 Return the @code{<derivation>} object of @var{package} cross-built from
1499 @var{system} to @var{target}.
1500
1501 @var{target} must be a valid GNU triplet denoting the target hardware
1502 and operating system, such as @code{"mips64el-linux-gnu"}
1503 (@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1504 Configure and Build System}).
1505 @end deffn
1506
1507
1508 @node Build Systems
1509 @section Build Systems
1510
1511 @cindex build system
1512 Each package definition specifies a @dfn{build system} and arguments for
1513 that build system (@pxref{Defining Packages}). This @code{build-system}
1514 field represents the build procedure of the package, as well implicit
1515 dependencies of that build procedure.
1516
1517 Build systems are @code{<build-system>} objects. The interface to
1518 create and manipulate them is provided by the @code{(guix build-system)}
1519 module, and actual build systems are exported by specific modules.
1520
1521 Build systems accept an optional list of @dfn{arguments}. In package
1522 definitions, these are passed @i{via} the @code{arguments} field
1523 (@pxref{Defining Packages}). They are typically keyword arguments
1524 (@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
1525 Guile Reference Manual}). The value of these arguments is usually
1526 evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
1527 by the daemon (@pxref{Derivations}).
1528
1529 The main build system is @var{gnu-build-system}, which implements the
1530 standard build procedure for GNU packages and many other packages. It
1531 is provided by the @code{(guix build-system gnu)} module.
1532
1533 @defvr {Scheme Variable} gnu-build-system
1534 @var{gnu-build-system} represents the GNU Build System, and variants
1535 thereof (@pxref{Configuration, configuration and makefile conventions,,
1536 standards, GNU Coding Standards}).
1537
1538 @cindex build phases
1539 In a nutshell, packages using it configured, built, and installed with
1540 the usual @code{./configure && make && make check && make install}
1541 command sequence. In practice, a few additional steps are often needed.
1542 All these steps are split up in separate @dfn{phases},
1543 notably@footnote{Please see the @code{(guix build gnu-build-system)}
1544 modules for more details about the build phases.}:
1545
1546 @table @code
1547 @item unpack
1548 Unpack the source tarball, and change the current directory to the
1549 extracted source tree. If the source is actually a directory, copy it
1550 to the build tree, and enter that directory.
1551
1552 @item patch-source-shebangs
1553 Patch shebangs encountered in source files so they refer to the right
1554 store file names. For instance, this changes @code{#!/bin/sh} to
1555 @code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
1556
1557 @item configure
1558 Run the @file{configure} script with a number of default options, such
1559 as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
1560 by the @code{#:configure-flags} argument.
1561
1562 @item build
1563 Run @code{make} with the list of flags specified with
1564 @code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
1565 (the default), build with @code{make -j}.
1566
1567 @item check
1568 Run @code{make check}, or some other target specified with
1569 @code{#:test-target}, unless @code{#:tests? #f} is passed. If the
1570 @code{#:parallel-tests?} argument is true (the default), run @code{make
1571 check -j}.
1572
1573 @item install
1574 Run @code{make install} with the flags listed in @code{#:make-flags}.
1575
1576 @item patch-shebangs
1577 Patch shebangs on the installed executable files.
1578
1579 @item strip
1580 Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
1581 is false), copying them to the @code{debug} output when available
1582 (@pxref{Installing Debugging Files}).
1583 @end table
1584
1585 @vindex %standard-phases
1586 The build-side module @code{(guix build gnu-build-system)} defines
1587 @var{%standard-phases} as the default list of build phases.
1588 @var{%standard-phases} is a list of symbol/procedure pairs, where the
1589 procedure implements the actual phase.
1590
1591 The list of phases used for a particular package can be changed with the
1592 @code{#:phases} parameter. For instance, passing:
1593
1594 @example
1595 #:phases (alist-delete 'configure %standard-phases)
1596 @end example
1597
1598 means that all the phases described above will be used, except the
1599 @code{configure} phase.
1600
1601 In addition, this build system ensures that the ``standard'' environment
1602 for GNU packages is available. This includes tools such as GCC, libc,
1603 Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
1604 build-system gnu)} module for a complete list.) We call these the
1605 @dfn{implicit inputs} of a package, because package definitions don't
1606 have to mention them.
1607 @end defvr
1608
1609 Other @code{<build-system>} objects are defined to support other
1610 conventions and tools used by free software packages. They inherit most
1611 of @var{gnu-build-system}, and differ mainly in the set of inputs
1612 implicitly added to the build process, and in the list of phases
1613 executed. Some of these build systems are listed below.
1614
1615 @defvr {Scheme Variable} cmake-build-system
1616 This variable is exported by @code{(guix build-system cmake)}. It
1617 implements the build procedure for packages using the
1618 @url{http://www.cmake.org, CMake build tool}.
1619
1620 It automatically adds the @code{cmake} package to the set of inputs.
1621 Which package is used can be specified with the @code{#:cmake}
1622 parameter.
1623 @end defvr
1624
1625 @defvr {Scheme Variable} python-build-system
1626 This variable is exported by @code{(guix build-system python)}. It
1627 implements the more or less standard build procedure used by Python
1628 packages, which consists in running @code{python setup.py build} and
1629 then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
1630
1631 For packages that install stand-alone Python programs under @code{bin/},
1632 it takes care of wrapping these programs so their @code{PYTHONPATH}
1633 environment variable points to all the Python libraries they depend on.
1634
1635 Which Python package is used can be specified with the @code{#:python}
1636 parameter.
1637 @end defvr
1638
1639 @defvr {Scheme Variable} perl-build-system
1640 This variable is exported by @code{(guix build-system perl)}. It
1641 implements the standard build procedure for Perl packages, which
1642 consists in running @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}},
1643 followed by @code{make} and @code{make install}.
1644
1645 The initial @code{perl Makefile.PL} invocation passes flags specified by
1646 the @code{#:make-maker-flags} parameter.
1647
1648 Which Perl package is used can be specified with @code{#:perl}.
1649 @end defvr
1650
1651
1652 Lastly, for packages that do not need anything as sophisticated, a
1653 ``trivial'' build system is provided. It is trivial in the sense that
1654 it provides basically no support: it does not pull any implicit inputs,
1655 and does not have a notion of build phases.
1656
1657 @defvr {Scheme Variable} trivial-build-system
1658 This variable is exported by @code{(guix build-system trivial)}.
1659
1660 This build system requires a @code{#:builder} argument. This argument
1661 must be a Scheme expression that builds the package's output(s)---as
1662 with @code{build-expression->derivation} (@pxref{Derivations,
1663 @code{build-expression->derivation}}).
1664 @end defvr
1665
1666 @node The Store
1667 @section The Store
1668
1669 @cindex store
1670 @cindex store paths
1671
1672 Conceptually, the @dfn{store} is where derivations that have been
1673 successfully built are stored---by default, under @file{/gnu/store}.
1674 Sub-directories in the store are referred to as @dfn{store paths}. The
1675 store has an associated database that contains information such has the
1676 store paths referred to by each store path, and the list of @emph{valid}
1677 store paths---paths that result from a successful build.
1678
1679 The store is always accessed by the daemon on behalf of its clients
1680 (@pxref{Invoking guix-daemon}). To manipulate the store, clients
1681 connect to the daemon over a Unix-domain socket, send it requests, and
1682 read the result---these are remote procedure calls, or RPCs.
1683
1684 The @code{(guix store)} module provides procedures to connect to the
1685 daemon, and to perform RPCs. These are described below.
1686
1687 @deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
1688 Connect to the daemon over the Unix-domain socket at @var{file}. When
1689 @var{reserve-space?} is true, instruct it to reserve a little bit of
1690 extra space on the file system so that the garbage collector can still
1691 operate, should the disk become full. Return a server object.
1692
1693 @var{file} defaults to @var{%default-socket-path}, which is the normal
1694 location given the options that were passed to @command{configure}.
1695 @end deffn
1696
1697 @deffn {Scheme Procedure} close-connection @var{server}
1698 Close the connection to @var{server}.
1699 @end deffn
1700
1701 @defvr {Scheme Variable} current-build-output-port
1702 This variable is bound to a SRFI-39 parameter, which refers to the port
1703 where build and error logs sent by the daemon should be written.
1704 @end defvr
1705
1706 Procedures that make RPCs all take a server object as their first
1707 argument.
1708
1709 @deffn {Scheme Procedure} valid-path? @var{server} @var{path}
1710 Return @code{#t} when @var{path} is a valid store path.
1711 @end deffn
1712
1713 @deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
1714 Add @var{text} under file @var{name} in the store, and return its store
1715 path. @var{references} is the list of store paths referred to by the
1716 resulting store path.
1717 @end deffn
1718
1719 @deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
1720 Build @var{derivations} (a list of @code{<derivation>} objects or
1721 derivation paths), and return when the worker is done building them.
1722 Return @code{#t} on success.
1723 @end deffn
1724
1725 Note that the @code{(guix monads)} module provides a monad as well as
1726 monadic versions of the above procedures, with the goal of making it
1727 more convenient to work with code that accesses the store (@pxref{The
1728 Store Monad}).
1729
1730 @c FIXME
1731 @i{This section is currently incomplete.}
1732
1733 @node Derivations
1734 @section Derivations
1735
1736 @cindex derivations
1737 Low-level build actions and the environment in which they are performed
1738 are represented by @dfn{derivations}. A derivation contain the
1739 following pieces of information:
1740
1741 @itemize
1742 @item
1743 The outputs of the derivation---derivations produce at least one file or
1744 directory in the store, but may produce more.
1745
1746 @item
1747 The inputs of the derivations, which may be other derivations or plain
1748 files in the store (patches, build scripts, etc.)
1749
1750 @item
1751 The system type targeted by the derivation---e.g., @code{x86_64-linux}.
1752
1753 @item
1754 The file name of a build script in the store, along with the arguments
1755 to be passed.
1756
1757 @item
1758 A list of environment variables to be defined.
1759
1760 @end itemize
1761
1762 @cindex derivation path
1763 Derivations allow clients of the daemon to communicate build actions to
1764 the store. They exist in two forms: as an in-memory representation,
1765 both on the client- and daemon-side, and as files in the store whose
1766 name end in @code{.drv}---these files are referred to as @dfn{derivation
1767 paths}. Derivations paths can be passed to the @code{build-derivations}
1768 procedure to perform the build actions they prescribe (@pxref{The
1769 Store}).
1770
1771 The @code{(guix derivations)} module provides a representation of
1772 derivations as Scheme objects, along with procedures to create and
1773 otherwise manipulate derivations. The lowest-level primitive to create
1774 a derivation is the @code{derivation} procedure:
1775
1776 @deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
1777 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
1778 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1779 [#:system (%current-system)] [#:references-graphs #f] @
1780 [#:allowed-references #f] [#:local-build? #f]
1781 Build a derivation with the given arguments, and return the resulting
1782 @code{<derivation>} object.
1783
1784 When @var{hash} and @var{hash-algo} are given, a
1785 @dfn{fixed-output derivation} is created---i.e., one whose result is
1786 known in advance, such as a file download. If, in addition,
1787 @var{recursive?} is true, then that fixed output may be an executable
1788 file or a directory and @var{hash} must be the hash of an archive
1789 containing this output.
1790
1791 When @var{references-graphs} is true, it must be a list of file
1792 name/store path pairs. In that case, the reference graph of each store
1793 path is exported in the build environment in the corresponding file, in
1794 a simple text format.
1795
1796 When @var{allowed-references} is true, it must be a list of store items
1797 or outputs that the derivation's output may refer to.
1798
1799 When @var{local-build?} is true, declare that the derivation is not a
1800 good candidate for offloading and should rather be built locally
1801 (@pxref{Daemon Offload Setup}). This is the case for small derivations
1802 where the costs of data transfers would outweigh the benefits.
1803 @end deffn
1804
1805 @noindent
1806 Here's an example with a shell script as its builder, assuming
1807 @var{store} is an open connection to the daemon, and @var{bash} points
1808 to a Bash executable in the store:
1809
1810 @lisp
1811 (use-modules (guix utils)
1812 (guix store)
1813 (guix derivations))
1814
1815 (let ((builder ; add the Bash script to the store
1816 (add-text-to-store store "my-builder.sh"
1817 "echo hello world > $out\n" '())))
1818 (derivation store "foo"
1819 bash `("-e" ,builder)
1820 #:inputs `((,bash) (,builder))
1821 #:env-vars '(("HOME" . "/homeless"))))
1822 @result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
1823 @end lisp
1824
1825 As can be guessed, this primitive is cumbersome to use directly. A
1826 better approach is to write build scripts in Scheme, of course! The
1827 best course of action for that is to write the build code as a
1828 ``G-expression'', and to pass it to @code{gexp->derivation}. For more
1829 information, @pxref{G-Expressions}.
1830
1831 Once upon a time, @code{gexp->derivation} did not exist and constructing
1832 derivations with build code written in Scheme was achieved with
1833 @code{build-expression->derivation}, documented below. This procedure
1834 is now deprecated in favor of the much nicer @code{gexp->derivation}.
1835
1836 @deffn {Scheme Procedure} build-expression->derivation @var{store} @
1837 @var{name} @var{exp} @
1838 [#:system (%current-system)] [#:inputs '()] @
1839 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
1840 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
1841 [#:references-graphs #f] [#:allowed-references #f] @
1842 [#:local-build? #f] [#:guile-for-build #f]
1843 Return a derivation that executes Scheme expression @var{exp} as a
1844 builder for derivation @var{name}. @var{inputs} must be a list of
1845 @code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
1846 @code{"out"} is assumed. @var{modules} is a list of names of Guile
1847 modules from the current search path to be copied in the store,
1848 compiled, and made available in the load path during the execution of
1849 @var{exp}---e.g., @code{((guix build utils) (guix build
1850 gnu-build-system))}.
1851
1852 @var{exp} is evaluated in an environment where @code{%outputs} is bound
1853 to a list of output/path pairs, and where @code{%build-inputs} is bound
1854 to a list of string/output-path pairs made from @var{inputs}.
1855 Optionally, @var{env-vars} is a list of string pairs specifying the name
1856 and value of environment variables visible to the builder. The builder
1857 terminates by passing the result of @var{exp} to @code{exit}; thus, when
1858 @var{exp} returns @code{#f}, the build is considered to have failed.
1859
1860 @var{exp} is built using @var{guile-for-build} (a derivation). When
1861 @var{guile-for-build} is omitted or is @code{#f}, the value of the
1862 @code{%guile-for-build} fluid is used instead.
1863
1864 See the @code{derivation} procedure for the meaning of
1865 @var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
1866 @end deffn
1867
1868 @noindent
1869 Here's an example of a single-output derivation that creates a directory
1870 containing one file:
1871
1872 @lisp
1873 (let ((builder '(let ((out (assoc-ref %outputs "out")))
1874 (mkdir out) ; create /gnu/store/@dots{}-goo
1875 (call-with-output-file (string-append out "/test")
1876 (lambda (p)
1877 (display '(hello guix) p))))))
1878 (build-expression->derivation store "goo" builder))
1879
1880 @result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
1881 @end lisp
1882
1883
1884 @node The Store Monad
1885 @section The Store Monad
1886
1887 @cindex monad
1888
1889 The procedures that operate on the store described in the previous
1890 sections all take an open connection to the build daemon as their first
1891 argument. Although the underlying model is functional, they either have
1892 side effects or depend on the current state of the store.
1893
1894 The former is inconvenient: the connection to the build daemon has to be
1895 carried around in all those functions, making it impossible to compose
1896 functions that do not take that parameter with functions that do. The
1897 latter can be problematic: since store operations have side effects
1898 and/or depend on external state, they have to be properly sequenced.
1899
1900 @cindex monadic values
1901 @cindex monadic functions
1902 This is where the @code{(guix monads)} module comes in. This module
1903 provides a framework for working with @dfn{monads}, and a particularly
1904 useful monad for our uses, the @dfn{store monad}. Monads are a
1905 construct that allows two things: associating ``context'' with values
1906 (in our case, the context is the store), and building sequences of
1907 computations (here computations includes accesses to the store.) Values
1908 in a monad---values that carry this additional context---are called
1909 @dfn{monadic values}; procedures that return such values are called
1910 @dfn{monadic procedures}.
1911
1912 Consider this ``normal'' procedure:
1913
1914 @example
1915 (define (sh-symlink store)
1916 ;; Return a derivation that symlinks the 'bash' executable.
1917 (let* ((drv (package-derivation store bash))
1918 (out (derivation->output-path drv))
1919 (sh (string-append out "/bin/bash")))
1920 (build-expression->derivation store "sh"
1921 `(symlink ,sh %output))))
1922 @end example
1923
1924 Using @code{(guix monads)}, it may be rewritten as a monadic function:
1925
1926 @c FIXME: Find a better example, one that uses 'mlet'.
1927 @example
1928 (define (sh-symlink)
1929 ;; Same, but return a monadic value.
1930 (gexp->derivation "sh"
1931 #~(symlink (string-append #$bash "/bin/bash") #$output)))
1932 @end example
1933
1934 There are two things to note in the second version: the @code{store}
1935 parameter is now implicit, and the monadic value returned by
1936 @code{package-file}---a wrapper around @code{package-derivation} and
1937 @code{derivation->output-path}---is @dfn{bound} using @code{mlet}
1938 instead of plain @code{let}.
1939
1940 Calling the monadic @code{profile.sh} has no effect. To get the desired
1941 effect, one must use @code{run-with-store}:
1942
1943 @example
1944 (run-with-store (open-connection) (profile.sh))
1945 @result{} /gnu/store/...-profile.sh
1946 @end example
1947
1948 Note that the @code{(guix monad-repl)} module extends Guile's REPL with
1949 new ``meta-commands'' to make it easier to deal with monadic procedures:
1950 @code{run-in-store}, and @code{enter-store-monad}. The former, is used
1951 to ``run'' a single monadic value through the store:
1952
1953 @example
1954 scheme@@(guile-user)> ,run-in-store (package->derivation hello)
1955 $1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
1956 @end example
1957
1958 The latter enters a recursive REPL, where all the return values are
1959 automatically run through the store:
1960
1961 @example
1962 scheme@@(guile-user)> ,enter-store-monad
1963 store-monad@@(guile-user) [1]> (package->derivation hello)
1964 $2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
1965 store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
1966 $3 = "/gnu/store/@dots{}-foo"
1967 store-monad@@(guile-user) [1]> ,q
1968 scheme@@(guile-user)>
1969 @end example
1970
1971 @noindent
1972 Note that non-monadic values cannot be returned in the
1973 @code{store-monad} REPL.
1974
1975 The main syntactic forms to deal with monads in general are described
1976 below.
1977
1978 @deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
1979 Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
1980 in @var{monad}.
1981 @end deffn
1982
1983 @deffn {Scheme Syntax} return @var{val}
1984 Return a monadic value that encapsulates @var{val}.
1985 @end deffn
1986
1987 @deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
1988 @dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
1989 procedure @var{mproc}@footnote{This operation is commonly referred to as
1990 ``bind'', but that name denotes an unrelated procedure in Guile. Thus
1991 we use this somewhat cryptic symbol inherited from the Haskell
1992 language.}.
1993 @end deffn
1994
1995 @deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
1996 @var{body} ...
1997 @deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
1998 @var{body} ...
1999 Bind the variables @var{var} to the monadic values @var{mval} in
2000 @var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2001 ``normal'' value @var{val}, as per @code{let}.
2002
2003 @code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2004 (@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2005 @end deffn
2006
2007 The interface to the store monad provided by @code{(guix monads)} is as
2008 follows.
2009
2010 @defvr {Scheme Variable} %store-monad
2011 The store monad. Values in the store monad encapsulate accesses to the
2012 store. When its effect is needed, a value of the store monad must be
2013 ``evaluated'' by passing it to the @code{run-with-store} procedure (see
2014 below.)
2015 @end defvr
2016
2017 @deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2018 Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2019 open store connection.
2020 @end deffn
2021
2022 @deffn {Monadic Procedure} text-file @var{name} @var{text}
2023 Return as a monadic value the absolute file name in the store of the file
2024 containing @var{text}, a string.
2025 @end deffn
2026
2027 @deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
2028 Return as a monadic value a derivation that builds a text file
2029 containing all of @var{text}. @var{text} may list, in addition to
2030 strings, packages, derivations, and store file names; the resulting
2031 store file holds references to all these.
2032
2033 This variant should be preferred over @code{text-file} anytime the file
2034 to create will reference items from the store. This is typically the
2035 case when building a configuration file that embeds store file names,
2036 like this:
2037
2038 @example
2039 (define (profile.sh)
2040 ;; Return the name of a shell script in the store that
2041 ;; initializes the 'PATH' environment variable.
2042 (text-file* "profile.sh"
2043 "export PATH=" coreutils "/bin:"
2044 grep "/bin:" sed "/bin\n"))
2045 @end example
2046
2047 In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
2048 will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
2049 preventing them from being garbage-collected during its lifetime.
2050 @end deffn
2051
2052 @deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2053 [#:recursive? #t]
2054 Return the name of @var{file} once interned in the store. Use
2055 @var{name} as its store name, or the basename of @var{file} if
2056 @var{name} is omitted.
2057
2058 When @var{recursive?} is true, the contents of @var{file} are added
2059 recursively; if @var{file} designates a flat file and @var{recursive?}
2060 is true, its contents are added, and its permission bits are kept.
2061
2062 The example below adds a file to the store, under two different names:
2063
2064 @example
2065 (run-with-store (open-connection)
2066 (mlet %store-monad ((a (interned-file "README"))
2067 (b (interned-file "README" "LEGU-MIN")))
2068 (return (list a b))))
2069
2070 @result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2071 @end example
2072
2073 @end deffn
2074
2075 @deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
2076 [#:system (%current-system)] [#:target #f] @
2077 [#:output "out"] Return as a monadic
2078 value in the absolute file name of @var{file} within the @var{output}
2079 directory of @var{package}. When @var{file} is omitted, return the name
2080 of the @var{output} directory of @var{package}. When @var{target} is
2081 true, use it as a cross-compilation target triplet.
2082 @end deffn
2083
2084 @deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
2085 @deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2086 @var{target} [@var{system}]
2087 Monadic version of @code{package-derivation} and
2088 @code{package-cross-derivation} (@pxref{Defining Packages}).
2089 @end deffn
2090
2091
2092 @node G-Expressions
2093 @section G-Expressions
2094
2095 @cindex G-expression
2096 @cindex build code quoting
2097 So we have ``derivations'', which represent a sequence of build actions
2098 to be performed to produce an item in the store (@pxref{Derivations}).
2099 Those build actions are performed when asking the daemon to actually
2100 build the derivations; they are run by the daemon in a container
2101 (@pxref{Invoking guix-daemon}).
2102
2103 @cindex strata of code
2104 It should come as no surprise that we like to write those build actions
2105 in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2106 code@footnote{The term @dfn{stratum} in this context was coined by
2107 Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2108 Kiselyov, who has written insightful
2109 @url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2110 on this topic}, refers to this kind of code generation as
2111 @dfn{staging}.}: the ``host code''---code that defines packages, talks
2112 to the daemon, etc.---and the ``build code''---code that actually
2113 performs build actions, such as making directories, invoking
2114 @command{make}, etc.
2115
2116 To describe a derivation and its build actions, one typically needs to
2117 embed build code inside host code. It boils down to manipulating build
2118 code as data, and Scheme's homoiconicity---code has a direct
2119 representation as data---comes in handy for that. But we need more than
2120 Scheme's normal @code{quasiquote} mechanism to construct build
2121 expressions.
2122
2123 The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2124 S-expressions adapted to build expressions. G-expressions, or
2125 @dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2126 @code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2127 @code{#$}, and @code{#$@@}), which are comparable respectively to
2128 @code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2129 (@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2130 Reference Manual}). However, there are major differences:
2131
2132 @itemize
2133 @item
2134 Gexps are meant to be written to a file and run or manipulated by other
2135 processes.
2136
2137 @item
2138 When a package or derivation is unquoted inside a gexp, the result is as
2139 if its output file name had been introduced.
2140
2141 @item
2142 Gexps carry information about the packages or derivations they refer to,
2143 and these dependencies are automatically added as inputs to the build
2144 processes that use them.
2145 @end itemize
2146
2147 To illustrate the idea, here is an example of a gexp:
2148
2149 @example
2150 (define build-exp
2151 #~(begin
2152 (mkdir #$output)
2153 (chdir #$output)
2154 (symlink (string-append #$coreutils "/bin/ls")
2155 "list-files")))
2156 @end example
2157
2158 This gexp can be passed to @code{gexp->derivation}; we obtain a
2159 derivation that builds a directory containing exactly one symlink to
2160 @file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2161
2162 @example
2163 (gexp->derivation "the-thing" build-exp)
2164 @end example
2165
2166 As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
2167 substituted to the reference to the @var{coreutils} package in the
2168 actual build code, and @var{coreutils} is automatically made an input to
2169 the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2170 output)}) is replaced by a string containing the derivation's output
2171 directory name.
2172
2173 @cindex cross compilation
2174 In a cross-compilation context, it is useful to distinguish between
2175 references to the @emph{native} build of a package---that can run on the
2176 host---versus references to cross builds of a package. To that end, the
2177 @code{#+} plays the same role as @code{#$}, but is a reference to a
2178 native package build:
2179
2180 @example
2181 (gexp->derivation "vi"
2182 #~(begin
2183 (mkdir #$output)
2184 (system* (string-append #+coreutils "/bin/ln")
2185 "-s"
2186 (string-append #$emacs "/bin/emacs")
2187 (string-append #$output "/bin/vi")))
2188 #:target "mips64el-linux")
2189 @end example
2190
2191 @noindent
2192 In the example above, the native build of @var{coreutils} is used, so
2193 that @command{ln} can actually run on the host; but then the
2194 cross-compiled build of @var{emacs} is referenced.
2195
2196 The syntactic form to construct gexps is summarized below.
2197
2198 @deffn {Scheme Syntax} #~@var{exp}
2199 @deffnx {Scheme Syntax} (gexp @var{exp})
2200 Return a G-expression containing @var{exp}. @var{exp} may contain one
2201 or more of the following forms:
2202
2203 @table @code
2204 @item #$@var{obj}
2205 @itemx (ungexp @var{obj})
2206 Introduce a reference to @var{obj}. @var{obj} may be a package or a
2207 derivation, in which case the @code{ungexp} form is replaced by its
2208 output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2209
2210 If @var{obj} is a list, it is traversed and any package or derivation
2211 references are substituted similarly.
2212
2213 If @var{obj} is another gexp, its contents are inserted and its
2214 dependencies are added to those of the containing gexp.
2215
2216 If @var{obj} is another kind of object, it is inserted as is.
2217
2218 @item #$@var{package-or-derivation}:@var{output}
2219 @itemx (ungexp @var{package-or-derivation} @var{output})
2220 This is like the form above, but referring explicitly to the
2221 @var{output} of @var{package-or-derivation}---this is useful when
2222 @var{package-or-derivation} produces multiple outputs (@pxref{Packages
2223 with Multiple Outputs}).
2224
2225 @item #+@var{obj}
2226 @itemx #+@var{obj}:output
2227 @itemx (ungexp-native @var{obj})
2228 @itemx (ungexp-native @var{obj} @var{output})
2229 Same as @code{ungexp}, but produces a reference to the @emph{native}
2230 build of @var{obj} when used in a cross compilation context.
2231
2232 @item #$output[:@var{output}]
2233 @itemx (ungexp output [@var{output}])
2234 Insert a reference to derivation output @var{output}, or to the main
2235 output when @var{output} is omitted.
2236
2237 This only makes sense for gexps passed to @code{gexp->derivation}.
2238
2239 @item #$@@@var{lst}
2240 @itemx (ungexp-splicing @var{lst})
2241 Like the above, but splices the contents of @var{lst} inside the
2242 containing list.
2243
2244 @item #+@@@var{lst}
2245 @itemx (ungexp-native-splicing @var{lst})
2246 Like the above, but refers to native builds of the objects listed in
2247 @var{lst}.
2248
2249 @end table
2250
2251 G-expressions created by @code{gexp} or @code{#~} are run-time objects
2252 of the @code{gexp?} type (see below.)
2253 @end deffn
2254
2255 @deffn {Scheme Procedure} gexp? @var{obj}
2256 Return @code{#t} if @var{obj} is a G-expression.
2257 @end deffn
2258
2259 G-expressions are meant to be written to disk, either as code building
2260 some derivation, or as plain files in the store. The monadic procedures
2261 below allow you to do that (@pxref{The Store Monad}, for more
2262 information about monads.)
2263
2264 @deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
2265 [#:system (%current-system)] [#:target #f] [#:inputs '()] @
2266 [#:hash #f] [#:hash-algo #f] @
2267 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
2268 [#:references-graphs #f] [#:local-build? #f] @
2269 [#:guile-for-build #f]
2270 Return a derivation @var{name} that runs @var{exp} (a gexp) with
2271 @var{guile-for-build} (a derivation) on @var{system}. When @var{target}
2272 is true, it is used as the cross-compilation target triplet for packages
2273 referred to by @var{exp}.
2274
2275 Make @var{modules} available in the evaluation context of @var{EXP};
2276 @var{MODULES} is a list of names of Guile modules from the current
2277 search path to be copied in the store, compiled, and made available in
2278 the load path during the execution of @var{exp}---e.g., @code{((guix
2279 build utils) (guix build gnu-build-system))}.
2280
2281 When @var{references-graphs} is true, it must be a list of tuples of one of the
2282 following forms:
2283
2284 @example
2285 (@var{file-name} @var{package})
2286 (@var{file-name} @var{package} @var{output})
2287 (@var{file-name} @var{derivation})
2288 (@var{file-name} @var{derivation} @var{output})
2289 (@var{file-name} @var{store-item})
2290 @end example
2291
2292 The right-hand-side of each element of @var{references-graphs} is automatically made
2293 an input of the build process of @var{exp}. In the build environment, each
2294 @var{file-name} contains the reference graph of the corresponding item, in a simple
2295 text format.
2296
2297 The other arguments are as for @code{derivation} (@pxref{Derivations}).
2298 @end deffn
2299
2300 @deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
2301 Return an executable script @var{name} that runs @var{exp} using
2302 @var{guile} with @var{modules} in its search path.
2303
2304 The example below builds a script that simply invokes the @command{ls}
2305 command:
2306
2307 @example
2308 (use-modules (guix gexp) (gnu packages base))
2309
2310 (gexp->script "list-files"
2311 #~(execl (string-append #$coreutils "/bin/ls")
2312 "ls"))
2313 @end example
2314
2315 When ``running'' it through the store (@pxref{The Store Monad,
2316 @code{run-with-store}}), we obtain a derivation that produces an
2317 executable file @file{/gnu/store/@dots{}-list-files} along these lines:
2318
2319 @example
2320 #!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
2321 !#
2322 (execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
2323 "ls")
2324 @end example
2325 @end deffn
2326
2327 @deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
2328 Return a derivation that builds a file @var{name} containing @var{exp}.
2329
2330 The resulting file holds references to all the dependencies of @var{exp}
2331 or a subset thereof.
2332 @end deffn
2333
2334 Of course, in addition to gexps embedded in ``host'' code, there are
2335 also modules containing build tools. To make it clear that they are
2336 meant to be used in the build stratum, these modules are kept in the
2337 @code{(guix build @dots{})} name space.
2338
2339
2340 @c *********************************************************************
2341 @node Utilities
2342 @chapter Utilities
2343
2344 This section describes tools primarily targeted at developers and users
2345 who write new package definitions. They complement the Scheme
2346 programming interface of Guix in a convenient way.
2347
2348 @menu
2349 * Invoking guix build:: Building packages from the command line.
2350 * Invoking guix download:: Downloading a file and printing its hash.
2351 * Invoking guix hash:: Computing the cryptographic hash of a file.
2352 * Invoking guix refresh:: Updating package definitions.
2353 * Invoking guix lint:: Finding errors in package definitions.
2354 @end menu
2355
2356 @node Invoking guix build
2357 @section Invoking @command{guix build}
2358
2359 The @command{guix build} command builds packages or derivations and
2360 their dependencies, and prints the resulting store paths. Note that it
2361 does not modify the user's profile---this is the job of the
2362 @command{guix package} command (@pxref{Invoking guix package}). Thus,
2363 it is mainly useful for distribution developers.
2364
2365 The general syntax is:
2366
2367 @example
2368 guix build @var{options} @var{package-or-derivation}@dots{}
2369 @end example
2370
2371 @var{package-or-derivation} may be either the name of a package found in
2372 the software distribution such as @code{coreutils} or
2373 @code{coreutils-8.20}, or a derivation such as
2374 @file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
2375 package with the corresponding name (and optionally version) is searched
2376 for among the GNU distribution modules (@pxref{Package Modules}).
2377
2378 Alternatively, the @code{--expression} option may be used to specify a
2379 Scheme expression that evaluates to a package; this is useful when
2380 disambiguation among several same-named packages or package variants is
2381 needed.
2382
2383 The @var{options} may be zero or more of the following:
2384
2385 @table @code
2386
2387 @item --expression=@var{expr}
2388 @itemx -e @var{expr}
2389 Build the package or derivation @var{expr} evaluates to.
2390
2391 For example, @var{expr} may be @code{(@@ (gnu packages guile)
2392 guile-1.8)}, which unambiguously designates this specific variant of
2393 version 1.8 of Guile.
2394
2395 Alternately, @var{expr} may be a G-expression, in which case it is used
2396 as a build program passed to @code{gexp->derivation}
2397 (@pxref{G-Expressions}).
2398
2399 Lastly, @var{expr} may refer to a zero-argument monadic procedure
2400 (@pxref{The Store Monad}). The procedure must return a derivation as a
2401 monadic value, which is then passed through @code{run-with-store}.
2402
2403 @item --source
2404 @itemx -S
2405 Build the packages' source derivations, rather than the packages
2406 themselves.
2407
2408 For instance, @code{guix build -S gcc} returns something like
2409 @file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
2410
2411 The returned source tarball is the result of applying any patches and
2412 code snippets specified in the package's @code{origin} (@pxref{Defining
2413 Packages}).
2414
2415 @item --system=@var{system}
2416 @itemx -s @var{system}
2417 Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
2418 the host's system type.
2419
2420 An example use of this is on Linux-based systems, which can emulate
2421 different personalities. For instance, passing
2422 @code{--system=i686-linux} on an @code{x86_64-linux} system allows users
2423 to build packages in a complete 32-bit environment.
2424
2425 @item --target=@var{triplet}
2426 @cindex cross-compilation
2427 Cross-build for @var{triplet}, which must be a valid GNU triplet, such
2428 as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
2429 configuration triplets,, configure, GNU Configure and Build System}).
2430
2431 @item --with-source=@var{source}
2432 Use @var{source} as the source of the corresponding package.
2433 @var{source} must be a file name or a URL, as for @command{guix
2434 download} (@pxref{Invoking guix download}).
2435
2436 The ``corresponding package'' is taken to be one specified on the
2437 command line whose name matches the base of @var{source}---e.g., if
2438 @var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
2439 package is @code{guile}. Likewise, the version string is inferred from
2440 @var{source}; in the previous example, it's @code{2.0.10}.
2441
2442 This option allows users to try out versions of packages other than the
2443 one provided by the distribution. The example below downloads
2444 @file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
2445 the @code{ed} package:
2446
2447 @example
2448 guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
2449 @end example
2450
2451 As a developer, @code{--with-source} makes it easy to test release
2452 candidates:
2453
2454 @example
2455 guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
2456 @end example
2457
2458
2459 @item --derivations
2460 @itemx -d
2461 Return the derivation paths, not the output paths, of the given
2462 packages.
2463
2464 @item --root=@var{file}
2465 @itemx -r @var{file}
2466 Make @var{file} a symlink to the result, and register it as a garbage
2467 collector root.
2468
2469 @item --log-file
2470 Return the build log file names for the given
2471 @var{package-or-derivation}s, or raise an error if build logs are
2472 missing.
2473
2474 This works regardless of how packages or derivations are specified. For
2475 instance, the following invocations are equivalent:
2476
2477 @example
2478 guix build --log-file `guix build -d guile`
2479 guix build --log-file `guix build guile`
2480 guix build --log-file guile
2481 guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
2482 @end example
2483
2484
2485 @end table
2486
2487 @cindex common build options
2488 In addition, a number of options that control the build process are
2489 common to @command{guix build} and other commands that can spawn builds,
2490 such as @command{guix package} or @command{guix archive}. These are the
2491 following:
2492
2493 @table @code
2494
2495 @item --load-path=@var{directory}
2496 @itemx -L @var{directory}
2497 Add @var{directory} to the front of the package module search path
2498 (@pxref{Package Modules}).
2499
2500 This allows users to define their own packages and make them visible to
2501 the command-line tools.
2502
2503 @item --keep-failed
2504 @itemx -K
2505 Keep the build tree of failed builds. Thus, if a build fail, its build
2506 tree is kept under @file{/tmp}, in a directory whose name is shown at
2507 the end of the build log. This is useful when debugging build issues.
2508
2509 @item --dry-run
2510 @itemx -n
2511 Do not build the derivations.
2512
2513 @item --fallback
2514 When substituting a pre-built binary fails, fall back to building
2515 packages locally.
2516
2517 @item --no-substitutes
2518 Do not use substitutes for build products. That is, always build things
2519 locally instead of allowing downloads of pre-built binaries
2520 (@pxref{Substitutes}).
2521
2522 @item --no-build-hook
2523 Do not attempt to offload builds @i{via} the daemon's ``build hook''
2524 (@pxref{Daemon Offload Setup}). That is, always build things locally
2525 instead of offloading builds to remote machines.
2526
2527 @item --max-silent-time=@var{seconds}
2528 When the build or substitution process remains silent for more than
2529 @var{seconds}, terminate it and report a build failure.
2530
2531 @item --timeout=@var{seconds}
2532 Likewise, when the build or substitution process lasts for more than
2533 @var{seconds}, terminate it and report a build failure.
2534
2535 By default there is no timeout. This behavior can be restored with
2536 @code{--timeout=0}.
2537
2538 @item --verbosity=@var{level}
2539 Use the given verbosity level. @var{level} must be an integer between 0
2540 and 5; higher means more verbose output. Setting a level of 4 or more
2541 may be helpful when debugging setup issues with the build daemon.
2542
2543 @item --cores=@var{n}
2544 @itemx -c @var{n}
2545 Allow the use of up to @var{n} CPU cores for the build. The special
2546 value @code{0} means to use as many CPU cores as available.
2547
2548 @end table
2549
2550 Behind the scenes, @command{guix build} is essentially an interface to
2551 the @code{package-derivation} procedure of the @code{(guix packages)}
2552 module, and to the @code{build-derivations} procedure of the @code{(guix
2553 store)} module.
2554
2555 @node Invoking guix download
2556 @section Invoking @command{guix download}
2557
2558 When writing a package definition, developers typically need to download
2559 the package's source tarball, compute its SHA256 hash, and write that
2560 hash in the package definition (@pxref{Defining Packages}). The
2561 @command{guix download} tool helps with this task: it downloads a file
2562 from the given URI, adds it to the store, and prints both its file name
2563 in the store and its SHA256 hash.
2564
2565 The fact that the downloaded file is added to the store saves bandwidth:
2566 when the developer eventually tries to build the newly defined package
2567 with @command{guix build}, the source tarball will not have to be
2568 downloaded again because it is already in the store. It is also a
2569 convenient way to temporarily stash files, which may be deleted
2570 eventually (@pxref{Invoking guix gc}).
2571
2572 The @command{guix download} command supports the same URIs as used in
2573 package definitions. In particular, it supports @code{mirror://} URIs.
2574 @code{https} URIs (HTTP over TLS) are supported @emph{provided} the
2575 Guile bindings for GnuTLS are available in the user's environment; when
2576 they are not available, an error is raised.
2577
2578 The following option is available:
2579
2580 @table @code
2581 @item --format=@var{fmt}
2582 @itemx -f @var{fmt}
2583 Write the hash in the format specified by @var{fmt}. For more
2584 information on the valid values for @var{fmt}, @ref{Invoking guix hash}.
2585 @end table
2586
2587 @node Invoking guix hash
2588 @section Invoking @command{guix hash}
2589
2590 The @command{guix hash} command computes the SHA256 hash of a file.
2591 It is primarily a convenience tool for anyone contributing to the
2592 distribution: it computes the cryptographic hash of a file, which can be
2593 used in the definition of a package (@pxref{Defining Packages}).
2594
2595 The general syntax is:
2596
2597 @example
2598 guix hash @var{option} @var{file}
2599 @end example
2600
2601 @command{guix hash} has the following option:
2602
2603 @table @code
2604
2605 @item --format=@var{fmt}
2606 @itemx -f @var{fmt}
2607 Write the hash in the format specified by @var{fmt}.
2608
2609 Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
2610 (@code{hex} and @code{hexadecimal} can be used as well).
2611
2612 If the @option{--format} option is not specified, @command{guix hash}
2613 will output the hash in @code{nix-base32}. This representation is used
2614 in the definitions of packages.
2615
2616 @item --recursive
2617 @itemx -r
2618 Compute the hash on @var{file} recursively.
2619
2620 In this case, the hash is computed on an archive containing @var{file},
2621 including its children if it is a directory. Some of @var{file}'s
2622 meta-data is part of the archive; for instance, when @var{file} is a
2623 regular file, the hash is different depending on whether @var{file} is
2624 executable or not. Meta-data such as time stamps has no impact on the
2625 hash (@pxref{Invoking guix archive}).
2626 @c FIXME: Replace xref above with xref to an ``Archive'' section when
2627 @c it exists.
2628
2629 @end table
2630
2631 @node Invoking guix refresh
2632 @section Invoking @command{guix refresh}
2633
2634 The primary audience of the @command{guix refresh} command is developers
2635 of the GNU software distribution. By default, it reports any packages
2636 provided by the distribution that are outdated compared to the latest
2637 upstream version, like this:
2638
2639 @example
2640 $ guix refresh
2641 gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
2642 gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
2643 @end example
2644
2645 It does so by browsing each package's FTP directory and determining the
2646 highest version number of the source tarballs
2647 therein@footnote{Currently, this only works for GNU packages.}.
2648
2649 When passed @code{--update}, it modifies distribution source files to
2650 update the version numbers and source tarball hashes of those packages'
2651 recipes (@pxref{Defining Packages}). This is achieved by downloading
2652 each package's latest source tarball and its associated OpenPGP
2653 signature, authenticating the downloaded tarball against its signature
2654 using @command{gpg}, and finally computing its hash. When the public
2655 key used to sign the tarball is missing from the user's keyring, an
2656 attempt is made to automatically retrieve it from a public key server;
2657 when it's successful, the key is added to the user's keyring; otherwise,
2658 @command{guix refresh} reports an error.
2659
2660 The following options are supported:
2661
2662 @table @code
2663
2664 @item --update
2665 @itemx -u
2666 Update distribution source files (package recipes) in place.
2667 @ref{Defining Packages}, for more information on package definitions.
2668
2669 @item --select=[@var{subset}]
2670 @itemx -s @var{subset}
2671 Select all the packages in @var{subset}, one of @code{core} or
2672 @code{non-core}.
2673
2674 The @code{core} subset refers to all the packages at the core of the
2675 distribution---i.e., packages that are used to build ``everything
2676 else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
2677 changing one of these packages in the distribution entails a rebuild of
2678 all the others. Thus, such updates are an inconvenience to users in
2679 terms of build time or bandwidth used to achieve the upgrade.
2680
2681 The @code{non-core} subset refers to the remaining packages. It is
2682 typically useful in cases where an update of the core packages would be
2683 inconvenient.
2684
2685 @end table
2686
2687 In addition, @command{guix refresh} can be passed one or more package
2688 names, as in this example:
2689
2690 @example
2691 guix refresh -u emacs idutils
2692 @end example
2693
2694 @noindent
2695 The command above specifically updates the @code{emacs} and
2696 @code{idutils} packages. The @code{--select} option would have no
2697 effect in this case.
2698
2699 When considering whether to upgrade a package, it is sometimes
2700 convenient to know which packages would be affected by the upgrade and
2701 should be checked for compatibility. For this the following option may
2702 be used when passing @command{guix refresh} one or more package names:
2703
2704 @table @code
2705
2706 @item --list-dependent
2707 @itemx -l
2708 List top-level dependent packages that would need to be rebuilt as a
2709 result of upgrading one or more packages.
2710
2711 @end table
2712
2713 Be aware that the @code{--list-dependent} option only
2714 @emph{approximates} the rebuilds that would be required as a result of
2715 an upgrade. More rebuilds might be required under some circumstances.
2716
2717 @example
2718 $ guix refresh --list-dependent flex
2719 Building the following 120 packages would ensure 213 dependent packages are rebuilt:
2720 hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
2721 @end example
2722
2723 The command above lists a set of packages that could be built to check
2724 for compatibility with an upgraded @code{flex} package.
2725
2726 The following options can be used to customize GnuPG operation:
2727
2728 @table @code
2729
2730 @item --key-server=@var{host}
2731 Use @var{host} as the OpenPGP key server when importing a public key.
2732
2733 @item --gpg=@var{command}
2734 Use @var{command} as the GnuPG 2.x command. @var{command} is searched
2735 for in @code{$PATH}.
2736
2737 @end table
2738
2739 @node Invoking guix lint
2740 @section Invoking @command{guix lint}
2741 The @command{guix lint} is meant to help package developers avoid common
2742 errors and use a consistent style. It runs a few checks on a given set of
2743 packages in order to find common mistakes in their definitions.
2744
2745 The general syntax is:
2746
2747 @example
2748 guix lint @var{options} @var{package}@dots{}
2749 @end example
2750
2751 If no package is given on the command line, then all packages are checked.
2752 The @var{options} may be zero or more of the following:
2753
2754 @table @code
2755
2756 @item --list-checkers
2757 @itemx -l
2758 List and describe all the available checkers that will be run on packages
2759 and exit.
2760
2761 @end table
2762
2763 @c *********************************************************************
2764 @node GNU Distribution
2765 @chapter GNU Distribution
2766
2767 Guix comes with a distribution of free software@footnote{The term
2768 ``free'' here refers to the
2769 @url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
2770 users of that software}.} that forms the basis of the GNU system. This
2771 includes core GNU packages such as GNU libc, GCC, and Binutils, as well
2772 as many GNU and non-GNU applications. The complete list of available
2773 packages can be browsed
2774 @url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
2775 running @command{guix package} (@pxref{Invoking guix package}):
2776
2777 @example
2778 guix package --list-available
2779 @end example
2780
2781 Our goal is to build a practical 100% free software distribution of
2782 Linux-based and other variants of GNU, with a focus on the promotion and
2783 tight integration of GNU components, and an emphasis on programs and
2784 tools that help users exert that freedom.
2785
2786 The GNU distribution is currently available on the following platforms:
2787
2788 @table @code
2789
2790 @item x86_64-linux
2791 Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
2792
2793 @item i686-linux
2794 Intel 32-bit architecture (IA32), Linux-Libre kernel;
2795
2796 @item mips64el-linux
2797 little-endian 64-bit MIPS processors, specifically the Loongson series,
2798 n32 application binary interface (ABI), and Linux-Libre kernel.
2799
2800 @end table
2801
2802 @noindent
2803 For information on porting to other architectures or kernels,
2804 @xref{Porting}.
2805
2806 @menu
2807 * System Installation:: Installing the whole operating system.
2808 * System Configuration:: Configuring a GNU system.
2809 * Installing Debugging Files:: Feeding the debugger.
2810 * Package Modules:: Packages from the programmer's viewpoint.
2811 * Packaging Guidelines:: Growing the distribution.
2812 * Bootstrapping:: GNU/Linux built from scratch.
2813 * Porting:: Targeting another platform or kernel.
2814 @end menu
2815
2816 Building this distribution is a cooperative effort, and you are invited
2817 to join! @ref{Contributing}, for information about how you can help.
2818
2819 @node System Installation
2820 @section System Installation
2821
2822 This section explains how to install the complete GNU operating system
2823 on a machine. The Guix package manager can also be installed on top of
2824 a running GNU/Linux system, @pxref{Installation}.
2825
2826 @ifinfo
2827 @c This paragraph is for people reading this from tty2 of the
2828 @c installation image.
2829 You're reading this documentation with an Info reader. For details on
2830 how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
2831 link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
2832 @kbd{l} afterwards to come back here.
2833 @end ifinfo
2834
2835 @subsection Limitations
2836
2837 As of version @value{VERSION}, GNU@tie{}Guix and the GNU system
2838 distribution are alpha software. It may contain bugs and lack important
2839 features. Thus, if you are looking for a stable production system that
2840 respects your freedom as a computer user, a good solution at this point
2841 is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
2842 more established GNU/Linux distributions}. We hope you can soon switch
2843 to the GNU system without fear, of course. In the meantime, you can
2844 also keep using your distribution and try out the package manager on top
2845 of it (@pxref{Installation}).
2846
2847 Before you proceed with the installation, be aware of the following
2848 noteworthy limitations applicable to version @value{VERSION}:
2849
2850 @itemize
2851 @item
2852 The installation process does not include a graphical user interface and
2853 requires familiarity with GNU/Linux (see the following subsections to
2854 get a feel of what that means.)
2855
2856 @item
2857 The system does not yet provide graphical desktop environments such as
2858 GNOME and KDE.
2859
2860 @item
2861 Support for the Logical Volume Manager (LVM) is missing.
2862
2863 @item
2864 Few system services are currently supported out-of-the-box
2865 (@pxref{Services}).
2866
2867 @item
2868 On the order of 1,000 packages are available, which means that you may
2869 occasionally find that a useful package is missing.
2870 @end itemize
2871
2872 You've been warned. But more than a disclaimer, this is an invitation
2873 to report issues (and success stories!), and join us in improving it.
2874 @xref{Contributing}, for more info.
2875
2876 @subsection USB Stick Installation
2877
2878 An installation image for USB sticks can be downloaded from
2879 @url{ftp://alpha.gnu.org/gnu/guix/gnu-usb-install-@value{VERSION}.@var{system}.xz},
2880 where @var{system} is one of:
2881
2882 @table @code
2883 @item x86_64-linux
2884 for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
2885
2886 @item i686-linux
2887 for a 32-bit GNU/Linux system on Intel-compatible CPUs.
2888 @end table
2889
2890 This image contains a single partition with the tools necessary for an
2891 installation. It is meant to be copied @emph{as is} to a large-enough
2892 USB stick.
2893
2894 To copy the image to a USB stick, follow these steps:
2895
2896 @enumerate
2897 @item
2898 Decompress the image using the @command{xz} command:
2899
2900 @example
2901 xz -d gnu-usb-install-@value{VERSION}.@var{system}.xz
2902 @end example
2903
2904 @item
2905 Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
2906 its device name. Assuming that USB stick is known as @file{/dev/sdX},
2907 copy the image with:
2908
2909 @example
2910 dd if=gnu-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
2911 @end example
2912
2913 Access to @file{/dev/sdX} usually requires root privileges.
2914 @end enumerate
2915
2916 Once this is done, you should be able to reboot the system and boot from
2917 the USB stick. The latter usually requires you to get in the BIOS' boot
2918 menu, where you can choose to boot from the USB stick.
2919
2920 @subsection Preparing for Installation
2921
2922 Once you have successfully booted the image on the USB stick, you should
2923 end up with a root prompt. Several console TTYs are configured and can
2924 be used to run commands as root. TTY2 shows this documentation,
2925 browsable using the Info reader commands (@pxref{Help,,, info, Info: An
2926 Introduction}).
2927
2928 To install the system, you would:
2929
2930 @enumerate
2931
2932 @item
2933 Configure the network, by running @command{dhclient eth0} (to get an
2934 automatically assigned IP address from the wired network interface
2935 controller), or using the @command{ifconfig} command.
2936
2937 The system automatically loads drivers for your network interface
2938 controllers.
2939
2940 Setting up network access is almost always a requirement because the
2941 image does not contain all the software and tools that may be needed.
2942
2943 @item
2944 Unless this has already been done, you must partition and format the
2945 target partitions.
2946
2947 Preferably, assign partitions a label so that you can easily and
2948 reliably refer to them in @code{file-system} declarations (@pxref{File
2949 Systems}). This is typically done using the @code{-L} option of
2950 @command{mkfs.ext4} and related commands.
2951
2952 The installation image includes Parted (@pxref{Overview,,, parted, GNU
2953 Parted User Manual}), @command{fdisk}, and e2fsprogs, the suite of tools
2954 to manipulate ext2/ext3/ext4 file systems.
2955
2956 @item
2957 Once that is done, mount the target root partition under @file{/mnt}.
2958
2959 @item
2960 Lastly, run @code{deco start cow-store /mnt}.
2961
2962 This will make @file{/gnu/store} copy-on-write, such that packages added
2963 to it during the installation phase will be written to the target disk
2964 rather than kept in memory.
2965
2966 @end enumerate
2967
2968
2969 @subsection Proceeding with the Installation
2970
2971 With the target partitions ready, you now have to edit a file and
2972 provide the declaration of the operating system to be installed. To
2973 that end, the installation system comes with two text editors: GNU nano
2974 (@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
2975 It is better to store that file on the target root file system, say, as
2976 @file{/mnt/etc/config.scm}.
2977
2978 A minimal operating system configuration, with just the bare minimum and
2979 only a root account would look like this (on the installation system,
2980 this example is available as @file{/etc/configuration-template.scm}):
2981
2982 @example
2983 @include os-config.texi
2984 @end example
2985
2986 @noindent
2987 For more information on @code{operating-system} declarations,
2988 @pxref{Using the Configuration System}.
2989
2990 Once that is done, the new system must be initialized (remember that the
2991 target root file system is mounted under @file{/mnt}):
2992
2993 @example
2994 guix system init /mnt/etc/config.scm /mnt
2995 @end example
2996
2997 @noindent
2998 This will copy all the necessary files, and install GRUB on
2999 @file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
3000 more information, @pxref{Invoking guix system}. This command may trigger
3001 downloads or builds of missing packages, which can take some time.
3002
3003 Once that command has completed---and hopefully succeeded!---you can
3004 run @command{reboot} and boot into the new system. Cross fingers, and
3005 join us on @code{#guix} on the Freenode IRC network or on
3006 @file{guix-devel@@gnu.org} to share your experience---good or not so
3007 good.
3008
3009 @subsection Building the Installation Image
3010
3011 The installation image described above was built using the @command{guix
3012 system} command, specifically:
3013
3014 @example
3015 guix system disk-image --image-size=800MiB gnu/system/install.scm
3016 @end example
3017
3018 @xref{Invoking guix system}, for more information. See
3019 @file{gnu/system/install.scm} in the source tree for more information
3020 about the installation image.
3021
3022 @node System Configuration
3023 @section System Configuration
3024
3025 @cindex system configuration
3026 The GNU system supports a consistent whole-system configuration
3027 mechanism. By that we mean that all aspects of the global system
3028 configuration---such as the available system services, timezone and
3029 locale settings, user accounts---are declared in a single place. Such
3030 a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
3031
3032 One of the advantages of putting all the system configuration under the
3033 control of Guix is that it supports transactional system upgrades, and
3034 makes it possible to roll-back to a previous system instantiation,
3035 should something go wrong with the new one (@pxref{Features}). Another
3036 one is that it makes it easy to replicate the exact same configuration
3037 across different machines, or at different points in time, without
3038 having to resort to additional administration tools layered on top of
3039 the system's own tools.
3040 @c Yes, we're talking of Puppet, Chef, & co. here. ↑
3041
3042 This section describes this mechanism. First we focus on the system
3043 administrator's viewpoint---explaining how the system is configured and
3044 instantiated. Then we show how this mechanism can be extended, for
3045 instance to support new system services.
3046
3047 @menu
3048 * Using the Configuration System:: Customizing your GNU system.
3049 * File Systems:: Configuring file system mounts.
3050 * Mapped Devices:: Block device extra processing.
3051 * User Accounts:: Specifying user accounts.
3052 * Services:: Specifying system services.
3053 * Setuid Programs:: Programs running with root privileges.
3054 * Initial RAM Disk:: Linux-Libre bootstrapping.
3055 * Invoking guix system:: Instantiating a system configuration.
3056 * Defining Services:: Adding new service definitions.
3057 @end menu
3058
3059 @node Using the Configuration System
3060 @subsection Using the Configuration System
3061
3062 The operating system is configured by providing an
3063 @code{operating-system} declaration in a file that can then be passed to
3064 the @command{guix system} command (@pxref{Invoking guix system}). A
3065 simple setup, with the default system services, the default Linux-Libre
3066 kernel, initial RAM disk, and boot loader looks like this:
3067
3068 @findex operating-system
3069 @lisp
3070 (use-modules (gnu) ; for 'user-account', '%base-services', etc.
3071 (gnu packages emacs) ; for 'emacs'
3072 (gnu services ssh)) ; for 'lsh-service'
3073
3074 (operating-system
3075 (host-name "komputilo")
3076 (timezone "Europe/Paris")
3077 (locale "fr_FR.UTF-8")
3078 (bootloader (grub-configuration
3079 (device "/dev/sda")))
3080 (file-systems (cons (file-system
3081 (device "/dev/sda1") ; or partition label
3082 (mount-point "/")
3083 (type "ext3"))
3084 %base-file-systems))
3085 (users (list (user-account
3086 (name "alice")
3087 (password "")
3088 (uid 1000) (group 100)
3089 (comment "Bob's sister")
3090 (home-directory "/home/alice"))))
3091 (packages (cons emacs %base-packages))
3092 (services (cons (lsh-service #:port 2222 #:allow-root-login? #t)
3093 %base-services)))
3094 @end lisp
3095
3096 This example should be self-describing. Some of the fields defined
3097 above, such as @code{host-name} and @code{bootloader}, are mandatory.
3098 Others, such as @code{packages} and @code{services}, can be omitted, in
3099 which case they get a default value.
3100
3101 @vindex %base-packages
3102 The @code{packages} field lists
3103 packages that will be globally visible on the system, for all user
3104 accounts---i.e., in every user's @code{PATH} environment variable---in
3105 addition to the per-user profiles (@pxref{Invoking guix package}). The
3106 @var{%base-packages} variable provides all the tools one would expect
3107 for basic user and administrator tasks---including the GNU Core
3108 Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
3109 editor, @command{find}, @command{grep}, etc. The example above adds
3110 Emacs to those, taken from the @code{(gnu packages emacs)} module
3111 (@pxref{Package Modules}).
3112
3113 @vindex %base-services
3114 The @code{services} field lists @dfn{system services} to be made
3115 available when the system starts (@pxref{Services}).
3116 The @code{operating-system} declaration above specifies that, in
3117 addition to the basic services, we want the @command{lshd} secure shell
3118 daemon listening on port 2222, and allowing remote @code{root} logins
3119 (@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
3120 @code{lsh-service} arranges so that @code{lshd} is started with the
3121 right command-line options, possibly with supporting configuration files
3122 generated as needed (@pxref{Defining Services}).
3123
3124 Assuming the above snippet is stored in the @file{my-system-config.scm}
3125 file, the @command{guix system reconfigure my-system-config.scm} command
3126 instantiates that configuration, and makes it the default GRUB boot
3127 entry (@pxref{Invoking guix system}). The normal way to change the
3128 system's configuration is by updating this file and re-running the
3129 @command{guix system} command.
3130
3131 At the Scheme level, the bulk of an @code{operating-system} declaration
3132 is instantiated with the following monadic procedure (@pxref{The Store
3133 Monad}):
3134
3135 @deffn {Monadic Procedure} operating-system-derivation os
3136 Return a derivation that builds @var{os}, an @code{operating-system}
3137 object (@pxref{Derivations}).
3138
3139 The output of the derivation is a single directory that refers to all
3140 the packages, configuration files, and other supporting files needed to
3141 instantiate @var{os}.
3142 @end deffn
3143
3144 @node File Systems
3145 @subsection File Systems
3146
3147 The list of file systems to be mounted is specified in the
3148 @code{file-systems} field of the operating system's declaration
3149 (@pxref{Using the Configuration System}). Each file system is declared
3150 using the @code{file-system} form, like this:
3151
3152 @example
3153 (file-system
3154 (mount-point "/home")
3155 (device "/dev/sda3")
3156 (type "ext4"))
3157 @end example
3158
3159 As usual, some of the fields are mandatory---those shown in the example
3160 above---while others can be omitted. These are described below.
3161
3162 @deftp {Data Type} file-system
3163 Objects of this type represent file systems to be mounted. They
3164 contain the following members:
3165
3166 @table @asis
3167 @item @code{type}
3168 This is a string specifying the type of the file system---e.g.,
3169 @code{"ext4"}.
3170
3171 @item @code{mount-point}
3172 This designates the place where the file system is to be mounted.
3173
3174 @item @code{device}
3175 This names the ``source'' of the file system. By default it is the name
3176 of a node under @file{/dev}, but its meaning depends on the @code{title}
3177 field described below.
3178
3179 @item @code{title} (default: @code{'device})
3180 This is a symbol that specifies how the @code{device} field is to be
3181 interpreted.
3182
3183 When it is the symbol @code{device}, then the @code{device} field is
3184 interpreted as a file name; when it is @code{label}, then @code{device}
3185 is interpreted as a partition label name; when it is @code{uuid},
3186 @code{device} is interpreted as a partition unique identifier (UUID).
3187
3188 The @code{label} and @code{uuid} options offer a way to refer to disk
3189 partitions without having to hard-code their actual device name.
3190
3191 @item @code{flags} (default: @code{'()})
3192 This is a list of symbols denoting mount flags. Recognized flags
3193 include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
3194 access to special files), @code{no-suid} (ignore setuid and setgid
3195 bits), and @code{no-exec} (disallow program execution.)
3196
3197 @item @code{options} (default: @code{#f})
3198 This is either @code{#f}, or a string denoting mount options.
3199
3200 @item @code{needed-for-boot?} (default: @code{#f})
3201 This Boolean value indicates whether the file system is needed when
3202 booting. If that is true, then the file system is mounted when the
3203 initial RAM disk (initrd) is loaded. This is always the case, for
3204 instance, for the root file system.
3205
3206 @item @code{check?} (default: @code{#t})
3207 This Boolean indicates whether the file system needs to be checked for
3208 errors before being mounted.
3209
3210 @item @code{create-mount-point?} (default: @code{#f})
3211 When true, the mount point is created if it does not exist yet.
3212
3213 @end table
3214 @end deftp
3215
3216 The @code{(gnu system file-systems)} exports the following useful
3217 variables.
3218
3219 @defvr {Scheme Variable} %base-file-systems
3220 These are essential file systems that are required on normal systems,
3221 such as @var{%devtmpfs-file-system} (see below.) Operating system
3222 declarations should always contain at least these.
3223 @end defvr
3224
3225 @defvr {Scheme Variable} %devtmpfs-file-system
3226 The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
3227 requirement for udev (@pxref{Base Services, @code{udev-service}}).
3228 @end defvr
3229
3230 @defvr {Scheme Variable} %pseudo-terminal-file-system
3231 This is the file system to be mounted as @file{/dev/pts}. It supports
3232 @dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
3233 functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
3234 Manual}). Pseudo-terminals are used by terminal emulators such as
3235 @command{xterm}.
3236 @end defvr
3237
3238 @defvr {Scheme Variable} %shared-memory-file-system
3239 This file system is mounted as @file{/dev/shm} and is used to support
3240 memory sharing across processes (@pxref{Memory-mapped I/O,
3241 @code{shm_open},, libc, The GNU C Library Reference Manual}).
3242 @end defvr
3243
3244 @defvr {Scheme Variable} %binary-format-file-system
3245 The @code{binfmt_misc} file system, which allows handling of arbitrary
3246 executable file types to be delegated to user space. This requires the
3247 @code{binfmt.ko} kernel module to be loaded.
3248 @end defvr
3249
3250 @defvr {Scheme Variable} %fuse-control-file-system
3251 The @code{fusectl} file system, which allows unprivileged users to mount
3252 and unmount user-space FUSE file systems. This requires the
3253 @code{fuse.ko} kernel module to be loaded.
3254 @end defvr
3255
3256 @node Mapped Devices
3257 @subsection Mapped Devices
3258
3259 @cindex device mapping
3260 @cindex mapped devices
3261 The Linux kernel has a notion of @dfn{device mapping}: a block device,
3262 such as a hard disk partition, can be @dfn{mapped} into another device,
3263 with additional processing over the data that flows through
3264 it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
3265 concept of a ``mapped device'' and that of a file system: both boil down
3266 to @emph{translating} input/output operations made on a file to
3267 operations on its backing store. Thus, the Hurd implements mapped
3268 devices, like file systems, using the generic @dfn{translator} mechanism
3269 (@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
3270 typical example is encryption device mapping: all writes to the mapped
3271 device are encrypted, and all reads are deciphered, transparently.
3272
3273 Mapped devices are declared using the @code{mapped-device} form:
3274
3275 @example
3276 (mapped-device
3277 (source "/dev/sda3")
3278 (target "home")
3279 (type luks-device-mapping))
3280 @end example
3281
3282 @noindent
3283 @cindex disk encryption
3284 @cindex LUKS
3285 This example specifies a mapping from @file{/dev/sda3} to
3286 @file{/dev/mapper/home} using LUKS---the
3287 @url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
3288 standard mechanism for disk encryption. The @file{/dev/mapper/home}
3289 device can then be used as the @code{device} of a @code{file-system}
3290 declaration (@pxref{File Systems}). The @code{mapped-device} form is
3291 detailed below.
3292
3293 @deftp {Data Type} mapped-device
3294 Objects of this type represent device mappings that will be made when
3295 the system boots up.
3296
3297 @table @code
3298 @item source
3299 This string specifies the name of the block device to be mapped, such as
3300 @code{"/dev/sda3"}.
3301
3302 @item target
3303 This string specifies the name of the mapping to be established. For
3304 example, specifying @code{"my-partition"} will lead to the creation of
3305 the @code{"/dev/mapper/my-partition"} device.
3306
3307 @item type
3308 This must be a @code{mapped-device-kind} object, which specifies how
3309 @var{source} is mapped to @var{target}.
3310 @end table
3311 @end deftp
3312
3313 @defvr {Scheme Variable} luks-device-mapping
3314 This defines LUKS block device encryption using the @command{cryptsetup}
3315 command, from the same-named package. This relies on the
3316 @code{dm-crypt} Linux kernel module.
3317 @end defvr
3318
3319 @node User Accounts
3320 @subsection User Accounts
3321
3322 User accounts are specified with the @code{user-account} form:
3323
3324 @example
3325 (user-account
3326 (name "alice")
3327 (group "users")
3328 (supplementary-groups '("wheel" ;allow use of sudo, etc.
3329 "audio" ;sound card
3330 "video" ;video devices such as webcams
3331 "cdrom")) ;the good ol' CD-ROM
3332 (comment "Bob's sister")
3333 (home-directory "/home/alice"))
3334 @end example
3335
3336 @deftp {Data Type} user-account
3337 Objects of this type represent user accounts. The following members may
3338 be specified:
3339
3340 @table @asis
3341 @item @code{name}
3342 The name of the user account.
3343
3344 @item @code{group}
3345 This is the name (a string) or identifier (a number) of the user group
3346 this account belongs to.
3347
3348 @item @code{supplementary-groups} (default: @code{'()})
3349 Optionally, this can be defined as a list of group names that this
3350 account belongs to.
3351
3352 @item @code{uid} (default: @code{#f})
3353 This is the user ID for this account (a number), or @code{#f}. In the
3354 latter case, a number is automatically chosen by the system when the
3355 account is created.
3356
3357 @item @code{comment} (default: @code{""})
3358 A comment about the account, such as the account's owner full name.
3359
3360 @item @code{home-directory}
3361 This is the name of the home directory for the account.
3362
3363 @item @code{shell} (default: Bash)
3364 This is a G-expression denoting the file name of a program to be used as
3365 the shell (@pxref{G-Expressions}).
3366
3367 @item @code{system?} (default: @code{#f})
3368 This Boolean value indicates whether the account is a ``system''
3369 account. System accounts are sometimes treated specially; for instance,
3370 graphical login managers do not list them.
3371
3372 @item @code{password} (default: @code{#f})
3373 Unless @code{#f}, this is the password to be used for the account.
3374
3375 @end table
3376 @end deftp
3377
3378 User group declarations are even simpler:
3379
3380 @example
3381 (user-group (name "students"))
3382 @end example
3383
3384 @deftp {Data Type} user-group
3385 This type is for, well, user groups. There are just a few fields:
3386
3387 @table @asis
3388 @item @code{name}
3389 The group's name.
3390
3391 @item @code{id} (default: @code{#f})
3392 The group identifier (a number). If @code{#f}, a new number is
3393 automatically allocated when the group is created.
3394
3395 @item @code{system?} (default: @code{#f})
3396 This Boolean value indicates whether the group is a ``system'' group.
3397 System groups have low numerical IDs.
3398
3399 @item @code{password} (default: @code{#f})
3400 What, user groups can have a password? Well, apparently yes. Unless
3401 @code{#f}, this field specifies the group's password.
3402
3403 @end table
3404 @end deftp
3405
3406 For convenience, a variable lists all the basic user groups one may
3407 expect:
3408
3409 @defvr {Scheme Variable} %base-groups
3410 This is the list of basic user groups that users and/or packages expect
3411 to be present on the system. This includes groups such as ``root'',
3412 ``wheel'', and ``users'', as well as groups used to control access to
3413 specific devices such as ``audio'', ``disk'', and ``cdrom''.
3414 @end defvr
3415
3416
3417 @node Services
3418 @subsection Services
3419
3420 @cindex system services
3421 An important part of preparing an @code{operating-system} declaration is
3422 listing @dfn{system services} and their configuration (@pxref{Using the
3423 Configuration System}). System services are typically daemons launched
3424 when the system boots, or other actions needed at that time---e.g.,
3425 configuring network access. They are managed by GNU@tie{}dmd
3426 (@pxref{Introduction,,, dmd, GNU dmd Manual}).
3427
3428 The following sections document the available services, starting with
3429 the core services.
3430
3431 @menu
3432 * Base Services:: Essential system services.
3433 * Networking Services:: Network setup, SSH daemon, etc.
3434 * X Window:: Graphical display.
3435 @end menu
3436
3437 @node Base Services
3438 @subsubsection Base Services
3439
3440 The @code{(gnu services base)} module provides definitions for the basic
3441 services that one expects from the system. The services exported by
3442 this module are listed below.
3443
3444 @defvr {Scheme Variable} %base-services
3445 This variable contains a list of basic services@footnote{Technically,
3446 this is a list of monadic services. @xref{The Store Monad}.} one would
3447 expect from the system: a login service (mingetty) on each tty, syslogd,
3448 libc's name service cache daemon (nscd), the udev device manager, and
3449 more.
3450
3451 This is the default value of the @code{services} field of
3452 @code{operating-system} declarations. Usually, when customizing a
3453 system, you will want to append services to @var{%base-services}, like
3454 this:
3455
3456 @example
3457 (cons* (avahi-service) (lshd-service) %base-services)
3458 @end example
3459 @end defvr
3460
3461 @deffn {Monadic Procedure} host-name-service @var{name}
3462 Return a service that sets the host name to @var{name}.
3463 @end deffn
3464
3465 @deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
3466 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
3467 [#:allow-empty-passwords? #f]
3468 Return a service to run mingetty on @var{tty}.
3469
3470 When @var{allow-empty-passwords?} is true, allow empty log-in password. When
3471 @var{auto-login} is true, it must be a user name under which to log-in
3472 automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
3473 @var{auto-login}, in which case the user will have to press a key before the
3474 login shell is launched.
3475
3476 When true, @var{login-program} is a gexp or a monadic gexp denoting the name
3477 of the log-in program (the default is the @code{login} program from the Shadow
3478 tool suite.)
3479
3480 @var{motd} is a monadic value containing a text file to use as
3481 the ``message of the day''.
3482 @end deffn
3483
3484 @deffn {Monadic Procedure} nscd-service [#:glibc glibc]
3485 Return a service that runs libc's name service cache daemon (nscd).
3486 @end deffn
3487
3488 @deffn {Monadic Procedure} syslog-service
3489 Return a service that runs @code{syslogd} with reasonable default
3490 settings.
3491 @end deffn
3492
3493 @deffn {Monadic Procedure} guix-service [#:guix guix] @
3494 [#:builder-group "guixbuild"] [#:build-accounts 10] @
3495 [#:authorize-hydra-key? #f] [#:use-substitutes? #t] @
3496 [#:extra-options '()]
3497 Return a service that runs the build daemon from @var{guix}, and has
3498 @var{build-accounts} user accounts available under @var{builder-group}.
3499
3500 When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
3501 provided by @var{guix} is authorized upon activation, meaning that substitutes
3502 from @code{hydra.gnu.org} are used by default.
3503
3504 If @var{use-substitutes?} is false, the daemon is run with
3505 @option{--no-substitutes} (@pxref{Invoking guix-daemon,
3506 @option{--no-substitutes}}).
3507
3508 Finally, @var{extra-options} is a list of additional command-line options
3509 passed to @command{guix-daemon}.
3510 @end deffn
3511
3512 @deffn {Monadic Procedure} udev-service [#:udev udev]
3513 Run @var{udev}, which populates the @file{/dev} directory dynamically.
3514 @end deffn
3515
3516
3517 @node Networking Services
3518 @subsubsection Networking Services
3519
3520 The @code{(gnu system networking)} module provides services to configure
3521 the network interface.
3522
3523 @cindex DHCP, networking service
3524 @deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
3525 Return a service that runs @var{dhcp}, a Dynamic Host Configuration
3526 Protocol (DHCP) client, on all the non-loopback network interfaces.
3527 @end deffn
3528
3529 @deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
3530 [#:gateway #f] [#:name-services @code{'()}]
3531 Return a service that starts @var{interface} with address @var{ip}. If
3532 @var{gateway} is true, it must be a string specifying the default network
3533 gateway.
3534 @end deffn
3535
3536 @deffn {Monadic Procedure} tor-service [#:tor tor]
3537 Return a service to run the @uref{https://torproject.org,Tor} daemon.
3538
3539 The daemon runs with the default settings (in particular the default exit
3540 policy) as the @code{tor} unprivileged user.
3541 @end deffn
3542
3543 @deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
3544 [#:interface "127.0.0.1"] [#:port 6667] @
3545 [#:extra-settings ""]
3546 Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
3547 acts as a gateway between IRC and chat networks.
3548
3549 The daemon will listen to the interface corresponding to the IP address
3550 specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
3551 local clients can connect, whereas @code{0.0.0.0} means that connections can
3552 come from any networking interface.
3553
3554 In addition, @var{extra-settings} specifies a string to append to the
3555 configuration file.
3556 @end deffn
3557
3558 Furthermore, @code{(gnu system ssh)} provides the following service.
3559
3560 @deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
3561 [#:interfaces '()] [#:port-number 22] @
3562 [#:allow-empty-passwords? #f] [#:root-login? #f] @
3563 [#:syslog-output? #t] [#:x11-forwarding? #t] @
3564 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
3565 [public-key-authentication? #t] [#:initialize? #f]
3566 Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
3567 @var{host-key} must designate a file containing the host key, and readable
3568 only by root.
3569
3570 When @var{initialize?} is true, automatically create the seed and host key
3571 upon service activation if they do not exist yet. This may take long and
3572 require interaction.
3573
3574 When @var{interfaces} is empty, lshd listens for connections on all the
3575 network interfaces; otherwise, @var{interfaces} must be a list of host names
3576 or addresses.
3577
3578 @var{allow-empty-passwords?} specifies whether to accepts log-ins with empty
3579 passwords, and @var{root-login?} specifies whether to accepts log-ins as
3580 root.
3581
3582 The other options should be self-descriptive.
3583 @end deffn
3584
3585 @node X Window
3586 @subsubsection X Window
3587
3588 Support for the X Window graphical display system---specifically
3589 Xorg---is provided by the @code{(gnu services xorg)} module. Note that
3590 there is no @code{xorg-service} procedure. Instead, the X server is
3591 started by the @dfn{login manager}, currently SLiM.
3592
3593 @deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
3594 [#:auto-login? #f] [#:default-user ""] [#:startx]
3595 Return a service that spawns the SLiM graphical login manager, which in
3596 turn starts the X display server with @var{startx}, a command as returned by
3597 @code{xorg-start-command}.
3598
3599 When @var{allow-empty-passwords?} is true, allow logins with an empty
3600 password. When @var{auto-login?} is true, log in automatically as
3601 @var{default-user}.
3602 @end deffn
3603
3604
3605 @node Setuid Programs
3606 @subsection Setuid Programs
3607
3608 @cindex setuid programs
3609 Some programs need to run with ``root'' privileges, even when they are
3610 launched by unprivileged users. A notorious example is the
3611 @command{passwd} programs, which can users can run to change their
3612 password, and which requires write access to the @file{/etc/passwd} and
3613 @file{/etc/shadow} files---something normally restricted to root, for
3614 obvious security reasons. To address that, these executables are
3615 @dfn{setuid-root}, meaning that they always run with root privileges
3616 (@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
3617 for more info about the setuid mechanisms.)
3618
3619 The store itself @emph{cannot} contain setuid programs: that would be a
3620 security issue since any user on the system can write derivations that
3621 populate the store (@pxref{The Store}). Thus, a different mechanism is
3622 used: instead of changing the setuid bit directly on files that are in
3623 the store, we let the system administrator @emph{declare} which programs
3624 should be setuid root.
3625
3626 The @code{setuid-programs} field of an @code{operating-system}
3627 declaration contains a list of G-expressions denoting the names of
3628 programs to be setuid-root (@pxref{Using the Configuration System}).
3629 For instance, the @command{passwd} program, which is part of the Shadow
3630 package, can be designated by this G-expression (@pxref{G-Expressions}):
3631
3632 @example
3633 #~(string-append #$shadow "/bin/passwd")
3634 @end example
3635
3636 A default set of setuid programs is defined by the
3637 @code{%setuid-programs} variable of the @code{(gnu system)} module.
3638
3639 @defvr {Scheme Variable} %setuid-programs
3640 A list of G-expressions denoting common programs that are setuid-root.
3641
3642 The list includes commands such as @command{passwd}, @command{ping},
3643 @command{su}, and @command{sudo}.
3644 @end defvr
3645
3646 Under the hood, the actual setuid programs are created in the
3647 @file{/run/setuid-programs} directory at system activation time. The
3648 files in this directory refer to the ``real'' binaries, which are in the
3649 store.
3650
3651
3652 @node Initial RAM Disk
3653 @subsection Initial RAM Disk
3654
3655 @cindex initial RAM disk (initrd)
3656 @cindex initrd (initial RAM disk)
3657 For bootstrapping purposes, the Linux-Libre kernel is passed an
3658 @dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
3659 root file system, as well as an initialization script. The latter is
3660 responsible for mounting the real root file system, and for loading any
3661 kernel modules that may be needed to achieve that.
3662
3663 The @code{initrd} field of an @code{operating-system} declaration allows
3664 you to specify which initrd you would like to use. The @code{(gnu
3665 system linux-initrd)} module provides two ways to build an initrd: the
3666 high-level @code{base-initrd} procedure, and the low-level
3667 @code{expression->initrd} procedure.
3668
3669 The @code{base-initrd} procedure is intended to cover most common uses.
3670 For example, if you want to add a bunch of kernel modules to be loaded
3671 at boot time, you can define the @code{initrd} field of the operating
3672 system declaration like this:
3673
3674 @example
3675 (initrd (lambda (file-systems . rest)
3676 (apply base-initrd file-systems
3677 #:extra-modules '("my.ko" "modules.ko")
3678 rest)))
3679 @end example
3680
3681 The @code{base-initrd} procedure also handles common use cases that
3682 involves using the system as a QEMU guest, or as a ``live'' system whose
3683 root file system is volatile.
3684
3685 @deffn {Monadic Procedure} base-initrd @var{file-systems} @
3686 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
3687 [#:extra-modules '()] [#:mapped-devices '()]
3688 Return a monadic derivation that builds a generic initrd. @var{file-systems} is
3689 a list of file-systems to be mounted by the initrd, possibly in addition to
3690 the root file system specified on the kernel command line via @code{--root}.
3691 @var{mapped-devices} is a list of device mappings to realize before
3692 @var{file-systems} are mounted (@pxref{Mapped Devices}).
3693
3694 When @var{qemu-networking?} is true, set up networking with the standard QEMU
3695 parameters. When @var{virtio?} is true, load additional modules so the initrd can
3696 be used as a QEMU guest with para-virtualized I/O drivers.
3697
3698 When @var{volatile-root?} is true, the root file system is writable but any changes
3699 to it are lost.
3700
3701 The initrd is automatically populated with all the kernel modules necessary
3702 for @var{file-systems} and for the given options. However, additional kernel
3703 modules can be listed in @var{extra-modules}. They will be added to the initrd, and
3704 loaded at boot time in the order in which they appear.
3705 @end deffn
3706
3707 Needless to say, the initrds we produce and use embed a
3708 statically-linked Guile, and the initialization program is a Guile
3709 program. That gives a lot of flexibility. The
3710 @code{expression->initrd} procedure builds such an initrd, given the
3711 program to run in that initrd.
3712
3713 @deffn {Monadic Procedure} expression->initrd @var{exp} @
3714 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
3715 [#:modules '()]
3716 Return a derivation that builds a Linux initrd (a gzipped cpio archive)
3717 containing @var{guile} and that evaluates @var{exp}, a G-expression,
3718 upon booting. All the derivations referenced by @var{exp} are
3719 automatically copied to the initrd.
3720
3721 @var{modules} is a list of Guile module names to be embedded in the
3722 initrd.
3723 @end deffn
3724
3725 @node Invoking guix system
3726 @subsection Invoking @code{guix system}
3727
3728 Once you have written an operating system declaration, as seen in the
3729 previous section, it can be @dfn{instantiated} using the @command{guix
3730 system} command. The synopsis is:
3731
3732 @example
3733 guix system @var{options}@dots{} @var{action} @var{file}
3734 @end example
3735
3736 @var{file} must be the name of a file containing an
3737 @code{operating-system} declaration. @var{action} specifies how the
3738 operating system is instantiate. Currently the following values are
3739 supported:
3740
3741 @table @code
3742 @item reconfigure
3743 Build the operating system described in @var{file}, activate it, and
3744 switch to it@footnote{This action is usable only on systems already
3745 running GNU.}.
3746
3747 This effects all the configuration specified in @var{file}: user
3748 accounts, system services, global package list, setuid programs, etc.
3749
3750 It also adds a GRUB menu entry for the new OS configuration, and moves
3751 entries for older configurations to a submenu---unless
3752 @option{--no-grub} is passed.
3753
3754 @item build
3755 Build the operating system's derivation, which includes all the
3756 configuration files and programs needed to boot and run the system.
3757 This action does not actually install anything.
3758
3759 @item init
3760 Populate the given directory with all the files necessary to run the
3761 operating system specified in @var{file}. This is useful for first-time
3762 installations of the GNU system. For instance:
3763
3764 @example
3765 guix system init my-os-config.scm /mnt
3766 @end example
3767
3768 copies to @file{/mnt} all the store items required by the configuration
3769 specified in @file{my-os-config.scm}. This includes configuration
3770 files, packages, and so on. It also creates other essential files
3771 needed for the system to operate correctly---e.g., the @file{/etc},
3772 @file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
3773
3774 This command also installs GRUB on the device specified in
3775 @file{my-os-config}, unless the @option{--no-grub} option was passed.
3776
3777 @item vm
3778 @cindex virtual machine
3779 Build a virtual machine that contain the operating system declared in
3780 @var{file}, and return a script to run that virtual machine (VM).
3781
3782 The VM shares its store with the host system.
3783
3784 @item vm-image
3785 @itemx disk-image
3786 Return a virtual machine or disk image of the operating system declared
3787 in @var{file} that stands alone. Use the @option{--image-size} option
3788 to specify the size of the image.
3789
3790 When using @code{vm-image}, the returned image is in qcow2 format, which
3791 the QEMU emulator can efficiently use.
3792
3793 When using @code{disk-image}, a raw disk image is produced; it can be
3794 copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
3795 the device corresponding to a USB stick, one can copy the image on it
3796 using the following command:
3797
3798 @example
3799 # dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
3800 @end example
3801
3802 @end table
3803
3804 @var{options} can contain any of the common build options provided by
3805 @command{guix build} (@pxref{Invoking guix build}). In addition,
3806 @var{options} can contain one of the following:
3807
3808 @table @option
3809 @item --system=@var{system}
3810 @itemx -s @var{system}
3811 Attempt to build for @var{system} instead of the host's system type.
3812 This works as per @command{guix build} (@pxref{Invoking guix build}).
3813
3814 @item --image-size=@var{size}
3815 For the @code{vm-image} and @code{disk-image} actions, create an image
3816 of the given @var{size}. @var{size} may be a number of bytes, or it may
3817 include a unit as a suffix, such as @code{MiB} for mebibytes and
3818 @code{GB} for gigabytes.
3819 @end table
3820
3821 Note that all the actions above, except @code{build} and @code{init},
3822 rely on KVM support in the Linux-Libre kernel. Specifically, the
3823 machine should have hardware virtualization support, the corresponding
3824 KVM kernel module should be loaded, and the @file{/dev/kvm} device node
3825 must exist and be readable and writable by the user and by the daemon's
3826 build users.
3827
3828 @node Defining Services
3829 @subsection Defining Services
3830
3831 The @code{(gnu services @dots{})} modules define several procedures that allow
3832 users to declare the operating system's services (@pxref{Using the
3833 Configuration System}). These procedures are @emph{monadic
3834 procedures}---i.e., procedures that return a monadic value in the store
3835 monad (@pxref{The Store Monad}). For examples of such procedures,
3836 @xref{Services}.
3837
3838 @cindex service definition
3839 The monadic value returned by those procedures is a @dfn{service
3840 definition}---a structure as returned by the @code{service} form.
3841 Service definitions specifies the inputs the service depends on, and an
3842 expression to start and stop the service. Behind the scenes, service
3843 definitions are ``translated'' into the form suitable for the
3844 configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
3845 dmd Manual}).
3846
3847 As an example, here is what the @code{nscd-service} procedure looks
3848 like:
3849
3850 @lisp
3851 (define (nscd-service)
3852 (with-monad %store-monad
3853 (return (service
3854 (documentation "Run libc's name service cache daemon.")
3855 (provision '(nscd))
3856 (activate #~(begin
3857 (use-modules (guix build utils))
3858 (mkdir-p "/var/run/nscd")))
3859 (start #~(make-forkexec-constructor
3860 (string-append #$glibc "/sbin/nscd")
3861 "-f" "/dev/null" "--foreground"))
3862 (stop #~(make-kill-destructor))
3863 (respawn? #f)))))
3864 @end lisp
3865
3866 @noindent
3867 The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
3868 (@pxref{G-Expressions}). The @code{activate} field contains a script to
3869 run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
3870 directory exists before @command{nscd} is started.
3871
3872 The @code{start} and @code{stop} fields refer to dmd's facilities to
3873 start and stop processes (@pxref{Service De- and Constructors,,, dmd,
3874 GNU dmd Manual}). The @code{provision} field specifies the name under
3875 which this service is known to dmd, and @code{documentation} specifies
3876 on-line documentation. Thus, the commands @command{deco start ncsd},
3877 @command{deco stop nscd}, and @command{deco doc nscd} will do what you
3878 would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
3879
3880
3881 @node Installing Debugging Files
3882 @section Installing Debugging Files
3883
3884 @cindex debugging files
3885 Program binaries, as produced by the GCC compilers for instance, are
3886 typically written in the ELF format, with a section containing
3887 @dfn{debugging information}. Debugging information is what allows the
3888 debugger, GDB, to map binary code to source code; it is required to
3889 debug a compiled program in good conditions.
3890
3891 The problem with debugging information is that is takes up a fair amount
3892 of disk space. For example, debugging information for the GNU C Library
3893 weighs in at more than 60 MiB. Thus, as a user, keeping all the
3894 debugging info of all the installed programs is usually not an option.
3895 Yet, space savings should not come at the cost of an impediment to
3896 debugging---especially in the GNU system, which should make it easier
3897 for users to exert their computing freedom (@pxref{GNU Distribution}).
3898
3899 Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
3900 mechanism that allows users to get the best of both worlds: debugging
3901 information can be stripped from the binaries and stored in separate
3902 files. GDB is then able to load debugging information from those files,
3903 when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
3904 with GDB}).
3905
3906 The GNU distribution takes advantage of this by storing debugging
3907 information in the @code{lib/debug} sub-directory of a separate package
3908 output unimaginatively called @code{debug} (@pxref{Packages with
3909 Multiple Outputs}). Users can choose to install the @code{debug} output
3910 of a package when they need it. For instance, the following command
3911 installs the debugging information for the GNU C Library and for GNU
3912 Guile:
3913
3914 @example
3915 guix package -i glibc:debug guile:debug
3916 @end example
3917
3918 GDB must then be told to look for debug files in the user's profile, by
3919 setting the @code{debug-file-directory} variable (consider setting it
3920 from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
3921 GDB}):
3922
3923 @example
3924 (gdb) set debug-file-directory ~/.guix-profile/lib/debug
3925 @end example
3926
3927 From there on, GDB will pick up debugging information from the
3928 @code{.debug} files under @file{~/.guix-profile/lib/debug}.
3929
3930 In addition, you will most likely want GDB to be able to show the source
3931 code being debugged. To do that, you will have to unpack the source
3932 code of the package of interest (obtained with @code{guix build
3933 --source}, @pxref{Invoking guix build}), and to point GDB to that source
3934 directory using the @code{directory} command (@pxref{Source Path,
3935 @code{directory},, gdb, Debugging with GDB}).
3936
3937 @c XXX: keep me up-to-date
3938 The @code{debug} output mechanism in Guix is implemented by the
3939 @code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
3940 opt-in---debugging information is available only for those packages
3941 whose definition explicitly declares a @code{debug} output. This may be
3942 changed to opt-out in the future, if our build farm servers can handle
3943 the load. To check whether a package has a @code{debug} output, use
3944 @command{guix package --list-available} (@pxref{Invoking guix package}).
3945
3946
3947 @node Package Modules
3948 @section Package Modules
3949
3950 From a programming viewpoint, the package definitions of the
3951 GNU distribution are provided by Guile modules in the @code{(gnu packages
3952 @dots{})} name space@footnote{Note that packages under the @code{(gnu
3953 packages @dots{})} module name space are not necessarily ``GNU
3954 packages''. This module naming scheme follows the usual Guile module
3955 naming convention: @code{gnu} means that these modules are distributed
3956 as part of the GNU system, and @code{packages} identifies modules that
3957 define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
3958 Reference Manual}). For instance, the @code{(gnu packages emacs)}
3959 module exports a variable named @code{emacs}, which is bound to a
3960 @code{<package>} object (@pxref{Defining Packages}).
3961
3962 The @code{(gnu packages @dots{})} module name space is
3963 automatically scanned for packages by the command-line tools. For
3964 instance, when running @code{guix package -i emacs}, all the @code{(gnu
3965 packages @dots{})} modules are scanned until one that exports a package
3966 object whose name is @code{emacs} is found. This package search
3967 facility is implemented in the @code{(gnu packages)} module.
3968
3969 @cindex customization, of packages
3970 @cindex package module search path
3971 Users can store package definitions in modules with different
3972 names---e.g., @code{(my-packages emacs)}. These package definitions
3973 will not be visible by default. Thus, users can invoke commands such as
3974 @command{guix package} and @command{guix build} have to be used with the
3975 @code{-e} option so that they know where to find the package, or use the
3976 @code{-L} option of these commands to make those modules visible
3977 (@pxref{Invoking guix build, @code{--load-path}}), or define the
3978 @code{GUIX_PACKAGE_PATH} environment variable. This environment
3979 variable makes it easy to extend or customize the distribution and is
3980 honored by all the user interfaces.
3981
3982 @defvr {Environment Variable} GUIX_PACKAGE_PATH
3983 This is a colon-separated list of directories to search for package
3984 modules. Directories listed in this variable take precedence over the
3985 distribution's own modules.
3986 @end defvr
3987
3988 The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
3989 each package is built based solely on other packages in the
3990 distribution. The root of this dependency graph is a small set of
3991 @dfn{bootstrap binaries}, provided by the @code{(gnu packages
3992 bootstrap)} module. For more information on bootstrapping,
3993 @ref{Bootstrapping}.
3994
3995 @node Packaging Guidelines
3996 @section Packaging Guidelines
3997
3998 The GNU distribution is nascent and may well lack some of your favorite
3999 packages. This section describes how you can help make the distribution
4000 grow. @xref{Contributing}, for additional information on how you can
4001 help.
4002
4003 Free software packages are usually distributed in the form of
4004 @dfn{source code tarballs}---typically @file{tar.gz} files that contain
4005 all the source files. Adding a package to the distribution means
4006 essentially two things: adding a @dfn{recipe} that describes how to
4007 build the package, including a list of other packages required to build
4008 it, and adding @dfn{package meta-data} along with that recipe, such as a
4009 description and licensing information.
4010
4011 In Guix all this information is embodied in @dfn{package definitions}.
4012 Package definitions provide a high-level view of the package. They are
4013 written using the syntax of the Scheme programming language; in fact,
4014 for each package we define a variable bound to the package definition,
4015 and export that variable from a module (@pxref{Package Modules}).
4016 However, in-depth Scheme knowledge is @emph{not} a prerequisite for
4017 creating packages. For more information on package definitions,
4018 @ref{Defining Packages}.
4019
4020 Once a package definition is in place, stored in a file in the Guix
4021 source tree, it can be tested using the @command{guix build} command
4022 (@pxref{Invoking guix build}). For example, assuming the new package is
4023 called @code{gnew}, you may run this command from the Guix build tree:
4024
4025 @example
4026 ./pre-inst-env guix build gnew --keep-failed
4027 @end example
4028
4029 Using @code{--keep-failed} makes it easier to debug build failures since
4030 it provides access to the failed build tree. Another useful
4031 command-line option when debugging is @code{--log-file}, to access the
4032 build log.
4033
4034 If the package is unknown to the @command{guix} command, it may be that
4035 the source file contains a syntax error, or lacks a @code{define-public}
4036 clause to export the package variable. To figure it out, you may load
4037 the module from Guile to get more information about the actual error:
4038
4039 @example
4040 ./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
4041 @end example
4042
4043 Once your package builds correctly, please send us a patch
4044 (@pxref{Contributing}). Well, if you need help, we will be happy to
4045 help you too. Once the patch is committed in the Guix repository, the
4046 new package automatically gets built on the supported platforms by
4047 @url{http://hydra.gnu.org/gnu/master, our continuous integration
4048 system}.
4049
4050 @cindex substituter
4051 Users can obtain the new package definition simply by running
4052 @command{guix pull} (@pxref{Invoking guix pull}). When
4053 @code{hydra.gnu.org} is done building the package, installing the
4054 package automatically downloads binaries from there
4055 (@pxref{Substitutes}). The only place where human intervention is
4056 needed is to review and apply the patch.
4057
4058
4059 @menu
4060 * Software Freedom:: What may go into the distribution.
4061 * Package Naming:: What's in a name?
4062 * Version Numbers:: When the name is not enough.
4063 * Python Modules:: Taming the snake.
4064 * Perl Modules:: Little pearls.
4065 @end menu
4066
4067 @node Software Freedom
4068 @subsection Software Freedom
4069
4070 @c Adapted from http://www.gnu.org/philosophy/philosophy.html.
4071
4072 The GNU operating system has been developed so that users can have
4073 freedom in their computing. GNU is @dfn{free software}, meaning that
4074 users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
4075 essential freedoms}: to run the program, to study and change the program
4076 in source code form, to redistribute exact copies, and to distribute
4077 modified versions. Packages found in the GNU distribution provide only
4078 software that conveys these four freedoms.
4079
4080 In addition, the GNU distribution follow the
4081 @url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
4082 software distribution guidelines}. Among other things, these guidelines
4083 reject non-free firmware, recommendations of non-free software, and
4084 discuss ways to deal with trademarks and patents.
4085
4086 Some packages contain a small and optional subset that violates the
4087 above guidelines, for instance because this subset is itself non-free
4088 code. When that happens, the offending items are removed with
4089 appropriate patches or code snippets in the package definition's
4090 @code{origin} form (@pxref{Defining Packages}). That way, @code{guix
4091 build --source} returns the ``freed'' source rather than the unmodified
4092 upstream source.
4093
4094
4095 @node Package Naming
4096 @subsection Package Naming
4097
4098 A package has actually two names associated with it:
4099 First, there is the name of the @emph{Scheme variable}, the one following
4100 @code{define-public}. By this name, the package can be made known in the
4101 Scheme code, for instance as input to another package. Second, there is
4102 the string in the @code{name} field of a package definition. This name
4103 is used by package management commands such as
4104 @command{guix package} and @command{guix build}.
4105
4106 Both are usually the same and correspond to the lowercase conversion of
4107 the project name chosen upstream, with underscores replaced with
4108 hyphens. For instance, GNUnet is available as @code{gnunet}, and
4109 SDL_net as @code{sdl-net}.
4110
4111 We do not add @code{lib} prefixes for library packages, unless these are
4112 already part of the official project name. But see @pxref{Python
4113 Modules} and @ref{Perl Modules} for special rules concerning modules for
4114 the Python and Perl languages.
4115
4116
4117 @node Version Numbers
4118 @subsection Version Numbers
4119
4120 We usually package only the latest version of a given free software
4121 project. But sometimes, for instance for incompatible library versions,
4122 two (or more) versions of the same package are needed. These require
4123 different Scheme variable names. We use the name as defined
4124 in @ref{Package Naming}
4125 for the most recent version; previous versions use the same name, suffixed
4126 by @code{-} and the smallest prefix of the version number that may
4127 distinguish the two versions.
4128
4129 The name inside the package definition is the same for all versions of a
4130 package and does not contain any version number.
4131
4132 For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
4133
4134 @example
4135 (define-public gtk+
4136 (package
4137 (name "gtk+")
4138 (version "3.9.12")
4139 ...))
4140 (define-public gtk+-2
4141 (package
4142 (name "gtk+")
4143 (version "2.24.20")
4144 ...))
4145 @end example
4146 If we also wanted GTK+ 3.8.2, this would be packaged as
4147 @example
4148 (define-public gtk+-3.8
4149 (package
4150 (name "gtk+")
4151 (version "3.8.2")
4152 ...))
4153 @end example
4154
4155
4156 @node Python Modules
4157 @subsection Python Modules
4158
4159 We currently package Python 2 and Python 3, under the Scheme variable names
4160 @code{python-2} and @code{python} as explained in @ref{Version Numbers}.
4161 To avoid confusion and naming clashes with other programming languages, it
4162 seems desirable that the name of a package for a Python module contains
4163 the word @code{python}.
4164
4165 Some modules are compatible with only one version of Python, others with both.
4166 If the package Foo compiles only with Python 3, we name it
4167 @code{python-foo}; if it compiles only with Python 2, we name it
4168 @code{python2-foo}. If it is compatible with both versions, we create two
4169 packages with the corresponding names.
4170
4171 If a project already contains the word @code{python}, we drop this;
4172 for instance, the module python-dateutil is packaged under the names
4173 @code{python-dateutil} and @code{python2-dateutil}.
4174
4175
4176 @node Perl Modules
4177 @subsection Perl Modules
4178
4179 Perl programs standing for themselves are named as any other package,
4180 using the lowercase upstream name.
4181 For Perl packages containing a single class, we use the lowercase class name,
4182 replace all occurrences of @code{::} by dashes and prepend the prefix
4183 @code{perl-}.
4184 So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
4185 Modules containing several classes keep their lowercase upstream name and
4186 are also prepended by @code{perl-}. Such modules tend to have the word
4187 @code{perl} somewhere in their name, which gets dropped in favor of the
4188 prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
4189
4190
4191
4192 @node Bootstrapping
4193 @section Bootstrapping
4194
4195 @c Adapted from the ELS 2013 paper.
4196
4197 @cindex bootstrapping
4198
4199 Bootstrapping in our context refers to how the distribution gets built
4200 ``from nothing''. Remember that the build environment of a derivation
4201 contains nothing but its declared inputs (@pxref{Introduction}). So
4202 there's an obvious chicken-and-egg problem: how does the first package
4203 get built? How does the first compiler get compiled? Note that this is
4204 a question of interest only to the curious hacker, not to the regular
4205 user, so you can shamelessly skip this section if you consider yourself
4206 a ``regular user''.
4207
4208 @cindex bootstrap binaries
4209 The GNU system is primarily made of C code, with libc at its core. The
4210 GNU build system itself assumes the availability of a Bourne shell and
4211 command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
4212 `grep'. Furthermore, build programs---programs that run
4213 @code{./configure}, @code{make}, etc.---are written in Guile Scheme
4214 (@pxref{Derivations}). Consequently, to be able to build anything at
4215 all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
4216 Binutils, libc, and the other packages mentioned above---the
4217 @dfn{bootstrap binaries}.
4218
4219 These bootstrap binaries are ``taken for granted'', though we can also
4220 re-create them if needed (more on that later).
4221
4222 @unnumberedsubsec Preparing to Use the Bootstrap Binaries
4223
4224 @c As of Emacs 24.3, Info-mode displays the image, but since it's a
4225 @c large image, it's hard to scroll. Oh well.
4226 @image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
4227
4228 The figure above shows the very beginning of the dependency graph of the
4229 distribution, corresponding to the package definitions of the @code{(gnu
4230 packages bootstrap)} module. At this level of detail, things are
4231 slightly complex. First, Guile itself consists of an ELF executable,
4232 along with many source and compiled Scheme files that are dynamically
4233 loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
4234 tarball shown in this graph. This tarball is part of Guix's ``source''
4235 distribution, and gets inserted into the store with @code{add-to-store}
4236 (@pxref{The Store}).
4237
4238 But how do we write a derivation that unpacks this tarball and adds it
4239 to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
4240 derivation---the first one that gets built---uses @code{bash} as its
4241 builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
4242 @code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
4243 @file{xz}, and @file{mkdir} are statically-linked binaries, also part of
4244 the Guix source distribution, whose sole purpose is to allow the Guile
4245 tarball to be unpacked.
4246
4247 Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
4248 Guile that can be used to run subsequent build programs. Its first task
4249 is to download tarballs containing the other pre-built binaries---this
4250 is what the @code{.tar.xz.drv} derivations do. Guix modules such as
4251 @code{ftp-client.scm} are used for this purpose. The
4252 @code{module-import.drv} derivations import those modules in a directory
4253 in the store, using the original layout. The
4254 @code{module-import-compiled.drv} derivations compile those modules, and
4255 write them in an output directory with the right layout. This
4256 corresponds to the @code{#:modules} argument of
4257 @code{build-expression->derivation} (@pxref{Derivations}).
4258
4259 Finally, the various tarballs are unpacked by the
4260 derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
4261 etc., at which point we have a working C tool chain.
4262
4263
4264 @unnumberedsubsec Building the Build Tools
4265
4266 @c TODO: Add a package-level dependency graph generated from (gnu
4267 @c packages base).
4268
4269 Bootstrapping is complete when we have a full tool chain that does not
4270 depend on the pre-built bootstrap tools discussed above. This
4271 no-dependency requirement is verified by checking whether the files of
4272 the final tool chain contain references to the @file{/gnu/store}
4273 directories of the bootstrap inputs. The process that leads to this
4274 ``final'' tool chain is described by the package definitions found in
4275 the @code{(gnu packages base)} module.
4276
4277 @c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
4278 The first tool that gets built with the bootstrap binaries is
4279 GNU Make, which is a prerequisite for all the following packages.
4280 From there Findutils and Diffutils get built.
4281
4282 Then come the first-stage Binutils and GCC, built as pseudo cross
4283 tools---i.e., with @code{--target} equal to @code{--host}. They are
4284 used to build libc. Thanks to this cross-build trick, this libc is
4285 guaranteed not to hold any reference to the initial tool chain.
4286
4287 From there the final Binutils and GCC are built. GCC uses @code{ld}
4288 from the final Binutils, and links programs against the just-built libc.
4289 This tool chain is used to build the other packages used by Guix and by
4290 the GNU Build System: Guile, Bash, Coreutils, etc.
4291
4292 And voilà! At this point we have the complete set of build tools that
4293 the GNU Build System expects. These are in the @code{%final-inputs}
4294 variable of the @code{(gnu packages commencement)} module, and are
4295 implicitly used by any package that uses @code{gnu-build-system}
4296 (@pxref{Defining Packages}).
4297
4298
4299 @unnumberedsubsec Building the Bootstrap Binaries
4300
4301 Because the final tool chain does not depend on the bootstrap binaries,
4302 those rarely need to be updated. Nevertheless, it is useful to have an
4303 automated way to produce them, should an update occur, and this is what
4304 the @code{(gnu packages make-bootstrap)} module provides.
4305
4306 The following command builds the tarballs containing the bootstrap
4307 binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
4308 of Coreutils and other basic command-line tools):
4309
4310 @example
4311 guix build bootstrap-tarballs
4312 @end example
4313
4314 The generated tarballs are those that should be referred to in the
4315 @code{(gnu packages bootstrap)} module mentioned at the beginning of
4316 this section.
4317
4318 Still here? Then perhaps by now you've started to wonder: when do we
4319 reach a fixed point? That is an interesting question! The answer is
4320 unknown, but if you would like to investigate further (and have
4321 significant computational and storage resources to do so), then let us
4322 know.
4323
4324 @node Porting
4325 @section Porting to a New Platform
4326
4327 As discussed above, the GNU distribution is self-contained, and
4328 self-containment is achieved by relying on pre-built ``bootstrap
4329 binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
4330 operating system kernel, CPU architecture, and application binary
4331 interface (ABI). Thus, to port the distribution to a platform that is
4332 not yet supported, one must build those bootstrap binaries, and update
4333 the @code{(gnu packages bootstrap)} module to use them on that platform.
4334
4335 Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
4336 When everything goes well, and assuming the GNU tool chain supports the
4337 target platform, this can be as simple as running a command like this
4338 one:
4339
4340 @example
4341 guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
4342 @end example
4343
4344 Once these are built, the @code{(gnu packages bootstrap)} module needs
4345 to be updated to refer to these binaries on the target platform. In
4346 addition, the @code{glibc-dynamic-linker} procedure in that module must
4347 be augmented to return the right file name for libc's dynamic linker on
4348 that platform; likewise, @code{system->linux-architecture} in @code{(gnu
4349 packages linux)} must be taught about the new platform.
4350
4351 In practice, there may be some complications. First, it may be that the
4352 extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
4353 above) is not recognized by all the GNU tools. Typically, glibc
4354 recognizes some of these, whereas GCC uses an extra @code{--with-abi}
4355 configure flag (see @code{gcc.scm} for examples of how to handle this).
4356 Second, some of the required packages could fail to build for that
4357 platform. Lastly, the generated binaries could be broken for some
4358 reason.
4359
4360
4361 @c *********************************************************************
4362 @node Contributing
4363 @chapter Contributing
4364
4365 This project is a cooperative effort, and we need your help to make it
4366 grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
4367 @code{#guix} on the Freenode IRC network. We welcome ideas, bug
4368 reports, patches, and anything that may be helpful to the project. We
4369 particularly welcome help on packaging (@pxref{Packaging Guidelines}).
4370
4371 Please see the
4372 @url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
4373 @file{HACKING} file} that comes with the Guix source code for practical
4374 details about contributions.
4375
4376
4377 @c *********************************************************************
4378 @node Acknowledgments
4379 @chapter Acknowledgments
4380
4381 Guix is based on the Nix package manager, which was designed and
4382 implemented by Eelco Dolstra. Nix pioneered functional package
4383 management, and promoted unprecedented features, such as transactional
4384 package upgrades and rollbacks, per-user profiles, and referentially
4385 transparent build processes. Without this work, Guix would not exist.
4386
4387 The Nix-based software distributions, Nixpkgs and NixOS, have also been
4388 an inspiration for Guix.
4389
4390 @c *********************************************************************
4391 @node GNU Free Documentation License
4392 @appendix GNU Free Documentation License
4393
4394 @include fdl-1.3.texi
4395
4396 @c *********************************************************************
4397 @node Concept Index
4398 @unnumbered Concept Index
4399 @printindex cp
4400
4401 @node Programming Index
4402 @unnumbered Programming Index
4403 @syncodeindex tp fn
4404 @syncodeindex vr fn
4405 @printindex fn
4406
4407 @bye
4408
4409 @c Local Variables:
4410 @c ispell-local-dictionary: "american";
4411 @c End: