gnu: harfbuzz: Update to 0.9.22.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
58db733e 11@set YEARS 2012, 2013
568717fd 12
eeaf4427 13@dircategory Package management
568717fd
LC
14@direntry
15* guix: (guix). Guix, the functional package manager.
e49951eb 16* guix package: (guix)Invoking guix package
eeaf4427 17 Managing packages with Guix.
e49951eb 18* guix build: (guix)Invoking guix build
568717fd
LC
19 Building packages with Guix.
20@end direntry
568717fd
LC
21
22@titlepage
7730d112
LC
23@title GNU Guix Reference Manual
24@subtitle Using the GNU Guix Functional Package Manager
568717fd 25@author Ludovic Courtès
da7cabd4 26@author Andreas Enge
acc08466 27@author Nikita Karetnikov
568717fd
LC
28
29@page
30@vskip 0pt plus 1filll
31Edition @value{EDITION} @*
32@value{UPDATED} @*
33
da7cabd4 34Copyright @copyright{} @value{YEARS} Ludovic Court@`es, Andreas Enge, Nikita Karetnikov
568717fd 35
46cb9da2 36@ifinfo
568717fd
LC
37@quotation
38Permission is granted to copy, distribute and/or modify this document
39under the terms of the GNU Free Documentation License, Version 1.3 or
40any later version published by the Free Software Foundation; with no
41Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
42copy of the license is included in the section entitled ``GNU Free
43Documentation License''.
44@end quotation
46cb9da2
AE
45@end ifinfo
46
568717fd
LC
47@end titlepage
48
49@copying
f8348b91 50This manual documents GNU Guix version @value{VERSION}.
568717fd 51
58db733e 52Copyright @copyright{} @value{YEARS} Ludovic Courtès
568717fd
LC
53
54Permission is granted to copy, distribute and/or modify this document
55under the terms of the GNU Free Documentation License, Version 1.3 or
56any later version published by the Free Software Foundation; with no
57Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
58copy of the license is included in the section entitled ``GNU Free
59Documentation License.''
60@end copying
61
62@contents
63
64@c *********************************************************************
65@node Top
f8348b91 66@top GNU Guix
568717fd 67
f8348b91
LC
68This document describes GNU Guix version @value{VERSION}, a functional
69package management tool written for the GNU system.
568717fd 70
46cb9da2
AE
71
72@quotation
73Copyright @copyright{} @value{YEARS} Ludovic Courtès, Andreas Enge, Nikita Karetnikov
74
75Permission is granted to copy, distribute and/or modify this document
76under the terms of the GNU Free Documentation License, Version 1.3 or
77any later version published by the Free Software Foundation; with no
78Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
79copy of the license is included in the section entitled ``GNU Free
80Documentation License.''
81@end quotation
82
568717fd
LC
83@menu
84* Introduction:: What is Guix about?
bd5e766b 85* Installation:: Installing Guix.
eeaf4427 86* Package Management:: Package installation, upgrade, etc.
568717fd
LC
87* Programming Interface:: Using Guix in Scheme.
88* Utilities:: Package management commands.
a1ba8475 89* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 90* Contributing:: Your help needed!
568717fd
LC
91
92* Acknowledgments:: Thanks!
93* GNU Free Documentation License:: The license of this manual.
94* Concept Index:: Concepts.
95* Function Index:: Functions.
96@end menu
97
98@c *********************************************************************
99@node Introduction
100@chapter Introduction
101
c80e7e55
LC
102GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
103using the international phonetic alphabet (IPA).} is a functional
104package management tool for the GNU system. Package management consists
4bfc4ea3
NK
105of all activities that relate to building packages from sources,
106honoring their build-time and run-time dependencies,
c80e7e55
LC
107installing packages in user environments, upgrading installed packages
108to new versions or rolling back to a previous set, removing unused
109software packages, etc.
568717fd
LC
110
111@cindex functional package management
112The term @dfn{functional} refers to a specific package management
113discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
114as a function, in the mathematical sense. That function takes inputs,
115such as build scripts, a compiler, and libraries, and
116returns an installed package. As a pure function, its result depends
568717fd
LC
117solely on its inputs---for instance, it cannot refer to software or
118scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
119always produces the same result when passed a given set of inputs. It
120cannot alter the system's environment in
568717fd
LC
121any way; for instance, it cannot create, modify, or delete files outside
122of its build and installation directories. This is achieved by running
4bfc4ea3
NK
123build processes in isolated environments (or @dfn{chroots}), where only their
124explicit inputs are visible.
568717fd 125
e531ac2a 126@cindex store
568717fd 127The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
128system, in a special directory called @dfn{the store} (@pxref{The
129Store}). Each package is installed in a directory of its own, in the
568717fd
LC
130store---by default under @file{/nix/store}. The directory name contains
131a hash of all the inputs used to build that package; thus, changing an
132input yields a different directory name.
133
134This approach is the foundation of Guix's salient features: support for
4bfc4ea3 135transactional package upgrade and rollback, per-user installation, and
eeaf4427 136garbage collection of packages (@pxref{Features}).
568717fd 137
4bfc4ea3 138Guix has a command-line interface, which allows users to build, install,
568717fd 139upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 140
a1ba8475
LC
141Last but not least, Guix is used to build a distribution of the GNU
142system, with many GNU and non-GNU free software packages. @xref{GNU
143Distribution}.
144
bd5e766b
LC
145@c *********************************************************************
146@node Installation
147@chapter Installation
148
48febeb8
LC
149GNU Guix is available for download from its website at
150@url{http://www.gnu.org/software/guix/}. This section describes the
151software requirements of Guix, as well as how to install it and get
152ready to use it.
bd5e766b 153
b22a12fd 154The build procedure for Guix is the same as for other GNU software, and
1da983b9 155is not covered here. Please see the files @file{README} and
b22a12fd
LC
156@file{INSTALL} in the Guix source tree for additional details.
157
bd5e766b
LC
158@menu
159* Requirements:: Software needed to build and run Guix.
160* Setting Up the Daemon:: Preparing the build daemon's environment.
161* Invoking guix-daemon:: Running the build daemon.
162@end menu
163
164@node Requirements
165@section Requirements
166
167GNU Guix depends on the following packages:
168
169@itemize
4a328f73 170@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.5 or later;
bd5e766b
LC
171@item @url{http://gnupg.org/, GNU libgcrypt}
172@end itemize
173
174Unless @code{--disable-daemon} was passed to @command{configure}, the
175following packages are also needed:
176
177@itemize
178@item @url{http://sqlite.org, SQLite 3}
179@item @url{http://www.bzip.org, libbz2}
180@item @url{http://gcc.gnu.org, GCC's g++}
181@end itemize
182
4bfc4ea3
NK
183When a working installation of @url{http://nixos.org/nix/, the Nix package
184manager} is available, you
bd5e766b 185can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 186Nix replaces the three dependencies above.
bd5e766b 187
b22a12fd
LC
188Guix is compatible with Nix, so it is possible to share the same store
189between both. To do so, you must pass @command{configure} not only the
190same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
191@code{--localstatedir} value. The latter is essential because it
192specifies where the database that stores metadata about the store is
193located, among other things. The default values are
b22a12fd 194@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
195Note that @code{--disable-daemon} is not required if
196your goal is to share the store with Nix.
b22a12fd 197
bd5e766b
LC
198@node Setting Up the Daemon
199@section Setting Up the Daemon
200
201@cindex daemon
202Operations such as building a package or running the garbage collector
203are all performed by a specialized process, the @dfn{Guix daemon}, on
204behalf of clients. Only the daemon may access the store and its
205associated database. Thus, any operation that manipulates the store
206goes through the daemon. For instance, command-line tools such as
e49951eb 207@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
208daemon (@i{via} remote procedure calls) to instruct it what to do.
209
210In a standard multi-user setup, Guix and its daemon---the
211@command{guix-daemon} program---are installed by the system
212administrator; @file{/nix/store} is owned by @code{root} and
213@command{guix-daemon} runs as @code{root}. Unprivileged users may use
214Guix tools to build packages or otherwise access the store, and the
215daemon will do it on their behalf, ensuring that the store is kept in a
216consistent state, and allowing built packages to be shared among users.
217
218@cindex build users
219When @command{guix-daemon} runs as @code{root}, you may not want package
220build processes themselves to run as @code{root} too, for obvious
221security reasons. To avoid that, a special pool of @dfn{build users}
222should be created for use by build processes started by the daemon.
223These build users need not have a shell and a home directory: they will
224just be used when the daemon drops @code{root} privileges in build
225processes. Having several such users allows the daemon to launch
226distinct build processes under separate UIDs, which guarantees that they
227do not interfere with each other---an essential feature since builds are
228regarded as pure functions (@pxref{Introduction}).
229
230On a GNU/Linux system, a build user pool may be created like this (using
231Bash syntax and the @code{shadow} commands):
232
091196b3
LC
233@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
234@c for why `-G' is needed.
bd5e766b
LC
235@example
236# groupadd guix-builder
237# for i in `seq 1 10`;
238 do
091196b3
LC
239 useradd -g guix-builder -G guix-builder \
240 -d /var/empty -s `which nologin` \
80ba8cc0 241 -c "Guix build user $i" guix-builder$i;
bd5e766b
LC
242 done
243@end example
244
245@noindent
246The @code{guix-daemon} program may then be run as @code{root} with:
247
248@example
249# guix-daemon --build-users-group=guix-builder
250@end example
251
b095792f
LC
252@noindent
253This way, the daemon starts build processes in a chroot, under one of
254the @code{guix-builder} users. On GNU/Linux, by default, the chroot
255environment contains nothing but the @code{/dev} and @code{/proc}
256directories@footnote{On some systems @code{/dev/shm}, which supports
257shared memory, is a symlink to another directory such as
258@code{/run/shm}, that is @emph{not} is the chroot. When that is the
259case, shared memory support is unavailable in the chroot environment.
260The workaround is to make sure that @file{/dev/shm} is directly a
261@code{tmpfs} mount point.}.
262
bd5e766b 263Guix may also be used in a single-user setup, with @command{guix-daemon}
1da983b9 264running as an unprivileged user. However, to maximize non-interference
bd5e766b
LC
265of build processes, the daemon still needs to perform certain operations
266that are restricted to @code{root} on GNU/Linux: it should be able to
267run build processes in a chroot, and to run them under different UIDs.
268To that end, the @command{nix-setuid-helper} program is provided; it is
269a small C program (less than 300 lines) that, if it is made setuid
270@code{root}, can be executed by the daemon to perform these operations
271on its behalf. The @code{root}-owned @file{/etc/nix-setuid.conf} file
272is read by @command{nix-setuid-helper}; it should contain exactly two
273words: the user name under which the authorized @command{guix-daemon}
274runs, and the name of the build users group.
275
276If you are installing Guix as an unprivileged user and do not have the
277ability to make @file{nix-setuid-helper} setuid-@code{root}, it is still
278possible to run @command{guix-daemon}. However, build processes will
279not be isolated from one another, and not from the rest of the system.
280Thus, build processes may interfere with each other, and may access
281programs, libraries, and other files available on the system---making it
282much harder to view them as @emph{pure} functions.
283
284@node Invoking guix-daemon
285@section Invoking @command{guix-daemon}
286
287The @command{guix-daemon} program implements all the functionality to
288access the store. This includes launching build processes, running the
289garbage collector, querying the availability of a build result, etc. It
290is normally run as @code{root} like this:
291
292@example
293# guix-daemon --build-users-group=guix-builder
294@end example
295
296@noindent
297For details on how to set it up, @ref{Setting Up the Daemon}.
298
299By default, @command{guix-daemon} launches build processes under
300different UIDs, taken from the build group specified with
301@code{--build-users-group}. In addition, each build process is run in a
302chroot environment that only contains the subset of the store that the
303build process depends on, as specified by its derivation
304(@pxref{Programming Interface, derivation}), plus a set of specific
305system directories. By default, the latter contains @file{/dev} and
306@file{/dev/pts}.
307
308The following command-line options are supported:
309
310@table @code
311@item --build-users-group=@var{group}
312Take users from @var{group} to run build processes (@pxref{Setting Up
313the Daemon, build users}).
314
6858f9d1
LC
315@item --no-substitutes
316Do not use substitutes for build products. That is, always build things
317locally instead of allowing downloads of pre-built binaries.
318
bd5e766b
LC
319@item --cache-failures
320Cache build failures. By default, only successful builds are cached.
321
322@item --cores=@var{n}
323@itemx -c @var{n}
324Use @var{n} CPU cores to build each derivation; @code{0} means as many
325as available.
326
327The default value is @code{1}, but it may be overridden by clients, such
e49951eb
MW
328as the @code{--cores} option of @command{guix build} (@pxref{Invoking
329guix build}).
bd5e766b
LC
330
331The effect is to define the @code{NIX_BUILD_CORES} environment variable
332in the build process, which can then use it to exploit internal
333parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
334
335@item --max-jobs=@var{n}
336@itemx -M @var{n}
337Allow at most @var{n} build jobs in parallel. The default value is
338@code{1}.
339
340@item --debug
341Produce debugging output.
342
343This is useful to debug daemon start-up issues, but then it may be
344overridden by clients, for example the @code{--verbosity} option of
e49951eb 345@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
346
347@item --chroot-directory=@var{dir}
348Add @var{dir} to the build chroot.
349
350Doing this may change the result of build processes---for instance if
351they use optional dependencies found in @var{dir} when it is available,
352and not otherwise. For that reason, it is not recommended to do so.
353Instead, make sure that each derivation declares all the inputs that it
354needs.
355
356@item --disable-chroot
357Disable chroot builds.
358
359Using this option is not recommended since, again, it would allow build
360processes to gain access to undeclared dependencies.
361
362@item --disable-log-compression
363Disable compression of the build logs.
364
1da983b9
LC
365Unless @code{--lose-logs} is used, all the build logs are kept in the
366@var{localstatedir}. To save space, the daemon automatically compresses
367them with bzip2 by default. This option disables that.
368
bd5e766b
LC
369@item --disable-store-optimization
370Disable automatic file ``deduplication'' in the store.
371
1da983b9
LC
372By default, files added to the store are automatically ``deduplicated'':
373if a newly added file is identical as another one found in the store,
374the daemon makes the new file a hard link to the other file. This
375slightly increases the input/output load at the end of a build process.
376This option disables this.
377
bd5e766b
LC
378@item --impersonate-linux-2.6
379On Linux-based systems, impersonate Linux 2.6. This means that the
380kernel's @code{uname} system call will report 2.6 as the release number.
381
382This might be helpful to build programs that (usually wrongfully) depend
383on the kernel version number.
384
385@item --lose-logs
386Do not keep build logs. By default they are kept under
387@code{@var{localstatedir}/nix/log}.
388
389@item --system=@var{system}
390Assume @var{system} as the current system type. By default it is the
391architecture/kernel pair found at configure time, such as
392@code{x86_64-linux}.
b8d2aa26
LC
393
394@item --listen=@var{socket}
395Listen for connections on @var{socket}, the file name of a Unix-domain
396socket. The default socket is
397@file{@var{localstatedir}/daemon-socket/socket}. This option is only
398useful in exceptional circumstances, such as if you need to run several
399daemons on the same machine.
bd5e766b
LC
400@end table
401
402
eeaf4427
LC
403@c *********************************************************************
404@node Package Management
405@chapter Package Management
406
f8348b91 407The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
408remove software packages, without having to know about their build
409procedure or dependencies. Guix also goes beyond this obvious set of
410features.
411
412This chapter describes the main features of Guix, as well as the package
413management tools it provides.
414
415@menu
416* Features:: How Guix will make your life brighter.
e49951eb 417* Invoking guix package:: Package installation, removal, etc.
6e721c4d 418* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 419* Invoking guix gc:: Running the garbage collector.
f651b477 420* Invoking guix pull:: Fetching the latest Guix and distribution.
eeaf4427
LC
421@end menu
422
423@node Features
424@section Features
425
426When using Guix, each package ends up in the @dfn{package store}, in its
427own directory---something that resembles
428@file{/nix/store/xxx-package-1.2}, where @code{xxx} is a base32 string.
429
430Instead of referring to these directories, users have their own
431@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
432use. These profiles are stored within each user's home directory, at
433@code{$HOME/.guix-profile}.
eeaf4427 434
821b0015 435For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 436@file{/home/alice/.guix-profile/bin/gcc} points to
821b0015
LC
437@file{/nix/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
438@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
439simply continues to point to
440@file{/nix/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
441coexist on the same system without any interference.
eeaf4427 442
e49951eb
MW
443The @command{guix package} command is the central tool to manage
444packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 445profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
446
447The command provides the obvious install, remove, and upgrade
448operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 449the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 450@command{guix package} process is terminated during the transaction,
eeaf4427
LC
451or if a power outage occurs during the transaction, then the user's
452profile remains in its previous state, and remains usable.
453
454In addition, any package transaction may be @emph{rolled back}. So, if,
455for example, an upgrade installs a new version of a package that turns
456out to have a serious bug, users may roll back to the previous instance
457of their profile, which was known to work well.
458
459All those packages in the package store may be @emph{garbage-collected}.
460Guix can determine which packages are still referenced by the user
fe8ff028 461profiles, and remove those that are provably no longer referenced
e49951eb 462(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
463generations of their profile so that the packages they refer to can be
464collected.
eeaf4427
LC
465
466Finally, Guix takes a @dfn{purely functional} approach to package
467management, as described in the introduction (@pxref{Introduction}).
468Each @file{/nix/store} package directory name contains a hash of all the
469inputs that were used to build that package---compiler, libraries, build
470scripts, etc. This direct correspondence allows users to make sure a
471given package installation matches the current state of their
a1ba8475 472distribution, and helps maximize @dfn{reproducibility}.
eeaf4427
LC
473
474This foundation allows Guix to support @dfn{transparent binary/source
3b78d1ea 475deployment}. When a pre-built binary for a @file{/nix/store} path is
eeaf4427
LC
476available from an external source, Guix just downloads it; otherwise, it
477builds the package from source, locally.
478
e49951eb
MW
479@node Invoking guix package
480@section Invoking @command{guix package}
eeaf4427 481
e49951eb 482The @command{guix package} command is the tool that allows users to
eeaf4427
LC
483install, upgrade, and remove packages, as well as rolling back to
484previous configurations. It operates only on the user's own profile,
485and works with normal user privileges (@pxref{Features}). Its syntax
486is:
487
488@example
e49951eb 489guix package @var{options}
eeaf4427
LC
490@end example
491
ba55b1cb 492Primarily, @var{options} specifies the operations to be performed during
eeaf4427
LC
493the transaction. Upon completion, a new profile is created, but
494previous generations of the profile remain available, should the user
495want to roll back.
496
b9e5c0a9 497For each user, a symlink to the user's default profile is automatically
0ec1af59 498created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
499current generation of the user's default profile. Thus, users can add
500@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
501variable, and so on.
502
0ec1af59
LC
503In a multi-user setup, user profiles must be stored in a place
504registered as a @dfn{garbage-collector root}, which
e49951eb 505@file{$HOME/.guix-profile} points to (@pxref{Invoking guix gc}). That
0ec1af59
LC
506directory is normally
507@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
508@var{localstatedir} is the value passed to @code{configure} as
509@code{--localstatedir}, and @var{user} is the user name. It must be
510created by @code{root}, with @var{user} as the owner. When it does not
70c43291
LC
511exist, or is not owned by @var{user}, @command{guix package} emits an
512error about it.
0ec1af59
LC
513
514The @var{options} can be among the following:
515
eeaf4427
LC
516@table @code
517
518@item --install=@var{package}
51c8d790 519@itemx -i @var{package}
eeaf4427
LC
520Install @var{package}.
521
522@var{package} may specify either a simple package name, such as
523@code{guile}, or a package name followed by a hyphen and version number,
dc5669cd
MW
524such as @code{guile-1.8.8}. If no version number is specified, the
525newest available version will be selected. In addition, @var{package}
526may contain a colon, followed by the name of one of the outputs of the
6e721c4d
LC
527package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
528(@pxref{Packages with Multiple Outputs}).
eeaf4427 529
461572cc
LC
530@cindex propagated inputs
531Sometimes packages have @dfn{propagated inputs}: these are dependencies
532that automatically get installed along with the required package.
533
534An example is the GNU MPC library: its C header files refer to those of
535the GNU MPFR library, which in turn refer to those of the GMP library.
536Thus, when installing MPC, the MPFR and GMP libraries also get installed
537in the profile; removing MPC also removes MPFR and GMP---unless they had
538also been explicitly installed independently.
539
ba7ea5ce 540Besides, packages sometimes rely on the definition of environment
5924080d 541variables for their search paths (see explanation of
ba7ea5ce 542@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
543environment variable definitions are reported here.
544
ef010c0f 545@c XXX: keep me up-to-date
5924080d 546Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
547availability of a newer upstream version. In the future, it may provide
548the option of installing directly from the upstream version, even if
549that version is not yet in the distribution.
550
5d4b411f
LC
551@item --install-from-expression=@var{exp}
552@itemx -e @var{exp}
553Install the package @var{exp} evaluates to.
554
555@var{exp} must be a Scheme expression that evaluates to a
556@code{<package>} object. This option is notably useful to disambiguate
557between same-named variants of a package, with expressions such as
558@code{(@@ (gnu packages base) guile-final)}.
559
560Note that this option installs the first output of the specified
561package, which may be insufficient when needing a specific output of a
562multiple-output package.
563
eeaf4427
LC
564@item --remove=@var{package}
565@itemx -r @var{package}
566Remove @var{package}.
567
acb6ba25
CR
568@item --upgrade[=@var{regexp}]
569@itemx -u [@var{regexp}]
570Upgrade all the installed packages. When @var{regexp} is specified, upgrade
571only installed packages whose name matches @var{regexp}.
eeaf4427 572
f651b477
LC
573Note that this upgrades package to the latest version of packages found
574in the distribution currently installed. To update your distribution,
575you should regularly run @command{guix pull} (@pxref{Invoking guix
576pull}).
577
24e262f0
LC
578@item --roll-back
579Roll back to the previous @dfn{generation} of the profile---i.e., undo
580the last transaction.
581
582When combined with options such as @code{--install}, roll back occurs
583before any other actions.
584
d9307267 585When rolling back from the first generation that actually contains
4b2bc804
NK
586installed packages, the profile is made to point to the @dfn{zeroth
587generation}, which contains no files apart from its own meta-data.
d9307267 588
82fe08ed
LC
589Installing, removing, or upgrading packages from a generation that has
590been rolled back to overwrites previous future generations. Thus, the
591history of a profile's generations is always linear.
592
5924080d
LC
593@item --search-paths
594@cindex search paths
595Report environment variable definitions, in Bash syntax, that may be
596needed in order to use the set of installed packages. These environment
597variables are used to specify @dfn{search paths} for files used by some
598of the installed packages.
599
600For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
601environment variables to be defined so it can look for headers and
602libraries in the user's profile (@pxref{Environment Variables,,, gcc,
603Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
604library are installed in the profile, then @code{--search-paths} will
605suggest setting these variables to @code{@var{profile}/include} and
606@code{@var{profile}/lib}, respectively.
607
eeaf4427
LC
608@item --profile=@var{profile}
609@itemx -p @var{profile}
610Use @var{profile} instead of the user's default profile.
611
612@item --dry-run
613@itemx -n
614Show what would be done without actually doing it.
615
56b1f4b7
LC
616@item --fallback
617When substituting a pre-built binary fails, fall back to building
618packages locally.
619
3b824605 620@item --no-substitutes
969e678e
LC
621@itemx --max-silent-time=@var{seconds}
622Same as for @command{guix build} (@pxref{Invoking guix build}).
3b824605 623
70915c1a
LC
624@item --verbose
625Produce verbose output. In particular, emit the environment's build log
626on the standard error port.
627
eeaf4427
LC
628@item --bootstrap
629Use the bootstrap Guile to build the profile. This option is only
630useful to distribution developers.
631
632@end table
633
e49951eb 634In addition to these actions @command{guix package} supports the
733b4130
LC
635following options to query the current state of a profile, or the
636availability of packages:
eeaf4427 637
733b4130
LC
638@table @option
639
acc08466
NK
640@item --search=@var{regexp}
641@itemx -s @var{regexp}
642List the available packages whose synopsis or description matches
299112d3
LC
643@var{regexp}. Print all the meta-data of matching packages in
644@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
645GNU recutils manual}).
acc08466 646
299112d3
LC
647This allows specific fields to be extracted using the @command{recsel}
648command, for instance:
649
650@example
e49951eb 651$ guix package -s malloc | recsel -p name,version
299112d3
LC
652name: glibc
653version: 2.17
654
655name: libgc
656version: 7.2alpha6
657@end example
acc08466 658
733b4130
LC
659@item --list-installed[=@var{regexp}]
660@itemx -I [@var{regexp}]
bd9bde1c
LC
661List the currently installed packages in the specified profile, with the
662most recently installed packages shown last. When @var{regexp} is
663specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
664
665For each installed package, print the following items, separated by
666tabs: the package name, its version string, the part of the package that
667is installed (for instance, @code{out} for the default output,
668@code{include} for its headers, etc.), and the path of this package in
669the store.
670
64fc89b6
LC
671@item --list-available[=@var{regexp}]
672@itemx -A [@var{regexp}]
a1ba8475
LC
673List packages currently available in the software distribution
674(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
675installed packages whose name matches @var{regexp}.
64fc89b6
LC
676
677For each package, print the following items separated by tabs: its name,
6e721c4d
LC
678its version string, the parts of the package (@pxref{Packages with
679Multiple Outputs}), and the source location of its definition.
64fc89b6 680
f566d765
LC
681@item --list-generations[=@var{pattern}]
682@itemx -l [@var{pattern}]
683Return a list of generations along with their creation dates; for each
684generation, show the installed packages, with the most recently
4b2bc804
NK
685installed packages shown last. Note that the zeroth generation is never
686shown.
f566d765
LC
687
688For each installed package, print the following items, separated by
689tabs: the name of a package, its version string, the part of the package
690that is installed (@pxref{Packages with Multiple Outputs}), and the
691location of this package in the store.
692
693When @var{pattern} is used, the command returns only matching
694generations. Valid patterns include:
695
696@itemize
697@item @emph{Integers and comma-separated integers}. Both patterns denote
698generation numbers. For instance, @code{--list-generations=1} returns
699the first one.
700
701And @code{--list-generations=1,8,2} outputs three generations in the
702specified order. Neither spaces nor trailing commas are allowed.
703
704@item @emph{Ranges}. @code{--list-generations=2..9} prints the
705specified generations and everything in between. Note that the start of
706a range must be lesser than its end.
707
708It is also possible to omit the endpoint. For example,
709@code{--list-generations=2..}, returns all generations starting from the
710second one.
711
712@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
713or months by passing an integer along with the first letter of the
d7ddb257
LC
714duration. For example, @code{--list-generations=20d} lists generations
715that are up to 20 days old.
f566d765
LC
716@end itemize
717
b7884ca3
NK
718@item --delete-generations[=@var{pattern}]
719@itemx -d [@var{pattern}]
d7ddb257
LC
720When @var{pattern} is omitted, delete all generations except the current
721one.
b7884ca3
NK
722
723This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
724When @var{pattern} is specified, delete the matching generations. When
725@var{pattern} specifies a duration, generations @emph{older} than the
726specified duration match. For instance, @code{--delete-generations=1m}
727deletes generations that are more than one month old.
728
729If the current generation matches, it is deleted atomically---i.e., by
730switching to the previous available generation. Note that the zeroth
731generation is never deleted.
b7884ca3 732
1bb9900a
LC
733Note that deleting generations prevents roll-back to them.
734Consequently, this command must be used with care.
735
733b4130 736@end table
eeaf4427 737
6e721c4d
LC
738@node Packages with Multiple Outputs
739@section Packages with Multiple Outputs
740
741@cindex multiple-output packages
742@cindex package outputs
743
744Often, packages defined in Guix have a single @dfn{output}---i.e., the
745source package leads exactly one directory in the store. When running
746@command{guix package -i glibc}, one installs the default output of the
747GNU libc package; the default output is called @code{out}, but its name
748can be omitted as shown in this command. In this particular case, the
749default output of @code{glibc} contains all the C header files, shared
750libraries, static libraries, Info documentation, and other supporting
751files.
752
753Sometimes it is more appropriate to separate the various types of files
754produced from a single source package into separate outputs. For
755instance, the GLib C library (used by GTK+ and related packages)
756installs more than 20 MiB of reference documentation as HTML pages.
757To save space for users who do not need it, the documentation goes to a
758separate output, called @code{doc}. To install the main GLib output,
759which contains everything but the documentation, one would run:
760
761@example
762guix package -i glib
763@end example
764
765The command to install its documentation is:
766
767@example
768guix package -i glib:doc
769@end example
770
771Some packages install programs with different ``dependency footprints''.
772For instance, the WordNet package install both command-line tools and
773graphical user interfaces (GUIs). The former depend solely on the C
774library, whereas the latter depend on Tcl/Tk and the underlying X
775libraries. In this case, we leave the command-line tools in the default
776output, whereas the GUIs are in a separate output. This allows users
777who do not need the GUIs to save space.
778
779There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
780Other conventional output names include @code{lib} for libraries and
781possibly header files, @code{bin} for stand-alone programs, and
782@code{debug} for debugging information (@pxref{Installing Debugging
783Files}). The outputs of a packages are listed in the third column of
784the output of @command{guix package --list-available} (@pxref{Invoking
785guix package}).
6e721c4d 786
eeaf4427 787
e49951eb
MW
788@node Invoking guix gc
789@section Invoking @command{guix gc}
fe8ff028
LC
790
791@cindex garbage collector
792Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 793The @command{guix gc} command allows users to explicitly run the garbage
fe8ff028
LC
794collector to reclaim space from the @file{/nix/store} directory.
795
796The garbage collector has a set of known @dfn{roots}: any file under
797@file{/nix/store} reachable from a root is considered @dfn{live} and
798cannot be deleted; any other file is considered @dfn{dead} and may be
799deleted. The set of garbage collector roots includes default user
e49951eb
MW
800profiles, and may be augmented with @command{guix build --root}, for
801example (@pxref{Invoking guix build}).
fe8ff028 802
1bb9900a
LC
803Prior to running @code{guix gc --collect-garbage} to make space, it is
804often useful to remove old generations from user profiles; that way, old
805package builds referenced by those generations can be reclaimed. This
806is achieved by running @code{guix package --delete-generations}
807(@pxref{Invoking guix package}).
808
e49951eb 809The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
810used to garbage-collect any dead files (the default), to delete specific
811files (the @code{--delete} option), or to print garbage-collector
812information. The available options are listed below:
813
814@table @code
815@item --collect-garbage[=@var{min}]
816@itemx -C [@var{min}]
817Collect garbage---i.e., unreachable @file{/nix/store} files and
818sub-directories. This is the default operation when no option is
819specified.
820
821When @var{min} is given, stop once @var{min} bytes have been collected.
822@var{min} may be a number of bytes, or it may include a unit as a
823suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes.
824
825When @var{min} is omitted, collect all the garbage.
826
827@item --delete
828@itemx -d
829Attempt to delete all the store files and directories specified as
830arguments. This fails if some of the files are not in the store, or if
831they are still live.
832
833@item --list-dead
834Show the list of dead files and directories still present in the
835store---i.e., files and directories no longer reachable from any root.
836
837@item --list-live
838Show the list of live store files and directories.
ba8b732d
LC
839
840@end table
841
842In addition, the references among existing store files can be queried:
843
844@table @code
845
846@item --references
847@itemx --referrers
848List the references (respectively, the referrers) of store files given
849as arguments.
850
8e59fdd5
LC
851@item --requisites
852@itemx -R
853List the requisites of the store files passed as arguments. Requisites
854include the store files themselves, their references, and the references
855of these, recursively. In other words, the returned list is the
856@dfn{transitive closure} of the store files.
857
fe8ff028
LC
858@end table
859
eeaf4427 860
f651b477
LC
861@node Invoking guix pull
862@section Invoking @command{guix pull}
863
864Packages are installed or upgraded to the latest version available in
865the distribution currently available on your local machine. To update
866that distribution, along with the Guix tools, you must run @command{guix
867pull}: the command downloads the latest Guix source code and package
868descriptions, and deploys it.
869
870On completion, @command{guix package} will use packages and package
871versions from this just-retrieved copy of Guix. Not only that, but all
872the Guix commands and Scheme modules will also be taken from that latest
873version. New @command{guix} sub-commands added by the update also
874become available.
875
876The @command{guix pull} command is usually invoked with no arguments,
877but it supports the following options:
878
879@table @code
880@item --verbose
881Produce verbose output, writing build logs to the standard error output.
882
ab5d72ad
LC
883@item --url=@var{url}
884Download the source tarball of Guix from @var{url}.
885
886By default, the tarball is taken from its canonical address at
887@code{gnu.org}, for the stable branch of Guix.
888
f651b477
LC
889@item --bootstrap
890Use the bootstrap Guile to build the latest Guix. This option is only
891useful to Guix developers.
892@end table
893
568717fd
LC
894@c *********************************************************************
895@node Programming Interface
896@chapter Programming Interface
897
3dc1970d
LC
898GNU Guix provides several Scheme programming interfaces (APIs) to
899define, build, and query packages. The first interface allows users to
900write high-level package definitions. These definitions refer to
901familiar packaging concepts, such as the name and version of a package,
902its build system, and its dependencies. These definitions can then be
903turned into concrete build actions.
904
ba55b1cb 905Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d
LC
906standard setup, the daemon has write access to the store---the
907@file{/nix/store} directory---whereas users do not. The recommended
908setup also has the daemon perform builds in chroots, under a specific
909build users, to minimize interference with the rest of the system.
910
911@cindex derivation
912Lower-level APIs are available to interact with the daemon and the
913store. To instruct the daemon to perform a build action, users actually
914provide it with a @dfn{derivation}. A derivation is a low-level
915representation of the build actions to be taken, and the environment in
916which they should occur---derivations are to package definitions what
917assembly is to C programs.
918
919This chapter describes all these APIs in turn, starting from high-level
920package definitions.
921
568717fd 922@menu
b860f382
LC
923* Defining Packages:: Defining new packages.
924* The Store:: Manipulating the package store.
925* Derivations:: Low-level interface to package derivations.
926* The Store Monad:: Purely functional interface to the store.
568717fd
LC
927@end menu
928
929@node Defining Packages
930@section Defining Packages
931
3dc1970d
LC
932The high-level interface to package definitions is implemented in the
933@code{(guix packages)} and @code{(guix build-system)} modules. As an
934example, the package definition, or @dfn{recipe}, for the GNU Hello
935package looks like this:
936
937@example
b22a12fd
LC
938(use-modules (guix packages)
939 (guix download)
940 (guix build-system gnu)
941 (guix licenses))
942
3dc1970d
LC
943(define hello
944 (package
945 (name "hello")
946 (version "2.8")
947 (source (origin
948 (method url-fetch)
949 (uri (string-append "mirror://gnu/hello/hello-" version
950 ".tar.gz"))
951 (sha256
952 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
953 (build-system gnu-build-system)
954 (inputs `(("gawk" ,gawk)))
955 (synopsis "GNU Hello")
956 (description "Yeah...")
957 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 958 (license gpl3+)))
3dc1970d
LC
959@end example
960
961@noindent
962Without being a Scheme expert, the reader may have guessed the meaning
963of the various fields here. This expression binds variable @var{hello}
964to a @code{<package>} object, which is essentially a record
965(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
966This package object can be inspected using procedures found in the
967@code{(guix packages)} module; for instance, @code{(package-name hello)}
968returns---surprise!---@code{"hello"}.
969
970There are a few points worth noting in the above package definition:
971
972@itemize
973@item
974The @code{source} field of the package is an @code{<origin>} object.
975Here, the @code{url-fetch} method from @code{(guix download)} is used,
976meaning that the source is a file to be downloaded over FTP or HTTP.
977
978The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
979the GNU mirrors defined in @code{(guix download)}.
980
981The @code{sha256} field specifies the expected SHA256 hash of the file
982being downloaded. It is mandatory, and allows Guix to check the
983integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 984base32 representation of the hash. You can obtain this information with
210cc920
LC
985@code{guix download} (@pxref{Invoking guix download}) and @code{guix
986hash} (@pxref{Invoking guix hash}).
3dc1970d
LC
987
988@item
989@cindex GNU Build System
990The @code{build-system} field is set to @var{gnu-build-system}. The
991@var{gnu-build-system} variable is defined in the @code{(guix
992build-system gnu)} module, and is bound to a @code{<build-system>}
993object.
994
995Naturally, @var{gnu-build-system} represents the familiar GNU Build
996System, and variants thereof (@pxref{Configuration, configuration and
997makefile conventions,, standards, GNU Coding Standards}). In a
ba55b1cb 998nutshell, packages using the GNU Build System may be configured, built,
3dc1970d
LC
999and installed with the usual @code{./configure && make && make check &&
1000make install} command sequence. This is what @var{gnu-build-system}
1001does.
1002
1003In addition, @var{gnu-build-system} ensures that the ``standard''
1004environment for GNU packages is available. This includes tools such as
1005GCC, Coreutils, Bash, Make, Diffutils, and Patch.
1006
1007@item
1008The @code{inputs} field specifies inputs to the build process---i.e.,
1009build-time or run-time dependencies of the package. Here, we define an
1010input called @code{"gawk"} whose value is that of the @var{gawk}
1011variable; @var{gawk} is itself bound to a @code{<package>} object.
1012
1013Note that GCC, Coreutils, Bash, and other essential tools do not need to
1014be specified as inputs here. Instead, @var{gnu-build-system} takes care
1015of ensuring that they are present.
1016
1017However, any other dependencies need to be specified in the
1018@code{inputs} field. Any dependency not specified here will simply be
1019unavailable to the build process, possibly leading to a build failure.
1020@end itemize
1021
1022There are other fields that package definitions may provide. Of
1023particular interest is the @code{arguments} field. When specified, it
1024must be bound to a list of additional arguments to be passed to the
1025build system. For instance, the above definition could be augmented
1026with the following field initializer:
1027
1028@example
1029 (arguments `(#:tests? #f
1030 #:configure-flags '("--enable-silent-rules")))
1031@end example
1032
1033@noindent
1034These are keyword arguments (@pxref{Optional Arguments, keyword
1035arguments in Guile,, guile, GNU Guile Reference Manual}). They are
1036passed to @var{gnu-build-system}, which interprets them as meaning ``do
1037not run @code{make check}'', and ``run @file{configure} with the
874e6874
LC
1038@code{--enable-silent-rules} flag''. The value of these keyword
1039parameters is actually evaluated in the @dfn{build stratum}---i.e., by a
1040Guile process launched by the daemon (@pxref{Derivations}).
3dc1970d
LC
1041
1042Once a package definition is in place@footnote{Simple package
1043definitions like the one above may be automatically converted from the
e49951eb
MW
1044Nixpkgs distribution using the @command{guix import} command.}, the
1045package may actually be built using the @code{guix build} command-line
37166310
LC
1046tool (@pxref{Invoking guix build}). Eventually, updating the package
1047definition to a new upstream version can be partly automated by the
1048@command{guix refresh} command (@pxref{Invoking guix refresh}).
3dc1970d
LC
1049
1050Behind the scenes, a derivation corresponding to the @code{<package>}
1051object is first computed by the @code{package-derivation} procedure.
1052That derivation is stored in a @code{.drv} file under @file{/nix/store}.
ba55b1cb 1053The build actions it prescribes may then be realized by using the
3dc1970d
LC
1054@code{build-derivations} procedure (@pxref{The Store}).
1055
1056@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1057Return the @code{<derivation>} object of @var{package} for @var{system}
1058(@pxref{Derivations}).
3dc1970d
LC
1059
1060@var{package} must be a valid @code{<package>} object, and @var{system}
1061must be a string denoting the target system type---e.g.,
1062@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1063must be a connection to the daemon, which operates on the store
1064(@pxref{The Store}).
1065@end deffn
568717fd 1066
9c1edabd
LC
1067@noindent
1068@cindex cross-compilation
1069Similarly, it is possible to compute a derivation that cross-builds a
1070package for some other system:
1071
1072@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1073 @var{package} @var{target} [@var{system}]
59688fc4
LC
1074Return the @code{<derivation>} object of @var{package} cross-built from
1075@var{system} to @var{target}.
9c1edabd
LC
1076
1077@var{target} must be a valid GNU triplet denoting the target hardware
1078and operating system, such as @code{"mips64el-linux-gnu"}
1079(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1080Configure and Build System}).
1081@end deffn
1082
1083
568717fd
LC
1084@node The Store
1085@section The Store
1086
e531ac2a
LC
1087@cindex store
1088@cindex store paths
1089
1090Conceptually, the @dfn{store} is where derivations that have been
1091successfully built are stored---by default, under @file{/nix/store}.
1092Sub-directories in the store are referred to as @dfn{store paths}. The
1093store has an associated database that contains information such has the
1094store paths referred to by each store path, and the list of @emph{valid}
1095store paths---paths that result from a successful build.
1096
1097The store is always accessed by the daemon on behalf of its clients
1098(@pxref{Invoking guix-daemon}). To manipulate the store, clients
1099connect to the daemon over a Unix-domain socket, send it requests, and
1100read the result---these are remote procedure calls, or RPCs.
1101
1102The @code{(guix store)} module provides procedures to connect to the
1103daemon, and to perform RPCs. These are described below.
1104
1105@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
1106Connect to the daemon over the Unix-domain socket at @var{file}. When
1107@var{reserve-space?} is true, instruct it to reserve a little bit of
1108extra space on the file system so that the garbage collector can still
1109operate, should the disk become full. Return a server object.
1110
1111@var{file} defaults to @var{%default-socket-path}, which is the normal
1112location given the options that were passed to @command{configure}.
1113@end deffn
1114
1115@deffn {Scheme Procedure} close-connection @var{server}
1116Close the connection to @var{server}.
1117@end deffn
1118
1119@defvr {Scheme Variable} current-build-output-port
1120This variable is bound to a SRFI-39 parameter, which refers to the port
1121where build and error logs sent by the daemon should be written.
1122@end defvr
1123
1124Procedures that make RPCs all take a server object as their first
1125argument.
1126
1127@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
1128Return @code{#t} when @var{path} is a valid store path.
1129@end deffn
1130
cfbf9160 1131@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
1132Add @var{text} under file @var{name} in the store, and return its store
1133path. @var{references} is the list of store paths referred to by the
1134resulting store path.
1135@end deffn
1136
874e6874 1137@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
1138Build @var{derivations} (a list of @code{<derivation>} objects or
1139derivation paths), and return when the worker is done building them.
1140Return @code{#t} on success.
874e6874
LC
1141@end deffn
1142
b860f382
LC
1143Note that the @code{(guix monads)} module provides a monad as well as
1144monadic versions of the above procedures, with the goal of making it
1145more convenient to work with code that accesses the store (@pxref{The
1146Store Monad}).
1147
e531ac2a
LC
1148@c FIXME
1149@i{This section is currently incomplete.}
568717fd
LC
1150
1151@node Derivations
1152@section Derivations
1153
874e6874
LC
1154@cindex derivations
1155Low-level build actions and the environment in which they are performed
1156are represented by @dfn{derivations}. A derivation contain the
1157following pieces of information:
1158
1159@itemize
1160@item
1161The outputs of the derivation---derivations produce at least one file or
1162directory in the store, but may produce more.
1163
1164@item
1165The inputs of the derivations, which may be other derivations or plain
1166files in the store (patches, build scripts, etc.)
1167
1168@item
1169The system type targeted by the derivation---e.g., @code{x86_64-linux}.
1170
1171@item
1172The file name of a build script in the store, along with the arguments
1173to be passed.
1174
1175@item
1176A list of environment variables to be defined.
1177
1178@end itemize
1179
1180@cindex derivation path
1181Derivations allow clients of the daemon to communicate build actions to
1182the store. They exist in two forms: as an in-memory representation,
1183both on the client- and daemon-side, and as files in the store whose
1184name end in @code{.drv}---these files are referred to as @dfn{derivation
1185paths}. Derivations paths can be passed to the @code{build-derivations}
1186procedure to perform the build actions they prescribe (@pxref{The
1187Store}).
1188
1189The @code{(guix derivations)} module provides a representation of
1190derivations as Scheme objects, along with procedures to create and
1191otherwise manipulate derivations. The lowest-level primitive to create
1192a derivation is the @code{derivation} procedure:
1193
858e9282 1194@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] [#:hash-mode #f] [#:inputs '()] [#:env-vars '()] [#:system (%current-system)] [#:references-graphs #f]
59688fc4
LC
1195Build a derivation with the given arguments, and return the resulting
1196@code{<derivation>} object.
874e6874
LC
1197
1198When @var{hash}, @var{hash-algo}, and @var{hash-mode} are given, a
1199@dfn{fixed-output derivation} is created---i.e., one whose result is
1200known in advance, such as a file download.
5b0c9d16 1201
858e9282 1202When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
1203name/store path pairs. In that case, the reference graph of each store
1204path is exported in the build environment in the corresponding file, in
1205a simple text format.
874e6874
LC
1206@end deffn
1207
1208@noindent
1209Here's an example with a shell script as its builder, assuming
1210@var{store} is an open connection to the daemon, and @var{bash} points
1211to a Bash executable in the store:
1212
1213@lisp
1214(use-modules (guix utils)
1215 (guix store)
1216 (guix derivations))
1217
59688fc4
LC
1218(let ((builder ; add the Bash script to the store
1219 (add-text-to-store store "my-builder.sh"
1220 "echo hello world > $out\n" '())))
1221 (derivation store "foo"
1222 bash `("-e" ,builder)
1223 #:env-vars '(("HOME" . "/homeless"))))
1224@result{} #<derivation /nix/store/@dots{}-foo.drv => /nix/store/@dots{}-foo>
874e6874
LC
1225@end lisp
1226
1227As can be guessed, this primitive is cumbersome to use directly. An
1228improved variant is @code{build-expression->derivation}, which allows
1229the caller to directly pass a Guile expression as the build script:
1230
858e9282 1231@deffn {Scheme Procedure} build-expression->derivation @var{store} @var{name} @var{system} @var{exp} @var{inputs} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] [#:env-vars '()] [#:modules '()] [#:references-graphs #f] [#:guile-for-build #f]
874e6874
LC
1232Return a derivation that executes Scheme expression @var{exp} as a
1233builder for derivation @var{name}. @var{inputs} must be a list of
1234@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
1235@code{"out"} is assumed. @var{modules} is a list of names of Guile
1236modules from the current search path to be copied in the store,
1237compiled, and made available in the load path during the execution of
1238@var{exp}---e.g., @code{((guix build utils) (guix build
1239gnu-build-system))}.
1240
1241@var{exp} is evaluated in an environment where @code{%outputs} is bound
1242to a list of output/path pairs, and where @code{%build-inputs} is bound
1243to a list of string/output-path pairs made from @var{inputs}.
1244Optionally, @var{env-vars} is a list of string pairs specifying the name
1245and value of environment variables visible to the builder. The builder
1246terminates by passing the result of @var{exp} to @code{exit}; thus, when
1247@var{exp} returns @code{#f}, the build is considered to have failed.
1248
1249@var{exp} is built using @var{guile-for-build} (a derivation). When
1250@var{guile-for-build} is omitted or is @code{#f}, the value of the
1251@code{%guile-for-build} fluid is used instead.
9c629a27 1252
858e9282 1253See the @code{derivation} procedure for the meaning of @var{references-graphs}.
874e6874
LC
1254@end deffn
1255
1256@noindent
1257Here's an example of a single-output derivation that creates a directory
1258containing one file:
1259
1260@lisp
1261(let ((builder '(let ((out (assoc-ref %outputs "out")))
1262 (mkdir out) ; create /nix/store/@dots{}-goo
1263 (call-with-output-file (string-append out "/test")
1264 (lambda (p)
1265 (display '(hello guix) p))))))
1266 (build-expression->derivation store "goo" (%current-system)
1267 builder '()))
1268
59688fc4 1269@result{} #<derivation /nix/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
1270@end lisp
1271
1272@cindex strata of code
1273Remember that the build expression passed to
1274@code{build-expression->derivation} is run by a separate Guile process
1275than the one that calls @code{build-expression->derivation}: it is run
1276by a Guile process launched by the daemon, typically in a chroot. So,
1277while there is a single language for both the @dfn{host} and the build
1278side, there are really two @dfn{strata} of code: the host-side, and the
1279build-side code@footnote{The term @dfn{stratum} in this context was
1280coined by Manuel Serrano et al. in the context of their work on Hop.}.
1281This distinction is important to keep in mind, notably when using
1282higher-level constructs such as @var{gnu-build-system} (@pxref{Defining
1283Packages}). For this reason, Guix modules that are meant to be used in
1284the build stratum are kept in the @code{(guix build @dots{})} name
1285space.
568717fd 1286
b860f382
LC
1287@node The Store Monad
1288@section The Store Monad
1289
1290@cindex monad
1291
1292The procedures that operate on the store described in the previous
1293sections all take an open connection to the build daemon as their first
1294argument. Although the underlying model is functional, they either have
1295side effects or depend on the current state of the store.
1296
1297The former is inconvenient: the connection to the build daemon has to be
1298carried around in all those functions, making it impossible to compose
1299functions that do not take that parameter with functions that do. The
1300latter can be problematic: since store operations have side effects
1301and/or depend on external state, they have to be properly sequenced.
1302
1303@cindex monadic values
1304@cindex monadic functions
1305This is where the @code{(guix monads)} module comes in. This module
1306provides a framework for working with @dfn{monads}, and a particularly
1307useful monad for our uses, the @dfn{store monad}. Monads are a
1308construct that allows two things: associating ``context'' with values
1309(in our case, the context is the store), and building sequences of
1310computations (here computations includes accesses to the store.) Values
1311in a monad---values that carry this additional context---are called
1312@dfn{monadic values}; procedures that return such values are called
1313@dfn{monadic procedures}.
1314
1315Consider this ``normal'' procedure:
1316
1317@example
1318(define (profile.sh store)
1319 ;; Return the name of a shell script in the store that
1320 ;; initializes the 'PATH' environment variable.
1321 (let* ((drv (package-derivation store coreutils))
1322 (out (derivation->output-path drv)))
1323 (add-text-to-store store "profile.sh"
1324 (format #f "export PATH=~a/bin" out))))
1325@end example
1326
1327Using @code{(guix monads)}, it may be rewritten as a monadic function:
1328
1329@example
1330(define (profile.sh)
1331 ;; Same, but return a monadic value.
1332 (mlet %store-monad ((bin (package-file coreutils "bin")))
1333 (text-file "profile.sh"
1334 (string-append "export PATH=" bin))))
1335@end example
1336
1337There are two things to note in the second version: the @code{store}
1338parameter is now implicit, and the monadic value returned by
1339@code{package-file}---a wrapper around @code{package-derivation} and
1340@code{derivation->output-path}---is @dfn{bound} using @code{mlet}
1341instead of plain @code{let}.
1342
1343Calling the monadic @code{profile.sh} has no effect. To get the desired
1344effect, one must use @code{run-with-store}:
1345
1346@example
1347(run-with-store (open-connection) (profile.sh))
1348@result{} /nix/store/...-profile.sh
1349@end example
1350
1351The main syntactic forms to deal with monads in general are described
1352below.
1353
1354@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
1355Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
1356in @var{monad}.
1357@end deffn
1358
1359@deffn {Scheme Syntax} return @var{val}
1360Return a monadic value that encapsulates @var{val}.
1361@end deffn
1362
1363@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
1364@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
1365procedure @var{mproc}@footnote{This operation is commonly referred to as
1366``bind'', but that name denotes an unrelated procedure in Guile. Thus
1367we use this somewhat cryptic symbol inherited from the Haskell
1368language.}.
1369@end deffn
1370
1371@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
1372 @var{body} ...
1373@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
1374 @var{body} ...
1375Bind the variables @var{var} to the monadic values @var{mval} in
1376@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
1377``normal'' value @var{val}, as per @code{let}.
1378
1379@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
1380(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
1381@end deffn
1382
1383The interface to the store monad provided by @code{(guix monads)} is as
1384follows.
1385
1386@defvr {Scheme Variable} %store-monad
1387The store monad. Values in the store monad encapsulate accesses to the
1388store. When its effect is needed, a value of the store monad must be
1389``evaluated'' by passing it to the @code{run-with-store} procedure (see
1390below.)
1391@end defvr
1392
1393@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
1394Run @var{mval}, a monadic value in the store monad, in @var{store}, an
1395open store connection.
1396@end deffn
1397
1398@deffn {Monadic Procedure} text-file @var{name} @var{text}
1399Return as a monadic value the absolute file name in the store of the file
1400containing @var{text}.
1401@end deffn
1402
1403@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
1404 [#:system (%current-system)] [#:output "out"] Return as a monadic
1405value in the absolute file name of @var{file} within the @var{output}
1406directory of @var{package}. When @var{file} is omitted, return the name
1407of the @var{output} directory of @var{package}.
1408@end deffn
1409
1410@deffn {Monadic Procedure} derivation-expression @var{name} @var{system} @
1411 @var{exp} @var{inputs} [#:outputs '("out")] [#:hash #f] @
1412 [#:hash-algo #f] [#:env-vars '()] [#:modules '()] @
1413 [#:references-graphs #f] [#:guile-for-build #f]
1414Monadic version of @code{build-expression->derivation}
1415(@pxref{Derivations}).
1416@end deffn
1417
1418@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
1419Monadic version of @code{package-derivation} (@pxref{Defining
1420Packages}).
1421@end deffn
1422
1423
568717fd
LC
1424@c *********************************************************************
1425@node Utilities
1426@chapter Utilities
1427
210cc920
LC
1428This section describes tools primarily targeted at developers and users
1429who write new package definitions. They complement the Scheme
1430programming interface of Guix in a convenient way.
1431
568717fd 1432@menu
37166310 1433* Invoking guix build:: Building packages from the command line.
210cc920 1434* Invoking guix download:: Downloading a file and printing its hash.
37166310
LC
1435* Invoking guix hash:: Computing the cryptographic hash of a file.
1436* Invoking guix refresh:: Updating package definitions.
568717fd
LC
1437@end menu
1438
e49951eb
MW
1439@node Invoking guix build
1440@section Invoking @command{guix build}
568717fd 1441
e49951eb 1442The @command{guix build} command builds packages or derivations and
6798a8e4
LC
1443their dependencies, and prints the resulting store paths. Note that it
1444does not modify the user's profile---this is the job of the
e49951eb 1445@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
1446it is mainly useful for distribution developers.
1447
1448The general syntax is:
c78bd12b
LC
1449
1450@example
e49951eb 1451guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
1452@end example
1453
1454@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
1455the software distribution such as @code{coreutils} or
1456@code{coreutils-8.20}, or a derivation such as
1457@file{/nix/store/@dots{}-coreutils-8.19.drv}. Alternatively, the
c78bd12b
LC
1458@code{--expression} option may be used to specify a Scheme expression
1459that evaluates to a package; this is useful when disambiguation among
1460several same-named packages or package variants is needed.
1461
1462The @var{options} may be zero or more of the following:
1463
1464@table @code
1465
1466@item --expression=@var{expr}
1467@itemx -e @var{expr}
1468Build the package @var{expr} evaluates to.
1469
5401dd75 1470For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
1471guile-1.8)}, which unambiguously designates this specific variant of
1472version 1.8 of Guile.
1473
1474@item --source
1475@itemx -S
1476Build the packages' source derivations, rather than the packages
1477themselves.
1478
e49951eb 1479For instance, @code{guix build -S gcc} returns something like
6798a8e4 1480@file{/nix/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b
LC
1481
1482@item --system=@var{system}
1483@itemx -s @var{system}
1484Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
1485the host's system type.
1486
1487An example use of this is on Linux-based systems, which can emulate
1488different personalities. For instance, passing
1489@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
1490to build packages in a complete 32-bit environment.
1491
e55ec43d
LC
1492@item --target=@var{triplet}
1493@cindex cross-compilation
1494Cross-build for @var{triplet}, which must be a valid GNU triplet, such
1495as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
1496configuration triplets,, configure, GNU Configure and Build System}).
1497
c78bd12b
LC
1498@item --derivations
1499@itemx -d
1500Return the derivation paths, not the output paths, of the given
1501packages.
1502
1503@item --keep-failed
1504@itemx -K
1505Keep the build tree of failed builds. Thus, if a build fail, its build
1506tree is kept under @file{/tmp}, in a directory whose name is shown at
1507the end of the build log. This is useful when debugging build issues.
1508
1509@item --dry-run
1510@itemx -n
1511Do not build the derivations.
1512
56b1f4b7
LC
1513@item --fallback
1514When substituting a pre-built binary fails, fall back to building
1515packages locally.
1516
c78bd12b
LC
1517@item --no-substitutes
1518Build instead of resorting to pre-built substitutes.
1519
969e678e
LC
1520@item --max-silent-time=@var{seconds}
1521When the build or substitution process remains silent for more than
1522@var{seconds}, terminate it and report a build failure.
1523
c78bd12b
LC
1524@item --cores=@var{n}
1525@itemx -c @var{n}
1526Allow the use of up to @var{n} CPU cores for the build. The special
1527value @code{0} means to use as many CPU cores as available.
1528
1529@item --root=@var{file}
1530@itemx -r @var{file}
1531Make @var{file} a symlink to the result, and register it as a garbage
1532collector root.
07ab4bf1
LC
1533
1534@item --verbosity=@var{level}
1535Use the given verbosity level. @var{level} must be an integer between 0
1536and 5; higher means more verbose output. Setting a level of 4 or more
1537may be helpful when debugging setup issues with the build daemon.
1538
c78bd12b
LC
1539@end table
1540
e49951eb 1541Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
1542the @code{package-derivation} procedure of the @code{(guix packages)}
1543module, and to the @code{build-derivations} procedure of the @code{(guix
1544store)} module.
1545
210cc920
LC
1546@node Invoking guix download
1547@section Invoking @command{guix download}
1548
1549When writing a package definition, developers typically need to download
1550the package's source tarball, compute its SHA256 hash, and write that
1551hash in the package definition (@pxref{Defining Packages}). The
1552@command{guix download} tool helps with this task: it downloads a file
1553from the given URI, adds it to the store, and prints both its file name
1554in the store and its SHA256 hash.
1555
1556The fact that the downloaded file is added to the store saves bandwidth:
1557when the developer eventually tries to build the newly defined package
1558with @command{guix build}, the source tarball will not have to be
1559downloaded again because it is already in the store. It is also a
1560convenient way to temporarily stash files, which may be deleted
1561eventually (@pxref{Invoking guix gc}).
1562
1563The @command{guix download} command supports the same URIs as used in
1564package definitions. In particular, it supports @code{mirror://} URIs.
1565@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
1566Guile bindings for GnuTLS are available in the user's environment; when
1567they are not available, an error is raised.
1568
1569The following option is available:
1570
1571@table @code
1572@item --format=@var{fmt}
1573@itemx -f @var{fmt}
1574Write the hash in the format specified by @var{fmt}. For more
1575information on the valid values for @var{fmt}, @ref{Invoking guix hash}.
1576@end table
1577
6c365eca
NK
1578@node Invoking guix hash
1579@section Invoking @command{guix hash}
1580
210cc920 1581The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
1582It is primarily a convenience tool for anyone contributing to the
1583distribution: it computes the cryptographic hash of a file, which can be
1584used in the definition of a package (@pxref{Defining Packages}).
1585
1586The general syntax is:
1587
1588@example
1589guix hash @var{option} @var{file}
1590@end example
1591
1592@command{guix hash} has the following option:
1593
1594@table @code
1595
1596@item --format=@var{fmt}
1597@itemx -f @var{fmt}
210cc920 1598Write the hash in the format specified by @var{fmt}.
6c365eca
NK
1599
1600Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
1601(@code{hex} and @code{hexadecimal} can be used as well).
1602
1603If the @option{--format} option is not specified, @command{guix hash}
1604will output the hash in @code{nix-base32}. This representation is used
1605in the definitions of packages.
1606
1607@end table
1608
37166310
LC
1609@node Invoking guix refresh
1610@section Invoking @command{guix refresh}
1611
1612The primary audience of the @command{guix refresh} command is developers
1613of the GNU software distribution. By default, it reports any packages
1614provided by the distribution that are outdated compared to the latest
1615upstream version, like this:
1616
1617@example
1618$ guix refresh
1619gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
1620gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
1621@end example
1622
1623It does so by browsing each package's FTP directory and determining the
1624highest version number of the source tarballs
1625therein@footnote{Currently, this only works for GNU packages.}.
1626
1627When passed @code{--update}, it modifies distribution source files to
1628update the version numbers and source tarball hashes of those packages'
1629recipes (@pxref{Defining Packages}). This is achieved by downloading
1630each package's latest source tarball and its associated OpenPGP
1631signature, authenticating the downloaded tarball against its signature
1632using @command{gpg}, and finally computing its hash. When the public
1633key used to sign the tarball is missing from the user's keyring, an
1634attempt is made to automatically retrieve it from a public key server;
1635when it's successful, the key is added to the user's keyring; otherwise,
1636@command{guix refresh} reports an error.
1637
1638The following options are supported:
1639
1640@table @code
1641
1642@item --update
1643@itemx -u
1644Update distribution source files (package recipes) in place.
1645@ref{Defining Packages}, for more information on package definitions.
1646
1647@item --select=[@var{subset}]
1648@itemx -s @var{subset}
1649Select all the packages in @var{subset}, one of @code{core} or
1650@code{non-core}.
1651
1652The @code{core} subset refers to all the packages at the core of the
1653distribution---i.e., packages that are used to build ``everything
1654else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
1655changing one of these packages in the distribution entails a rebuild of
1656all the others. Thus, such updates are an inconvenience to users in
1657terms of build time or bandwidth used to achieve the upgrade.
1658
1659The @code{non-core} subset refers to the remaining packages. It is
1660typically useful in cases where an update of the core packages would be
1661inconvenient.
1662
1663@end table
1664
1665In addition, @command{guix refresh} can be passed one or more package
1666names, as in this example:
1667
1668@example
1669guix refresh -u emacs idutils
1670@end example
1671
1672@noindent
1673The command above specifically updates the @code{emacs} and
1674@code{idutils} packages. The @code{--select} option would have no
1675effect in this case.
1676
f9230085
LC
1677The following options can be used to customize GnuPG operation:
1678
1679@table @code
1680
1681@item --key-server=@var{host}
1682Use @var{host} as the OpenPGP key server when importing a public key.
1683
1684@item --gpg=@var{command}
1685Use @var{command} as the GnuPG 2.x command. @var{command} is searched
1686for in @code{$PATH}.
1687
1688@end table
1689
37166310 1690
a1ba8475
LC
1691@c *********************************************************************
1692@node GNU Distribution
1693@chapter GNU Distribution
1694
1695Guix comes with a distribution of free software@footnote{The term
1696``free'' here refers to the
1697@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
1698users of that software}.} that form the basis of the GNU system. This
1699includes core GNU packages such as GNU libc, GCC, and Binutils, as well
1700as many GNU and non-GNU applications. The complete list of available
e49951eb
MW
1701packages can be seen by running @command{guix package} (@pxref{Invoking
1702guix package}):
a1ba8475
LC
1703
1704@example
e49951eb 1705guix package --list-available
a1ba8475
LC
1706@end example
1707
401c53c4
LC
1708Our goal is to build a practical 100% free software distribution of
1709Linux-based and other variants of GNU, with a focus on the promotion and
1710tight integration of GNU components, and an emphasis on programs and
1711tools that help users exert that freedom.
1712
1713@menu
91ef73d4 1714* Installing Debugging Files:: Feeding the debugger.
401c53c4 1715* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 1716* Packaging Guidelines:: Growing the distribution.
401c53c4 1717* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 1718* Porting:: Targeting another platform or kernel.
401c53c4
LC
1719@end menu
1720
1721Building this distribution is a cooperative effort, and you are invited
1722to join! @ref{Contributing}, for information about how you can help.
1723
b208a005 1724
91ef73d4
LC
1725@node Installing Debugging Files
1726@section Installing Debugging Files
1727
1728Program binaries, as produced by the GCC compilers for instance, are
1729typically written in the ELF format, with a section containing
1730@dfn{debugging information}. Debugging information is what allows the
1731debugger, GDB, to map binary code to source code; it is required to
1732debug a compiled program in good conditions.
1733
1734The problem with debugging information is that is takes up a fair amount
1735of disk space. For example, debugging information for the GNU C Library
1736weighs in at more than 60 MiB. Thus, as a user, keeping all the
1737debugging info of all the installed programs is usually not an option.
1738Yet, space savings should not come at the cost of an impediment to
1739debugging---especially in the GNU system, which should make it easier
1740for users to exert their computing freedom (@pxref{GNU Distribution}).
1741
1742Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
1743mechanism that allows users to get the best of both worlds: debugging
1744information can be stripped from the binaries and stored in separate
1745files. GDB is then able to load debugging information from those files,
1746when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
1747with GDB}).
1748
1749The GNU distribution takes advantage of this by storing debugging
1750information in the @code{lib/debug} sub-directory of a separate package
1751output unimaginatively called @code{debug} (@pxref{Packages with
1752Multiple Outputs}). Users can choose to install the @code{debug} output
1753of a package when they need it. For instance, the following command
1754installs the debugging information for the GNU C Library and for GNU
1755Guile:
1756
1757@example
1758guix package -i glibc:debug -i guile:debug
1759@end example
1760
1761GDB must then be told to look for debug files in the user's profile, by
1762setting the @code{debug-file-directory} variable (consider setting it
1763from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
1764GDB}):
1765
1766@example
1767(gdb) set debug-file-directory ~/.guix-profile/lib/debug
1768@end example
1769
1770From there on, GDB will pick up debugging information from the
1771@code{.debug} files under @file{~/.guix-profile/lib/debug}.
1772
1773@c XXX: keep me up-to-date
1774The @code{debug} output mechanism in Guix is implemented by the
1775@code{gnu-build-system} (@pxref{Defining Packages}). Currently, it is
1776opt-in---debugging information is available only for those packages
1777whose definition explicitly declares a @code{debug} output. This may be
1778changed to opt-out in the future, if our build farm servers can handle
1779the load. To check whether a package has a @code{debug} output, use
1780@command{guix package --list-available} (@pxref{Invoking guix package}).
1781
1782
401c53c4
LC
1783@node Package Modules
1784@section Package Modules
1785
1786From a programming viewpoint, the package definitions of the
1787distribution are provided by Guile modules in the @code{(gnu packages
b81e1947
LC
1788...)} name space (@pxref{Modules, Guile modules,, guile, GNU Guile
1789Reference Manual}). For instance, the @code{(gnu packages emacs)}
1790module exports a variable named @code{emacs}, which is bound to a
401c53c4
LC
1791@code{<package>} object (@pxref{Defining Packages}). The @code{(gnu
1792packages)} module provides facilities for searching for packages.
a1ba8475
LC
1793
1794The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
1795each package is built based solely on other packages in the
1796distribution. The root of this dependency graph is a small set of
1797@dfn{bootstrap binaries}, provided by the @code{(gnu packages
b81e1947
LC
1798bootstrap)} module. For more information on bootstrapping,
1799@ref{Bootstrapping}.
1800
da7cabd4
AE
1801@node Packaging Guidelines
1802@section Packaging Guidelines
b81e1947
LC
1803
1804The GNU distribution is nascent and may well lack some of your favorite
1805packages. This section describes how you can help make the distribution
c8c871d1 1806grow. @xref{Contributing}, for additional information on how you can
b81e1947
LC
1807help.
1808
b81e1947
LC
1809Free software packages are usually distributed in the form of
1810@dfn{source code tarballs}---typically @file{tar.gz} files that contain
1811all the source files. Adding a package to the distribution means
1812essentially two things: adding a @dfn{recipe} that describes how to
1813build the package, including a list of other packages required to build
1814it, and adding @dfn{package meta-data} along with that recipe, such as a
1815description and licensing information.
1816
1817In Guix all this information is embodied in @dfn{package definitions}.
1818Package definitions provide a high-level view of the package. They are
1819written using the syntax of the Scheme programming language; in fact,
1820for each package we define a variable bound to the package definition,
1821and export that variable from a module (@pxref{Package Modules}).
1822However, in-depth Scheme knowledge is @emph{not} a prerequisite for
1823creating packages. For more information on package definitions,
1824@ref{Defining Packages}.
1825
1826Once a package definition is in place, stored in a file in the Guix
1827source tree, it can be tested using the @command{guix build} command
1828(@pxref{Invoking guix build}). For example, assuming the new package is
1829called @code{gnew}, you may run this command from the Guix build tree:
1830
1831@example
1832./pre-inst-env guix build gnew --keep-failed
1833@end example
1834
1835Using @code{--keep-failed} makes it easier to debug build failures since
1836it provides access to the failed build tree.
1837
1838Once your package builds correctly, please send us a patch
1839(@pxref{Contributing}). Well, if you need help, we will be happy to
1840help you too. Once the patch is committed in the Guix repository, the
1841new package automatically gets built on the supported platforms by
1842@url{http://hydra.gnu.org/gnu/master, our continuous integration
1843system}.
1844
1845@cindex substituter
1846Users can obtain the new package definition simply by running
1847@command{guix pull} (@pxref{Invoking guix pull}). When
1848@code{hydra.gnu.org} is done building the package, installing the
1849package automatically downloads binaries from there (except when using
1850@code{--no-substitutes}). The only place where human intervention is
1851needed is to review and apply the patch.
401c53c4
LC
1852
1853
da7cabd4 1854@menu
ee85f3db
AE
1855* Software Freedom:: What may go into the distribution.
1856* Package Naming:: What's in a name?
1857* Version Numbers:: When the name is not enough.
1858* Python Modules:: Taming the snake.
da7cabd4
AE
1859@end menu
1860
1861@node Software Freedom
1862@subsection Software Freedom
1863
1864@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
1865
1866The GNU operating system has been developed so that users can have
1867freedom in their computing. GNU is @dfn{free software}, meaning that
1868users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
1869essential freedoms}: to run the program, to study and change the program
1870in source code form, to redistribute exact copies, and to distribute
1871modified versions. Packages found in the GNU distribution provide only
1872software that conveys these four freedoms.
1873
1874In addition, the GNU distribution follow the
1875@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
1876software distribution guidelines}. Among other things, these guidelines
1877reject non-free firmware, recommendations of non-free software, and
1878discuss ways to deal with trademarks and patents.
1879
1880
ee85f3db
AE
1881@node Package Naming
1882@subsection Package Naming
1883
c8c871d1 1884A package has actually two names associated with it:
ee85f3db 1885First, there is the name of the @emph{Scheme variable}, the one following
c8c871d1
AE
1886@code{define-public}. By this name, the package can be made known in the
1887Scheme code, for instance as input to another package. Second, there is
1888the string in the @code{name} field of a package definition. This name
1889is used by package management commands such as
1890@command{guix package} and @command{guix build}.
ee85f3db
AE
1891
1892Both are usually the same and correspond to the lowercase conversion of the
c8c871d1
AE
1893project name chosen upstream. For instance, the GNUnet project is packaged
1894as @code{gnunet}. We do not add @code{lib} prefixes for library packages,
1895unless these are already part of the official project name. But see
1896@ref{Python Modules} for special rules concerning modules for
ee85f3db
AE
1897the Python language.
1898
1899
1900@node Version Numbers
1901@subsection Version Numbers
1902
1903We usually package only the latest version of a given free software
c8c871d1
AE
1904project. But sometimes, for instance for incompatible library versions,
1905two (or more) versions of the same package are needed. These require
1906different Scheme variable names. We use the name as defined
1907in @ref{Package Naming}
ee85f3db
AE
1908for the most recent version; previous versions use the same name, suffixed
1909by @code{-} and the smallest prefix of the version number that may
1910distinguish the two versions.
1911
1912The name inside the package definition is the same for all versions of a
1913package and does not contain any version number.
1914
1915For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
c8c871d1 1916
ee85f3db
AE
1917@example
1918(define-public gtk+
1919 (package
1920 (name "gtk+")
1921 (version "3.9.12")
1922 ...))
1923(define-public gtk+-2
1924 (package
1925 (name "gtk+")
1926 (version "2.24.20")
1927 ...))
1928@end example
1929If we also wanted GTK+ 3.8.2, this would be packaged as
1930@example
1931(define-public gtk+-3.8
1932 (package
1933 (name "gtk+")
1934 (version "3.8.2")
1935 ...))
1936@end example
1937
1938
1939@node Python Modules
1940@subsection Python Modules
1941
1942We currently package Python 2 and Python 3, under the Scheme variable names
1943@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
1944To avoid confusion and naming clashes with other programming languages, it
1945seems desirable that the name of a package for a Python module contains
1946the word @code{python}.
c8c871d1 1947
ee85f3db
AE
1948Some modules are compatible with only one version of Python, others with both.
1949If the package Foo compiles only with Python 3, we name it
1950@code{python-foo}; if it compiles only with Python 2, we name it
1951@code{python2-foo}. If it is compatible with both versions, we create two
1952packages with the corresponding names.
1953
1954If a project already contains the word @code{python}, we drop this;
1955for instance, the module python-dateutil is packaged under the names
1956@code{python-dateutil} and @code{python2-dateutil}.
1957
1958
1959
1960
1961
401c53c4
LC
1962@node Bootstrapping
1963@section Bootstrapping
1964
1965@c Adapted from the ELS 2013 paper.
1966
1967@cindex bootstrapping
1968
1969Bootstrapping in our context refers to how the distribution gets built
1970``from nothing''. Remember that the build environment of a derivation
1971contains nothing but its declared inputs (@pxref{Introduction}). So
1972there's an obvious chicken-and-egg problem: how does the first package
1973get built? How does the first compiler get compiled? Note that this is
1974a question of interest only to the curious hacker, not to the regular
1975user, so you can shamelessly skip this section if you consider yourself
1976a ``regular user''.
1977
1978@cindex bootstrap binaries
1979The GNU system is primarily made of C code, with libc at its core. The
1980GNU build system itself assumes the availability of a Bourne shell and
1981command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
1982`grep'. Furthermore, build programs---programs that run
1983@code{./configure}, @code{make}, etc.---are written in Guile Scheme
1984(@pxref{Derivations}). Consequently, to be able to build anything at
1985all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
1986Binutils, libc, and the other packages mentioned above---the
1987@dfn{bootstrap binaries}.
1988
1989These bootstrap binaries are ``taken for granted'', though we can also
ba7ea5ce 1990re-create them if needed (more on that later).
401c53c4
LC
1991
1992@unnumberedsubsec Preparing to Use the Bootstrap Binaries
1993
1994@c As of Emacs 24.3, Info-mode displays the image, but since it's a
1995@c large image, it's hard to scroll. Oh well.
29f66ddd 1996@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
401c53c4
LC
1997
1998The figure above shows the very beginning of the dependency graph of the
1999distribution, corresponding to the package definitions of the @code{(gnu
2000packages bootstrap)} module. At this level of detail, things are
2001slightly complex. First, Guile itself consists of an ELF executable,
2002along with many source and compiled Scheme files that are dynamically
2003loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
2004tarball shown in this graph. This tarball is part of Guix's ``source''
2005distribution, and gets inserted into the store with @code{add-to-store}
2006(@pxref{The Store}).
a1ba8475 2007
401c53c4
LC
2008But how do we write a derivation that unpacks this tarball and adds it
2009to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
2010derivation---the first one that gets built---uses @code{bash} as its
2011builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
2012@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
2013@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
2014the Guix source distribution, whose sole purpose is to allow the Guile
2015tarball to be unpacked.
2016
2017Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
2018Guile that can be used to run subsequent build programs. Its first task
2019is to download tarballs containing the other pre-built binaries---this
2020is what the @code{.tar.xz.drv} derivations do. Guix modules such as
2021@code{ftp-client.scm} are used for this purpose. The
2022@code{module-import.drv} derivations import those modules in a directory
2023in the store, using the original layout. The
2024@code{module-import-compiled.drv} derivations compile those modules, and
2025write them in an output directory with the right layout. This
2026corresponds to the @code{#:modules} argument of
2027@code{build-expression->derivation} (@pxref{Derivations}).
2028
2029Finally, the various tarballs are unpacked by the
2030derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
2031etc., at which point we have a working C tool chain.
2032
2033
2034@unnumberedsubsec Building the Build Tools
2035
2036@c TODO: Add a package-level dependency graph generated from (gnu
2037@c packages base).
2038
2039Bootstrapping is complete when we have a full tool chain that does not
2040depend on the pre-built bootstrap tools discussed above. This
2041no-dependency requirement is verified by checking whether the files of
2042the final tool chain contain references to the @file{/nix/store}
2043directories of the bootstrap inputs. The process that leads to this
2044``final'' tool chain is described by the package definitions found in
2045the @code{(gnu packages base)} module.
2046
2047@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
2048The first tool that gets built with the bootstrap binaries is
2049GNU Make, which is a prerequisite for all the following packages.
2050From there Findutils and Diffutils get built.
2051
2052Then come the first-stage Binutils and GCC, built as pseudo cross
2053tools---i.e., with @code{--target} equal to @code{--host}. They are
2054used to build libc. Thanks to this cross-build trick, this libc is
2055guaranteed not to hold any reference to the initial tool chain.
2056
2057From there the final Binutils and GCC are built. GCC uses @code{ld}
2058from the final Binutils, and links programs against the just-built libc.
2059This tool chain is used to build the other packages used by Guix and by
2060the GNU Build System: Guile, Bash, Coreutils, etc.
2061
2062And voilà! At this point we have the complete set of build tools that
2063the GNU Build System expects. These are in the @code{%final-inputs}
2064variables of the @code{(gnu packages base)} module, and are implicitly
2065used by any package that uses @code{gnu-build-system} (@pxref{Defining
2066Packages}).
2067
2068
2069@unnumberedsubsec Building the Bootstrap Binaries
2070
2071Because the final tool chain does not depend on the bootstrap binaries,
2072those rarely need to be updated. Nevertheless, it is useful to have an
2073automated way to produce them, should an update occur, and this is what
2074the @code{(gnu packages make-bootstrap)} module provides.
2075
2076The following command builds the tarballs containing the bootstrap
2077binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
2078of Coreutils and other basic command-line tools):
a1ba8475 2079
401c53c4
LC
2080@example
2081guix build bootstrap-tarballs
2082@end example
2083
2084The generated tarballs are those that should be referred to in the
2085@code{(gnu packages bootstrap)} module mentioned at the beginning of
2086this section.
2087
2088Still here? Then perhaps by now you've started to wonder: when do we
2089reach a fixed point? That is an interesting question! The answer is
2090unknown, but if you would like to investigate further (and have
2091significant computational and storage resources to do so), then let us
2092know.
a1ba8475 2093
8b315a6d
LC
2094@node Porting
2095@section Porting to a New Platform
2096
2097As discussed above, the GNU distribution is self-contained, and
2098self-containment is achieved by relying on pre-built ``bootstrap
2099binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
2100operating system kernel, CPU architecture, and application binary
2101interface (ABI). Thus, to port the distribution to a platform that is
2102not yet supported, one must build those bootstrap binaries, and update
2103the @code{(gnu packages bootstrap)} module to use them on that platform.
2104
2105Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
2106When everything goes well, and assuming the GNU tool chain supports the
2107target platform, this can be as simple as running a command like this
2108one:
2109
2110@example
2111guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
2112@end example
2113
2114In practice, there may be some complications. First, it may be that the
2115extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
2116above) is not recognized by all the GNU tools. Typically, glibc
2117recognizes some of these, whereas GCC uses an extra @code{--with-abi}
ba7ea5ce 2118configure flag (see @code{gcc.scm} for examples of how to handle this).
8b315a6d
LC
2119Second, some of the required packages could fail to build for that
2120platform. Lastly, the generated binaries could be broken for some
2121reason.
2122
9bf3c1a7
LC
2123
2124@c *********************************************************************
2125@node Contributing
2126@chapter Contributing
2127
2128This project is a cooperative effort, and we need your help to make it
63f6004b 2129grow! Please get in touch with us on @email{guix-devel@@gnu.org}. We
a1ba8475 2130welcome ideas, bug reports, patches, and anything that may be helpful to
da7cabd4
AE
2131the project. We particularly welcome help on packaging
2132(@pxref{Packaging Guidelines}).
a1ba8475 2133
9bf3c1a7
LC
2134Please see the
2135@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
2136@file{HACKING} file} that comes with the Guix source code for practical
2137details about contributions.
2138
c78bd12b 2139
568717fd
LC
2140@c *********************************************************************
2141@node Acknowledgments
2142@chapter Acknowledgments
2143
2144Guix is based on the Nix package manager, which was designed and
2145implemented by Eelco Dolstra. Nix pioneered functional package
2146management, and promoted unprecedented features, such as transactional
2147package upgrades and rollbacks, per-user profiles, and referentially
2148transparent build processes. Without this work, Guix would not exist.
2149
2150The Nix-based software distributions, Nixpkgs and NixOS, have also been
2151an inspiration for Guix.
2152
2153@c *********************************************************************
2154@node GNU Free Documentation License
2155@appendix GNU Free Documentation License
2156
2157@include fdl-1.3.texi
2158
2159@c *********************************************************************
2160@node Concept Index
2161@unnumbered Concept Index
2162@printindex cp
2163
2164@node Function Index
2165@unnumbered Function Index
2166@printindex fn
2167
2168@bye
2169
2170@c Local Variables:
2171@c ispell-local-dictionary: "american";
2172@c End: