profiles: Add 'packages->manifest' procedure.
[jackhill/guix/guix.git] / doc / guix.texi
CommitLineData
568717fd
LC
1\input texinfo
2@c -*-texinfo-*-
3
4@c %**start of header
5@setfilename guix.info
6@documentencoding UTF-8
f8348b91 7@settitle GNU Guix Reference Manual
568717fd
LC
8@c %**end of header
9
10@include version.texi
7df7a74e
NK
11
12@copying
4379c35b 13Copyright @copyright{} 2012, 2013, 2014, 2015 Ludovic Courtès@*
af8a56b8 14Copyright @copyright{} 2013, 2014 Andreas Enge@*
87eafdbd
TUBK
15Copyright @copyright{} 2013 Nikita Karetnikov@*
16Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer
7df7a74e
NK
17
18Permission is granted to copy, distribute and/or modify this document
19under the terms of the GNU Free Documentation License, Version 1.3 or
20any later version published by the Free Software Foundation; with no
21Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
22copy of the license is included in the section entitled ``GNU Free
23Documentation License''.
24@end copying
568717fd 25
eeaf4427 26@dircategory Package management
568717fd
LC
27@direntry
28* guix: (guix). Guix, the functional package manager.
e49951eb 29* guix package: (guix)Invoking guix package
eeaf4427 30 Managing packages with Guix.
e49951eb 31* guix build: (guix)Invoking guix build
568717fd 32 Building packages with Guix.
054e8576
LC
33* guix system: (guix)Invoking guix system
34 Managing the operating system configuration.
568717fd 35@end direntry
568717fd 36
372c4bbc
DT
37@dircategory Software development
38@direntry
39* guix environment: (guix)Invoking guix environment
40 Building development environments with Guix.
41@end direntry
42
568717fd 43@titlepage
7730d112
LC
44@title GNU Guix Reference Manual
45@subtitle Using the GNU Guix Functional Package Manager
568717fd 46@author Ludovic Courtès
da7cabd4 47@author Andreas Enge
acc08466 48@author Nikita Karetnikov
568717fd
LC
49
50@page
51@vskip 0pt plus 1filll
52Edition @value{EDITION} @*
53@value{UPDATED} @*
54
7df7a74e 55@insertcopying
568717fd
LC
56@end titlepage
57
568717fd
LC
58@contents
59
60@c *********************************************************************
61@node Top
f8348b91 62@top GNU Guix
568717fd 63
f8348b91
LC
64This document describes GNU Guix version @value{VERSION}, a functional
65package management tool written for the GNU system.
568717fd
LC
66
67@menu
68* Introduction:: What is Guix about?
bd5e766b 69* Installation:: Installing Guix.
eeaf4427 70* Package Management:: Package installation, upgrade, etc.
568717fd
LC
71* Programming Interface:: Using Guix in Scheme.
72* Utilities:: Package management commands.
a1ba8475 73* GNU Distribution:: Software for your friendly GNU system.
9bf3c1a7 74* Contributing:: Your help needed!
568717fd
LC
75
76* Acknowledgments:: Thanks!
77* GNU Free Documentation License:: The license of this manual.
78* Concept Index:: Concepts.
a85b83d2 79* Programming Index:: Data types, functions, and variables.
aaa3eaa9
LC
80
81@detailmenu
82 --- The Detailed Node Listing ---
83
84Installation
85
1b2b8177 86* Binary Installation:: Getting Guix running in no time!
aaa3eaa9 87* Requirements:: Software needed to build and run Guix.
ec0339cd 88* Running the Test Suite:: Testing Guix.
aaa3eaa9
LC
89* Setting Up the Daemon:: Preparing the build daemon's environment.
90* Invoking guix-daemon:: Running the build daemon.
91
92Setting Up the Daemon
93
94* Build Environment Setup:: Preparing the isolated build environment.
95* Daemon Offload Setup:: Offloading builds to remote machines.
96
97Package Management
98
99* Features:: How Guix will make your life brighter.
100* Invoking guix package:: Package installation, removal, etc.
101* Emacs Interface:: Package management from Emacs.
102* Substitutes:: Downloading pre-built binaries.
103* Packages with Multiple Outputs:: Single source package, multiple outputs.
104* Invoking guix gc:: Running the garbage collector.
105* Invoking guix pull:: Fetching the latest Guix and distribution.
106* Invoking guix archive:: Exporting and importing store files.
107
108Programming Interface
109
110* Defining Packages:: Defining new packages.
111* Build Systems:: Specifying how packages are built.
112* The Store:: Manipulating the package store.
113* Derivations:: Low-level interface to package derivations.
114* The Store Monad:: Purely functional interface to the store.
115* G-Expressions:: Manipulating build expressions.
116
117Utilities
118
119* Invoking guix build:: Building packages from the command line.
120* Invoking guix download:: Downloading a file and printing its hash.
121* Invoking guix hash:: Computing the cryptographic hash of a file.
122* Invoking guix import:: Importing package definitions.
123* Invoking guix refresh:: Updating package definitions.
124* Invoking guix lint:: Finding errors in package definitions.
125* Invoking guix environment:: Setting up development environments.
aff8ce7c 126* Invoking guix publish:: Sharing substitutes.
aaa3eaa9
LC
127
128GNU Distribution
129
130* System Installation:: Installing the whole operating system.
35ed9306 131* System Configuration:: Configuring the operating system.
aaa3eaa9
LC
132* Installing Debugging Files:: Feeding the debugger.
133* Security Updates:: Deploying security fixes quickly.
134* Package Modules:: Packages from the programmer's viewpoint.
135* Packaging Guidelines:: Growing the distribution.
136* Bootstrapping:: GNU/Linux built from scratch.
137* Porting:: Targeting another platform or kernel.
138
139System Configuration
140
141* Using the Configuration System:: Customizing your GNU system.
142* operating-system Reference:: Detail of operating-system declarations.
143* File Systems:: Configuring file system mounts.
144* Mapped Devices:: Block device extra processing.
145* User Accounts:: Specifying user accounts.
598e19dc 146* Locales:: Language and cultural convention settings.
aaa3eaa9
LC
147* Services:: Specifying system services.
148* Setuid Programs:: Programs running with root privileges.
1b2b8177 149* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 150* Name Service Switch:: Configuring libc's name service switch.
aaa3eaa9
LC
151* Initial RAM Disk:: Linux-Libre bootstrapping.
152* GRUB Configuration:: Configuring the boot loader.
153* Invoking guix system:: Instantiating a system configuration.
154* Defining Services:: Adding new service definitions.
155
156Services
157
158* Base Services:: Essential system services.
159* Networking Services:: Network setup, SSH daemon, etc.
160* X Window:: Graphical display.
1b2b8177
LC
161* Desktop Services:: D-Bus and desktop services.
162* Database Services:: SQL databases.
aa4ed923 163* Various Services:: Other services.
aaa3eaa9
LC
164
165Packaging Guidelines
166
ec0339cd
LC
167* Software Freedom:: What may go into the distribution.
168* Package Naming:: What's in a name?
169* Version Numbers:: When the name is not enough.
170* Python Modules:: Taming the snake.
171* Perl Modules:: Little pearls.
172* Fonts:: Fond of fonts.
aaa3eaa9
LC
173
174@end detailmenu
568717fd
LC
175@end menu
176
177@c *********************************************************************
178@node Introduction
179@chapter Introduction
180
c80e7e55
LC
181GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
182using the international phonetic alphabet (IPA).} is a functional
183package management tool for the GNU system. Package management consists
4bfc4ea3
NK
184of all activities that relate to building packages from sources,
185honoring their build-time and run-time dependencies,
c80e7e55
LC
186installing packages in user environments, upgrading installed packages
187to new versions or rolling back to a previous set, removing unused
188software packages, etc.
568717fd
LC
189
190@cindex functional package management
191The term @dfn{functional} refers to a specific package management
192discipline. In Guix, the package build and installation process is seen
4bfc4ea3
NK
193as a function, in the mathematical sense. That function takes inputs,
194such as build scripts, a compiler, and libraries, and
195returns an installed package. As a pure function, its result depends
568717fd
LC
196solely on its inputs---for instance, it cannot refer to software or
197scripts that were not explicitly passed as inputs. A build function
4bfc4ea3
NK
198always produces the same result when passed a given set of inputs. It
199cannot alter the system's environment in
568717fd
LC
200any way; for instance, it cannot create, modify, or delete files outside
201of its build and installation directories. This is achieved by running
e900c503 202build processes in isolated environments (or @dfn{containers}), where only their
4bfc4ea3 203explicit inputs are visible.
568717fd 204
e531ac2a 205@cindex store
568717fd 206The result of package build functions is @dfn{cached} in the file
e531ac2a
LC
207system, in a special directory called @dfn{the store} (@pxref{The
208Store}). Each package is installed in a directory of its own, in the
834129e0 209store---by default under @file{/gnu/store}. The directory name contains
568717fd
LC
210a hash of all the inputs used to build that package; thus, changing an
211input yields a different directory name.
212
213This approach is the foundation of Guix's salient features: support for
4bfc4ea3 214transactional package upgrade and rollback, per-user installation, and
eeaf4427 215garbage collection of packages (@pxref{Features}).
568717fd 216
4bfc4ea3 217Guix has a command-line interface, which allows users to build, install,
568717fd 218upgrade, and remove packages, as well as a Scheme programming interface.
568717fd 219
3ca2731c 220@cindex Guix System Distribution
4705641f 221@cindex GuixSD
a1ba8475 222Last but not least, Guix is used to build a distribution of the GNU
3ca2731c 223system, with many GNU and non-GNU free software packages. The Guix
4705641f
LC
224System Distribution, or GNU@tie{}GuixSD, takes advantage of the core
225properties of Guix at the system level. With GuixSD, users
3ca2731c
LC
226@emph{declare} all aspects of the operating system configuration, and
227Guix takes care of instantiating that configuration in a reproducible,
228stateless fashion. @xref{GNU Distribution}.
a1ba8475 229
bd5e766b
LC
230@c *********************************************************************
231@node Installation
232@chapter Installation
233
48febeb8
LC
234GNU Guix is available for download from its website at
235@url{http://www.gnu.org/software/guix/}. This section describes the
236software requirements of Guix, as well as how to install it and get
237ready to use it.
bd5e766b 238
5af6de3e
LC
239Note that this section is concerned with the installation of the package
240manager, which can be done on top of a running GNU/Linux system. If,
241instead, you want to install the complete GNU operating system,
6621cdb6 242@pxref{System Installation}.
5af6de3e 243
bd5e766b 244@menu
09722b11 245* Binary Installation:: Getting Guix running in no time!
bd5e766b 246* Requirements:: Software needed to build and run Guix.
ec0339cd 247* Running the Test Suite:: Testing Guix.
bd5e766b
LC
248* Setting Up the Daemon:: Preparing the build daemon's environment.
249* Invoking guix-daemon:: Running the build daemon.
250@end menu
251
09722b11
LC
252@node Binary Installation
253@section Binary Installation
254
255This section describes how to install Guix on an arbitrary system from a
256self-contained tarball providing binaries for Guix and for all its
257dependencies. This is often quicker than installing from source, which
258is described in the next sections. The only requirement is to have
259GNU@tie{}tar and Xz.
260
261Installing goes along these lines:
262
263@enumerate
264@item
265Download the binary tarball from
ae806096 266@indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz}@footnote{As
09722b11
LC
267usual, make sure to download the associated @file{.sig} file and to
268verify the authenticity of the tarball against it!}, where @var{system}
269is @code{x86_64-linux} for an @code{x86_64} machine already running the
270kernel Linux, and so on.
271
272@item
273As @code{root}, run:
274
275@example
276# cd /
8c3a5d70
LC
277# tar --skip-old-files -xf \
278 guix-binary-@value{VERSION}.@var{system}.tar.xz
09722b11
LC
279@end example
280
281This creates @file{/gnu/store} (@pxref{The Store}), @file{/var/guix},
282and @file{/root/.guix-profile}. @file{/root/.guix-profile} is a
283ready-to-use profile for @code{root} where Guix is installed.
8c3a5d70
LC
284@c '--skip-old-files' does the right thing with tar 1.28. The manual
285@c does not clearly document the behavior we describe here, though.
286The @code{--skip-old-files} option allows you to make sure the owner and
287permissions on @file{/var} and @file{/root} are preserved (@pxref{Option
288Summary, @code{--skip-old-files},, tar, GNU tar: an archiver tool}).
09722b11 289
5dc3ce5f
LC
290Do @emph{not} unpack the tarball on a working Guix system since that
291would overwrite its own essential files.
292
09722b11 293@item
175ced41 294Run the daemon:
09722b11
LC
295
296@example
cfc149dc 297# /root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
09722b11
LC
298@end example
299
300@item
301Make the @command{guix} command available to other users on the machine,
302for instance with:
303
304@example
305# mkdir -p /usr/local/bin
306# cd /usr/local/bin
d72d05f9 307# ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
09722b11 308@end example
39f8ed14
LC
309
310@item
311To use substitutes from @code{hydra.gnu.org} (@pxref{Substitutes}),
312authorize them:
313
314@example
315# guix archive --authorize < /root/.guix-profile/share/guix/hydra.gnu.org.pub
316@end example
09722b11
LC
317@end enumerate
318
319And that's it!
320
5dc3ce5f 321The @code{guix} package must remain available in @code{root}'s
09722b11
LC
322profile, or it would become subject to garbage collection---in which
323case you would find yourself badly handicapped by the lack of the
324@command{guix} command.
325
39f8ed14
LC
326The tarball in question can be (re)produced and verified simply by
327running the following command in the Guix source tree:
09722b11
LC
328
329@example
330make guix-binary.@var{system}.tar.xz
331@end example
332
333
bd5e766b
LC
334@node Requirements
335@section Requirements
336
09722b11
LC
337This section lists requirements when building Guix from source. The
338build procedure for Guix is the same as for other GNU software, and is
339not covered here. Please see the files @file{README} and @file{INSTALL}
340in the Guix source tree for additional details.
341
bd5e766b
LC
342GNU Guix depends on the following packages:
343
344@itemize
47c66da0 345@item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
288dca55 346@item @url{http://gnupg.org/, GNU libgcrypt};
f0b98b84 347@item @url{http://www.gnu.org/software/make/, GNU Make}.
8a96bd4b
ID
348@end itemize
349
350The following dependencies are optional:
351
352@itemize
288dca55 353@item
8a96bd4b 354Installing
288dca55 355@url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
2f7d2d91
LC
356allow you to use the @command{guix import pypi} command (@pxref{Invoking
357guix import}). It is of
288dca55 358interest primarily for developers and not for casual users.
8a96bd4b
ID
359@item
360Installing @uref{http://gnutls.org/, GnuTLS-Guile} will
361allow you to access @code{https} URLs with the @command{guix download}
d45dc6da
EB
362command (@pxref{Invoking guix download}), the @command{guix import pypi}
363command, and the @command{guix import cpan} command. This is primarily
364of interest to developers. @xref{Guile Preparations, how to install the
365GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}.
bd5e766b
LC
366@end itemize
367
368Unless @code{--disable-daemon} was passed to @command{configure}, the
369following packages are also needed:
370
371@itemize
368d08f7
LC
372@item @url{http://sqlite.org, SQLite 3};
373@item @url{http://www.bzip.org, libbz2};
374@item @url{http://gcc.gnu.org, GCC's g++}, with support for the
375C++11 standard.
bd5e766b
LC
376@end itemize
377
4bfc4ea3
NK
378When a working installation of @url{http://nixos.org/nix/, the Nix package
379manager} is available, you
bd5e766b 380can instead configure Guix with @code{--disable-daemon}. In that case,
4bfc4ea3 381Nix replaces the three dependencies above.
bd5e766b 382
b22a12fd
LC
383Guix is compatible with Nix, so it is possible to share the same store
384between both. To do so, you must pass @command{configure} not only the
385same @code{--with-store-dir} value, but also the same
4bfc4ea3
NK
386@code{--localstatedir} value. The latter is essential because it
387specifies where the database that stores metadata about the store is
834129e0 388located, among other things. The default values for Nix are
b22a12fd 389@code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
4bfc4ea3
NK
390Note that @code{--disable-daemon} is not required if
391your goal is to share the store with Nix.
b22a12fd 392
ec0339cd
LC
393@node Running the Test Suite
394@section Running the Test Suite
395
396After a successful @command{configure} and @code{make} run, it is a good
397idea to run the test suite. It can help catch issues with the setup or
398environment, or bugs in Guix itself---and really, reporting test
399failures is a good way to help improve the software. To run the test
400suite, type:
401
402@example
403make check
404@end example
405
406Test cases can run in parallel: you can use the @code{-j} option of
407GNU@tie{}make to speed things up. The first run may take a few minutes
408on a recent machine; subsequent runs will be faster because the store
409that is created for test purposes will already have various things in
410cache.
411
412Upon failure, please email @email{bug-guix@@gnu.org} and attach the
413@file{test-suite.log} file. When @file{tests/@var{something}.scm}
414fails, please also attach the @file{@var{something}.log} file available
415in the top-level build directory. Please specify the Guix version being
416used as well as version numbers of the dependencies
417(@pxref{Requirements}) in your message.
418
bd5e766b
LC
419@node Setting Up the Daemon
420@section Setting Up the Daemon
421
422@cindex daemon
423Operations such as building a package or running the garbage collector
49e6291a 424are all performed by a specialized process, the @dfn{build daemon}, on
bd5e766b
LC
425behalf of clients. Only the daemon may access the store and its
426associated database. Thus, any operation that manipulates the store
427goes through the daemon. For instance, command-line tools such as
e49951eb 428@command{guix package} and @command{guix build} communicate with the
bd5e766b
LC
429daemon (@i{via} remote procedure calls) to instruct it what to do.
430
49e6291a 431The following sections explain how to prepare the build daemon's
225dafde
LC
432environment. Also @ref{Substitutes}, for information on how to allow
433the daemon to download pre-built binaries.
49e6291a
LC
434
435@menu
436* Build Environment Setup:: Preparing the isolated build environment.
437* Daemon Offload Setup:: Offloading builds to remote machines.
438@end menu
439
440@node Build Environment Setup
441@subsection Build Environment Setup
442
bd5e766b
LC
443In a standard multi-user setup, Guix and its daemon---the
444@command{guix-daemon} program---are installed by the system
834129e0 445administrator; @file{/gnu/store} is owned by @code{root} and
bd5e766b
LC
446@command{guix-daemon} runs as @code{root}. Unprivileged users may use
447Guix tools to build packages or otherwise access the store, and the
448daemon will do it on their behalf, ensuring that the store is kept in a
449consistent state, and allowing built packages to be shared among users.
450
451@cindex build users
452When @command{guix-daemon} runs as @code{root}, you may not want package
453build processes themselves to run as @code{root} too, for obvious
454security reasons. To avoid that, a special pool of @dfn{build users}
455should be created for use by build processes started by the daemon.
456These build users need not have a shell and a home directory: they will
457just be used when the daemon drops @code{root} privileges in build
458processes. Having several such users allows the daemon to launch
459distinct build processes under separate UIDs, which guarantees that they
460do not interfere with each other---an essential feature since builds are
461regarded as pure functions (@pxref{Introduction}).
462
463On a GNU/Linux system, a build user pool may be created like this (using
464Bash syntax and the @code{shadow} commands):
465
091196b3
LC
466@c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
467@c for why `-G' is needed.
bd5e766b 468@example
cfc149dc
LC
469# groupadd --system guixbuild
470# for i in `seq -w 1 10`;
bd5e766b 471 do
cfc149dc
LC
472 useradd -g guixbuild -G guixbuild \
473 -d /var/empty -s `which nologin` \
474 -c "Guix build user $i" --system \
475 guixbuilder$i;
bd5e766b
LC
476 done
477@end example
478
479@noindent
480The @code{guix-daemon} program may then be run as @code{root} with:
481
482@example
cfc149dc 483# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
484@end example
485
e900c503 486@cindex chroot
b095792f
LC
487@noindent
488This way, the daemon starts build processes in a chroot, under one of
cfc149dc 489the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
6dc99317
LC
490environment contains nothing but:
491
492@c Keep this list in sync with libstore/build.cc! -----------------------
493@itemize
494@item
4743a4da
LC
495a minimal @code{/dev} directory, created mostly independently from the
496host @code{/dev}@footnote{``Mostly'', because while the set of files
497that appear in the chroot's @code{/dev} is fixed, most of these files
498can only be created if the host has them.};
499
500@item
501the @code{/proc} directory; it only shows the container's processes
502since a separate PID name space is used;
6dc99317
LC
503
504@item
505@file{/etc/passwd} with an entry for the current user and an entry for
506user @file{nobody};
507
508@item
509@file{/etc/group} with an entry for the user's group;
510
511@item
512@file{/etc/hosts} with an entry that maps @code{localhost} to
513@code{127.0.0.1};
514
515@item
516a writable @file{/tmp} directory.
517@end itemize
b095792f 518
d43eb499 519If you are installing Guix as an unprivileged user, it is still
bd5e766b
LC
520possible to run @command{guix-daemon}. However, build processes will
521not be isolated from one another, and not from the rest of the system.
522Thus, build processes may interfere with each other, and may access
523programs, libraries, and other files available on the system---making it
524much harder to view them as @emph{pure} functions.
525
49e6291a
LC
526
527@node Daemon Offload Setup
528@subsection Using the Offload Facility
529
530@cindex offloading
4ec2e92d
LC
531@cindex build hook
532When desired, the build daemon can @dfn{offload}
533derivation builds to other machines
49e6291a
LC
534running Guix, using the @code{offload} @dfn{build hook}. When that
535feature is enabled, a list of user-specified build machines is read from
536@file{/etc/guix/machines.scm}; anytime a build is requested, for
537instance via @code{guix build}, the daemon attempts to offload it to one
538of the machines that satisfies the derivation's constraints, in
539particular its system type---e.g., @file{x86_64-linux}. Missing
540prerequisites for the build are copied over SSH to the target machine,
541which then proceeds with the build; upon success the output(s) of the
542build are copied back to the initial machine.
543
4ec2e92d 544The @file{/etc/guix/machines.scm} file typically looks like this:
49e6291a
LC
545
546@example
547(list (build-machine
548 (name "eightysix.example.org")
549 (system "x86_64-linux")
550 (user "bob")
551 (speed 2.)) ; incredibly fast!
552
553 (build-machine
554 (name "meeps.example.org")
555 (system "mips64el-linux")
556 (user "alice")
557 (private-key
558 (string-append (getenv "HOME")
559 "/.ssh/id-rsa-for-guix"))))
560@end example
561
562@noindent
563In the example above we specify a list of two build machines, one for
564the @code{x86_64} architecture and one for the @code{mips64el}
4ec2e92d
LC
565architecture.
566
567In fact, this file is---not surprisingly!---a Scheme file that is
568evaluated when the @code{offload} hook is started. Its return value
569must be a list of @code{build-machine} objects. While this example
570shows a fixed list of build machines, one could imagine, say, using
571DNS-SD to return a list of potential build machines discovered in the
572local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
c678a4ee
LC
573Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
574detailed below.
4ec2e92d 575
c678a4ee
LC
576@deftp {Data Type} build-machine
577This data type represents build machines the daemon may offload builds
578to. The important fields are:
49e6291a
LC
579
580@table @code
581
582@item name
583The remote machine's host name.
584
585@item system
c678a4ee 586The remote machine's system type---e.g., @code{"x86_64-linux"}.
49e6291a
LC
587
588@item user
589The user account to use when connecting to the remote machine over SSH.
590Note that the SSH key pair must @emph{not} be passphrase-protected, to
591allow non-interactive logins.
592
593@end table
594
4ec2e92d 595A number of optional fields may be specified:
49e6291a
LC
596
597@table @code
598
cecd72d5
LC
599@item port
600Port number of the machine's SSH server (default: 22).
601
49e6291a
LC
602@item private-key
603The SSH private key file to use when connecting to the machine.
604
605@item parallel-builds
606The number of builds that may run in parallel on the machine (1 by
607default.)
608
609@item speed
610A ``relative speed factor''. The offload scheduler will tend to prefer
611machines with a higher speed factor.
612
613@item features
614A list of strings denoting specific features supported by the machine.
615An example is @code{"kvm"} for machines that have the KVM Linux modules
616and corresponding hardware support. Derivations can request features by
617name, and they will be scheduled on matching build machines.
618
619@end table
c678a4ee 620@end deftp
49e6291a
LC
621
622The @code{guix} command must be in the search path on the build
623machines, since offloading works by invoking the @code{guix archive} and
624@code{guix build} commands.
625
626There's one last thing to do once @file{machines.scm} is in place. As
627explained above, when offloading, files are transferred back and forth
628between the machine stores. For this to work, you need to generate a
629key pair to allow the daemon to export signed archives of files from the
630store (@pxref{Invoking guix archive}):
631
632@example
633# guix archive --generate-key
634@end example
635
636@noindent
637Thus, when receiving files, a machine's build daemon can make sure they
638are genuine, have not been tampered with, and that they are signed by an
639authorized key.
640
641
bd5e766b
LC
642@node Invoking guix-daemon
643@section Invoking @command{guix-daemon}
644
645The @command{guix-daemon} program implements all the functionality to
646access the store. This includes launching build processes, running the
647garbage collector, querying the availability of a build result, etc. It
648is normally run as @code{root} like this:
649
650@example
cfc149dc 651# guix-daemon --build-users-group=guixbuild
bd5e766b
LC
652@end example
653
654@noindent
081145cf 655For details on how to set it up, @pxref{Setting Up the Daemon}.
bd5e766b 656
e900c503
LC
657@cindex chroot
658@cindex container, build environment
659@cindex build environment
660@cindex reproducible builds
bd5e766b
LC
661By default, @command{guix-daemon} launches build processes under
662different UIDs, taken from the build group specified with
663@code{--build-users-group}. In addition, each build process is run in a
664chroot environment that only contains the subset of the store that the
665build process depends on, as specified by its derivation
666(@pxref{Programming Interface, derivation}), plus a set of specific
667system directories. By default, the latter contains @file{/dev} and
e900c503
LC
668@file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
669@dfn{container}: in addition to having its own file system tree, it has
670a separate mount name space, its own PID name space, network name space,
671etc. This helps achieve reproducible builds (@pxref{Features}).
bd5e766b 672
cbc538fe
LC
673When the daemon performs a build on behalf of the user, it creates a
674build directory under @file{/tmp} or under the directory specified by
675its @code{TMPDIR} environment variable; this directory is shared with
676the container for the duration of the build. Be aware that using a
677directory other than @file{/tmp} can affect build results---for example,
678with a longer directory name, a build process that uses Unix-domain
679sockets might hit the name length limitation for @code{sun_path}, which
680it would otherwise not hit.
681
682The build directory is automatically deleted upon completion, unless the
683build failed and the client specified @option{--keep-failed}
684(@pxref{Invoking guix build, @option{--keep-failed}}).
685
bd5e766b
LC
686The following command-line options are supported:
687
688@table @code
689@item --build-users-group=@var{group}
690Take users from @var{group} to run build processes (@pxref{Setting Up
691the Daemon, build users}).
692
6858f9d1 693@item --no-substitutes
b5385b52 694@cindex substitutes
6858f9d1 695Do not use substitutes for build products. That is, always build things
c4202d60
LC
696locally instead of allowing downloads of pre-built binaries
697(@pxref{Substitutes}).
6858f9d1 698
b5385b52
LC
699By default substitutes are used, unless the client---such as the
700@command{guix package} command---is explicitly invoked with
701@code{--no-substitutes}.
702
703When the daemon runs with @code{--no-substitutes}, clients can still
704explicitly enable substitution @i{via} the @code{set-build-options}
705remote procedure call (@pxref{The Store}).
706
9176607e
LC
707@item --substitute-urls=@var{urls}
708Consider @var{urls} the default whitespace-separated list of substitute
ae806096 709source URLs. When this option is omitted, @indicateurl{http://hydra.gnu.org}
9176607e
LC
710is used.
711
712This means that substitutes may be downloaded from @var{urls}, as long
713as they are signed by a trusted signature (@pxref{Substitutes}).
714
4ec2e92d
LC
715@cindex build hook
716@item --no-build-hook
717Do not use the @dfn{build hook}.
718
719The build hook is a helper program that the daemon can start and to
720which it submits build requests. This mechanism is used to offload
721builds to other machines (@pxref{Daemon Offload Setup}).
722
bd5e766b
LC
723@item --cache-failures
724Cache build failures. By default, only successful builds are cached.
725
726@item --cores=@var{n}
727@itemx -c @var{n}
728Use @var{n} CPU cores to build each derivation; @code{0} means as many
729as available.
730
6efc160e 731The default value is @code{0}, but it may be overridden by clients, such
e49951eb
MW
732as the @code{--cores} option of @command{guix build} (@pxref{Invoking
733guix build}).
bd5e766b
LC
734
735The effect is to define the @code{NIX_BUILD_CORES} environment variable
736in the build process, which can then use it to exploit internal
737parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
738
739@item --max-jobs=@var{n}
740@itemx -M @var{n}
741Allow at most @var{n} build jobs in parallel. The default value is
f6526eb3
LC
742@code{1}. Setting it to @code{0} means that no builds will be performed
743locally; instead, the daemon will offload builds (@pxref{Daemon Offload
744Setup}), or simply fail.
bd5e766b
LC
745
746@item --debug
747Produce debugging output.
748
749This is useful to debug daemon start-up issues, but then it may be
750overridden by clients, for example the @code{--verbosity} option of
e49951eb 751@command{guix build} (@pxref{Invoking guix build}).
bd5e766b
LC
752
753@item --chroot-directory=@var{dir}
754Add @var{dir} to the build chroot.
755
756Doing this may change the result of build processes---for instance if
757they use optional dependencies found in @var{dir} when it is available,
758and not otherwise. For that reason, it is not recommended to do so.
759Instead, make sure that each derivation declares all the inputs that it
760needs.
761
762@item --disable-chroot
763Disable chroot builds.
764
765Using this option is not recommended since, again, it would allow build
766processes to gain access to undeclared dependencies.
767
768@item --disable-log-compression
769Disable compression of the build logs.
770
1da983b9
LC
771Unless @code{--lose-logs} is used, all the build logs are kept in the
772@var{localstatedir}. To save space, the daemon automatically compresses
773them with bzip2 by default. This option disables that.
774
ab3893d7
LC
775@item --disable-deduplication
776@cindex deduplication
bd5e766b
LC
777Disable automatic file ``deduplication'' in the store.
778
1da983b9 779By default, files added to the store are automatically ``deduplicated'':
ab3893d7
LC
780if a newly added file is identical to another one found in the store,
781the daemon makes the new file a hard link to the other file. This can
782noticeably reduce disk usage, at the expense of slightly increasde
783input/output load at the end of a build process. This option disables
784this optimization.
1da983b9 785
6e37066e
LC
786@item --gc-keep-outputs[=yes|no]
787Tell whether the garbage collector (GC) must keep outputs of live
788derivations.
789
790When set to ``yes'', the GC will keep the outputs of any live derivation
791available in the store---the @code{.drv} files. The default is ``no'',
792meaning that derivation outputs are kept only if they are GC roots.
793
794@item --gc-keep-derivations[=yes|no]
795Tell whether the garbage collector (GC) must keep derivations
796corresponding to live outputs.
797
798When set to ``yes'', as is the case by default, the GC keeps
799derivations---i.e., @code{.drv} files---as long as at least one of their
800outputs is live. This allows users to keep track of the origins of
801items in their store. Setting it to ``no'' saves a bit of disk space.
802
803Note that when both @code{--gc-keep-derivations} and
804@code{--gc-keep-outputs} are used, the effect is to keep all the build
805prerequisites (the sources, compiler, libraries, and other build-time
806tools) of live objects in the store, regardless of whether these
807prerequisites are live. This is convenient for developers since it
808saves rebuilds or downloads.
809
bd5e766b
LC
810@item --impersonate-linux-2.6
811On Linux-based systems, impersonate Linux 2.6. This means that the
812kernel's @code{uname} system call will report 2.6 as the release number.
813
814This might be helpful to build programs that (usually wrongfully) depend
815on the kernel version number.
816
817@item --lose-logs
818Do not keep build logs. By default they are kept under
ce33631f 819@code{@var{localstatedir}/guix/log}.
bd5e766b
LC
820
821@item --system=@var{system}
822Assume @var{system} as the current system type. By default it is the
823architecture/kernel pair found at configure time, such as
824@code{x86_64-linux}.
b8d2aa26
LC
825
826@item --listen=@var{socket}
827Listen for connections on @var{socket}, the file name of a Unix-domain
828socket. The default socket is
829@file{@var{localstatedir}/daemon-socket/socket}. This option is only
830useful in exceptional circumstances, such as if you need to run several
831daemons on the same machine.
bd5e766b
LC
832@end table
833
834
eeaf4427
LC
835@c *********************************************************************
836@node Package Management
837@chapter Package Management
838
f8348b91 839The purpose of GNU Guix is to allow users to easily install, upgrade, and
eeaf4427
LC
840remove software packages, without having to know about their build
841procedure or dependencies. Guix also goes beyond this obvious set of
842features.
843
844This chapter describes the main features of Guix, as well as the package
c1941588
LC
845management tools it provides. Two user interfaces are provided for
846routine package management tasks: a command-line interface
847(@pxref{Invoking guix package, @code{guix package}}), and a visual user
848interface in Emacs (@pxref{Emacs Interface}).
eeaf4427
LC
849
850@menu
851* Features:: How Guix will make your life brighter.
e49951eb 852* Invoking guix package:: Package installation, removal, etc.
457f60fa 853* Emacs Interface:: Package management from Emacs.
c4202d60 854* Substitutes:: Downloading pre-built binaries.
760c60d6 855* Packages with Multiple Outputs:: Single source package, multiple outputs.
e49951eb 856* Invoking guix gc:: Running the garbage collector.
f651b477 857* Invoking guix pull:: Fetching the latest Guix and distribution.
760c60d6 858* Invoking guix archive:: Exporting and importing store files.
eeaf4427
LC
859@end menu
860
861@node Features
862@section Features
863
864When using Guix, each package ends up in the @dfn{package store}, in its
865own directory---something that resembles
9a130e19
AK
866@file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
867(note that Guix comes with an Emacs extension to shorten those file
081145cf 868names, @pxref{Emacs Prettify}.)
eeaf4427
LC
869
870Instead of referring to these directories, users have their own
871@dfn{profile}, which points to the packages that they actually want to
821b0015
LC
872use. These profiles are stored within each user's home directory, at
873@code{$HOME/.guix-profile}.
eeaf4427 874
821b0015 875For example, @code{alice} installs GCC 4.7.2. As a result,
eeaf4427 876@file{/home/alice/.guix-profile/bin/gcc} points to
834129e0 877@file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
821b0015
LC
878@code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
879simply continues to point to
834129e0 880@file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
821b0015 881coexist on the same system without any interference.
eeaf4427 882
e49951eb
MW
883The @command{guix package} command is the central tool to manage
884packages (@pxref{Invoking guix package}). It operates on those per-user
821b0015 885profiles, and can be used @emph{with normal user privileges}.
eeaf4427
LC
886
887The command provides the obvious install, remove, and upgrade
888operations. Each invocation is actually a @emph{transaction}: either
ba55b1cb 889the specified operation succeeds, or nothing happens. Thus, if the
e49951eb 890@command{guix package} process is terminated during the transaction,
eeaf4427
LC
891or if a power outage occurs during the transaction, then the user's
892profile remains in its previous state, and remains usable.
893
894In addition, any package transaction may be @emph{rolled back}. So, if,
895for example, an upgrade installs a new version of a package that turns
896out to have a serious bug, users may roll back to the previous instance
4af2447e
LC
897of their profile, which was known to work well. Similarly, the global
898system configuration is subject to transactional upgrades and roll-back
899(@pxref{Using the Configuration System}).
eeaf4427
LC
900
901All those packages in the package store may be @emph{garbage-collected}.
902Guix can determine which packages are still referenced by the user
fe8ff028 903profiles, and remove those that are provably no longer referenced
e49951eb 904(@pxref{Invoking guix gc}). Users may also explicitly remove old
fe8ff028
LC
905generations of their profile so that the packages they refer to can be
906collected.
eeaf4427 907
e900c503
LC
908@cindex reproducibility
909@cindex reproducible builds
eeaf4427
LC
910Finally, Guix takes a @dfn{purely functional} approach to package
911management, as described in the introduction (@pxref{Introduction}).
834129e0 912Each @file{/gnu/store} package directory name contains a hash of all the
eeaf4427
LC
913inputs that were used to build that package---compiler, libraries, build
914scripts, etc. This direct correspondence allows users to make sure a
915given package installation matches the current state of their
e900c503
LC
916distribution. It also helps maximize @dfn{build reproducibility}:
917thanks to the isolated build environments that are used, a given build
918is likely to yield bit-identical files when performed on different
919machines (@pxref{Invoking guix-daemon, container}).
eeaf4427 920
c4202d60 921@cindex substitutes
eeaf4427 922This foundation allows Guix to support @dfn{transparent binary/source
c4202d60 923deployment}. When a pre-built binary for a @file{/gnu/store} item is
18f2887b 924available from an external source---a @dfn{substitute}, Guix just
c4202d60
LC
925downloads it and unpacks it;
926otherwise, it builds the package from source, locally
927(@pxref{Substitutes}).
eeaf4427 928
f5fd4fd2
LC
929Control over the build environment is a feature that is also useful for
930developers. The @command{guix environment} command allows developers of
931a package to quickly set up the right development environment for their
932package, without having to manually install the package's dependencies
933in their profile (@pxref{Invoking guix environment}).
934
e49951eb
MW
935@node Invoking guix package
936@section Invoking @command{guix package}
eeaf4427 937
e49951eb 938The @command{guix package} command is the tool that allows users to
eeaf4427
LC
939install, upgrade, and remove packages, as well as rolling back to
940previous configurations. It operates only on the user's own profile,
941and works with normal user privileges (@pxref{Features}). Its syntax
942is:
943
944@example
e49951eb 945guix package @var{options}
eeaf4427
LC
946@end example
947
ba55b1cb 948Primarily, @var{options} specifies the operations to be performed during
eeaf4427
LC
949the transaction. Upon completion, a new profile is created, but
950previous generations of the profile remain available, should the user
951want to roll back.
952
6447738c
MW
953For example, to remove @code{lua} and install @code{guile} and
954@code{guile-cairo} in a single transaction:
955
956@example
957guix package -r lua -i guile guile-cairo
958@end example
959
b9e5c0a9 960For each user, a symlink to the user's default profile is automatically
0ec1af59 961created in @file{$HOME/.guix-profile}. This symlink always points to the
b9e5c0a9
LC
962current generation of the user's default profile. Thus, users can add
963@file{$HOME/.guix-profile/bin} to their @code{PATH} environment
964variable, and so on.
d664f1b4
LC
965@cindex search paths
966If you are not using the Guix System Distribution, consider adding the
967following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
968Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
969shells get all the right environment variable definitions:
970
971@example
972GUIX_PROFILE="$HOME/.guix-profile" \
973source "$HOME/.guix-profile/etc/profile"
974@end example
b9e5c0a9 975
4379c35b
LC
976In a multi-user setup, user profiles are stored in a place registered as
977a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
978to (@pxref{Invoking guix gc}). That directory is normally
0ec1af59
LC
979@code{@var{localstatedir}/profiles/per-user/@var{user}}, where
980@var{localstatedir} is the value passed to @code{configure} as
4379c35b
LC
981@code{--localstatedir}, and @var{user} is the user name. The
982@file{per-user} directory is created when @command{guix-daemon} is
983started, and the @var{user} sub-directory is created by @command{guix
984package}.
0ec1af59
LC
985
986The @var{options} can be among the following:
987
eeaf4427
LC
988@table @code
989
6447738c
MW
990@item --install=@var{package} @dots{}
991@itemx -i @var{package} @dots{}
992Install the specified @var{package}s.
eeaf4427 993
6447738c 994Each @var{package} may specify either a simple package name, such as
eeaf4427 995@code{guile}, or a package name followed by a hyphen and version number,
724311a2
LC
996such as @code{guile-1.8.8} or simply @code{guile-1.8} (in the latter
997case, the newest version prefixed by @code{1.8} is selected.)
998
999If no version number is specified, the
dc5669cd
MW
1000newest available version will be selected. In addition, @var{package}
1001may contain a colon, followed by the name of one of the outputs of the
6e721c4d 1002package, as in @code{gcc:doc} or @code{binutils-2.22:lib}
e7f34eb0
LC
1003(@pxref{Packages with Multiple Outputs}). Packages with a corresponding
1004name (and optionally version) are searched for among the GNU
1005distribution modules (@pxref{Package Modules}).
eeaf4427 1006
461572cc
LC
1007@cindex propagated inputs
1008Sometimes packages have @dfn{propagated inputs}: these are dependencies
1009that automatically get installed along with the required package.
1010
1011An example is the GNU MPC library: its C header files refer to those of
1012the GNU MPFR library, which in turn refer to those of the GMP library.
1013Thus, when installing MPC, the MPFR and GMP libraries also get installed
1014in the profile; removing MPC also removes MPFR and GMP---unless they had
1015also been explicitly installed independently.
1016
ba7ea5ce 1017Besides, packages sometimes rely on the definition of environment
5924080d 1018variables for their search paths (see explanation of
ba7ea5ce 1019@code{--search-paths} below). Any missing or possibly incorrect
5924080d
LC
1020environment variable definitions are reported here.
1021
ef010c0f 1022@c XXX: keep me up-to-date
5924080d 1023Finally, when installing a GNU package, the tool reports the
ef010c0f
LC
1024availability of a newer upstream version. In the future, it may provide
1025the option of installing directly from the upstream version, even if
1026that version is not yet in the distribution.
1027
5d4b411f
LC
1028@item --install-from-expression=@var{exp}
1029@itemx -e @var{exp}
1030Install the package @var{exp} evaluates to.
1031
1032@var{exp} must be a Scheme expression that evaluates to a
1033@code{<package>} object. This option is notably useful to disambiguate
1034between same-named variants of a package, with expressions such as
1035@code{(@@ (gnu packages base) guile-final)}.
1036
1037Note that this option installs the first output of the specified
1038package, which may be insufficient when needing a specific output of a
1039multiple-output package.
1040
6447738c
MW
1041@item --remove=@var{package} @dots{}
1042@itemx -r @var{package} @dots{}
1043Remove the specified @var{package}s.
eeaf4427 1044
6447738c 1045As for @code{--install}, each @var{package} may specify a version number
13ed095c
LC
1046and/or output name in addition to the package name. For instance,
1047@code{-r glibc:debug} would remove the @code{debug} output of
1048@code{glibc}.
1049
6447738c
MW
1050@item --upgrade[=@var{regexp} @dots{}]
1051@itemx -u [@var{regexp} @dots{}]
1052Upgrade all the installed packages. If one or more @var{regexp}s are
1053specified, upgrade only installed packages whose name matches a
d5f01e48 1054@var{regexp}. Also see the @code{--do-not-upgrade} option below.
eeaf4427 1055
f651b477
LC
1056Note that this upgrades package to the latest version of packages found
1057in the distribution currently installed. To update your distribution,
1058you should regularly run @command{guix pull} (@pxref{Invoking guix
1059pull}).
1060
d5f01e48
MW
1061@item --do-not-upgrade[=@var{regexp} @dots{}]
1062When used together with the @code{--upgrade} option, do @emph{not}
1063upgrade any packages whose name matches a @var{regexp}. For example, to
1064upgrade all packages in the current profile except those containing the
1065substring ``emacs'':
1066
1067@example
1068$ guix package --upgrade . --do-not-upgrade emacs
1069@end example
1070
24e262f0
LC
1071@item --roll-back
1072Roll back to the previous @dfn{generation} of the profile---i.e., undo
1073the last transaction.
1074
1075When combined with options such as @code{--install}, roll back occurs
1076before any other actions.
1077
d9307267 1078When rolling back from the first generation that actually contains
4b2bc804
NK
1079installed packages, the profile is made to point to the @dfn{zeroth
1080generation}, which contains no files apart from its own meta-data.
d9307267 1081
82fe08ed
LC
1082Installing, removing, or upgrading packages from a generation that has
1083been rolled back to overwrites previous future generations. Thus, the
1084history of a profile's generations is always linear.
1085
b3bb82f1
AK
1086@item --switch-generation=@var{pattern}
1087@itemx -S @var{pattern}
1088Switch to a particular generation defined by @var{pattern}.
1089
1090@var{pattern} may be either a generation number or a number prefixed
1091with ``+'' or ``-''. The latter means: move forward/backward by a
1092specified number of generations. For example, if you want to return to
1093the latest generation after @code{--roll-back}, use
1094@code{--switch-generation=+1}.
1095
1096The difference between @code{--roll-back} and
1097@code{--switch-generation=-1} is that @code{--switch-generation} will
1098not make a zeroth generation, so if a specified generation does not
1099exist, the current generation will not be changed.
1100
dbc31ab2 1101@item --search-paths[=@var{kind}]
5924080d
LC
1102@cindex search paths
1103Report environment variable definitions, in Bash syntax, that may be
1104needed in order to use the set of installed packages. These environment
1105variables are used to specify @dfn{search paths} for files used by some
1106of the installed packages.
1107
1108For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1109environment variables to be defined so it can look for headers and
1110libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1111Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1112library are installed in the profile, then @code{--search-paths} will
1113suggest setting these variables to @code{@var{profile}/include} and
1114@code{@var{profile}/lib}, respectively.
1115
dbc31ab2
LC
1116The typical use case is to define these environment variables in the
1117shell:
1118
1119@example
1120$ eval `guix package --search-paths`
1121@end example
1122
1123@var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1124meaning that the returned environment variable definitions will either
1125be exact settings, or prefixes or suffixes of the current value of these
1126variables. When omitted, @var{kind} defaults to @code{exact}.
1127
eeaf4427
LC
1128@item --profile=@var{profile}
1129@itemx -p @var{profile}
1130Use @var{profile} instead of the user's default profile.
1131
70915c1a
LC
1132@item --verbose
1133Produce verbose output. In particular, emit the environment's build log
1134on the standard error port.
1135
eeaf4427
LC
1136@item --bootstrap
1137Use the bootstrap Guile to build the profile. This option is only
1138useful to distribution developers.
1139
1140@end table
1141
e49951eb 1142In addition to these actions @command{guix package} supports the
733b4130
LC
1143following options to query the current state of a profile, or the
1144availability of packages:
eeaf4427 1145
733b4130
LC
1146@table @option
1147
acc08466
NK
1148@item --search=@var{regexp}
1149@itemx -s @var{regexp}
5763ad92 1150List the available packages whose name, synopsis, or description matches
299112d3
LC
1151@var{regexp}. Print all the meta-data of matching packages in
1152@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1153GNU recutils manual}).
acc08466 1154
299112d3
LC
1155This allows specific fields to be extracted using the @command{recsel}
1156command, for instance:
1157
1158@example
e49951eb 1159$ guix package -s malloc | recsel -p name,version
299112d3
LC
1160name: glibc
1161version: 2.17
1162
1163name: libgc
1164version: 7.2alpha6
1165@end example
acc08466 1166
a12d92f5
LC
1167Similarly, to show the name of all the packages available under the
1168terms of the GNU@tie{}LGPL version 3:
1169
1170@example
1171$ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1172name: elfutils
1173
1174name: gmp
1175@dots{}
1176@end example
1177
2aa6efb0
CR
1178@item --show=@var{package}
1179Show details about @var{package}, taken from the list of available packages, in
1180@code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1181recutils manual}).
1182
1183@example
1184$ guix package --show=python | recsel -p name,version
1185name: python
1186version: 2.7.6
1187
1188name: python
1189version: 3.3.5
1190@end example
1191
1192You may also specify the full name of a package to only get details about a
1193specific version of it:
1194@example
1195$ guix package --show=python-3.3.5 | recsel -p name,version
1196name: python
1197version: 3.3.5
1198@end example
1199
1200
1201
733b4130
LC
1202@item --list-installed[=@var{regexp}]
1203@itemx -I [@var{regexp}]
bd9bde1c
LC
1204List the currently installed packages in the specified profile, with the
1205most recently installed packages shown last. When @var{regexp} is
1206specified, list only installed packages whose name matches @var{regexp}.
733b4130
LC
1207
1208For each installed package, print the following items, separated by
1209tabs: the package name, its version string, the part of the package that
1210is installed (for instance, @code{out} for the default output,
1211@code{include} for its headers, etc.), and the path of this package in
1212the store.
1213
64fc89b6
LC
1214@item --list-available[=@var{regexp}]
1215@itemx -A [@var{regexp}]
5763ad92 1216List packages currently available in the distribution for this system
a1ba8475
LC
1217(@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1218installed packages whose name matches @var{regexp}.
64fc89b6
LC
1219
1220For each package, print the following items separated by tabs: its name,
6e721c4d
LC
1221its version string, the parts of the package (@pxref{Packages with
1222Multiple Outputs}), and the source location of its definition.
64fc89b6 1223
f566d765
LC
1224@item --list-generations[=@var{pattern}]
1225@itemx -l [@var{pattern}]
1226Return a list of generations along with their creation dates; for each
1227generation, show the installed packages, with the most recently
4b2bc804
NK
1228installed packages shown last. Note that the zeroth generation is never
1229shown.
f566d765
LC
1230
1231For each installed package, print the following items, separated by
1232tabs: the name of a package, its version string, the part of the package
1233that is installed (@pxref{Packages with Multiple Outputs}), and the
1234location of this package in the store.
1235
1236When @var{pattern} is used, the command returns only matching
1237generations. Valid patterns include:
1238
1239@itemize
1240@item @emph{Integers and comma-separated integers}. Both patterns denote
1241generation numbers. For instance, @code{--list-generations=1} returns
1242the first one.
1243
1244And @code{--list-generations=1,8,2} outputs three generations in the
1245specified order. Neither spaces nor trailing commas are allowed.
1246
1247@item @emph{Ranges}. @code{--list-generations=2..9} prints the
1248specified generations and everything in between. Note that the start of
1249a range must be lesser than its end.
1250
1251It is also possible to omit the endpoint. For example,
1252@code{--list-generations=2..}, returns all generations starting from the
1253second one.
1254
1255@item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1256or months by passing an integer along with the first letter of the
d7ddb257
LC
1257duration. For example, @code{--list-generations=20d} lists generations
1258that are up to 20 days old.
f566d765
LC
1259@end itemize
1260
b7884ca3
NK
1261@item --delete-generations[=@var{pattern}]
1262@itemx -d [@var{pattern}]
d7ddb257
LC
1263When @var{pattern} is omitted, delete all generations except the current
1264one.
b7884ca3
NK
1265
1266This command accepts the same patterns as @option{--list-generations}.
d7ddb257
LC
1267When @var{pattern} is specified, delete the matching generations. When
1268@var{pattern} specifies a duration, generations @emph{older} than the
1269specified duration match. For instance, @code{--delete-generations=1m}
1270deletes generations that are more than one month old.
1271
391bdd8f
LC
1272If the current generation matches, it is @emph{not} deleted. Also, the
1273zeroth generation is never deleted.
b7884ca3 1274
1bb9900a
LC
1275Note that deleting generations prevents roll-back to them.
1276Consequently, this command must be used with care.
1277
733b4130 1278@end table
eeaf4427 1279
70ee5642
LC
1280Finally, since @command{guix package} may actually start build
1281processes, it supports all the common build options that @command{guix
1282build} supports (@pxref{Invoking guix build, common build options}).
1283
457f60fa
AK
1284@include emacs.texi
1285
c4202d60
LC
1286@node Substitutes
1287@section Substitutes
1288
1289@cindex substitutes
1290@cindex pre-built binaries
1291Guix supports transparent source/binary deployment, which means that it
1292can either build things locally, or download pre-built items from a
1293server. We call these pre-built items @dfn{substitutes}---they are
1294substitutes for local build results. In many cases, downloading a
1295substitute is much faster than building things locally.
1296
1297Substitutes can be anything resulting from a derivation build
1298(@pxref{Derivations}). Of course, in the common case, they are
1299pre-built package binaries, but source tarballs, for instance, which
1300also result from derivation builds, can be available as substitutes.
1301
1302The @code{hydra.gnu.org} server is a front-end to a build farm that
1303builds packages from the GNU distribution continuously for some
9176607e
LC
1304architectures, and makes them available as substitutes. This is the
1305default source of substitutes; it can be overridden by passing
1306@command{guix-daemon} the @code{--substitute-urls} option
1307(@pxref{Invoking guix-daemon}).
c4202d60
LC
1308
1309@cindex security
1310@cindex digital signatures
1311To allow Guix to download substitutes from @code{hydra.gnu.org}, you
1312must add its public key to the access control list (ACL) of archive
1313imports, using the @command{guix archive} command (@pxref{Invoking guix
1314archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1315be compromised and to serve genuine substitutes.
1316
1317This public key is installed along with Guix, in
1318@code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1319the installation prefix of Guix. If you installed Guix from source,
1320make sure you checked the GPG signature of
1321@file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1322Then, you can run something like this:
1323
1324@example
1325# guix archive --authorize < hydra.gnu.org.pub
1326@end example
1327
1328Once this is in place, the output of a command like @code{guix build}
1329should change from something like:
1330
1331@example
1332$ guix build emacs --dry-run
1333The following derivations would be built:
1334 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1335 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1336 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1337 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1338@dots{}
1339@end example
1340
1341@noindent
1342to something like:
1343
1344@example
1345$ guix build emacs --dry-run
1346The following files would be downloaded:
1347 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1348 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1349 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1350 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1351@dots{}
1352@end example
1353
1354@noindent
1355This indicates that substitutes from @code{hydra.gnu.org} are usable and
1356will be downloaded, when possible, for future builds.
1357
1358Guix ignores substitutes that are not signed, or that are not signed by
ef27aa9c 1359one of the keys listed in the ACL. It also detects and raises an error
c4202d60
LC
1360when attempting to use a substitute that has been tampered with.
1361
1362The substitute mechanism can be disabled globally by running
1363@code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1364guix-daemon}). It can also be disabled temporarily by passing the
1365@code{--no-substitutes} option to @command{guix package}, @command{guix
1366build}, and other command-line tools.
1367
1368
1369Today, each individual's control over their own computing is at the
1370mercy of institutions, corporations, and groups with enough power and
1371determination to subvert the computing infrastructure and exploit its
1372weaknesses. While using @code{hydra.gnu.org} substitutes can be
1373convenient, we encourage users to also build on their own, or even run
1374their own build farm, such that @code{hydra.gnu.org} is less of an
8ce229fc
LC
1375interesting target. One way to help is by publishing the software you
1376build using @command{guix publish} so that others have one more choice
1377of server to download substitutes from (@pxref{Invoking guix publish}).
c4202d60
LC
1378
1379Guix has the foundations to maximize build reproducibility
1380(@pxref{Features}). In most cases, independent builds of a given
1381package or derivation should yield bit-identical results. Thus, through
1382a diverse set of independent package builds, we can strengthen the
1383integrity of our systems.
1384
1385In the future, we want Guix to have support to publish and retrieve
1386binaries to/from other users, in a peer-to-peer fashion. If you would
1387like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1388
1389
6e721c4d
LC
1390@node Packages with Multiple Outputs
1391@section Packages with Multiple Outputs
1392
1393@cindex multiple-output packages
1394@cindex package outputs
1395
1396Often, packages defined in Guix have a single @dfn{output}---i.e., the
1397source package leads exactly one directory in the store. When running
1398@command{guix package -i glibc}, one installs the default output of the
1399GNU libc package; the default output is called @code{out}, but its name
1400can be omitted as shown in this command. In this particular case, the
1401default output of @code{glibc} contains all the C header files, shared
1402libraries, static libraries, Info documentation, and other supporting
1403files.
1404
1405Sometimes it is more appropriate to separate the various types of files
1406produced from a single source package into separate outputs. For
1407instance, the GLib C library (used by GTK+ and related packages)
1408installs more than 20 MiB of reference documentation as HTML pages.
1409To save space for users who do not need it, the documentation goes to a
1410separate output, called @code{doc}. To install the main GLib output,
1411which contains everything but the documentation, one would run:
1412
1413@example
1414guix package -i glib
1415@end example
1416
1417The command to install its documentation is:
1418
1419@example
1420guix package -i glib:doc
1421@end example
1422
1423Some packages install programs with different ``dependency footprints''.
1424For instance, the WordNet package install both command-line tools and
1425graphical user interfaces (GUIs). The former depend solely on the C
1426library, whereas the latter depend on Tcl/Tk and the underlying X
1427libraries. In this case, we leave the command-line tools in the default
1428output, whereas the GUIs are in a separate output. This allows users
1429who do not need the GUIs to save space.
1430
1431There are several such multiple-output packages in the GNU distribution.
91ef73d4
LC
1432Other conventional output names include @code{lib} for libraries and
1433possibly header files, @code{bin} for stand-alone programs, and
1434@code{debug} for debugging information (@pxref{Installing Debugging
1435Files}). The outputs of a packages are listed in the third column of
1436the output of @command{guix package --list-available} (@pxref{Invoking
1437guix package}).
6e721c4d 1438
eeaf4427 1439
e49951eb
MW
1440@node Invoking guix gc
1441@section Invoking @command{guix gc}
fe8ff028
LC
1442
1443@cindex garbage collector
1444Packages that are installed but not used may be @dfn{garbage-collected}.
e49951eb 1445The @command{guix gc} command allows users to explicitly run the garbage
c22eb992
LC
1446collector to reclaim space from the @file{/gnu/store} directory. It is
1447the @emph{only} way to remove files from @file{/gnu/store}---removing
1448files or directories manually may break it beyond repair!
fe8ff028
LC
1449
1450The garbage collector has a set of known @dfn{roots}: any file under
834129e0 1451@file{/gnu/store} reachable from a root is considered @dfn{live} and
fe8ff028
LC
1452cannot be deleted; any other file is considered @dfn{dead} and may be
1453deleted. The set of garbage collector roots includes default user
e49951eb
MW
1454profiles, and may be augmented with @command{guix build --root}, for
1455example (@pxref{Invoking guix build}).
fe8ff028 1456
1bb9900a
LC
1457Prior to running @code{guix gc --collect-garbage} to make space, it is
1458often useful to remove old generations from user profiles; that way, old
1459package builds referenced by those generations can be reclaimed. This
1460is achieved by running @code{guix package --delete-generations}
1461(@pxref{Invoking guix package}).
1462
e49951eb 1463The @command{guix gc} command has three modes of operation: it can be
fe8ff028
LC
1464used to garbage-collect any dead files (the default), to delete specific
1465files (the @code{--delete} option), or to print garbage-collector
1466information. The available options are listed below:
1467
1468@table @code
1469@item --collect-garbage[=@var{min}]
1470@itemx -C [@var{min}]
834129e0 1471Collect garbage---i.e., unreachable @file{/gnu/store} files and
fe8ff028
LC
1472sub-directories. This is the default operation when no option is
1473specified.
1474
1475When @var{min} is given, stop once @var{min} bytes have been collected.
1476@var{min} may be a number of bytes, or it may include a unit as a
4a44d7bb
LC
1477suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
1478(@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
fe8ff028
LC
1479
1480When @var{min} is omitted, collect all the garbage.
1481
1482@item --delete
1483@itemx -d
1484Attempt to delete all the store files and directories specified as
1485arguments. This fails if some of the files are not in the store, or if
1486they are still live.
1487
38d27786
LC
1488@item --optimize
1489@cindex deduplication
1490Optimize the store by hard-linking identical files---this is
1491@dfn{deduplication}.
1492
1493The daemon performs deduplication after each successful build or archive
1494import, unless it was started with @code{--disable-deduplication}
1495(@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
1496this option is primarily useful when the daemon was running with
1497@code{--disable-deduplication}.
1498
fe8ff028
LC
1499@item --list-dead
1500Show the list of dead files and directories still present in the
1501store---i.e., files and directories no longer reachable from any root.
1502
1503@item --list-live
1504Show the list of live store files and directories.
ba8b732d
LC
1505
1506@end table
1507
1508In addition, the references among existing store files can be queried:
1509
1510@table @code
1511
1512@item --references
1513@itemx --referrers
1514List the references (respectively, the referrers) of store files given
1515as arguments.
1516
8e59fdd5
LC
1517@item --requisites
1518@itemx -R
1519List the requisites of the store files passed as arguments. Requisites
1520include the store files themselves, their references, and the references
1521of these, recursively. In other words, the returned list is the
1522@dfn{transitive closure} of the store files.
1523
fe8ff028
LC
1524@end table
1525
eeaf4427 1526
f651b477
LC
1527@node Invoking guix pull
1528@section Invoking @command{guix pull}
1529
1530Packages are installed or upgraded to the latest version available in
1531the distribution currently available on your local machine. To update
1532that distribution, along with the Guix tools, you must run @command{guix
1533pull}: the command downloads the latest Guix source code and package
1534descriptions, and deploys it.
1535
1536On completion, @command{guix package} will use packages and package
1537versions from this just-retrieved copy of Guix. Not only that, but all
1538the Guix commands and Scheme modules will also be taken from that latest
1539version. New @command{guix} sub-commands added by the update also
1540become available.
1541
1542The @command{guix pull} command is usually invoked with no arguments,
1543but it supports the following options:
1544
1545@table @code
1546@item --verbose
1547Produce verbose output, writing build logs to the standard error output.
1548
ab5d72ad
LC
1549@item --url=@var{url}
1550Download the source tarball of Guix from @var{url}.
1551
1552By default, the tarball is taken from its canonical address at
1553@code{gnu.org}, for the stable branch of Guix.
1554
f651b477
LC
1555@item --bootstrap
1556Use the bootstrap Guile to build the latest Guix. This option is only
1557useful to Guix developers.
1558@end table
1559
760c60d6
LC
1560
1561@node Invoking guix archive
1562@section Invoking @command{guix archive}
1563
1564The @command{guix archive} command allows users to @dfn{export} files
1565from the store into a single archive, and to later @dfn{import} them.
1566In particular, it allows store files to be transferred from one machine
1567to another machine's store. For example, to transfer the @code{emacs}
1568package to a machine connected over SSH, one would run:
1569
1570@example
56607088 1571guix archive --export -r emacs | ssh the-machine guix archive --import
760c60d6
LC
1572@end example
1573
87236aed 1574@noindent
56607088
LC
1575Similarly, a complete user profile may be transferred from one machine
1576to another like this:
1577
1578@example
1579guix archive --export -r $(readlink -f ~/.guix-profile) | \
1580 ssh the-machine guix-archive --import
1581@end example
1582
1583@noindent
1584However, note that, in both examples, all of @code{emacs} and the
1585profile as well as all of their dependencies are transferred (due to
1586@code{-r}), regardless of what is already available in the target
1587machine's store. The @code{--missing} option can help figure out which
1588items are missing from the target's store.
87236aed 1589
760c60d6 1590Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
0dbd88db
LC
1591comparable in spirit to `tar', but with a few noteworthy differences
1592that make it more appropriate for our purposes. First, rather than
1593recording all Unix meta-data for each file, the Nar format only mentions
1594the file type (regular, directory, or symbolic link); Unix permissions
1595and owner/group are dismissed. Second, the order in which directory
1596entries are stored always follows the order of file names according to
1597the C locale collation order. This makes archive production fully
1598deterministic.
1599
1600When exporting, the daemon digitally signs the contents of the archive,
1601and that digital signature is appended. When importing, the daemon
1602verifies the signature and rejects the import in case of an invalid
1603signature or if the signing key is not authorized.
760c60d6
LC
1604@c FIXME: Add xref to daemon doc about signatures.
1605
1606The main options are:
1607
1608@table @code
1609@item --export
1610Export the specified store files or packages (see below.) Write the
1611resulting archive to the standard output.
1612
56607088
LC
1613Dependencies are @emph{not} included in the output, unless
1614@code{--recursive} is passed.
1615
1616@item -r
1617@itemx --recursive
1618When combined with @code{--export}, this instructs @command{guix
1619archive} to include dependencies of the given items in the archive.
1620Thus, the resulting archive is self-contained: it contains the closure
1621of the exported store items.
1622
760c60d6
LC
1623@item --import
1624Read an archive from the standard input, and import the files listed
1625therein into the store. Abort if the archive has an invalid digital
f82cc5fd
LC
1626signature, or if it is signed by a public key not among the authorized
1627keys (see @code{--authorize} below.)
554f26ec 1628
87236aed
LC
1629@item --missing
1630Read a list of store file names from the standard input, one per line,
1631and write on the standard output the subset of these files missing from
1632the store.
1633
554f26ec 1634@item --generate-key[=@var{parameters}]
f82cc5fd 1635@cindex signing, archives
554f26ec
LC
1636Generate a new key pair for the daemons. This is a prerequisite before
1637archives can be exported with @code{--export}. Note that this operation
1638usually takes time, because it needs to gather enough entropy to
1639generate the key pair.
1640
1641The generated key pair is typically stored under @file{/etc/guix}, in
1642@file{signing-key.pub} (public key) and @file{signing-key.sec} (private
867d8473
LC
1643key, which must be kept secret.) When @var{parameters} is omitted,
1644an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
1645versions before 1.6.0, it is a 4096-bit RSA key.
1646Alternately, @var{parameters} can specify
554f26ec
LC
1647@code{genkey} parameters suitable for Libgcrypt (@pxref{General
1648public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
1649Libgcrypt Reference Manual}).
f82cc5fd
LC
1650
1651@item --authorize
1652@cindex authorizing, archives
1653Authorize imports signed by the public key passed on standard input.
1654The public key must be in ``s-expression advanced format''---i.e., the
1655same format as the @file{signing-key.pub} file.
1656
1657The list of authorized keys is kept in the human-editable file
1658@file{/etc/guix/acl}. The file contains
1659@url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
1660s-expressions''} and is structured as an access-control list in the
1661@url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
1662(SPKI)}.
760c60d6
LC
1663@end table
1664
1665To export store files as an archive to the standard output, run:
1666
1667@example
1668guix archive --export @var{options} @var{specifications}...
1669@end example
1670
1671@var{specifications} may be either store file names or package
1672specifications, as for @command{guix package} (@pxref{Invoking guix
1673package}). For instance, the following command creates an archive
1674containing the @code{gui} output of the @code{git} package and the main
1675output of @code{emacs}:
1676
1677@example
834129e0 1678guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
760c60d6
LC
1679@end example
1680
1681If the specified packages are not built yet, @command{guix archive}
1682automatically builds them. The build process may be controlled with the
1683same options that can be passed to the @command{guix build} command
70ee5642 1684(@pxref{Invoking guix build, common build options}).
760c60d6
LC
1685
1686
568717fd
LC
1687@c *********************************************************************
1688@node Programming Interface
1689@chapter Programming Interface
1690
3dc1970d
LC
1691GNU Guix provides several Scheme programming interfaces (APIs) to
1692define, build, and query packages. The first interface allows users to
1693write high-level package definitions. These definitions refer to
1694familiar packaging concepts, such as the name and version of a package,
1695its build system, and its dependencies. These definitions can then be
1696turned into concrete build actions.
1697
ba55b1cb 1698Build actions are performed by the Guix daemon, on behalf of users. In a
3dc1970d 1699standard setup, the daemon has write access to the store---the
834129e0 1700@file{/gnu/store} directory---whereas users do not. The recommended
3dc1970d
LC
1701setup also has the daemon perform builds in chroots, under a specific
1702build users, to minimize interference with the rest of the system.
1703
1704@cindex derivation
1705Lower-level APIs are available to interact with the daemon and the
1706store. To instruct the daemon to perform a build action, users actually
1707provide it with a @dfn{derivation}. A derivation is a low-level
1708representation of the build actions to be taken, and the environment in
1709which they should occur---derivations are to package definitions what
49ad317a
LC
1710assembly is to C programs. The term ``derivation'' comes from the fact
1711that build results @emph{derive} from them.
3dc1970d
LC
1712
1713This chapter describes all these APIs in turn, starting from high-level
1714package definitions.
1715
568717fd 1716@menu
b860f382 1717* Defining Packages:: Defining new packages.
7458bd0a 1718* Build Systems:: Specifying how packages are built.
b860f382
LC
1719* The Store:: Manipulating the package store.
1720* Derivations:: Low-level interface to package derivations.
1721* The Store Monad:: Purely functional interface to the store.
21b679f6 1722* G-Expressions:: Manipulating build expressions.
568717fd
LC
1723@end menu
1724
1725@node Defining Packages
1726@section Defining Packages
1727
3dc1970d
LC
1728The high-level interface to package definitions is implemented in the
1729@code{(guix packages)} and @code{(guix build-system)} modules. As an
1730example, the package definition, or @dfn{recipe}, for the GNU Hello
1731package looks like this:
1732
1733@example
e7f34eb0
LC
1734(define-module (gnu packages hello)
1735 #:use-module (guix packages)
1736 #:use-module (guix download)
1737 #:use-module (guix build-system gnu)
1738 #:use-module (guix licenses))
b22a12fd 1739
79f5dd59 1740(define-public hello
3dc1970d
LC
1741 (package
1742 (name "hello")
1743 (version "2.8")
1744 (source (origin
1745 (method url-fetch)
1746 (uri (string-append "mirror://gnu/hello/hello-" version
1747 ".tar.gz"))
1748 (sha256
1749 (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
1750 (build-system gnu-build-system)
7458bd0a 1751 (arguments `(#:configure-flags '("--enable-silent-rules")))
3dc1970d 1752 (inputs `(("gawk" ,gawk)))
7458bd0a
LC
1753 (synopsis "Hello, GNU world: An example GNU package")
1754 (description "Guess what GNU Hello prints!")
3dc1970d 1755 (home-page "http://www.gnu.org/software/hello/")
b22a12fd 1756 (license gpl3+)))
3dc1970d
LC
1757@end example
1758
1759@noindent
1760Without being a Scheme expert, the reader may have guessed the meaning
e7f34eb0 1761of the various fields here. This expression binds variable @code{hello}
3dc1970d
LC
1762to a @code{<package>} object, which is essentially a record
1763(@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
1764This package object can be inspected using procedures found in the
1765@code{(guix packages)} module; for instance, @code{(package-name hello)}
1766returns---surprise!---@code{"hello"}.
1767
2f7d2d91
LC
1768With luck, you may be able to import part or all of the definition of
1769the package you are interested in from another repository, using the
1770@code{guix import} command (@pxref{Invoking guix import}).
1771
e7f34eb0
LC
1772In the example above, @var{hello} is defined into a module of its own,
1773@code{(gnu packages hello)}. Technically, this is not strictly
1774necessary, but it is convenient to do so: all the packages defined in
1775modules under @code{(gnu packages @dots{})} are automatically known to
1776the command-line tools (@pxref{Package Modules}).
1777
3dc1970d
LC
1778There are a few points worth noting in the above package definition:
1779
1780@itemize
1781@item
1782The @code{source} field of the package is an @code{<origin>} object.
1783Here, the @code{url-fetch} method from @code{(guix download)} is used,
1784meaning that the source is a file to be downloaded over FTP or HTTP.
1785
1786The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
1787the GNU mirrors defined in @code{(guix download)}.
1788
1789The @code{sha256} field specifies the expected SHA256 hash of the file
1790being downloaded. It is mandatory, and allows Guix to check the
1791integrity of the file. The @code{(base32 @dots{})} form introduces the
6c365eca 1792base32 representation of the hash. You can obtain this information with
210cc920
LC
1793@code{guix download} (@pxref{Invoking guix download}) and @code{guix
1794hash} (@pxref{Invoking guix hash}).
3dc1970d 1795
f9cc8971
LC
1796@cindex patches
1797When needed, the @code{origin} form can also have a @code{patches} field
1798listing patches to be applied, and a @code{snippet} field giving a
1799Scheme expression to modify the source code.
1800
3dc1970d
LC
1801@item
1802@cindex GNU Build System
7458bd0a
LC
1803The @code{build-system} field specifies the procedure to build the
1804package (@pxref{Build Systems}). Here, @var{gnu-build-system}
1805represents the familiar GNU Build System, where packages may be
1806configured, built, and installed with the usual @code{./configure &&
1807make && make check && make install} command sequence.
1808
1809@item
1810The @code{arguments} field specifies options for the build system
1811(@pxref{Build Systems}). Here it is interpreted by
1812@var{gnu-build-system} as a request run @file{configure} with the
1813@code{--enable-silent-rules} flag.
3dc1970d
LC
1814
1815@item
1816The @code{inputs} field specifies inputs to the build process---i.e.,
1817build-time or run-time dependencies of the package. Here, we define an
1818input called @code{"gawk"} whose value is that of the @var{gawk}
1819variable; @var{gawk} is itself bound to a @code{<package>} object.
1820
1821Note that GCC, Coreutils, Bash, and other essential tools do not need to
1822be specified as inputs here. Instead, @var{gnu-build-system} takes care
7458bd0a 1823of ensuring that they are present (@pxref{Build Systems}).
3dc1970d
LC
1824
1825However, any other dependencies need to be specified in the
1826@code{inputs} field. Any dependency not specified here will simply be
1827unavailable to the build process, possibly leading to a build failure.
1828@end itemize
1829
87eafdbd
TUBK
1830@xref{package Reference}, for a full description of possible fields.
1831
2f7d2d91 1832Once a package definition is in place, the
e49951eb 1833package may actually be built using the @code{guix build} command-line
7458bd0a 1834tool (@pxref{Invoking guix build}). @xref{Packaging Guidelines}, for
b4f5e0e8
CR
1835more information on how to test package definitions, and
1836@ref{Invoking guix lint}, for information on how to check a definition
1837for style conformance.
1838
7458bd0a
LC
1839Eventually, updating the package definition to a new upstream version
1840can be partly automated by the @command{guix refresh} command
1841(@pxref{Invoking guix refresh}).
3dc1970d
LC
1842
1843Behind the scenes, a derivation corresponding to the @code{<package>}
1844object is first computed by the @code{package-derivation} procedure.
834129e0 1845That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
ba55b1cb 1846The build actions it prescribes may then be realized by using the
3dc1970d
LC
1847@code{build-derivations} procedure (@pxref{The Store}).
1848
1849@deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
59688fc4
LC
1850Return the @code{<derivation>} object of @var{package} for @var{system}
1851(@pxref{Derivations}).
3dc1970d
LC
1852
1853@var{package} must be a valid @code{<package>} object, and @var{system}
1854must be a string denoting the target system type---e.g.,
1855@code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
1856must be a connection to the daemon, which operates on the store
1857(@pxref{The Store}).
1858@end deffn
568717fd 1859
9c1edabd
LC
1860@noindent
1861@cindex cross-compilation
1862Similarly, it is possible to compute a derivation that cross-builds a
1863package for some other system:
1864
1865@deffn {Scheme Procedure} package-cross-derivation @var{store} @
1866 @var{package} @var{target} [@var{system}]
59688fc4
LC
1867Return the @code{<derivation>} object of @var{package} cross-built from
1868@var{system} to @var{target}.
9c1edabd
LC
1869
1870@var{target} must be a valid GNU triplet denoting the target hardware
1871and operating system, such as @code{"mips64el-linux-gnu"}
1872(@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
1873Configure and Build System}).
1874@end deffn
1875
87eafdbd
TUBK
1876@menu
1877* package Reference :: The package data type.
1878* origin Reference:: The origin data type.
1879@end menu
1880
1881
1882@node package Reference
1883@subsection @code{package} Reference
1884
1885This section summarizes all the options available in @code{package}
1886declarations (@pxref{Defining Packages}).
1887
1888@deftp {Data Type} package
1889This is the data type representing a package recipe.
1890
1891@table @asis
1892@item @code{name}
1893The name of the package, as a string.
1894
1895@item @code{version}
1896The version of the package, as a string.
1897
1898@item @code{source}
1899An origin object telling how the source code for the package should be
1900acquired (@pxref{origin Reference}).
1901
1902@item @code{build-system}
1903The build system that should be used to build the package (@pxref{Build
1904Systems}).
1905
1906@item @code{arguments} (default: @code{'()})
1907The arguments that should be passed to the build system. This is a
1908list, typically containing sequential keyword-value pairs.
1909
1910@item @code{inputs} (default: @code{'()})
1911Package or derivation inputs to the build. This is a list of lists,
1912where each list has the name of the input (a string) as its first
1913element, a package or derivation object as its second element, and
1914optionally the name of the output of the package or derivation that
1915should be used, which defaults to @code{"out"}.
1916
1917@item @code{propagated-inputs} (default: @code{'()})
1918This field is like @code{inputs}, but the specified packages will be
1919force-installed alongside the package they belong to. For example this
1920is necessary when a library needs headers of another library to compile,
1921or needs another shared library to be linked alongside itself when a
1922program wants to link to it.
1923
1924@item @code{native-inputs} (default: @code{'()})
1925This field is like @code{inputs}, but in case of a cross-compilation it
1926will be ensured that packages for the architecture of the build machine
1927are present, such that executables from them can be used during the
1928build. For example, this is necessary for build tools such as Autoconf,
1929Libtool, pkg-config, or Gettext.
1930
1931@item @code{self-native-input?} (default: @code{#f})
1932This is a Boolean field telling whether the package should use itself as
1933a native input when cross-compiling.
1934
1935@item @code{outputs} (default: @code{'("out")})
1936The list of output names of the package. @xref{Packages with Multiple
1937Outputs}, for typical uses of additional outputs.
1938
1939@item @code{native-search-paths} (default: @code{'()})
1940@itemx @code{search-paths} (default: @code{'()})
1941A list of @code{search-path-specification} objects describing
1942search-path environment variables honored by the package.
1943
1944@item @code{replacement} (default: @code{#f})
1945This must either @code{#f} or a package object that will be used as a
1946@dfn{replacement} for this package. @xref{Security Updates, grafts},
1947for details.
1948
1949@item @code{synopsis}
1950A one-line description of the package.
1951
1952@item @code{description}
1953A more elaborate description of the package.
1954
1955@item @code{license}
1956The license of the package; a value from @code{(guix licenses)}.
1957
1958@item @code{home-page}
1959The URL to the home-page of the package, as a string.
1960
1961@item @code{supported-systems} (default: @var{%supported-systems})
1962The list of systems supported by the package, as strings of the form
1963@code{architecture-kernel}, for example @code{"x86_64-linux"}.
1964
1965@item @code{maintainers} (default: @code{'()})
1966The list of maintainers of the package, as @code{maintainer} objects.
1967
1968@item @code{location} (default: source location of the @code{package} form)
1969The source location of the package. It's useful to override this when
1970inheriting from another package, in which case this field is not
1971automatically corrected.
1972@end table
1973@end deftp
1974
1975
1976@node origin Reference
1977@subsection @code{origin} Reference
1978
1979This section summarizes all the options available in @code{origin}
1980declarations (@pxref{Defining Packages}).
1981
1982@deftp {Data Type} origin
1983This is the data type representing a source code origin.
1984
1985@table @asis
1986@item @code{uri}
1987An object containing the URI of the source. The object type depends on
1988the @code{method} (see below). For example, when using the
1989@var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
1990values are: a URL represented as a string, or a list thereof.
1991
1992@item @code{method}
1993A procedure that will handle the URI.
1994
1995Examples include:
1996
1997@table @asis
1998@item @var{url-fetch} from @code{(guix download)}
1999download a file the HTTP, HTTPS, or FTP URL specified in the
2000@code{uri} field;
2001
2002@item @var{git-fetch} from @code{(guix git-download)}
2003clone the Git version control repository, and check out the revision
2004specified in the @code{uri} field as a @code{git-reference} object; a
2005@code{git-reference} looks like this:
2006
2007@example
2008(git-reference
2009 (url "git://git.debian.org/git/pkg-shadow/shadow")
2010 (commit "v4.1.5.1"))
2011@end example
2012@end table
2013
2014@item @code{sha256}
2015A bytevector containing the SHA-256 hash of the source. Typically the
2016@code{base32} form is used here to generate the bytevector from a
2017base-32 string.
2018
2019@item @code{file-name} (default: @code{#f})
2020The file name under which the source code should be saved. When this is
2021@code{#f}, a sensible default value will be used in most cases. In case
2022the source is fetched from a URL, the file name from the URL will be
2023used. For version control checkouts, it's recommended to provide the
2024file name explicitly because the default is not very descriptive.
2025
2026@item @code{patches} (default: @code{'()})
2027A list of file names containing patches to be applied to the source.
2028
2029@item @code{snippet} (default: @code{#f})
2030A quoted piece of code that will be run in the source directory to make
2031any modifications, which is sometimes more convenient than a patch.
2032
2033@item @code{patch-flags} (default: @code{'("-p1")})
2034A list of command-line flags that should be passed to the @code{patch}
2035command.
2036
2037@item @code{patch-inputs} (default: @code{#f})
2038Input packages or derivations to the patching process. When this is
2039@code{#f}, the usual set of inputs necessary for patching are provided,
2040such as GNU@tie{}Patch.
2041
2042@item @code{modules} (default: @code{'()})
2043A list of Guile modules that should be loaded during the patching
2044process and while running the code in the @code{snippet} field.
2045
2046@item @code{imported-modules} (default: @code{'()})
2047The list of Guile modules to import in the patch derivation, for use by
2048the @code{snippet}.
2049
2050@item @code{patch-guile} (default: @code{#f})
2051The Guile package that should be used in the patching process. When
2052this is @code{#f}, a sensible default is used.
2053@end table
2054@end deftp
2055
9c1edabd 2056
7458bd0a
LC
2057@node Build Systems
2058@section Build Systems
2059
2060@cindex build system
2061Each package definition specifies a @dfn{build system} and arguments for
2062that build system (@pxref{Defining Packages}). This @code{build-system}
2063field represents the build procedure of the package, as well implicit
2064dependencies of that build procedure.
2065
2066Build systems are @code{<build-system>} objects. The interface to
2067create and manipulate them is provided by the @code{(guix build-system)}
2068module, and actual build systems are exported by specific modules.
2069
f5fd4fd2 2070@cindex bag (low-level package representation)
0d5a559f
LC
2071Under the hood, build systems first compile package objects to
2072@dfn{bags}. A @dfn{bag} is like a package, but with less
2073ornamentation---in other words, a bag is a lower-level representation of
2074a package, which includes all the inputs of that package, including some
2075that were implicitly added by the build system. This intermediate
2076representation is then compiled to a derivation (@pxref{Derivations}).
2077
7458bd0a
LC
2078Build systems accept an optional list of @dfn{arguments}. In package
2079definitions, these are passed @i{via} the @code{arguments} field
2080(@pxref{Defining Packages}). They are typically keyword arguments
2081(@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2082Guile Reference Manual}). The value of these arguments is usually
2083evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2084by the daemon (@pxref{Derivations}).
2085
2086The main build system is @var{gnu-build-system}, which implements the
2087standard build procedure for GNU packages and many other packages. It
2088is provided by the @code{(guix build-system gnu)} module.
2089
2090@defvr {Scheme Variable} gnu-build-system
2091@var{gnu-build-system} represents the GNU Build System, and variants
2092thereof (@pxref{Configuration, configuration and makefile conventions,,
2093standards, GNU Coding Standards}).
2094
2095@cindex build phases
2096In a nutshell, packages using it configured, built, and installed with
2097the usual @code{./configure && make && make check && make install}
2098command sequence. In practice, a few additional steps are often needed.
2099All these steps are split up in separate @dfn{phases},
2100notably@footnote{Please see the @code{(guix build gnu-build-system)}
2101modules for more details about the build phases.}:
2102
2103@table @code
2104@item unpack
2105Unpack the source tarball, and change the current directory to the
2106extracted source tree. If the source is actually a directory, copy it
2107to the build tree, and enter that directory.
2108
2109@item patch-source-shebangs
2110Patch shebangs encountered in source files so they refer to the right
2111store file names. For instance, this changes @code{#!/bin/sh} to
2112@code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2113
2114@item configure
2115Run the @file{configure} script with a number of default options, such
2116as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2117by the @code{#:configure-flags} argument.
2118
2119@item build
2120Run @code{make} with the list of flags specified with
2121@code{#:make-flags}. If the @code{#:parallel-builds?} argument is true
2122(the default), build with @code{make -j}.
2123
2124@item check
2125Run @code{make check}, or some other target specified with
2126@code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2127@code{#:parallel-tests?} argument is true (the default), run @code{make
2128check -j}.
2129
2130@item install
2131Run @code{make install} with the flags listed in @code{#:make-flags}.
2132
2133@item patch-shebangs
2134Patch shebangs on the installed executable files.
2135
2136@item strip
2137Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2138is false), copying them to the @code{debug} output when available
2139(@pxref{Installing Debugging Files}).
2140@end table
2141
2142@vindex %standard-phases
2143The build-side module @code{(guix build gnu-build-system)} defines
2144@var{%standard-phases} as the default list of build phases.
2145@var{%standard-phases} is a list of symbol/procedure pairs, where the
2146procedure implements the actual phase.
2147
2148The list of phases used for a particular package can be changed with the
2149@code{#:phases} parameter. For instance, passing:
2150
2151@example
2152#:phases (alist-delete 'configure %standard-phases)
2153@end example
2154
9bf404e9 2155means that all the phases described above will be used, except the
7458bd0a
LC
2156@code{configure} phase.
2157
2158In addition, this build system ensures that the ``standard'' environment
2159for GNU packages is available. This includes tools such as GCC, libc,
2160Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2161build-system gnu)} module for a complete list.) We call these the
2162@dfn{implicit inputs} of a package, because package definitions don't
2163have to mention them.
2164@end defvr
2165
2166Other @code{<build-system>} objects are defined to support other
2167conventions and tools used by free software packages. They inherit most
2168of @var{gnu-build-system}, and differ mainly in the set of inputs
2169implicitly added to the build process, and in the list of phases
2170executed. Some of these build systems are listed below.
2171
2172@defvr {Scheme Variable} cmake-build-system
2173This variable is exported by @code{(guix build-system cmake)}. It
2174implements the build procedure for packages using the
2175@url{http://www.cmake.org, CMake build tool}.
2176
2177It automatically adds the @code{cmake} package to the set of inputs.
2178Which package is used can be specified with the @code{#:cmake}
2179parameter.
9849cfc1
LC
2180
2181The @code{#:configure-flags} parameter is taken as a list of flags
2182passed to the @command{cmake} command. The @code{#:build-type}
2183parameter specifies in abstract terms the flags passed to the compiler;
2184it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2185debugging information''), which roughly means that code is compiled with
2186@code{-O2 -g}, as is the case for Autoconf-based packages by default.
7458bd0a
LC
2187@end defvr
2188
3afcf52b
FB
2189@defvr {Scheme Variable} glib-or-gtk-build-system
2190This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2191is intended for use with packages making use of GLib or GTK+.
2192
2193This build system adds the following two phases to the ones defined by
2194@var{gnu-build-system}:
2195
2196@table @code
2197@item glib-or-gtk-wrap
2198The phase @code{glib-or-gtk-wrap} ensures that programs found under
2199@file{bin/} are able to find GLib's ``schemas'' and
2200@uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2201modules}. This is achieved by wrapping the programs in launch scripts
2202that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2203environment variables.
2204
73aa8ddb
LC
2205It is possible to exclude specific package outputs from that wrapping
2206process by listing their names in the
2207@code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
2208when an output is known not to contain any GLib or GTK+ binaries, and
2209where wrapping would gratuitously add a dependency of that output on
2210GLib and GTK+.
2211
3afcf52b
FB
2212@item glib-or-gtk-compile-schemas
2213The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
2214@uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
2215GSettings schemas} are compiled. Compilation is performed by the
2216@command{glib-compile-schemas} program. It is provided by the package
2217@code{glib:bin} which is automatically imported by the build system.
2218The @code{glib} package providing @command{glib-compile-schemas} can be
2219specified with the @code{#:glib} parameter.
2220@end table
2221
2222Both phases are executed after the @code{install} phase.
2223@end defvr
2224
7458bd0a
LC
2225@defvr {Scheme Variable} python-build-system
2226This variable is exported by @code{(guix build-system python)}. It
2227implements the more or less standard build procedure used by Python
2228packages, which consists in running @code{python setup.py build} and
2229then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
2230
2231For packages that install stand-alone Python programs under @code{bin/},
2232it takes care of wrapping these programs so their @code{PYTHONPATH}
2233environment variable points to all the Python libraries they depend on.
2234
2235Which Python package is used can be specified with the @code{#:python}
2236parameter.
2237@end defvr
2238
2239@defvr {Scheme Variable} perl-build-system
2240This variable is exported by @code{(guix build-system perl)}. It
2d2a53fc
EB
2241implements the standard build procedure for Perl packages, which either
2242consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
2243followed by @code{Build} and @code{Build install}; or in running
2244@code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
2245@code{make} and @code{make install}; depending on which of
2246@code{Build.PL} or @code{Makefile.PL} is present in the package
2247distribution. Preference is given to the former if both @code{Build.PL}
2248and @code{Makefile.PL} exist in the package distribution. This
2249preference can be reversed by specifying @code{#t} for the
2250@code{#:make-maker?} parameter.
2251
2252The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
2253passes flags specified by the @code{#:make-maker-flags} or
2254@code{#:module-build-flags} parameter, respectively.
7458bd0a
LC
2255
2256Which Perl package is used can be specified with @code{#:perl}.
2257@end defvr
2258
c08f9818
DT
2259@defvr {Scheme Variable} ruby-build-system
2260This variable is exported by @code{(guix build-system ruby)}. It
2261implements the RubyGems build procedure used by Ruby packages, which
2262involves running @code{gem build} followed by @code{gem install}.
2263
2264Which Ruby package is used can be specified with the @code{#:ruby}
2265parameter.
2266@end defvr
7458bd0a 2267
a677c726
RW
2268@defvr {Scheme Variable} waf-build-system
2269This variable is exported by @code{(guix build-system waf)}. It
2270implements a build procedure around the @code{waf} script. The common
2271phases---@code{configure}, @code{build}, and @code{install}---are
2272implemented by passing their names as arguments to the @code{waf}
2273script.
2274
2275The @code{waf} script is executed by the Python interpreter. Which
2276Python package is used to run the script can be specified with the
2277@code{#:python} parameter.
2278@end defvr
2279
14dfdf2e
FB
2280@defvr {Scheme Variable} haskell-build-system
2281This variable is exported by @code{(guix build-system haskell)}. It
2282implements the Cabal build procedure used by Haskell packages, which
2283involves running @code{runhaskell Setup.hs configure
2284--prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
2285Instead of installing the package by running @code{runhaskell Setup.hs
2286install}, to avoid trying to register libraries in the read-only
2287compiler store directory, the build system uses @code{runhaskell
2288Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
2289addition, the build system generates the package documentation by
2290running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
2291is passed. Optional Haddock parameters can be passed with the help of
2292the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
2293not found, the build system looks for @code{Setup.lhs} instead.
2294
2295Which Haskell compiler is used can be specified with the @code{#:haskell}
2296parameter which defaults to @code{ghc}.
2297@end defvr
2298
7458bd0a
LC
2299Lastly, for packages that do not need anything as sophisticated, a
2300``trivial'' build system is provided. It is trivial in the sense that
2301it provides basically no support: it does not pull any implicit inputs,
2302and does not have a notion of build phases.
2303
2304@defvr {Scheme Variable} trivial-build-system
2305This variable is exported by @code{(guix build-system trivial)}.
2306
2307This build system requires a @code{#:builder} argument. This argument
2308must be a Scheme expression that builds the package's output(s)---as
2309with @code{build-expression->derivation} (@pxref{Derivations,
2310@code{build-expression->derivation}}).
2311@end defvr
2312
568717fd
LC
2313@node The Store
2314@section The Store
2315
e531ac2a
LC
2316@cindex store
2317@cindex store paths
2318
2319Conceptually, the @dfn{store} is where derivations that have been
834129e0 2320successfully built are stored---by default, under @file{/gnu/store}.
e531ac2a
LC
2321Sub-directories in the store are referred to as @dfn{store paths}. The
2322store has an associated database that contains information such has the
2323store paths referred to by each store path, and the list of @emph{valid}
2324store paths---paths that result from a successful build.
2325
2326The store is always accessed by the daemon on behalf of its clients
2327(@pxref{Invoking guix-daemon}). To manipulate the store, clients
2328connect to the daemon over a Unix-domain socket, send it requests, and
2329read the result---these are remote procedure calls, or RPCs.
2330
2331The @code{(guix store)} module provides procedures to connect to the
2332daemon, and to perform RPCs. These are described below.
2333
2334@deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
2335Connect to the daemon over the Unix-domain socket at @var{file}. When
2336@var{reserve-space?} is true, instruct it to reserve a little bit of
2337extra space on the file system so that the garbage collector can still
2338operate, should the disk become full. Return a server object.
2339
2340@var{file} defaults to @var{%default-socket-path}, which is the normal
2341location given the options that were passed to @command{configure}.
2342@end deffn
2343
2344@deffn {Scheme Procedure} close-connection @var{server}
2345Close the connection to @var{server}.
2346@end deffn
2347
2348@defvr {Scheme Variable} current-build-output-port
2349This variable is bound to a SRFI-39 parameter, which refers to the port
2350where build and error logs sent by the daemon should be written.
2351@end defvr
2352
2353Procedures that make RPCs all take a server object as their first
2354argument.
2355
2356@deffn {Scheme Procedure} valid-path? @var{server} @var{path}
2357Return @code{#t} when @var{path} is a valid store path.
2358@end deffn
2359
cfbf9160 2360@deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
e531ac2a
LC
2361Add @var{text} under file @var{name} in the store, and return its store
2362path. @var{references} is the list of store paths referred to by the
2363resulting store path.
2364@end deffn
2365
874e6874 2366@deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
59688fc4
LC
2367Build @var{derivations} (a list of @code{<derivation>} objects or
2368derivation paths), and return when the worker is done building them.
2369Return @code{#t} on success.
874e6874
LC
2370@end deffn
2371
b860f382
LC
2372Note that the @code{(guix monads)} module provides a monad as well as
2373monadic versions of the above procedures, with the goal of making it
2374more convenient to work with code that accesses the store (@pxref{The
2375Store Monad}).
2376
e531ac2a
LC
2377@c FIXME
2378@i{This section is currently incomplete.}
568717fd
LC
2379
2380@node Derivations
2381@section Derivations
2382
874e6874
LC
2383@cindex derivations
2384Low-level build actions and the environment in which they are performed
2385are represented by @dfn{derivations}. A derivation contain the
2386following pieces of information:
2387
2388@itemize
2389@item
2390The outputs of the derivation---derivations produce at least one file or
2391directory in the store, but may produce more.
2392
2393@item
2394The inputs of the derivations, which may be other derivations or plain
2395files in the store (patches, build scripts, etc.)
2396
2397@item
2398The system type targeted by the derivation---e.g., @code{x86_64-linux}.
2399
2400@item
2401The file name of a build script in the store, along with the arguments
2402to be passed.
2403
2404@item
2405A list of environment variables to be defined.
2406
2407@end itemize
2408
2409@cindex derivation path
2410Derivations allow clients of the daemon to communicate build actions to
2411the store. They exist in two forms: as an in-memory representation,
2412both on the client- and daemon-side, and as files in the store whose
2413name end in @code{.drv}---these files are referred to as @dfn{derivation
2414paths}. Derivations paths can be passed to the @code{build-derivations}
2415procedure to perform the build actions they prescribe (@pxref{The
2416Store}).
2417
2418The @code{(guix derivations)} module provides a representation of
2419derivations as Scheme objects, along with procedures to create and
2420otherwise manipulate derivations. The lowest-level primitive to create
2421a derivation is the @code{derivation} procedure:
2422
1909431c
LC
2423@deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
2424 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
2096ef47 2425 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
1909431c 2426 [#:system (%current-system)] [#:references-graphs #f] @
c0468155 2427 [#:allowed-references #f] [#:leaked-env-vars #f] [#:local-build? #f]
59688fc4
LC
2428Build a derivation with the given arguments, and return the resulting
2429@code{<derivation>} object.
874e6874 2430
2096ef47 2431When @var{hash} and @var{hash-algo} are given, a
874e6874 2432@dfn{fixed-output derivation} is created---i.e., one whose result is
36bbbbd1
LC
2433known in advance, such as a file download. If, in addition,
2434@var{recursive?} is true, then that fixed output may be an executable
2435file or a directory and @var{hash} must be the hash of an archive
2436containing this output.
5b0c9d16 2437
858e9282 2438When @var{references-graphs} is true, it must be a list of file
5b0c9d16
LC
2439name/store path pairs. In that case, the reference graph of each store
2440path is exported in the build environment in the corresponding file, in
2441a simple text format.
1909431c 2442
b53be755
LC
2443When @var{allowed-references} is true, it must be a list of store items
2444or outputs that the derivation's output may refer to.
2445
c0468155
LC
2446When @var{leaked-env-vars} is true, it must be a list of strings
2447denoting environment variables that are allowed to ``leak'' from the
2448daemon's environment to the build environment. This is only applicable
2449to fixed-output derivations---i.e., when @var{hash} is true. The main
2450use is to allow variables such as @code{http_proxy} to be passed to
2451derivations that download files.
2452
1909431c
LC
2453When @var{local-build?} is true, declare that the derivation is not a
2454good candidate for offloading and should rather be built locally
2455(@pxref{Daemon Offload Setup}). This is the case for small derivations
2456where the costs of data transfers would outweigh the benefits.
874e6874
LC
2457@end deffn
2458
2459@noindent
2460Here's an example with a shell script as its builder, assuming
2461@var{store} is an open connection to the daemon, and @var{bash} points
2462to a Bash executable in the store:
2463
2464@lisp
2465(use-modules (guix utils)
2466 (guix store)
2467 (guix derivations))
2468
59688fc4
LC
2469(let ((builder ; add the Bash script to the store
2470 (add-text-to-store store "my-builder.sh"
2471 "echo hello world > $out\n" '())))
2472 (derivation store "foo"
2473 bash `("-e" ,builder)
21b679f6 2474 #:inputs `((,bash) (,builder))
59688fc4 2475 #:env-vars '(("HOME" . "/homeless"))))
834129e0 2476@result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
874e6874
LC
2477@end lisp
2478
21b679f6
LC
2479As can be guessed, this primitive is cumbersome to use directly. A
2480better approach is to write build scripts in Scheme, of course! The
2481best course of action for that is to write the build code as a
2482``G-expression'', and to pass it to @code{gexp->derivation}. For more
6621cdb6 2483information, @pxref{G-Expressions}.
21b679f6
LC
2484
2485Once upon a time, @code{gexp->derivation} did not exist and constructing
2486derivations with build code written in Scheme was achieved with
2487@code{build-expression->derivation}, documented below. This procedure
2488is now deprecated in favor of the much nicer @code{gexp->derivation}.
874e6874 2489
dd1a5a15
LC
2490@deffn {Scheme Procedure} build-expression->derivation @var{store} @
2491 @var{name} @var{exp} @
2492 [#:system (%current-system)] [#:inputs '()] @
2493 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
36bbbbd1 2494 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
63a42824
LC
2495 [#:references-graphs #f] [#:allowed-references #f] @
2496 [#:local-build? #f] [#:guile-for-build #f]
874e6874
LC
2497Return a derivation that executes Scheme expression @var{exp} as a
2498builder for derivation @var{name}. @var{inputs} must be a list of
2499@code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
2500@code{"out"} is assumed. @var{modules} is a list of names of Guile
2501modules from the current search path to be copied in the store,
2502compiled, and made available in the load path during the execution of
2503@var{exp}---e.g., @code{((guix build utils) (guix build
2504gnu-build-system))}.
2505
2506@var{exp} is evaluated in an environment where @code{%outputs} is bound
2507to a list of output/path pairs, and where @code{%build-inputs} is bound
2508to a list of string/output-path pairs made from @var{inputs}.
2509Optionally, @var{env-vars} is a list of string pairs specifying the name
2510and value of environment variables visible to the builder. The builder
2511terminates by passing the result of @var{exp} to @code{exit}; thus, when
2512@var{exp} returns @code{#f}, the build is considered to have failed.
2513
2514@var{exp} is built using @var{guile-for-build} (a derivation). When
2515@var{guile-for-build} is omitted or is @code{#f}, the value of the
2516@code{%guile-for-build} fluid is used instead.
9c629a27 2517
63a42824
LC
2518See the @code{derivation} procedure for the meaning of
2519@var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
874e6874
LC
2520@end deffn
2521
2522@noindent
2523Here's an example of a single-output derivation that creates a directory
2524containing one file:
2525
2526@lisp
2527(let ((builder '(let ((out (assoc-ref %outputs "out")))
834129e0 2528 (mkdir out) ; create /gnu/store/@dots{}-goo
874e6874
LC
2529 (call-with-output-file (string-append out "/test")
2530 (lambda (p)
2531 (display '(hello guix) p))))))
dd1a5a15 2532 (build-expression->derivation store "goo" builder))
874e6874 2533
834129e0 2534@result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
874e6874
LC
2535@end lisp
2536
568717fd 2537
b860f382
LC
2538@node The Store Monad
2539@section The Store Monad
2540
2541@cindex monad
2542
2543The procedures that operate on the store described in the previous
2544sections all take an open connection to the build daemon as their first
2545argument. Although the underlying model is functional, they either have
2546side effects or depend on the current state of the store.
2547
2548The former is inconvenient: the connection to the build daemon has to be
2549carried around in all those functions, making it impossible to compose
2550functions that do not take that parameter with functions that do. The
2551latter can be problematic: since store operations have side effects
2552and/or depend on external state, they have to be properly sequenced.
2553
2554@cindex monadic values
2555@cindex monadic functions
2556This is where the @code{(guix monads)} module comes in. This module
2557provides a framework for working with @dfn{monads}, and a particularly
2558useful monad for our uses, the @dfn{store monad}. Monads are a
2559construct that allows two things: associating ``context'' with values
2560(in our case, the context is the store), and building sequences of
561fb6c3 2561computations (here computations include accesses to the store.) Values
b860f382
LC
2562in a monad---values that carry this additional context---are called
2563@dfn{monadic values}; procedures that return such values are called
2564@dfn{monadic procedures}.
2565
2566Consider this ``normal'' procedure:
2567
2568@example
45adbd62
LC
2569(define (sh-symlink store)
2570 ;; Return a derivation that symlinks the 'bash' executable.
2571 (let* ((drv (package-derivation store bash))
2572 (out (derivation->output-path drv))
2573 (sh (string-append out "/bin/bash")))
2574 (build-expression->derivation store "sh"
2575 `(symlink ,sh %output))))
b860f382
LC
2576@end example
2577
c6f30b81
LC
2578Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
2579as a monadic function:
b860f382
LC
2580
2581@example
45adbd62 2582(define (sh-symlink)
b860f382 2583 ;; Same, but return a monadic value.
c6f30b81
LC
2584 (mlet %store-monad ((drv (package->derivation bash)))
2585 (gexp->derivation "sh"
2586 #~(symlink (string-append #$drv "/bin/bash")
2587 #$output))))
b860f382
LC
2588@end example
2589
c6f30b81
LC
2590There several things to note in the second version: the @code{store}
2591parameter is now implicit and is ``threaded'' in the calls to the
2592@code{package->derivation} and @code{gexp->derivation} monadic
2593procedures, and the monadic value returned by @code{package->derivation}
2594is @dfn{bound} using @code{mlet} instead of plain @code{let}.
2595
2596As it turns out, the call to @code{package->derivation} can even be
2597omitted since it will take place implicitly, as we will see later
2598(@pxref{G-Expressions}):
2599
2600@example
2601(define (sh-symlink)
2602 (gexp->derivation "sh"
2603 #~(symlink (string-append #$bash "/bin/bash")
2604 #$output)))
2605@end example
b860f382 2606
8e9aa37f 2607Calling the monadic @code{sh-symlink} has no effect. To get the desired
b860f382
LC
2608effect, one must use @code{run-with-store}:
2609
2610@example
8e9aa37f
CAW
2611(run-with-store (open-connection) (sh-symlink))
2612@result{} /gnu/store/...-sh-symlink
b860f382
LC
2613@end example
2614
b9b86078
LC
2615Note that the @code{(guix monad-repl)} module extends Guile's REPL with
2616new ``meta-commands'' to make it easier to deal with monadic procedures:
2617@code{run-in-store}, and @code{enter-store-monad}. The former, is used
2618to ``run'' a single monadic value through the store:
2619
2620@example
2621scheme@@(guile-user)> ,run-in-store (package->derivation hello)
2622$1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2623@end example
2624
2625The latter enters a recursive REPL, where all the return values are
2626automatically run through the store:
2627
2628@example
2629scheme@@(guile-user)> ,enter-store-monad
2630store-monad@@(guile-user) [1]> (package->derivation hello)
2631$2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
2632store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
2633$3 = "/gnu/store/@dots{}-foo"
2634store-monad@@(guile-user) [1]> ,q
2635scheme@@(guile-user)>
2636@end example
2637
2638@noindent
2639Note that non-monadic values cannot be returned in the
2640@code{store-monad} REPL.
2641
e87f0591
LC
2642The main syntactic forms to deal with monads in general are provided by
2643the @code{(guix monads)} module and are described below.
b860f382
LC
2644
2645@deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
2646Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
2647in @var{monad}.
2648@end deffn
2649
2650@deffn {Scheme Syntax} return @var{val}
2651Return a monadic value that encapsulates @var{val}.
2652@end deffn
2653
2654@deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
2655@dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
2656procedure @var{mproc}@footnote{This operation is commonly referred to as
2657``bind'', but that name denotes an unrelated procedure in Guile. Thus
2658we use this somewhat cryptic symbol inherited from the Haskell
2659language.}.
2660@end deffn
2661
2662@deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
2663 @var{body} ...
2664@deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
2665 @var{body} ...
2666Bind the variables @var{var} to the monadic values @var{mval} in
2667@var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
2668``normal'' value @var{val}, as per @code{let}.
2669
2670@code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
2671(@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
2672@end deffn
2673
405a9d4e
LC
2674@deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
2675Bind @var{mexp} and the following monadic expressions in sequence,
2676returning the result of the last expression.
2677
2678This is akin to @code{mlet}, except that the return values of the
2679monadic expressions are ignored. In that sense, it is analogous to
2680@code{begin}, but applied to monadic expressions.
2681@end deffn
2682
561fb6c3
LC
2683@cindex state monad
2684The @code{(guix monads)} module provides the @dfn{state monad}, which
2685allows an additional value---the state---to be @emph{threaded} through
2686monadic procedure calls.
2687
2688@defvr {Scheme Variable} %state-monad
2689The state monad. Procedures in the state monad can access and change
2690the state that is threaded.
2691
2692Consider the example below. The @code{square} procedure returns a value
2693in the state monad. It returns the square of its argument, but also
2694increments the current state value:
2695
2696@example
2697(define (square x)
2698 (mlet %state-monad ((count (current-state)))
2699 (mbegin %state-monad
2700 (set-current-state (+ 1 count))
2701 (return (* x x)))))
2702
2703(run-with-state (sequence %state-monad (map square (iota 3))) 0)
2704@result{} (0 1 4)
2705@result{} 3
2706@end example
2707
2708When ``run'' through @var{%state-monad}, we obtain that additional state
2709value, which is the number of @code{square} calls.
2710@end defvr
2711
2712@deffn {Monadic Procedure} current-state
2713Return the current state as a monadic value.
2714@end deffn
2715
2716@deffn {Monadic Procedure} set-current-state @var{value}
2717Set the current state to @var{value} and return the previous state as a
2718monadic value.
2719@end deffn
2720
2721@deffn {Monadic Procedure} state-push @var{value}
2722Push @var{value} to the current state, which is assumed to be a list,
2723and return the previous state as a monadic value.
2724@end deffn
2725
2726@deffn {Monadic Procedure} state-pop
2727Pop a value from the current state and return it as a monadic value.
2728The state is assumed to be a list.
2729@end deffn
2730
2731@deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
2732Run monadic value @var{mval} starting with @var{state} as the initial
2733state. Return two values: the resulting value, and the resulting state.
2734@end deffn
2735
e87f0591
LC
2736The main interface to the store monad, provided by the @code{(guix
2737store)} module, is as follows.
b860f382
LC
2738
2739@defvr {Scheme Variable} %store-monad
561fb6c3
LC
2740The store monad---an alias for @var{%state-monad}.
2741
2742Values in the store monad encapsulate accesses to the store. When its
2743effect is needed, a value of the store monad must be ``evaluated'' by
2744passing it to the @code{run-with-store} procedure (see below.)
b860f382
LC
2745@end defvr
2746
2747@deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
2748Run @var{mval}, a monadic value in the store monad, in @var{store}, an
2749open store connection.
2750@end deffn
2751
ad372953 2752@deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
b860f382 2753Return as a monadic value the absolute file name in the store of the file
ad372953
LC
2754containing @var{text}, a string. @var{references} is a list of store items that the
2755resulting text file refers to; it defaults to the empty list.
45adbd62
LC
2756@end deffn
2757
0a90af15
LC
2758@deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
2759 [#:recursive? #t]
2760Return the name of @var{file} once interned in the store. Use
2761@var{name} as its store name, or the basename of @var{file} if
2762@var{name} is omitted.
2763
2764When @var{recursive?} is true, the contents of @var{file} are added
2765recursively; if @var{file} designates a flat file and @var{recursive?}
2766is true, its contents are added, and its permission bits are kept.
2767
2768The example below adds a file to the store, under two different names:
2769
2770@example
2771(run-with-store (open-connection)
2772 (mlet %store-monad ((a (interned-file "README"))
2773 (b (interned-file "README" "LEGU-MIN")))
2774 (return (list a b))))
2775
2776@result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
2777@end example
2778
2779@end deffn
2780
e87f0591
LC
2781The @code{(guix packages)} module exports the following package-related
2782monadic procedures:
2783
b860f382 2784@deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
4231f05b
LC
2785 [#:system (%current-system)] [#:target #f] @
2786 [#:output "out"] Return as a monadic
b860f382
LC
2787value in the absolute file name of @var{file} within the @var{output}
2788directory of @var{package}. When @var{file} is omitted, return the name
4231f05b
LC
2789of the @var{output} directory of @var{package}. When @var{target} is
2790true, use it as a cross-compilation target triplet.
b860f382
LC
2791@end deffn
2792
b860f382 2793@deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
4231f05b
LC
2794@deffnx {Monadic Procedure} package->cross-derivation @var{package} @
2795 @var{target} [@var{system}]
2796Monadic version of @code{package-derivation} and
2797@code{package-cross-derivation} (@pxref{Defining Packages}).
b860f382
LC
2798@end deffn
2799
2800
21b679f6
LC
2801@node G-Expressions
2802@section G-Expressions
2803
2804@cindex G-expression
2805@cindex build code quoting
2806So we have ``derivations'', which represent a sequence of build actions
2807to be performed to produce an item in the store (@pxref{Derivations}).
2808Those build actions are performed when asking the daemon to actually
2809build the derivations; they are run by the daemon in a container
2810(@pxref{Invoking guix-daemon}).
2811
2812@cindex strata of code
2813It should come as no surprise that we like to write those build actions
2814in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
2815code@footnote{The term @dfn{stratum} in this context was coined by
ef4ab0a4
LC
2816Manuel Serrano et al.@: in the context of their work on Hop. Oleg
2817Kiselyov, who has written insightful
2818@url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
2819on this topic}, refers to this kind of code generation as
2820@dfn{staging}.}: the ``host code''---code that defines packages, talks
2821to the daemon, etc.---and the ``build code''---code that actually
2822performs build actions, such as making directories, invoking
2823@command{make}, etc.
21b679f6
LC
2824
2825To describe a derivation and its build actions, one typically needs to
2826embed build code inside host code. It boils down to manipulating build
2827code as data, and Scheme's homoiconicity---code has a direct
2828representation as data---comes in handy for that. But we need more than
2829Scheme's normal @code{quasiquote} mechanism to construct build
2830expressions.
2831
2832The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
2833S-expressions adapted to build expressions. G-expressions, or
2834@dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
2835@code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
2836@code{#$}, and @code{#$@@}), which are comparable respectively to
2837@code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
2838(@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
2839Reference Manual}). However, there are major differences:
2840
2841@itemize
2842@item
2843Gexps are meant to be written to a file and run or manipulated by other
2844processes.
2845
2846@item
b39fc6f7
LC
2847When a high-level object such as a package or derivation is unquoted
2848inside a gexp, the result is as if its output file name had been
2849introduced.
ff40e9b7 2850
21b679f6
LC
2851@item
2852Gexps carry information about the packages or derivations they refer to,
2853and these dependencies are automatically added as inputs to the build
2854processes that use them.
2855@end itemize
2856
b39fc6f7
LC
2857Actually this mechanism is not limited to package and derivation
2858objects; @dfn{compilers} able to ``lower'' other high-level objects to
2859derivations can be defined, such that these objects can also be inserted
d9ae938f
LC
2860into gexps. Another useful type of high-level object that can be
2861inserted in a gexp is @dfn{local files}, which allows files from the
2862local file system to be added to the store and referred to by
2863derivations and such (see @code{local-file} below.)
b39fc6f7 2864
21b679f6
LC
2865To illustrate the idea, here is an example of a gexp:
2866
2867@example
2868(define build-exp
2869 #~(begin
2870 (mkdir #$output)
2871 (chdir #$output)
aff8ce7c 2872 (symlink (string-append #$coreutils "/bin/ls")
21b679f6
LC
2873 "list-files")))
2874@end example
2875
2876This gexp can be passed to @code{gexp->derivation}; we obtain a
2877derivation that builds a directory containing exactly one symlink to
2878@file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
2879
2880@example
2881(gexp->derivation "the-thing" build-exp)
2882@end example
2883
e20fd1bf 2884As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
21b679f6
LC
2885substituted to the reference to the @var{coreutils} package in the
2886actual build code, and @var{coreutils} is automatically made an input to
2887the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
2888output)}) is replaced by a string containing the derivation's output
667b2508
LC
2889directory name.
2890
2891@cindex cross compilation
2892In a cross-compilation context, it is useful to distinguish between
2893references to the @emph{native} build of a package---that can run on the
2894host---versus references to cross builds of a package. To that end, the
2895@code{#+} plays the same role as @code{#$}, but is a reference to a
2896native package build:
2897
2898@example
2899(gexp->derivation "vi"
2900 #~(begin
2901 (mkdir #$output)
2902 (system* (string-append #+coreutils "/bin/ln")
2903 "-s"
2904 (string-append #$emacs "/bin/emacs")
2905 (string-append #$output "/bin/vi")))
2906 #:target "mips64el-linux")
2907@end example
2908
2909@noindent
2910In the example above, the native build of @var{coreutils} is used, so
2911that @command{ln} can actually run on the host; but then the
2912cross-compiled build of @var{emacs} is referenced.
2913
2914The syntactic form to construct gexps is summarized below.
21b679f6
LC
2915
2916@deffn {Scheme Syntax} #~@var{exp}
2917@deffnx {Scheme Syntax} (gexp @var{exp})
2918Return a G-expression containing @var{exp}. @var{exp} may contain one
2919or more of the following forms:
2920
2921@table @code
2922@item #$@var{obj}
2923@itemx (ungexp @var{obj})
b39fc6f7
LC
2924Introduce a reference to @var{obj}. @var{obj} may have one of the
2925supported types, for example a package or a
21b679f6
LC
2926derivation, in which case the @code{ungexp} form is replaced by its
2927output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
2928
b39fc6f7
LC
2929If @var{obj} is a list, it is traversed and references to supported
2930objects are substituted similarly.
21b679f6
LC
2931
2932If @var{obj} is another gexp, its contents are inserted and its
2933dependencies are added to those of the containing gexp.
2934
2935If @var{obj} is another kind of object, it is inserted as is.
2936
b39fc6f7
LC
2937@item #$@var{obj}:@var{output}
2938@itemx (ungexp @var{obj} @var{output})
21b679f6 2939This is like the form above, but referring explicitly to the
b39fc6f7
LC
2940@var{output} of @var{obj}---this is useful when @var{obj} produces
2941multiple outputs (@pxref{Packages with Multiple Outputs}).
21b679f6 2942
667b2508
LC
2943@item #+@var{obj}
2944@itemx #+@var{obj}:output
2945@itemx (ungexp-native @var{obj})
2946@itemx (ungexp-native @var{obj} @var{output})
2947Same as @code{ungexp}, but produces a reference to the @emph{native}
2948build of @var{obj} when used in a cross compilation context.
2949
21b679f6
LC
2950@item #$output[:@var{output}]
2951@itemx (ungexp output [@var{output}])
2952Insert a reference to derivation output @var{output}, or to the main
2953output when @var{output} is omitted.
2954
2955This only makes sense for gexps passed to @code{gexp->derivation}.
2956
2957@item #$@@@var{lst}
2958@itemx (ungexp-splicing @var{lst})
2959Like the above, but splices the contents of @var{lst} inside the
2960containing list.
2961
667b2508
LC
2962@item #+@@@var{lst}
2963@itemx (ungexp-native-splicing @var{lst})
2964Like the above, but refers to native builds of the objects listed in
2965@var{lst}.
2966
21b679f6
LC
2967@end table
2968
2969G-expressions created by @code{gexp} or @code{#~} are run-time objects
2970of the @code{gexp?} type (see below.)
2971@end deffn
2972
2973@deffn {Scheme Procedure} gexp? @var{obj}
2974Return @code{#t} if @var{obj} is a G-expression.
2975@end deffn
2976
2977G-expressions are meant to be written to disk, either as code building
2978some derivation, or as plain files in the store. The monadic procedures
2979below allow you to do that (@pxref{The Store Monad}, for more
2980information about monads.)
2981
2982@deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
ce45eb4c 2983 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
21b679f6
LC
2984 [#:hash #f] [#:hash-algo #f] @
2985 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
4684f301 2986 [#:module-path @var{%load-path}] @
c8351d9a 2987 [#:references-graphs #f] [#:allowed-references #f] @
c0468155 2988 [#:leaked-env-vars #f] @
c8351d9a 2989 [#:local-build? #f] [#:guile-for-build #f]
21b679f6 2990Return a derivation @var{name} that runs @var{exp} (a gexp) with
68a61e9f
LC
2991@var{guile-for-build} (a derivation) on @var{system}. When @var{target}
2992is true, it is used as the cross-compilation target triplet for packages
2993referred to by @var{exp}.
21b679f6 2994
ce45eb4c
LC
2995Make @var{modules} available in the evaluation context of @var{exp};
2996@var{modules} is a list of names of Guile modules searched in
2997@var{module-path} to be copied in the store, compiled, and made available in
21b679f6
LC
2998the load path during the execution of @var{exp}---e.g., @code{((guix
2999build utils) (guix build gnu-build-system))}.
3000
ce45eb4c
LC
3001@var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3002applicable.
3003
b53833b2
LC
3004When @var{references-graphs} is true, it must be a list of tuples of one of the
3005following forms:
3006
3007@example
3008(@var{file-name} @var{package})
3009(@var{file-name} @var{package} @var{output})
3010(@var{file-name} @var{derivation})
3011(@var{file-name} @var{derivation} @var{output})
3012(@var{file-name} @var{store-item})
3013@end example
3014
3015The right-hand-side of each element of @var{references-graphs} is automatically made
3016an input of the build process of @var{exp}. In the build environment, each
3017@var{file-name} contains the reference graph of the corresponding item, in a simple
3018text format.
3019
c8351d9a
LC
3020@var{allowed-references} must be either @code{#f} or a list of output names and packages.
3021In the latter case, the list denotes store items that the result is allowed to
3022refer to. Any reference to another store item will lead to a build error.
3023
e20fd1bf 3024The other arguments are as for @code{derivation} (@pxref{Derivations}).
21b679f6
LC
3025@end deffn
3026
d9ae938f
LC
3027@deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
3028 [#:recursive? #t]
3029Return an object representing local file @var{file} to add to the store; this
3030object can be used in a gexp. @var{file} will be added to the store under @var{name}--by
3031default the base name of @var{file}.
3032
3033When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
3034designates a flat file and @var{recursive?} is true, its contents are added, and its
3035permission bits are kept.
3036
3037This is the declarative counterpart of the @code{interned-file} monadic
3038procedure (@pxref{The Store Monad, @code{interned-file}}).
3039@end deffn
3040
21b679f6
LC
3041@deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
3042Return an executable script @var{name} that runs @var{exp} using
3043@var{guile} with @var{modules} in its search path.
3044
3045The example below builds a script that simply invokes the @command{ls}
3046command:
3047
3048@example
3049(use-modules (guix gexp) (gnu packages base))
3050
3051(gexp->script "list-files"
3052 #~(execl (string-append #$coreutils "/bin/ls")
3053 "ls"))
3054@end example
3055
3056When ``running'' it through the store (@pxref{The Store Monad,
e20fd1bf 3057@code{run-with-store}}), we obtain a derivation that produces an
21b679f6
LC
3058executable file @file{/gnu/store/@dots{}-list-files} along these lines:
3059
3060@example
3061#!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
3062!#
3063(execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
3064 "ls")
3065@end example
3066@end deffn
3067
3068@deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
3069Return a derivation that builds a file @var{name} containing @var{exp}.
3070
3071The resulting file holds references to all the dependencies of @var{exp}
3072or a subset thereof.
3073@end deffn
1ed19464
LC
3074
3075@deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
3076Return as a monadic value a derivation that builds a text file
3077containing all of @var{text}. @var{text} may list, in addition to
d9ae938f
LC
3078strings, objects of any type that can be used in a gexp: packages,
3079derivations, local file objects, etc. The resulting store file holds
3080references to all these.
1ed19464
LC
3081
3082This variant should be preferred over @code{text-file} anytime the file
3083to create will reference items from the store. This is typically the
3084case when building a configuration file that embeds store file names,
3085like this:
3086
3087@example
3088(define (profile.sh)
3089 ;; Return the name of a shell script in the store that
3090 ;; initializes the 'PATH' environment variable.
3091 (text-file* "profile.sh"
3092 "export PATH=" coreutils "/bin:"
3093 grep "/bin:" sed "/bin\n"))
3094@end example
3095
3096In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
3097will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
3098preventing them from being garbage-collected during its lifetime.
3099@end deffn
21b679f6
LC
3100
3101Of course, in addition to gexps embedded in ``host'' code, there are
3102also modules containing build tools. To make it clear that they are
3103meant to be used in the build stratum, these modules are kept in the
3104@code{(guix build @dots{})} name space.
3105
3106
568717fd
LC
3107@c *********************************************************************
3108@node Utilities
3109@chapter Utilities
3110
210cc920
LC
3111This section describes tools primarily targeted at developers and users
3112who write new package definitions. They complement the Scheme
3113programming interface of Guix in a convenient way.
3114
568717fd 3115@menu
37166310 3116* Invoking guix build:: Building packages from the command line.
210cc920 3117* Invoking guix download:: Downloading a file and printing its hash.
37166310 3118* Invoking guix hash:: Computing the cryptographic hash of a file.
2f7d2d91 3119* Invoking guix import:: Importing package definitions.
37166310 3120* Invoking guix refresh:: Updating package definitions.
b4f5e0e8 3121* Invoking guix lint:: Finding errors in package definitions.
372c4bbc 3122* Invoking guix environment:: Setting up development environments.
aff8ce7c 3123* Invoking guix publish:: Sharing substitutes.
568717fd
LC
3124@end menu
3125
e49951eb
MW
3126@node Invoking guix build
3127@section Invoking @command{guix build}
568717fd 3128
e49951eb 3129The @command{guix build} command builds packages or derivations and
6798a8e4
LC
3130their dependencies, and prints the resulting store paths. Note that it
3131does not modify the user's profile---this is the job of the
e49951eb 3132@command{guix package} command (@pxref{Invoking guix package}). Thus,
6798a8e4
LC
3133it is mainly useful for distribution developers.
3134
3135The general syntax is:
c78bd12b
LC
3136
3137@example
e49951eb 3138guix build @var{options} @var{package-or-derivation}@dots{}
c78bd12b
LC
3139@end example
3140
3141@var{package-or-derivation} may be either the name of a package found in
5401dd75
LC
3142the software distribution such as @code{coreutils} or
3143@code{coreutils-8.20}, or a derivation such as
834129e0 3144@file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
e7f34eb0
LC
3145package with the corresponding name (and optionally version) is searched
3146for among the GNU distribution modules (@pxref{Package Modules}).
3147
3148Alternatively, the @code{--expression} option may be used to specify a
3149Scheme expression that evaluates to a package; this is useful when
3150disambiguation among several same-named packages or package variants is
3151needed.
c78bd12b
LC
3152
3153The @var{options} may be zero or more of the following:
3154
3155@table @code
3156
3157@item --expression=@var{expr}
3158@itemx -e @var{expr}
ac5de156 3159Build the package or derivation @var{expr} evaluates to.
c78bd12b 3160
5401dd75 3161For example, @var{expr} may be @code{(@@ (gnu packages guile)
c78bd12b
LC
3162guile-1.8)}, which unambiguously designates this specific variant of
3163version 1.8 of Guile.
3164
56b82106
LC
3165Alternately, @var{expr} may be a G-expression, in which case it is used
3166as a build program passed to @code{gexp->derivation}
3167(@pxref{G-Expressions}).
3168
3169Lastly, @var{expr} may refer to a zero-argument monadic procedure
ac5de156
LC
3170(@pxref{The Store Monad}). The procedure must return a derivation as a
3171monadic value, which is then passed through @code{run-with-store}.
3172
c78bd12b
LC
3173@item --source
3174@itemx -S
3175Build the packages' source derivations, rather than the packages
3176themselves.
3177
e49951eb 3178For instance, @code{guix build -S gcc} returns something like
834129e0 3179@file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
c78bd12b 3180
f9cc8971
LC
3181The returned source tarball is the result of applying any patches and
3182code snippets specified in the package's @code{origin} (@pxref{Defining
3183Packages}).
3184
2cdfe13d
EB
3185@item --sources
3186Fetch and return the source of @var{package-or-derivation} and all their
3187dependencies, recursively. This is a handy way to obtain a local copy
3188of all the source code needed to build @var{packages}, allowing you to
3189eventually build them even without network access. It is an extension
3190of the @code{--source} option and can accept one of the following
3191optional argument values:
3192
3193@table @code
3194@item package
3195This value causes the @code{--sources} option to behave in the same way
3196as the @code{--source} option.
3197
3198@item all
3199Build all packages' source derivations, including any source that might
3200be listed as @code{inputs}. This is the default value.
3201
3202@example
3203$ guix build --sources tzdata
3204The following derivations will be built:
3205 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
3206 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3207@end example
3208
3209@item transitive
3210Build all packages' source derivations, as well as all source
3211derivations for packages' transitive inputs. This can be used e.g. to
3212prefetch package source for later offline building.
3213
3214@example
3215$ guix build --sources=transitive tzdata
3216The following derivations will be built:
3217 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
3218 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
3219 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
3220 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
3221 /gnu/store/@dots{}-make-4.1.tar.xz.drv
3222 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
3223@dots{}
3224@end example
3225
3226@end table
3227
c78bd12b
LC
3228@item --system=@var{system}
3229@itemx -s @var{system}
3230Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
3231the host's system type.
3232
3233An example use of this is on Linux-based systems, which can emulate
3234different personalities. For instance, passing
3235@code{--system=i686-linux} on an @code{x86_64-linux} system allows users
3236to build packages in a complete 32-bit environment.
3237
e55ec43d
LC
3238@item --target=@var{triplet}
3239@cindex cross-compilation
3240Cross-build for @var{triplet}, which must be a valid GNU triplet, such
3241as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
3242configuration triplets,, configure, GNU Configure and Build System}).
3243
7f3673f2
LC
3244@item --with-source=@var{source}
3245Use @var{source} as the source of the corresponding package.
3246@var{source} must be a file name or a URL, as for @command{guix
3247download} (@pxref{Invoking guix download}).
3248
3249The ``corresponding package'' is taken to be one specified on the
3250command line whose name matches the base of @var{source}---e.g., if
3251@var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
3252package is @code{guile}. Likewise, the version string is inferred from
3253@var{source}; in the previous example, it's @code{2.0.10}.
3254
3255This option allows users to try out versions of packages other than the
3256one provided by the distribution. The example below downloads
3257@file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
3258the @code{ed} package:
3259
3260@example
3261guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
3262@end example
3263
3264As a developer, @code{--with-source} makes it easy to test release
3265candidates:
3266
3267@example
3268guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
3269@end example
3270
05962f29
LC
3271@item --no-grafts
3272Do not ``graft'' packages. In practice, this means that package updates
3273available as grafts are not applied. @xref{Security Updates}, for more
3274information on grafts.
7f3673f2 3275
c78bd12b
LC
3276@item --derivations
3277@itemx -d
3278Return the derivation paths, not the output paths, of the given
3279packages.
3280
70ee5642
LC
3281@item --root=@var{file}
3282@itemx -r @var{file}
3283Make @var{file} a symlink to the result, and register it as a garbage
3284collector root.
3285
3286@item --log-file
3287Return the build log file names for the given
3288@var{package-or-derivation}s, or raise an error if build logs are
3289missing.
3290
3291This works regardless of how packages or derivations are specified. For
3292instance, the following invocations are equivalent:
3293
3294@example
3295guix build --log-file `guix build -d guile`
3296guix build --log-file `guix build guile`
3297guix build --log-file guile
3298guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
3299@end example
3300
3301
3302@end table
3303
3304@cindex common build options
3305In addition, a number of options that control the build process are
3306common to @command{guix build} and other commands that can spawn builds,
3307such as @command{guix package} or @command{guix archive}. These are the
3308following:
3309
3310@table @code
3311
300868ba
LC
3312@item --load-path=@var{directory}
3313@itemx -L @var{directory}
3314Add @var{directory} to the front of the package module search path
3315(@pxref{Package Modules}).
3316
3317This allows users to define their own packages and make them visible to
3318the command-line tools.
3319
c78bd12b
LC
3320@item --keep-failed
3321@itemx -K
3322Keep the build tree of failed builds. Thus, if a build fail, its build
3323tree is kept under @file{/tmp}, in a directory whose name is shown at
3324the end of the build log. This is useful when debugging build issues.
3325
3326@item --dry-run
3327@itemx -n
3328Do not build the derivations.
3329
56b1f4b7
LC
3330@item --fallback
3331When substituting a pre-built binary fails, fall back to building
3332packages locally.
3333
c78bd12b 3334@item --no-substitutes
b5385b52 3335Do not use substitutes for build products. That is, always build things
c4202d60
LC
3336locally instead of allowing downloads of pre-built binaries
3337(@pxref{Substitutes}).
c78bd12b 3338
425b0bfc 3339@item --no-build-hook
4ec2e92d
LC
3340Do not attempt to offload builds @i{via} the daemon's ``build hook''
3341(@pxref{Daemon Offload Setup}). That is, always build things locally
3342instead of offloading builds to remote machines.
425b0bfc 3343
969e678e
LC
3344@item --max-silent-time=@var{seconds}
3345When the build or substitution process remains silent for more than
3346@var{seconds}, terminate it and report a build failure.
3347
002622b6
LC
3348@item --timeout=@var{seconds}
3349Likewise, when the build or substitution process lasts for more than
3350@var{seconds}, terminate it and report a build failure.
3351
3352By default there is no timeout. This behavior can be restored with
3353@code{--timeout=0}.
3354
07ab4bf1
LC
3355@item --verbosity=@var{level}
3356Use the given verbosity level. @var{level} must be an integer between 0
3357and 5; higher means more verbose output. Setting a level of 4 or more
3358may be helpful when debugging setup issues with the build daemon.
3359
70ee5642
LC
3360@item --cores=@var{n}
3361@itemx -c @var{n}
3362Allow the use of up to @var{n} CPU cores for the build. The special
3363value @code{0} means to use as many CPU cores as available.
bf421152 3364
f6526eb3
LC
3365@item --max-jobs=@var{n}
3366@itemx -M @var{n}
3367Allow at most @var{n} build jobs in parallel. @xref{Invoking
3368guix-daemon, @code{--max-jobs}}, for details about this option and the
3369equivalent @command{guix-daemon} option.
3370
c78bd12b
LC
3371@end table
3372
e49951eb 3373Behind the scenes, @command{guix build} is essentially an interface to
c78bd12b
LC
3374the @code{package-derivation} procedure of the @code{(guix packages)}
3375module, and to the @code{build-derivations} procedure of the @code{(guix
01d8ac64 3376derivations)} module.
c78bd12b 3377
16eb115e
DP
3378In addition to options explicitly passed on the command line,
3379@command{guix build} and other @command{guix} commands that support
3380building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
3381
3382@defvr {Environment Variable} GUIX_BUILD_OPTIONS
3383Users can define this variable to a list of command line options that
3384will automatically be used by @command{guix build} and other
3385@command{guix} commands that can perform builds, as in the example
3386below:
3387
3388@example
3389$ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
3390@end example
3391
847391fe
DP
3392These options are parsed independently, and the result is appended to
3393the parsed command-line options.
16eb115e
DP
3394@end defvr
3395
3396
210cc920
LC
3397@node Invoking guix download
3398@section Invoking @command{guix download}
3399
3400When writing a package definition, developers typically need to download
3401the package's source tarball, compute its SHA256 hash, and write that
3402hash in the package definition (@pxref{Defining Packages}). The
3403@command{guix download} tool helps with this task: it downloads a file
3404from the given URI, adds it to the store, and prints both its file name
3405in the store and its SHA256 hash.
3406
3407The fact that the downloaded file is added to the store saves bandwidth:
3408when the developer eventually tries to build the newly defined package
3409with @command{guix build}, the source tarball will not have to be
3410downloaded again because it is already in the store. It is also a
3411convenient way to temporarily stash files, which may be deleted
3412eventually (@pxref{Invoking guix gc}).
3413
3414The @command{guix download} command supports the same URIs as used in
3415package definitions. In particular, it supports @code{mirror://} URIs.
3416@code{https} URIs (HTTP over TLS) are supported @emph{provided} the
3417Guile bindings for GnuTLS are available in the user's environment; when
537c8bb3
LC
3418they are not available, an error is raised. @xref{Guile Preparations,
3419how to install the GnuTLS bindings for Guile,, gnutls-guile,
3420GnuTLS-Guile}, for more information.
210cc920
LC
3421
3422The following option is available:
3423
3424@table @code
3425@item --format=@var{fmt}
3426@itemx -f @var{fmt}
3427Write the hash in the format specified by @var{fmt}. For more
081145cf 3428information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
210cc920
LC
3429@end table
3430
6c365eca
NK
3431@node Invoking guix hash
3432@section Invoking @command{guix hash}
3433
210cc920 3434The @command{guix hash} command computes the SHA256 hash of a file.
6c365eca
NK
3435It is primarily a convenience tool for anyone contributing to the
3436distribution: it computes the cryptographic hash of a file, which can be
3437used in the definition of a package (@pxref{Defining Packages}).
3438
3439The general syntax is:
3440
3441@example
3442guix hash @var{option} @var{file}
3443@end example
3444
3445@command{guix hash} has the following option:
3446
3447@table @code
3448
3449@item --format=@var{fmt}
3450@itemx -f @var{fmt}
210cc920 3451Write the hash in the format specified by @var{fmt}.
6c365eca
NK
3452
3453Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
3454(@code{hex} and @code{hexadecimal} can be used as well).
3455
3456If the @option{--format} option is not specified, @command{guix hash}
3457will output the hash in @code{nix-base32}. This representation is used
3458in the definitions of packages.
3459
3140f2df
LC
3460@item --recursive
3461@itemx -r
3462Compute the hash on @var{file} recursively.
3463
3464In this case, the hash is computed on an archive containing @var{file},
3465including its children if it is a directory. Some of @var{file}'s
3466meta-data is part of the archive; for instance, when @var{file} is a
3467regular file, the hash is different depending on whether @var{file} is
3468executable or not. Meta-data such as time stamps has no impact on the
3469hash (@pxref{Invoking guix archive}).
3470@c FIXME: Replace xref above with xref to an ``Archive'' section when
3471@c it exists.
3472
6c365eca
NK
3473@end table
3474
2f7d2d91
LC
3475@node Invoking guix import
3476@section Invoking @command{guix import}
3477
3478@cindex importing packages
3479@cindex package import
3480@cindex package conversion
3481The @command{guix import} command is useful for people willing to add a
3482package to the distribution but who'd rather do as little work as
3483possible to get there---a legitimate demand. The command knows of a few
3484repositories from which it can ``import'' package meta-data. The result
3485is a package definition, or a template thereof, in the format we know
3486(@pxref{Defining Packages}).
3487
3488The general syntax is:
3489
3490@example
3491guix import @var{importer} @var{options}@dots{}
3492@end example
3493
3494@var{importer} specifies the source from which to import package
3495meta-data, and @var{options} specifies a package identifier and other
3496options specific to @var{importer}. Currently, the available
3497``importers'' are:
3498
3499@table @code
3500@item gnu
3501Import meta-data for the given GNU package. This provides a template
3502for the latest version of that GNU package, including the hash of its
3503source tarball, and its canonical synopsis and description.
3504
3505Additional information such as the package's dependencies and its
3506license needs to be figured out manually.
3507
3508For example, the following command returns a package definition for
3509GNU@tie{}Hello:
3510
3511@example
3512guix import gnu hello
3513@end example
3514
3515Specific command-line options are:
3516
3517@table @code
3518@item --key-download=@var{policy}
3519As for @code{guix refresh}, specify the policy to handle missing OpenPGP
3520keys when verifying the package's signature. @xref{Invoking guix
3521refresh, @code{--key-download}}.
3522@end table
3523
3524@item pypi
3525@cindex pypi
3526Import meta-data from the @uref{https://pypi.python.org/, Python Package
3527Index}@footnote{This functionality requires Guile-JSON to be installed.
3528@xref{Requirements}.}. Information is taken from the JSON-formatted
3529description available at @code{pypi.python.org} and usually includes all
3530the relevant information, including package dependencies.
3531
3532The command below imports meta-data for the @code{itsdangerous} Python
3533package:
3534
3535@example
3536guix import pypi itsdangerous
3537@end example
3538
d45dc6da
EB
3539@item cpan
3540@cindex CPAN
3541Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}.
3542Information is taken from the JSON-formatted meta-data provided through
3543@uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
66392e47
EB
3544relevant information, such as module dependencies. License information
3545should be checked closely. If Perl is available in the store, then the
3546@code{corelist} utility will be used to filter core modules out of the
3547list of dependencies.
d45dc6da
EB
3548
3549The command command below imports meta-data for the @code{Acme::Boolean}
3550Perl module:
3551
3552@example
3553guix import cpan Acme::Boolean
3554@end example
3555
2f7d2d91
LC
3556@item nix
3557Import meta-data from a local copy of the source of the
3558@uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
3559relies on the @command{nix-instantiate} command of
3560@uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
3561typically written in a mixture of Nix-language and Bash code. This
3562command only imports the high-level package structure that is written in
3563the Nix language. It normally includes all the basic fields of a
3564package definition.
3565
3566When importing a GNU package, the synopsis and descriptions are replaced
3567by their canonical upstream variant.
3568
3569As an example, the command below imports the package definition of
3570LibreOffice (more precisely, it imports the definition of the package
3571bound to the @code{libreoffice} top-level attribute):
3572
3573@example
3574guix import nix ~/path/to/nixpkgs libreoffice
3575@end example
863af4e1
FB
3576
3577@item hackage
3578@cindex hackage
3579Import meta-data from Haskell community's central package archive
3580@uref{https://hackage.haskell.org/, Hackage}. Information is taken from
3581Cabal files and includes all the relevant information, including package
3582dependencies.
3583
3584Specific command-line options are:
3585
3586@table @code
3587@item --no-test-dependencies
3588@itemx -t
3589Do not include dependencies only required to run the test suite.
3590@end table
3591
3592The command below imports meta-data for the latest version of the
3593@code{HTTP} Haskell package without including test dependencies:
3594
3595@example
3596guix import hackage -t HTTP
3597@end example
3598
3599A specific package version may optionally be specified by following the
3600package name by a hyphen and a version number as in the following example:
3601
3602@example
3603guix import hackage mtl-2.1.3.1
3604@end example
3605
3606Currently only indentation structured Cabal files are supported.
2f7d2d91
LC
3607@end table
3608
3609The structure of the @command{guix import} code is modular. It would be
3610useful to have more importers for other package formats, and your help
3611is welcome here (@pxref{Contributing}).
3612
37166310
LC
3613@node Invoking guix refresh
3614@section Invoking @command{guix refresh}
3615
3616The primary audience of the @command{guix refresh} command is developers
3617of the GNU software distribution. By default, it reports any packages
3618provided by the distribution that are outdated compared to the latest
3619upstream version, like this:
3620
3621@example
3622$ guix refresh
3623gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
3624gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
3625@end example
3626
3627It does so by browsing each package's FTP directory and determining the
3628highest version number of the source tarballs
3629therein@footnote{Currently, this only works for GNU packages.}.
3630
3631When passed @code{--update}, it modifies distribution source files to
3632update the version numbers and source tarball hashes of those packages'
3633recipes (@pxref{Defining Packages}). This is achieved by downloading
3634each package's latest source tarball and its associated OpenPGP
3635signature, authenticating the downloaded tarball against its signature
3636using @command{gpg}, and finally computing its hash. When the public
3637key used to sign the tarball is missing from the user's keyring, an
3638attempt is made to automatically retrieve it from a public key server;
3639when it's successful, the key is added to the user's keyring; otherwise,
3640@command{guix refresh} reports an error.
3641
3642The following options are supported:
3643
3644@table @code
3645
3646@item --update
3647@itemx -u
3648Update distribution source files (package recipes) in place.
081145cf 3649@xref{Defining Packages}, for more information on package definitions.
37166310
LC
3650
3651@item --select=[@var{subset}]
3652@itemx -s @var{subset}
3653Select all the packages in @var{subset}, one of @code{core} or
3654@code{non-core}.
3655
3656The @code{core} subset refers to all the packages at the core of the
3657distribution---i.e., packages that are used to build ``everything
3658else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
3659changing one of these packages in the distribution entails a rebuild of
3660all the others. Thus, such updates are an inconvenience to users in
3661terms of build time or bandwidth used to achieve the upgrade.
3662
3663The @code{non-core} subset refers to the remaining packages. It is
3664typically useful in cases where an update of the core packages would be
3665inconvenient.
3666
3667@end table
3668
3669In addition, @command{guix refresh} can be passed one or more package
3670names, as in this example:
3671
3672@example
4b9b3cbb 3673guix refresh -u emacs idutils gcc-4.8.4
37166310
LC
3674@end example
3675
3676@noindent
3677The command above specifically updates the @code{emacs} and
3678@code{idutils} packages. The @code{--select} option would have no
3679effect in this case.
3680
7d193ec3
EB
3681When considering whether to upgrade a package, it is sometimes
3682convenient to know which packages would be affected by the upgrade and
3683should be checked for compatibility. For this the following option may
3684be used when passing @command{guix refresh} one or more package names:
3685
3686@table @code
3687
3688@item --list-dependent
3689@itemx -l
3690List top-level dependent packages that would need to be rebuilt as a
3691result of upgrading one or more packages.
3692
3693@end table
3694
3695Be aware that the @code{--list-dependent} option only
3696@emph{approximates} the rebuilds that would be required as a result of
3697an upgrade. More rebuilds might be required under some circumstances.
3698
3699@example
7779ab61
LC
3700$ guix refresh --list-dependent flex
3701Building the following 120 packages would ensure 213 dependent packages are rebuilt:
3702hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
7d193ec3
EB
3703@end example
3704
3705The command above lists a set of packages that could be built to check
3706for compatibility with an upgraded @code{flex} package.
3707
f9230085
LC
3708The following options can be used to customize GnuPG operation:
3709
3710@table @code
3711
f9230085
LC
3712@item --gpg=@var{command}
3713Use @var{command} as the GnuPG 2.x command. @var{command} is searched
3714for in @code{$PATH}.
3715
2bc53ba9
LC
3716@item --key-download=@var{policy}
3717Handle missing OpenPGP keys according to @var{policy}, which may be one
3718of:
3719
3720@table @code
3721@item always
3722Always download missing OpenPGP keys from the key server, and add them
3723to the user's GnuPG keyring.
3724
3725@item never
3726Never try to download missing OpenPGP keys. Instead just bail out.
3727
3728@item interactive
3729When a package signed with an unknown OpenPGP key is encountered, ask
3730the user whether to download it or not. This is the default behavior.
3731@end table
3732
3733@item --key-server=@var{host}
3734Use @var{host} as the OpenPGP key server when importing a public key.
3735
f9230085
LC
3736@end table
3737
b4f5e0e8
CR
3738@node Invoking guix lint
3739@section Invoking @command{guix lint}
3740The @command{guix lint} is meant to help package developers avoid common
873c4085
LC
3741errors and use a consistent style. It runs a number of checks on a
3742given set of packages in order to find common mistakes in their
3743definitions. Available @dfn{checkers} include (see
3744@code{--list-checkers} for a complete list):
3745
3746@table @code
3747@item synopsis
3748@itemx description
3749Validate certain typographical and stylistic rules about package
3750descriptions and synopses.
3751
3752@item inputs-should-be-native
3753Identify inputs that should most likely be native inputs.
3754
3755@item source
3756@itemx home-page
3757Probe @code{home-page} and @code{source} URLs and report those that are
3758invalid.
3759@end table
b4f5e0e8
CR
3760
3761The general syntax is:
3762
3763@example
3764guix lint @var{options} @var{package}@dots{}
3765@end example
3766
3767If no package is given on the command line, then all packages are checked.
3768The @var{options} may be zero or more of the following:
3769
3770@table @code
3771
dd7c013d
CR
3772@item --checkers
3773@itemx -c
3774Only enable the checkers specified in a comma-separated list using the
3775names returned by @code{--list-checkers}.
3776
b4f5e0e8
CR
3777@item --list-checkers
3778@itemx -l
3779List and describe all the available checkers that will be run on packages
3780and exit.
3781
3782@end table
37166310 3783
372c4bbc
DT
3784@node Invoking guix environment
3785@section Invoking @command{guix environment}
3786
f5fd4fd2 3787@cindex reproducible build environments
372c4bbc
DT
3788The purpose of @command{guix environment} is to assist hackers in
3789creating reproducible development environments without polluting their
3790package profile. The @command{guix environment} tool takes one or more
3791packages, builds all of the necessary inputs, and creates a shell
3792environment to use them.
3793
3794The general syntax is:
3795
3796@example
3797guix environment @var{options} @var{package}@dots{}
3798@end example
3799
3800The following examples spawns a new shell that is capable of building
3801the GNU Guile source code:
3802
3803@example
3804guix environment guile
3805@end example
3806
3807If the specified packages are not built yet, @command{guix environment}
3808automatically builds them. The new shell's environment is an augmented
3809version of the environment that @command{guix environment} was run in.
3810It contains the necessary search paths for building the given package
3811added to the existing environment variables. To create a ``pure''
3812environment in which the original environment variables have been unset,
3813use the @code{--pure} option.
3814
3815Additionally, more than one package may be specified, in which case the
3816union of the inputs for the given packages are used. For example, the
3817command below spawns a shell where all of the dependencies of both Guile
3818and Emacs are available:
3819
3820@example
3821guix environment guile emacs
3822@end example
3823
3824Sometimes an interactive shell session is not desired. The
3825@code{--exec} option can be used to specify the command to run instead.
3826
3827@example
3828guix environment guile --exec=make
3829@end example
3830
3831The following options are available:
3832
3833@table @code
3834@item --expression=@var{expr}
3835@itemx -e @var{expr}
3836Create an environment for the package that @var{expr} evaluates to.
3837
3838@item --load=@var{file}
3839@itemx -l @var{file}
3840Create an environment for the package that the code within @var{file}
3841evaluates to.
3842
3843@item --exec=@var{command}
3844@item -E @var{command}
3845Execute @var{command} in the new environment.
3846
3847@item --pure
3848Unset existing environment variables when building the new environment.
3849This has the effect of creating an environment in which search paths
3850only contain package inputs.
3851
3852@item --search-paths
3853Display the environment variable definitions that make up the
3854environment.
3855@end table
3856
3857It also supports all of the common build options that @command{guix
3858build} supports (@pxref{Invoking guix build, common build options}).
3859
aff8ce7c
DT
3860@node Invoking guix publish
3861@section Invoking @command{guix publish}
3862
3863The purpose of @command{guix publish} is to enable users to easily share
8ce229fc
LC
3864their store with others, which can then use it as a substitute server
3865(@pxref{Substitutes}).
3866
3867When @command{guix publish} runs, it spawns an HTTP server which allows
3868anyone with network access to obtain substitutes from it. This means
3869that any machine running Guix can also act as if it were a build farm,
3870since the HTTP interface is compatible with Hydra, the software behind
3871the @code{hydra.gnu.org} build farm.
aff8ce7c
DT
3872
3873For security, each substitute is signed, allowing recipients to check
3874their authenticity and integrity (@pxref{Substitutes}). Because
3875@command{guix publish} uses the system's signing key, which is only
5463fe51
LC
3876readable by the system administrator, it must be started as root; the
3877@code{--user} option makes it drop root privileges early on.
aff8ce7c
DT
3878
3879The general syntax is:
3880
3881@example
3882guix publish @var{options}@dots{}
3883@end example
3884
3885Running @command{guix publish} without any additional arguments will
3886spawn an HTTP server on port 8080:
3887
3888@example
3889guix publish
3890@end example
3891
3892Once a publishing server has been authorized (@pxref{Invoking guix
3893archive}), the daemon may download substitutes from it:
3894
3895@example
3896guix-daemon --substitute-urls=http://example.org:8080
3897@end example
3898
3899The following options are available:
3900
3901@table @code
3902@item --port=@var{port}
3903@itemx -p @var{port}
3904Listen for HTTP requests on @var{port}.
3905
9e2292ef
LC
3906@item --listen=@var{host}
3907Listen on the network interface for @var{host}. The default is to
3908accept connections from any interface.
3909
5463fe51
LC
3910@item --user=@var{user}
3911@itemx -u @var{user}
3912Change privileges to @var{user} as soon as possible---i.e., once the
3913server socket is open and the signing key has been read.
3914
aff8ce7c
DT
3915@item --repl[=@var{port}]
3916@itemx -r [@var{port}]
3917Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
8ce229fc
LC
3918Reference Manual}) on @var{port} (37146 by default). This is used
3919primarily for debugging a running @command{guix publish} server.
aff8ce7c
DT
3920@end table
3921
a1ba8475
LC
3922@c *********************************************************************
3923@node GNU Distribution
3924@chapter GNU Distribution
3925
3ca2731c 3926@cindex Guix System Distribution
4705641f 3927@cindex GuixSD
3ca2731c
LC
3928Guix comes with a distribution of the GNU system consisting entirely of
3929free software@footnote{The term ``free'' here refers to the
a1ba8475 3930@url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
3ca2731c 3931users of that software}.}. The
35ed9306
LC
3932distribution can be installed on its own (@pxref{System Installation}),
3933but it is also possible to install Guix as a package manager on top of
3934an installed GNU/Linux system (@pxref{Installation}). To distinguish
3ca2731c 3935between the two, we refer to the standalone distribution as the Guix
4705641f 3936System Distribution, or GuixSD.
35ed9306
LC
3937
3938The distribution provides core GNU packages such as GNU libc, GCC, and
3939Binutils, as well as many GNU and non-GNU applications. The complete
3940list of available packages can be browsed
d03bb653
LC
3941@url{http://www.gnu.org/software/guix/package-list.html,on-line} or by
3942running @command{guix package} (@pxref{Invoking guix package}):
a1ba8475
LC
3943
3944@example
e49951eb 3945guix package --list-available
a1ba8475
LC
3946@end example
3947
35ed9306 3948Our goal has been to provide a practical 100% free software distribution of
401c53c4
LC
3949Linux-based and other variants of GNU, with a focus on the promotion and
3950tight integration of GNU components, and an emphasis on programs and
3951tools that help users exert that freedom.
3952
3ca2731c 3953Packages are currently available on the following platforms:
c320011d
LC
3954
3955@table @code
3956
3957@item x86_64-linux
3958Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
3959
3960@item i686-linux
3961Intel 32-bit architecture (IA32), Linux-Libre kernel;
3962
aa1e1947
MW
3963@item armhf-linux
3964ARMv7-A architecture with hard float, Thumb-2 and VFP3D16 coprocessor,
3965using the EABI hard-float ABI, and Linux-Libre kernel.
3966
c320011d
LC
3967@item mips64el-linux
3968little-endian 64-bit MIPS processors, specifically the Loongson series,
3969n32 application binary interface (ABI), and Linux-Libre kernel.
3970
3971@end table
3972
4705641f 3973GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
3ca2731c 3974
c320011d
LC
3975@noindent
3976For information on porting to other architectures or kernels,
3977@xref{Porting}.
3978
401c53c4 3979@menu
5af6de3e 3980* System Installation:: Installing the whole operating system.
35ed9306 3981* System Configuration:: Configuring the operating system.
91ef73d4 3982* Installing Debugging Files:: Feeding the debugger.
05962f29 3983* Security Updates:: Deploying security fixes quickly.
401c53c4 3984* Package Modules:: Packages from the programmer's viewpoint.
da7cabd4 3985* Packaging Guidelines:: Growing the distribution.
401c53c4 3986* Bootstrapping:: GNU/Linux built from scratch.
8b315a6d 3987* Porting:: Targeting another platform or kernel.
401c53c4
LC
3988@end menu
3989
3990Building this distribution is a cooperative effort, and you are invited
081145cf 3991to join! @xref{Contributing}, for information about how you can help.
401c53c4 3992
5af6de3e
LC
3993@node System Installation
3994@section System Installation
3995
3ca2731c
LC
3996@cindex Guix System Distribution
3997This section explains how to install the Guix System Distribution
3998on a machine. The Guix package manager can
35ed9306
LC
3999also be installed on top of a running GNU/Linux system,
4000@pxref{Installation}.
5af6de3e
LC
4001
4002@ifinfo
4003@c This paragraph is for people reading this from tty2 of the
4004@c installation image.
4005You're reading this documentation with an Info reader. For details on
4006how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6621cdb6 4007link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit
5af6de3e
LC
4008@kbd{l} afterwards to come back here.
4009@end ifinfo
4010
8aaaae38
LC
4011@subsection Limitations
4012
4705641f 4013As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
3ca2731c 4014not production-ready. It may contain bugs and lack important
8aaaae38
LC
4015features. Thus, if you are looking for a stable production system that
4016respects your freedom as a computer user, a good solution at this point
4017is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
4018more established GNU/Linux distributions}. We hope you can soon switch
4705641f 4019to the GuixSD without fear, of course. In the meantime, you can
8aaaae38
LC
4020also keep using your distribution and try out the package manager on top
4021of it (@pxref{Installation}).
4022
4023Before you proceed with the installation, be aware of the following
4024noteworthy limitations applicable to version @value{VERSION}:
4025
4026@itemize
4027@item
4028The installation process does not include a graphical user interface and
4029requires familiarity with GNU/Linux (see the following subsections to
4030get a feel of what that means.)
4031
4032@item
b1e95eca
LC
4033The system does not yet provide GNOME and KDE; it provides Xfce, though,
4034if graphical desktop environments are your thing.
8aaaae38
LC
4035
4036@item
dbcb0ab1 4037Support for the Logical Volume Manager (LVM) is missing.
8aaaae38
LC
4038
4039@item
4040Few system services are currently supported out-of-the-box
4041(@pxref{Services}).
4042
4043@item
49607566 4044On the order of 1,900 packages are available, which means that you may
8aaaae38
LC
4045occasionally find that a useful package is missing.
4046@end itemize
4047
4048You've been warned. But more than a disclaimer, this is an invitation
4049to report issues (and success stories!), and join us in improving it.
4050@xref{Contributing}, for more info.
5af6de3e
LC
4051
4052@subsection USB Stick Installation
4053
4054An installation image for USB sticks can be downloaded from
4705641f 4055@indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
5af6de3e
LC
4056where @var{system} is one of:
4057
4058@table @code
4059@item x86_64-linux
4060for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
4061
4062@item i686-linux
4063for a 32-bit GNU/Linux system on Intel-compatible CPUs.
4064@end table
4065
4066This image contains a single partition with the tools necessary for an
4067installation. It is meant to be copied @emph{as is} to a large-enough
4068USB stick.
4069
4070To copy the image to a USB stick, follow these steps:
4071
4072@enumerate
4073@item
4074Decompress the image using the @command{xz} command:
4075
4076@example
4705641f 4077xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
5af6de3e
LC
4078@end example
4079
4080@item
4081Insert a USB stick of 1@tie{}GiB or more in your machine, and determine
4082its device name. Assuming that USB stick is known as @file{/dev/sdX},
4083copy the image with:
4084
4085@example
4705641f 4086dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
5af6de3e
LC
4087@end example
4088
4089Access to @file{/dev/sdX} usually requires root privileges.
4090@end enumerate
4091
4092Once this is done, you should be able to reboot the system and boot from
4093the USB stick. The latter usually requires you to get in the BIOS' boot
4094menu, where you can choose to boot from the USB stick.
4095
4096@subsection Preparing for Installation
4097
4098Once you have successfully booted the image on the USB stick, you should
4099end up with a root prompt. Several console TTYs are configured and can
4100be used to run commands as root. TTY2 shows this documentation,
4101browsable using the Info reader commands (@pxref{Help,,, info, Info: An
4102Introduction}).
4103
4104To install the system, you would:
4105
4106@enumerate
4107
4108@item
152dd61c
LC
4109Configure the network, by running @command{ifconfig eno1 up && dhclient
4110eno1} (to get an automatically assigned IP address from the wired
4111network interface controller@footnote{
95c559c1
LC
4112@c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
4113The name @code{eno1} is for the first on-board Ethernet controller. The
4114interface name for an Ethernet controller that is in the first slot of
4115the first PCI bus, for instance, would be @code{enp1s0}. Use
4116@command{ifconfig -a} to list all the available network interfaces.}),
4117or using the @command{ifconfig} command.
5af6de3e
LC
4118
4119The system automatically loads drivers for your network interface
4120controllers.
4121
4122Setting up network access is almost always a requirement because the
4123image does not contain all the software and tools that may be needed.
4124
4125@item
4126Unless this has already been done, you must partition and format the
4127target partitions.
4128
7ab44369
LC
4129Preferably, assign partitions a label so that you can easily and
4130reliably refer to them in @code{file-system} declarations (@pxref{File
4131Systems}). This is typically done using the @code{-L} option of
4132@command{mkfs.ext4} and related commands.
4133
5af6de3e 4134The installation image includes Parted (@pxref{Overview,,, parted, GNU
b419c7f5
LC
4135Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk
4136encryption, and e2fsprogs, the suite of tools to manipulate
4137ext2/ext3/ext4 file systems.
5af6de3e 4138
83a17b62
LC
4139@item
4140Once that is done, mount the target root partition under @file{/mnt}.
4141
4142@item
4143Lastly, run @code{deco start cow-store /mnt}.
4144
4145This will make @file{/gnu/store} copy-on-write, such that packages added
4146to it during the installation phase will be written to the target disk
4147rather than kept in memory.
4148
5af6de3e
LC
4149@end enumerate
4150
5af6de3e
LC
4151
4152@subsection Proceeding with the Installation
4153
4154With the target partitions ready, you now have to edit a file and
4155provide the declaration of the operating system to be installed. To
4156that end, the installation system comes with two text editors: GNU nano
4157(@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
4158It is better to store that file on the target root file system, say, as
4159@file{/mnt/etc/config.scm}.
4160
dd51caac
LC
4161@xref{Using the Configuration System}, for examples of operating system
4162configurations. These examples are available under
4163@file{/etc/configuration} in the installation image, so you can copy
4164them and use them as a starting point for your own configuration.
5af6de3e 4165
dd51caac
LC
4166Once you are done preparing the configuration file, the new system must
4167be initialized (remember that the target root file system is mounted
4168under @file{/mnt}):
5af6de3e
LC
4169
4170@example
4171guix system init /mnt/etc/config.scm /mnt
4172@end example
4173
4174@noindent
4175This will copy all the necessary files, and install GRUB on
4176@file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6621cdb6 4177more information, @pxref{Invoking guix system}. This command may trigger
5af6de3e
LC
4178downloads or builds of missing packages, which can take some time.
4179
4180Once that command has completed---and hopefully succeeded!---you can
ad14d9e7 4181run @command{reboot} and boot into the new system. Cross fingers, and
5af6de3e
LC
4182join us on @code{#guix} on the Freenode IRC network or on
4183@file{guix-devel@@gnu.org} to share your experience---good or not so
4184good.
4185
4186@subsection Building the Installation Image
4187
4188The installation image described above was built using the @command{guix
4189system} command, specifically:
4190
4191@example
8a225c66 4192guix system disk-image --image-size=850MiB gnu/system/install.scm
5af6de3e
LC
4193@end example
4194
4195@xref{Invoking guix system}, for more information. See
4196@file{gnu/system/install.scm} in the source tree for more information
4197about the installation image.
4198
cf4a9129
LC
4199@node System Configuration
4200@section System Configuration
b208a005 4201
cf4a9129 4202@cindex system configuration
3ca2731c 4203The Guix System Distribution supports a consistent whole-system configuration
cf4a9129
LC
4204mechanism. By that we mean that all aspects of the global system
4205configuration---such as the available system services, timezone and
4206locale settings, user accounts---are declared in a single place. Such
4207a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
91ef73d4 4208
cf4a9129
LC
4209One of the advantages of putting all the system configuration under the
4210control of Guix is that it supports transactional system upgrades, and
4211makes it possible to roll-back to a previous system instantiation,
4212should something go wrong with the new one (@pxref{Features}). Another
4213one is that it makes it easy to replicate the exact same configuration
4214across different machines, or at different points in time, without
4215having to resort to additional administration tools layered on top of
4216the system's own tools.
4217@c Yes, we're talking of Puppet, Chef, & co. here. ↑
91ef73d4 4218
cf4a9129
LC
4219This section describes this mechanism. First we focus on the system
4220administrator's viewpoint---explaining how the system is configured and
4221instantiated. Then we show how this mechanism can be extended, for
4222instance to support new system services.
91ef73d4 4223
cf4a9129
LC
4224@menu
4225* Using the Configuration System:: Customizing your GNU system.
7313a52e 4226* operating-system Reference:: Detail of operating-system declarations.
cf4a9129 4227* File Systems:: Configuring file system mounts.
510f9d86 4228* Mapped Devices:: Block device extra processing.
cf4a9129 4229* User Accounts:: Specifying user accounts.
598e19dc 4230* Locales:: Language and cultural convention settings.
cf4a9129 4231* Services:: Specifying system services.
0ae8c15a 4232* Setuid Programs:: Programs running with root privileges.
efb5e833 4233* X.509 Certificates:: Authenticating HTTPS servers.
996ed739 4234* Name Service Switch:: Configuring libc's name service switch.
fd1b1fa2 4235* Initial RAM Disk:: Linux-Libre bootstrapping.
88faf933 4236* GRUB Configuration:: Configuring the boot loader.
cf4a9129
LC
4237* Invoking guix system:: Instantiating a system configuration.
4238* Defining Services:: Adding new service definitions.
4239@end menu
91ef73d4 4240
cf4a9129
LC
4241@node Using the Configuration System
4242@subsection Using the Configuration System
64d76fa6 4243
cf4a9129
LC
4244The operating system is configured by providing an
4245@code{operating-system} declaration in a file that can then be passed to
4246the @command{guix system} command (@pxref{Invoking guix system}). A
4247simple setup, with the default system services, the default Linux-Libre
4248kernel, initial RAM disk, and boot loader looks like this:
91ef73d4 4249
cf4a9129
LC
4250@findex operating-system
4251@lisp
dd51caac 4252@include os-config-bare-bones.texi
cf4a9129 4253@end lisp
401c53c4 4254
cf4a9129
LC
4255This example should be self-describing. Some of the fields defined
4256above, such as @code{host-name} and @code{bootloader}, are mandatory.
4257Others, such as @code{packages} and @code{services}, can be omitted, in
4258which case they get a default value.
e7f34eb0 4259
cf4a9129
LC
4260@vindex %base-packages
4261The @code{packages} field lists
4262packages that will be globally visible on the system, for all user
4263accounts---i.e., in every user's @code{PATH} environment variable---in
4264addition to the per-user profiles (@pxref{Invoking guix package}). The
4265@var{%base-packages} variable provides all the tools one would expect
4266for basic user and administrator tasks---including the GNU Core
4267Utilities, the GNU Networking Utilities, the GNU Zile lightweight text
4268editor, @command{find}, @command{grep}, etc. The example above adds
4269Emacs to those, taken from the @code{(gnu packages emacs)} module
4270(@pxref{Package Modules}).
e7f34eb0 4271
cf4a9129
LC
4272@vindex %base-services
4273The @code{services} field lists @dfn{system services} to be made
4274available when the system starts (@pxref{Services}).
4275The @code{operating-system} declaration above specifies that, in
4276addition to the basic services, we want the @command{lshd} secure shell
4277daemon listening on port 2222, and allowing remote @code{root} logins
4278(@pxref{Invoking lshd,,, lsh, GNU lsh Manual}). Under the hood,
4279@code{lsh-service} arranges so that @code{lshd} is started with the
4280right command-line options, possibly with supporting configuration files
7313a52e
LC
4281generated as needed (@pxref{Defining Services}). @xref{operating-system
4282Reference}, for details about the available @code{operating-system}
4283fields.
a1ba8475 4284
dd51caac
LC
4285The configuration for a typical ``desktop'' usage, with the X11 display
4286server, a desktop environment, network management, an SSH server, and
4287more, would look like this:
4288
4289@lisp
4290@include os-config-desktop.texi
4291@end lisp
4292
4293@xref{Desktop Services}, for the exact list of services provided by
efb5e833
LC
4294@var{%desktop-services}. @xref{X.509 Certificates}, for background
4295information about the @code{nss-certs} package that is used here.
dd51caac 4296
cf4a9129
LC
4297Assuming the above snippet is stored in the @file{my-system-config.scm}
4298file, the @command{guix system reconfigure my-system-config.scm} command
4299instantiates that configuration, and makes it the default GRUB boot
4300entry (@pxref{Invoking guix system}). The normal way to change the
4301system's configuration is by updating this file and re-running the
4302@command{guix system} command.
b81e1947 4303
cf4a9129
LC
4304At the Scheme level, the bulk of an @code{operating-system} declaration
4305is instantiated with the following monadic procedure (@pxref{The Store
4306Monad}):
b81e1947 4307
cf4a9129
LC
4308@deffn {Monadic Procedure} operating-system-derivation os
4309Return a derivation that builds @var{os}, an @code{operating-system}
4310object (@pxref{Derivations}).
b81e1947 4311
cf4a9129
LC
4312The output of the derivation is a single directory that refers to all
4313the packages, configuration files, and other supporting files needed to
4314instantiate @var{os}.
4315@end deffn
b81e1947 4316
7313a52e
LC
4317@node operating-system Reference
4318@subsection @code{operating-system} Reference
4319
4320This section summarizes all the options available in
4321@code{operating-system} declarations (@pxref{Using the Configuration
4322System}).
4323
4324@deftp {Data Type} operating-system
4325This is the data type representing an operating system configuration.
4326By that, we mean all the global system configuration, not per-user
4327configuration (@pxref{Using the Configuration System}).
4328
4329@table @asis
4330@item @code{kernel} (default: @var{linux-libre})
4331The package object of the operating system to use@footnote{Currently
4332only the Linux-libre kernel is supported. In the future, it will be
4333possible to use the GNU@tie{}Hurd.}.
4334
4335@item @code{bootloader}
88faf933 4336The system bootloader configuration object. @xref{GRUB Configuration}.
7313a52e
LC
4337
4338@item @code{initrd} (default: @code{base-initrd})
4339A two-argument monadic procedure that returns an initial RAM disk for
4340the Linux kernel. @xref{Initial RAM Disk}.
4341
f34c56be
LC
4342@item @code{firmware} (default: @var{%base-firmware})
4343@cindex firmware
4344List of firmware packages loadable by the operating system kernel.
4345
4346The default includes firmware needed for Atheros-based WiFi devices
4347(Linux-libre module @code{ath9k}.)
4348
7313a52e
LC
4349@item @code{host-name}
4350The host name.
4351
4352@item @code{hosts-file}
4353@cindex hosts file
4354A zero-argument monadic procedure that returns a text file for use as
4355@file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
4356Reference Manual}). The default is to produce a file with entries for
4357@code{localhost} and @var{host-name}.
4358
4359@item @code{mapped-devices} (default: @code{'()})
4360A list of mapped devices. @xref{Mapped Devices}.
4361
4362@item @code{file-systems}
4363A list of file systems. @xref{File Systems}.
4364
4365@item @code{swap-devices} (default: @code{'()})
4366@cindex swap devices
4367A list of strings identifying devices to be used for ``swap space''
4368(@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
4369For example, @code{'("/dev/sda3")}.
4370
4371@item @code{users} (default: @code{'()})
4372@itemx @code{groups} (default: @var{%base-groups})
4373List of user accounts and groups. @xref{User Accounts}.
4374
4375@item @code{skeletons} (default: @code{(default-skeletons)})
4376A monadic list of pairs of target file name and files. These are the
4377files that will be used as skeletons as new accounts are created.
4378
4379For instance, a valid value may look like this:
4380
4381@example
4382(mlet %store-monad ((bashrc (text-file "bashrc" "\
4383 export PATH=$HOME/.guix-profile/bin")))
4384 (return `((".bashrc" ,bashrc))))
4385@end example
4386
4387@item @code{issue} (default: @var{%default-issue})
4388A string denoting the contents of the @file{/etc/issue} file, which is
4389what displayed when users log in on a text console.
4390
4391@item @code{packages} (default: @var{%base-packages})
4392The set of packages installed in the global profile, which is accessible
4393at @file{/run/current-system/profile}.
4394
4395The default set includes core utilities, but it is good practice to
4396install non-core utilities in user profiles (@pxref{Invoking guix
4397package}).
4398
4399@item @code{timezone}
4400A timezone identifying string---e.g., @code{"Europe/Paris"}.
4401
598e19dc
LC
4402@item @code{locale} (default: @code{"en_US.utf8"})
4403The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
4404Library Reference Manual}). @xref{Locales}, for more information.
4405
4406@item @code{locale-definitions} (default: @var{%default-locale-definitions})
4407The list of locale definitions to be compiled and that may be used at
4408run time. @xref{Locales}.
7313a52e 4409
996ed739
LC
4410@item @code{name-service-switch} (default: @var{%default-nss})
4411Configuration of libc's name service switch (NSS)---a
4412@code{<name-service-switch>} object. @xref{Name Service Switch}, for
4413details.
4414
7313a52e
LC
4415@item @code{services} (default: @var{%base-services})
4416A list of monadic values denoting system services. @xref{Services}.
4417
4418@item @code{pam-services} (default: @code{(base-pam-services)})
4419@cindex PAM
4420@cindex pluggable authentication modules
4421Linux @dfn{pluggable authentication module} (PAM) services.
4422@c FIXME: Add xref to PAM services section.
4423
4424@item @code{setuid-programs} (default: @var{%setuid-programs})
4425List of string-valued G-expressions denoting setuid programs.
4426@xref{Setuid Programs}.
4427
4428@item @code{sudoers} (default: @var{%sudoers-specification})
4429@cindex sudoers
4430The contents of the @file{/etc/sudoers} file as a string.
4431
4432This file specifies which users can use the @command{sudo} command, what
4433they are allowed to do, and what privileges they may gain. The default
4434is that only @code{root} and members of the @code{wheel} group may use
4435@code{sudo}.
4436
4437@end table
4438@end deftp
4439
cf4a9129
LC
4440@node File Systems
4441@subsection File Systems
b81e1947 4442
cf4a9129
LC
4443The list of file systems to be mounted is specified in the
4444@code{file-systems} field of the operating system's declaration
4445(@pxref{Using the Configuration System}). Each file system is declared
4446using the @code{file-system} form, like this:
b81e1947
LC
4447
4448@example
cf4a9129
LC
4449(file-system
4450 (mount-point "/home")
4451 (device "/dev/sda3")
4452 (type "ext4"))
b81e1947
LC
4453@end example
4454
cf4a9129
LC
4455As usual, some of the fields are mandatory---those shown in the example
4456above---while others can be omitted. These are described below.
b81e1947 4457
cf4a9129
LC
4458@deftp {Data Type} file-system
4459Objects of this type represent file systems to be mounted. They
4460contain the following members:
5ff3c4b8 4461
cf4a9129
LC
4462@table @asis
4463@item @code{type}
4464This is a string specifying the type of the file system---e.g.,
4465@code{"ext4"}.
5ff3c4b8 4466
cf4a9129
LC
4467@item @code{mount-point}
4468This designates the place where the file system is to be mounted.
b81e1947 4469
cf4a9129
LC
4470@item @code{device}
4471This names the ``source'' of the file system. By default it is the name
4472of a node under @file{/dev}, but its meaning depends on the @code{title}
4473field described below.
401c53c4 4474
cf4a9129
LC
4475@item @code{title} (default: @code{'device})
4476This is a symbol that specifies how the @code{device} field is to be
4477interpreted.
401c53c4 4478
cf4a9129
LC
4479When it is the symbol @code{device}, then the @code{device} field is
4480interpreted as a file name; when it is @code{label}, then @code{device}
4481is interpreted as a partition label name; when it is @code{uuid},
4482@code{device} is interpreted as a partition unique identifier (UUID).
da7cabd4 4483
cf4a9129
LC
4484The @code{label} and @code{uuid} options offer a way to refer to disk
4485partitions without having to hard-code their actual device name.
da7cabd4 4486
5f86a66e
LC
4487However, when a file system's source is a mapped device (@pxref{Mapped
4488Devices}), its @code{device} field @emph{must} refer to the mapped
4489device name---e.g., @file{/dev/mapper/root-partition}---and consequently
4490@code{title} must be set to @code{'device}. This is required so that
4491the system knows that mounting the file system depends on having the
4492corresponding device mapping established.
4493
cf4a9129
LC
4494@item @code{flags} (default: @code{'()})
4495This is a list of symbols denoting mount flags. Recognized flags
2c071ce9
LC
4496include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
4497access to special files), @code{no-suid} (ignore setuid and setgid
4498bits), and @code{no-exec} (disallow program execution.)
da7cabd4 4499
cf4a9129
LC
4500@item @code{options} (default: @code{#f})
4501This is either @code{#f}, or a string denoting mount options.
da7cabd4 4502
cf4a9129
LC
4503@item @code{needed-for-boot?} (default: @code{#f})
4504This Boolean value indicates whether the file system is needed when
4505booting. If that is true, then the file system is mounted when the
4506initial RAM disk (initrd) is loaded. This is always the case, for
4507instance, for the root file system.
da7cabd4 4508
cf4a9129
LC
4509@item @code{check?} (default: @code{#t})
4510This Boolean indicates whether the file system needs to be checked for
4511errors before being mounted.
f9cc8971 4512
4e469051
LC
4513@item @code{create-mount-point?} (default: @code{#f})
4514When true, the mount point is created if it does not exist yet.
4515
cf4a9129
LC
4516@end table
4517@end deftp
da7cabd4 4518
a69576ea
LC
4519The @code{(gnu system file-systems)} exports the following useful
4520variables.
4521
4522@defvr {Scheme Variable} %base-file-systems
4523These are essential file systems that are required on normal systems,
3392ce5d
LC
4524such as @var{%devtmpfs-file-system} and @var{%immutable-store} (see
4525below.) Operating system declarations should always contain at least
4526these.
a69576ea
LC
4527@end defvr
4528
4529@defvr {Scheme Variable} %devtmpfs-file-system
4530The @code{devtmpfs} file system to be mounted on @file{/dev}. This is a
4531requirement for udev (@pxref{Base Services, @code{udev-service}}).
4532@end defvr
4533
7f239fd3
LC
4534@defvr {Scheme Variable} %pseudo-terminal-file-system
4535This is the file system to be mounted as @file{/dev/pts}. It supports
4536@dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
4537functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
4538Manual}). Pseudo-terminals are used by terminal emulators such as
4539@command{xterm}.
4540@end defvr
4541
db17ae5c
LC
4542@defvr {Scheme Variable} %shared-memory-file-system
4543This file system is mounted as @file{/dev/shm} and is used to support
4544memory sharing across processes (@pxref{Memory-mapped I/O,
4545@code{shm_open},, libc, The GNU C Library Reference Manual}).
4546@end defvr
4547
3392ce5d
LC
4548@defvr {Scheme Variable} %immutable-store
4549This file system performs a read-only ``bind mount'' of
4550@file{/gnu/store}, making it read-only for all the users including
4551@code{root}. This prevents against accidental modification by software
4552running as @code{root} or by system administrators.
4553
4554The daemon itself is still able to write to the store: it remounts it
4555read-write in its own ``name space.''
4556@end defvr
4557
a69576ea
LC
4558@defvr {Scheme Variable} %binary-format-file-system
4559The @code{binfmt_misc} file system, which allows handling of arbitrary
4560executable file types to be delegated to user space. This requires the
4561@code{binfmt.ko} kernel module to be loaded.
4562@end defvr
4563
4564@defvr {Scheme Variable} %fuse-control-file-system
4565The @code{fusectl} file system, which allows unprivileged users to mount
4566and unmount user-space FUSE file systems. This requires the
4567@code{fuse.ko} kernel module to be loaded.
4568@end defvr
4569
510f9d86
LC
4570@node Mapped Devices
4571@subsection Mapped Devices
4572
4573@cindex device mapping
4574@cindex mapped devices
4575The Linux kernel has a notion of @dfn{device mapping}: a block device,
4576such as a hard disk partition, can be @dfn{mapped} into another device,
4577with additional processing over the data that flows through
4578it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
4579concept of a ``mapped device'' and that of a file system: both boil down
4580to @emph{translating} input/output operations made on a file to
4581operations on its backing store. Thus, the Hurd implements mapped
4582devices, like file systems, using the generic @dfn{translator} mechanism
4583(@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
4584typical example is encryption device mapping: all writes to the mapped
4585device are encrypted, and all reads are deciphered, transparently.
4586
4587Mapped devices are declared using the @code{mapped-device} form:
4588
4589@example
4590(mapped-device
4591 (source "/dev/sda3")
4592 (target "home")
4593 (type luks-device-mapping))
4594@end example
4595
4596@noindent
4597@cindex disk encryption
4598@cindex LUKS
4599This example specifies a mapping from @file{/dev/sda3} to
4600@file{/dev/mapper/home} using LUKS---the
4601@url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
4602standard mechanism for disk encryption. The @file{/dev/mapper/home}
4603device can then be used as the @code{device} of a @code{file-system}
4604declaration (@pxref{File Systems}). The @code{mapped-device} form is
4605detailed below.
4606
4607@deftp {Data Type} mapped-device
4608Objects of this type represent device mappings that will be made when
4609the system boots up.
4610
9cb426b8
LC
4611@table @code
4612@item source
510f9d86
LC
4613This string specifies the name of the block device to be mapped, such as
4614@code{"/dev/sda3"}.
4615
9cb426b8 4616@item target
510f9d86
LC
4617This string specifies the name of the mapping to be established. For
4618example, specifying @code{"my-partition"} will lead to the creation of
4619the @code{"/dev/mapper/my-partition"} device.
4620
9cb426b8 4621@item type
510f9d86
LC
4622This must be a @code{mapped-device-kind} object, which specifies how
4623@var{source} is mapped to @var{target}.
4624@end table
4625@end deftp
4626
4627@defvr {Scheme Variable} luks-device-mapping
4628This defines LUKS block device encryption using the @command{cryptsetup}
4629command, from the same-named package. This relies on the
4630@code{dm-crypt} Linux kernel module.
4631@end defvr
4632
cf4a9129
LC
4633@node User Accounts
4634@subsection User Accounts
ee85f3db 4635
9bea87a5
LC
4636User accounts and groups are entirely managed through the
4637@code{operating-system} declaration. They are specified with the
4638@code{user-account} and @code{user-group} forms:
ee85f3db 4639
cf4a9129
LC
4640@example
4641(user-account
4642 (name "alice")
4643 (group "users")
24e752c0
LC
4644 (supplementary-groups '("wheel" ;allow use of sudo, etc.
4645 "audio" ;sound card
4646 "video" ;video devices such as webcams
4647 "cdrom")) ;the good ol' CD-ROM
cf4a9129
LC
4648 (comment "Bob's sister")
4649 (home-directory "/home/alice"))
4650@end example
25083588 4651
9bea87a5
LC
4652When booting or upon completion of @command{guix system reconfigure},
4653the system ensures that only the user accounts and groups specified in
4654the @code{operating-system} declaration exist, and with the specified
4655properties. Thus, account or group creations or modifications made by
4656directly invoking commands such as @command{useradd} are lost upon
4657reconfiguration or reboot. This ensures that the system remains exactly
4658as declared.
4659
cf4a9129
LC
4660@deftp {Data Type} user-account
4661Objects of this type represent user accounts. The following members may
4662be specified:
ee85f3db 4663
cf4a9129
LC
4664@table @asis
4665@item @code{name}
4666The name of the user account.
ee85f3db 4667
cf4a9129
LC
4668@item @code{group}
4669This is the name (a string) or identifier (a number) of the user group
4670this account belongs to.
ee85f3db 4671
cf4a9129
LC
4672@item @code{supplementary-groups} (default: @code{'()})
4673Optionally, this can be defined as a list of group names that this
4674account belongs to.
ee85f3db 4675
cf4a9129
LC
4676@item @code{uid} (default: @code{#f})
4677This is the user ID for this account (a number), or @code{#f}. In the
4678latter case, a number is automatically chosen by the system when the
4679account is created.
ee85f3db 4680
cf4a9129
LC
4681@item @code{comment} (default: @code{""})
4682A comment about the account, such as the account's owner full name.
c8c871d1 4683
cf4a9129
LC
4684@item @code{home-directory}
4685This is the name of the home directory for the account.
ee85f3db 4686
cf4a9129
LC
4687@item @code{shell} (default: Bash)
4688This is a G-expression denoting the file name of a program to be used as
4689the shell (@pxref{G-Expressions}).
ee85f3db 4690
cf4a9129
LC
4691@item @code{system?} (default: @code{#f})
4692This Boolean value indicates whether the account is a ``system''
4693account. System accounts are sometimes treated specially; for instance,
4694graphical login managers do not list them.
ee85f3db 4695
cf4a9129 4696@item @code{password} (default: @code{#f})
eb59595c
LC
4697You would normally leave this field to @code{#f}, initialize user
4698passwords as @code{root} with the @command{passwd} command, and then let
9bea87a5
LC
4699users change it with @command{passwd}. Passwords set with
4700@command{passwd} are of course preserved across reboot and
4701reconfiguration.
eb59595c
LC
4702
4703If you @emph{do} want to have a preset password for an account, then
4704this field must contain the encrypted password, as a string.
5d1f1177
LC
4705@xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
4706on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
eb59595c 4707Manual}, for information on Guile's @code{crypt} procedure.
c8c871d1 4708
cf4a9129
LC
4709@end table
4710@end deftp
ee85f3db 4711
cf4a9129 4712User group declarations are even simpler:
ee85f3db 4713
cf4a9129
LC
4714@example
4715(user-group (name "students"))
4716@end example
ee85f3db 4717
cf4a9129
LC
4718@deftp {Data Type} user-group
4719This type is for, well, user groups. There are just a few fields:
af8a56b8 4720
cf4a9129
LC
4721@table @asis
4722@item @code{name}
4723The group's name.
ee85f3db 4724
cf4a9129
LC
4725@item @code{id} (default: @code{#f})
4726The group identifier (a number). If @code{#f}, a new number is
4727automatically allocated when the group is created.
ee85f3db 4728
c8fa3426
LC
4729@item @code{system?} (default: @code{#f})
4730This Boolean value indicates whether the group is a ``system'' group.
4731System groups have low numerical IDs.
4732
cf4a9129
LC
4733@item @code{password} (default: @code{#f})
4734What, user groups can have a password? Well, apparently yes. Unless
4735@code{#f}, this field specifies the group's password.
ee85f3db 4736
cf4a9129
LC
4737@end table
4738@end deftp
401c53c4 4739
cf4a9129
LC
4740For convenience, a variable lists all the basic user groups one may
4741expect:
401c53c4 4742
cf4a9129
LC
4743@defvr {Scheme Variable} %base-groups
4744This is the list of basic user groups that users and/or packages expect
4745to be present on the system. This includes groups such as ``root'',
4746``wheel'', and ``users'', as well as groups used to control access to
4747specific devices such as ``audio'', ``disk'', and ``cdrom''.
4748@end defvr
401c53c4 4749
598e19dc
LC
4750@node Locales
4751@subsection Locales
4752
4753@cindex locale
4754A @dfn{locale} defines cultural conventions for a particular language
4755and region of the world (@pxref{Locales,,, libc, The GNU C Library
4756Reference Manual}). Each locale has a name that typically has the form
4757@code{@var{language}_@var{territory}.@var{charset}}---e.g.,
4758@code{fr_LU.utf8} designates the locale for the French language, with
4759cultural conventions from Luxembourg, and using the UTF-8 encoding.
4760
4761@cindex locale definition
4762Usually, you will want to specify the default locale for the machine
4763using the @code{locale} field of the @code{operating-system} declaration
4764(@pxref{operating-system Reference, @code{locale}}).
4765
4766That locale must be among the @dfn{locale definitions} that are known to
4767the system---and these are specified in the @code{locale-definitions}
4768slot of @code{operating-system}. The default value includes locale
4769definition for some widely used locales, but not for all the available
4770locales, in order to save space.
4771
4772If the locale specified in the @code{locale} field is not among the
4773definitions listed in @code{locale-definitions}, @command{guix system}
4774raises an error. In that case, you should add the locale definition to
4775the @code{locale-definitions} field. For instance, to add the North
4776Frisian locale for Germany, the value of that field may be:
4777
4778@example
4779(cons (locale-definition
4780 (name "fy_DE.utf8") (source "fy_DE"))
4781 %default-locale-definitions)
4782@end example
4783
4784Likewise, to save space, one might want @code{locale-definitions} to
4785list only the locales that are actually used, as in:
4786
4787@example
4788(list (locale-definition
4789 (name "ja_JP.eucjp") (source "ja_JP")
4790 (charset "EUC-JP")))
4791@end example
4792
4793The @code{locale-definition} form is provided by the @code{(gnu system
4794locale)} module. Details are given below.
4795
4796@deftp {Data Type} locale-definition
4797This is the data type of a locale definition.
4798
4799@table @asis
4800
4801@item @code{name}
4802The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
4803Reference Manual}, for more information on locale names.
4804
4805@item @code{source}
4806The name of the source for that locale. This is typically the
4807@code{@var{language}_@var{territory}} part of the locale name.
4808
4809@item @code{charset} (default: @code{"UTF-8"})
4810The ``character set'' or ``code set'' for that locale,
4811@uref{http://www.iana.org/assignments/character-sets, as defined by
4812IANA}.
4813
4814@end table
4815@end deftp
4816
4817@defvr {Scheme Variable} %default-locale-definitions
4818An arbitrary list of commonly used locales, used as the default value of
4819the @code{locale-definitions} field of @code{operating-system}
4820declarations.
4821@end defvr
401c53c4 4822
cf4a9129
LC
4823@node Services
4824@subsection Services
401c53c4 4825
cf4a9129
LC
4826@cindex system services
4827An important part of preparing an @code{operating-system} declaration is
4828listing @dfn{system services} and their configuration (@pxref{Using the
4829Configuration System}). System services are typically daemons launched
4830when the system boots, or other actions needed at that time---e.g.,
d8b94dbd
LC
4831configuring network access.
4832
4833Services are managed by GNU@tie{}dmd (@pxref{Introduction,,, dmd, GNU
4834dmd Manual}). On a running system, the @command{deco} command allows
4835you to list the available services, show their status, start and stop
4836them, or do other specific operations (@pxref{Jump Start,,, dmd, GNU dmd
4837Manual}). For example:
4838
4839@example
4840# deco status dmd
4841@end example
4842
4843The above command, run as @code{root}, lists the currently defined
4844services. The @command{deco doc} command shows a synopsis of the given
4845service:
4846
4847@example
4848# deco doc nscd
4849Run libc's name service cache daemon (nscd).
4850@end example
4851
4852The @command{start}, @command{stop}, and @command{restart} sub-commands
4853have the effect you would expect. For instance, the commands below stop
4854the nscd service and restart the Xorg display server:
4855
4856@example
4857# deco stop nscd
4858Service nscd has been stopped.
4859# deco restart xorg-server
4860Service xorg-server has been stopped.
4861Service xorg-server has been started.
4862@end example
401c53c4 4863
cf4a9129 4864The following sections document the available services, starting with
d8b94dbd
LC
4865the core services, that may be used in an @code{operating-system}
4866declaration.
401c53c4 4867
cf4a9129
LC
4868@menu
4869* Base Services:: Essential system services.
4870* Networking Services:: Network setup, SSH daemon, etc.
4871* X Window:: Graphical display.
fe1a39d3 4872* Desktop Services:: D-Bus and desktop services.
105369a4 4873* Database Services:: SQL databases.
aa4ed923 4874* Various Services:: Other services.
cf4a9129 4875@end menu
401c53c4 4876
cf4a9129
LC
4877@node Base Services
4878@subsubsection Base Services
a1ba8475 4879
cf4a9129
LC
4880The @code{(gnu services base)} module provides definitions for the basic
4881services that one expects from the system. The services exported by
4882this module are listed below.
401c53c4 4883
cf4a9129
LC
4884@defvr {Scheme Variable} %base-services
4885This variable contains a list of basic services@footnote{Technically,
4886this is a list of monadic services. @xref{The Store Monad}.} one would
4887expect from the system: a login service (mingetty) on each tty, syslogd,
4888libc's name service cache daemon (nscd), the udev device manager, and
4889more.
401c53c4 4890
cf4a9129
LC
4891This is the default value of the @code{services} field of
4892@code{operating-system} declarations. Usually, when customizing a
4893system, you will want to append services to @var{%base-services}, like
4894this:
401c53c4 4895
cf4a9129 4896@example
fa1e31b8 4897(cons* (avahi-service) (lsh-service) %base-services)
cf4a9129
LC
4898@end example
4899@end defvr
401c53c4 4900
cf4a9129
LC
4901@deffn {Monadic Procedure} host-name-service @var{name}
4902Return a service that sets the host name to @var{name}.
4903@end deffn
401c53c4 4904
cf4a9129
LC
4905@deffn {Monadic Procedure} mingetty-service @var{tty} [#:motd] @
4906 [#:auto-login #f] [#:login-program] [#:login-pause? #f] @
4907 [#:allow-empty-passwords? #f]
4908Return a service to run mingetty on @var{tty}.
401c53c4 4909
cf4a9129
LC
4910When @var{allow-empty-passwords?} is true, allow empty log-in password. When
4911@var{auto-login} is true, it must be a user name under which to log-in
4912automatically. @var{login-pause?} can be set to @code{#t} in conjunction with
4913@var{auto-login}, in which case the user will have to press a key before the
4914login shell is launched.
401c53c4 4915
cf4a9129
LC
4916When true, @var{login-program} is a gexp or a monadic gexp denoting the name
4917of the log-in program (the default is the @code{login} program from the Shadow
4918tool suite.)
401c53c4 4919
cf4a9129
LC
4920@var{motd} is a monadic value containing a text file to use as
4921the ``message of the day''.
4922@end deffn
401c53c4 4923
6454b333
LC
4924@cindex name service cache daemon
4925@cindex nscd
4aee6e60
LC
4926@deffn {Monadic Procedure} nscd-service [@var{config}] [#:glibc glibc] @
4927 [#:name-services '()]
4928Return a service that runs libc's name service cache daemon (nscd) with
4929the given @var{config}---an @code{<nscd-configuration>} object.
4930Optionally, @code{#:name-services} is a list of packages that provide
4c9050c6
LC
4931name service switch (NSS) modules needed by nscd. @xref{Name Service
4932Switch}, for an example.
cf4a9129 4933@end deffn
401c53c4 4934
6454b333
LC
4935@defvr {Scheme Variable} %nscd-default-configuration
4936This is the default @code{<nscd-configuration>} value (see below) used
4937by @code{nscd-service}. This uses the caches defined by
4938@var{%nscd-default-caches}; see below.
4939@end defvr
4940
4941@deftp {Data Type} nscd-configuration
4942This is the type representing the name service cache daemon (nscd)
4943configuration.
4944
4945@table @asis
4946
4947@item @code{log-file} (default: @code{"/var/log/nscd.log"})
4948Name of nscd's log file. This is where debugging output goes when
4949@code{debug-level} is strictly positive.
4950
4951@item @code{debug-level} (default: @code{0})
4952Integer denoting the debugging levels. Higher numbers mean more
4953debugging output is logged.
4954
4955@item @code{caches} (default: @var{%nscd-default-caches})
4956List of @code{<nscd-cache>} objects denoting things to be cached; see
4957below.
4958
4959@end table
4960@end deftp
4961
4962@deftp {Data Type} nscd-cache
4963Data type representing a cache database of nscd and its parameters.
4964
4965@table @asis
4966
4967@item @code{database}
4968This is a symbol representing the name of the database to be cached.
4969Valid values are @code{passwd}, @code{group}, @code{hosts}, and
4970@code{services}, which designate the corresponding NSS database
4971(@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
4972
4973@item @code{positive-time-to-live}
4974@itemx @code{negative-time-to-live} (default: @code{20})
4975A number representing the number of seconds during which a positive or
4976negative lookup result remains in cache.
4977
4978@item @code{check-files?} (default: @code{#t})
4979Whether to check for updates of the files corresponding to
4980@var{database}.
4981
4982For instance, when @var{database} is @code{hosts}, setting this flag
4983instructs nscd to check for updates in @file{/etc/hosts} and to take
4984them into account.
4985
4986@item @code{persistent?} (default: @code{#t})
4987Whether the cache should be stored persistently on disk.
4988
4989@item @code{shared?} (default: @code{#t})
4990Whether the cache should be shared among users.
4991
4992@item @code{max-database-size} (default: 32@tie{}MiB)
4993Maximum size in bytes of the database cache.
4994
4995@c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
4996@c settings, so leave them out.
4997
4998@end table
4999@end deftp
5000
5001@defvr {Scheme Variable} %nscd-default-caches
5002List of @code{<nscd-cache>} objects used by default by
5003@code{nscd-configuration} (see above.)
5004
5005It enables persistent and aggressive caching of service and host name
5006lookups. The latter provides better host name lookup performance,
5007resilience in the face of unreliable name servers, and also better
5008privacy---often the result of host name lookups is in local cache, so
5009external name servers do not even need to be queried.
5010@end defvr
5011
5012
1bb76f75
AK
5013@deffn {Monadic Procedure} syslog-service [#:config-file #f]
5014Return a service that runs @code{syslogd}. If configuration file name
5015@var{config-file} is not specified, use some reasonable default
cf4a9129
LC
5016settings.
5017@end deffn
401c53c4 5018
cf4a9129
LC
5019@deffn {Monadic Procedure} guix-service [#:guix guix] @
5020 [#:builder-group "guixbuild"] [#:build-accounts 10] @
02bb6b45 5021 [#:authorize-hydra-key? #t] [#:use-substitutes? #t] @
cf4a9129
LC
5022 [#:extra-options '()]
5023Return a service that runs the build daemon from @var{guix}, and has
5024@var{build-accounts} user accounts available under @var{builder-group}.
401c53c4 5025
cf4a9129
LC
5026When @var{authorize-hydra-key?} is true, the @code{hydra.gnu.org} public key
5027provided by @var{guix} is authorized upon activation, meaning that substitutes
5028from @code{hydra.gnu.org} are used by default.
401c53c4 5029
cf4a9129
LC
5030If @var{use-substitutes?} is false, the daemon is run with
5031@option{--no-substitutes} (@pxref{Invoking guix-daemon,
5032@option{--no-substitutes}}).
401c53c4 5033
cf4a9129
LC
5034Finally, @var{extra-options} is a list of additional command-line options
5035passed to @command{guix-daemon}.
5036@end deffn
a1ba8475 5037
cf4a9129
LC
5038@deffn {Monadic Procedure} udev-service [#:udev udev]
5039Run @var{udev}, which populates the @file{/dev} directory dynamically.
5040@end deffn
401c53c4 5041
5eca9459
AK
5042@deffn {Monadic Procedure} console-keymap-service @var{file}
5043Return a service to load console keymap from @var{file} using
5044@command{loadkeys} command.
5045@end deffn
5046
a69576ea 5047
cf4a9129
LC
5048@node Networking Services
5049@subsubsection Networking Services
401c53c4 5050
fa1e31b8 5051The @code{(gnu services networking)} module provides services to configure
cf4a9129 5052the network interface.
a1ba8475 5053
a023cca8
LC
5054@cindex DHCP, networking service
5055@deffn {Monadic Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
5056Return a service that runs @var{dhcp}, a Dynamic Host Configuration
5057Protocol (DHCP) client, on all the non-loopback network interfaces.
5058@end deffn
5059
cf4a9129
LC
5060@deffn {Monadic Procedure} static-networking-service @var{interface} @var{ip} @
5061 [#:gateway #f] [#:name-services @code{'()}]
5062Return a service that starts @var{interface} with address @var{ip}. If
5063@var{gateway} is true, it must be a string specifying the default network
5064gateway.
5065@end deffn
8b315a6d 5066
b7d0c494
MW
5067@cindex wicd
5068@deffn {Monadic Procedure} wicd-service [#:wicd @var{wicd}]
5069Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a
5070network manager that aims to simplify wired and wireless networking.
5071@end deffn
5072
63854bcb
LC
5073@deffn {Monadic Procedure} ntp-service [#:ntp @var{ntp}] @
5074 [#:name-service @var{%ntp-servers}]
5075Return a service that runs the daemon from @var{ntp}, the
5076@uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
5077keep the system clock synchronized with that of @var{servers}.
5078@end deffn
5079
5080@defvr {Scheme Variable} %ntp-servers
5081List of host names used as the default NTP servers.
5082@end defvr
5083
cf4a9129
LC
5084@deffn {Monadic Procedure} tor-service [#:tor tor]
5085Return a service to run the @uref{https://torproject.org,Tor} daemon.
8b315a6d 5086
cf4a9129
LC
5087The daemon runs with the default settings (in particular the default exit
5088policy) as the @code{tor} unprivileged user.
5089@end deffn
8b315a6d 5090
4627a464
LC
5091@deffn {Monadic Procedure} bitlbee-service [#:bitlbee bitlbee] @
5092 [#:interface "127.0.0.1"] [#:port 6667] @
5093 [#:extra-settings ""]
5094Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
5095acts as a gateway between IRC and chat networks.
5096
5097The daemon will listen to the interface corresponding to the IP address
5098specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
5099local clients can connect, whereas @code{0.0.0.0} means that connections can
5100come from any networking interface.
5101
5102In addition, @var{extra-settings} specifies a string to append to the
5103configuration file.
5104@end deffn
5105
f4391bec 5106Furthermore, @code{(gnu services ssh)} provides the following service.
8b315a6d 5107
cf4a9129 5108@deffn {Monadic Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
5833bf33 5109 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
cf4a9129
LC
5110 [#:allow-empty-passwords? #f] [#:root-login? #f] @
5111 [#:syslog-output? #t] [#:x11-forwarding? #t] @
5112 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
21cc905a 5113 [#:public-key-authentication? #t] [#:initialize? #t]
cf4a9129
LC
5114Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
5115@var{host-key} must designate a file containing the host key, and readable
5116only by root.
72e25e35 5117
5833bf33
DP
5118When @var{daemonic?} is true, @command{lshd} will detach from the
5119controlling terminal and log its output to syslogd, unless one sets
5120@var{syslog-output?} to false. Obviously, it also makes lsh-service
5121depend on existence of syslogd service. When @var{pid-file?} is true,
5122@command{lshd} writes its PID to the file called @var{pid-file}.
5123
cf4a9129
LC
5124When @var{initialize?} is true, automatically create the seed and host key
5125upon service activation if they do not exist yet. This may take long and
5126require interaction.
8b315a6d 5127
20dd519c
LC
5128When @var{initialize?} is false, it is up to the user to initialize the
5129randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
5130a key pair with the private key stored in file @var{host-key} (@pxref{lshd
5131basics,,, lsh, LSH Manual}).
5132
cf4a9129
LC
5133When @var{interfaces} is empty, lshd listens for connections on all the
5134network interfaces; otherwise, @var{interfaces} must be a list of host names
5135or addresses.
9bf3c1a7 5136
20dd519c
LC
5137@var{allow-empty-passwords?} specifies whether to accept log-ins with empty
5138passwords, and @var{root-login?} specifies whether to accept log-ins as
cf4a9129 5139root.
4af2447e 5140
cf4a9129
LC
5141The other options should be self-descriptive.
5142@end deffn
4af2447e 5143
fa0c1d61
LC
5144@defvr {Scheme Variable} %facebook-host-aliases
5145This variable contains a string for use in @file{/etc/hosts}
5146(@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
5147line contains a entry that maps a known server name of the Facebook
5148on-line service---e.g., @code{www.facebook.com}---to the local
5149host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
5150
5151This variable is typically used in the @code{hosts-file} field of an
7313a52e
LC
5152@code{operating-system} declaration (@pxref{operating-system Reference,
5153@file{/etc/hosts}}):
fa0c1d61
LC
5154
5155@example
5156(use-modules (gnu) (guix))
5157
5158(operating-system
5159 (host-name "mymachine")
5160 ;; ...
5161 (hosts-file
5162 ;; Create a /etc/hosts file with aliases for "localhost"
5163 ;; and "mymachine", as well as for Facebook servers.
5164 (text-file "hosts"
5165 (string-append (local-host-aliases host-name)
5166 %facebook-host-aliases))))
5167@end example
5168
5169This mechanism can prevent programs running locally, such as Web
5170browsers, from accessing Facebook.
5171@end defvr
5172
965a7332
LC
5173The @code{(gnu services avahi)} provides the following definition.
5174
5175@deffn {Monadic Procedure} avahi-service [#:avahi @var{avahi}] @
5176 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
5177 [#:ipv6? #t] [#:wide-area? #f] @
5178 [#:domains-to-browse '()]
5179Return a service that runs @command{avahi-daemon}, a system-wide
5180mDNS/DNS-SD responder that allows for service discovery and
5181"zero-configuration" host name lookups (see @uref{http://avahi.org/}).
5182
5183If @var{host-name} is different from @code{#f}, use that as the host name to
5184publish for this machine; otherwise, use the machine's actual host name.
5185
5186When @var{publish?} is true, publishing of host names and services is allowed;
5187in particular, avahi-daemon will publish the machine's host name and IP
5188address via mDNS on the local network.
5189
5190When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
5191
5192Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
5193sockets.
5194@end deffn
5195
5196
cf4a9129
LC
5197@node X Window
5198@subsubsection X Window
68ad877c 5199
cf4a9129
LC
5200Support for the X Window graphical display system---specifically
5201Xorg---is provided by the @code{(gnu services xorg)} module. Note that
5202there is no @code{xorg-service} procedure. Instead, the X server is
5203started by the @dfn{login manager}, currently SLiM.
4af2447e 5204
cf4a9129 5205@deffn {Monadic Procedure} slim-service [#:allow-empty-passwords? #f] @
0ecc3bf3
LC
5206 [#:auto-login? #f] [#:default-user ""] [#:startx] @
5207 [#:theme @var{%default-slim-theme}] @
4bd43bbe 5208 [#:theme-name @var{%default-slim-theme-name}]
cf4a9129
LC
5209Return a service that spawns the SLiM graphical login manager, which in
5210turn starts the X display server with @var{startx}, a command as returned by
5211@code{xorg-start-command}.
4af2447e 5212
04e4e6ab
LC
5213@cindex X session
5214
5215SLiM automatically looks for session types described by the @file{.desktop}
5216files in @file{/run/current-system/profile/share/xsessions} and allows users
5217to choose a session from the log-in screen using @kbd{F1}. Packages such as
5218@var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
5219adding them to the system-wide set of packages automatically makes them
5220available at the log-in screen.
5221
5222In addition, @file{~/.xsession} files are honored. When available,
5223@file{~/.xsession} must be an executable that starts a window manager
5224and/or other X clients.
5225
cf4a9129
LC
5226When @var{allow-empty-passwords?} is true, allow logins with an empty
5227password. When @var{auto-login?} is true, log in automatically as
5228@var{default-user}.
0ecc3bf3
LC
5229
5230If @var{theme} is @code{#f}, the use the default log-in theme; otherwise
5231@var{theme} must be a gexp denoting the name of a directory containing the
5232theme to use. In that case, @var{theme-name} specifies the name of the
5233theme.
cf4a9129 5234@end deffn
4af2447e 5235
0ecc3bf3
LC
5236@defvr {Scheme Variable} %default-theme
5237@defvrx {Scheme Variable} %default-theme-name
5238The G-Expression denoting the default SLiM theme and its name.
5239@end defvr
5240
f703413e 5241@deffn {Monadic Procedure} xorg-start-command [#:guile] @
d2e59637 5242 [#:drivers '()] [#:resolutions '()] [#:xorg-server @var{xorg-server}]
f703413e
LC
5243Return a derivation that builds a @var{guile} script to start the X server
5244from @var{xorg-server}. Usually the X server is started by a login manager.
5245
5246@var{drivers} must be either the empty list, in which case Xorg chooses a
5247graphics driver automatically, or a list of driver names that will be tried in
5248this order---e.g., @code{("modesetting" "vesa")}.
d2e59637
LC
5249
5250Likewise, when @var{resolutions} is the empty list, Xorg chooses an
5251appropriate screen resolution; otherwise, it must be a list of
5252resolutions---e.g., @code{((1024 768) (640 480))}.
f703413e 5253@end deffn
4af2447e 5254
fe1a39d3
LC
5255@node Desktop Services
5256@subsubsection Desktop Services
aa4ed923 5257
fe1a39d3
LC
5258The @code{(gnu services desktop)} module provides services that are
5259usually useful in the context of a ``desktop'' setup---that is, on a
5260machine running a graphical display server, possibly with graphical user
5261interfaces, etc.
aa4ed923 5262
4467be21
LC
5263To simplify things, the module defines a variable containing the set of
5264services that users typically expect on a machine with a graphical
5265environment and networking:
5266
5267@defvr {Scheme Variable} %desktop-services
5268This is a list of services that builds upon @var{%base-services} and
5269adds or adjust services for a typical ``desktop'' setup.
5270
5271In particular, it adds a graphical login manager (@pxref{X Window,
5272@code{slim-service}}), a network management tool (@pxref{Networking
5273Services, @code{wicd-service}}), energy and color management services,
5274an NTP client and an SSH server (@pxref{Networking Services}), the Avahi
5275daemon, and has the name service switch service configured to be able to
5276use @code{nss-mdns} (@pxref{Name Service Switch, mDNS}).
5277@end defvr
5278
5279The @var{%desktop-services} variable can be used as the @code{services}
5280field of an @code{operating-system} declaration (@pxref{operating-system
5281Reference, @code{services}}).
5282
5283The actual service definitions provided by @code{(gnu services desktop)}
5284are described below.
5285
fe1a39d3
LC
5286@deffn {Monadic Procedure} dbus-service @var{services} @
5287 [#:dbus @var{dbus}]
5288Return a service that runs the ``system bus'', using @var{dbus}, with
5289support for @var{services}.
aa4ed923 5290
fe1a39d3
LC
5291@uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
5292facility. Its system bus is used to allow system services to communicate
5293and be notified of system-wide events.
aa4ed923 5294
fe1a39d3
LC
5295@var{services} must be a list of packages that provide an
5296@file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
5297and policy files. For example, to allow avahi-daemon to use the system bus,
5298@var{services} must be equal to @code{(list avahi)}.
aa4ed923
AK
5299@end deffn
5300
be234128
AW
5301@deffn {Monadic Procedure} upower-service [#:upower @var{upower}] @
5302 [#:watts-up-pro? #f] @
5303 [#:poll-batteries? #t] @
5304 [#:ignore-lid? #f] @
5305 [#:use-percentage-for-policy? #f] @
5306 [#:percentage-low 10] @
5307 [#:percentage-critical 3] @
5308 [#:percentage-action 2] @
5309 [#:time-low 1200] @
5310 [#:time-critical 300] @
5311 [#:time-action 120] @
5312 [#:critical-power-action 'hybrid-sleep]
5313Return a service that runs @uref{http://upower.freedesktop.org/,
5314@command{upowerd}}, a system-wide monitor for power consumption and battery
5315levels, with the given configuration settings. It implements the
5316@code{org.freedesktop.UPower} D-Bus interface, and is notably used by
5317GNOME.
5318@end deffn
5319
7ce597ff
AW
5320@deffn {Monadic Procedure} colord-service [#:colord @var{colord}]
5321Return a service that runs @command{colord}, a system service with a D-Bus
5322interface to manage the color profiles of input and output devices such as
5323screens and scanners. It is notably used by the GNOME Color Manager graphical
5324tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
5325site} for more information.
5326@end deffn
5327
105369a4
DT
5328@node Database Services
5329@subsubsection Database Services
5330
5331The @code{(gnu services databases)} module provides the following service.
5332
5333@deffn {Monadic Procedure} postgresql-service [#:postgresql postgresql] @
5334 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
5335Return a service that runs @var{postgresql}, the PostgreSQL database
5336server.
5337
5338The PostgreSQL daemon loads its runtime configuration from
5339@var{config-file} and stores the database cluster in
5340@var{data-directory}.
5341@end deffn
fe1a39d3
LC
5342
5343@node Various Services
5344@subsubsection Various Services
5345
5346The @code{(gnu services lirc)} module provides the following service.
5347
5348@deffn {Monadic Procedure} lirc-service [#:lirc lirc] @
5349 [#:device #f] [#:driver #f] [#:config-file #f] @
5350 [#:extra-options '()]
5351Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
5352decodes infrared signals from remote controls.
5353
5354Optionally, @var{device}, @var{driver} and @var{config-file}
5355(configuration file name) may be specified. See @command{lircd} manual
5356for details.
5357
5358Finally, @var{extra-options} is a list of additional command-line options
5359passed to @command{lircd}.
5360@end deffn
5361
5362
0ae8c15a
LC
5363@node Setuid Programs
5364@subsection Setuid Programs
5365
5366@cindex setuid programs
5367Some programs need to run with ``root'' privileges, even when they are
5368launched by unprivileged users. A notorious example is the
5369@command{passwd} programs, which can users can run to change their
5370password, and which requires write access to the @file{/etc/passwd} and
5371@file{/etc/shadow} files---something normally restricted to root, for
5372obvious security reasons. To address that, these executables are
5373@dfn{setuid-root}, meaning that they always run with root privileges
5374(@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
5375for more info about the setuid mechanisms.)
5376
5377The store itself @emph{cannot} contain setuid programs: that would be a
5378security issue since any user on the system can write derivations that
5379populate the store (@pxref{The Store}). Thus, a different mechanism is
5380used: instead of changing the setuid bit directly on files that are in
5381the store, we let the system administrator @emph{declare} which programs
5382should be setuid root.
5383
5384The @code{setuid-programs} field of an @code{operating-system}
5385declaration contains a list of G-expressions denoting the names of
5386programs to be setuid-root (@pxref{Using the Configuration System}).
5387For instance, the @command{passwd} program, which is part of the Shadow
5388package, can be designated by this G-expression (@pxref{G-Expressions}):
5389
5390@example
5391#~(string-append #$shadow "/bin/passwd")
5392@end example
5393
5394A default set of setuid programs is defined by the
5395@code{%setuid-programs} variable of the @code{(gnu system)} module.
5396
5397@defvr {Scheme Variable} %setuid-programs
5398A list of G-expressions denoting common programs that are setuid-root.
5399
5400The list includes commands such as @command{passwd}, @command{ping},
5401@command{su}, and @command{sudo}.
5402@end defvr
5403
5404Under the hood, the actual setuid programs are created in the
5405@file{/run/setuid-programs} directory at system activation time. The
5406files in this directory refer to the ``real'' binaries, which are in the
5407store.
5408
efb5e833
LC
5409@node X.509 Certificates
5410@subsection X.509 Certificates
5411
5412@cindex HTTPS, certificates
5413@cindex X.509 certificates
5414@cindex TLS
5415Web servers available over HTTPS (that is, HTTP over the transport-layer
5416security mechanism, TLS) send client programs an @dfn{X.509 certificate}
5417that the client can then use to @emph{authenticate} the server. To do
5418that, clients verify that the server's certificate is signed by a
5419so-called @dfn{certificate authority} (CA). But to verify the CA's
5420signature, clients must have first acquired the CA's certificate.
5421
5422Web browsers such as GNU@tie{}IceCat include their own set of CA
5423certificates, such that they are able to verify CA signatures
5424out-of-the-box.
5425
5426However, most other programs that can talk HTTPS---@command{wget},
5427@command{git}, @command{w3m}, etc.---need to be told where CA
5428certificates can be found.
5429
5430@cindex @code{nss-certs}
5431In GuixSD, this is done by adding a package that provides certificates
5432to the @code{packages} field of the @code{operating-system} declaration
5433(@pxref{operating-system Reference}). GuixSD includes one such package,
5434@code{nss-certs}, which is a set of CA certificates provided as part of
5435Mozilla's Network Security Services.
5436
5437Note that it is @emph{not} part of @var{%base-packages}, so you need to
5438explicitly add it. The @file{/etc/ssl/certs} directory, which is where
5439most applications and libraries look for certificates by default, points
5440to the certificates installed globally.
5441
5442Unprivileged users can also install their own certificate package in
5443their profile. A number of environment variables need to be defined so
5444that applications and libraries know where to find them. Namely, the
5445OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
5446variables. Some applications add their own environment variables; for
5447instance, the Git version control system honors the certificate bundle
5448pointed to by the @code{GIT_SSL_CAINFO} environment variable.
5449
5450
996ed739
LC
5451@node Name Service Switch
5452@subsection Name Service Switch
5453
5454@cindex name service switch
5455@cindex NSS
5456The @code{(gnu system nss)} module provides bindings to the
5457configuration file of libc's @dfn{name service switch} or @dfn{NSS}
5458(@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
5459Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
5460extended with new ``name'' lookup methods for system databases, which
5461includes host names, service names, user accounts, and more (@pxref{Name
5462Service Switch, System Databases and Name Service Switch,, libc, The GNU
5463C Library Reference Manual}).
5464
5465The NSS configuration specifies, for each system database, which lookup
5466method is to be used, and how the various methods are chained
5467together---for instance, under which circumstances NSS should try the
5468next method in the list. The NSS configuration is given in the
5469@code{name-service-switch} field of @code{operating-system} declarations
5470(@pxref{operating-system Reference, @code{name-service-switch}}).
5471
4c9050c6
LC
5472@cindex nss-mdns
5473@cindex .local, host name lookup
996ed739 5474As an example, the declaration below configures the NSS to use the
4c9050c6
LC
5475@uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
5476back-end}, which supports host name lookups over multicast DNS (mDNS)
5477for host names ending in @code{.local}:
996ed739
LC
5478
5479@example
5480(name-service-switch
5481 (hosts (list %files ;first, check /etc/hosts
5482
5483 ;; If the above did not succeed, try
5484 ;; with 'mdns_minimal'.
5485 (name-service
5486 (name "mdns_minimal")
5487
5488 ;; 'mdns_minimal' is authoritative for
5489 ;; '.local'. When it returns "not found",
5490 ;; no need to try the next methods.
5491 (reaction (lookup-specification
5492 (not-found => return))))
5493
5494 ;; Then fall back to DNS.
5495 (name-service
5496 (name "dns"))
5497
5498 ;; Finally, try with the "full" 'mdns'.
5499 (name-service
5500 (name "mdns")))))
5501@end example
5502
15137a29
LC
5503Don't worry: the @code{%mdns-host-lookup-nss} variable (see below)
5504contains this configuration, so you won't have to type it if all you
5505want is to have @code{.local} host lookup working.
5506
4c9050c6
LC
5507Note that, in this case, in addition to setting the
5508@code{name-service-switch} of the @code{operating-system} declaration,
5509@code{nscd-service} must be told where to find the @code{nss-mdns}
5510shared library (@pxref{Base Services, @code{nscd-service}}). Since the
5511@code{nscd} service is part of @var{%base-services}, you may want to
5512customize it by adding this snippet in the operating system
5513configuration file:
5514
5515@example
5516(use-modules (guix) (gnu))
5517
5518(define %my-base-services
5519 ;; Replace the default nscd service with one that knows
5520 ;; about nss-mdns.
5521 (map (lambda (mservice)
5522 ;; "Bind" the MSERVICE monadic value to inspect it.
5523 (mlet %store-monad ((service mservice))
5524 (if (member 'nscd (service-provision service))
5525 (nscd-service (nscd-configuration)
5526 #:name-services (list nss-mdns))
5527 mservice)))
5528 %base-services))
5529@end example
5530
5531@noindent
5532@dots{} and then refer to @var{%my-base-services} instead of
5533@var{%base-services} in the @code{operating-system} declaration.
15137a29 5534Lastly, this relies on the availability of the Avahi service
965a7332 5535(@pxref{Networking Services, @code{avahi-service}}).
15137a29
LC
5536
5537For convenience, the following variables provide typical NSS
5538configurations.
5539
5540@defvr {Scheme Variable} %default-nss
5541This is the default name service switch configuration, a
5542@code{name-service-switch} object.
5543@end defvr
5544
5545@defvr {Scheme Variable} %mdns-host-lookup-nss
5546This is the name service switch configuration with support for host name
5547lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
5548@end defvr
4c9050c6 5549
996ed739
LC
5550The reference for name service switch configuration is given below. It
5551is a direct mapping of the C library's configuration file format, so
5552please refer to the C library manual for more information (@pxref{NSS
5553Configuration File,,, libc, The GNU C Library Reference Manual}).
5554Compared to libc's NSS configuration file format, it has the advantage
5555not only of adding this warm parenthetic feel that we like, but also
5556static checks: you'll know about syntax errors and typos as soon as you
5557run @command{guix system}.
5558
996ed739
LC
5559@deftp {Data Type} name-service-switch
5560
5561This is the data type representation the configuration of libc's name
5562service switch (NSS). Each field below represents one of the supported
5563system databases.
5564
5565@table @code
5566@item aliases
5567@itemx ethers
5568@itemx group
5569@itemx gshadow
5570@itemx hosts
5571@itemx initgroups
5572@itemx netgroup
5573@itemx networks
5574@itemx password
5575@itemx public-key
5576@itemx rpc
5577@itemx services
5578@itemx shadow
5579The system databases handled by the NSS. Each of these fields must be a
5580list of @code{<name-service>} objects (see below.)
5581@end table
5582@end deftp
5583
5584@deftp {Data Type} name-service
5585
5586This is the data type representing an actual name service and the
5587associated lookup action.
5588
5589@table @code
5590@item name
5591A string denoting the name service (@pxref{Services in the NSS
5592configuration,,, libc, The GNU C Library Reference Manual}).
5593
4aee6e60
LC
5594Note that name services listed here must be visible to nscd. This is
5595achieved by passing the @code{#:name-services} argument to
5596@code{nscd-service} the list of packages providing the needed name
5597services (@pxref{Base Services, @code{nscd-service}}).
5598
996ed739
LC
5599@item reaction
5600An action specified using the @code{lookup-specification} macro
5601(@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
5602Reference Manual}). For example:
5603
5604@example
5605(lookup-specification (unavailable => continue)
5606 (success => return))
5607@end example
5608@end table
5609@end deftp
0ae8c15a 5610
fd1b1fa2
LC
5611@node Initial RAM Disk
5612@subsection Initial RAM Disk
5613
5614@cindex initial RAM disk (initrd)
5615@cindex initrd (initial RAM disk)
5616For bootstrapping purposes, the Linux-Libre kernel is passed an
5617@dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
5618root file system, as well as an initialization script. The latter is
5619responsible for mounting the real root file system, and for loading any
5620kernel modules that may be needed to achieve that.
5621
5622The @code{initrd} field of an @code{operating-system} declaration allows
5623you to specify which initrd you would like to use. The @code{(gnu
5624system linux-initrd)} module provides two ways to build an initrd: the
5625high-level @code{base-initrd} procedure, and the low-level
5626@code{expression->initrd} procedure.
5627
5628The @code{base-initrd} procedure is intended to cover most common uses.
5629For example, if you want to add a bunch of kernel modules to be loaded
5630at boot time, you can define the @code{initrd} field of the operating
5631system declaration like this:
5632
5633@example
52ac153e 5634(initrd (lambda (file-systems . rest)
027981d6
LC
5635 ;; Create a standard initrd that has modules "foo.ko"
5636 ;; and "bar.ko", as well as their dependencies, in
5637 ;; addition to the modules available by default.
52ac153e 5638 (apply base-initrd file-systems
027981d6 5639 #:extra-modules '("foo" "bar")
52ac153e 5640 rest)))
fd1b1fa2
LC
5641@end example
5642
52ac153e
LC
5643The @code{base-initrd} procedure also handles common use cases that
5644involves using the system as a QEMU guest, or as a ``live'' system whose
5645root file system is volatile.
fd1b1fa2
LC
5646
5647@deffn {Monadic Procedure} base-initrd @var{file-systems} @
5648 [#:qemu-networking? #f] [#:virtio? #f] [#:volatile-root? #f] @
52ac153e 5649 [#:extra-modules '()] [#:mapped-devices '()]
fd1b1fa2
LC
5650Return a monadic derivation that builds a generic initrd. @var{file-systems} is
5651a list of file-systems to be mounted by the initrd, possibly in addition to
5652the root file system specified on the kernel command line via @code{--root}.
52ac153e
LC
5653@var{mapped-devices} is a list of device mappings to realize before
5654@var{file-systems} are mounted (@pxref{Mapped Devices}).
fd1b1fa2
LC
5655
5656When @var{qemu-networking?} is true, set up networking with the standard QEMU
5657parameters. When @var{virtio?} is true, load additional modules so the initrd can
5658be used as a QEMU guest with para-virtualized I/O drivers.
5659
5660When @var{volatile-root?} is true, the root file system is writable but any changes
5661to it are lost.
5662
5663The initrd is automatically populated with all the kernel modules necessary
5664for @var{file-systems} and for the given options. However, additional kernel
5665modules can be listed in @var{extra-modules}. They will be added to the initrd, and
5666loaded at boot time in the order in which they appear.
5667@end deffn
5668
5669Needless to say, the initrds we produce and use embed a
5670statically-linked Guile, and the initialization program is a Guile
5671program. That gives a lot of flexibility. The
5672@code{expression->initrd} procedure builds such an initrd, given the
5673program to run in that initrd.
5674
5675@deffn {Monadic Procedure} expression->initrd @var{exp} @
5676 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
42d10464 5677 [#:modules '()]
fd1b1fa2
LC
5678Return a derivation that builds a Linux initrd (a gzipped cpio archive)
5679containing @var{guile} and that evaluates @var{exp}, a G-expression,
df650fa8
LC
5680upon booting. All the derivations referenced by @var{exp} are
5681automatically copied to the initrd.
fd1b1fa2 5682
42d10464
LC
5683@var{modules} is a list of Guile module names to be embedded in the
5684initrd.
fd1b1fa2
LC
5685@end deffn
5686
88faf933
LC
5687@node GRUB Configuration
5688@subsection GRUB Configuration
5689
5690@cindex GRUB
5691@cindex boot loader
5692
5693The operating system uses GNU@tie{}GRUB as its boot loader
5694(@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
5695configured using @code{grub-configuration} declarations. This data type
5696is exported by the @code{(gnu system grub)} module, and described below.
5697
5698@deftp {Data Type} grub-configuration
5699The type of a GRUB configuration declaration.
5700
5701@table @asis
5702
5703@item @code{device}
5704This is a string denoting the boot device. It must be a device name
5705understood by the @command{grub-install} command, such as
5706@code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
5707GNU GRUB Manual}).
5708
5709@item @code{menu-entries} (default: @code{()})
5710A possibly empty list of @code{menu-entry} objects (see below), denoting
5711entries to appear in the GRUB boot menu, in addition to the current
5712system entry and the entry pointing to previous system generations.
5713
5714@item @code{default-entry} (default: @code{0})
5715The index of the default boot menu entry. Index 0 is for the current
5716system's entry.
5717
5718@item @code{timeout} (default: @code{5})
5719The number of seconds to wait for keyboard input before booting. Set to
57200 to boot immediately, and to -1 to wait indefinitely.
5721
5722@item @code{theme} (default: @var{%default-theme})
5723The @code{grub-theme} object describing the theme to use.
5724@end table
5725
5726@end deftp
5727
5728Should you want to list additional boot menu entries @i{via} the
5729@code{menu-entries} field above, you will need to create them with the
5730@code{menu-entry} form:
5731
5732@deftp {Data Type} menu-entry
5733The type of an entry in the GRUB boot menu.
5734
5735@table @asis
5736
5737@item @code{label}
35ed9306 5738The label to show in the menu---e.g., @code{"GNU"}.
88faf933
LC
5739
5740@item @code{linux}
5741The Linux kernel to boot.
5742
5743@item @code{linux-arguments} (default: @code{()})
5744The list of extra Linux kernel command-line arguments---e.g.,
5745@code{("console=ttyS0")}.
5746
5747@item @code{initrd}
5748A G-Expression or string denoting the file name of the initial RAM disk
5749to use (@pxref{G-Expressions}).
5750
5751@end table
5752@end deftp
5753
5754@c FIXME: Write documentation once it's stable.
5755Themes are created using the @code{grub-theme} form, which is not
5756documented yet.
5757
5758@defvr {Scheme Variable} %default-theme
5759This is the default GRUB theme used by the operating system, with a
5760fancy background image displaying the GNU and Guix logos.
5761@end defvr
5762
5763
cf4a9129
LC
5764@node Invoking guix system
5765@subsection Invoking @code{guix system}
0918e64a 5766
cf4a9129
LC
5767Once you have written an operating system declaration, as seen in the
5768previous section, it can be @dfn{instantiated} using the @command{guix
5769system} command. The synopsis is:
4af2447e 5770
cf4a9129
LC
5771@example
5772guix system @var{options}@dots{} @var{action} @var{file}
5773@end example
4af2447e 5774
cf4a9129
LC
5775@var{file} must be the name of a file containing an
5776@code{operating-system} declaration. @var{action} specifies how the
5777operating system is instantiate. Currently the following values are
5778supported:
4af2447e 5779
cf4a9129
LC
5780@table @code
5781@item reconfigure
5782Build the operating system described in @var{file}, activate it, and
5783switch to it@footnote{This action is usable only on systems already
5784running GNU.}.
4af2447e 5785
cf4a9129
LC
5786This effects all the configuration specified in @var{file}: user
5787accounts, system services, global package list, setuid programs, etc.
4af2447e 5788
cf4a9129
LC
5789It also adds a GRUB menu entry for the new OS configuration, and moves
5790entries for older configurations to a submenu---unless
5791@option{--no-grub} is passed.
4af2447e 5792
bf2479c7
LC
5793@c The paragraph below refers to the problem discussed at
5794@c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
5795It is highly recommended to run @command{guix pull} once before you run
5796@command{guix system reconfigure} for the first time (@pxref{Invoking
5797guix pull}). Failing to do that you would see an older version of Guix
5798once @command{reconfigure} has completed.
5799
cf4a9129
LC
5800@item build
5801Build the operating system's derivation, which includes all the
5802configuration files and programs needed to boot and run the system.
5803This action does not actually install anything.
113daf62 5804
cf4a9129
LC
5805@item init
5806Populate the given directory with all the files necessary to run the
5807operating system specified in @var{file}. This is useful for first-time
4705641f 5808installations of GuixSD. For instance:
113daf62
LC
5809
5810@example
cf4a9129 5811guix system init my-os-config.scm /mnt
113daf62
LC
5812@end example
5813
cf4a9129
LC
5814copies to @file{/mnt} all the store items required by the configuration
5815specified in @file{my-os-config.scm}. This includes configuration
5816files, packages, and so on. It also creates other essential files
5817needed for the system to operate correctly---e.g., the @file{/etc},
5818@file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
113daf62 5819
cf4a9129
LC
5820This command also installs GRUB on the device specified in
5821@file{my-os-config}, unless the @option{--no-grub} option was passed.
113daf62 5822
cf4a9129
LC
5823@item vm
5824@cindex virtual machine
0276f697 5825@cindex VM
cf4a9129
LC
5826Build a virtual machine that contain the operating system declared in
5827@var{file}, and return a script to run that virtual machine (VM).
810568b3 5828Arguments given to the script are passed as is to QEMU.
113daf62 5829
cf4a9129 5830The VM shares its store with the host system.
113daf62 5831
0276f697
LC
5832Additional file systems can be shared between the host and the VM using
5833the @code{--share} and @code{--expose} command-line options: the former
5834specifies a directory to be shared with write access, while the latter
5835provides read-only access to the shared directory.
5836
5837The example below creates a VM in which the user's home directory is
5838accessible read-only, and where the @file{/exchange} directory is a
5839read-write mapping of the host's @file{$HOME/tmp}:
5840
5841@example
5842guix system vm my-config.scm \
5843 --expose=$HOME --share=$HOME/tmp=/exchange
5844@end example
5845
6aa260af
LC
5846On GNU/Linux, the default is to boot directly to the kernel; this has
5847the advantage of requiring only a very tiny root disk image since the
5848host's store can then be mounted.
5849
5850The @code{--full-boot} option forces a complete boot sequence, starting
5851with the bootloader. This requires more disk space since a root image
5852containing at least the kernel, initrd, and bootloader data files must
5853be created. The @code{--image-size} option can be used to specify the
5854image's size.
ab11f0be 5855
cf4a9129
LC
5856@item vm-image
5857@itemx disk-image
5858Return a virtual machine or disk image of the operating system declared
5859in @var{file} that stands alone. Use the @option{--image-size} option
5860to specify the size of the image.
113daf62 5861
cf4a9129
LC
5862When using @code{vm-image}, the returned image is in qcow2 format, which
5863the QEMU emulator can efficiently use.
113daf62 5864
cf4a9129
LC
5865When using @code{disk-image}, a raw disk image is produced; it can be
5866copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
5867the device corresponding to a USB stick, one can copy the image on it
5868using the following command:
113daf62 5869
cf4a9129
LC
5870@example
5871# dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
5872@end example
113daf62 5873
cf4a9129 5874@end table
113daf62 5875
cf4a9129
LC
5876@var{options} can contain any of the common build options provided by
5877@command{guix build} (@pxref{Invoking guix build}). In addition,
5878@var{options} can contain one of the following:
113daf62 5879
cf4a9129
LC
5880@table @option
5881@item --system=@var{system}
5882@itemx -s @var{system}
5883Attempt to build for @var{system} instead of the host's system type.
5884This works as per @command{guix build} (@pxref{Invoking guix build}).
113daf62 5885
cf4a9129
LC
5886@item --image-size=@var{size}
5887For the @code{vm-image} and @code{disk-image} actions, create an image
5888of the given @var{size}. @var{size} may be a number of bytes, or it may
4a44d7bb
LC
5889include a unit as a suffix (@pxref{Block size, size specifications,,
5890coreutils, GNU Coreutils}).
113daf62 5891@end table
113daf62 5892
cf4a9129
LC
5893Note that all the actions above, except @code{build} and @code{init},
5894rely on KVM support in the Linux-Libre kernel. Specifically, the
5895machine should have hardware virtualization support, the corresponding
5896KVM kernel module should be loaded, and the @file{/dev/kvm} device node
5897must exist and be readable and writable by the user and by the daemon's
5898build users.
8451a568 5899
cf4a9129
LC
5900@node Defining Services
5901@subsection Defining Services
8451a568 5902
cf4a9129
LC
5903The @code{(gnu services @dots{})} modules define several procedures that allow
5904users to declare the operating system's services (@pxref{Using the
5905Configuration System}). These procedures are @emph{monadic
5906procedures}---i.e., procedures that return a monadic value in the store
5907monad (@pxref{The Store Monad}). For examples of such procedures,
5908@xref{Services}.
8451a568 5909
cf4a9129
LC
5910@cindex service definition
5911The monadic value returned by those procedures is a @dfn{service
5912definition}---a structure as returned by the @code{service} form.
5913Service definitions specifies the inputs the service depends on, and an
5914expression to start and stop the service. Behind the scenes, service
5915definitions are ``translated'' into the form suitable for the
5916configuration file of dmd, the init system (@pxref{Services,,, dmd, GNU
5917dmd Manual}).
8451a568 5918
cf4a9129
LC
5919As an example, here is what the @code{nscd-service} procedure looks
5920like:
8451a568 5921
cf4a9129
LC
5922@lisp
5923(define (nscd-service)
5924 (with-monad %store-monad
5925 (return (service
5926 (documentation "Run libc's name service cache daemon.")
5927 (provision '(nscd))
5928 (activate #~(begin
5929 (use-modules (guix build utils))
5930 (mkdir-p "/var/run/nscd")))
5931 (start #~(make-forkexec-constructor
5932 (string-append #$glibc "/sbin/nscd")
5933 "-f" "/dev/null" "--foreground"))
5934 (stop #~(make-kill-destructor))
5935 (respawn? #f)))))
5936@end lisp
8451a568 5937
cf4a9129
LC
5938@noindent
5939The @code{activate}, @code{start}, and @code{stop} fields are G-expressions
5940(@pxref{G-Expressions}). The @code{activate} field contains a script to
5941run at ``activation'' time; it makes sure that the @file{/var/run/nscd}
5942directory exists before @command{nscd} is started.
8451a568 5943
cf4a9129
LC
5944The @code{start} and @code{stop} fields refer to dmd's facilities to
5945start and stop processes (@pxref{Service De- and Constructors,,, dmd,
5946GNU dmd Manual}). The @code{provision} field specifies the name under
5947which this service is known to dmd, and @code{documentation} specifies
5948on-line documentation. Thus, the commands @command{deco start ncsd},
5949@command{deco stop nscd}, and @command{deco doc nscd} will do what you
5950would expect (@pxref{Invoking deco,,, dmd, GNU dmd Manual}).
8451a568 5951
8451a568 5952
cf4a9129
LC
5953@node Installing Debugging Files
5954@section Installing Debugging Files
8451a568 5955
cf4a9129
LC
5956@cindex debugging files
5957Program binaries, as produced by the GCC compilers for instance, are
5958typically written in the ELF format, with a section containing
5959@dfn{debugging information}. Debugging information is what allows the
5960debugger, GDB, to map binary code to source code; it is required to
5961debug a compiled program in good conditions.
8451a568 5962
cf4a9129
LC
5963The problem with debugging information is that is takes up a fair amount
5964of disk space. For example, debugging information for the GNU C Library
5965weighs in at more than 60 MiB. Thus, as a user, keeping all the
5966debugging info of all the installed programs is usually not an option.
5967Yet, space savings should not come at the cost of an impediment to
5968debugging---especially in the GNU system, which should make it easier
5969for users to exert their computing freedom (@pxref{GNU Distribution}).
8451a568 5970
cf4a9129
LC
5971Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
5972mechanism that allows users to get the best of both worlds: debugging
5973information can be stripped from the binaries and stored in separate
5974files. GDB is then able to load debugging information from those files,
5975when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
5976with GDB}).
8451a568 5977
cf4a9129
LC
5978The GNU distribution takes advantage of this by storing debugging
5979information in the @code{lib/debug} sub-directory of a separate package
5980output unimaginatively called @code{debug} (@pxref{Packages with
5981Multiple Outputs}). Users can choose to install the @code{debug} output
5982of a package when they need it. For instance, the following command
5983installs the debugging information for the GNU C Library and for GNU
5984Guile:
8451a568
LC
5985
5986@example
cf4a9129 5987guix package -i glibc:debug guile:debug
8451a568
LC
5988@end example
5989
cf4a9129
LC
5990GDB must then be told to look for debug files in the user's profile, by
5991setting the @code{debug-file-directory} variable (consider setting it
5992from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
5993GDB}):
8451a568 5994
cf4a9129
LC
5995@example
5996(gdb) set debug-file-directory ~/.guix-profile/lib/debug
5997@end example
8451a568 5998
cf4a9129
LC
5999From there on, GDB will pick up debugging information from the
6000@code{.debug} files under @file{~/.guix-profile/lib/debug}.
8451a568 6001
cf4a9129
LC
6002In addition, you will most likely want GDB to be able to show the source
6003code being debugged. To do that, you will have to unpack the source
6004code of the package of interest (obtained with @code{guix build
6005--source}, @pxref{Invoking guix build}), and to point GDB to that source
6006directory using the @code{directory} command (@pxref{Source Path,
6007@code{directory},, gdb, Debugging with GDB}).
8451a568 6008
cf4a9129
LC
6009@c XXX: keep me up-to-date
6010The @code{debug} output mechanism in Guix is implemented by the
6011@code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
6012opt-in---debugging information is available only for those packages
6013whose definition explicitly declares a @code{debug} output. This may be
6014changed to opt-out in the future, if our build farm servers can handle
6015the load. To check whether a package has a @code{debug} output, use
6016@command{guix package --list-available} (@pxref{Invoking guix package}).
8451a568 6017
8451a568 6018
05962f29
LC
6019@node Security Updates
6020@section Security Updates
6021
843858b8
LC
6022@quotation Note
6023As of version @value{VERSION}, the feature described in this section is
6024experimental.
6025@end quotation
05962f29
LC
6026
6027@cindex security updates
6028Occasionally, important security vulnerabilities are discovered in core
6029software packages and must be patched. Guix follows a functional
6030package management discipline (@pxref{Introduction}), which implies
6031that, when a package is changed, @emph{every package that depends on it}
6032must be rebuilt. This can significantly slow down the deployment of
6033fixes in core packages such as libc or Bash, since basically the whole
6034distribution would need to be rebuilt. Using pre-built binaries helps
6035(@pxref{Substitutes}), but deployment may still take more time than
6036desired.
6037
6038@cindex grafts
6039To address that, Guix implements @dfn{grafts}, a mechanism that allows
6040for fast deployment of critical updates without the costs associated
6041with a whole-distribution rebuild. The idea is to rebuild only the
6042package that needs to be patched, and then to ``graft'' it onto packages
6043explicitly installed by the user and that were previously referring to
6044the original package. The cost of grafting is typically very low, and
6045order of magnitudes lower than a full rebuild of the dependency chain.
6046
6047@cindex replacements of packages, for grafts
6048For instance, suppose a security update needs to be applied to Bash.
6049Guix developers will provide a package definition for the ``fixed''
6050Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
6051Packages}). Then, the original package definition is augmented with a
6052@code{replacement} field pointing to the package containing the bug fix:
6053
6054@example
6055(define bash
6056 (package
6057 (name "bash")
6058 ;; @dots{}
6059 (replacement bash-fixed)))
6060@end example
6061
6062From there on, any package depending directly or indirectly on Bash that
6063is installed will automatically be ``rewritten'' to refer to
6064@var{bash-fixed} instead of @var{bash}. This grafting process takes
6065time proportional to the size of the package, but expect less than a
6066minute for an ``average'' package on a recent machine.
6067
6068Currently, the graft and the package it replaces (@var{bash-fixed} and
6069@var{bash} in the example above) must have the exact same @code{name}
6070and @code{version} fields. This restriction mostly comes from the fact
6071that grafting works by patching files, including binary files, directly.
6072Other restrictions may apply: for instance, when adding a graft to a
6073package providing a shared library, the original shared library and its
6074replacement must have the same @code{SONAME} and be binary-compatible.
6075
6076
cf4a9129
LC
6077@node Package Modules
6078@section Package Modules
8451a568 6079
cf4a9129
LC
6080From a programming viewpoint, the package definitions of the
6081GNU distribution are provided by Guile modules in the @code{(gnu packages
6082@dots{})} name space@footnote{Note that packages under the @code{(gnu
6083packages @dots{})} module name space are not necessarily ``GNU
6084packages''. This module naming scheme follows the usual Guile module
6085naming convention: @code{gnu} means that these modules are distributed
6086as part of the GNU system, and @code{packages} identifies modules that
6087define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
6088Reference Manual}). For instance, the @code{(gnu packages emacs)}
6089module exports a variable named @code{emacs}, which is bound to a
6090@code{<package>} object (@pxref{Defining Packages}).
113daf62 6091
300868ba 6092The @code{(gnu packages @dots{})} module name space is
cf4a9129
LC
6093automatically scanned for packages by the command-line tools. For
6094instance, when running @code{guix package -i emacs}, all the @code{(gnu
6095packages @dots{})} modules are scanned until one that exports a package
6096object whose name is @code{emacs} is found. This package search
6097facility is implemented in the @code{(gnu packages)} module.
113daf62 6098
300868ba 6099@cindex customization, of packages
8689901f 6100@cindex package module search path
cf4a9129 6101Users can store package definitions in modules with different
60142854
LC
6102names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
6103name and module name must match. @xref{Modules and the File System,,,
6104guile, GNU Guile Reference Manual}, for details.} These package definitions
300868ba
LC
6105will not be visible by default. Thus, users can invoke commands such as
6106@command{guix package} and @command{guix build} have to be used with the
6107@code{-e} option so that they know where to find the package, or use the
6108@code{-L} option of these commands to make those modules visible
8689901f
LC
6109(@pxref{Invoking guix build, @code{--load-path}}), or define the
6110@code{GUIX_PACKAGE_PATH} environment variable. This environment
6111variable makes it easy to extend or customize the distribution and is
6112honored by all the user interfaces.
6113
6114@defvr {Environment Variable} GUIX_PACKAGE_PATH
6115This is a colon-separated list of directories to search for package
6116modules. Directories listed in this variable take precedence over the
6117distribution's own modules.
6118@end defvr
ef5dd60a 6119
cf4a9129
LC
6120The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
6121each package is built based solely on other packages in the
6122distribution. The root of this dependency graph is a small set of
6123@dfn{bootstrap binaries}, provided by the @code{(gnu packages
6124bootstrap)} module. For more information on bootstrapping,
081145cf 6125@pxref{Bootstrapping}.
ef5dd60a 6126
cf4a9129
LC
6127@node Packaging Guidelines
6128@section Packaging Guidelines
ef5dd60a 6129
cf4a9129
LC
6130The GNU distribution is nascent and may well lack some of your favorite
6131packages. This section describes how you can help make the distribution
6132grow. @xref{Contributing}, for additional information on how you can
6133help.
ef5dd60a 6134
cf4a9129
LC
6135Free software packages are usually distributed in the form of
6136@dfn{source code tarballs}---typically @file{tar.gz} files that contain
6137all the source files. Adding a package to the distribution means
6138essentially two things: adding a @dfn{recipe} that describes how to
6139build the package, including a list of other packages required to build
6140it, and adding @dfn{package meta-data} along with that recipe, such as a
6141description and licensing information.
ef5dd60a 6142
cf4a9129
LC
6143In Guix all this information is embodied in @dfn{package definitions}.
6144Package definitions provide a high-level view of the package. They are
6145written using the syntax of the Scheme programming language; in fact,
6146for each package we define a variable bound to the package definition,
6147and export that variable from a module (@pxref{Package Modules}).
6148However, in-depth Scheme knowledge is @emph{not} a prerequisite for
6149creating packages. For more information on package definitions,
081145cf 6150@pxref{Defining Packages}.
ef5dd60a 6151
cf4a9129
LC
6152Once a package definition is in place, stored in a file in the Guix
6153source tree, it can be tested using the @command{guix build} command
6154(@pxref{Invoking guix build}). For example, assuming the new package is
6155called @code{gnew}, you may run this command from the Guix build tree:
ef5dd60a
LC
6156
6157@example
cf4a9129 6158./pre-inst-env guix build gnew --keep-failed
ef5dd60a 6159@end example
ef5dd60a 6160
cf4a9129
LC
6161Using @code{--keep-failed} makes it easier to debug build failures since
6162it provides access to the failed build tree. Another useful
6163command-line option when debugging is @code{--log-file}, to access the
6164build log.
ef5dd60a 6165
cf4a9129
LC
6166If the package is unknown to the @command{guix} command, it may be that
6167the source file contains a syntax error, or lacks a @code{define-public}
6168clause to export the package variable. To figure it out, you may load
6169the module from Guile to get more information about the actual error:
ef5dd60a 6170
cf4a9129
LC
6171@example
6172./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
6173@end example
ef5dd60a 6174
cf4a9129
LC
6175Once your package builds correctly, please send us a patch
6176(@pxref{Contributing}). Well, if you need help, we will be happy to
6177help you too. Once the patch is committed in the Guix repository, the
6178new package automatically gets built on the supported platforms by
2b1cee21 6179@url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
cf4a9129 6180system}.
ef5dd60a 6181
cf4a9129
LC
6182@cindex substituter
6183Users can obtain the new package definition simply by running
6184@command{guix pull} (@pxref{Invoking guix pull}). When
6185@code{hydra.gnu.org} is done building the package, installing the
6186package automatically downloads binaries from there
6187(@pxref{Substitutes}). The only place where human intervention is
6188needed is to review and apply the patch.
ef5dd60a 6189
ef5dd60a 6190
cf4a9129 6191@menu
ec0339cd
LC
6192* Software Freedom:: What may go into the distribution.
6193* Package Naming:: What's in a name?
6194* Version Numbers:: When the name is not enough.
6195* Python Modules:: Taming the snake.
6196* Perl Modules:: Little pearls.
6197* Fonts:: Fond of fonts.
cf4a9129 6198@end menu
ef5dd60a 6199
cf4a9129
LC
6200@node Software Freedom
6201@subsection Software Freedom
ef5dd60a 6202
cf4a9129 6203@c Adapted from http://www.gnu.org/philosophy/philosophy.html.
c11a6eb1 6204
cf4a9129
LC
6205The GNU operating system has been developed so that users can have
6206freedom in their computing. GNU is @dfn{free software}, meaning that
6207users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
6208essential freedoms}: to run the program, to study and change the program
6209in source code form, to redistribute exact copies, and to distribute
6210modified versions. Packages found in the GNU distribution provide only
6211software that conveys these four freedoms.
c11a6eb1 6212
cf4a9129
LC
6213In addition, the GNU distribution follow the
6214@url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
6215software distribution guidelines}. Among other things, these guidelines
6216reject non-free firmware, recommendations of non-free software, and
6217discuss ways to deal with trademarks and patents.
ef5dd60a 6218
cf4a9129
LC
6219Some packages contain a small and optional subset that violates the
6220above guidelines, for instance because this subset is itself non-free
6221code. When that happens, the offending items are removed with
6222appropriate patches or code snippets in the package definition's
6223@code{origin} form (@pxref{Defining Packages}). That way, @code{guix
6224build --source} returns the ``freed'' source rather than the unmodified
6225upstream source.
ef5dd60a 6226
ef5dd60a 6227
cf4a9129
LC
6228@node Package Naming
6229@subsection Package Naming
ef5dd60a 6230
cf4a9129
LC
6231A package has actually two names associated with it:
6232First, there is the name of the @emph{Scheme variable}, the one following
6233@code{define-public}. By this name, the package can be made known in the
6234Scheme code, for instance as input to another package. Second, there is
6235the string in the @code{name} field of a package definition. This name
6236is used by package management commands such as
6237@command{guix package} and @command{guix build}.
ef5dd60a 6238
cf4a9129
LC
6239Both are usually the same and correspond to the lowercase conversion of
6240the project name chosen upstream, with underscores replaced with
6241hyphens. For instance, GNUnet is available as @code{gnunet}, and
6242SDL_net as @code{sdl-net}.
927097ef 6243
cf4a9129 6244We do not add @code{lib} prefixes for library packages, unless these are
081145cf 6245already part of the official project name. But @pxref{Python
cf4a9129
LC
6246Modules} and @ref{Perl Modules} for special rules concerning modules for
6247the Python and Perl languages.
927097ef 6248
1b366ee4 6249Font package names are handled differently, @pxref{Fonts}.
7fec52b7 6250
ef5dd60a 6251
cf4a9129
LC
6252@node Version Numbers
6253@subsection Version Numbers
ef5dd60a 6254
cf4a9129
LC
6255We usually package only the latest version of a given free software
6256project. But sometimes, for instance for incompatible library versions,
6257two (or more) versions of the same package are needed. These require
6258different Scheme variable names. We use the name as defined
6259in @ref{Package Naming}
6260for the most recent version; previous versions use the same name, suffixed
6261by @code{-} and the smallest prefix of the version number that may
6262distinguish the two versions.
ef5dd60a 6263
cf4a9129
LC
6264The name inside the package definition is the same for all versions of a
6265package and does not contain any version number.
ef5dd60a 6266
cf4a9129 6267For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
ef5dd60a 6268
cf4a9129
LC
6269@example
6270(define-public gtk+
6271 (package
6272 (name "gtk+")
6273 (version "3.9.12")
6274 ...))
6275(define-public gtk+-2
6276 (package
6277 (name "gtk+")
6278 (version "2.24.20")
6279 ...))
6280@end example
6281If we also wanted GTK+ 3.8.2, this would be packaged as
6282@example
6283(define-public gtk+-3.8
6284 (package
6285 (name "gtk+")
6286 (version "3.8.2")
6287 ...))
6288@end example
ef5dd60a 6289
ef5dd60a 6290
cf4a9129
LC
6291@node Python Modules
6292@subsection Python Modules
ef5dd60a 6293
cf4a9129
LC
6294We currently package Python 2 and Python 3, under the Scheme variable names
6295@code{python-2} and @code{python} as explained in @ref{Version Numbers}.
6296To avoid confusion and naming clashes with other programming languages, it
6297seems desirable that the name of a package for a Python module contains
6298the word @code{python}.
ef5dd60a 6299
cf4a9129
LC
6300Some modules are compatible with only one version of Python, others with both.
6301If the package Foo compiles only with Python 3, we name it
6302@code{python-foo}; if it compiles only with Python 2, we name it
6303@code{python2-foo}. If it is compatible with both versions, we create two
6304packages with the corresponding names.
ef5dd60a 6305
cf4a9129
LC
6306If a project already contains the word @code{python}, we drop this;
6307for instance, the module python-dateutil is packaged under the names
6308@code{python-dateutil} and @code{python2-dateutil}.
113daf62 6309
523e4896 6310
cf4a9129
LC
6311@node Perl Modules
6312@subsection Perl Modules
523e4896 6313
cf4a9129
LC
6314Perl programs standing for themselves are named as any other package,
6315using the lowercase upstream name.
6316For Perl packages containing a single class, we use the lowercase class name,
6317replace all occurrences of @code{::} by dashes and prepend the prefix
6318@code{perl-}.
6319So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
6320Modules containing several classes keep their lowercase upstream name and
6321are also prepended by @code{perl-}. Such modules tend to have the word
6322@code{perl} somewhere in their name, which gets dropped in favor of the
6323prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
523e4896 6324
523e4896 6325
7fec52b7
AE
6326@node Fonts
6327@subsection Fonts
6328
6329For fonts that are in general not installed by a user for typesetting
6330purposes, or that are distributed as part of a larger software package,
6331we rely on the general packaging rules for software; for instance, this
6332applies to the fonts delivered as part of the X.Org system or fonts that
6333are part of TeX Live.
6334
6335To make it easier for a user to search for fonts, names for other packages
6336containing only fonts are constructed as follows, independently of the
6337upstream package name.
6338
6339The name of a package containing only one font family starts with
6340@code{font-}; it is followed by the foundry name and a dash @code{-}
6341if the foundry is known, and the font family name, in which spaces are
6342replaced by dashes (and as usual, all upper case letters are transformed
6343to lower case).
6344For example, the Gentium font family by SIL is packaged under the name
6345@code{font-sil-gentium}.
6346
6347For a package containing several font families, the name of the collection
6348is used in the place of the font family name.
6349For instance, the Liberation fonts consist of three families,
6350Liberation Sans, Liberation Serif and Liberation Mono.
6351These could be packaged separately under the names
6352@code{font-liberation-sans} and so on; but as they are distributed together
6353under a common name, we prefer to package them together as
6354@code{font-liberation}.
6355
6356In the case where several formats of the same font family or font collection
6357are packaged separately, a short form of the format, prepended by a dash,
6358is added to the package name. We use @code{-ttf} for TrueType fonts,
1b366ee4 6359@code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
7fec52b7
AE
6360fonts.
6361
6362
b25937e3 6363
cf4a9129
LC
6364@node Bootstrapping
6365@section Bootstrapping
b25937e3 6366
cf4a9129 6367@c Adapted from the ELS 2013 paper.
b25937e3 6368
cf4a9129 6369@cindex bootstrapping
7889394e 6370
cf4a9129
LC
6371Bootstrapping in our context refers to how the distribution gets built
6372``from nothing''. Remember that the build environment of a derivation
6373contains nothing but its declared inputs (@pxref{Introduction}). So
6374there's an obvious chicken-and-egg problem: how does the first package
6375get built? How does the first compiler get compiled? Note that this is
6376a question of interest only to the curious hacker, not to the regular
6377user, so you can shamelessly skip this section if you consider yourself
6378a ``regular user''.
72b9d60d 6379
cf4a9129
LC
6380@cindex bootstrap binaries
6381The GNU system is primarily made of C code, with libc at its core. The
6382GNU build system itself assumes the availability of a Bourne shell and
6383command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
6384`grep'. Furthermore, build programs---programs that run
6385@code{./configure}, @code{make}, etc.---are written in Guile Scheme
6386(@pxref{Derivations}). Consequently, to be able to build anything at
6387all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
6388Binutils, libc, and the other packages mentioned above---the
6389@dfn{bootstrap binaries}.
72b9d60d 6390
cf4a9129
LC
6391These bootstrap binaries are ``taken for granted'', though we can also
6392re-create them if needed (more on that later).
72b9d60d 6393
cf4a9129 6394@unnumberedsubsec Preparing to Use the Bootstrap Binaries
c79d54fe 6395
cf4a9129
LC
6396@c As of Emacs 24.3, Info-mode displays the image, but since it's a
6397@c large image, it's hard to scroll. Oh well.
6398@image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
523e4896 6399
cf4a9129
LC
6400The figure above shows the very beginning of the dependency graph of the
6401distribution, corresponding to the package definitions of the @code{(gnu
6402packages bootstrap)} module. At this level of detail, things are
6403slightly complex. First, Guile itself consists of an ELF executable,
6404along with many source and compiled Scheme files that are dynamically
6405loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
6406tarball shown in this graph. This tarball is part of Guix's ``source''
6407distribution, and gets inserted into the store with @code{add-to-store}
6408(@pxref{The Store}).
2e7b5cea 6409
cf4a9129
LC
6410But how do we write a derivation that unpacks this tarball and adds it
6411to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
6412derivation---the first one that gets built---uses @code{bash} as its
6413builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
6414@code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
6415@file{xz}, and @file{mkdir} are statically-linked binaries, also part of
6416the Guix source distribution, whose sole purpose is to allow the Guile
6417tarball to be unpacked.
fb729425 6418
cf4a9129
LC
6419Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
6420Guile that can be used to run subsequent build programs. Its first task
6421is to download tarballs containing the other pre-built binaries---this
6422is what the @code{.tar.xz.drv} derivations do. Guix modules such as
6423@code{ftp-client.scm} are used for this purpose. The
6424@code{module-import.drv} derivations import those modules in a directory
6425in the store, using the original layout. The
6426@code{module-import-compiled.drv} derivations compile those modules, and
6427write them in an output directory with the right layout. This
6428corresponds to the @code{#:modules} argument of
6429@code{build-expression->derivation} (@pxref{Derivations}).
fb729425 6430
cf4a9129
LC
6431Finally, the various tarballs are unpacked by the
6432derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
6433etc., at which point we have a working C tool chain.
fb729425 6434
fb729425 6435
cf4a9129 6436@unnumberedsubsec Building the Build Tools
523e4896 6437
cf4a9129
LC
6438@c TODO: Add a package-level dependency graph generated from (gnu
6439@c packages base).
df2ce343 6440
cf4a9129
LC
6441Bootstrapping is complete when we have a full tool chain that does not
6442depend on the pre-built bootstrap tools discussed above. This
6443no-dependency requirement is verified by checking whether the files of
6444the final tool chain contain references to the @file{/gnu/store}
6445directories of the bootstrap inputs. The process that leads to this
6446``final'' tool chain is described by the package definitions found in
1f6f57df 6447the @code{(gnu packages commencement)} module.
df2ce343 6448
cf4a9129
LC
6449@c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
6450The first tool that gets built with the bootstrap binaries is
6451GNU Make, which is a prerequisite for all the following packages.
6452From there Findutils and Diffutils get built.
523e4896 6453
cf4a9129
LC
6454Then come the first-stage Binutils and GCC, built as pseudo cross
6455tools---i.e., with @code{--target} equal to @code{--host}. They are
6456used to build libc. Thanks to this cross-build trick, this libc is
6457guaranteed not to hold any reference to the initial tool chain.
4af2447e 6458
cf4a9129
LC
6459From there the final Binutils and GCC are built. GCC uses @code{ld}
6460from the final Binutils, and links programs against the just-built libc.
6461This tool chain is used to build the other packages used by Guix and by
6462the GNU Build System: Guile, Bash, Coreutils, etc.
4af2447e 6463
cf4a9129
LC
6464And voilà! At this point we have the complete set of build tools that
6465the GNU Build System expects. These are in the @code{%final-inputs}
dd164244
MW
6466variable of the @code{(gnu packages commencement)} module, and are
6467implicitly used by any package that uses @code{gnu-build-system}
1f6f57df 6468(@pxref{Build Systems, @code{gnu-build-system}}).
4af2447e 6469
4af2447e 6470
cf4a9129 6471@unnumberedsubsec Building the Bootstrap Binaries
4af2447e 6472
cf4a9129
LC
6473Because the final tool chain does not depend on the bootstrap binaries,
6474those rarely need to be updated. Nevertheless, it is useful to have an
6475automated way to produce them, should an update occur, and this is what
6476the @code{(gnu packages make-bootstrap)} module provides.
4af2447e 6477
cf4a9129
LC
6478The following command builds the tarballs containing the bootstrap
6479binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
6480of Coreutils and other basic command-line tools):
4b2615e1 6481
cf4a9129
LC
6482@example
6483guix build bootstrap-tarballs
6484@end example
6485
6486The generated tarballs are those that should be referred to in the
6487@code{(gnu packages bootstrap)} module mentioned at the beginning of
6488this section.
6489
6490Still here? Then perhaps by now you've started to wonder: when do we
6491reach a fixed point? That is an interesting question! The answer is
6492unknown, but if you would like to investigate further (and have
6493significant computational and storage resources to do so), then let us
6494know.
6495
6496@node Porting
6497@section Porting to a New Platform
6498
6499As discussed above, the GNU distribution is self-contained, and
6500self-containment is achieved by relying on pre-built ``bootstrap
6501binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
6502operating system kernel, CPU architecture, and application binary
6503interface (ABI). Thus, to port the distribution to a platform that is
6504not yet supported, one must build those bootstrap binaries, and update
6505the @code{(gnu packages bootstrap)} module to use them on that platform.
6506
6507Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
6508When everything goes well, and assuming the GNU tool chain supports the
6509target platform, this can be as simple as running a command like this
6510one:
6511
6512@example
6513guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
6514@end example
6515
1c0c417d
LC
6516For this to work, the @code{glibc-dynamic-linker} procedure in
6517@code{(gnu packages bootstrap)} must be augmented to return the right
6518file name for libc's dynamic linker on that platform; likewise,
6519@code{system->linux-architecture} in @code{(gnu packages linux)} must be
6520taught about the new platform.
6521
cf4a9129 6522Once these are built, the @code{(gnu packages bootstrap)} module needs
1c0c417d
LC
6523to be updated to refer to these binaries on the target platform. That
6524is, the hashes and URLs of the bootstrap tarballs for the new platform
6525must be added alongside those of the currently supported platforms. The
6526bootstrap Guile tarball is treated specially: it is expected to be
6527available locally, and @file{gnu-system.am} has rules do download it for
6528the supported architectures; a rule for the new platform must be added
6529as well.
cf4a9129
LC
6530
6531In practice, there may be some complications. First, it may be that the
6532extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
6533above) is not recognized by all the GNU tools. Typically, glibc
6534recognizes some of these, whereas GCC uses an extra @code{--with-abi}
6535configure flag (see @code{gcc.scm} for examples of how to handle this).
6536Second, some of the required packages could fail to build for that
6537platform. Lastly, the generated binaries could be broken for some
6538reason.
4af2447e
LC
6539
6540
9bf3c1a7
LC
6541@c *********************************************************************
6542@node Contributing
6543@chapter Contributing
6544
6545This project is a cooperative effort, and we need your help to make it
5ff3c4b8
PAR
6546grow! Please get in touch with us on @email{guix-devel@@gnu.org} and
6547@code{#guix} on the Freenode IRC network. We welcome ideas, bug
6548reports, patches, and anything that may be helpful to the project. We
6549particularly welcome help on packaging (@pxref{Packaging Guidelines}).
a1ba8475 6550
9bf3c1a7
LC
6551Please see the
6552@url{http://git.savannah.gnu.org/cgit/guix.git/tree/HACKING,
6553@file{HACKING} file} that comes with the Guix source code for practical
6554details about contributions.
6555
c78bd12b 6556
568717fd
LC
6557@c *********************************************************************
6558@node Acknowledgments
6559@chapter Acknowledgments
6560
6561Guix is based on the Nix package manager, which was designed and
4c7ac9aa
LC
6562implemented by Eelco Dolstra, with contributions from other people (see
6563the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
568717fd
LC
6564management, and promoted unprecedented features, such as transactional
6565package upgrades and rollbacks, per-user profiles, and referentially
6566transparent build processes. Without this work, Guix would not exist.
6567
6568The Nix-based software distributions, Nixpkgs and NixOS, have also been
6569an inspiration for Guix.
6570
4c7ac9aa
LC
6571GNU@tie{}Guix itself is a collective work with contributions from a
6572number of people. See the @file{AUTHORS} file in Guix for more
6573information on these fine people. The @file{THANKS} file lists people
6574who have helped by reporting bugs, taking care of the infrastructure,
6575providing artwork and themes, making suggestions, and more---thank you!
6576
6577
568717fd
LC
6578@c *********************************************************************
6579@node GNU Free Documentation License
6580@appendix GNU Free Documentation License
6581
6582@include fdl-1.3.texi
6583
6584@c *********************************************************************
6585@node Concept Index
6586@unnumbered Concept Index
6587@printindex cp
6588
a85b83d2
LC
6589@node Programming Index
6590@unnumbered Programming Index
6591@syncodeindex tp fn
6592@syncodeindex vr fn
568717fd
LC
6593@printindex fn
6594
6595@bye
6596
6597@c Local Variables:
6598@c ispell-local-dictionary: "american";
6599@c End: