services: Add rngd-service.
[jackhill/guix/guix.git] / doc / guix.texi
1 \input texinfo
2 @c -*-texinfo-*-
3
4 @c %**start of header
5 @setfilename guix.info
6 @documentencoding UTF-8
7 @settitle GNU Guix Reference Manual
8 @c %**end of header
9
10 @include version.texi
11
12 @copying
13 Copyright @copyright{} 2012, 2013, 2014, 2015, 2016 Ludovic Courtès@*
14 Copyright @copyright{} 2013, 2014, 2016 Andreas Enge@*
15 Copyright @copyright{} 2013 Nikita Karetnikov@*
16 Copyright @copyright{} 2015, 2016 Mathieu Lirzin@*
17 Copyright @copyright{} 2014 Pierre-Antoine Rault@*
18 Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer@*
19 Copyright @copyright{} 2015, 2016 Leo Famulari@*
20 Copyright @copyright{} 2016 Ben Woodcroft@*
21 Copyright @copyright{} 2016 Chris Marusich@*
22 Copyright @copyright{} 2016 Efraim Flashner
23
24 Permission is granted to copy, distribute and/or modify this document
25 under the terms of the GNU Free Documentation License, Version 1.3 or
26 any later version published by the Free Software Foundation; with no
27 Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
28 copy of the license is included in the section entitled ``GNU Free
29 Documentation License''.
30 @end copying
31
32 @dircategory System administration
33 @direntry
34 * Guix: (guix). Manage installed software and system configuration.
35 * guix package: (guix)Invoking guix package. Installing, removing, and upgrading packages.
36 * guix build: (guix)Invoking guix build. Building packages.
37 * guix gc: (guix)Invoking guix gc. Reclaiming unused disk space.
38 * guix pull: (guix)Invoking guix pull. Update the list of available packages.
39 * guix system: (guix)Invoking guix system. Manage the operating system configuration.
40 @end direntry
41
42 @dircategory Software development
43 @direntry
44 * guix environment: (guix)Invoking guix environment. Building development environments with Guix.
45 @end direntry
46
47 @dircategory Emacs
48 @direntry
49 * Guix user interface: (guix)Emacs Interface. Package management from the comfort of Emacs.
50 @end direntry
51
52
53 @titlepage
54 @title GNU Guix Reference Manual
55 @subtitle Using the GNU Guix Functional Package Manager
56 @author The GNU Guix Developers
57
58 @page
59 @vskip 0pt plus 1filll
60 Edition @value{EDITION} @*
61 @value{UPDATED} @*
62
63 @insertcopying
64 @end titlepage
65
66 @contents
67
68 @c *********************************************************************
69 @node Top
70 @top GNU Guix
71
72 This document describes GNU Guix version @value{VERSION}, a functional
73 package management tool written for the GNU system.
74
75 @menu
76 * Introduction:: What is Guix about?
77 * Installation:: Installing Guix.
78 * Package Management:: Package installation, upgrade, etc.
79 * Emacs Interface:: Using Guix from Emacs.
80 * Programming Interface:: Using Guix in Scheme.
81 * Utilities:: Package management commands.
82 * GNU Distribution:: Software for your friendly GNU system.
83 * Contributing:: Your help needed!
84
85 * Acknowledgments:: Thanks!
86 * GNU Free Documentation License:: The license of this manual.
87 * Concept Index:: Concepts.
88 * Programming Index:: Data types, functions, and variables.
89
90 @detailmenu
91 --- The Detailed Node Listing ---
92
93 Installation
94
95 * Binary Installation:: Getting Guix running in no time!
96 * Requirements:: Software needed to build and run Guix.
97 * Running the Test Suite:: Testing Guix.
98 * Setting Up the Daemon:: Preparing the build daemon's environment.
99 * Invoking guix-daemon:: Running the build daemon.
100 * Application Setup:: Application-specific setup.
101
102 Setting Up the Daemon
103
104 * Build Environment Setup:: Preparing the isolated build environment.
105 * Daemon Offload Setup:: Offloading builds to remote machines.
106
107 Package Management
108
109 * Features:: How Guix will make your life brighter.
110 * Invoking guix package:: Package installation, removal, etc.
111 * Substitutes:: Downloading pre-built binaries.
112 * Packages with Multiple Outputs:: Single source package, multiple outputs.
113 * Invoking guix gc:: Running the garbage collector.
114 * Invoking guix pull:: Fetching the latest Guix and distribution.
115 * Invoking guix archive:: Exporting and importing store files.
116
117 Emacs Interface
118
119 * Initial Setup: Emacs Initial Setup. Preparing @file{~/.emacs}.
120 * Package Management: Emacs Package Management. Managing packages and generations.
121 * Licenses: Emacs Licenses. Interface for licenses of Guix packages.
122 * Package Source Locations: Emacs Package Locations. Interface for package location files.
123 * Popup Interface: Emacs Popup Interface. Magit-like interface for guix commands.
124 * Prettify Mode: Emacs Prettify. Abbreviating @file{/gnu/store/@dots{}} file names.
125 * Build Log Mode: Emacs Build Log. Highlighting Guix build logs.
126 * Completions: Emacs Completions. Completing @command{guix} shell command.
127 * Development: Emacs Development. Tools for Guix developers.
128 * Hydra: Emacs Hydra. Interface for Guix build farm.
129
130 Programming Interface
131
132 * Defining Packages:: Defining new packages.
133 * Build Systems:: Specifying how packages are built.
134 * The Store:: Manipulating the package store.
135 * Derivations:: Low-level interface to package derivations.
136 * The Store Monad:: Purely functional interface to the store.
137 * G-Expressions:: Manipulating build expressions.
138
139 Defining Packages
140
141 * package Reference:: The package data type.
142 * origin Reference:: The origin data type.
143
144 Utilities
145
146 * Invoking guix build:: Building packages from the command line.
147 * Invoking guix edit:: Editing package definitions.
148 * Invoking guix download:: Downloading a file and printing its hash.
149 * Invoking guix hash:: Computing the cryptographic hash of a file.
150 * Invoking guix import:: Importing package definitions.
151 * Invoking guix refresh:: Updating package definitions.
152 * Invoking guix lint:: Finding errors in package definitions.
153 * Invoking guix size:: Profiling disk usage.
154 * Invoking guix graph:: Visualizing the graph of packages.
155 * Invoking guix environment:: Setting up development environments.
156 * Invoking guix publish:: Sharing substitutes.
157 * Invoking guix challenge:: Challenging substitute servers.
158 * Invoking guix container:: Process isolation.
159
160 Invoking @command{guix build}
161
162 * Common Build Options:: Build options for most commands.
163 * Package Transformation Options:: Creating variants of packages.
164 * Additional Build Options:: Options specific to 'guix build'.
165
166 GNU Distribution
167
168 * System Installation:: Installing the whole operating system.
169 * System Configuration:: Configuring the operating system.
170 * Installing Debugging Files:: Feeding the debugger.
171 * Security Updates:: Deploying security fixes quickly.
172 * Package Modules:: Packages from the programmer's viewpoint.
173 * Packaging Guidelines:: Growing the distribution.
174 * Bootstrapping:: GNU/Linux built from scratch.
175 * Porting:: Targeting another platform or kernel.
176
177 System Installation
178
179 * Limitations:: What you can expect.
180 * Hardware Considerations:: Supported hardware.
181 * USB Stick Installation:: Preparing the installation medium.
182 * Preparing for Installation:: Networking, partitioning, etc.
183 * Proceeding with the Installation:: The real thing.
184 * Building the Installation Image:: How this comes to be.
185
186 System Configuration
187
188 * Using the Configuration System:: Customizing your GNU system.
189 * operating-system Reference:: Detail of operating-system declarations.
190 * File Systems:: Configuring file system mounts.
191 * Mapped Devices:: Block device extra processing.
192 * User Accounts:: Specifying user accounts.
193 * Locales:: Language and cultural convention settings.
194 * Services:: Specifying system services.
195 * Setuid Programs:: Programs running with root privileges.
196 * X.509 Certificates:: Authenticating HTTPS servers.
197 * Name Service Switch:: Configuring libc's name service switch.
198 * Initial RAM Disk:: Linux-Libre bootstrapping.
199 * GRUB Configuration:: Configuring the boot loader.
200 * Invoking guix system:: Instantiating a system configuration.
201 * Running GuixSD in a VM:: How to run GuixSD in a virtual machine.
202 * Defining Services:: Adding new service definitions.
203
204 Services
205
206 * Base Services:: Essential system services.
207 * Scheduled Job Execution:: The mcron service.
208 * Networking Services:: Network setup, SSH daemon, etc.
209 * X Window:: Graphical display.
210 * Desktop Services:: D-Bus and desktop services.
211 * Database Services:: SQL databases.
212 * Mail Services:: IMAP, POP3, SMTP, and all that.
213 * Web Services:: Web servers.
214 * Various Services:: Other services.
215
216 Defining Services
217
218 * Service Composition:: The model for composing services.
219 * Service Types and Services:: Types and services.
220 * Service Reference:: API reference.
221 * Shepherd Services:: A particular type of service.
222
223 Packaging Guidelines
224
225 * Software Freedom:: What may go into the distribution.
226 * Package Naming:: What's in a name?
227 * Version Numbers:: When the name is not enough.
228 * Synopses and Descriptions:: Helping users find the right package.
229 * Python Modules:: Taming the snake.
230 * Perl Modules:: Little pearls.
231 * Java Packages:: Coffee break.
232 * Fonts:: Fond of fonts.
233
234 Contributing
235
236 * Building from Git:: The latest and greatest.
237 * Running Guix Before It Is Installed:: Hacker tricks.
238 * The Perfect Setup:: The right tools.
239 * Coding Style:: Hygiene of the contributor.
240 * Submitting Patches:: Share your work.
241
242 Coding Style
243
244 * Programming Paradigm:: How to compose your elements.
245 * Modules:: Where to store your code?
246 * Data Types and Pattern Matching:: Implementing data structures.
247 * Formatting Code:: Writing conventions.
248
249 @end detailmenu
250 @end menu
251
252 @c *********************************************************************
253 @node Introduction
254 @chapter Introduction
255
256 @cindex purpose
257 GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
258 using the international phonetic alphabet (IPA).} is a package
259 management tool for the GNU system. Guix makes it easy for unprivileged
260 users to install, upgrade, or remove packages, to roll back to a
261 previous package set, to build packages from source, and generally
262 assists with the creation and maintenance of software environments.
263
264 @cindex user interfaces
265 Guix provides a command-line package management interface
266 (@pxref{Invoking guix package}), a set of command-line utilities
267 (@pxref{Utilities}), a visual user interface in Emacs (@pxref{Emacs
268 Interface}), as well as Scheme programming interfaces
269 (@pxref{Programming Interface}).
270 @cindex build daemon
271 Its @dfn{build daemon} is responsible for building packages on behalf of
272 users (@pxref{Setting Up the Daemon}) and for downloading pre-built
273 binaries from authorized sources (@pxref{Substitutes}).
274
275 @cindex extensibility of the distribution
276 @cindex customization of packages
277 Guix includes package definitions for many GNU and non-GNU packages, all
278 of which @uref{https://www.gnu.org/philosophy/free-sw.html, respect the
279 user's computing freedom}. It is @emph{extensible}: users can write
280 their own package definitions (@pxref{Defining Packages}) and make them
281 available as independent package modules (@pxref{Package Modules}). It
282 is also @emph{customizable}: users can @emph{derive} specialized package
283 definitions from existing ones, including from the command line
284 (@pxref{Package Transformation Options}).
285
286 @cindex Guix System Distribution
287 @cindex GuixSD
288 You can install GNU@tie{}Guix on top of an existing GNU/Linux system
289 where it complements the available tools without interference
290 (@pxref{Installation}), or you can use it as part of the standalone
291 @dfn{Guix System Distribution} or GuixSD (@pxref{GNU Distribution}).
292 With GNU@tie{}GuixSD, you @emph{declare} all aspects of the operating
293 system configuration and Guix takes care of instantiating the
294 configuration in a transactional, reproducible, and stateless fashion
295 (@pxref{System Configuration}).
296
297 @cindex functional package management
298 Under the hood, Guix implements the @dfn{functional package management}
299 discipline pioneered by Nix (@pxref{Acknowledgments}).
300 In Guix, the package build and installation process is seen
301 as a @emph{function}, in the mathematical sense. That function takes inputs,
302 such as build scripts, a compiler, and libraries, and
303 returns an installed package. As a pure function, its result depends
304 solely on its inputs---for instance, it cannot refer to software or
305 scripts that were not explicitly passed as inputs. A build function
306 always produces the same result when passed a given set of inputs. It
307 cannot alter the environment of the running system in
308 any way; for instance, it cannot create, modify, or delete files outside
309 of its build and installation directories. This is achieved by running
310 build processes in isolated environments (or @dfn{containers}), where only their
311 explicit inputs are visible.
312
313 @cindex store
314 The result of package build functions is @dfn{cached} in the file
315 system, in a special directory called @dfn{the store} (@pxref{The
316 Store}). Each package is installed in a directory of its own in the
317 store---by default under @file{/gnu/store}. The directory name contains
318 a hash of all the inputs used to build that package; thus, changing an
319 input yields a different directory name.
320
321 This approach is the foundation for the salient features of Guix: support
322 for transactional package upgrade and rollback, per-user installation, and
323 garbage collection of packages (@pxref{Features}).
324
325
326 @c *********************************************************************
327 @node Installation
328 @chapter Installation
329
330 GNU Guix is available for download from its website at
331 @url{http://www.gnu.org/software/guix/}. This section describes the
332 software requirements of Guix, as well as how to install it and get
333 ready to use it.
334
335 Note that this section is concerned with the installation of the package
336 manager, which can be done on top of a running GNU/Linux system. If,
337 instead, you want to install the complete GNU operating system,
338 @pxref{System Installation}.
339
340 @cindex foreign distro
341 When installed on a running GNU/Linux system---thereafter called a
342 @dfn{foreign distro}---GNU@tie{}Guix complements the available tools
343 without interference. Its data lives exclusively in two directories,
344 usually @file{/gnu/store} and @file{/var/guix}; other files on your
345 system, such as @file{/etc}, are left untouched.
346
347 @menu
348 * Binary Installation:: Getting Guix running in no time!
349 * Requirements:: Software needed to build and run Guix.
350 * Running the Test Suite:: Testing Guix.
351 * Setting Up the Daemon:: Preparing the build daemon's environment.
352 * Invoking guix-daemon:: Running the build daemon.
353 * Application Setup:: Application-specific setup.
354 @end menu
355
356 @node Binary Installation
357 @section Binary Installation
358
359 This section describes how to install Guix on an arbitrary system from a
360 self-contained tarball providing binaries for Guix and for all its
361 dependencies. This is often quicker than installing from source, which
362 is described in the next sections. The only requirement is to have
363 GNU@tie{}tar and Xz.
364
365 Installing goes along these lines:
366
367 @enumerate
368 @item
369 Download the binary tarball from
370 @indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz},
371 where @var{system} is @code{x86_64-linux} for an @code{x86_64} machine
372 already running the kernel Linux, and so on.
373
374 Make sure to download the associated @file{.sig} file and to verify the
375 authenticity of the tarball against it, along these lines:
376
377 @example
378 $ wget ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz.sig
379 $ gpg --verify guix-binary-@value{VERSION}.@var{system}.tar.xz.sig
380 @end example
381
382 If that command fails because you do not have the required public key,
383 then run this command to import it:
384
385 @example
386 $ gpg --keyserver pgp.mit.edu --recv-keys 090B11993D9AEBB5
387 @end example
388
389 @noindent
390 and rerun the @code{gpg --verify} command.
391
392 @item
393 As @code{root}, run:
394
395 @example
396 # cd /tmp
397 # tar --warning=no-timestamp -xf \
398 guix-binary-@value{VERSION}.@var{system}.tar.xz
399 # mv var/guix /var/ && mv gnu /
400 @end example
401
402 This creates @file{/gnu/store} (@pxref{The Store}) and @file{/var/guix}.
403 The latter contains a ready-to-use profile for @code{root} (see next
404 step.)
405
406 Do @emph{not} unpack the tarball on a working Guix system since that
407 would overwrite its own essential files.
408
409 The @code{--warning=no-timestamp} option makes sure GNU@tie{}tar does
410 not emit warnings about ``implausibly old time stamps'' (such
411 warnings were triggered by GNU@tie{}tar 1.26 and older; recent
412 versions are fine.)
413 They stem from the fact that all the
414 files in the archive have their modification time set to zero (which
415 means January 1st, 1970.) This is done on purpose to make sure the
416 archive content is independent of its creation time, thus making it
417 reproducible.
418
419 @item
420 Make @code{root}'s profile available under @file{~/.guix-profile}:
421
422 @example
423 # ln -sf /var/guix/profiles/per-user/root/guix-profile \
424 ~root/.guix-profile
425 @end example
426
427 @item
428 Create the group and user accounts for build users as explained below
429 (@pxref{Build Environment Setup}).
430
431 @item
432 Run the daemon, and set it to automatically start on boot.
433
434 If your host distro uses the systemd init system, this can be achieved
435 with these commands:
436
437 @example
438 # cp ~root/.guix-profile/lib/systemd/system/guix-daemon.service \
439 /etc/systemd/system/
440 # systemctl start guix-daemon && systemctl enable guix-daemon
441 @end example
442
443 If your host distro uses the Upstart init system:
444
445 @example
446 # cp ~root/.guix-profile/lib/upstart/system/guix-daemon.conf /etc/init/
447 # start guix-daemon
448 @end example
449
450 Otherwise, you can still start the daemon manually with:
451
452 @example
453 # ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
454 @end example
455
456 @item
457 Make the @command{guix} command available to other users on the machine,
458 for instance with:
459
460 @example
461 # mkdir -p /usr/local/bin
462 # cd /usr/local/bin
463 # ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
464 @end example
465
466 It is also a good idea to make the Info version of this manual available
467 there:
468
469 @example
470 # mkdir -p /usr/local/share/info
471 # cd /usr/local/share/info
472 # for i in /var/guix/profiles/per-user/root/guix-profile/share/info/* ;
473 do ln -s $i ; done
474 @end example
475
476 That way, assuming @file{/usr/local/share/info} is in the search path,
477 running @command{info guix} will open this manual (@pxref{Other Info
478 Directories,,, texinfo, GNU Texinfo}, for more details on changing the
479 Info search path.)
480
481 @item
482 To use substitutes from @code{hydra.gnu.org} or one of its mirrors
483 (@pxref{Substitutes}), authorize them:
484
485 @example
486 # guix archive --authorize < ~root/.guix-profile/share/guix/hydra.gnu.org.pub
487 @end example
488 @end enumerate
489
490 This completes root-level install of Guix. Each user will need to
491 perform additional steps to make their Guix envionment ready for use,
492 @pxref{Application Setup}.
493
494 You can confirm that Guix is working by installing a sample package into
495 the root profile:
496
497 @example
498 # guix package -i hello
499 @end example
500
501 The @code{guix} package must remain available in @code{root}'s profile,
502 or it would become subject to garbage collection---in which case you
503 would find yourself badly handicapped by the lack of the @command{guix}
504 command. In other words, do not remove @code{guix} by running
505 @code{guix package -r guix}.
506
507 The binary installation tarball can be (re)produced and verified simply
508 by running the following command in the Guix source tree:
509
510 @example
511 make guix-binary.@var{system}.tar.xz
512 @end example
513
514
515 @node Requirements
516 @section Requirements
517
518 This section lists requirements when building Guix from source. The
519 build procedure for Guix is the same as for other GNU software, and is
520 not covered here. Please see the files @file{README} and @file{INSTALL}
521 in the Guix source tree for additional details.
522
523 GNU Guix depends on the following packages:
524
525 @itemize
526 @item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
527 @item @url{http://gnupg.org/, GNU libgcrypt};
528 @item @url{http://www.gnu.org/software/make/, GNU Make}.
529 @end itemize
530
531 The following dependencies are optional:
532
533 @itemize
534 @item
535 Installing @uref{http://gnutls.org/, GnuTLS-Guile} will allow you to
536 access @code{https} URLs for substitutes, which is highly recommended
537 (@pxref{Substitutes}). It also allows you to access HTTPS URLs with the
538 @command{guix download} command (@pxref{Invoking guix download}), the
539 @command{guix import pypi} command, and the @command{guix import cpan}
540 command. @xref{Guile Preparations, how to install the GnuTLS bindings
541 for Guile,, gnutls-guile, GnuTLS-Guile}.
542
543 @item
544 Installing
545 @url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
546 allow you to use the @command{guix import pypi} command (@pxref{Invoking
547 guix import}). It is of
548 interest primarily for developers and not for casual users.
549 @end itemize
550
551 Unless @code{--disable-daemon} was passed to @command{configure}, the
552 following packages are also needed:
553
554 @itemize
555 @item @url{http://sqlite.org, SQLite 3};
556 @item @url{http://www.bzip.org, libbz2};
557 @item @url{http://gcc.gnu.org, GCC's g++}, with support for the
558 C++11 standard.
559 @end itemize
560
561 When configuring Guix on a system that already has a Guix installation,
562 be sure to specify the same state directory as the existing installation
563 using the @code{--localstatedir} option of the @command{configure}
564 script (@pxref{Directory Variables, @code{localstatedir},, standards,
565 GNU Coding Standards}). The @command{configure} script protects against
566 unintended misconfiguration of @var{localstatedir} so you do not
567 inadvertently corrupt your store (@pxref{The Store}).
568
569 When a working installation of @url{http://nixos.org/nix/, the Nix package
570 manager} is available, you
571 can instead configure Guix with @code{--disable-daemon}. In that case,
572 Nix replaces the three dependencies above.
573
574 Guix is compatible with Nix, so it is possible to share the same store
575 between both. To do so, you must pass @command{configure} not only the
576 same @code{--with-store-dir} value, but also the same
577 @code{--localstatedir} value. The latter is essential because it
578 specifies where the database that stores metadata about the store is
579 located, among other things. The default values for Nix are
580 @code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
581 Note that @code{--disable-daemon} is not required if
582 your goal is to share the store with Nix.
583
584 @node Running the Test Suite
585 @section Running the Test Suite
586
587 After a successful @command{configure} and @code{make} run, it is a good
588 idea to run the test suite. It can help catch issues with the setup or
589 environment, or bugs in Guix itself---and really, reporting test
590 failures is a good way to help improve the software. To run the test
591 suite, type:
592
593 @example
594 make check
595 @end example
596
597 Test cases can run in parallel: you can use the @code{-j} option of
598 GNU@tie{}make to speed things up. The first run may take a few minutes
599 on a recent machine; subsequent runs will be faster because the store
600 that is created for test purposes will already have various things in
601 cache.
602
603 It is also possible to run a subset of the tests by defining the
604 @code{TESTS} makefile variable as in this example:
605
606 @example
607 make check TESTS="tests/store.scm tests/cpio.scm"
608 @end example
609
610 By default, tests results are displayed at a file level. In order to
611 see the details of every individual test cases, it is possible to define
612 the @code{SCM_LOG_DRIVER_FLAGS} makefile variable as in this example:
613
614 @example
615 make check TESTS="tests/base64.scm" SCM_LOG_DRIVER_FLAGS="--brief=no"
616 @end example
617
618 Upon failure, please email @email{bug-guix@@gnu.org} and attach the
619 @file{test-suite.log} file. Please specify the Guix version being used
620 as well as version numbers of the dependencies (@pxref{Requirements}) in
621 your message.
622
623 Guix also comes with a whole-system test suite that tests complete
624 GuixSD operating system instances. It can only run on systems where
625 Guix is already installed, using:
626
627 @example
628 make check-system
629 @end example
630
631 @noindent
632 or, again, by defining @code{TESTS} to select a subset of tests to run:
633
634 @example
635 make check-system TESTS="basic mcron"
636 @end example
637
638 These system tests are defined in the @code{(gnu tests @dots{})}
639 modules. They work by running the operating systems under test with
640 lightweight instrumentation in a virtual machine (VM). They can be
641 computationally intensive or rather cheap, depending on whether
642 substitutes are available for their dependencies (@pxref{Substitutes}).
643 Some of them require a lot of storage space to hold VM images.
644
645 Again in case of test failures, please send @email{bug-guix@@gnu.org}
646 all the details.
647
648 @node Setting Up the Daemon
649 @section Setting Up the Daemon
650
651 @cindex daemon
652 Operations such as building a package or running the garbage collector
653 are all performed by a specialized process, the @dfn{build daemon}, on
654 behalf of clients. Only the daemon may access the store and its
655 associated database. Thus, any operation that manipulates the store
656 goes through the daemon. For instance, command-line tools such as
657 @command{guix package} and @command{guix build} communicate with the
658 daemon (@i{via} remote procedure calls) to instruct it what to do.
659
660 The following sections explain how to prepare the build daemon's
661 environment. See also @ref{Substitutes}, for information on how to allow
662 the daemon to download pre-built binaries.
663
664 @menu
665 * Build Environment Setup:: Preparing the isolated build environment.
666 * Daemon Offload Setup:: Offloading builds to remote machines.
667 @end menu
668
669 @node Build Environment Setup
670 @subsection Build Environment Setup
671
672 In a standard multi-user setup, Guix and its daemon---the
673 @command{guix-daemon} program---are installed by the system
674 administrator; @file{/gnu/store} is owned by @code{root} and
675 @command{guix-daemon} runs as @code{root}. Unprivileged users may use
676 Guix tools to build packages or otherwise access the store, and the
677 daemon will do it on their behalf, ensuring that the store is kept in a
678 consistent state, and allowing built packages to be shared among users.
679
680 @cindex build users
681 When @command{guix-daemon} runs as @code{root}, you may not want package
682 build processes themselves to run as @code{root} too, for obvious
683 security reasons. To avoid that, a special pool of @dfn{build users}
684 should be created for use by build processes started by the daemon.
685 These build users need not have a shell and a home directory: they will
686 just be used when the daemon drops @code{root} privileges in build
687 processes. Having several such users allows the daemon to launch
688 distinct build processes under separate UIDs, which guarantees that they
689 do not interfere with each other---an essential feature since builds are
690 regarded as pure functions (@pxref{Introduction}).
691
692 On a GNU/Linux system, a build user pool may be created like this (using
693 Bash syntax and the @code{shadow} commands):
694
695 @c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
696 @c for why `-G' is needed.
697 @example
698 # groupadd --system guixbuild
699 # for i in `seq -w 1 10`;
700 do
701 useradd -g guixbuild -G guixbuild \
702 -d /var/empty -s `which nologin` \
703 -c "Guix build user $i" --system \
704 guixbuilder$i;
705 done
706 @end example
707
708 @noindent
709 The number of build users determines how many build jobs may run in
710 parallel, as specified by the @option{--max-jobs} option
711 (@pxref{Invoking guix-daemon, @option{--max-jobs}}). To use
712 @command{guix system vm} and related commands, you may need to add the
713 build users to the @code{kvm} group so they can access @file{/dev/kvm},
714 using @code{-G guixbuild,kvm} instead of @code{-G guixbuild}
715 (@pxref{Invoking guix system}).
716
717 The @code{guix-daemon} program may then be run as @code{root} with the
718 following command@footnote{If your machine uses the systemd init system,
719 dropping the @file{@var{prefix}/lib/systemd/system/guix-daemon.service}
720 file in @file{/etc/systemd/system} will ensure that
721 @command{guix-daemon} is automatically started. Similarly, if your
722 machine uses the Upstart init system, drop the
723 @file{@var{prefix}/lib/upstart/system/guix-daemon.conf}
724 file in @file{/etc/init}.}:
725
726 @example
727 # guix-daemon --build-users-group=guixbuild
728 @end example
729
730 @cindex chroot
731 @noindent
732 This way, the daemon starts build processes in a chroot, under one of
733 the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
734 environment contains nothing but:
735
736 @c Keep this list in sync with libstore/build.cc! -----------------------
737 @itemize
738 @item
739 a minimal @code{/dev} directory, created mostly independently from the
740 host @code{/dev}@footnote{``Mostly'', because while the set of files
741 that appear in the chroot's @code{/dev} is fixed, most of these files
742 can only be created if the host has them.};
743
744 @item
745 the @code{/proc} directory; it only shows the processes of the container
746 since a separate PID name space is used;
747
748 @item
749 @file{/etc/passwd} with an entry for the current user and an entry for
750 user @file{nobody};
751
752 @item
753 @file{/etc/group} with an entry for the user's group;
754
755 @item
756 @file{/etc/hosts} with an entry that maps @code{localhost} to
757 @code{127.0.0.1};
758
759 @item
760 a writable @file{/tmp} directory.
761 @end itemize
762
763 You can influence the directory where the daemon stores build trees
764 @i{via} the @code{TMPDIR} environment variable. However, the build tree
765 within the chroot is always called @file{/tmp/guix-build-@var{name}.drv-0},
766 where @var{name} is the derivation name---e.g., @code{coreutils-8.24}.
767 This way, the value of @code{TMPDIR} does not leak inside build
768 environments, which avoids discrepancies in cases where build processes
769 capture the name of their build tree.
770
771 @vindex http_proxy
772 The daemon also honors the @code{http_proxy} environment variable for
773 HTTP downloads it performs, be it for fixed-output derivations
774 (@pxref{Derivations}) or for substitutes (@pxref{Substitutes}).
775
776 If you are installing Guix as an unprivileged user, it is still possible
777 to run @command{guix-daemon} provided you pass @code{--disable-chroot}.
778 However, build processes will not be isolated from one another, and not
779 from the rest of the system. Thus, build processes may interfere with
780 each other, and may access programs, libraries, and other files
781 available on the system---making it much harder to view them as
782 @emph{pure} functions.
783
784
785 @node Daemon Offload Setup
786 @subsection Using the Offload Facility
787
788 @cindex offloading
789 @cindex build hook
790 When desired, the build daemon can @dfn{offload}
791 derivation builds to other machines
792 running Guix, using the @code{offload} @dfn{build hook}. When that
793 feature is enabled, a list of user-specified build machines is read from
794 @file{/etc/guix/machines.scm}; every time a build is requested, for
795 instance via @code{guix build}, the daemon attempts to offload it to one
796 of the machines that satisfy the constraints of the derivation, in
797 particular its system type---e.g., @file{x86_64-linux}. Missing
798 prerequisites for the build are copied over SSH to the target machine,
799 which then proceeds with the build; upon success the output(s) of the
800 build are copied back to the initial machine.
801
802 The @file{/etc/guix/machines.scm} file typically looks like this:
803
804 @example
805 (list (build-machine
806 (name "eightysix.example.org")
807 (system "x86_64-linux")
808 (user "bob")
809 (speed 2.)) ; incredibly fast!
810
811 (build-machine
812 (name "meeps.example.org")
813 (system "mips64el-linux")
814 (user "alice")
815 (private-key
816 (string-append (getenv "HOME")
817 "/.lsh/identity-for-guix"))))
818 @end example
819
820 @noindent
821 In the example above we specify a list of two build machines, one for
822 the @code{x86_64} architecture and one for the @code{mips64el}
823 architecture.
824
825 In fact, this file is---not surprisingly!---a Scheme file that is
826 evaluated when the @code{offload} hook is started. Its return value
827 must be a list of @code{build-machine} objects. While this example
828 shows a fixed list of build machines, one could imagine, say, using
829 DNS-SD to return a list of potential build machines discovered in the
830 local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
831 Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
832 detailed below.
833
834 @deftp {Data Type} build-machine
835 This data type represents build machines to which the daemon may offload
836 builds. The important fields are:
837
838 @table @code
839
840 @item name
841 The host name of the remote machine.
842
843 @item system
844 The system type of the remote machine---e.g., @code{"x86_64-linux"}.
845
846 @item user
847 The user account to use when connecting to the remote machine over SSH.
848 Note that the SSH key pair must @emph{not} be passphrase-protected, to
849 allow non-interactive logins.
850
851 @end table
852
853 A number of optional fields may be specified:
854
855 @table @code
856
857 @item port
858 Port number of SSH server on the machine (default: 22).
859
860 @item private-key
861 The SSH private key file to use when connecting to the machine.
862
863 Currently offloading uses GNU@tie{}lsh as its SSH client
864 (@pxref{Invoking lsh,,, GNU lsh Manual}). Thus, the key file here must
865 be an lsh key file. This may change in the future, though.
866
867 @item parallel-builds
868 The number of builds that may run in parallel on the machine (1 by
869 default.)
870
871 @item speed
872 A ``relative speed factor''. The offload scheduler will tend to prefer
873 machines with a higher speed factor.
874
875 @item features
876 A list of strings denoting specific features supported by the machine.
877 An example is @code{"kvm"} for machines that have the KVM Linux modules
878 and corresponding hardware support. Derivations can request features by
879 name, and they will be scheduled on matching build machines.
880
881 @end table
882 @end deftp
883
884 The @code{guix} command must be in the search path on the build
885 machines, since offloading works by invoking the @code{guix archive} and
886 @code{guix build} commands. In addition, the Guix modules must be in
887 @code{$GUILE_LOAD_PATH} on the build machine---you can check whether
888 this is the case by running:
889
890 @example
891 lsh build-machine guile -c "'(use-modules (guix config))'"
892 @end example
893
894 There is one last thing to do once @file{machines.scm} is in place. As
895 explained above, when offloading, files are transferred back and forth
896 between the machine stores. For this to work, you first need to
897 generate a key pair on each machine to allow the daemon to export signed
898 archives of files from the store (@pxref{Invoking guix archive}):
899
900 @example
901 # guix archive --generate-key
902 @end example
903
904 @noindent
905 Each build machine must authorize the key of the master machine so that
906 it accepts store items it receives from the master:
907
908 @example
909 # guix archive --authorize < master-public-key.txt
910 @end example
911
912 @noindent
913 Likewise, the master machine must authorize the key of each build machine.
914
915 All the fuss with keys is here to express pairwise mutual trust
916 relations between the master and the build machines. Concretely, when
917 the master receives files from a build machine (and @i{vice versa}), its
918 build daemon can make sure they are genuine, have not been tampered
919 with, and that they are signed by an authorized key.
920
921
922 @node Invoking guix-daemon
923 @section Invoking @command{guix-daemon}
924
925 The @command{guix-daemon} program implements all the functionality to
926 access the store. This includes launching build processes, running the
927 garbage collector, querying the availability of a build result, etc. It
928 is normally run as @code{root} like this:
929
930 @example
931 # guix-daemon --build-users-group=guixbuild
932 @end example
933
934 @noindent
935 For details on how to set it up, @pxref{Setting Up the Daemon}.
936
937 @cindex chroot
938 @cindex container, build environment
939 @cindex build environment
940 @cindex reproducible builds
941 By default, @command{guix-daemon} launches build processes under
942 different UIDs, taken from the build group specified with
943 @code{--build-users-group}. In addition, each build process is run in a
944 chroot environment that only contains the subset of the store that the
945 build process depends on, as specified by its derivation
946 (@pxref{Programming Interface, derivation}), plus a set of specific
947 system directories. By default, the latter contains @file{/dev} and
948 @file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
949 @dfn{container}: in addition to having its own file system tree, it has
950 a separate mount name space, its own PID name space, network name space,
951 etc. This helps achieve reproducible builds (@pxref{Features}).
952
953 When the daemon performs a build on behalf of the user, it creates a
954 build directory under @file{/tmp} or under the directory specified by
955 its @code{TMPDIR} environment variable; this directory is shared with
956 the container for the duration of the build. Be aware that using a
957 directory other than @file{/tmp} can affect build results---for example,
958 with a longer directory name, a build process that uses Unix-domain
959 sockets might hit the name length limitation for @code{sun_path}, which
960 it would otherwise not hit.
961
962 The build directory is automatically deleted upon completion, unless the
963 build failed and the client specified @option{--keep-failed}
964 (@pxref{Invoking guix build, @option{--keep-failed}}).
965
966 The following command-line options are supported:
967
968 @table @code
969 @item --build-users-group=@var{group}
970 Take users from @var{group} to run build processes (@pxref{Setting Up
971 the Daemon, build users}).
972
973 @item --no-substitutes
974 @cindex substitutes
975 Do not use substitutes for build products. That is, always build things
976 locally instead of allowing downloads of pre-built binaries
977 (@pxref{Substitutes}).
978
979 By default substitutes are used, unless the client---such as the
980 @command{guix package} command---is explicitly invoked with
981 @code{--no-substitutes}.
982
983 When the daemon runs with @code{--no-substitutes}, clients can still
984 explicitly enable substitution @i{via} the @code{set-build-options}
985 remote procedure call (@pxref{The Store}).
986
987 @item --substitute-urls=@var{urls}
988 @anchor{daemon-substitute-urls}
989 Consider @var{urls} the default whitespace-separated list of substitute
990 source URLs. When this option is omitted,
991 @indicateurl{https://mirror.hydra.gnu.org https://hydra.gnu.org} is used
992 (@code{mirror.hydra.gnu.org} is a mirror of @code{hydra.gnu.org}).
993
994 This means that substitutes may be downloaded from @var{urls}, as long
995 as they are signed by a trusted signature (@pxref{Substitutes}).
996
997 @cindex build hook
998 @item --no-build-hook
999 Do not use the @dfn{build hook}.
1000
1001 The build hook is a helper program that the daemon can start and to
1002 which it submits build requests. This mechanism is used to offload
1003 builds to other machines (@pxref{Daemon Offload Setup}).
1004
1005 @item --cache-failures
1006 Cache build failures. By default, only successful builds are cached.
1007
1008 When this option is used, @command{guix gc --list-failures} can be used
1009 to query the set of store items marked as failed; @command{guix gc
1010 --clear-failures} removes store items from the set of cached failures.
1011 @xref{Invoking guix gc}.
1012
1013 @item --cores=@var{n}
1014 @itemx -c @var{n}
1015 Use @var{n} CPU cores to build each derivation; @code{0} means as many
1016 as available.
1017
1018 The default value is @code{0}, but it may be overridden by clients, such
1019 as the @code{--cores} option of @command{guix build} (@pxref{Invoking
1020 guix build}).
1021
1022 The effect is to define the @code{NIX_BUILD_CORES} environment variable
1023 in the build process, which can then use it to exploit internal
1024 parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
1025
1026 @item --max-jobs=@var{n}
1027 @itemx -M @var{n}
1028 Allow at most @var{n} build jobs in parallel. The default value is
1029 @code{1}. Setting it to @code{0} means that no builds will be performed
1030 locally; instead, the daemon will offload builds (@pxref{Daemon Offload
1031 Setup}), or simply fail.
1032
1033 @item --rounds=@var{N}
1034 Build each derivation @var{n} times in a row, and raise an error if
1035 consecutive build results are not bit-for-bit identical. Note that this
1036 setting can be overridden by clients such as @command{guix build}
1037 (@pxref{Invoking guix build}).
1038
1039 When used in conjunction with @option{--keep-failed}, the differing
1040 output is kept in the store, under @file{/gnu/store/@dots{}-check}.
1041 This makes it easy to look for differences between the two results.
1042
1043 @item --debug
1044 Produce debugging output.
1045
1046 This is useful to debug daemon start-up issues, but then it may be
1047 overridden by clients, for example the @code{--verbosity} option of
1048 @command{guix build} (@pxref{Invoking guix build}).
1049
1050 @item --chroot-directory=@var{dir}
1051 Add @var{dir} to the build chroot.
1052
1053 Doing this may change the result of build processes---for instance if
1054 they use optional dependencies found in @var{dir} when it is available,
1055 and not otherwise. For that reason, it is not recommended to do so.
1056 Instead, make sure that each derivation declares all the inputs that it
1057 needs.
1058
1059 @item --disable-chroot
1060 Disable chroot builds.
1061
1062 Using this option is not recommended since, again, it would allow build
1063 processes to gain access to undeclared dependencies. It is necessary,
1064 though, when @command{guix-daemon} is running under an unprivileged user
1065 account.
1066
1067 @item --disable-log-compression
1068 Disable compression of the build logs.
1069
1070 Unless @code{--lose-logs} is used, all the build logs are kept in the
1071 @var{localstatedir}. To save space, the daemon automatically compresses
1072 them with bzip2 by default. This option disables that.
1073
1074 @item --disable-deduplication
1075 @cindex deduplication
1076 Disable automatic file ``deduplication'' in the store.
1077
1078 By default, files added to the store are automatically ``deduplicated'':
1079 if a newly added file is identical to another one found in the store,
1080 the daemon makes the new file a hard link to the other file. This can
1081 noticeably reduce disk usage, at the expense of slightly increased
1082 input/output load at the end of a build process. This option disables
1083 this optimization.
1084
1085 @item --gc-keep-outputs[=yes|no]
1086 Tell whether the garbage collector (GC) must keep outputs of live
1087 derivations.
1088
1089 When set to ``yes'', the GC will keep the outputs of any live derivation
1090 available in the store---the @code{.drv} files. The default is ``no'',
1091 meaning that derivation outputs are kept only if they are GC roots.
1092
1093 @item --gc-keep-derivations[=yes|no]
1094 Tell whether the garbage collector (GC) must keep derivations
1095 corresponding to live outputs.
1096
1097 When set to ``yes'', as is the case by default, the GC keeps
1098 derivations---i.e., @code{.drv} files---as long as at least one of their
1099 outputs is live. This allows users to keep track of the origins of
1100 items in their store. Setting it to ``no'' saves a bit of disk space.
1101
1102 Note that when both @code{--gc-keep-derivations} and
1103 @code{--gc-keep-outputs} are used, the effect is to keep all the build
1104 prerequisites (the sources, compiler, libraries, and other build-time
1105 tools) of live objects in the store, regardless of whether these
1106 prerequisites are live. This is convenient for developers since it
1107 saves rebuilds or downloads.
1108
1109 @item --impersonate-linux-2.6
1110 On Linux-based systems, impersonate Linux 2.6. This means that the
1111 kernel's @code{uname} system call will report 2.6 as the release number.
1112
1113 This might be helpful to build programs that (usually wrongfully) depend
1114 on the kernel version number.
1115
1116 @item --lose-logs
1117 Do not keep build logs. By default they are kept under
1118 @code{@var{localstatedir}/guix/log}.
1119
1120 @item --system=@var{system}
1121 Assume @var{system} as the current system type. By default it is the
1122 architecture/kernel pair found at configure time, such as
1123 @code{x86_64-linux}.
1124
1125 @item --listen=@var{socket}
1126 Listen for connections on @var{socket}, the file name of a Unix-domain
1127 socket. The default socket is
1128 @file{@var{localstatedir}/daemon-socket/socket}. This option is only
1129 useful in exceptional circumstances, such as if you need to run several
1130 daemons on the same machine.
1131 @end table
1132
1133
1134 @node Application Setup
1135 @section Application Setup
1136
1137 @cindex foreign distro
1138 When using Guix on top of GNU/Linux distribution other than GuixSD---a
1139 so-called @dfn{foreign distro}---a few additional steps are needed to
1140 get everything in place. Here are some of them.
1141
1142 @subsection Locales
1143
1144 @anchor{locales-and-locpath}
1145 @cindex locales, when not on GuixSD
1146 @vindex LOCPATH
1147 @vindex GUIX_LOCPATH
1148 Packages installed @i{via} Guix will not use the locale data of the
1149 host system. Instead, you must first install one of the locale packages
1150 available with Guix and then define the @code{GUIX_LOCPATH} environment
1151 variable:
1152
1153 @example
1154 $ guix package -i glibc-locales
1155 $ export GUIX_LOCPATH=$HOME/.guix-profile/lib/locale
1156 @end example
1157
1158 Note that the @code{glibc-locales} package contains data for all the
1159 locales supported by the GNU@tie{}libc and weighs in at around
1160 110@tie{}MiB. Alternatively, the @code{glibc-utf8-locales} is smaller but
1161 limited to a few UTF-8 locales.
1162
1163 The @code{GUIX_LOCPATH} variable plays a role similar to @code{LOCPATH}
1164 (@pxref{Locale Names, @code{LOCPATH},, libc, The GNU C Library Reference
1165 Manual}). There are two important differences though:
1166
1167 @enumerate
1168 @item
1169 @code{GUIX_LOCPATH} is honored only by the libc in Guix, and not by the libc
1170 provided by foreign distros. Thus, using @code{GUIX_LOCPATH} allows you
1171 to make sure the programs of the foreign distro will not end up loading
1172 incompatible locale data.
1173
1174 @item
1175 libc suffixes each entry of @code{GUIX_LOCPATH} with @code{/X.Y}, where
1176 @code{X.Y} is the libc version---e.g., @code{2.22}. This means that,
1177 should your Guix profile contain a mixture of programs linked against
1178 different libc version, each libc version will only try to load locale
1179 data in the right format.
1180 @end enumerate
1181
1182 This is important because the locale data format used by different libc
1183 versions may be incompatible.
1184
1185 @subsection X11 Fonts
1186
1187 The majority of graphical applications use Fontconfig to locate and
1188 load fonts and perform X11-client-side rendering. The @code{fontconfig}
1189 package in Guix looks for fonts in @file{$HOME/.guix-profile}
1190 by default. Thus, to allow graphical applications installed with Guix
1191 to display fonts, you have to install fonts with Guix as well.
1192 Essential font packages include @code{gs-fonts}, @code{font-dejavu}, and
1193 @code{font-gnu-freefont-ttf}.
1194
1195 To display text written in Chinese languages, Japanese, or Korean in
1196 graphical applications, consider installing
1197 @code{font-adobe-source-han-sans} or @code{font-wqy-zenhei}. The former
1198 has multiple outputs, one per language family (@pxref{Packages with
1199 Multiple Outputs}). For instance, the following command installs fonts
1200 for Chinese languages:
1201
1202 @example
1203 guix package -i font-adobe-source-han-sans:cn
1204 @end example
1205
1206 @subsection X.509 Certificates
1207
1208 The @code{nss-certs} package provides X.509 certificates, which allow
1209 programs to authenticate Web servers accessed over HTTPS.
1210
1211 When using Guix on a foreign distro, you can install this package and
1212 define the relevant environment variables so that packages know where to
1213 look for certificates. @pxref{X.509 Certificates}, for detailed
1214 information.
1215
1216 @subsection Emacs Packages
1217
1218 When you install Emacs packages with Guix, the elisp files may be placed
1219 either in @file{$HOME/.guix-profile/share/emacs/site-lisp/} or in
1220 sub-directories of
1221 @file{$HOME/.guix-profile/share/emacs/site-lisp/guix.d/}. The latter
1222 directory exists because potentially there may exist thousands of Emacs
1223 packages and storing all their files in a single directory may be not
1224 reliable (because of name conflicts). So we think using a separate
1225 directory for each package is a good idea. It is very similar to how
1226 the Emacs package system organizes the file structure (@pxref{Package
1227 Files,,, emacs, The GNU Emacs Manual}).
1228
1229 By default, Emacs (installed with Guix) ``knows'' where these packages
1230 are placed, so you do not need to perform any configuration. If, for
1231 some reason, you want to avoid auto-loading Emacs packages installed
1232 with Guix, you can do so by running Emacs with @code{--no-site-file}
1233 option (@pxref{Init File,,, emacs, The GNU Emacs Manual}).
1234
1235 @c TODO What else?
1236
1237 @c *********************************************************************
1238 @node Package Management
1239 @chapter Package Management
1240
1241 The purpose of GNU Guix is to allow users to easily install, upgrade, and
1242 remove software packages, without having to know about their build
1243 procedures or dependencies. Guix also goes beyond this obvious set of
1244 features.
1245
1246 This chapter describes the main features of Guix, as well as the package
1247 management tools it provides. Two user interfaces are provided for
1248 routine package management tasks: A command-line interface described below
1249 (@pxref{Invoking guix package, @code{guix package}}), as well as a visual user
1250 interface in Emacs described in a subsequent chapter (@pxref{Emacs Interface}).
1251
1252 @menu
1253 * Features:: How Guix will make your life brighter.
1254 * Invoking guix package:: Package installation, removal, etc.
1255 * Substitutes:: Downloading pre-built binaries.
1256 * Packages with Multiple Outputs:: Single source package, multiple outputs.
1257 * Invoking guix gc:: Running the garbage collector.
1258 * Invoking guix pull:: Fetching the latest Guix and distribution.
1259 * Invoking guix archive:: Exporting and importing store files.
1260 @end menu
1261
1262 @node Features
1263 @section Features
1264
1265 When using Guix, each package ends up in the @dfn{package store}, in its
1266 own directory---something that resembles
1267 @file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
1268 (note that Guix comes with an Emacs extension to shorten those file
1269 names, @pxref{Emacs Prettify}.)
1270
1271 Instead of referring to these directories, users have their own
1272 @dfn{profile}, which points to the packages that they actually want to
1273 use. These profiles are stored within each user's home directory, at
1274 @code{$HOME/.guix-profile}.
1275
1276 For example, @code{alice} installs GCC 4.7.2. As a result,
1277 @file{/home/alice/.guix-profile/bin/gcc} points to
1278 @file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
1279 @code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
1280 simply continues to point to
1281 @file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
1282 coexist on the same system without any interference.
1283
1284 The @command{guix package} command is the central tool to manage
1285 packages (@pxref{Invoking guix package}). It operates on the per-user
1286 profiles, and can be used @emph{with normal user privileges}.
1287
1288 The command provides the obvious install, remove, and upgrade
1289 operations. Each invocation is actually a @emph{transaction}: either
1290 the specified operation succeeds, or nothing happens. Thus, if the
1291 @command{guix package} process is terminated during the transaction,
1292 or if a power outage occurs during the transaction, then the user's
1293 profile remains in its previous state, and remains usable.
1294
1295 In addition, any package transaction may be @emph{rolled back}. So, if,
1296 for example, an upgrade installs a new version of a package that turns
1297 out to have a serious bug, users may roll back to the previous instance
1298 of their profile, which was known to work well. Similarly, the global
1299 system configuration on GuixSD is subject to
1300 transactional upgrades and roll-back
1301 (@pxref{Using the Configuration System}).
1302
1303 All packages in the package store may be @emph{garbage-collected}.
1304 Guix can determine which packages are still referenced by user
1305 profiles, and remove those that are provably no longer referenced
1306 (@pxref{Invoking guix gc}). Users may also explicitly remove old
1307 generations of their profile so that the packages they refer to can be
1308 collected.
1309
1310 @cindex reproducibility
1311 @cindex reproducible builds
1312 Finally, Guix takes a @dfn{purely functional} approach to package
1313 management, as described in the introduction (@pxref{Introduction}).
1314 Each @file{/gnu/store} package directory name contains a hash of all the
1315 inputs that were used to build that package---compiler, libraries, build
1316 scripts, etc. This direct correspondence allows users to make sure a
1317 given package installation matches the current state of their
1318 distribution. It also helps maximize @dfn{build reproducibility}:
1319 thanks to the isolated build environments that are used, a given build
1320 is likely to yield bit-identical files when performed on different
1321 machines (@pxref{Invoking guix-daemon, container}).
1322
1323 @cindex substitutes
1324 This foundation allows Guix to support @dfn{transparent binary/source
1325 deployment}. When a pre-built binary for a @file{/gnu/store} item is
1326 available from an external source---a @dfn{substitute}, Guix just
1327 downloads it and unpacks it;
1328 otherwise, it builds the package from source, locally
1329 (@pxref{Substitutes}). Because build results are usually bit-for-bit
1330 reproducible, users do not have to trust servers that provide
1331 substitutes: they can force a local build and @emph{challenge} providers
1332 (@pxref{Invoking guix challenge}).
1333
1334 Control over the build environment is a feature that is also useful for
1335 developers. The @command{guix environment} command allows developers of
1336 a package to quickly set up the right development environment for their
1337 package, without having to manually install the dependencies of the
1338 package into their profile (@pxref{Invoking guix environment}).
1339
1340 @node Invoking guix package
1341 @section Invoking @command{guix package}
1342
1343 The @command{guix package} command is the tool that allows users to
1344 install, upgrade, and remove packages, as well as rolling back to
1345 previous configurations. It operates only on the user's own profile,
1346 and works with normal user privileges (@pxref{Features}). Its syntax
1347 is:
1348
1349 @example
1350 guix package @var{options}
1351 @end example
1352
1353 Primarily, @var{options} specifies the operations to be performed during
1354 the transaction. Upon completion, a new profile is created, but
1355 previous @dfn{generations} of the profile remain available, should the user
1356 want to roll back.
1357
1358 For example, to remove @code{lua} and install @code{guile} and
1359 @code{guile-cairo} in a single transaction:
1360
1361 @example
1362 guix package -r lua -i guile guile-cairo
1363 @end example
1364
1365 @command{guix package} also supports a @dfn{declarative approach}
1366 whereby the user specifies the exact set of packages to be available and
1367 passes it @i{via} the @option{--manifest} option
1368 (@pxref{profile-manifest, @option{--manifest}}).
1369
1370 For each user, a symlink to the user's default profile is automatically
1371 created in @file{$HOME/.guix-profile}. This symlink always points to the
1372 current generation of the user's default profile. Thus, users can add
1373 @file{$HOME/.guix-profile/bin} to their @code{PATH} environment
1374 variable, and so on.
1375 @cindex search paths
1376 If you are not using the Guix System Distribution, consider adding the
1377 following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
1378 Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
1379 shells get all the right environment variable definitions:
1380
1381 @example
1382 GUIX_PROFILE="$HOME/.guix-profile" \
1383 source "$HOME/.guix-profile/etc/profile"
1384 @end example
1385
1386 In a multi-user setup, user profiles are stored in a place registered as
1387 a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
1388 to (@pxref{Invoking guix gc}). That directory is normally
1389 @code{@var{localstatedir}/profiles/per-user/@var{user}}, where
1390 @var{localstatedir} is the value passed to @code{configure} as
1391 @code{--localstatedir}, and @var{user} is the user name. The
1392 @file{per-user} directory is created when @command{guix-daemon} is
1393 started, and the @var{user} sub-directory is created by @command{guix
1394 package}.
1395
1396 The @var{options} can be among the following:
1397
1398 @table @code
1399
1400 @item --install=@var{package} @dots{}
1401 @itemx -i @var{package} @dots{}
1402 Install the specified @var{package}s.
1403
1404 Each @var{package} may specify either a simple package name, such as
1405 @code{guile}, or a package name followed by an at-sign and version number,
1406 such as @code{guile@@1.8.8} or simply @code{guile@@1.8} (in the latter
1407 case, the newest version prefixed by @code{1.8} is selected.)
1408
1409 If no version number is specified, the
1410 newest available version will be selected. In addition, @var{package}
1411 may contain a colon, followed by the name of one of the outputs of the
1412 package, as in @code{gcc:doc} or @code{binutils@@2.22:lib}
1413 (@pxref{Packages with Multiple Outputs}). Packages with a corresponding
1414 name (and optionally version) are searched for among the GNU
1415 distribution modules (@pxref{Package Modules}).
1416
1417 @cindex propagated inputs
1418 Sometimes packages have @dfn{propagated inputs}: these are dependencies
1419 that automatically get installed along with the required package
1420 (@pxref{package-propagated-inputs, @code{propagated-inputs} in
1421 @code{package} objects}, for information about propagated inputs in
1422 package definitions).
1423
1424 @anchor{package-cmd-propagated-inputs}
1425 An example is the GNU MPC library: its C header files refer to those of
1426 the GNU MPFR library, which in turn refer to those of the GMP library.
1427 Thus, when installing MPC, the MPFR and GMP libraries also get installed
1428 in the profile; removing MPC also removes MPFR and GMP---unless they had
1429 also been explicitly installed by the user.
1430
1431 Besides, packages sometimes rely on the definition of environment
1432 variables for their search paths (see explanation of
1433 @code{--search-paths} below). Any missing or possibly incorrect
1434 environment variable definitions are reported here.
1435
1436 @item --install-from-expression=@var{exp}
1437 @itemx -e @var{exp}
1438 Install the package @var{exp} evaluates to.
1439
1440 @var{exp} must be a Scheme expression that evaluates to a
1441 @code{<package>} object. This option is notably useful to disambiguate
1442 between same-named variants of a package, with expressions such as
1443 @code{(@@ (gnu packages base) guile-final)}.
1444
1445 Note that this option installs the first output of the specified
1446 package, which may be insufficient when needing a specific output of a
1447 multiple-output package.
1448
1449 @item --install-from-file=@var{file}
1450 @itemx -f @var{file}
1451 Install the package that the code within @var{file} evaluates to.
1452
1453 As an example, @var{file} might contain a definition like this
1454 (@pxref{Defining Packages}):
1455
1456 @example
1457 @verbatiminclude package-hello.scm
1458 @end example
1459
1460 Developers may find it useful to include such a @file{guix.scm} file
1461 in the root of their project source tree that can be used to test
1462 development snapshots and create reproducible development environments
1463 (@pxref{Invoking guix environment}).
1464
1465 @item --remove=@var{package} @dots{}
1466 @itemx -r @var{package} @dots{}
1467 Remove the specified @var{package}s.
1468
1469 As for @code{--install}, each @var{package} may specify a version number
1470 and/or output name in addition to the package name. For instance,
1471 @code{-r glibc:debug} would remove the @code{debug} output of
1472 @code{glibc}.
1473
1474 @item --upgrade[=@var{regexp} @dots{}]
1475 @itemx -u [@var{regexp} @dots{}]
1476 Upgrade all the installed packages. If one or more @var{regexp}s are
1477 specified, upgrade only installed packages whose name matches a
1478 @var{regexp}. Also see the @code{--do-not-upgrade} option below.
1479
1480 Note that this upgrades package to the latest version of packages found
1481 in the distribution currently installed. To update your distribution,
1482 you should regularly run @command{guix pull} (@pxref{Invoking guix
1483 pull}).
1484
1485 @item --do-not-upgrade[=@var{regexp} @dots{}]
1486 When used together with the @code{--upgrade} option, do @emph{not}
1487 upgrade any packages whose name matches a @var{regexp}. For example, to
1488 upgrade all packages in the current profile except those containing the
1489 substring ``emacs'':
1490
1491 @example
1492 $ guix package --upgrade . --do-not-upgrade emacs
1493 @end example
1494
1495 @item @anchor{profile-manifest}--manifest=@var{file}
1496 @itemx -m @var{file}
1497 @cindex profile declaration
1498 @cindex profile manifest
1499 Create a new generation of the profile from the manifest object
1500 returned by the Scheme code in @var{file}.
1501
1502 This allows you to @emph{declare} the profile's contents rather than
1503 constructing it through a sequence of @code{--install} and similar
1504 commands. The advantage is that @var{file} can be put under version
1505 control, copied to different machines to reproduce the same profile, and
1506 so on.
1507
1508 @c FIXME: Add reference to (guix profile) documentation when available.
1509 @var{file} must return a @dfn{manifest} object, which is roughly a list
1510 of packages:
1511
1512 @findex packages->manifest
1513 @example
1514 (use-package-modules guile emacs)
1515
1516 (packages->manifest
1517 (list emacs
1518 guile-2.0
1519 ;; Use a specific package output.
1520 (list guile-2.0 "debug")))
1521 @end example
1522
1523 @item --roll-back
1524 Roll back to the previous @dfn{generation} of the profile---i.e., undo
1525 the last transaction.
1526
1527 When combined with options such as @code{--install}, roll back occurs
1528 before any other actions.
1529
1530 When rolling back from the first generation that actually contains
1531 installed packages, the profile is made to point to the @dfn{zeroth
1532 generation}, which contains no files apart from its own metadata.
1533
1534 After having rolled back, installing, removing, or upgrading packages
1535 overwrites previous future generations. Thus, the history of the
1536 generations in a profile is always linear.
1537
1538 @item --switch-generation=@var{pattern}
1539 @itemx -S @var{pattern}
1540 Switch to a particular generation defined by @var{pattern}.
1541
1542 @var{pattern} may be either a generation number or a number prefixed
1543 with ``+'' or ``-''. The latter means: move forward/backward by a
1544 specified number of generations. For example, if you want to return to
1545 the latest generation after @code{--roll-back}, use
1546 @code{--switch-generation=+1}.
1547
1548 The difference between @code{--roll-back} and
1549 @code{--switch-generation=-1} is that @code{--switch-generation} will
1550 not make a zeroth generation, so if a specified generation does not
1551 exist, the current generation will not be changed.
1552
1553 @item --search-paths[=@var{kind}]
1554 @cindex search paths
1555 Report environment variable definitions, in Bash syntax, that may be
1556 needed in order to use the set of installed packages. These environment
1557 variables are used to specify @dfn{search paths} for files used by some
1558 of the installed packages.
1559
1560 For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1561 environment variables to be defined so it can look for headers and
1562 libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1563 Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1564 library are installed in the profile, then @code{--search-paths} will
1565 suggest setting these variables to @code{@var{profile}/include} and
1566 @code{@var{profile}/lib}, respectively.
1567
1568 The typical use case is to define these environment variables in the
1569 shell:
1570
1571 @example
1572 $ eval `guix package --search-paths`
1573 @end example
1574
1575 @var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1576 meaning that the returned environment variable definitions will either
1577 be exact settings, or prefixes or suffixes of the current value of these
1578 variables. When omitted, @var{kind} defaults to @code{exact}.
1579
1580 This option can also be used to compute the @emph{combined} search paths
1581 of several profiles. Consider this example:
1582
1583 @example
1584 $ guix package -p foo -i guile
1585 $ guix package -p bar -i guile-json
1586 $ guix package -p foo -p bar --search-paths
1587 @end example
1588
1589 The last command above reports about the @code{GUILE_LOAD_PATH}
1590 variable, even though, taken individually, neither @file{foo} nor
1591 @file{bar} would lead to that recommendation.
1592
1593
1594 @item --profile=@var{profile}
1595 @itemx -p @var{profile}
1596 Use @var{profile} instead of the user's default profile.
1597
1598 @item --verbose
1599 Produce verbose output. In particular, emit the build log of the
1600 environment on the standard error port.
1601
1602 @item --bootstrap
1603 Use the bootstrap Guile to build the profile. This option is only
1604 useful to distribution developers.
1605
1606 @end table
1607
1608 In addition to these actions, @command{guix package} supports the
1609 following options to query the current state of a profile, or the
1610 availability of packages:
1611
1612 @table @option
1613
1614 @item --search=@var{regexp}
1615 @itemx -s @var{regexp}
1616 @cindex searching for packages
1617 List the available packages whose name, synopsis, or description matches
1618 @var{regexp}. Print all the metadata of matching packages in
1619 @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1620 GNU recutils manual}).
1621
1622 This allows specific fields to be extracted using the @command{recsel}
1623 command, for instance:
1624
1625 @example
1626 $ guix package -s malloc | recsel -p name,version
1627 name: glibc
1628 version: 2.17
1629
1630 name: libgc
1631 version: 7.2alpha6
1632 @end example
1633
1634 Similarly, to show the name of all the packages available under the
1635 terms of the GNU@tie{}LGPL version 3:
1636
1637 @example
1638 $ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1639 name: elfutils
1640
1641 name: gmp
1642 @dots{}
1643 @end example
1644
1645 It is also possible to refine search results using several @code{-s}
1646 flags. For example, the following command returns a list of board
1647 games:
1648
1649 @example
1650 $ guix package -s '\<board\>' -s game | recsel -p name
1651 name: gnubg
1652 @dots{}
1653 @end example
1654
1655 If we were to omit @code{-s game}, we would also get software packages
1656 that deal with printed circuit boards; removing the angle brackets
1657 around @code{board} would further add packages that have to do with
1658 keyboards.
1659
1660 And now for a more elaborate example. The following command searches
1661 for cryptographic libraries, filters out Haskell, Perl, Python, and Ruby
1662 libraries, and prints the name and synopsis of the matching packages:
1663
1664 @example
1665 $ guix package -s crypto -s library | \
1666 recsel -e '! (name ~ "^(ghc|perl|python|ruby)")' -p name,synopsis
1667 @end example
1668
1669 @noindent
1670 @xref{Selection Expressions,,, recutils, GNU recutils manual}, for more
1671 information on @dfn{selection expressions} for @code{recsel -e}.
1672
1673 @item --show=@var{package}
1674 Show details about @var{package}, taken from the list of available packages, in
1675 @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1676 recutils manual}).
1677
1678 @example
1679 $ guix package --show=python | recsel -p name,version
1680 name: python
1681 version: 2.7.6
1682
1683 name: python
1684 version: 3.3.5
1685 @end example
1686
1687 You may also specify the full name of a package to only get details about a
1688 specific version of it:
1689 @example
1690 $ guix package --show=python-3.3.5 | recsel -p name,version
1691 name: python
1692 version: 3.3.5
1693 @end example
1694
1695
1696
1697 @item --list-installed[=@var{regexp}]
1698 @itemx -I [@var{regexp}]
1699 List the currently installed packages in the specified profile, with the
1700 most recently installed packages shown last. When @var{regexp} is
1701 specified, list only installed packages whose name matches @var{regexp}.
1702
1703 For each installed package, print the following items, separated by
1704 tabs: the package name, its version string, the part of the package that
1705 is installed (for instance, @code{out} for the default output,
1706 @code{include} for its headers, etc.), and the path of this package in
1707 the store.
1708
1709 @item --list-available[=@var{regexp}]
1710 @itemx -A [@var{regexp}]
1711 List packages currently available in the distribution for this system
1712 (@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1713 installed packages whose name matches @var{regexp}.
1714
1715 For each package, print the following items separated by tabs: its name,
1716 its version string, the parts of the package (@pxref{Packages with
1717 Multiple Outputs}), and the source location of its definition.
1718
1719 @item --list-generations[=@var{pattern}]
1720 @itemx -l [@var{pattern}]
1721 Return a list of generations along with their creation dates; for each
1722 generation, show the installed packages, with the most recently
1723 installed packages shown last. Note that the zeroth generation is never
1724 shown.
1725
1726 For each installed package, print the following items, separated by
1727 tabs: the name of a package, its version string, the part of the package
1728 that is installed (@pxref{Packages with Multiple Outputs}), and the
1729 location of this package in the store.
1730
1731 When @var{pattern} is used, the command returns only matching
1732 generations. Valid patterns include:
1733
1734 @itemize
1735 @item @emph{Integers and comma-separated integers}. Both patterns denote
1736 generation numbers. For instance, @code{--list-generations=1} returns
1737 the first one.
1738
1739 And @code{--list-generations=1,8,2} outputs three generations in the
1740 specified order. Neither spaces nor trailing commas are allowed.
1741
1742 @item @emph{Ranges}. @code{--list-generations=2..9} prints the
1743 specified generations and everything in between. Note that the start of
1744 a range must be smaller than its end.
1745
1746 It is also possible to omit the endpoint. For example,
1747 @code{--list-generations=2..}, returns all generations starting from the
1748 second one.
1749
1750 @item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1751 or months by passing an integer along with the first letter of the
1752 duration. For example, @code{--list-generations=20d} lists generations
1753 that are up to 20 days old.
1754 @end itemize
1755
1756 @item --delete-generations[=@var{pattern}]
1757 @itemx -d [@var{pattern}]
1758 When @var{pattern} is omitted, delete all generations except the current
1759 one.
1760
1761 This command accepts the same patterns as @option{--list-generations}.
1762 When @var{pattern} is specified, delete the matching generations. When
1763 @var{pattern} specifies a duration, generations @emph{older} than the
1764 specified duration match. For instance, @code{--delete-generations=1m}
1765 deletes generations that are more than one month old.
1766
1767 If the current generation matches, it is @emph{not} deleted. Also, the
1768 zeroth generation is never deleted.
1769
1770 Note that deleting generations prevents rolling back to them.
1771 Consequently, this command must be used with care.
1772
1773 @end table
1774
1775 Finally, since @command{guix package} may actually start build
1776 processes, it supports all the common build options (@pxref{Common Build
1777 Options}). It also supports package transformation options, such as
1778 @option{--with-source} (@pxref{Package Transformation Options}).
1779 However, note that package transformations are lost when upgrading; to
1780 preserve transformations across upgrades, you should define your own
1781 package variant in a Guile module and add it to @code{GUIX_PACKAGE_PATH}
1782 (@pxref{Defining Packages}).
1783
1784
1785 @node Substitutes
1786 @section Substitutes
1787
1788 @cindex substitutes
1789 @cindex pre-built binaries
1790 Guix supports transparent source/binary deployment, which means that it
1791 can either build things locally, or download pre-built items from a
1792 server. We call these pre-built items @dfn{substitutes}---they are
1793 substitutes for local build results. In many cases, downloading a
1794 substitute is much faster than building things locally.
1795
1796 Substitutes can be anything resulting from a derivation build
1797 (@pxref{Derivations}). Of course, in the common case, they are
1798 pre-built package binaries, but source tarballs, for instance, which
1799 also result from derivation builds, can be available as substitutes.
1800
1801 The @code{hydra.gnu.org} server is a front-end to a build farm that
1802 builds packages from the GNU distribution continuously for some
1803 architectures, and makes them available as substitutes (@pxref{Emacs
1804 Hydra}, for information on how to query the continuous integration
1805 server). This is the
1806 default source of substitutes; it can be overridden by passing the
1807 @option{--substitute-urls} option either to @command{guix-daemon}
1808 (@pxref{daemon-substitute-urls,, @code{guix-daemon --substitute-urls}})
1809 or to client tools such as @command{guix package}
1810 (@pxref{client-substitute-urls,, client @option{--substitute-urls}
1811 option}).
1812
1813 Substitute URLs can be either HTTP or HTTPS@footnote{For HTTPS access,
1814 the Guile bindings of GnuTLS must be installed. @xref{Requirements}.}
1815 HTTPS is recommended because communications are encrypted; conversely,
1816 using HTTP makes all communications visible to an eavesdropper, who
1817 could use the information gathered to determine, for instance, whether
1818 your system has unpatched security vulnerabilities.
1819
1820 @cindex security
1821 @cindex digital signatures
1822 To allow Guix to download substitutes from @code{hydra.gnu.org} or a
1823 mirror thereof, you
1824 must add its public key to the access control list (ACL) of archive
1825 imports, using the @command{guix archive} command (@pxref{Invoking guix
1826 archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1827 be compromised and to serve genuine substitutes.
1828
1829 This public key is installed along with Guix, in
1830 @code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1831 the installation prefix of Guix. If you installed Guix from source,
1832 make sure you checked the GPG signature of
1833 @file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1834 Then, you can run something like this:
1835
1836 @example
1837 # guix archive --authorize < hydra.gnu.org.pub
1838 @end example
1839
1840 Once this is in place, the output of a command like @code{guix build}
1841 should change from something like:
1842
1843 @example
1844 $ guix build emacs --dry-run
1845 The following derivations would be built:
1846 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1847 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1848 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1849 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1850 @dots{}
1851 @end example
1852
1853 @noindent
1854 to something like:
1855
1856 @example
1857 $ guix build emacs --dry-run
1858 The following files would be downloaded:
1859 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1860 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1861 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1862 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1863 @dots{}
1864 @end example
1865
1866 @noindent
1867 This indicates that substitutes from @code{hydra.gnu.org} are usable and
1868 will be downloaded, when possible, for future builds.
1869
1870 Guix ignores substitutes that are not signed, or that are not signed by
1871 one of the keys listed in the ACL. It also detects and raises an error
1872 when attempting to use a substitute that has been tampered with.
1873
1874 @vindex http_proxy
1875 Substitutes are downloaded over HTTP or HTTPS.
1876 The @code{http_proxy} environment
1877 variable can be set in the environment of @command{guix-daemon} and is
1878 honored for downloads of substitutes. Note that the value of
1879 @code{http_proxy} in the environment where @command{guix build},
1880 @command{guix package}, and other client commands are run has
1881 @emph{absolutely no effect}.
1882
1883 When using HTTPS, the server's X.509 certificate is @emph{not} validated
1884 (in other words, the server is not authenticated), contrary to what
1885 HTTPS clients such as Web browsers usually do. This is because Guix
1886 authenticates substitute information itself, as explained above, which
1887 is what we care about (whereas X.509 certificates are about
1888 authenticating bindings between domain names and public keys.)
1889
1890 The substitute mechanism can be disabled globally by running
1891 @code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1892 guix-daemon}). It can also be disabled temporarily by passing the
1893 @code{--no-substitutes} option to @command{guix package}, @command{guix
1894 build}, and other command-line tools.
1895
1896
1897 @unnumberedsubsec On Trusting Binaries
1898
1899 Today, each individual's control over their own computing is at the
1900 mercy of institutions, corporations, and groups with enough power and
1901 determination to subvert the computing infrastructure and exploit its
1902 weaknesses. While using @code{hydra.gnu.org} substitutes can be
1903 convenient, we encourage users to also build on their own, or even run
1904 their own build farm, such that @code{hydra.gnu.org} is less of an
1905 interesting target. One way to help is by publishing the software you
1906 build using @command{guix publish} so that others have one more choice
1907 of server to download substitutes from (@pxref{Invoking guix publish}).
1908
1909 Guix has the foundations to maximize build reproducibility
1910 (@pxref{Features}). In most cases, independent builds of a given
1911 package or derivation should yield bit-identical results. Thus, through
1912 a diverse set of independent package builds, we can strengthen the
1913 integrity of our systems. The @command{guix challenge} command aims to
1914 help users assess substitute servers, and to assist developers in
1915 finding out about non-deterministic package builds (@pxref{Invoking guix
1916 challenge}). Similarly, the @option{--check} option of @command{guix
1917 build} allows users to check whether previously-installed substitutes
1918 are genuine by rebuilding them locally (@pxref{build-check,
1919 @command{guix build --check}}).
1920
1921 In the future, we want Guix to have support to publish and retrieve
1922 binaries to/from other users, in a peer-to-peer fashion. If you would
1923 like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1924
1925
1926 @node Packages with Multiple Outputs
1927 @section Packages with Multiple Outputs
1928
1929 @cindex multiple-output packages
1930 @cindex package outputs
1931
1932 Often, packages defined in Guix have a single @dfn{output}---i.e., the
1933 source package leads to exactly one directory in the store. When running
1934 @command{guix package -i glibc}, one installs the default output of the
1935 GNU libc package; the default output is called @code{out}, but its name
1936 can be omitted as shown in this command. In this particular case, the
1937 default output of @code{glibc} contains all the C header files, shared
1938 libraries, static libraries, Info documentation, and other supporting
1939 files.
1940
1941 Sometimes it is more appropriate to separate the various types of files
1942 produced from a single source package into separate outputs. For
1943 instance, the GLib C library (used by GTK+ and related packages)
1944 installs more than 20 MiB of reference documentation as HTML pages.
1945 To save space for users who do not need it, the documentation goes to a
1946 separate output, called @code{doc}. To install the main GLib output,
1947 which contains everything but the documentation, one would run:
1948
1949 @example
1950 guix package -i glib
1951 @end example
1952
1953 The command to install its documentation is:
1954
1955 @example
1956 guix package -i glib:doc
1957 @end example
1958
1959 Some packages install programs with different ``dependency footprints''.
1960 For instance, the WordNet package installs both command-line tools and
1961 graphical user interfaces (GUIs). The former depend solely on the C
1962 library, whereas the latter depend on Tcl/Tk and the underlying X
1963 libraries. In this case, we leave the command-line tools in the default
1964 output, whereas the GUIs are in a separate output. This allows users
1965 who do not need the GUIs to save space. The @command{guix size} command
1966 can help find out about such situations (@pxref{Invoking guix size}).
1967 @command{guix graph} can also be helpful (@pxref{Invoking guix graph}).
1968
1969 There are several such multiple-output packages in the GNU distribution.
1970 Other conventional output names include @code{lib} for libraries and
1971 possibly header files, @code{bin} for stand-alone programs, and
1972 @code{debug} for debugging information (@pxref{Installing Debugging
1973 Files}). The outputs of a packages are listed in the third column of
1974 the output of @command{guix package --list-available} (@pxref{Invoking
1975 guix package}).
1976
1977
1978 @node Invoking guix gc
1979 @section Invoking @command{guix gc}
1980
1981 @cindex garbage collector
1982 Packages that are installed, but not used, may be @dfn{garbage-collected}.
1983 The @command{guix gc} command allows users to explicitly run the garbage
1984 collector to reclaim space from the @file{/gnu/store} directory. It is
1985 the @emph{only} way to remove files from @file{/gnu/store}---removing
1986 files or directories manually may break it beyond repair!
1987
1988 The garbage collector has a set of known @dfn{roots}: any file under
1989 @file{/gnu/store} reachable from a root is considered @dfn{live} and
1990 cannot be deleted; any other file is considered @dfn{dead} and may be
1991 deleted. The set of garbage collector roots includes default user
1992 profiles, and may be augmented with @command{guix build --root}, for
1993 example (@pxref{Invoking guix build}).
1994
1995 Prior to running @code{guix gc --collect-garbage} to make space, it is
1996 often useful to remove old generations from user profiles; that way, old
1997 package builds referenced by those generations can be reclaimed. This
1998 is achieved by running @code{guix package --delete-generations}
1999 (@pxref{Invoking guix package}).
2000
2001 The @command{guix gc} command has three modes of operation: it can be
2002 used to garbage-collect any dead files (the default), to delete specific
2003 files (the @code{--delete} option), to print garbage-collector
2004 information, or for more advanced queries. The garbage collection
2005 options are as follows:
2006
2007 @table @code
2008 @item --collect-garbage[=@var{min}]
2009 @itemx -C [@var{min}]
2010 Collect garbage---i.e., unreachable @file{/gnu/store} files and
2011 sub-directories. This is the default operation when no option is
2012 specified.
2013
2014 When @var{min} is given, stop once @var{min} bytes have been collected.
2015 @var{min} may be a number of bytes, or it may include a unit as a
2016 suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
2017 (@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
2018
2019 When @var{min} is omitted, collect all the garbage.
2020
2021 @item --free-space=@var{free}
2022 @itemx -F @var{free}
2023 Collect garbage until @var{free} space is available under
2024 @file{/gnu/store}, if possible; @var{free} denotes storage space, such
2025 as @code{500MiB}, as described above.
2026
2027 When @var{free} or more is already available in @file{/gnu/store}, do
2028 nothing and exit immediately.
2029
2030 @item --delete
2031 @itemx -d
2032 Attempt to delete all the store files and directories specified as
2033 arguments. This fails if some of the files are not in the store, or if
2034 they are still live.
2035
2036 @item --list-failures
2037 List store items corresponding to cached build failures.
2038
2039 This prints nothing unless the daemon was started with
2040 @option{--cache-failures} (@pxref{Invoking guix-daemon,
2041 @option{--cache-failures}}).
2042
2043 @item --clear-failures
2044 Remove the specified store items from the failed-build cache.
2045
2046 Again, this option only makes sense when the daemon is started with
2047 @option{--cache-failures}. Otherwise, it does nothing.
2048
2049 @item --list-dead
2050 Show the list of dead files and directories still present in the
2051 store---i.e., files and directories no longer reachable from any root.
2052
2053 @item --list-live
2054 Show the list of live store files and directories.
2055
2056 @end table
2057
2058 In addition, the references among existing store files can be queried:
2059
2060 @table @code
2061
2062 @item --references
2063 @itemx --referrers
2064 List the references (respectively, the referrers) of store files given
2065 as arguments.
2066
2067 @item --requisites
2068 @itemx -R
2069 @cindex closure
2070 List the requisites of the store files passed as arguments. Requisites
2071 include the store files themselves, their references, and the references
2072 of these, recursively. In other words, the returned list is the
2073 @dfn{transitive closure} of the store files.
2074
2075 @xref{Invoking guix size}, for a tool to profile the size of the closure
2076 of an element. @xref{Invoking guix graph}, for a tool to visualize
2077 the graph of references.
2078
2079 @end table
2080
2081 Lastly, the following options allow you to check the integrity of the
2082 store and to control disk usage.
2083
2084 @table @option
2085
2086 @item --verify[=@var{options}]
2087 @cindex integrity, of the store
2088 @cindex integrity checking
2089 Verify the integrity of the store.
2090
2091 By default, make sure that all the store items marked as valid in the
2092 database of the daemon actually exist in @file{/gnu/store}.
2093
2094 When provided, @var{options} must be a comma-separated list containing one
2095 or more of @code{contents} and @code{repair}.
2096
2097 When passing @option{--verify=contents}, the daemon computse the
2098 content hash of each store item and compares it against its hash in the
2099 database. Hash mismatches are reported as data corruptions. Because it
2100 traverses @emph{all the files in the store}, this command can take a
2101 long time, especially on systems with a slow disk drive.
2102
2103 @cindex repairing the store
2104 Using @option{--verify=repair} or @option{--verify=contents,repair}
2105 causes the daemon to try to repair corrupt store items by fetching
2106 substitutes for them (@pxref{Substitutes}). Because repairing is not
2107 atomic, and thus potentially dangerous, it is available only to the
2108 system administrator.
2109
2110 @item --optimize
2111 @cindex deduplication
2112 Optimize the store by hard-linking identical files---this is
2113 @dfn{deduplication}.
2114
2115 The daemon performs deduplication after each successful build or archive
2116 import, unless it was started with @code{--disable-deduplication}
2117 (@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
2118 this option is primarily useful when the daemon was running with
2119 @code{--disable-deduplication}.
2120
2121 @end table
2122
2123 @node Invoking guix pull
2124 @section Invoking @command{guix pull}
2125
2126 Packages are installed or upgraded to the latest version available in
2127 the distribution currently available on your local machine. To update
2128 that distribution, along with the Guix tools, you must run @command{guix
2129 pull}: the command downloads the latest Guix source code and package
2130 descriptions, and deploys it.
2131
2132 On completion, @command{guix package} will use packages and package
2133 versions from this just-retrieved copy of Guix. Not only that, but all
2134 the Guix commands and Scheme modules will also be taken from that latest
2135 version. New @command{guix} sub-commands added by the update also
2136 become available.
2137
2138 Any user can update their Guix copy using @command{guix pull}, and the
2139 effect is limited to the user who run @command{guix pull}. For
2140 instance, when user @code{root} runs @command{guix pull}, this has no
2141 effect on the version of Guix that user @code{alice} sees, and vice
2142 versa@footnote{Under the hood, @command{guix pull} updates the
2143 @file{~/.config/guix/latest} symbolic link to point to the latest Guix,
2144 and the @command{guix} command loads code from there.}.
2145
2146 The @command{guix pull} command is usually invoked with no arguments,
2147 but it supports the following options:
2148
2149 @table @code
2150 @item --verbose
2151 Produce verbose output, writing build logs to the standard error output.
2152
2153 @item --url=@var{url}
2154 Download the source tarball of Guix from @var{url}.
2155
2156 By default, the tarball is taken from its canonical address at
2157 @code{gnu.org}, for the stable branch of Guix.
2158
2159 @item --bootstrap
2160 Use the bootstrap Guile to build the latest Guix. This option is only
2161 useful to Guix developers.
2162 @end table
2163
2164
2165 @node Invoking guix archive
2166 @section Invoking @command{guix archive}
2167
2168 The @command{guix archive} command allows users to @dfn{export} files
2169 from the store into a single archive, and to later @dfn{import} them.
2170 In particular, it allows store files to be transferred from one machine
2171 to the store on another machine.
2172
2173 To export store files as an archive to standard output, run:
2174
2175 @example
2176 guix archive --export @var{options} @var{specifications}...
2177 @end example
2178
2179 @var{specifications} may be either store file names or package
2180 specifications, as for @command{guix package} (@pxref{Invoking guix
2181 package}). For instance, the following command creates an archive
2182 containing the @code{gui} output of the @code{git} package and the main
2183 output of @code{emacs}:
2184
2185 @example
2186 guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
2187 @end example
2188
2189 If the specified packages are not built yet, @command{guix archive}
2190 automatically builds them. The build process may be controlled with the
2191 common build options (@pxref{Common Build Options}).
2192
2193 To transfer the @code{emacs} package to a machine connected over SSH,
2194 one would run:
2195
2196 @example
2197 guix archive --export -r emacs | ssh the-machine guix archive --import
2198 @end example
2199
2200 @noindent
2201 Similarly, a complete user profile may be transferred from one machine
2202 to another like this:
2203
2204 @example
2205 guix archive --export -r $(readlink -f ~/.guix-profile) | \
2206 ssh the-machine guix-archive --import
2207 @end example
2208
2209 @noindent
2210 However, note that, in both examples, all of @code{emacs} and the
2211 profile as well as all of their dependencies are transferred (due to
2212 @code{-r}), regardless of what is already available in the store on the
2213 target machine. The @code{--missing} option can help figure out which
2214 items are missing from the target store.
2215
2216 Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
2217 comparable in spirit to `tar', but with a few noteworthy differences
2218 that make it more appropriate for our purposes. First, rather than
2219 recording all Unix metadata for each file, the Nar format only mentions
2220 the file type (regular, directory, or symbolic link); Unix permissions
2221 and owner/group are dismissed. Second, the order in which directory
2222 entries are stored always follows the order of file names according to
2223 the C locale collation order. This makes archive production fully
2224 deterministic.
2225
2226 When exporting, the daemon digitally signs the contents of the archive,
2227 and that digital signature is appended. When importing, the daemon
2228 verifies the signature and rejects the import in case of an invalid
2229 signature or if the signing key is not authorized.
2230 @c FIXME: Add xref to daemon doc about signatures.
2231
2232 The main options are:
2233
2234 @table @code
2235 @item --export
2236 Export the specified store files or packages (see below.) Write the
2237 resulting archive to the standard output.
2238
2239 Dependencies are @emph{not} included in the output, unless
2240 @code{--recursive} is passed.
2241
2242 @item -r
2243 @itemx --recursive
2244 When combined with @code{--export}, this instructs @command{guix
2245 archive} to include dependencies of the given items in the archive.
2246 Thus, the resulting archive is self-contained: it contains the closure
2247 of the exported store items.
2248
2249 @item --import
2250 Read an archive from the standard input, and import the files listed
2251 therein into the store. Abort if the archive has an invalid digital
2252 signature, or if it is signed by a public key not among the authorized
2253 keys (see @code{--authorize} below.)
2254
2255 @item --missing
2256 Read a list of store file names from the standard input, one per line,
2257 and write on the standard output the subset of these files missing from
2258 the store.
2259
2260 @item --generate-key[=@var{parameters}]
2261 @cindex signing, archives
2262 Generate a new key pair for the daemon. This is a prerequisite before
2263 archives can be exported with @code{--export}. Note that this operation
2264 usually takes time, because it needs to gather enough entropy to
2265 generate the key pair.
2266
2267 The generated key pair is typically stored under @file{/etc/guix}, in
2268 @file{signing-key.pub} (public key) and @file{signing-key.sec} (private
2269 key, which must be kept secret.) When @var{parameters} is omitted,
2270 an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
2271 versions before 1.6.0, it is a 4096-bit RSA key.
2272 Alternatively, @var{parameters} can specify
2273 @code{genkey} parameters suitable for Libgcrypt (@pxref{General
2274 public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
2275 Libgcrypt Reference Manual}).
2276
2277 @item --authorize
2278 @cindex authorizing, archives
2279 Authorize imports signed by the public key passed on standard input.
2280 The public key must be in ``s-expression advanced format''---i.e., the
2281 same format as the @file{signing-key.pub} file.
2282
2283 The list of authorized keys is kept in the human-editable file
2284 @file{/etc/guix/acl}. The file contains
2285 @url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
2286 s-expressions''} and is structured as an access-control list in the
2287 @url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
2288 (SPKI)}.
2289
2290 @item --extract=@var{directory}
2291 @itemx -x @var{directory}
2292 Read a single-item archive as served by substitute servers
2293 (@pxref{Substitutes}) and extract it to @var{directory}. This is a
2294 low-level operation needed in only very narrow use cases; see below.
2295
2296 For example, the following command extracts the substitute for Emacs
2297 served by @code{hydra.gnu.org} to @file{/tmp/emacs}:
2298
2299 @example
2300 $ wget -O - \
2301 https://hydra.gnu.org/nar/@dots{}-emacs-24.5 \
2302 | bunzip2 | guix archive -x /tmp/emacs
2303 @end example
2304
2305 Single-item archives are different from multiple-item archives produced
2306 by @command{guix archive --export}; they contain a single store item,
2307 and they do @emph{not} embed a signature. Thus this operation does
2308 @emph{no} signature verification and its output should be considered
2309 unsafe.
2310
2311 The primary purpose of this operation is to facilitate inspection of
2312 archive contents coming from possibly untrusted substitute servers.
2313
2314 @end table
2315
2316 @c *********************************************************************
2317 @include emacs.texi
2318
2319 @c *********************************************************************
2320 @node Programming Interface
2321 @chapter Programming Interface
2322
2323 GNU Guix provides several Scheme programming interfaces (APIs) to
2324 define, build, and query packages. The first interface allows users to
2325 write high-level package definitions. These definitions refer to
2326 familiar packaging concepts, such as the name and version of a package,
2327 its build system, and its dependencies. These definitions can then be
2328 turned into concrete build actions.
2329
2330 Build actions are performed by the Guix daemon, on behalf of users. In a
2331 standard setup, the daemon has write access to the store---the
2332 @file{/gnu/store} directory---whereas users do not. The recommended
2333 setup also has the daemon perform builds in chroots, under a specific
2334 build users, to minimize interference with the rest of the system.
2335
2336 @cindex derivation
2337 Lower-level APIs are available to interact with the daemon and the
2338 store. To instruct the daemon to perform a build action, users actually
2339 provide it with a @dfn{derivation}. A derivation is a low-level
2340 representation of the build actions to be taken, and the environment in
2341 which they should occur---derivations are to package definitions what
2342 assembly is to C programs. The term ``derivation'' comes from the fact
2343 that build results @emph{derive} from them.
2344
2345 This chapter describes all these APIs in turn, starting from high-level
2346 package definitions.
2347
2348 @menu
2349 * Defining Packages:: Defining new packages.
2350 * Build Systems:: Specifying how packages are built.
2351 * The Store:: Manipulating the package store.
2352 * Derivations:: Low-level interface to package derivations.
2353 * The Store Monad:: Purely functional interface to the store.
2354 * G-Expressions:: Manipulating build expressions.
2355 @end menu
2356
2357 @node Defining Packages
2358 @section Defining Packages
2359
2360 The high-level interface to package definitions is implemented in the
2361 @code{(guix packages)} and @code{(guix build-system)} modules. As an
2362 example, the package definition, or @dfn{recipe}, for the GNU Hello
2363 package looks like this:
2364
2365 @example
2366 (define-module (gnu packages hello)
2367 #:use-module (guix packages)
2368 #:use-module (guix download)
2369 #:use-module (guix build-system gnu)
2370 #:use-module (guix licenses)
2371 #:use-module (gnu packages gawk))
2372
2373 (define-public hello
2374 (package
2375 (name "hello")
2376 (version "2.10")
2377 (source (origin
2378 (method url-fetch)
2379 (uri (string-append "mirror://gnu/hello/hello-" version
2380 ".tar.gz"))
2381 (sha256
2382 (base32
2383 "0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i"))))
2384 (build-system gnu-build-system)
2385 (arguments `(#:configure-flags '("--enable-silent-rules")))
2386 (inputs `(("gawk" ,gawk)))
2387 (synopsis "Hello, GNU world: An example GNU package")
2388 (description "Guess what GNU Hello prints!")
2389 (home-page "http://www.gnu.org/software/hello/")
2390 (license gpl3+)))
2391 @end example
2392
2393 @noindent
2394 Without being a Scheme expert, the reader may have guessed the meaning
2395 of the various fields here. This expression binds the variable
2396 @code{hello} to a @code{<package>} object, which is essentially a record
2397 (@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
2398 This package object can be inspected using procedures found in the
2399 @code{(guix packages)} module; for instance, @code{(package-name hello)}
2400 returns---surprise!---@code{"hello"}.
2401
2402 With luck, you may be able to import part or all of the definition of
2403 the package you are interested in from another repository, using the
2404 @code{guix import} command (@pxref{Invoking guix import}).
2405
2406 In the example above, @var{hello} is defined in a module of its own,
2407 @code{(gnu packages hello)}. Technically, this is not strictly
2408 necessary, but it is convenient to do so: all the packages defined in
2409 modules under @code{(gnu packages @dots{})} are automatically known to
2410 the command-line tools (@pxref{Package Modules}).
2411
2412 There are a few points worth noting in the above package definition:
2413
2414 @itemize
2415 @item
2416 The @code{source} field of the package is an @code{<origin>} object
2417 (@pxref{origin Reference}, for the complete reference).
2418 Here, the @code{url-fetch} method from @code{(guix download)} is used,
2419 meaning that the source is a file to be downloaded over FTP or HTTP.
2420
2421 The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
2422 the GNU mirrors defined in @code{(guix download)}.
2423
2424 The @code{sha256} field specifies the expected SHA256 hash of the file
2425 being downloaded. It is mandatory, and allows Guix to check the
2426 integrity of the file. The @code{(base32 @dots{})} form introduces the
2427 base32 representation of the hash. You can obtain this information with
2428 @code{guix download} (@pxref{Invoking guix download}) and @code{guix
2429 hash} (@pxref{Invoking guix hash}).
2430
2431 @cindex patches
2432 When needed, the @code{origin} form can also have a @code{patches} field
2433 listing patches to be applied, and a @code{snippet} field giving a
2434 Scheme expression to modify the source code.
2435
2436 @item
2437 @cindex GNU Build System
2438 The @code{build-system} field specifies the procedure to build the
2439 package (@pxref{Build Systems}). Here, @var{gnu-build-system}
2440 represents the familiar GNU Build System, where packages may be
2441 configured, built, and installed with the usual @code{./configure &&
2442 make && make check && make install} command sequence.
2443
2444 @item
2445 The @code{arguments} field specifies options for the build system
2446 (@pxref{Build Systems}). Here it is interpreted by
2447 @var{gnu-build-system} as a request run @file{configure} with the
2448 @code{--enable-silent-rules} flag.
2449
2450 @item
2451 The @code{inputs} field specifies inputs to the build process---i.e.,
2452 build-time or run-time dependencies of the package. Here, we define an
2453 input called @code{"gawk"} whose value is that of the @var{gawk}
2454 variable; @var{gawk} is itself bound to a @code{<package>} object.
2455
2456 Note that GCC, Coreutils, Bash, and other essential tools do not need to
2457 be specified as inputs here. Instead, @var{gnu-build-system} takes care
2458 of ensuring that they are present (@pxref{Build Systems}).
2459
2460 However, any other dependencies need to be specified in the
2461 @code{inputs} field. Any dependency not specified here will simply be
2462 unavailable to the build process, possibly leading to a build failure.
2463 @end itemize
2464
2465 @xref{package Reference}, for a full description of possible fields.
2466
2467 Once a package definition is in place, the
2468 package may actually be built using the @code{guix build} command-line
2469 tool (@pxref{Invoking guix build}). You can easily jump back to the
2470 package definition using the @command{guix edit} command
2471 (@pxref{Invoking guix edit}).
2472 @xref{Packaging Guidelines}, for
2473 more information on how to test package definitions, and
2474 @ref{Invoking guix lint}, for information on how to check a definition
2475 for style conformance.
2476
2477 Finally, updating the package definition to a new upstream version
2478 can be partly automated by the @command{guix refresh} command
2479 (@pxref{Invoking guix refresh}).
2480
2481 Behind the scenes, a derivation corresponding to the @code{<package>}
2482 object is first computed by the @code{package-derivation} procedure.
2483 That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
2484 The build actions it prescribes may then be realized by using the
2485 @code{build-derivations} procedure (@pxref{The Store}).
2486
2487 @deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
2488 Return the @code{<derivation>} object of @var{package} for @var{system}
2489 (@pxref{Derivations}).
2490
2491 @var{package} must be a valid @code{<package>} object, and @var{system}
2492 must be a string denoting the target system type---e.g.,
2493 @code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
2494 must be a connection to the daemon, which operates on the store
2495 (@pxref{The Store}).
2496 @end deffn
2497
2498 @noindent
2499 @cindex cross-compilation
2500 Similarly, it is possible to compute a derivation that cross-builds a
2501 package for some other system:
2502
2503 @deffn {Scheme Procedure} package-cross-derivation @var{store} @
2504 @var{package} @var{target} [@var{system}]
2505 Return the @code{<derivation>} object of @var{package} cross-built from
2506 @var{system} to @var{target}.
2507
2508 @var{target} must be a valid GNU triplet denoting the target hardware
2509 and operating system, such as @code{"mips64el-linux-gnu"}
2510 (@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
2511 Configure and Build System}).
2512 @end deffn
2513
2514 @menu
2515 * package Reference :: The package data type.
2516 * origin Reference:: The origin data type.
2517 @end menu
2518
2519
2520 @node package Reference
2521 @subsection @code{package} Reference
2522
2523 This section summarizes all the options available in @code{package}
2524 declarations (@pxref{Defining Packages}).
2525
2526 @deftp {Data Type} package
2527 This is the data type representing a package recipe.
2528
2529 @table @asis
2530 @item @code{name}
2531 The name of the package, as a string.
2532
2533 @item @code{version}
2534 The version of the package, as a string.
2535
2536 @item @code{source}
2537 An object telling how the source code for the package should be
2538 acquired. Most of the time, this is an @code{origin} object, which
2539 denotes a file fetched from the Internet (@pxref{origin Reference}). It
2540 can also be any other ``file-like'' object such as a @code{local-file},
2541 which denotes a file from the local file system (@pxref{G-Expressions,
2542 @code{local-file}}).
2543
2544 @item @code{build-system}
2545 The build system that should be used to build the package (@pxref{Build
2546 Systems}).
2547
2548 @item @code{arguments} (default: @code{'()})
2549 The arguments that should be passed to the build system. This is a
2550 list, typically containing sequential keyword-value pairs.
2551
2552 @item @code{inputs} (default: @code{'()})
2553 @itemx @code{native-inputs} (default: @code{'()})
2554 @itemx @code{propagated-inputs} (default: @code{'()})
2555 @cindex inputs, of packages
2556 These fields list dependencies of the package. Each one is a list of
2557 tuples, where each tuple has a label for the input (a string) as its
2558 first element, a package, origin, or derivation as its second element,
2559 and optionally the name of the output thereof that should be used, which
2560 defaults to @code{"out"} (@pxref{Packages with Multiple Outputs}, for
2561 more on package outputs). For example, the list below specifies three
2562 inputs:
2563
2564 @example
2565 `(("libffi" ,libffi)
2566 ("libunistring" ,libunistring)
2567 ("glib:bin" ,glib "bin")) ;the "bin" output of Glib
2568 @end example
2569
2570 @cindex cross compilation, package dependencies
2571 The distinction between @code{native-inputs} and @code{inputs} is
2572 necessary when considering cross-compilation. When cross-compiling,
2573 dependencies listed in @code{inputs} are built for the @emph{target}
2574 architecture; conversely, dependencies listed in @code{native-inputs}
2575 are built for the architecture of the @emph{build} machine.
2576
2577 @code{native-inputs} is typically used to list tools needed at
2578 build time, but not at run time, such as Autoconf, Automake, pkg-config,
2579 Gettext, or Bison. @command{guix lint} can report likely mistakes in
2580 this area (@pxref{Invoking guix lint}).
2581
2582 @anchor{package-propagated-inputs}
2583 Lastly, @code{propagated-inputs} is similar to @code{inputs}, but the
2584 specified packages will be automatically installed alongside the package
2585 they belong to (@pxref{package-cmd-propagated-inputs, @command{guix
2586 package}}, for information on how @command{guix package} deals with
2587 propagated inputs.)
2588
2589 For example this is necessary when a C/C++ library needs headers of
2590 another library to compile, or when a pkg-config file refers to another
2591 one @i{via} its @code{Requires} field.
2592
2593 Another example where @code{propagated-inputs} is useful is for languages
2594 that lack a facility to record the run-time search path akin to the
2595 @code{RUNPATH} of ELF files; this includes Guile, Python, Perl, GHC, and
2596 more. To ensure that libraries written in those languages can find
2597 library code they depend on at run time, run-time dependencies must be
2598 listed in @code{propagated-inputs} rather than @code{inputs}.
2599
2600 @item @code{self-native-input?} (default: @code{#f})
2601 This is a Boolean field telling whether the package should use itself as
2602 a native input when cross-compiling.
2603
2604 @item @code{outputs} (default: @code{'("out")})
2605 The list of output names of the package. @xref{Packages with Multiple
2606 Outputs}, for typical uses of additional outputs.
2607
2608 @item @code{native-search-paths} (default: @code{'()})
2609 @itemx @code{search-paths} (default: @code{'()})
2610 A list of @code{search-path-specification} objects describing
2611 search-path environment variables honored by the package.
2612
2613 @item @code{replacement} (default: @code{#f})
2614 This must be either @code{#f} or a package object that will be used as a
2615 @dfn{replacement} for this package. @xref{Security Updates, grafts},
2616 for details.
2617
2618 @item @code{synopsis}
2619 A one-line description of the package.
2620
2621 @item @code{description}
2622 A more elaborate description of the package.
2623
2624 @item @code{license}
2625 The license of the package; a value from @code{(guix licenses)},
2626 or a list of such values.
2627
2628 @item @code{home-page}
2629 The URL to the home-page of the package, as a string.
2630
2631 @item @code{supported-systems} (default: @var{%supported-systems})
2632 The list of systems supported by the package, as strings of the form
2633 @code{architecture-kernel}, for example @code{"x86_64-linux"}.
2634
2635 @item @code{maintainers} (default: @code{'()})
2636 The list of maintainers of the package, as @code{maintainer} objects.
2637
2638 @item @code{location} (default: source location of the @code{package} form)
2639 The source location of the package. It is useful to override this when
2640 inheriting from another package, in which case this field is not
2641 automatically corrected.
2642 @end table
2643 @end deftp
2644
2645
2646 @node origin Reference
2647 @subsection @code{origin} Reference
2648
2649 This section summarizes all the options available in @code{origin}
2650 declarations (@pxref{Defining Packages}).
2651
2652 @deftp {Data Type} origin
2653 This is the data type representing a source code origin.
2654
2655 @table @asis
2656 @item @code{uri}
2657 An object containing the URI of the source. The object type depends on
2658 the @code{method} (see below). For example, when using the
2659 @var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
2660 values are: a URL represented as a string, or a list thereof.
2661
2662 @item @code{method}
2663 A procedure that handles the URI.
2664
2665 Examples include:
2666
2667 @table @asis
2668 @item @var{url-fetch} from @code{(guix download)}
2669 download a file from the HTTP, HTTPS, or FTP URL specified in the
2670 @code{uri} field;
2671
2672 @item @var{git-fetch} from @code{(guix git-download)}
2673 clone the Git version control repository, and check out the revision
2674 specified in the @code{uri} field as a @code{git-reference} object; a
2675 @code{git-reference} looks like this:
2676
2677 @example
2678 (git-reference
2679 (url "git://git.debian.org/git/pkg-shadow/shadow")
2680 (commit "v4.1.5.1"))
2681 @end example
2682 @end table
2683
2684 @item @code{sha256}
2685 A bytevector containing the SHA-256 hash of the source. Typically the
2686 @code{base32} form is used here to generate the bytevector from a
2687 base-32 string.
2688
2689 @item @code{file-name} (default: @code{#f})
2690 The file name under which the source code should be saved. When this is
2691 @code{#f}, a sensible default value will be used in most cases. In case
2692 the source is fetched from a URL, the file name from the URL will be
2693 used. For version control checkouts, it is recommended to provide the
2694 file name explicitly because the default is not very descriptive.
2695
2696 @item @code{patches} (default: @code{'()})
2697 A list of file names containing patches to be applied to the source.
2698
2699 @item @code{snippet} (default: @code{#f})
2700 A quoted piece of code that will be run in the source directory to make
2701 any modifications, which is sometimes more convenient than a patch.
2702
2703 @item @code{patch-flags} (default: @code{'("-p1")})
2704 A list of command-line flags that should be passed to the @code{patch}
2705 command.
2706
2707 @item @code{patch-inputs} (default: @code{#f})
2708 Input packages or derivations to the patching process. When this is
2709 @code{#f}, the usual set of inputs necessary for patching are provided,
2710 such as GNU@tie{}Patch.
2711
2712 @item @code{modules} (default: @code{'()})
2713 A list of Guile modules that should be loaded during the patching
2714 process and while running the code in the @code{snippet} field.
2715
2716 @item @code{imported-modules} (default: @code{'()})
2717 The list of Guile modules to import in the patch derivation, for use by
2718 the @code{snippet}.
2719
2720 @item @code{patch-guile} (default: @code{#f})
2721 The Guile package that should be used in the patching process. When
2722 this is @code{#f}, a sensible default is used.
2723 @end table
2724 @end deftp
2725
2726
2727 @node Build Systems
2728 @section Build Systems
2729
2730 @cindex build system
2731 Each package definition specifies a @dfn{build system} and arguments for
2732 that build system (@pxref{Defining Packages}). This @code{build-system}
2733 field represents the build procedure of the package, as well as implicit
2734 dependencies of that build procedure.
2735
2736 Build systems are @code{<build-system>} objects. The interface to
2737 create and manipulate them is provided by the @code{(guix build-system)}
2738 module, and actual build systems are exported by specific modules.
2739
2740 @cindex bag (low-level package representation)
2741 Under the hood, build systems first compile package objects to
2742 @dfn{bags}. A @dfn{bag} is like a package, but with less
2743 ornamentation---in other words, a bag is a lower-level representation of
2744 a package, which includes all the inputs of that package, including some
2745 that were implicitly added by the build system. This intermediate
2746 representation is then compiled to a derivation (@pxref{Derivations}).
2747
2748 Build systems accept an optional list of @dfn{arguments}. In package
2749 definitions, these are passed @i{via} the @code{arguments} field
2750 (@pxref{Defining Packages}). They are typically keyword arguments
2751 (@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2752 Guile Reference Manual}). The value of these arguments is usually
2753 evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2754 by the daemon (@pxref{Derivations}).
2755
2756 The main build system is @var{gnu-build-system}, which implements the
2757 standard build procedure for GNU and many other packages. It
2758 is provided by the @code{(guix build-system gnu)} module.
2759
2760 @defvr {Scheme Variable} gnu-build-system
2761 @var{gnu-build-system} represents the GNU Build System, and variants
2762 thereof (@pxref{Configuration, configuration and makefile conventions,,
2763 standards, GNU Coding Standards}).
2764
2765 @cindex build phases
2766 In a nutshell, packages using it are configured, built, and installed with
2767 the usual @code{./configure && make && make check && make install}
2768 command sequence. In practice, a few additional steps are often needed.
2769 All these steps are split up in separate @dfn{phases},
2770 notably@footnote{Please see the @code{(guix build gnu-build-system)}
2771 modules for more details about the build phases.}:
2772
2773 @table @code
2774 @item unpack
2775 Unpack the source tarball, and change the current directory to the
2776 extracted source tree. If the source is actually a directory, copy it
2777 to the build tree, and enter that directory.
2778
2779 @item patch-source-shebangs
2780 Patch shebangs encountered in source files so they refer to the right
2781 store file names. For instance, this changes @code{#!/bin/sh} to
2782 @code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2783
2784 @item configure
2785 Run the @file{configure} script with a number of default options, such
2786 as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2787 by the @code{#:configure-flags} argument.
2788
2789 @item build
2790 Run @code{make} with the list of flags specified with
2791 @code{#:make-flags}. If the @code{#:parallel-build?} argument is true
2792 (the default), build with @code{make -j}.
2793
2794 @item check
2795 Run @code{make check}, or some other target specified with
2796 @code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2797 @code{#:parallel-tests?} argument is true (the default), run @code{make
2798 check -j}.
2799
2800 @item install
2801 Run @code{make install} with the flags listed in @code{#:make-flags}.
2802
2803 @item patch-shebangs
2804 Patch shebangs on the installed executable files.
2805
2806 @item strip
2807 Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2808 is false), copying them to the @code{debug} output when available
2809 (@pxref{Installing Debugging Files}).
2810 @end table
2811
2812 @vindex %standard-phases
2813 The build-side module @code{(guix build gnu-build-system)} defines
2814 @var{%standard-phases} as the default list of build phases.
2815 @var{%standard-phases} is a list of symbol/procedure pairs, where the
2816 procedure implements the actual phase.
2817
2818 The list of phases used for a particular package can be changed with the
2819 @code{#:phases} parameter. For instance, passing:
2820
2821 @example
2822 #:phases (modify-phases %standard-phases (delete 'configure))
2823 @end example
2824
2825 means that all the phases described above will be used, except the
2826 @code{configure} phase.
2827
2828 In addition, this build system ensures that the ``standard'' environment
2829 for GNU packages is available. This includes tools such as GCC, libc,
2830 Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2831 build-system gnu)} module for a complete list). We call these the
2832 @dfn{implicit inputs} of a package, because package definitions do not
2833 have to mention them.
2834 @end defvr
2835
2836 Other @code{<build-system>} objects are defined to support other
2837 conventions and tools used by free software packages. They inherit most
2838 of @var{gnu-build-system}, and differ mainly in the set of inputs
2839 implicitly added to the build process, and in the list of phases
2840 executed. Some of these build systems are listed below.
2841
2842 @defvr {Scheme Variable} ant-build-system
2843 This variable is exported by @code{(guix build-system ant)}. It
2844 implements the build procedure for Java packages that can be built with
2845 @url{http://ant.apache.org/, Ant build tool}.
2846
2847 It adds both @code{ant} and the @dfn{Java Development Kit} (JDK) as
2848 provided by the @code{icedtea} package to the set of inputs. Different
2849 packages can be specified with the @code{#:ant} and @code{#:jdk}
2850 parameters, respectively.
2851
2852 When the original package does not provide a suitable Ant build file,
2853 the parameter @code{#:jar-name} can be used to generate a minimal Ant
2854 build file @file{build.xml} with tasks to build the specified jar
2855 archive.
2856
2857 The parameter @code{#:build-target} can be used to specify the Ant task
2858 that should be run during the @code{build} phase. By default the
2859 ``jar'' task will be run.
2860
2861 @end defvr
2862
2863 @defvr {Scheme Variable} cmake-build-system
2864 This variable is exported by @code{(guix build-system cmake)}. It
2865 implements the build procedure for packages using the
2866 @url{http://www.cmake.org, CMake build tool}.
2867
2868 It automatically adds the @code{cmake} package to the set of inputs.
2869 Which package is used can be specified with the @code{#:cmake}
2870 parameter.
2871
2872 The @code{#:configure-flags} parameter is taken as a list of flags
2873 passed to the @command{cmake} command. The @code{#:build-type}
2874 parameter specifies in abstract terms the flags passed to the compiler;
2875 it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2876 debugging information''), which roughly means that code is compiled with
2877 @code{-O2 -g}, as is the case for Autoconf-based packages by default.
2878 @end defvr
2879
2880 @defvr {Scheme Variable} glib-or-gtk-build-system
2881 This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2882 is intended for use with packages making use of GLib or GTK+.
2883
2884 This build system adds the following two phases to the ones defined by
2885 @var{gnu-build-system}:
2886
2887 @table @code
2888 @item glib-or-gtk-wrap
2889 The phase @code{glib-or-gtk-wrap} ensures that programs in
2890 @file{bin/} are able to find GLib ``schemas'' and
2891 @uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2892 modules}. This is achieved by wrapping the programs in launch scripts
2893 that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2894 environment variables.
2895
2896 It is possible to exclude specific package outputs from that wrapping
2897 process by listing their names in the
2898 @code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
2899 when an output is known not to contain any GLib or GTK+ binaries, and
2900 where wrapping would gratuitously add a dependency of that output on
2901 GLib and GTK+.
2902
2903 @item glib-or-gtk-compile-schemas
2904 The phase @code{glib-or-gtk-compile-schemas} makes sure that all
2905 @uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
2906 GSettings schemas} of GLib are compiled. Compilation is performed by the
2907 @command{glib-compile-schemas} program. It is provided by the package
2908 @code{glib:bin} which is automatically imported by the build system.
2909 The @code{glib} package providing @command{glib-compile-schemas} can be
2910 specified with the @code{#:glib} parameter.
2911 @end table
2912
2913 Both phases are executed after the @code{install} phase.
2914 @end defvr
2915
2916 @defvr {Scheme Variable} python-build-system
2917 This variable is exported by @code{(guix build-system python)}. It
2918 implements the more or less standard build procedure used by Python
2919 packages, which consists in running @code{python setup.py build} and
2920 then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
2921
2922 For packages that install stand-alone Python programs under @code{bin/},
2923 it takes care of wrapping these programs so that their @code{PYTHONPATH}
2924 environment variable points to all the Python libraries they depend on.
2925
2926 Which Python package is used to perform the build can be specified with
2927 the @code{#:python} parameter. This is a useful way to force a package
2928 to be built for a specific version of the Python interpreter, which
2929 might be necessary if the package is only compatible with a single
2930 interpreter version.
2931 @end defvr
2932
2933 @defvr {Scheme Variable} perl-build-system
2934 This variable is exported by @code{(guix build-system perl)}. It
2935 implements the standard build procedure for Perl packages, which either
2936 consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
2937 followed by @code{Build} and @code{Build install}; or in running
2938 @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
2939 @code{make} and @code{make install}, depending on which of
2940 @code{Build.PL} or @code{Makefile.PL} is present in the package
2941 distribution. Preference is given to the former if both @code{Build.PL}
2942 and @code{Makefile.PL} exist in the package distribution. This
2943 preference can be reversed by specifying @code{#t} for the
2944 @code{#:make-maker?} parameter.
2945
2946 The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
2947 passes flags specified by the @code{#:make-maker-flags} or
2948 @code{#:module-build-flags} parameter, respectively.
2949
2950 Which Perl package is used can be specified with @code{#:perl}.
2951 @end defvr
2952
2953 @defvr {Scheme Variable} r-build-system
2954 This variable is exported by @code{(guix build-system r)}. It
2955 implements the build procedure used by @uref{http://r-project.org, R}
2956 packages, which essentially is little more than running @code{R CMD
2957 INSTALL --library=/gnu/store/@dots{}} in an environment where
2958 @code{R_LIBS_SITE} contains the paths to all R package inputs. Tests
2959 are run after installation using the R function
2960 @code{tools::testInstalledPackage}.
2961 @end defvr
2962
2963 @defvr {Scheme Variable} ruby-build-system
2964 This variable is exported by @code{(guix build-system ruby)}. It
2965 implements the RubyGems build procedure used by Ruby packages, which
2966 involves running @code{gem build} followed by @code{gem install}.
2967
2968 The @code{source} field of a package that uses this build system
2969 typically references a gem archive, since this is the format that Ruby
2970 developers use when releasing their software. The build system unpacks
2971 the gem archive, potentially patches the source, runs the test suite,
2972 repackages the gem, and installs it. Additionally, directories and
2973 tarballs may be referenced to allow building unreleased gems from Git or
2974 a traditional source release tarball.
2975
2976 Which Ruby package is used can be specified with the @code{#:ruby}
2977 parameter. A list of additional flags to be passed to the @command{gem}
2978 command can be specified with the @code{#:gem-flags} parameter.
2979 @end defvr
2980
2981 @defvr {Scheme Variable} waf-build-system
2982 This variable is exported by @code{(guix build-system waf)}. It
2983 implements a build procedure around the @code{waf} script. The common
2984 phases---@code{configure}, @code{build}, and @code{install}---are
2985 implemented by passing their names as arguments to the @code{waf}
2986 script.
2987
2988 The @code{waf} script is executed by the Python interpreter. Which
2989 Python package is used to run the script can be specified with the
2990 @code{#:python} parameter.
2991 @end defvr
2992
2993 @defvr {Scheme Variable} haskell-build-system
2994 This variable is exported by @code{(guix build-system haskell)}. It
2995 implements the Cabal build procedure used by Haskell packages, which
2996 involves running @code{runhaskell Setup.hs configure
2997 --prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
2998 Instead of installing the package by running @code{runhaskell Setup.hs
2999 install}, to avoid trying to register libraries in the read-only
3000 compiler store directory, the build system uses @code{runhaskell
3001 Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
3002 addition, the build system generates the package documentation by
3003 running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
3004 is passed. Optional Haddock parameters can be passed with the help of
3005 the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
3006 not found, the build system looks for @code{Setup.lhs} instead.
3007
3008 Which Haskell compiler is used can be specified with the @code{#:haskell}
3009 parameter which defaults to @code{ghc}.
3010 @end defvr
3011
3012 @defvr {Scheme Variable} emacs-build-system
3013 This variable is exported by @code{(guix build-system emacs)}. It
3014 implements an installation procedure similar to the packaging system
3015 of Emacs itself (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
3016
3017 It first creates the @code{@var{package}-autoloads.el} file, then it
3018 byte compiles all Emacs Lisp files. Differently from the Emacs
3019 packaging system, the Info documentation files are moved to the standard
3020 documentation directory and the @file{dir} file is deleted. Each
3021 package is installed in its own directory under
3022 @file{share/emacs/site-lisp/guix.d}.
3023 @end defvr
3024
3025 Lastly, for packages that do not need anything as sophisticated, a
3026 ``trivial'' build system is provided. It is trivial in the sense that
3027 it provides basically no support: it does not pull any implicit inputs,
3028 and does not have a notion of build phases.
3029
3030 @defvr {Scheme Variable} trivial-build-system
3031 This variable is exported by @code{(guix build-system trivial)}.
3032
3033 This build system requires a @code{#:builder} argument. This argument
3034 must be a Scheme expression that builds the package output(s)---as
3035 with @code{build-expression->derivation} (@pxref{Derivations,
3036 @code{build-expression->derivation}}).
3037 @end defvr
3038
3039 @node The Store
3040 @section The Store
3041
3042 @cindex store
3043 @cindex store items
3044 @cindex store paths
3045
3046 Conceptually, the @dfn{store} is the place where derivations that have
3047 been built successfully are stored---by default, @file{/gnu/store}.
3048 Sub-directories in the store are referred to as @dfn{store items} or
3049 sometimes @dfn{store paths}. The store has an associated database that
3050 contains information such as the store paths referred to by each store
3051 path, and the list of @emph{valid} store items---results of successful
3052 builds. This database resides in @file{@var{localstatedir}/guix/db},
3053 where @var{localstatedir} is the state directory specified @i{via}
3054 @option{--localstatedir} at configure time, usually @file{/var}.
3055
3056 The store is @emph{always} accessed by the daemon on behalf of its clients
3057 (@pxref{Invoking guix-daemon}). To manipulate the store, clients
3058 connect to the daemon over a Unix-domain socket, send requests to it,
3059 and read the result---these are remote procedure calls, or RPCs.
3060
3061 @quotation Note
3062 Users must @emph{never} modify files under @file{/gnu/store} directly.
3063 This would lead to inconsistencies and break the immutability
3064 assumptions of Guix's functional model (@pxref{Introduction}).
3065
3066 @xref{Invoking guix gc, @command{guix gc --verify}}, for information on
3067 how to check the integrity of the store and attempt recovery from
3068 accidental modifications.
3069 @end quotation
3070
3071 The @code{(guix store)} module provides procedures to connect to the
3072 daemon, and to perform RPCs. These are described below.
3073
3074 @deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
3075 Connect to the daemon over the Unix-domain socket at @var{file}. When
3076 @var{reserve-space?} is true, instruct it to reserve a little bit of
3077 extra space on the file system so that the garbage collector can still
3078 operate should the disk become full. Return a server object.
3079
3080 @var{file} defaults to @var{%default-socket-path}, which is the normal
3081 location given the options that were passed to @command{configure}.
3082 @end deffn
3083
3084 @deffn {Scheme Procedure} close-connection @var{server}
3085 Close the connection to @var{server}.
3086 @end deffn
3087
3088 @defvr {Scheme Variable} current-build-output-port
3089 This variable is bound to a SRFI-39 parameter, which refers to the port
3090 where build and error logs sent by the daemon should be written.
3091 @end defvr
3092
3093 Procedures that make RPCs all take a server object as their first
3094 argument.
3095
3096 @deffn {Scheme Procedure} valid-path? @var{server} @var{path}
3097 @cindex invalid store items
3098 Return @code{#t} when @var{path} designates a valid store item and
3099 @code{#f} otherwise (an invalid item may exist on disk but still be
3100 invalid, for instance because it is the result of an aborted or failed
3101 build.)
3102
3103 A @code{&nix-protocol-error} condition is raised if @var{path} is not
3104 prefixed by the store directory (@file{/gnu/store}).
3105 @end deffn
3106
3107 @deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
3108 Add @var{text} under file @var{name} in the store, and return its store
3109 path. @var{references} is the list of store paths referred to by the
3110 resulting store path.
3111 @end deffn
3112
3113 @deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
3114 Build @var{derivations} (a list of @code{<derivation>} objects or
3115 derivation paths), and return when the worker is done building them.
3116 Return @code{#t} on success.
3117 @end deffn
3118
3119 Note that the @code{(guix monads)} module provides a monad as well as
3120 monadic versions of the above procedures, with the goal of making it
3121 more convenient to work with code that accesses the store (@pxref{The
3122 Store Monad}).
3123
3124 @c FIXME
3125 @i{This section is currently incomplete.}
3126
3127 @node Derivations
3128 @section Derivations
3129
3130 @cindex derivations
3131 Low-level build actions and the environment in which they are performed
3132 are represented by @dfn{derivations}. A derivation contains the
3133 following pieces of information:
3134
3135 @itemize
3136 @item
3137 The outputs of the derivation---derivations produce at least one file or
3138 directory in the store, but may produce more.
3139
3140 @item
3141 The inputs of the derivations, which may be other derivations or plain
3142 files in the store (patches, build scripts, etc.)
3143
3144 @item
3145 The system type targeted by the derivation---e.g., @code{x86_64-linux}.
3146
3147 @item
3148 The file name of a build script in the store, along with the arguments
3149 to be passed.
3150
3151 @item
3152 A list of environment variables to be defined.
3153
3154 @end itemize
3155
3156 @cindex derivation path
3157 Derivations allow clients of the daemon to communicate build actions to
3158 the store. They exist in two forms: as an in-memory representation,
3159 both on the client- and daemon-side, and as files in the store whose
3160 name end in @code{.drv}---these files are referred to as @dfn{derivation
3161 paths}. Derivations paths can be passed to the @code{build-derivations}
3162 procedure to perform the build actions they prescribe (@pxref{The
3163 Store}).
3164
3165 The @code{(guix derivations)} module provides a representation of
3166 derivations as Scheme objects, along with procedures to create and
3167 otherwise manipulate derivations. The lowest-level primitive to create
3168 a derivation is the @code{derivation} procedure:
3169
3170 @deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
3171 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
3172 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
3173 [#:system (%current-system)] [#:references-graphs #f] @
3174 [#:allowed-references #f] [#:disallowed-references #f] @
3175 [#:leaked-env-vars #f] [#:local-build? #f] @
3176 [#:substitutable? #t]
3177 Build a derivation with the given arguments, and return the resulting
3178 @code{<derivation>} object.
3179
3180 When @var{hash} and @var{hash-algo} are given, a
3181 @dfn{fixed-output derivation} is created---i.e., one whose result is
3182 known in advance, such as a file download. If, in addition,
3183 @var{recursive?} is true, then that fixed output may be an executable
3184 file or a directory and @var{hash} must be the hash of an archive
3185 containing this output.
3186
3187 When @var{references-graphs} is true, it must be a list of file
3188 name/store path pairs. In that case, the reference graph of each store
3189 path is exported in the build environment in the corresponding file, in
3190 a simple text format.
3191
3192 When @var{allowed-references} is true, it must be a list of store items
3193 or outputs that the derivation's output may refer to. Likewise,
3194 @var{disallowed-references}, if true, must be a list of things the
3195 outputs may @emph{not} refer to.
3196
3197 When @var{leaked-env-vars} is true, it must be a list of strings
3198 denoting environment variables that are allowed to ``leak'' from the
3199 daemon's environment to the build environment. This is only applicable
3200 to fixed-output derivations---i.e., when @var{hash} is true. The main
3201 use is to allow variables such as @code{http_proxy} to be passed to
3202 derivations that download files.
3203
3204 When @var{local-build?} is true, declare that the derivation is not a
3205 good candidate for offloading and should rather be built locally
3206 (@pxref{Daemon Offload Setup}). This is the case for small derivations
3207 where the costs of data transfers would outweigh the benefits.
3208
3209 When @var{substitutable?} is false, declare that substitutes of the
3210 derivation's output should not be used (@pxref{Substitutes}). This is
3211 useful, for instance, when building packages that capture details of the
3212 host CPU instruction set.
3213 @end deffn
3214
3215 @noindent
3216 Here's an example with a shell script as its builder, assuming
3217 @var{store} is an open connection to the daemon, and @var{bash} points
3218 to a Bash executable in the store:
3219
3220 @lisp
3221 (use-modules (guix utils)
3222 (guix store)
3223 (guix derivations))
3224
3225 (let ((builder ; add the Bash script to the store
3226 (add-text-to-store store "my-builder.sh"
3227 "echo hello world > $out\n" '())))
3228 (derivation store "foo"
3229 bash `("-e" ,builder)
3230 #:inputs `((,bash) (,builder))
3231 #:env-vars '(("HOME" . "/homeless"))))
3232 @result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
3233 @end lisp
3234
3235 As can be guessed, this primitive is cumbersome to use directly. A
3236 better approach is to write build scripts in Scheme, of course! The
3237 best course of action for that is to write the build code as a
3238 ``G-expression'', and to pass it to @code{gexp->derivation}. For more
3239 information, @pxref{G-Expressions}.
3240
3241 Once upon a time, @code{gexp->derivation} did not exist and constructing
3242 derivations with build code written in Scheme was achieved with
3243 @code{build-expression->derivation}, documented below. This procedure
3244 is now deprecated in favor of the much nicer @code{gexp->derivation}.
3245
3246 @deffn {Scheme Procedure} build-expression->derivation @var{store} @
3247 @var{name} @var{exp} @
3248 [#:system (%current-system)] [#:inputs '()] @
3249 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
3250 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
3251 [#:references-graphs #f] [#:allowed-references #f] @
3252 [#:disallowed-references #f] @
3253 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
3254 Return a derivation that executes Scheme expression @var{exp} as a
3255 builder for derivation @var{name}. @var{inputs} must be a list of
3256 @code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
3257 @code{"out"} is assumed. @var{modules} is a list of names of Guile
3258 modules from the current search path to be copied in the store,
3259 compiled, and made available in the load path during the execution of
3260 @var{exp}---e.g., @code{((guix build utils) (guix build
3261 gnu-build-system))}.
3262
3263 @var{exp} is evaluated in an environment where @code{%outputs} is bound
3264 to a list of output/path pairs, and where @code{%build-inputs} is bound
3265 to a list of string/output-path pairs made from @var{inputs}.
3266 Optionally, @var{env-vars} is a list of string pairs specifying the name
3267 and value of environment variables visible to the builder. The builder
3268 terminates by passing the result of @var{exp} to @code{exit}; thus, when
3269 @var{exp} returns @code{#f}, the build is considered to have failed.
3270
3271 @var{exp} is built using @var{guile-for-build} (a derivation). When
3272 @var{guile-for-build} is omitted or is @code{#f}, the value of the
3273 @code{%guile-for-build} fluid is used instead.
3274
3275 See the @code{derivation} procedure for the meaning of
3276 @var{references-graphs}, @var{allowed-references},
3277 @var{disallowed-references}, @var{local-build?}, and
3278 @var{substitutable?}.
3279 @end deffn
3280
3281 @noindent
3282 Here's an example of a single-output derivation that creates a directory
3283 containing one file:
3284
3285 @lisp
3286 (let ((builder '(let ((out (assoc-ref %outputs "out")))
3287 (mkdir out) ; create /gnu/store/@dots{}-goo
3288 (call-with-output-file (string-append out "/test")
3289 (lambda (p)
3290 (display '(hello guix) p))))))
3291 (build-expression->derivation store "goo" builder))
3292
3293 @result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
3294 @end lisp
3295
3296
3297 @node The Store Monad
3298 @section The Store Monad
3299
3300 @cindex monad
3301
3302 The procedures that operate on the store described in the previous
3303 sections all take an open connection to the build daemon as their first
3304 argument. Although the underlying model is functional, they either have
3305 side effects or depend on the current state of the store.
3306
3307 The former is inconvenient: the connection to the build daemon has to be
3308 carried around in all those functions, making it impossible to compose
3309 functions that do not take that parameter with functions that do. The
3310 latter can be problematic: since store operations have side effects
3311 and/or depend on external state, they have to be properly sequenced.
3312
3313 @cindex monadic values
3314 @cindex monadic functions
3315 This is where the @code{(guix monads)} module comes in. This module
3316 provides a framework for working with @dfn{monads}, and a particularly
3317 useful monad for our uses, the @dfn{store monad}. Monads are a
3318 construct that allows two things: associating ``context'' with values
3319 (in our case, the context is the store), and building sequences of
3320 computations (here computations include accesses to the store). Values
3321 in a monad---values that carry this additional context---are called
3322 @dfn{monadic values}; procedures that return such values are called
3323 @dfn{monadic procedures}.
3324
3325 Consider this ``normal'' procedure:
3326
3327 @example
3328 (define (sh-symlink store)
3329 ;; Return a derivation that symlinks the 'bash' executable.
3330 (let* ((drv (package-derivation store bash))
3331 (out (derivation->output-path drv))
3332 (sh (string-append out "/bin/bash")))
3333 (build-expression->derivation store "sh"
3334 `(symlink ,sh %output))))
3335 @end example
3336
3337 Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
3338 as a monadic function:
3339
3340 @example
3341 (define (sh-symlink)
3342 ;; Same, but return a monadic value.
3343 (mlet %store-monad ((drv (package->derivation bash)))
3344 (gexp->derivation "sh"
3345 #~(symlink (string-append #$drv "/bin/bash")
3346 #$output))))
3347 @end example
3348
3349 There are several things to note in the second version: the @code{store}
3350 parameter is now implicit and is ``threaded'' in the calls to the
3351 @code{package->derivation} and @code{gexp->derivation} monadic
3352 procedures, and the monadic value returned by @code{package->derivation}
3353 is @dfn{bound} using @code{mlet} instead of plain @code{let}.
3354
3355 As it turns out, the call to @code{package->derivation} can even be
3356 omitted since it will take place implicitly, as we will see later
3357 (@pxref{G-Expressions}):
3358
3359 @example
3360 (define (sh-symlink)
3361 (gexp->derivation "sh"
3362 #~(symlink (string-append #$bash "/bin/bash")
3363 #$output)))
3364 @end example
3365
3366 @c See
3367 @c <https://syntaxexclamation.wordpress.com/2014/06/26/escaping-continuations/>
3368 @c for the funny quote.
3369 Calling the monadic @code{sh-symlink} has no effect. As someone once
3370 said, ``you exit a monad like you exit a building on fire: by running''.
3371 So, to exit the monad and get the desired effect, one must use
3372 @code{run-with-store}:
3373
3374 @example
3375 (run-with-store (open-connection) (sh-symlink))
3376 @result{} /gnu/store/...-sh-symlink
3377 @end example
3378
3379 Note that the @code{(guix monad-repl)} module extends the Guile REPL with
3380 new ``meta-commands'' to make it easier to deal with monadic procedures:
3381 @code{run-in-store}, and @code{enter-store-monad}. The former is used
3382 to ``run'' a single monadic value through the store:
3383
3384 @example
3385 scheme@@(guile-user)> ,run-in-store (package->derivation hello)
3386 $1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
3387 @end example
3388
3389 The latter enters a recursive REPL, where all the return values are
3390 automatically run through the store:
3391
3392 @example
3393 scheme@@(guile-user)> ,enter-store-monad
3394 store-monad@@(guile-user) [1]> (package->derivation hello)
3395 $2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
3396 store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
3397 $3 = "/gnu/store/@dots{}-foo"
3398 store-monad@@(guile-user) [1]> ,q
3399 scheme@@(guile-user)>
3400 @end example
3401
3402 @noindent
3403 Note that non-monadic values cannot be returned in the
3404 @code{store-monad} REPL.
3405
3406 The main syntactic forms to deal with monads in general are provided by
3407 the @code{(guix monads)} module and are described below.
3408
3409 @deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
3410 Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
3411 in @var{monad}.
3412 @end deffn
3413
3414 @deffn {Scheme Syntax} return @var{val}
3415 Return a monadic value that encapsulates @var{val}.
3416 @end deffn
3417
3418 @deffn {Scheme Syntax} >>= @var{mval} @var{mproc} ...
3419 @dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
3420 procedures @var{mproc}@dots{}@footnote{This operation is commonly
3421 referred to as ``bind'', but that name denotes an unrelated procedure in
3422 Guile. Thus we use this somewhat cryptic symbol inherited from the
3423 Haskell language.}. There can be one @var{mproc} or several of them, as
3424 in this example:
3425
3426 @example
3427 (run-with-state
3428 (with-monad %state-monad
3429 (>>= (return 1)
3430 (lambda (x) (return (+ 1 x)))
3431 (lambda (x) (return (* 2 x)))))
3432 'some-state)
3433
3434 @result{} 4
3435 @result{} some-state
3436 @end example
3437 @end deffn
3438
3439 @deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
3440 @var{body} ...
3441 @deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
3442 @var{body} ...
3443 Bind the variables @var{var} to the monadic values @var{mval} in
3444 @var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
3445 ``normal'' value @var{val}, as per @code{let}.
3446
3447 @code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
3448 (@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
3449 @end deffn
3450
3451 @deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
3452 Bind @var{mexp} and the following monadic expressions in sequence,
3453 returning the result of the last expression.
3454
3455 This is akin to @code{mlet}, except that the return values of the
3456 monadic expressions are ignored. In that sense, it is analogous to
3457 @code{begin}, but applied to monadic expressions.
3458 @end deffn
3459
3460 @cindex state monad
3461 The @code{(guix monads)} module provides the @dfn{state monad}, which
3462 allows an additional value---the state---to be @emph{threaded} through
3463 monadic procedure calls.
3464
3465 @defvr {Scheme Variable} %state-monad
3466 The state monad. Procedures in the state monad can access and change
3467 the state that is threaded.
3468
3469 Consider the example below. The @code{square} procedure returns a value
3470 in the state monad. It returns the square of its argument, but also
3471 increments the current state value:
3472
3473 @example
3474 (define (square x)
3475 (mlet %state-monad ((count (current-state)))
3476 (mbegin %state-monad
3477 (set-current-state (+ 1 count))
3478 (return (* x x)))))
3479
3480 (run-with-state (sequence %state-monad (map square (iota 3))) 0)
3481 @result{} (0 1 4)
3482 @result{} 3
3483 @end example
3484
3485 When ``run'' through @var{%state-monad}, we obtain that additional state
3486 value, which is the number of @code{square} calls.
3487 @end defvr
3488
3489 @deffn {Monadic Procedure} current-state
3490 Return the current state as a monadic value.
3491 @end deffn
3492
3493 @deffn {Monadic Procedure} set-current-state @var{value}
3494 Set the current state to @var{value} and return the previous state as a
3495 monadic value.
3496 @end deffn
3497
3498 @deffn {Monadic Procedure} state-push @var{value}
3499 Push @var{value} to the current state, which is assumed to be a list,
3500 and return the previous state as a monadic value.
3501 @end deffn
3502
3503 @deffn {Monadic Procedure} state-pop
3504 Pop a value from the current state and return it as a monadic value.
3505 The state is assumed to be a list.
3506 @end deffn
3507
3508 @deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
3509 Run monadic value @var{mval} starting with @var{state} as the initial
3510 state. Return two values: the resulting value, and the resulting state.
3511 @end deffn
3512
3513 The main interface to the store monad, provided by the @code{(guix
3514 store)} module, is as follows.
3515
3516 @defvr {Scheme Variable} %store-monad
3517 The store monad---an alias for @var{%state-monad}.
3518
3519 Values in the store monad encapsulate accesses to the store. When its
3520 effect is needed, a value of the store monad must be ``evaluated'' by
3521 passing it to the @code{run-with-store} procedure (see below.)
3522 @end defvr
3523
3524 @deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
3525 Run @var{mval}, a monadic value in the store monad, in @var{store}, an
3526 open store connection.
3527 @end deffn
3528
3529 @deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
3530 Return as a monadic value the absolute file name in the store of the file
3531 containing @var{text}, a string. @var{references} is a list of store items that the
3532 resulting text file refers to; it defaults to the empty list.
3533 @end deffn
3534
3535 @deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
3536 [#:recursive? #t] [#:select? (const #t)]
3537 Return the name of @var{file} once interned in the store. Use
3538 @var{name} as its store name, or the basename of @var{file} if
3539 @var{name} is omitted.
3540
3541 When @var{recursive?} is true, the contents of @var{file} are added
3542 recursively; if @var{file} designates a flat file and @var{recursive?}
3543 is true, its contents are added, and its permission bits are kept.
3544
3545 When @var{recursive?} is true, call @code{(@var{select?} @var{file}
3546 @var{stat})} for each directory entry, where @var{file} is the entry's
3547 absolute file name and @var{stat} is the result of @code{lstat}; exclude
3548 entries for which @var{select?} does not return true.
3549
3550 The example below adds a file to the store, under two different names:
3551
3552 @example
3553 (run-with-store (open-connection)
3554 (mlet %store-monad ((a (interned-file "README"))
3555 (b (interned-file "README" "LEGU-MIN")))
3556 (return (list a b))))
3557
3558 @result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
3559 @end example
3560
3561 @end deffn
3562
3563 The @code{(guix packages)} module exports the following package-related
3564 monadic procedures:
3565
3566 @deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
3567 [#:system (%current-system)] [#:target #f] @
3568 [#:output "out"]
3569 Return as a monadic
3570 value in the absolute file name of @var{file} within the @var{output}
3571 directory of @var{package}. When @var{file} is omitted, return the name
3572 of the @var{output} directory of @var{package}. When @var{target} is
3573 true, use it as a cross-compilation target triplet.
3574 @end deffn
3575
3576 @deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
3577 @deffnx {Monadic Procedure} package->cross-derivation @var{package} @
3578 @var{target} [@var{system}]
3579 Monadic version of @code{package-derivation} and
3580 @code{package-cross-derivation} (@pxref{Defining Packages}).
3581 @end deffn
3582
3583
3584 @node G-Expressions
3585 @section G-Expressions
3586
3587 @cindex G-expression
3588 @cindex build code quoting
3589 So we have ``derivations'', which represent a sequence of build actions
3590 to be performed to produce an item in the store (@pxref{Derivations}).
3591 These build actions are performed when asking the daemon to actually
3592 build the derivations; they are run by the daemon in a container
3593 (@pxref{Invoking guix-daemon}).
3594
3595 @cindex strata of code
3596 It should come as no surprise that we like to write these build actions
3597 in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
3598 code@footnote{The term @dfn{stratum} in this context was coined by
3599 Manuel Serrano et al.@: in the context of their work on Hop. Oleg
3600 Kiselyov, who has written insightful
3601 @url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
3602 on this topic}, refers to this kind of code generation as
3603 @dfn{staging}.}: the ``host code''---code that defines packages, talks
3604 to the daemon, etc.---and the ``build code''---code that actually
3605 performs build actions, such as making directories, invoking
3606 @command{make}, etc.
3607
3608 To describe a derivation and its build actions, one typically needs to
3609 embed build code inside host code. It boils down to manipulating build
3610 code as data, and the homoiconicity of Scheme---code has a direct
3611 representation as data---comes in handy for that. But we need more than
3612 the normal @code{quasiquote} mechanism in Scheme to construct build
3613 expressions.
3614
3615 The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
3616 S-expressions adapted to build expressions. G-expressions, or
3617 @dfn{gexps}, consist essentially of three syntactic forms: @code{gexp},
3618 @code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
3619 @code{#$}, and @code{#$@@}), which are comparable to
3620 @code{quasiquote}, @code{unquote}, and @code{unquote-splicing},
3621 respectively (@pxref{Expression Syntax, @code{quasiquote},, guile,
3622 GNU Guile Reference Manual}). However, there are major differences:
3623
3624 @itemize
3625 @item
3626 Gexps are meant to be written to a file and run or manipulated by other
3627 processes.
3628
3629 @item
3630 When a high-level object such as a package or derivation is unquoted
3631 inside a gexp, the result is as if its output file name had been
3632 introduced.
3633
3634 @item
3635 Gexps carry information about the packages or derivations they refer to,
3636 and these dependencies are automatically added as inputs to the build
3637 processes that use them.
3638 @end itemize
3639
3640 @cindex lowering, of high-level objects in gexps
3641 This mechanism is not limited to package and derivation
3642 objects: @dfn{compilers} able to ``lower'' other high-level objects to
3643 derivations or files in the store can be defined,
3644 such that these objects can also be inserted
3645 into gexps. For example, a useful type of high-level objects that can be
3646 inserted in a gexp is ``file-like objects'', which make it easy to
3647 add files to the store and to refer to them in
3648 derivations and such (see @code{local-file} and @code{plain-file}
3649 below.)
3650
3651 To illustrate the idea, here is an example of a gexp:
3652
3653 @example
3654 (define build-exp
3655 #~(begin
3656 (mkdir #$output)
3657 (chdir #$output)
3658 (symlink (string-append #$coreutils "/bin/ls")
3659 "list-files")))
3660 @end example
3661
3662 This gexp can be passed to @code{gexp->derivation}; we obtain a
3663 derivation that builds a directory containing exactly one symlink to
3664 @file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
3665
3666 @example
3667 (gexp->derivation "the-thing" build-exp)
3668 @end example
3669
3670 As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
3671 substituted to the reference to the @var{coreutils} package in the
3672 actual build code, and @var{coreutils} is automatically made an input to
3673 the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
3674 output)}) is replaced by a string containing the directory name of the
3675 output of the derivation.
3676
3677 @cindex cross compilation
3678 In a cross-compilation context, it is useful to distinguish between
3679 references to the @emph{native} build of a package---that can run on the
3680 host---versus references to cross builds of a package. To that end, the
3681 @code{#+} plays the same role as @code{#$}, but is a reference to a
3682 native package build:
3683
3684 @example
3685 (gexp->derivation "vi"
3686 #~(begin
3687 (mkdir #$output)
3688 (system* (string-append #+coreutils "/bin/ln")
3689 "-s"
3690 (string-append #$emacs "/bin/emacs")
3691 (string-append #$output "/bin/vi")))
3692 #:target "mips64el-linux")
3693 @end example
3694
3695 @noindent
3696 In the example above, the native build of @var{coreutils} is used, so
3697 that @command{ln} can actually run on the host; but then the
3698 cross-compiled build of @var{emacs} is referenced.
3699
3700 The syntactic form to construct gexps is summarized below.
3701
3702 @deffn {Scheme Syntax} #~@var{exp}
3703 @deffnx {Scheme Syntax} (gexp @var{exp})
3704 Return a G-expression containing @var{exp}. @var{exp} may contain one
3705 or more of the following forms:
3706
3707 @table @code
3708 @item #$@var{obj}
3709 @itemx (ungexp @var{obj})
3710 Introduce a reference to @var{obj}. @var{obj} may have one of the
3711 supported types, for example a package or a
3712 derivation, in which case the @code{ungexp} form is replaced by its
3713 output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
3714
3715 If @var{obj} is a list, it is traversed and references to supported
3716 objects are substituted similarly.
3717
3718 If @var{obj} is another gexp, its contents are inserted and its
3719 dependencies are added to those of the containing gexp.
3720
3721 If @var{obj} is another kind of object, it is inserted as is.
3722
3723 @item #$@var{obj}:@var{output}
3724 @itemx (ungexp @var{obj} @var{output})
3725 This is like the form above, but referring explicitly to the
3726 @var{output} of @var{obj}---this is useful when @var{obj} produces
3727 multiple outputs (@pxref{Packages with Multiple Outputs}).
3728
3729 @item #+@var{obj}
3730 @itemx #+@var{obj}:output
3731 @itemx (ungexp-native @var{obj})
3732 @itemx (ungexp-native @var{obj} @var{output})
3733 Same as @code{ungexp}, but produces a reference to the @emph{native}
3734 build of @var{obj} when used in a cross compilation context.
3735
3736 @item #$output[:@var{output}]
3737 @itemx (ungexp output [@var{output}])
3738 Insert a reference to derivation output @var{output}, or to the main
3739 output when @var{output} is omitted.
3740
3741 This only makes sense for gexps passed to @code{gexp->derivation}.
3742
3743 @item #$@@@var{lst}
3744 @itemx (ungexp-splicing @var{lst})
3745 Like the above, but splices the contents of @var{lst} inside the
3746 containing list.
3747
3748 @item #+@@@var{lst}
3749 @itemx (ungexp-native-splicing @var{lst})
3750 Like the above, but refers to native builds of the objects listed in
3751 @var{lst}.
3752
3753 @end table
3754
3755 G-expressions created by @code{gexp} or @code{#~} are run-time objects
3756 of the @code{gexp?} type (see below.)
3757 @end deffn
3758
3759 @deffn {Scheme Procedure} gexp? @var{obj}
3760 Return @code{#t} if @var{obj} is a G-expression.
3761 @end deffn
3762
3763 G-expressions are meant to be written to disk, either as code building
3764 some derivation, or as plain files in the store. The monadic procedures
3765 below allow you to do that (@pxref{The Store Monad}, for more
3766 information about monads.)
3767
3768 @deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
3769 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
3770 [#:hash #f] [#:hash-algo #f] @
3771 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
3772 [#:module-path @var{%load-path}] @
3773 [#:references-graphs #f] [#:allowed-references #f] @
3774 [#:disallowed-references #f] @
3775 [#:leaked-env-vars #f] @
3776 [#:script-name (string-append @var{name} "-builder")] @
3777 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
3778 Return a derivation @var{name} that runs @var{exp} (a gexp) with
3779 @var{guile-for-build} (a derivation) on @var{system}; @var{exp} is
3780 stored in a file called @var{script-name}. When @var{target} is true,
3781 it is used as the cross-compilation target triplet for packages referred
3782 to by @var{exp}.
3783
3784 Make @var{modules} available in the evaluation context of @var{exp};
3785 @var{modules} is a list of names of Guile modules searched in
3786 @var{module-path} to be copied in the store, compiled, and made available in
3787 the load path during the execution of @var{exp}---e.g., @code{((guix
3788 build utils) (guix build gnu-build-system))}.
3789
3790 @var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3791 applicable.
3792
3793 When @var{references-graphs} is true, it must be a list of tuples of one of the
3794 following forms:
3795
3796 @example
3797 (@var{file-name} @var{package})
3798 (@var{file-name} @var{package} @var{output})
3799 (@var{file-name} @var{derivation})
3800 (@var{file-name} @var{derivation} @var{output})
3801 (@var{file-name} @var{store-item})
3802 @end example
3803
3804 The right-hand-side of each element of @var{references-graphs} is automatically made
3805 an input of the build process of @var{exp}. In the build environment, each
3806 @var{file-name} contains the reference graph of the corresponding item, in a simple
3807 text format.
3808
3809 @var{allowed-references} must be either @code{#f} or a list of output names and packages.
3810 In the latter case, the list denotes store items that the result is allowed to
3811 refer to. Any reference to another store item will lead to a build error.
3812 Similarly for @var{disallowed-references}, which can list items that must not be
3813 referenced by the outputs.
3814
3815 The other arguments are as for @code{derivation} (@pxref{Derivations}).
3816 @end deffn
3817
3818 @cindex file-like objects
3819 The @code{local-file}, @code{plain-file}, @code{computed-file},
3820 @code{program-file}, and @code{scheme-file} procedures below return
3821 @dfn{file-like objects}. That is, when unquoted in a G-expression,
3822 these objects lead to a file in the store. Consider this G-expression:
3823
3824 @example
3825 #~(system* (string-append #$glibc "/sbin/nscd") "-f"
3826 #$(local-file "/tmp/my-nscd.conf"))
3827 @end example
3828
3829 The effect here is to ``intern'' @file{/tmp/my-nscd.conf} by copying it
3830 to the store. Once expanded, for instance @i{via}
3831 @code{gexp->derivation}, the G-expression refers to that copy under
3832 @file{/gnu/store}; thus, modifying or removing the file in @file{/tmp}
3833 does not have any effect on what the G-expression does.
3834 @code{plain-file} can be used similarly; it differs in that the file
3835 content is directly passed as a string.
3836
3837 @deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
3838 [#:recursive? #f] [#:select? (const #t)]
3839 Return an object representing local file @var{file} to add to the store; this
3840 object can be used in a gexp. If @var{file} is a relative file name, it is looked
3841 up relative to the source file where this form appears. @var{file} will be added to
3842 the store under @var{name}--by default the base name of @var{file}.
3843
3844 When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
3845 designates a flat file and @var{recursive?} is true, its contents are added, and its
3846 permission bits are kept.
3847
3848 When @var{recursive?} is true, call @code{(@var{select?} @var{file}
3849 @var{stat})} for each directory entry, where @var{file} is the entry's
3850 absolute file name and @var{stat} is the result of @code{lstat}; exclude
3851 entries for which @var{select?} does not return true.
3852
3853 This is the declarative counterpart of the @code{interned-file} monadic
3854 procedure (@pxref{The Store Monad, @code{interned-file}}).
3855 @end deffn
3856
3857 @deffn {Scheme Procedure} plain-file @var{name} @var{content}
3858 Return an object representing a text file called @var{name} with the given
3859 @var{content} (a string) to be added to the store.
3860
3861 This is the declarative counterpart of @code{text-file}.
3862 @end deffn
3863
3864 @deffn {Scheme Procedure} computed-file @var{name} @var{gexp} @
3865 [#:modules '()] [#:options '(#:local-build? #t)]
3866 Return an object representing the store item @var{name}, a file or
3867 directory computed by @var{gexp}. @var{modules} specifies the set of
3868 modules visible in the execution context of @var{gexp}. @var{options}
3869 is a list of additional arguments to pass to @code{gexp->derivation}.
3870
3871 This is the declarative counterpart of @code{gexp->derivation}.
3872 @end deffn
3873
3874 @deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
3875 Return an executable script @var{name} that runs @var{exp} using
3876 @var{guile} with @var{modules} in its search path.
3877
3878 The example below builds a script that simply invokes the @command{ls}
3879 command:
3880
3881 @example
3882 (use-modules (guix gexp) (gnu packages base))
3883
3884 (gexp->script "list-files"
3885 #~(execl (string-append #$coreutils "/bin/ls")
3886 "ls"))
3887 @end example
3888
3889 When ``running'' it through the store (@pxref{The Store Monad,
3890 @code{run-with-store}}), we obtain a derivation that produces an
3891 executable file @file{/gnu/store/@dots{}-list-files} along these lines:
3892
3893 @example
3894 #!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
3895 !#
3896 (execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
3897 "ls")
3898 @end example
3899 @end deffn
3900
3901 @deffn {Scheme Procedure} program-file @var{name} @var{exp} @
3902 [#:modules '()] [#:guile #f]
3903 Return an object representing the executable store item @var{name} that
3904 runs @var{gexp}. @var{guile} is the Guile package used to execute that
3905 script, and @var{modules} is the list of modules visible to that script.
3906
3907 This is the declarative counterpart of @code{gexp->script}.
3908 @end deffn
3909
3910 @deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
3911 Return a derivation that builds a file @var{name} containing @var{exp}.
3912
3913 The resulting file holds references to all the dependencies of @var{exp}
3914 or a subset thereof.
3915 @end deffn
3916
3917 @deffn {Scheme Procedure} scheme-file @var{name} @var{exp}
3918 Return an object representing the Scheme file @var{name} that contains
3919 @var{exp}.
3920
3921 This is the declarative counterpart of @code{gexp->file}.
3922 @end deffn
3923
3924 @deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
3925 Return as a monadic value a derivation that builds a text file
3926 containing all of @var{text}. @var{text} may list, in addition to
3927 strings, objects of any type that can be used in a gexp: packages,
3928 derivations, local file objects, etc. The resulting store file holds
3929 references to all these.
3930
3931 This variant should be preferred over @code{text-file} anytime the file
3932 to create will reference items from the store. This is typically the
3933 case when building a configuration file that embeds store file names,
3934 like this:
3935
3936 @example
3937 (define (profile.sh)
3938 ;; Return the name of a shell script in the store that
3939 ;; initializes the 'PATH' environment variable.
3940 (text-file* "profile.sh"
3941 "export PATH=" coreutils "/bin:"
3942 grep "/bin:" sed "/bin\n"))
3943 @end example
3944
3945 In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
3946 will reference @var{coreutils}, @var{grep}, and @var{sed}, thereby
3947 preventing them from being garbage-collected during its lifetime.
3948 @end deffn
3949
3950 @deffn {Scheme Procedure} mixed-text-file @var{name} @var{text} @dots{}
3951 Return an object representing store file @var{name} containing
3952 @var{text}. @var{text} is a sequence of strings and file-like objects,
3953 as in:
3954
3955 @example
3956 (mixed-text-file "profile"
3957 "export PATH=" coreutils "/bin:" grep "/bin")
3958 @end example
3959
3960 This is the declarative counterpart of @code{text-file*}.
3961 @end deffn
3962
3963 Of course, in addition to gexps embedded in ``host'' code, there are
3964 also modules containing build tools. To make it clear that they are
3965 meant to be used in the build stratum, these modules are kept in the
3966 @code{(guix build @dots{})} name space.
3967
3968 @cindex lowering, of high-level objects in gexps
3969 Internally, high-level objects are @dfn{lowered}, using their compiler,
3970 to either derivations or store items. For instance, lowering a package
3971 yields a derivation, and lowering a @code{plain-file} yields a store
3972 item. This is achieved using the @code{lower-object} monadic procedure.
3973
3974 @deffn {Monadic Procedure} lower-object @var{obj} [@var{system}] @
3975 [#:target #f]
3976 Return as a value in @var{%store-monad} the derivation or store item
3977 corresponding to @var{obj} for @var{system}, cross-compiling for
3978 @var{target} if @var{target} is true. @var{obj} must be an object that
3979 has an associated gexp compiler, such as a @code{<package>}.
3980 @end deffn
3981
3982
3983 @c *********************************************************************
3984 @node Utilities
3985 @chapter Utilities
3986
3987 This section describes Guix command-line utilities. Some of them are
3988 primarily targeted at developers and users who write new package
3989 definitions, while others are more generally useful. They complement
3990 the Scheme programming interface of Guix in a convenient way.
3991
3992 @menu
3993 * Invoking guix build:: Building packages from the command line.
3994 * Invoking guix edit:: Editing package definitions.
3995 * Invoking guix download:: Downloading a file and printing its hash.
3996 * Invoking guix hash:: Computing the cryptographic hash of a file.
3997 * Invoking guix import:: Importing package definitions.
3998 * Invoking guix refresh:: Updating package definitions.
3999 * Invoking guix lint:: Finding errors in package definitions.
4000 * Invoking guix size:: Profiling disk usage.
4001 * Invoking guix graph:: Visualizing the graph of packages.
4002 * Invoking guix environment:: Setting up development environments.
4003 * Invoking guix publish:: Sharing substitutes.
4004 * Invoking guix challenge:: Challenging substitute servers.
4005 * Invoking guix container:: Process isolation.
4006 @end menu
4007
4008 @node Invoking guix build
4009 @section Invoking @command{guix build}
4010
4011 The @command{guix build} command builds packages or derivations and
4012 their dependencies, and prints the resulting store paths. Note that it
4013 does not modify the user's profile---this is the job of the
4014 @command{guix package} command (@pxref{Invoking guix package}). Thus,
4015 it is mainly useful for distribution developers.
4016
4017 The general syntax is:
4018
4019 @example
4020 guix build @var{options} @var{package-or-derivation}@dots{}
4021 @end example
4022
4023 As an example, the following command builds the latest versions of Emacs
4024 and of Guile, displays their build logs, and finally displays the
4025 resulting directories:
4026
4027 @example
4028 guix build emacs guile
4029 @end example
4030
4031 Similarly, the following command builds all the available packages:
4032
4033 @example
4034 guix build --quiet --keep-going \
4035 `guix package -A | cut -f1,2 --output-delimiter=@@`
4036 @end example
4037
4038 @var{package-or-derivation} may be either the name of a package found in
4039 the software distribution such as @code{coreutils} or
4040 @code{coreutils-8.20}, or a derivation such as
4041 @file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
4042 package with the corresponding name (and optionally version) is searched
4043 for among the GNU distribution modules (@pxref{Package Modules}).
4044
4045 Alternatively, the @code{--expression} option may be used to specify a
4046 Scheme expression that evaluates to a package; this is useful when
4047 disambiguating among several same-named packages or package variants is
4048 needed.
4049
4050 There may be zero or more @var{options}. The available options are
4051 described in the subsections below.
4052
4053 @menu
4054 * Common Build Options:: Build options for most commands.
4055 * Package Transformation Options:: Creating variants of packages.
4056 * Additional Build Options:: Options specific to 'guix build'.
4057 @end menu
4058
4059 @node Common Build Options
4060 @subsection Common Build Options
4061
4062 A number of options that control the build process are common to
4063 @command{guix build} and other commands that can spawn builds, such as
4064 @command{guix package} or @command{guix archive}. These are the
4065 following:
4066
4067 @table @code
4068
4069 @item --load-path=@var{directory}
4070 @itemx -L @var{directory}
4071 Add @var{directory} to the front of the package module search path
4072 (@pxref{Package Modules}).
4073
4074 This allows users to define their own packages and make them visible to
4075 the command-line tools.
4076
4077 @item --keep-failed
4078 @itemx -K
4079 Keep the build tree of failed builds. Thus, if a build fails, its build
4080 tree is kept under @file{/tmp}, in a directory whose name is shown at
4081 the end of the build log. This is useful when debugging build issues.
4082
4083 @item --keep-going
4084 @itemx -k
4085 Keep going when some of the derivations fail to build; return only once
4086 all the builds have either completed or failed.
4087
4088 The default behavior is to stop as soon as one of the specified
4089 derivations has failed.
4090
4091 @item --dry-run
4092 @itemx -n
4093 Do not build the derivations.
4094
4095 @item --fallback
4096 When substituting a pre-built binary fails, fall back to building
4097 packages locally.
4098
4099 @item --substitute-urls=@var{urls}
4100 @anchor{client-substitute-urls}
4101 Consider @var{urls} the whitespace-separated list of substitute source
4102 URLs, overriding the default list of URLs of @command{guix-daemon}
4103 (@pxref{daemon-substitute-urls,, @command{guix-daemon} URLs}).
4104
4105 This means that substitutes may be downloaded from @var{urls}, provided
4106 they are signed by a key authorized by the system administrator
4107 (@pxref{Substitutes}).
4108
4109 When @var{urls} is the empty string, substitutes are effectively
4110 disabled.
4111
4112 @item --no-substitutes
4113 Do not use substitutes for build products. That is, always build things
4114 locally instead of allowing downloads of pre-built binaries
4115 (@pxref{Substitutes}).
4116
4117 @item --no-grafts
4118 Do not ``graft'' packages. In practice, this means that package updates
4119 available as grafts are not applied. @xref{Security Updates}, for more
4120 information on grafts.
4121
4122 @item --rounds=@var{n}
4123 Build each derivation @var{n} times in a row, and raise an error if
4124 consecutive build results are not bit-for-bit identical.
4125
4126 This is a useful way to detect non-deterministic builds processes.
4127 Non-deterministic build processes are a problem because they make it
4128 practically impossible for users to @emph{verify} whether third-party
4129 binaries are genuine. @xref{Invoking guix challenge}, for more.
4130
4131 Note that, currently, the differing build results are not kept around,
4132 so you will have to manually investigate in case of an error---e.g., by
4133 stashing one of the build results with @code{guix archive --export}
4134 (@pxref{Invoking guix archive}), then rebuilding, and finally comparing
4135 the two results.
4136
4137 @item --no-build-hook
4138 Do not attempt to offload builds @i{via} the ``build hook'' of the daemon
4139 (@pxref{Daemon Offload Setup}). That is, always build things locally
4140 instead of offloading builds to remote machines.
4141
4142 @item --max-silent-time=@var{seconds}
4143 When the build or substitution process remains silent for more than
4144 @var{seconds}, terminate it and report a build failure.
4145
4146 @item --timeout=@var{seconds}
4147 Likewise, when the build or substitution process lasts for more than
4148 @var{seconds}, terminate it and report a build failure.
4149
4150 By default there is no timeout. This behavior can be restored with
4151 @code{--timeout=0}.
4152
4153 @item --verbosity=@var{level}
4154 Use the given verbosity level. @var{level} must be an integer between 0
4155 and 5; higher means more verbose output. Setting a level of 4 or more
4156 may be helpful when debugging setup issues with the build daemon.
4157
4158 @item --cores=@var{n}
4159 @itemx -c @var{n}
4160 Allow the use of up to @var{n} CPU cores for the build. The special
4161 value @code{0} means to use as many CPU cores as available.
4162
4163 @item --max-jobs=@var{n}
4164 @itemx -M @var{n}
4165 Allow at most @var{n} build jobs in parallel. @xref{Invoking
4166 guix-daemon, @code{--max-jobs}}, for details about this option and the
4167 equivalent @command{guix-daemon} option.
4168
4169 @end table
4170
4171 Behind the scenes, @command{guix build} is essentially an interface to
4172 the @code{package-derivation} procedure of the @code{(guix packages)}
4173 module, and to the @code{build-derivations} procedure of the @code{(guix
4174 derivations)} module.
4175
4176 In addition to options explicitly passed on the command line,
4177 @command{guix build} and other @command{guix} commands that support
4178 building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
4179
4180 @defvr {Environment Variable} GUIX_BUILD_OPTIONS
4181 Users can define this variable to a list of command line options that
4182 will automatically be used by @command{guix build} and other
4183 @command{guix} commands that can perform builds, as in the example
4184 below:
4185
4186 @example
4187 $ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
4188 @end example
4189
4190 These options are parsed independently, and the result is appended to
4191 the parsed command-line options.
4192 @end defvr
4193
4194
4195 @node Package Transformation Options
4196 @subsection Package Transformation Options
4197
4198 @cindex package variants
4199 Another set of command-line options supported by @command{guix build}
4200 and also @command{guix package} are @dfn{package transformation
4201 options}. These are options that make it possible to define @dfn{package
4202 variants}---for instance, packages built from different source code.
4203 This is a convenient way to create customized packages on the fly
4204 without having to type in the definitions of package variants
4205 (@pxref{Defining Packages}).
4206
4207 @table @code
4208
4209 @item --with-source=@var{source}
4210 Use @var{source} as the source of the corresponding package.
4211 @var{source} must be a file name or a URL, as for @command{guix
4212 download} (@pxref{Invoking guix download}).
4213
4214 The ``corresponding package'' is taken to be the one specified on the
4215 command line the name of which matches the base of @var{source}---e.g.,
4216 if @var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
4217 package is @code{guile}. Likewise, the version string is inferred from
4218 @var{source}; in the previous example, it is @code{2.0.10}.
4219
4220 This option allows users to try out versions of packages other than the
4221 one provided by the distribution. The example below downloads
4222 @file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
4223 the @code{ed} package:
4224
4225 @example
4226 guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
4227 @end example
4228
4229 As a developer, @code{--with-source} makes it easy to test release
4230 candidates:
4231
4232 @example
4233 guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
4234 @end example
4235
4236 @dots{} or to build from a checkout in a pristine environment:
4237
4238 @example
4239 $ git clone git://git.sv.gnu.org/guix.git
4240 $ guix build guix --with-source=./guix
4241 @end example
4242
4243 @item --with-input=@var{package}=@var{replacement}
4244 Replace dependency on @var{package} by a dependency on
4245 @var{replacement}. @var{package} must be a package name, and
4246 @var{replacement} must be a package specification such as @code{guile}
4247 or @code{guile@@1.8}.
4248
4249 For instance, the following command builds Guix, but replaces its
4250 dependency on the current stable version of Guile with a dependency on
4251 the development version of Guile, @code{guile-next}:
4252
4253 @example
4254 guix build --with-input=guile=guile-next guix
4255 @end example
4256
4257 This is a recursive, deep replacement. So in this example, both
4258 @code{guix} and its dependency @code{guile-json} (which also depends on
4259 @code{guile}) get rebuilt against @code{guile-next}.
4260
4261 However, implicit inputs are left unchanged.
4262 @end table
4263
4264 @node Additional Build Options
4265 @subsection Additional Build Options
4266
4267 The command-line options presented below are specific to @command{guix
4268 build}.
4269
4270 @table @code
4271
4272 @item --quiet
4273 @itemx -q
4274 Build quietly, without displaying the build log. Upon completion, the
4275 build log is kept in @file{/var} (or similar) and can always be
4276 retrieved using the @option{--log-file} option.
4277
4278 @item --file=@var{file}
4279 @itemx -f @var{file}
4280
4281 Build the package or derivation that the code within @var{file}
4282 evaluates to.
4283
4284 As an example, @var{file} might contain a package definition like this
4285 (@pxref{Defining Packages}):
4286
4287 @example
4288 @verbatiminclude package-hello.scm
4289 @end example
4290
4291 @item --expression=@var{expr}
4292 @itemx -e @var{expr}
4293 Build the package or derivation @var{expr} evaluates to.
4294
4295 For example, @var{expr} may be @code{(@@ (gnu packages guile)
4296 guile-1.8)}, which unambiguously designates this specific variant of
4297 version 1.8 of Guile.
4298
4299 Alternatively, @var{expr} may be a G-expression, in which case it is used
4300 as a build program passed to @code{gexp->derivation}
4301 (@pxref{G-Expressions}).
4302
4303 Lastly, @var{expr} may refer to a zero-argument monadic procedure
4304 (@pxref{The Store Monad}). The procedure must return a derivation as a
4305 monadic value, which is then passed through @code{run-with-store}.
4306
4307 @item --source
4308 @itemx -S
4309 Build the source derivations of the packages, rather than the packages
4310 themselves.
4311
4312 For instance, @code{guix build -S gcc} returns something like
4313 @file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is the GCC
4314 source tarball.
4315
4316 The returned source tarball is the result of applying any patches and
4317 code snippets specified in the package @code{origin} (@pxref{Defining
4318 Packages}).
4319
4320 @item --sources
4321 Fetch and return the source of @var{package-or-derivation} and all their
4322 dependencies, recursively. This is a handy way to obtain a local copy
4323 of all the source code needed to build @var{packages}, allowing you to
4324 eventually build them even without network access. It is an extension
4325 of the @code{--source} option and can accept one of the following
4326 optional argument values:
4327
4328 @table @code
4329 @item package
4330 This value causes the @code{--sources} option to behave in the same way
4331 as the @code{--source} option.
4332
4333 @item all
4334 Build the source derivations of all packages, including any source that
4335 might be listed as @code{inputs}. This is the default value.
4336
4337 @example
4338 $ guix build --sources tzdata
4339 The following derivations will be built:
4340 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
4341 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
4342 @end example
4343
4344 @item transitive
4345 Build the source derivations of all packages, as well of all transitive
4346 inputs to the packages. This can be used e.g. to
4347 prefetch package source for later offline building.
4348
4349 @example
4350 $ guix build --sources=transitive tzdata
4351 The following derivations will be built:
4352 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
4353 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
4354 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
4355 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
4356 /gnu/store/@dots{}-make-4.1.tar.xz.drv
4357 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
4358 @dots{}
4359 @end example
4360
4361 @end table
4362
4363 @item --system=@var{system}
4364 @itemx -s @var{system}
4365 Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
4366 the system type of the build host.
4367
4368 An example use of this is on Linux-based systems, which can emulate
4369 different personalities. For instance, passing
4370 @code{--system=i686-linux} on an @code{x86_64-linux} system allows users
4371 to build packages in a complete 32-bit environment.
4372
4373 @item --target=@var{triplet}
4374 @cindex cross-compilation
4375 Cross-build for @var{triplet}, which must be a valid GNU triplet, such
4376 as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
4377 configuration triplets,, configure, GNU Configure and Build System}).
4378
4379 @anchor{build-check}
4380 @item --check
4381 @cindex determinism, checking
4382 @cindex reproducibility, checking
4383 Rebuild @var{package-or-derivation}, which are already available in the
4384 store, and raise an error if the build results are not bit-for-bit
4385 identical.
4386
4387 This mechanism allows you to check whether previously installed
4388 substitutes are genuine (@pxref{Substitutes}), or whether the build result
4389 of a package is deterministic. @xref{Invoking guix challenge}, for more
4390 background information and tools.
4391
4392 When used in conjunction with @option{--keep-failed}, the differing
4393 output is kept in the store, under @file{/gnu/store/@dots{}-check}.
4394 This makes it easy to look for differences between the two results.
4395
4396 @item --derivations
4397 @itemx -d
4398 Return the derivation paths, not the output paths, of the given
4399 packages.
4400
4401 @item --root=@var{file}
4402 @itemx -r @var{file}
4403 Make @var{file} a symlink to the result, and register it as a garbage
4404 collector root.
4405
4406 @item --log-file
4407 Return the build log file names or URLs for the given
4408 @var{package-or-derivation}, or raise an error if build logs are
4409 missing.
4410
4411 This works regardless of how packages or derivations are specified. For
4412 instance, the following invocations are equivalent:
4413
4414 @example
4415 guix build --log-file `guix build -d guile`
4416 guix build --log-file `guix build guile`
4417 guix build --log-file guile
4418 guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
4419 @end example
4420
4421 If a log is unavailable locally, and unless @code{--no-substitutes} is
4422 passed, the command looks for a corresponding log on one of the
4423 substitute servers (as specified with @code{--substitute-urls}.)
4424
4425 So for instance, imagine you want to see the build log of GDB on MIPS,
4426 but you are actually on an @code{x86_64} machine:
4427
4428 @example
4429 $ guix build --log-file gdb -s mips64el-linux
4430 https://hydra.gnu.org/log/@dots{}-gdb-7.10
4431 @end example
4432
4433 You can freely access a huge library of build logs!
4434 @end table
4435
4436
4437 @node Invoking guix edit
4438 @section Invoking @command{guix edit}
4439
4440 @cindex package definition, editing
4441 So many packages, so many source files! The @command{guix edit} command
4442 facilitates the life of packagers by pointing their editor at the source
4443 file containing the definition of the specified packages. For instance:
4444
4445 @example
4446 guix edit gcc@@4.9 vim
4447 @end example
4448
4449 @noindent
4450 launches the program specified in the @code{VISUAL} or in the
4451 @code{EDITOR} environment variable to edit the recipe of GCC@tie{}4.9.3
4452 and that of Vim.
4453
4454 If you are using Emacs, note that the Emacs user interface provides the
4455 @kbd{M-x guix-edit} command and a similar functionality in the ``package
4456 info'' and ``package list'' buffers created by the @kbd{M-x
4457 guix-search-by-name} and similar commands (@pxref{Emacs Commands}).
4458
4459
4460 @node Invoking guix download
4461 @section Invoking @command{guix download}
4462
4463 When writing a package definition, developers typically need to download
4464 a source tarball, compute its SHA256 hash, and write that
4465 hash in the package definition (@pxref{Defining Packages}). The
4466 @command{guix download} tool helps with this task: it downloads a file
4467 from the given URI, adds it to the store, and prints both its file name
4468 in the store and its SHA256 hash.
4469
4470 The fact that the downloaded file is added to the store saves bandwidth:
4471 when the developer eventually tries to build the newly defined package
4472 with @command{guix build}, the source tarball will not have to be
4473 downloaded again because it is already in the store. It is also a
4474 convenient way to temporarily stash files, which may be deleted
4475 eventually (@pxref{Invoking guix gc}).
4476
4477 The @command{guix download} command supports the same URIs as used in
4478 package definitions. In particular, it supports @code{mirror://} URIs.
4479 @code{https} URIs (HTTP over TLS) are supported @emph{provided} the
4480 Guile bindings for GnuTLS are available in the user's environment; when
4481 they are not available, an error is raised. @xref{Guile Preparations,
4482 how to install the GnuTLS bindings for Guile,, gnutls-guile,
4483 GnuTLS-Guile}, for more information.
4484
4485 The following option is available:
4486
4487 @table @code
4488 @item --format=@var{fmt}
4489 @itemx -f @var{fmt}
4490 Write the hash in the format specified by @var{fmt}. For more
4491 information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
4492 @end table
4493
4494 @node Invoking guix hash
4495 @section Invoking @command{guix hash}
4496
4497 The @command{guix hash} command computes the SHA256 hash of a file.
4498 It is primarily a convenience tool for anyone contributing to the
4499 distribution: it computes the cryptographic hash of a file, which can be
4500 used in the definition of a package (@pxref{Defining Packages}).
4501
4502 The general syntax is:
4503
4504 @example
4505 guix hash @var{option} @var{file}
4506 @end example
4507
4508 @command{guix hash} has the following option:
4509
4510 @table @code
4511
4512 @item --format=@var{fmt}
4513 @itemx -f @var{fmt}
4514 Write the hash in the format specified by @var{fmt}.
4515
4516 Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
4517 (@code{hex} and @code{hexadecimal} can be used as well).
4518
4519 If the @option{--format} option is not specified, @command{guix hash}
4520 will output the hash in @code{nix-base32}. This representation is used
4521 in the definitions of packages.
4522
4523 @item --recursive
4524 @itemx -r
4525 Compute the hash on @var{file} recursively.
4526
4527 In this case, the hash is computed on an archive containing @var{file},
4528 including its children if it is a directory. Some of the metadata of
4529 @var{file} is part of the archive; for instance, when @var{file} is a
4530 regular file, the hash is different depending on whether @var{file} is
4531 executable or not. Metadata such as time stamps has no impact on the
4532 hash (@pxref{Invoking guix archive}).
4533 @c FIXME: Replace xref above with xref to an ``Archive'' section when
4534 @c it exists.
4535
4536 @end table
4537
4538 @node Invoking guix import
4539 @section Invoking @command{guix import}
4540
4541 @cindex importing packages
4542 @cindex package import
4543 @cindex package conversion
4544 The @command{guix import} command is useful for people who would like to
4545 add a package to the distribution with as little work as
4546 possible---a legitimate demand. The command knows of a few
4547 repositories from which it can ``import'' package metadata. The result
4548 is a package definition, or a template thereof, in the format we know
4549 (@pxref{Defining Packages}).
4550
4551 The general syntax is:
4552
4553 @example
4554 guix import @var{importer} @var{options}@dots{}
4555 @end example
4556
4557 @var{importer} specifies the source from which to import package
4558 metadata, and @var{options} specifies a package identifier and other
4559 options specific to @var{importer}. Currently, the available
4560 ``importers'' are:
4561
4562 @table @code
4563 @item gnu
4564 Import metadata for the given GNU package. This provides a template
4565 for the latest version of that GNU package, including the hash of its
4566 source tarball, and its canonical synopsis and description.
4567
4568 Additional information such as the package dependencies and its
4569 license needs to be figured out manually.
4570
4571 For example, the following command returns a package definition for
4572 GNU@tie{}Hello:
4573
4574 @example
4575 guix import gnu hello
4576 @end example
4577
4578 Specific command-line options are:
4579
4580 @table @code
4581 @item --key-download=@var{policy}
4582 As for @code{guix refresh}, specify the policy to handle missing OpenPGP
4583 keys when verifying the package signature. @xref{Invoking guix
4584 refresh, @code{--key-download}}.
4585 @end table
4586
4587 @item pypi
4588 @cindex pypi
4589 Import metadata from the @uref{https://pypi.python.org/, Python Package
4590 Index}@footnote{This functionality requires Guile-JSON to be installed.
4591 @xref{Requirements}.}. Information is taken from the JSON-formatted
4592 description available at @code{pypi.python.org} and usually includes all
4593 the relevant information, including package dependencies. For maximum
4594 efficiency, it is recommended to install the @command{unzip} utility, so
4595 that the importer can unzip Python wheels and gather data from them.
4596
4597 The command below imports metadata for the @code{itsdangerous} Python
4598 package:
4599
4600 @example
4601 guix import pypi itsdangerous
4602 @end example
4603
4604 @item gem
4605 @cindex gem
4606 Import metadata from @uref{https://rubygems.org/,
4607 RubyGems}@footnote{This functionality requires Guile-JSON to be
4608 installed. @xref{Requirements}.}. Information is taken from the
4609 JSON-formatted description available at @code{rubygems.org} and includes
4610 most relevant information, including runtime dependencies. There are
4611 some caveats, however. The metadata doesn't distinguish between
4612 synopses and descriptions, so the same string is used for both fields.
4613 Additionally, the details of non-Ruby dependencies required to build
4614 native extensions is unavailable and left as an exercise to the
4615 packager.
4616
4617 The command below imports metadata for the @code{rails} Ruby package:
4618
4619 @example
4620 guix import gem rails
4621 @end example
4622
4623 @item cpan
4624 @cindex CPAN
4625 Import metadata from @uref{https://www.metacpan.org/, MetaCPAN}@footnote{This
4626 functionality requires Guile-JSON to be installed.
4627 @xref{Requirements}.}.
4628 Information is taken from the JSON-formatted metadata provided through
4629 @uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
4630 relevant information, such as module dependencies. License information
4631 should be checked closely. If Perl is available in the store, then the
4632 @code{corelist} utility will be used to filter core modules out of the
4633 list of dependencies.
4634
4635 The command command below imports metadata for the @code{Acme::Boolean}
4636 Perl module:
4637
4638 @example
4639 guix import cpan Acme::Boolean
4640 @end example
4641
4642 @item cran
4643 @cindex CRAN
4644 @cindex Bioconductor
4645 Import metadata from @uref{http://cran.r-project.org/, CRAN}, the
4646 central repository for the @uref{http://r-project.org, GNU@tie{}R
4647 statistical and graphical environment}.
4648
4649 Information is extracted from the @code{DESCRIPTION} file of the package.
4650
4651 The command command below imports metadata for the @code{Cairo}
4652 R package:
4653
4654 @example
4655 guix import cran Cairo
4656 @end example
4657
4658 When @code{--archive=bioconductor} is added, metadata is imported from
4659 @uref{http://www.bioconductor.org/, Bioconductor}, a repository of R
4660 packages for for the analysis and comprehension of high-throughput
4661 genomic data in bioinformatics.
4662
4663 Information is extracted from the @code{DESCRIPTION} file of a package
4664 published on the web interface of the Bioconductor SVN repository.
4665
4666 The command below imports metadata for the @code{GenomicRanges}
4667 R package:
4668
4669 @example
4670 guix import cran --archive=bioconductor GenomicRanges
4671 @end example
4672
4673 @item nix
4674 Import metadata from a local copy of the source of the
4675 @uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
4676 relies on the @command{nix-instantiate} command of
4677 @uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
4678 typically written in a mixture of Nix-language and Bash code. This
4679 command only imports the high-level package structure that is written in
4680 the Nix language. It normally includes all the basic fields of a
4681 package definition.
4682
4683 When importing a GNU package, the synopsis and descriptions are replaced
4684 by their canonical upstream variant.
4685
4686 Usually, you will first need to do:
4687
4688 @example
4689 export NIX_REMOTE=daemon
4690 @end example
4691
4692 @noindent
4693 so that @command{nix-instantiate} does not try to open the Nix database.
4694
4695 As an example, the command below imports the package definition of
4696 LibreOffice (more precisely, it imports the definition of the package
4697 bound to the @code{libreoffice} top-level attribute):
4698
4699 @example
4700 guix import nix ~/path/to/nixpkgs libreoffice
4701 @end example
4702
4703 @item hackage
4704 @cindex hackage
4705 Import metadata from the Haskell community's central package archive
4706 @uref{https://hackage.haskell.org/, Hackage}. Information is taken from
4707 Cabal files and includes all the relevant information, including package
4708 dependencies.
4709
4710 Specific command-line options are:
4711
4712 @table @code
4713 @item --stdin
4714 @itemx -s
4715 Read a Cabal file from standard input.
4716 @item --no-test-dependencies
4717 @itemx -t
4718 Do not include dependencies required only by the test suites.
4719 @item --cabal-environment=@var{alist}
4720 @itemx -e @var{alist}
4721 @var{alist} is a Scheme alist defining the environment in which the
4722 Cabal conditionals are evaluated. The accepted keys are: @code{os},
4723 @code{arch}, @code{impl} and a string representing the name of a flag.
4724 The value associated with a flag has to be either the symbol
4725 @code{true} or @code{false}. The value associated with other keys
4726 has to conform to the Cabal file format definition. The default value
4727 associated with the keys @code{os}, @code{arch} and @code{impl} is
4728 @samp{linux}, @samp{x86_64} and @samp{ghc}, respectively.
4729 @end table
4730
4731 The command below imports metadata for the latest version of the
4732 @code{HTTP} Haskell package without including test dependencies and
4733 specifying the value of the flag @samp{network-uri} as @code{false}:
4734
4735 @example
4736 guix import hackage -t -e "'((\"network-uri\" . false))" HTTP
4737 @end example
4738
4739 A specific package version may optionally be specified by following the
4740 package name by an at-sign and a version number as in the following example:
4741
4742 @example
4743 guix import hackage mtl@@2.1.3.1
4744 @end example
4745
4746 @item elpa
4747 @cindex elpa
4748 Import metadata from an Emacs Lisp Package Archive (ELPA) package
4749 repository (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
4750
4751 Specific command-line options are:
4752
4753 @table @code
4754 @item --archive=@var{repo}
4755 @itemx -a @var{repo}
4756 @var{repo} identifies the archive repository from which to retrieve the
4757 information. Currently the supported repositories and their identifiers
4758 are:
4759 @itemize -
4760 @item
4761 @uref{http://elpa.gnu.org/packages, GNU}, selected by the @code{gnu}
4762 identifier. This is the default.
4763
4764 @item
4765 @uref{http://stable.melpa.org/packages, MELPA-Stable}, selected by the
4766 @code{melpa-stable} identifier.
4767
4768 @item
4769 @uref{http://melpa.org/packages, MELPA}, selected by the @code{melpa}
4770 identifier.
4771 @end itemize
4772 @end table
4773 @end table
4774
4775 The structure of the @command{guix import} code is modular. It would be
4776 useful to have more importers for other package formats, and your help
4777 is welcome here (@pxref{Contributing}).
4778
4779 @node Invoking guix refresh
4780 @section Invoking @command{guix refresh}
4781
4782 The primary audience of the @command{guix refresh} command is developers
4783 of the GNU software distribution. By default, it reports any packages
4784 provided by the distribution that are outdated compared to the latest
4785 upstream version, like this:
4786
4787 @example
4788 $ guix refresh
4789 gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
4790 gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
4791 @end example
4792
4793 It does so by browsing the FTP directory of each package and determining
4794 the highest version number of the source tarballs therein. The command
4795 knows how to update specific types of packages: GNU packages, ELPA
4796 packages, etc.---see the documentation for @option{--type} below. The
4797 are many packages, though, for which it lacks a method to determine
4798 whether a new upstream release is available. However, the mechanism is
4799 extensible, so feel free to get in touch with us to add a new method!
4800
4801 When passed @code{--update}, it modifies distribution source files to
4802 update the version numbers and source tarball hashes of those package
4803 recipes (@pxref{Defining Packages}). This is achieved by downloading
4804 each package's latest source tarball and its associated OpenPGP
4805 signature, authenticating the downloaded tarball against its signature
4806 using @command{gpg}, and finally computing its hash. When the public
4807 key used to sign the tarball is missing from the user's keyring, an
4808 attempt is made to automatically retrieve it from a public key server;
4809 when this is successful, the key is added to the user's keyring; otherwise,
4810 @command{guix refresh} reports an error.
4811
4812 The following options are supported:
4813
4814 @table @code
4815
4816 @item --expression=@var{expr}
4817 @itemx -e @var{expr}
4818 Consider the package @var{expr} evaluates to.
4819
4820 This is useful to precisely refer to a package, as in this example:
4821
4822 @example
4823 guix refresh -l -e '(@@@@ (gnu packages commencement) glibc-final)'
4824 @end example
4825
4826 This command lists the dependents of the ``final'' libc (essentially all
4827 the packages.)
4828
4829 @item --update
4830 @itemx -u
4831 Update distribution source files (package recipes) in place. This is
4832 usually run from a checkout of the Guix source tree (@pxref{Running
4833 Guix Before It Is Installed}):
4834
4835 @example
4836 $ ./pre-inst-env guix refresh -s non-core
4837 @end example
4838
4839 @xref{Defining Packages}, for more information on package definitions.
4840
4841 @item --select=[@var{subset}]
4842 @itemx -s @var{subset}
4843 Select all the packages in @var{subset}, one of @code{core} or
4844 @code{non-core}.
4845
4846 The @code{core} subset refers to all the packages at the core of the
4847 distribution---i.e., packages that are used to build ``everything
4848 else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
4849 changing one of these packages in the distribution entails a rebuild of
4850 all the others. Thus, such updates are an inconvenience to users in
4851 terms of build time or bandwidth used to achieve the upgrade.
4852
4853 The @code{non-core} subset refers to the remaining packages. It is
4854 typically useful in cases where an update of the core packages would be
4855 inconvenient.
4856
4857 @item --type=@var{updater}
4858 @itemx -t @var{updater}
4859 Select only packages handled by @var{updater} (may be a comma-separated
4860 list of updaters). Currently, @var{updater} may be one of:
4861
4862 @table @code
4863 @item gnu
4864 the updater for GNU packages;
4865 @item gnome
4866 the updater for GNOME packages;
4867 @item xorg
4868 the updater for X.org packages;
4869 @item elpa
4870 the updater for @uref{http://elpa.gnu.org/, ELPA} packages;
4871 @item cran
4872 the updater for @uref{http://cran.r-project.org/, CRAN} packages;
4873 @item bioconductor
4874 the updater for @uref{http://www.bioconductor.org/, Bioconductor} R packages;
4875 @item pypi
4876 the updater for @uref{https://pypi.python.org, PyPI} packages.
4877 @item gem
4878 the updater for @uref{https://rubygems.org, RubyGems} packages.
4879 @item github
4880 the updater for @uref{https://github.com, GitHub} packages.
4881 @item hackage
4882 the updater for @uref{https://hackage.haskell.org, Hackage} packages.
4883 @end table
4884
4885 For instance, the following command only checks for updates of Emacs
4886 packages hosted at @code{elpa.gnu.org} and for updates of CRAN packages:
4887
4888 @example
4889 $ guix refresh --type=elpa,cran
4890 gnu/packages/statistics.scm:819:13: r-testthat would be upgraded from 0.10.0 to 0.11.0
4891 gnu/packages/emacs.scm:856:13: emacs-auctex would be upgraded from 11.88.6 to 11.88.9
4892 @end example
4893
4894 @end table
4895
4896 In addition, @command{guix refresh} can be passed one or more package
4897 names, as in this example:
4898
4899 @example
4900 $ ./pre-inst-env guix refresh -u emacs idutils gcc-4.8.4
4901 @end example
4902
4903 @noindent
4904 The command above specifically updates the @code{emacs} and
4905 @code{idutils} packages. The @code{--select} option would have no
4906 effect in this case.
4907
4908 When considering whether to upgrade a package, it is sometimes
4909 convenient to know which packages would be affected by the upgrade and
4910 should be checked for compatibility. For this the following option may
4911 be used when passing @command{guix refresh} one or more package names:
4912
4913 @table @code
4914
4915 @item --list-updaters
4916 @itemx -L
4917 List available updaters and exit (see @option{--type} above.)
4918
4919 @item --list-dependent
4920 @itemx -l
4921 List top-level dependent packages that would need to be rebuilt as a
4922 result of upgrading one or more packages.
4923
4924 @end table
4925
4926 Be aware that the @code{--list-dependent} option only
4927 @emph{approximates} the rebuilds that would be required as a result of
4928 an upgrade. More rebuilds might be required under some circumstances.
4929
4930 @example
4931 $ guix refresh --list-dependent flex
4932 Building the following 120 packages would ensure 213 dependent packages are rebuilt:
4933 hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
4934 @end example
4935
4936 The command above lists a set of packages that could be built to check
4937 for compatibility with an upgraded @code{flex} package.
4938
4939 The following options can be used to customize GnuPG operation:
4940
4941 @table @code
4942
4943 @item --gpg=@var{command}
4944 Use @var{command} as the GnuPG 2.x command. @var{command} is searched
4945 for in @code{$PATH}.
4946
4947 @item --key-download=@var{policy}
4948 Handle missing OpenPGP keys according to @var{policy}, which may be one
4949 of:
4950
4951 @table @code
4952 @item always
4953 Always download missing OpenPGP keys from the key server, and add them
4954 to the user's GnuPG keyring.
4955
4956 @item never
4957 Never try to download missing OpenPGP keys. Instead just bail out.
4958
4959 @item interactive
4960 When a package signed with an unknown OpenPGP key is encountered, ask
4961 the user whether to download it or not. This is the default behavior.
4962 @end table
4963
4964 @item --key-server=@var{host}
4965 Use @var{host} as the OpenPGP key server when importing a public key.
4966
4967 @end table
4968
4969 The @code{github} updater uses the
4970 @uref{https://developer.github.com/v3/, GitHub API} to query for new
4971 releases. When used repeatedly e.g. when refreshing all packages,
4972 GitHub will eventually refuse to answer any further API requests. By
4973 default 60 API requests per hour are allowed, and a full refresh on all
4974 GitHub packages in Guix requires more than this. Authentication with
4975 GitHub through the use of an API token alleviates these limits. To use
4976 an API token, set the environment variable @code{GUIX_GITHUB_TOKEN} to a
4977 token procured from @uref{https://github.com/settings/tokens} or
4978 otherwise.
4979
4980
4981 @node Invoking guix lint
4982 @section Invoking @command{guix lint}
4983 The @command{guix lint} command is meant to help package developers avoid
4984 common errors and use a consistent style. It runs a number of checks on
4985 a given set of packages in order to find common mistakes in their
4986 definitions. Available @dfn{checkers} include (see
4987 @code{--list-checkers} for a complete list):
4988
4989 @table @code
4990 @item synopsis
4991 @itemx description
4992 Validate certain typographical and stylistic rules about package
4993 descriptions and synopses.
4994
4995 @item inputs-should-be-native
4996 Identify inputs that should most likely be native inputs.
4997
4998 @item source
4999 @itemx home-page
5000 @itemx source-file-name
5001 Probe @code{home-page} and @code{source} URLs and report those that are
5002 invalid. Check that the source file name is meaningful, e.g. is not
5003 just a version number or ``git-checkout'', without a declared
5004 @code{file-name} (@pxref{origin Reference}).
5005
5006 @item cve
5007 @cindex security vulnerabilities
5008 @cindex CVE, Common Vulnerabilities and Exposures
5009 Report known vulnerabilities found in the Common Vulnerabilities and
5010 Exposures (CVE) databases of the current and past year
5011 @uref{https://nvd.nist.gov/download.cfm#CVE_FEED, published by the US
5012 NIST}.
5013
5014 To view information about a particular vulnerability, visit pages such as:
5015
5016 @itemize
5017 @item
5018 @indicateurl{https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-YYYY-ABCD}
5019 @item
5020 @indicateurl{https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-YYYY-ABCD}
5021 @end itemize
5022
5023 @noindent
5024 where @code{CVE-YYYY-ABCD} is the CVE identifier---e.g.,
5025 @code{CVE-2015-7554}.
5026
5027 Package developers can specify in package recipes the
5028 @uref{https://nvd.nist.gov/cpe.cfm,Common Platform Enumeration (CPE)}
5029 name and version of the package when they differ from the name that Guix
5030 uses, as in this example:
5031
5032 @example
5033 (package
5034 (name "grub")
5035 ;; @dots{}
5036 ;; CPE calls this package "grub2".
5037 (properties '((cpe-name . "grub2"))))
5038 @end example
5039
5040 @item formatting
5041 Warn about obvious source code formatting issues: trailing white space,
5042 use of tabulations, etc.
5043 @end table
5044
5045 The general syntax is:
5046
5047 @example
5048 guix lint @var{options} @var{package}@dots{}
5049 @end example
5050
5051 If no package is given on the command line, then all packages are checked.
5052 The @var{options} may be zero or more of the following:
5053
5054 @table @code
5055 @item --list-checkers
5056 @itemx -l
5057 List and describe all the available checkers that will be run on packages
5058 and exit.
5059
5060 @item --checkers
5061 @itemx -c
5062 Only enable the checkers specified in a comma-separated list using the
5063 names returned by @code{--list-checkers}.
5064
5065 @end table
5066
5067 @node Invoking guix size
5068 @section Invoking @command{guix size}
5069
5070 The @command{guix size} command helps package developers profile the
5071 disk usage of packages. It is easy to overlook the impact of an
5072 additional dependency added to a package, or the impact of using a
5073 single output for a package that could easily be split (@pxref{Packages
5074 with Multiple Outputs}). Such are the typical issues that
5075 @command{guix size} can highlight.
5076
5077 The command can be passed a package specification such as @code{gcc-4.8}
5078 or @code{guile:debug}, or a file name in the store. Consider this
5079 example:
5080
5081 @example
5082 $ guix size coreutils
5083 store item total self
5084 /gnu/store/@dots{}-coreutils-8.23 70.0 13.9 19.8%
5085 /gnu/store/@dots{}-gmp-6.0.0a 55.3 2.5 3.6%
5086 /gnu/store/@dots{}-acl-2.2.52 53.7 0.5 0.7%
5087 /gnu/store/@dots{}-attr-2.4.46 53.2 0.3 0.5%
5088 /gnu/store/@dots{}-gcc-4.8.4-lib 52.9 15.7 22.4%
5089 /gnu/store/@dots{}-glibc-2.21 37.2 37.2 53.1%
5090 @end example
5091
5092 @cindex closure
5093 The store items listed here constitute the @dfn{transitive closure} of
5094 Coreutils---i.e., Coreutils and all its dependencies, recursively---as
5095 would be returned by:
5096
5097 @example
5098 $ guix gc -R /gnu/store/@dots{}-coreutils-8.23
5099 @end example
5100
5101 Here the output shows three columns next to store items. The first column,
5102 labeled ``total'', shows the size in mebibytes (MiB) of the closure of
5103 the store item---that is, its own size plus the size of all its
5104 dependencies. The next column, labeled ``self'', shows the size of the
5105 item itself. The last column shows the ratio of the size of the item
5106 itself to the space occupied by all the items listed here.
5107
5108 In this example, we see that the closure of Coreutils weighs in at
5109 70@tie{}MiB, half of which is taken by libc. (That libc represents a
5110 large fraction of the closure is not a problem @i{per se} because it is
5111 always available on the system anyway.)
5112
5113 When the package passed to @command{guix size} is available in the
5114 store, @command{guix size} queries the daemon to determine its
5115 dependencies, and measures its size in the store, similar to @command{du
5116 -ms --apparent-size} (@pxref{du invocation,,, coreutils, GNU
5117 Coreutils}).
5118
5119 When the given package is @emph{not} in the store, @command{guix size}
5120 reports information based on the available substitutes
5121 (@pxref{Substitutes}). This makes it possible it to profile disk usage of
5122 store items that are not even on disk, only available remotely.
5123
5124 You can also specify several package names:
5125
5126 @example
5127 $ guix size coreutils grep sed bash
5128 store item total self
5129 /gnu/store/@dots{}-coreutils-8.24 77.8 13.8 13.4%
5130 /gnu/store/@dots{}-grep-2.22 73.1 0.8 0.8%
5131 /gnu/store/@dots{}-bash-4.3.42 72.3 4.7 4.6%
5132 /gnu/store/@dots{}-readline-6.3 67.6 1.2 1.2%
5133 @dots{}
5134 total: 102.3 MiB
5135 @end example
5136
5137 @noindent
5138 In this example we see that the combination of the four packages takes
5139 102.3@tie{}MiB in total, which is much less than the sum of each closure
5140 since they have a lot of dependencies in common.
5141
5142 The available options are:
5143
5144 @table @option
5145
5146 @item --substitute-urls=@var{urls}
5147 Use substitute information from @var{urls}.
5148 @xref{client-substitute-urls, the same option for @code{guix build}}.
5149
5150 @item --map-file=@var{file}
5151 Write a graphical map of disk usage in PNG format to @var{file}.
5152
5153 For the example above, the map looks like this:
5154
5155 @image{images/coreutils-size-map,5in,, map of Coreutils disk usage
5156 produced by @command{guix size}}
5157
5158 This option requires that
5159 @uref{http://wingolog.org/software/guile-charting/, Guile-Charting} be
5160 installed and visible in Guile's module search path. When that is not
5161 the case, @command{guix size} fails as it tries to load it.
5162
5163 @item --system=@var{system}
5164 @itemx -s @var{system}
5165 Consider packages for @var{system}---e.g., @code{x86_64-linux}.
5166
5167 @end table
5168
5169 @node Invoking guix graph
5170 @section Invoking @command{guix graph}
5171
5172 @cindex DAG
5173 Packages and their dependencies form a @dfn{graph}, specifically a
5174 directed acyclic graph (DAG). It can quickly become difficult to have a
5175 mental model of the package DAG, so the @command{guix graph} command
5176 provides a visual representation of the DAG. @command{guix graph}
5177 emits a DAG representation in the input format of
5178 @uref{http://www.graphviz.org/, Graphviz}, so its output can be passed
5179 directly to the @command{dot} command of Graphviz. The general
5180 syntax is:
5181
5182 @example
5183 guix graph @var{options} @var{package}@dots{}
5184 @end example
5185
5186 For example, the following command generates a PDF file representing the
5187 package DAG for the GNU@tie{}Core Utilities, showing its build-time
5188 dependencies:
5189
5190 @example
5191 guix graph coreutils | dot -Tpdf > dag.pdf
5192 @end example
5193
5194 The output looks like this:
5195
5196 @image{images/coreutils-graph,2in,,Dependency graph of the GNU Coreutils}
5197
5198 Nice little graph, no?
5199
5200 But there is more than one graph! The one above is concise: it is the
5201 graph of package objects, omitting implicit inputs such as GCC, libc,
5202 grep, etc. It is often useful to have such a concise graph, but
5203 sometimes one may want to see more details. @command{guix graph} supports
5204 several types of graphs, allowing you to choose the level of detail:
5205
5206 @table @code
5207 @item package
5208 This is the default type used in the example above. It shows the DAG of
5209 package objects, excluding implicit dependencies. It is concise, but
5210 filters out many details.
5211
5212 @item bag-emerged
5213 This is the package DAG, @emph{including} implicit inputs.
5214
5215 For instance, the following command:
5216
5217 @example
5218 guix graph --type=bag-emerged coreutils | dot -Tpdf > dag.pdf
5219 @end example
5220
5221 ... yields this bigger graph:
5222
5223 @image{images/coreutils-bag-graph,,5in,Detailed dependency graph of the GNU Coreutils}
5224
5225 At the bottom of the graph, we see all the implicit inputs of
5226 @var{gnu-build-system} (@pxref{Build Systems, @code{gnu-build-system}}).
5227
5228 Now, note that the dependencies of these implicit inputs---that is, the
5229 @dfn{bootstrap dependencies} (@pxref{Bootstrapping})---are not shown
5230 here, for conciseness.
5231
5232 @item bag
5233 Similar to @code{bag-emerged}, but this time including all the bootstrap
5234 dependencies.
5235
5236 @item bag-with-origins
5237 Similar to @code{bag}, but also showing origins and their dependencies.
5238
5239 @item derivations
5240 This is the most detailed representation: It shows the DAG of
5241 derivations (@pxref{Derivations}) and plain store items. Compared to
5242 the above representation, many additional nodes are visible, including
5243 build scripts, patches, Guile modules, etc.
5244
5245 For this type of graph, it is also possible to pass a @file{.drv} file
5246 name instead of a package name, as in:
5247
5248 @example
5249 guix graph -t derivation `guix system build -d my-config.scm`
5250 @end example
5251 @end table
5252
5253 All the types above correspond to @emph{build-time dependencies}. The
5254 following graph type represents the @emph{run-time dependencies}:
5255
5256 @table @code
5257 @item references
5258 This is the graph of @dfn{references} of a package output, as returned
5259 by @command{guix gc --references} (@pxref{Invoking guix gc}).
5260
5261 If the given package output is not available in the store, @command{guix
5262 graph} attempts to obtain dependency information from substitutes.
5263
5264 Here you can also pass a store file name instead of a package name. For
5265 example, the command below produces the reference graph of your profile
5266 (which can be big!):
5267
5268 @example
5269 guix graph -t references `readlink -f ~/.guix-profile`
5270 @end example
5271 @end table
5272
5273 The available options are the following:
5274
5275 @table @option
5276 @item --type=@var{type}
5277 @itemx -t @var{type}
5278 Produce a graph output of @var{type}, where @var{type} must be one of
5279 the values listed above.
5280
5281 @item --list-types
5282 List the supported graph types.
5283
5284 @item --expression=@var{expr}
5285 @itemx -e @var{expr}
5286 Consider the package @var{expr} evaluates to.
5287
5288 This is useful to precisely refer to a package, as in this example:
5289
5290 @example
5291 guix graph -e '(@@@@ (gnu packages commencement) gnu-make-final)'
5292 @end example
5293 @end table
5294
5295
5296 @node Invoking guix environment
5297 @section Invoking @command{guix environment}
5298
5299 @cindex reproducible build environments
5300 @cindex development environments
5301 The purpose of @command{guix environment} is to assist hackers in
5302 creating reproducible development environments without polluting their
5303 package profile. The @command{guix environment} tool takes one or more
5304 packages, builds all of their inputs, and creates a shell
5305 environment to use them.
5306
5307 The general syntax is:
5308
5309 @example
5310 guix environment @var{options} @var{package}@dots{}
5311 @end example
5312
5313 The following example spawns a new shell set up for the development of
5314 GNU@tie{}Guile:
5315
5316 @example
5317 guix environment guile
5318 @end example
5319
5320 If the needed dependencies are not built yet, @command{guix environment}
5321 automatically builds them. The environment of the new shell is an augmented
5322 version of the environment that @command{guix environment} was run in.
5323 It contains the necessary search paths for building the given package
5324 added to the existing environment variables. To create a ``pure''
5325 environment, in which the original environment variables have been unset,
5326 use the @code{--pure} option@footnote{Users sometimes wrongfully augment
5327 environment variables such as @code{PATH} in their @file{~/.bashrc}
5328 file. As a consequence, when @code{guix environment} launches it, Bash
5329 may read @file{~/.bashrc}, thereby introducing ``impurities'' in these
5330 environment variables. It is an error to define such environment
5331 variables in @file{.bashrc}; instead, they should be defined in
5332 @file{.bash_profile}, which is sourced only by log-in shells.
5333 @xref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}, for
5334 details on Bash start-up files.}.
5335
5336 @vindex GUIX_ENVIRONMENT
5337 @command{guix environment} defines the @code{GUIX_ENVIRONMENT}
5338 variable in the shell it spawns. This allows users to, say, define a
5339 specific prompt for development environments in their @file{.bashrc}
5340 (@pxref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}):
5341
5342 @example
5343 if [ -n "$GUIX_ENVIRONMENT" ]
5344 then
5345 export PS1="\u@@\h \w [dev]\$ "
5346 fi
5347 @end example
5348
5349 Additionally, more than one package may be specified, in which case the
5350 union of the inputs for the given packages are used. For example, the
5351 command below spawns a shell where all of the dependencies of both Guile
5352 and Emacs are available:
5353
5354 @example
5355 guix environment guile emacs
5356 @end example
5357
5358 Sometimes an interactive shell session is not desired. An arbitrary
5359 command may be invoked by placing the @code{--} token to separate the
5360 command from the rest of the arguments:
5361
5362 @example
5363 guix environment guile -- make -j4
5364 @end example
5365
5366 In other situations, it is more convenient to specify the list of
5367 packages needed in the environment. For example, the following command
5368 runs @command{python} from an environment containing Python@tie{}2.7 and
5369 NumPy:
5370
5371 @example
5372 guix environment --ad-hoc python2-numpy python-2.7 -- python
5373 @end example
5374
5375 Furthermore, one might want the dependencies of a package and also some
5376 additional packages that are not build-time or runtime dependencies, but
5377 are useful when developing nonetheless. Because of this, the
5378 @code{--ad-hoc} flag is positional. Packages appearing before
5379 @code{--ad-hoc} are interpreted as packages whose dependencies will be
5380 added to the environment. Packages appearing after are interpreted as
5381 packages that will be added to the environment directly. For example,
5382 the following command creates a Guix development environment that
5383 additionally includes Git and strace:
5384
5385 @example
5386 guix environment guix --ad-hoc git strace
5387 @end example
5388
5389 Sometimes it is desirable to isolate the environment as much as
5390 possible, for maximal purity and reproducibility. In particular, when
5391 using Guix on a host distro that is not GuixSD, it is desirable to
5392 prevent access to @file{/usr/bin} and other system-wide resources from
5393 the development environment. For example, the following command spawns
5394 a Guile REPL in a ``container'' where only the store and the current
5395 working directory are mounted:
5396
5397 @example
5398 guix environment --ad-hoc --container guile -- guile
5399 @end example
5400
5401 @quotation Note
5402 The @code{--container} option requires Linux-libre 3.19 or newer.
5403 @end quotation
5404
5405 The available options are summarized below.
5406
5407 @table @code
5408 @item --expression=@var{expr}
5409 @itemx -e @var{expr}
5410 Create an environment for the package or list of packages that
5411 @var{expr} evaluates to.
5412
5413 For example, running:
5414
5415 @example
5416 guix environment -e '(@@ (gnu packages maths) petsc-openmpi)'
5417 @end example
5418
5419 starts a shell with the environment for this specific variant of the
5420 PETSc package.
5421
5422 Running:
5423
5424 @example
5425 guix environment --ad-hoc -e '(@@ (gnu) %base-packages)'
5426 @end example
5427
5428 starts a shell with all the GuixSD base packages available.
5429
5430 The above commands only the use default output of the given packages.
5431 To select other outputs, two element tuples can be specified:
5432
5433 @example
5434 guix environment --ad-hoc -e '(list (@ (gnu packages bash) bash) "include")'
5435 @end example
5436
5437 @item --load=@var{file}
5438 @itemx -l @var{file}
5439 Create an environment for the package or list of packages that the code
5440 within @var{file} evaluates to.
5441
5442 As an example, @var{file} might contain a definition like this
5443 (@pxref{Defining Packages}):
5444
5445 @example
5446 @verbatiminclude environment-gdb.scm
5447 @end example
5448
5449 @item --ad-hoc
5450 Include all specified packages in the resulting environment, as if an
5451 @i{ad hoc} package were defined with them as inputs. This option is
5452 useful for quickly creating an environment without having to write a
5453 package expression to contain the desired inputs.
5454
5455 For instance, the command:
5456
5457 @example
5458 guix environment --ad-hoc guile guile-sdl -- guile
5459 @end example
5460
5461 runs @command{guile} in an environment where Guile and Guile-SDL are
5462 available.
5463
5464 Note that this example implicitly asks for the default output of
5465 @code{guile} and @code{guile-sdl}, but it is possible to ask for a
5466 specific output---e.g., @code{glib:bin} asks for the @code{bin} output
5467 of @code{glib} (@pxref{Packages with Multiple Outputs}).
5468
5469 This option may be composed with the default behavior of @command{guix
5470 environment}. Packages appearing before @code{--ad-hoc} are interpreted
5471 as packages whose dependencies will be added to the environment, the
5472 default behavior. Packages appearing after are interpreted as packages
5473 that will be added to the environment directly.
5474
5475 @item --pure
5476 Unset existing environment variables when building the new environment.
5477 This has the effect of creating an environment in which search paths
5478 only contain package inputs.
5479
5480 @item --search-paths
5481 Display the environment variable definitions that make up the
5482 environment.
5483
5484 @item --system=@var{system}
5485 @itemx -s @var{system}
5486 Attempt to build for @var{system}---e.g., @code{i686-linux}.
5487
5488 @item --container
5489 @itemx -C
5490 @cindex container
5491 Run @var{command} within an isolated container. The current working
5492 directory outside the container is mapped inside the container.
5493 Additionally, a dummy home directory is created that matches the current
5494 user's home directory, and @file{/etc/passwd} is configured accordingly.
5495 The spawned process runs as the current user outside the container, but
5496 has root privileges in the context of the container.
5497
5498 @item --network
5499 @itemx -N
5500 For containers, share the network namespace with the host system.
5501 Containers created without this flag only have access to the loopback
5502 device.
5503
5504 @item --expose=@var{source}[=@var{target}]
5505 For containers, expose the file system @var{source} from the host system
5506 as the read-only file system @var{target} within the container. If
5507 @var{target} is not specified, @var{source} is used as the target mount
5508 point in the container.
5509
5510 The example below spawns a Guile REPL in a container in which the user's
5511 home directory is accessible read-only via the @file{/exchange}
5512 directory:
5513
5514 @example
5515 guix environment --container --expose=$HOME=/exchange guile -- guile
5516 @end example
5517
5518 @item --share=@var{source}[=@var{target}]
5519 For containers, share the file system @var{source} from the host system
5520 as the writable file system @var{target} within the container. If
5521 @var{target} is not specified, @var{source} is used as the target mount
5522 point in the container.
5523
5524 The example below spawns a Guile REPL in a container in which the user's
5525 home directory is accessible for both reading and writing via the
5526 @file{/exchange} directory:
5527
5528 @example
5529 guix environment --container --share=$HOME=/exchange guile -- guile
5530 @end example
5531 @end table
5532
5533 It also supports all of the common build options that @command{guix
5534 build} supports (@pxref{Common Build Options}).
5535
5536 @node Invoking guix publish
5537 @section Invoking @command{guix publish}
5538
5539 The purpose of @command{guix publish} is to enable users to easily share
5540 their store with others, who can then use it as a substitute server
5541 (@pxref{Substitutes}).
5542
5543 When @command{guix publish} runs, it spawns an HTTP server which allows
5544 anyone with network access to obtain substitutes from it. This means
5545 that any machine running Guix can also act as if it were a build farm,
5546 since the HTTP interface is compatible with Hydra, the software behind
5547 the @code{hydra.gnu.org} build farm.
5548
5549 For security, each substitute is signed, allowing recipients to check
5550 their authenticity and integrity (@pxref{Substitutes}). Because
5551 @command{guix publish} uses the signing key of the system, which is only
5552 readable by the system administrator, it must be started as root; the
5553 @code{--user} option makes it drop root privileges early on.
5554
5555 The signing key pair must be generated before @command{guix publish} is
5556 launched, using @command{guix archive --generate-key} (@pxref{Invoking
5557 guix archive}).
5558
5559 The general syntax is:
5560
5561 @example
5562 guix publish @var{options}@dots{}
5563 @end example
5564
5565 Running @command{guix publish} without any additional arguments will
5566 spawn an HTTP server on port 8080:
5567
5568 @example
5569 guix publish
5570 @end example
5571
5572 Once a publishing server has been authorized (@pxref{Invoking guix
5573 archive}), the daemon may download substitutes from it:
5574
5575 @example
5576 guix-daemon --substitute-urls=http://example.org:8080
5577 @end example
5578
5579 The following options are available:
5580
5581 @table @code
5582 @item --port=@var{port}
5583 @itemx -p @var{port}
5584 Listen for HTTP requests on @var{port}.
5585
5586 @item --listen=@var{host}
5587 Listen on the network interface for @var{host}. The default is to
5588 accept connections from any interface.
5589
5590 @item --user=@var{user}
5591 @itemx -u @var{user}
5592 Change privileges to @var{user} as soon as possible---i.e., once the
5593 server socket is open and the signing key has been read.
5594
5595 @item --ttl=@var{ttl}
5596 Produce @code{Cache-Control} HTTP headers that advertise a time-to-live
5597 (TTL) of @var{ttl}. @var{ttl} must denote a duration: @code{5d} means 5
5598 days, @code{1m} means 1 month, and so on.
5599
5600 This allows the user's Guix to keep substitute information in cache for
5601 @var{ttl}. However, note that @code{guix publish} does not itself
5602 guarantee that the store items it provides will indeed remain available
5603 for as long as @var{ttl}.
5604
5605 @item --repl[=@var{port}]
5606 @itemx -r [@var{port}]
5607 Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
5608 Reference Manual}) on @var{port} (37146 by default). This is used
5609 primarily for debugging a running @command{guix publish} server.
5610 @end table
5611
5612 Enabling @command{guix publish} on a GuixSD system is a one-liner: just
5613 add a call to @code{guix-publish-service} in the @code{services} field
5614 of the @code{operating-system} declaration (@pxref{guix-publish-service,
5615 @code{guix-publish-service}}).
5616
5617
5618 @node Invoking guix challenge
5619 @section Invoking @command{guix challenge}
5620
5621 @cindex reproducible builds
5622 @cindex verifiable builds
5623
5624 Do the binaries provided by this server really correspond to the source
5625 code it claims to build? Is a package build process deterministic?
5626 These are the questions the @command{guix challenge} command attempts to
5627 answer.
5628
5629 The former is obviously an important question: Before using a substitute
5630 server (@pxref{Substitutes}), one had better @emph{verify} that it
5631 provides the right binaries, and thus @emph{challenge} it. The latter
5632 is what enables the former: If package builds are deterministic, then
5633 independent builds of the package should yield the exact same result,
5634 bit for bit; if a server provides a binary different from the one
5635 obtained locally, it may be either corrupt or malicious.
5636
5637 We know that the hash that shows up in @file{/gnu/store} file names is
5638 the hash of all the inputs of the process that built the file or
5639 directory---compilers, libraries, build scripts,
5640 etc. (@pxref{Introduction}). Assuming deterministic build processes,
5641 one store file name should map to exactly one build output.
5642 @command{guix challenge} checks whether there is, indeed, a single
5643 mapping by comparing the build outputs of several independent builds of
5644 any given store item.
5645
5646 The command output looks like this:
5647
5648 @smallexample
5649 $ guix challenge --substitute-urls="https://hydra.gnu.org https://guix.example.org"
5650 updating list of substitutes from 'https://hydra.gnu.org'... 100.0%
5651 updating list of substitutes from 'https://guix.example.org'... 100.0%
5652 /gnu/store/@dots{}-openssl-1.0.2d contents differ:
5653 local hash: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q
5654 https://hydra.gnu.org/nar/@dots{}-openssl-1.0.2d: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q
5655 https://guix.example.org/nar/@dots{}-openssl-1.0.2d: 1zy4fmaaqcnjrzzajkdn3f5gmjk754b43qkq47llbyak9z0qjyim
5656 /gnu/store/@dots{}-git-2.5.0 contents differ:
5657 local hash: 00p3bmryhjxrhpn2gxs2fy0a15lnip05l97205pgbk5ra395hyha
5658 https://hydra.gnu.org/nar/@dots{}-git-2.5.0: 069nb85bv4d4a6slrwjdy8v1cn4cwspm3kdbmyb81d6zckj3nq9f
5659 https://guix.example.org/nar/@dots{}-git-2.5.0: 0mdqa9w1p6cmli6976v4wi0sw9r4p5prkj7lzfd1877wk11c9c73
5660 /gnu/store/@dots{}-pius-2.1.1 contents differ:
5661 local hash: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax
5662 https://hydra.gnu.org/nar/@dots{}-pius-2.1.1: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax
5663 https://guix.example.org/nar/@dots{}-pius-2.1.1: 1cy25x1a4fzq5rk0pmvc8xhwyffnqz95h2bpvqsz2mpvlbccy0gs
5664 @end smallexample
5665
5666 @noindent
5667 In this example, @command{guix challenge} first scans the store to
5668 determine the set of locally-built derivations---as opposed to store
5669 items that were downloaded from a substitute server---and then queries
5670 all the substitute servers. It then reports those store items for which
5671 the servers obtained a result different from the local build.
5672
5673 @cindex non-determinism, in package builds
5674 As an example, @code{guix.example.org} always gets a different answer.
5675 Conversely, @code{hydra.gnu.org} agrees with local builds, except in the
5676 case of Git. This might indicate that the build process of Git is
5677 non-deterministic, meaning that its output varies as a function of
5678 various things that Guix does not fully control, in spite of building
5679 packages in isolated environments (@pxref{Features}). Most common
5680 sources of non-determinism include the addition of timestamps in build
5681 results, the inclusion of random numbers, and directory listings sorted
5682 by inode number. See @uref{https://reproducible-builds.org/docs/}, for
5683 more information.
5684
5685 To find out what is wrong with this Git binary, we can do something along
5686 these lines (@pxref{Invoking guix archive}):
5687
5688 @example
5689 $ wget -q -O - https://hydra.gnu.org/nar/@dots{}-git-2.5.0 \
5690 | guix archive -x /tmp/git
5691 $ diff -ur --no-dereference /gnu/store/@dots{}-git.2.5.0 /tmp/git
5692 @end example
5693
5694 This command shows the difference between the files resulting from the
5695 local build, and the files resulting from the build on
5696 @code{hydra.gnu.org} (@pxref{Overview, Comparing and Merging Files,,
5697 diffutils, Comparing and Merging Files}). The @command{diff} command
5698 works great for text files. When binary files differ, a better option
5699 is @uref{https://diffoscope.org/, Diffoscope}, a tool that helps
5700 visualize differences for all kinds of files.
5701
5702 Once you have done that work, you can tell whether the differences are due
5703 to a non-deterministic build process or to a malicious server. We try
5704 hard to remove sources of non-determinism in packages to make it easier
5705 to verify substitutes, but of course, this is a process that
5706 involves not just Guix, but a large part of the free software community.
5707 In the meantime, @command{guix challenge} is one tool to help address
5708 the problem.
5709
5710 If you are writing packages for Guix, you are encouraged to check
5711 whether @code{hydra.gnu.org} and other substitute servers obtain the
5712 same build result as you did with:
5713
5714 @example
5715 $ guix challenge @var{package}
5716 @end example
5717
5718 @noindent
5719 where @var{package} is a package specification such as
5720 @code{guile@@2.0} or @code{glibc:debug}.
5721
5722 The general syntax is:
5723
5724 @example
5725 guix challenge @var{options} [@var{packages}@dots{}]
5726 @end example
5727
5728 When a difference is found between the hash of a locally-built item and
5729 that of a server-provided substitute, or among substitutes provided by
5730 different servers, the command displays it as in the example above and
5731 its exit code is 2 (other non-zero exit codes denote other kinds of
5732 errors.)
5733
5734 The one option that matters is:
5735
5736 @table @code
5737
5738 @item --substitute-urls=@var{urls}
5739 Consider @var{urls} the whitespace-separated list of substitute source
5740 URLs to compare to.
5741
5742 @end table
5743
5744
5745 @node Invoking guix container
5746 @section Invoking @command{guix container}
5747 @cindex container
5748
5749 @quotation Note
5750 As of version @value{VERSION}, this tool is experimental. The interface
5751 is subject to radical change in the future.
5752 @end quotation
5753
5754 The purpose of @command{guix container} is to manipulate processes
5755 running within an isolated environment, commonly known as a
5756 ``container'', typically created by the @command{guix environment}
5757 (@pxref{Invoking guix environment}) and @command{guix system container}
5758 (@pxref{Invoking guix system}) commands.
5759
5760 The general syntax is:
5761
5762 @example
5763 guix container @var{action} @var{options}@dots{}
5764 @end example
5765
5766 @var{action} specifies the operation to perform with a container, and
5767 @var{options} specifies the context-specific arguments for the action.
5768
5769 The following actions are available:
5770
5771 @table @code
5772 @item exec
5773 Execute a command within the context of a running container.
5774
5775 The syntax is:
5776
5777 @example
5778 guix container exec @var{pid} @var{program} @var{arguments}@dots{}
5779 @end example
5780
5781 @var{pid} specifies the process ID of the running container.
5782 @var{program} specifies an executable file name within the root file
5783 system of the container. @var{arguments} are the additional options that
5784 will be passed to @var{program}.
5785
5786 The following command launches an interactive login shell inside a
5787 GuixSD container, started by @command{guix system container}, and whose
5788 process ID is 9001:
5789
5790 @example
5791 guix container exec 9001 /run/current-system/profile/bin/bash --login
5792 @end example
5793
5794 Note that the @var{pid} cannot be the parent process of a container. It
5795 must be PID 1 of the container or one of its child processes.
5796
5797 @end table
5798
5799 @c *********************************************************************
5800 @node GNU Distribution
5801 @chapter GNU Distribution
5802
5803 @cindex Guix System Distribution
5804 @cindex GuixSD
5805 Guix comes with a distribution of the GNU system consisting entirely of
5806 free software@footnote{The term ``free'' here refers to the
5807 @url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
5808 users of that software}.}. The
5809 distribution can be installed on its own (@pxref{System Installation}),
5810 but it is also possible to install Guix as a package manager on top of
5811 an installed GNU/Linux system (@pxref{Installation}). To distinguish
5812 between the two, we refer to the standalone distribution as the Guix
5813 System Distribution, or GuixSD.
5814
5815 The distribution provides core GNU packages such as GNU libc, GCC, and
5816 Binutils, as well as many GNU and non-GNU applications. The complete
5817 list of available packages can be browsed
5818 @url{http://www.gnu.org/software/guix/packages,on-line} or by
5819 running @command{guix package} (@pxref{Invoking guix package}):
5820
5821 @example
5822 guix package --list-available
5823 @end example
5824
5825 Our goal is to provide a practical 100% free software distribution of
5826 Linux-based and other variants of GNU, with a focus on the promotion and
5827 tight integration of GNU components, and an emphasis on programs and
5828 tools that help users exert that freedom.
5829
5830 Packages are currently available on the following platforms:
5831
5832 @table @code
5833
5834 @item x86_64-linux
5835 Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
5836
5837 @item i686-linux
5838 Intel 32-bit architecture (IA32), Linux-Libre kernel;
5839
5840 @item armhf-linux
5841 ARMv7-A architecture with hard float, Thumb-2 and NEON,
5842 using the EABI hard-float application binary interface (ABI),
5843 and Linux-Libre kernel.
5844
5845 @item mips64el-linux
5846 little-endian 64-bit MIPS processors, specifically the Loongson series,
5847 n32 ABI, and Linux-Libre kernel.
5848
5849 @end table
5850
5851 GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
5852
5853 @noindent
5854 For information on porting to other architectures or kernels,
5855 @pxref{Porting}.
5856
5857 @menu
5858 * System Installation:: Installing the whole operating system.
5859 * System Configuration:: Configuring the operating system.
5860 * Installing Debugging Files:: Feeding the debugger.
5861 * Security Updates:: Deploying security fixes quickly.
5862 * Package Modules:: Packages from the programmer's viewpoint.
5863 * Packaging Guidelines:: Growing the distribution.
5864 * Bootstrapping:: GNU/Linux built from scratch.
5865 * Porting:: Targeting another platform or kernel.
5866 @end menu
5867
5868 Building this distribution is a cooperative effort, and you are invited
5869 to join! @xref{Contributing}, for information about how you can help.
5870
5871 @node System Installation
5872 @section System Installation
5873
5874 @cindex Guix System Distribution
5875 This section explains how to install the Guix System Distribution
5876 on a machine. The Guix package manager can
5877 also be installed on top of a running GNU/Linux system,
5878 @pxref{Installation}.
5879
5880 @ifinfo
5881 @quotation Note
5882 @c This paragraph is for people reading this from tty2 of the
5883 @c installation image.
5884 You are reading this documentation with an Info reader. For details on
5885 how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
5886 link that follows: @pxref{Top, Info reader,, info-stnd, Stand-alone GNU
5887 Info}. Hit @kbd{l} afterwards to come back here.
5888
5889 Alternately, run @command{info info} in another tty to keep the manual
5890 available.
5891 @end quotation
5892 @end ifinfo
5893
5894 @menu
5895 * Limitations:: What you can expect.
5896 * Hardware Considerations:: Supported hardware.
5897 * USB Stick Installation:: Preparing the installation medium.
5898 * Preparing for Installation:: Networking, partitioning, etc.
5899 * Proceeding with the Installation:: The real thing.
5900 * Building the Installation Image:: How this comes to be.
5901 @end menu
5902
5903 @node Limitations
5904 @subsection Limitations
5905
5906 As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
5907 not production-ready. It may contain bugs and lack important
5908 features. Thus, if you are looking for a stable production system that
5909 respects your freedom as a computer user, a good solution at this point
5910 is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
5911 the more established GNU/Linux distributions}. We hope you can soon switch
5912 to the GuixSD without fear, of course. In the meantime, you can
5913 also keep using your distribution and try out the package manager on top
5914 of it (@pxref{Installation}).
5915
5916 Before you proceed with the installation, be aware of the following
5917 noteworthy limitations applicable to version @value{VERSION}:
5918
5919 @itemize
5920 @item
5921 The installation process does not include a graphical user interface and
5922 requires familiarity with GNU/Linux (see the following subsections to
5923 get a feel of what that means.)
5924
5925 @item
5926 Support for the Logical Volume Manager (LVM) is missing.
5927
5928 @item
5929 Few system services are currently supported out-of-the-box
5930 (@pxref{Services}).
5931
5932 @item
5933 More than 3,200 packages are available, but you may
5934 occasionally find that a useful package is missing.
5935
5936 @item
5937 GNOME, Xfce, and Enlightenment are available (@pxref{Desktop Services}),
5938 as well as a number of X11 window managers. However, some graphical
5939 applications may be missing, as well as KDE.
5940 @end itemize
5941
5942 You have been warned! But more than a disclaimer, this is an invitation
5943 to report issues (and success stories!), and to join us in improving it.
5944 @xref{Contributing}, for more info.
5945
5946
5947 @node Hardware Considerations
5948 @subsection Hardware Considerations
5949
5950 @cindex hardware support on GuixSD
5951 GNU@tie{}GuixSD focuses on respecting the user's computing freedom. It
5952 builds around the kernel Linux-libre, which means that only hardware for
5953 which free software drivers and firmware exist is supported. Nowadays,
5954 a wide range of off-the-shelf hardware is supported on
5955 GNU/Linux-libre---from keyboards to graphics cards to scanners and
5956 Ethernet controllers. Unfortunately, there are still areas where
5957 hardware vendors deny users control over their own computing, and such
5958 hardware is not supported on GuixSD.
5959
5960 @cindex WiFi, hardware support
5961 One of the main areas where free drivers or firmware are lacking is WiFi
5962 devices. WiFi devices known to work include those using Atheros chips
5963 (AR9271 and AR7010), which corresponds to the @code{ath9k} Linux-libre
5964 driver, and for which free firmware exists and is available
5965 out-of-the-box on GuixSD, as part of @var{%base-firmware}
5966 (@pxref{operating-system Reference, @code{firmware}}).
5967
5968 @cindex RYF, Respects Your Freedom
5969 The @uref{https://www.fsf.org/, Free Software Foundation} runs
5970 @uref{https://www.fsf.org/ryf, @dfn{Respects Your Freedom}} (RYF), a
5971 certification program for hardware products that respect your freedom
5972 and your privacy and ensure that you have control over your device. We
5973 encourage you to check the list of RYF-certified devices.
5974
5975 Another useful resource is the @uref{https://www.h-node.org/, H-Node}
5976 web site. It contains a catalog of hardware devices with information
5977 about their support in GNU/Linux.
5978
5979
5980 @node USB Stick Installation
5981 @subsection USB Stick Installation
5982
5983 An installation image for USB sticks can be downloaded from
5984 @indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
5985 where @var{system} is one of:
5986
5987 @table @code
5988 @item x86_64-linux
5989 for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
5990
5991 @item i686-linux
5992 for a 32-bit GNU/Linux system on Intel-compatible CPUs.
5993 @end table
5994
5995 This image contains a single partition with the tools necessary for an
5996 installation. It is meant to be copied @emph{as is} to a large-enough
5997 USB stick.
5998
5999 To copy the image to a USB stick, follow these steps:
6000
6001 @enumerate
6002 @item
6003 Decompress the image using the @command{xz} command:
6004
6005 @example
6006 xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
6007 @end example
6008
6009 @item
6010 Insert a USB stick of 1@tie{}GiB or more into your machine, and determine
6011 its device name. Assuming that the USB stick is known as @file{/dev/sdX},
6012 copy the image with:
6013
6014 @example
6015 dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
6016 @end example
6017
6018 Access to @file{/dev/sdX} usually requires root privileges.
6019 @end enumerate
6020
6021 Once this is done, you should be able to reboot the system and boot from
6022 the USB stick. The latter usually requires you to get in the BIOS' boot
6023 menu, where you can choose to boot from the USB stick.
6024
6025 @node Preparing for Installation
6026 @subsection Preparing for Installation
6027
6028 Once you have successfully booted the image on the USB stick, you should
6029 end up with a root prompt. Several console TTYs are configured and can
6030 be used to run commands as root. TTY2 shows this documentation,
6031 browsable using the Info reader commands (@pxref{Top,,, info-stnd,
6032 Stand-alone GNU Info}). The installation system runs the GPM mouse
6033 daemon, which allows you to select text with the left mouse button and
6034 to paste it with the middle button.
6035
6036 @quotation Note
6037 Installation requires access to the Internet so that any missing
6038 dependencies of your system configuration can be downloaded. See the
6039 ``Networking'' section below.
6040 @end quotation
6041
6042 The installation system includes many common tools needed for this task.
6043 But it is also a full-blown GuixSD system, which means that you can
6044 install additional packages, should you need it, using @command{guix
6045 package} (@pxref{Invoking guix package}).
6046
6047 @subsubsection Keyboard Layout
6048
6049 @cindex keyboard layout
6050 The installation image uses the US qwerty keyboard layout. If you want
6051 to change it, you can use the @command{loadkeys} command. For example,
6052 the following command selects the Dvorak keyboard layout:
6053
6054 @example
6055 loadkeys dvorak
6056 @end example
6057
6058 See the files under @file{/run/current-system/profile/share/keymaps} for
6059 a list of available keyboard layouts. Run @command{man loadkeys} for
6060 more information.
6061
6062 @subsubsection Networking
6063
6064 Run the following command see what your network interfaces are called:
6065
6066 @example
6067 ifconfig -a
6068 @end example
6069
6070 @noindent
6071 @dots{} or, using the GNU/Linux-specific @command{ip} command:
6072
6073 @example
6074 ip a
6075 @end example
6076
6077 @c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
6078 Wired interfaces have a name starting with @samp{e}; for example, the
6079 interface corresponding to the first on-board Ethernet controller is
6080 called @samp{eno1}. Wireless interfaces have a name starting with
6081 @samp{w}, like @samp{w1p2s0}.
6082
6083 @table @asis
6084 @item Wired connection
6085 To configure a wired network run the following command, substituting
6086 @var{interface} with the name of the wired interface you want to use.
6087
6088 @example
6089 ifconfig @var{interface} up
6090 @end example
6091
6092 @item Wireless connection
6093 To configure wireless networking, you can create a configuration file
6094 for the @command{wpa_supplicant} configuration tool (its location is not
6095 important) using one of the available text editors such as
6096 @command{zile}:
6097
6098 @example
6099 zile wpa_supplicant.conf
6100 @end example
6101
6102 As an example, the following stanza can go to this file and will work
6103 for many wireless networks, provided you give the actual SSID and
6104 passphrase for the network you are connecting to:
6105
6106 @example
6107 network=@{
6108 ssid="@var{my-ssid}"
6109 key_mgmt=WPA-PSK
6110 psk="the network's secret passphrase"
6111 @}
6112 @end example
6113
6114 Start the wireless service and run it in the background with the
6115 following command (substitute @var{interface} with the name of the
6116 network interface you want to use):
6117
6118 @example
6119 wpa_supplicant -c wpa_supplicant.conf -i @var{interface} -B
6120 @end example
6121
6122 Run @command{man wpa_supplicant} for more information.
6123 @end table
6124
6125 At this point, you need to acquire an IP address. On a network where IP
6126 addresses are automatically assigned @i{via} DHCP, you can run:
6127
6128 @example
6129 dhclient -v @var{interface}
6130 @end example
6131
6132 Try to ping a server to see if networking is up and running:
6133
6134 @example
6135 ping -c 3 gnu.org
6136 @end example
6137
6138 Setting up network access is almost always a requirement because the
6139 image does not contain all the software and tools that may be needed.
6140
6141 @subsubsection Disk Partitioning
6142
6143 Unless this has already been done, the next step is to partition, and
6144 then format the target partition(s).
6145
6146 The installation image includes several partitioning tools, including
6147 Parted (@pxref{Overview,,, parted, GNU Parted User Manual}),
6148 @command{fdisk}, and @command{cfdisk}. Run it and set up your disk with
6149 the partition layout you want:
6150
6151 @example
6152 cfdisk
6153 @end example
6154
6155 Once you are done partitioning the target hard disk drive, you have to
6156 create a file system on the relevant partition(s)@footnote{Currently
6157 GuixSD pretty much assumes an ext4 file system. In particular, code
6158 that reads partition UUIDs and labels only works with ext4. This will
6159 be fixed in the future.}.
6160
6161 Preferably, assign partitions a label so that you can easily and
6162 reliably refer to them in @code{file-system} declarations (@pxref{File
6163 Systems}). This is typically done using the @code{-L} option of
6164 @command{mkfs.ext4} and related commands. So, assuming the target root
6165 partition lives at @file{/dev/sda1}, a file system with the label
6166 @code{my-root} can be created with:
6167
6168 @example
6169 mkfs.ext4 -L my-root /dev/sda1
6170 @end example
6171
6172 @c FIXME: Uncomment this once GRUB fully supports encrypted roots.
6173 @c A typical command sequence may be:
6174 @c
6175 @c @example
6176 @c # fdisk /dev/sdX
6177 @c @dots{} Create partitions etc.@dots{}
6178 @c # cryptsetup luksFormat /dev/sdX1
6179 @c # cryptsetup open --type luks /dev/sdX1 my-partition
6180 @c # mkfs.ext4 -L my-root /dev/mapper/my-partition
6181 @c @end example
6182
6183 In addition to e2fsprogs, the suite of tools to manipulate
6184 ext2/ext3/ext4 file systems, the installation image includes
6185 Cryptsetup/LUKS for disk encryption.
6186
6187 Once that is done, mount the target root partition under @file{/mnt}
6188 with a command like (again, assuming @file{/dev/sda1} is the root
6189 partition):
6190
6191 @example
6192 mount /dev/sda1 /mnt
6193 @end example
6194
6195 Finally, if you plan to use one or more swap partitions (@pxref{Memory
6196 Concepts, swap space,, libc, The GNU C Library Reference Manual}), make
6197 sure to initialize them with @command{mkswap}. Assuming you have one
6198 swap partition on @file{/dev/sda2}, you would run:
6199
6200 @example
6201 mkswap /dev/sda2
6202 @end example
6203
6204 @node Proceeding with the Installation
6205 @subsection Proceeding with the Installation
6206
6207 With the target partitions ready and the target root mounted on
6208 @file{/mnt}, we're ready to go. First, run:
6209
6210 @example
6211 herd start cow-store /mnt
6212 @end example
6213
6214 This makes @file{/gnu/store} copy-on-write, such that packages added to it
6215 during the installation phase are written to the target disk on @file{/mnt}
6216 rather than kept in memory. This is necessary because the first phase of
6217 the @command{guix system init} command (see below) entails downloads or
6218 builds to @file{/gnu/store} which, initially, is an in-memory file system.
6219
6220 Next, you have to edit a file and
6221 provide the declaration of the operating system to be installed. To
6222 that end, the installation system comes with two text editors: GNU nano
6223 (@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone.
6224 We strongly recommend storing that file on the target root file system, say,
6225 as @file{/mnt/etc/config.scm}. Failing to do that, you will have lost your
6226 configuration file once you have rebooted into the newly-installed system.
6227
6228 @xref{Using the Configuration System}, for an overview of the
6229 configuration file. The example configurations discussed in that
6230 section are available under @file{/etc/configuration} in the
6231 installation image. Thus, to get started with a system configuration
6232 providing a graphical display server (a ``desktop'' system), you can run
6233 something along these lines:
6234
6235 @example
6236 # mkdir /mnt/etc
6237 # cp /etc/configuration/desktop.scm /mnt/etc/config.scm
6238 # zile /mnt/etc/config.scm
6239 @end example
6240
6241 You should pay attention to what your configuration file contains, and
6242 in particular:
6243
6244 @itemize
6245 @item
6246 Make sure the @code{grub-configuration} form refers to the device you
6247 want to install GRUB on.
6248
6249 @item
6250 Be sure that your partition labels match the value of their respective
6251 @code{device} fields in your @code{file-system} configuration, assuming
6252 your @code{file-system} configuration sets the value of @code{title} to
6253 @code{'label}.
6254 @end itemize
6255
6256 Once you are done preparing the configuration file, the new system must
6257 be initialized (remember that the target root file system is mounted
6258 under @file{/mnt}):
6259
6260 @example
6261 guix system init /mnt/etc/config.scm /mnt
6262 @end example
6263
6264 @noindent
6265 This copies all the necessary files and installs GRUB on
6266 @file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6267 more information, @pxref{Invoking guix system}. This command may trigger
6268 downloads or builds of missing packages, which can take some time.
6269
6270 Once that command has completed---and hopefully succeeded!---you can run
6271 @command{reboot} and boot into the new system. The @code{root} password
6272 in the new system is initially empty; other users' passwords need to be
6273 initialized by running the @command{passwd} command as @code{root},
6274 unless your configuration specifies otherwise
6275 (@pxref{user-account-password, user account passwords}).
6276
6277 Join us on @code{#guix} on the Freenode IRC network or on
6278 @file{guix-devel@@gnu.org} to share your experience---good or not so
6279 good.
6280
6281 @node Building the Installation Image
6282 @subsection Building the Installation Image
6283
6284 The installation image described above was built using the @command{guix
6285 system} command, specifically:
6286
6287 @c FIXME: 1G is too much; see <http://bugs.gnu.org/23077>.
6288 @example
6289 guix system disk-image --image-size=1G gnu/system/install.scm
6290 @end example
6291
6292 Have a look at @file{gnu/system/install.scm} in the source tree,
6293 and see also @ref{Invoking guix system} for more information
6294 about the installation image.
6295
6296 @node System Configuration
6297 @section System Configuration
6298
6299 @cindex system configuration
6300 The Guix System Distribution supports a consistent whole-system configuration
6301 mechanism. By that we mean that all aspects of the global system
6302 configuration---such as the available system services, timezone and
6303 locale settings, user accounts---are declared in a single place. Such
6304 a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
6305
6306 One of the advantages of putting all the system configuration under the
6307 control of Guix is that it supports transactional system upgrades, and
6308 makes it possible to roll back to a previous system instantiation,
6309 should something go wrong with the new one (@pxref{Features}). Another
6310 advantage is that it makes it easy to replicate the exact same configuration
6311 across different machines, or at different points in time, without
6312 having to resort to additional administration tools layered on top of
6313 the own tools of the system.
6314 @c Yes, we're talking of Puppet, Chef, & co. here. ↑
6315
6316 This section describes this mechanism. First we focus on the system
6317 administrator's viewpoint---explaining how the system is configured and
6318 instantiated. Then we show how this mechanism can be extended, for
6319 instance to support new system services.
6320
6321 @menu
6322 * Using the Configuration System:: Customizing your GNU system.
6323 * operating-system Reference:: Detail of operating-system declarations.
6324 * File Systems:: Configuring file system mounts.
6325 * Mapped Devices:: Block device extra processing.
6326 * User Accounts:: Specifying user accounts.
6327 * Locales:: Language and cultural convention settings.
6328 * Services:: Specifying system services.
6329 * Setuid Programs:: Programs running with root privileges.
6330 * X.509 Certificates:: Authenticating HTTPS servers.
6331 * Name Service Switch:: Configuring libc's name service switch.
6332 * Initial RAM Disk:: Linux-Libre bootstrapping.
6333 * GRUB Configuration:: Configuring the boot loader.
6334 * Invoking guix system:: Instantiating a system configuration.
6335 * Running GuixSD in a VM:: How to run GuixSD in a virtual machine.
6336 * Defining Services:: Adding new service definitions.
6337 @end menu
6338
6339 @node Using the Configuration System
6340 @subsection Using the Configuration System
6341
6342 The operating system is configured by providing an
6343 @code{operating-system} declaration in a file that can then be passed to
6344 the @command{guix system} command (@pxref{Invoking guix system}). A
6345 simple setup, with the default system services, the default Linux-Libre
6346 kernel, initial RAM disk, and boot loader looks like this:
6347
6348 @findex operating-system
6349 @lisp
6350 @include os-config-bare-bones.texi
6351 @end lisp
6352
6353 This example should be self-describing. Some of the fields defined
6354 above, such as @code{host-name} and @code{bootloader}, are mandatory.
6355 Others, such as @code{packages} and @code{services}, can be omitted, in
6356 which case they get a default value.
6357
6358 Below we discuss the effect of some of the most important fields
6359 (@pxref{operating-system Reference}, for details about all the available
6360 fields), and how to @dfn{instantiate} the operating system using
6361 @command{guix system}.
6362
6363 @unnumberedsubsubsec Globally-Visible Packages
6364
6365 @vindex %base-packages
6366 The @code{packages} field lists packages that will be globally visible
6367 on the system, for all user accounts---i.e., in every user's @code{PATH}
6368 environment variable---in addition to the per-user profiles
6369 (@pxref{Invoking guix package}). The @var{%base-packages} variable
6370 provides all the tools one would expect for basic user and administrator
6371 tasks---including the GNU Core Utilities, the GNU Networking Utilities,
6372 the GNU Zile lightweight text editor, @command{find}, @command{grep},
6373 etc. The example above adds tcpdump to those, taken from the @code{(gnu
6374 packages admin)} module (@pxref{Package Modules}).
6375
6376 @findex specification->package
6377 Referring to packages by variable name, like @var{tcpdump} above, has
6378 the advantage of being unambiguous; it also allows typos and such to be
6379 diagnosed right away as ``unbound variables''. The downside is that one
6380 needs to know which module defines which package, and to augment the
6381 @code{use-package-modules} line accordingly. To avoid that, one can use
6382 the @code{specification->package} procedure of the @code{(gnu packages)}
6383 module, which returns the best package for a given name or name and
6384 version:
6385
6386 @lisp
6387 (use-modules (gnu packages))
6388
6389 (operating-system
6390 ;; ...
6391 (packages (append (map specification->package
6392 '("tcpdump" "htop" "gnupg@@2.0"))
6393 %base-packages)))
6394 @end lisp
6395
6396 @unnumberedsubsubsec System Services
6397
6398 @vindex %base-services
6399 The @code{services} field lists @dfn{system services} to be made
6400 available when the system starts (@pxref{Services}).
6401 The @code{operating-system} declaration above specifies that, in
6402 addition to the basic services, we want the @command{lshd} secure shell
6403 daemon listening on port 2222 (@pxref{Networking Services,
6404 @code{lsh-service}}). Under the hood,
6405 @code{lsh-service} arranges so that @code{lshd} is started with the
6406 right command-line options, possibly with supporting configuration files
6407 generated as needed (@pxref{Defining Services}).
6408
6409 @cindex customization, of services
6410 @findex modify-services
6411 Occasionally, instead of using the base services as is, you will want to
6412 customize them. To do this, use @code{modify-services} (@pxref{Service
6413 Reference, @code{modify-services}}) to modify the list.
6414
6415 For example, suppose you want to modify @code{guix-daemon} and Mingetty
6416 (the console log-in) in the @var{%base-services} list (@pxref{Base
6417 Services, @code{%base-services}}). To do that, you can write the
6418 following in your operating system declaration:
6419
6420 @lisp
6421 (define %my-services
6422 ;; My very own list of services.
6423 (modify-services %base-services
6424 (guix-service-type config =>
6425 (guix-configuration
6426 (inherit config)
6427 (use-substitutes? #f)
6428 (extra-options '("--gc-keep-derivations"))))
6429 (mingetty-service-type config =>
6430 (mingetty-configuration
6431 (inherit config)
6432 (motd (plain-file "motd" "Howdy!"))))))
6433
6434 (operating-system
6435 ;; @dots{}
6436 (services %my-services))
6437 @end lisp
6438
6439 This changes the configuration---i.e., the service parameters---of the
6440 @code{guix-service-type} instance, and that of all the
6441 @code{mingetty-service-type} instances in the @var{%base-services} list.
6442 Observe how this is accomplished: first, we arrange for the original
6443 configuration to be bound to the identifier @code{config} in the
6444 @var{body}, and then we write the @var{body} so that it evaluates to the
6445 desired configuration. In particular, notice how we use @code{inherit}
6446 to create a new configuration which has the same values as the old
6447 configuration, but with a few modifications.
6448
6449 The configuration for a typical ``desktop'' usage, with the X11 display
6450 server, GNOME and Xfce (users can choose which of these desktop
6451 environments to use at the log-in screen by pressing @kbd{F1}), network
6452 management, power management, and more, would look like this:
6453
6454 @lisp
6455 @include os-config-desktop.texi
6456 @end lisp
6457
6458 A graphical environment with a choice of lightweight window managers
6459 instead of full-blown desktop environments would look like this:
6460
6461 @lisp
6462 @include os-config-lightweight-desktop.texi
6463 @end lisp
6464
6465 @xref{Desktop Services}, for the exact list of services provided by
6466 @var{%desktop-services}. @xref{X.509 Certificates}, for background
6467 information about the @code{nss-certs} package that is used here.
6468
6469 Again, @var{%desktop-services} is just a list of service objects. If
6470 you want to remove services from there, you can do so using the
6471 procedures for list filtering (@pxref{SRFI-1 Filtering and
6472 Partitioning,,, guile, GNU Guile Reference Manual}). For instance, the
6473 following expression returns a list that contains all the services in
6474 @var{%desktop-services} minus the Avahi service:
6475
6476 @example
6477 (remove (lambda (service)
6478 (eq? (service-kind service) avahi-service-type))
6479 %desktop-services)
6480 @end example
6481
6482 @unnumberedsubsubsec Instantiating the System
6483
6484 Assuming the @code{operating-system} declaration
6485 is stored in the @file{my-system-config.scm}
6486 file, the @command{guix system reconfigure my-system-config.scm} command
6487 instantiates that configuration, and makes it the default GRUB boot
6488 entry (@pxref{Invoking guix system}).
6489
6490 The normal way to change the system configuration is by updating this
6491 file and re-running @command{guix system reconfigure}. One should never
6492 have to touch files in @command{/etc} or to run commands that modify the
6493 system state such as @command{useradd} or @command{grub-install}. In
6494 fact, you must avoid that since that would not only void your warranty
6495 but also prevent you from rolling back to previous versions of your
6496 system, should you ever need to.
6497
6498 @cindex roll-back, of the operating system
6499 Speaking of roll-back, each time you run @command{guix system
6500 reconfigure}, a new @dfn{generation} of the system is created---without
6501 modifying or deleting previous generations. Old system generations get
6502 an entry in the GRUB boot menu, allowing you to boot them in case
6503 something went wrong with the latest generation. Reassuring, no? The
6504 @command{guix system list-generations} command lists the system
6505 generations available on disk.
6506
6507 @unnumberedsubsubsec The Programming Interface
6508
6509 At the Scheme level, the bulk of an @code{operating-system} declaration
6510 is instantiated with the following monadic procedure (@pxref{The Store
6511 Monad}):
6512
6513 @deffn {Monadic Procedure} operating-system-derivation os
6514 Return a derivation that builds @var{os}, an @code{operating-system}
6515 object (@pxref{Derivations}).
6516
6517 The output of the derivation is a single directory that refers to all
6518 the packages, configuration files, and other supporting files needed to
6519 instantiate @var{os}.
6520 @end deffn
6521
6522 This procedure is provided by the @code{(gnu system)} module. Along
6523 with @code{(gnu services)} (@pxref{Services}), this module contains the
6524 guts of GuixSD. Make sure to visit it!
6525
6526
6527 @node operating-system Reference
6528 @subsection @code{operating-system} Reference
6529
6530 This section summarizes all the options available in
6531 @code{operating-system} declarations (@pxref{Using the Configuration
6532 System}).
6533
6534 @deftp {Data Type} operating-system
6535 This is the data type representing an operating system configuration.
6536 By that, we mean all the global system configuration, not per-user
6537 configuration (@pxref{Using the Configuration System}).
6538
6539 @table @asis
6540 @item @code{kernel} (default: @var{linux-libre})
6541 The package object of the operating system kernel to use@footnote{Currently
6542 only the Linux-libre kernel is supported. In the future, it will be
6543 possible to use the GNU@tie{}Hurd.}.
6544
6545 @item @code{kernel-arguments} (default: @code{'()})
6546 List of strings or gexps representing additional arguments to pass on
6547 the command-line of the kernel---e.g., @code{("console=ttyS0")}.
6548
6549 @item @code{bootloader}
6550 The system bootloader configuration object. @xref{GRUB Configuration}.
6551
6552 @item @code{initrd} (default: @code{base-initrd})
6553 A two-argument monadic procedure that returns an initial RAM disk for
6554 the Linux kernel. @xref{Initial RAM Disk}.
6555
6556 @item @code{firmware} (default: @var{%base-firmware})
6557 @cindex firmware
6558 List of firmware packages loadable by the operating system kernel.
6559
6560 The default includes firmware needed for Atheros-based WiFi devices
6561 (Linux-libre module @code{ath9k}). @xref{Hardware Considerations}, for
6562 more info on supported hardware.
6563
6564 @item @code{host-name}
6565 The host name.
6566
6567 @item @code{hosts-file}
6568 @cindex hosts file
6569 A file-like object (@pxref{G-Expressions, file-like objects}) for use as
6570 @file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
6571 Reference Manual}). The default is a file with entries for
6572 @code{localhost} and @var{host-name}.
6573
6574 @item @code{mapped-devices} (default: @code{'()})
6575 A list of mapped devices. @xref{Mapped Devices}.
6576
6577 @item @code{file-systems}
6578 A list of file systems. @xref{File Systems}.
6579
6580 @item @code{swap-devices} (default: @code{'()})
6581 @cindex swap devices
6582 A list of strings identifying devices to be used for ``swap space''
6583 (@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
6584 For example, @code{'("/dev/sda3")}.
6585
6586 @item @code{users} (default: @code{%base-user-accounts})
6587 @itemx @code{groups} (default: @var{%base-groups})
6588 List of user accounts and groups. @xref{User Accounts}.
6589
6590 @item @code{skeletons} (default: @code{(default-skeletons)})
6591 A list target file name/file-like object tuples (@pxref{G-Expressions,
6592 file-like objects}). These are the skeleton files that will be added to
6593 the home directory of newly-created user accounts.
6594
6595 For instance, a valid value may look like this:
6596
6597 @example
6598 `((".bashrc" ,(plain-file "bashrc" "echo Hello\n"))
6599 (".guile" ,(plain-file "guile"
6600 "(use-modules (ice-9 readline))
6601 (activate-readline)")))
6602 @end example
6603
6604 @item @code{issue} (default: @var{%default-issue})
6605 A string denoting the contents of the @file{/etc/issue} file, which is
6606 displayed when users log in on a text console.
6607
6608 @item @code{packages} (default: @var{%base-packages})
6609 The set of packages installed in the global profile, which is accessible
6610 at @file{/run/current-system/profile}.
6611
6612 The default set includes core utilities and it is good practice to
6613 install non-core utilities in user profiles (@pxref{Invoking guix
6614 package}).
6615
6616 @item @code{timezone}
6617 A timezone identifying string---e.g., @code{"Europe/Paris"}.
6618
6619 You can run the @command{tzselect} command to find out which timezone
6620 string corresponds to your region. Choosing an invalid timezone name
6621 causes @command{guix system} to fail.
6622
6623 @item @code{locale} (default: @code{"en_US.utf8"})
6624 The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
6625 Library Reference Manual}). @xref{Locales}, for more information.
6626
6627 @item @code{locale-definitions} (default: @var{%default-locale-definitions})
6628 The list of locale definitions to be compiled and that may be used at
6629 run time. @xref{Locales}.
6630
6631 @item @code{locale-libcs} (default: @code{(list @var{glibc})})
6632 The list of GNU@tie{}libc packages whose locale data and tools are used
6633 to build the locale definitions. @xref{Locales}, for compatibility
6634 considerations that justify this option.
6635
6636 @item @code{name-service-switch} (default: @var{%default-nss})
6637 Configuration of the libc name service switch (NSS)---a
6638 @code{<name-service-switch>} object. @xref{Name Service Switch}, for
6639 details.
6640
6641 @item @code{services} (default: @var{%base-services})
6642 A list of service objects denoting system services. @xref{Services}.
6643
6644 @item @code{pam-services} (default: @code{(base-pam-services)})
6645 @cindex PAM
6646 @cindex pluggable authentication modules
6647 Linux @dfn{pluggable authentication module} (PAM) services.
6648 @c FIXME: Add xref to PAM services section.
6649
6650 @item @code{setuid-programs} (default: @var{%setuid-programs})
6651 List of string-valued G-expressions denoting setuid programs.
6652 @xref{Setuid Programs}.
6653
6654 @item @code{sudoers-file} (default: @var{%sudoers-specification})
6655 @cindex sudoers file
6656 The contents of the @file{/etc/sudoers} file as a file-like object
6657 (@pxref{G-Expressions, @code{local-file} and @code{plain-file}}).
6658
6659 This file specifies which users can use the @command{sudo} command, what
6660 they are allowed to do, and what privileges they may gain. The default
6661 is that only @code{root} and members of the @code{wheel} group may use
6662 @code{sudo}.
6663
6664 @end table
6665 @end deftp
6666
6667 @node File Systems
6668 @subsection File Systems
6669
6670 The list of file systems to be mounted is specified in the
6671 @code{file-systems} field of the operating system declaration
6672 (@pxref{Using the Configuration System}). Each file system is declared
6673 using the @code{file-system} form, like this:
6674
6675 @example
6676 (file-system
6677 (mount-point "/home")
6678 (device "/dev/sda3")
6679 (type "ext4"))
6680 @end example
6681
6682 As usual, some of the fields are mandatory---those shown in the example
6683 above---while others can be omitted. These are described below.
6684
6685 @deftp {Data Type} file-system
6686 Objects of this type represent file systems to be mounted. They
6687 contain the following members:
6688
6689 @table @asis
6690 @item @code{type}
6691 This is a string specifying the type of the file system---e.g.,
6692 @code{"ext4"}.
6693
6694 @item @code{mount-point}
6695 This designates the place where the file system is to be mounted.
6696
6697 @item @code{device}
6698 This names the ``source'' of the file system. By default it is the name
6699 of a node under @file{/dev}, but its meaning depends on the @code{title}
6700 field described below.
6701
6702 @item @code{title} (default: @code{'device})
6703 This is a symbol that specifies how the @code{device} field is to be
6704 interpreted.
6705
6706 When it is the symbol @code{device}, then the @code{device} field is
6707 interpreted as a file name; when it is @code{label}, then @code{device}
6708 is interpreted as a partition label name; when it is @code{uuid},
6709 @code{device} is interpreted as a partition unique identifier (UUID).
6710
6711 UUIDs may be converted from their string representation (as shown by the
6712 @command{tune2fs -l} command) using the @code{uuid} form@footnote{The
6713 @code{uuid} form expects 16-byte UUIDs as defined in
6714 @uref{https://tools.ietf.org/html/rfc4122, RFC@tie{}4122}. This is the
6715 form of UUID used by the ext2 family of file systems and others, but it
6716 is different from ``UUIDs'' found in FAT file systems, for instance.},
6717 like this:
6718
6719 @example
6720 (file-system
6721 (mount-point "/home")
6722 (type "ext4")
6723 (title 'uuid)
6724 (device (uuid "4dab5feb-d176-45de-b287-9b0a6e4c01cb")))
6725 @end example
6726
6727 The @code{label} and @code{uuid} options offer a way to refer to disk
6728 partitions without having to hard-code their actual device
6729 name@footnote{Note that, while it is tempting to use
6730 @file{/dev/disk/by-uuid} and similar device names to achieve the same
6731 result, this is not recommended: These special device nodes are created
6732 by the udev daemon and may be unavailable at the time the device is
6733 mounted.}.
6734
6735 However, when the source of a file system is a mapped device (@pxref{Mapped
6736 Devices}), its @code{device} field @emph{must} refer to the mapped
6737 device name---e.g., @file{/dev/mapper/root-partition}---and consequently
6738 @code{title} must be set to @code{'device}. This is required so that
6739 the system knows that mounting the file system depends on having the
6740 corresponding device mapping established.
6741
6742 @item @code{flags} (default: @code{'()})
6743 This is a list of symbols denoting mount flags. Recognized flags
6744 include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
6745 access to special files), @code{no-suid} (ignore setuid and setgid
6746 bits), and @code{no-exec} (disallow program execution.)
6747
6748 @item @code{options} (default: @code{#f})
6749 This is either @code{#f}, or a string denoting mount options.
6750
6751 @item @code{mount?} (default: @code{#t})
6752 This value indicates whether to automatically mount the file system when
6753 the system is brought up. When set to @code{#f}, the file system gets
6754 an entry in @file{/etc/fstab} (read by the @command{mount} command) but
6755 is not automatically mounted.
6756
6757 @item @code{needed-for-boot?} (default: @code{#f})
6758 This Boolean value indicates whether the file system is needed when
6759 booting. If that is true, then the file system is mounted when the
6760 initial RAM disk (initrd) is loaded. This is always the case, for
6761 instance, for the root file system.
6762
6763 @item @code{check?} (default: @code{#t})
6764 This Boolean indicates whether the file system needs to be checked for
6765 errors before being mounted.
6766
6767 @item @code{create-mount-point?} (default: @code{#f})
6768 When true, the mount point is created if it does not exist yet.
6769
6770 @item @code{dependencies} (default: @code{'()})
6771 This is a list of @code{<file-system>} objects representing file systems
6772 that must be mounted before (and unmounted after) this one.
6773
6774 As an example, consider a hierarchy of mounts: @file{/sys/fs/cgroup} is
6775 a dependency of @file{/sys/fs/cgroup/cpu} and
6776 @file{/sys/fs/cgroup/memory}.
6777
6778 @end table
6779 @end deftp
6780
6781 The @code{(gnu system file-systems)} exports the following useful
6782 variables.
6783
6784 @defvr {Scheme Variable} %base-file-systems
6785 These are essential file systems that are required on normal systems,
6786 such as @var{%pseudo-terminal-file-system} and @var{%immutable-store} (see
6787 below.) Operating system declarations should always contain at least
6788 these.
6789 @end defvr
6790
6791 @defvr {Scheme Variable} %pseudo-terminal-file-system
6792 This is the file system to be mounted as @file{/dev/pts}. It supports
6793 @dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
6794 functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
6795 Manual}). Pseudo-terminals are used by terminal emulators such as
6796 @command{xterm}.
6797 @end defvr
6798
6799 @defvr {Scheme Variable} %shared-memory-file-system
6800 This file system is mounted as @file{/dev/shm} and is used to support
6801 memory sharing across processes (@pxref{Memory-mapped I/O,
6802 @code{shm_open},, libc, The GNU C Library Reference Manual}).
6803 @end defvr
6804
6805 @defvr {Scheme Variable} %immutable-store
6806 This file system performs a read-only ``bind mount'' of
6807 @file{/gnu/store}, making it read-only for all the users including
6808 @code{root}. This prevents against accidental modification by software
6809 running as @code{root} or by system administrators.
6810
6811 The daemon itself is still able to write to the store: it remounts it
6812 read-write in its own ``name space.''
6813 @end defvr
6814
6815 @defvr {Scheme Variable} %binary-format-file-system
6816 The @code{binfmt_misc} file system, which allows handling of arbitrary
6817 executable file types to be delegated to user space. This requires the
6818 @code{binfmt.ko} kernel module to be loaded.
6819 @end defvr
6820
6821 @defvr {Scheme Variable} %fuse-control-file-system
6822 The @code{fusectl} file system, which allows unprivileged users to mount
6823 and unmount user-space FUSE file systems. This requires the
6824 @code{fuse.ko} kernel module to be loaded.
6825 @end defvr
6826
6827 @node Mapped Devices
6828 @subsection Mapped Devices
6829
6830 @cindex device mapping
6831 @cindex mapped devices
6832 The Linux kernel has a notion of @dfn{device mapping}: a block device,
6833 such as a hard disk partition, can be @dfn{mapped} into another device,
6834 with additional processing over the data that flows through
6835 it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
6836 concept of a ``mapped device'' and that of a file system: both boil down
6837 to @emph{translating} input/output operations made on a file to
6838 operations on its backing store. Thus, the Hurd implements mapped
6839 devices, like file systems, using the generic @dfn{translator} mechanism
6840 (@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
6841 typical example is encryption device mapping: all writes to the mapped
6842 device are encrypted, and all reads are deciphered, transparently.
6843
6844 Mapped devices are declared using the @code{mapped-device} form:
6845
6846 @example
6847 (mapped-device
6848 (source "/dev/sda3")
6849 (target "home")
6850 (type luks-device-mapping))
6851 @end example
6852
6853 Or, better yet, like this:
6854
6855 @example
6856 (mapped-device
6857 (source (uuid "cb67fc72-0d54-4c88-9d4b-b225f30b0f44"))
6858 (target "home")
6859 (type luks-device-mapping))
6860 @end example
6861
6862 @cindex disk encryption
6863 @cindex LUKS
6864 This example specifies a mapping from @file{/dev/sda3} to
6865 @file{/dev/mapper/home} using LUKS---the
6866 @url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
6867 standard mechanism for disk encryption. In the second example, the UUID
6868 (unique identifier) is the LUKS UUID returned for the device by a
6869 command like:
6870
6871 @example
6872 cryptsetup luksUUID /dev/sdx9
6873 @end example
6874
6875 The @file{/dev/mapper/home}
6876 device can then be used as the @code{device} of a @code{file-system}
6877 declaration (@pxref{File Systems}). The @code{mapped-device} form is
6878 detailed below.
6879
6880 @deftp {Data Type} mapped-device
6881 Objects of this type represent device mappings that will be made when
6882 the system boots up.
6883
6884 @table @code
6885 @item source
6886 This string specifies the name of the block device to be mapped, such as
6887 @code{"/dev/sda3"}.
6888
6889 @item target
6890 This string specifies the name of the mapping to be established. For
6891 example, specifying @code{"my-partition"} will lead to the creation of
6892 the @code{"/dev/mapper/my-partition"} device.
6893
6894 @item type
6895 This must be a @code{mapped-device-kind} object, which specifies how
6896 @var{source} is mapped to @var{target}.
6897 @end table
6898 @end deftp
6899
6900 @defvr {Scheme Variable} luks-device-mapping
6901 This defines LUKS block device encryption using the @command{cryptsetup}
6902 command from the package with the same name. It relies on the
6903 @code{dm-crypt} Linux kernel module.
6904 @end defvr
6905
6906 @node User Accounts
6907 @subsection User Accounts
6908
6909 User accounts and groups are entirely managed through the
6910 @code{operating-system} declaration. They are specified with the
6911 @code{user-account} and @code{user-group} forms:
6912
6913 @example
6914 (user-account
6915 (name "alice")
6916 (group "users")
6917 (supplementary-groups '("wheel" ;allow use of sudo, etc.
6918 "audio" ;sound card
6919 "video" ;video devices such as webcams
6920 "cdrom")) ;the good ol' CD-ROM
6921 (comment "Bob's sister")
6922 (home-directory "/home/alice"))
6923 @end example
6924
6925 When booting or upon completion of @command{guix system reconfigure},
6926 the system ensures that only the user accounts and groups specified in
6927 the @code{operating-system} declaration exist, and with the specified
6928 properties. Thus, account or group creations or modifications made by
6929 directly invoking commands such as @command{useradd} are lost upon
6930 reconfiguration or reboot. This ensures that the system remains exactly
6931 as declared.
6932
6933 @deftp {Data Type} user-account
6934 Objects of this type represent user accounts. The following members may
6935 be specified:
6936
6937 @table @asis
6938 @item @code{name}
6939 The name of the user account.
6940
6941 @item @code{group}
6942 This is the name (a string) or identifier (a number) of the user group
6943 this account belongs to.
6944
6945 @item @code{supplementary-groups} (default: @code{'()})
6946 Optionally, this can be defined as a list of group names that this
6947 account belongs to.
6948
6949 @item @code{uid} (default: @code{#f})
6950 This is the user ID for this account (a number), or @code{#f}. In the
6951 latter case, a number is automatically chosen by the system when the
6952 account is created.
6953
6954 @item @code{comment} (default: @code{""})
6955 A comment about the account, such as the account owner's full name.
6956
6957 @item @code{home-directory}
6958 This is the name of the home directory for the account.
6959
6960 @item @code{shell} (default: Bash)
6961 This is a G-expression denoting the file name of a program to be used as
6962 the shell (@pxref{G-Expressions}).
6963
6964 @item @code{system?} (default: @code{#f})
6965 This Boolean value indicates whether the account is a ``system''
6966 account. System accounts are sometimes treated specially; for instance,
6967 graphical login managers do not list them.
6968
6969 @anchor{user-account-password}
6970 @item @code{password} (default: @code{#f})
6971 You would normally leave this field to @code{#f}, initialize user
6972 passwords as @code{root} with the @command{passwd} command, and then let
6973 users change it with @command{passwd}. Passwords set with
6974 @command{passwd} are of course preserved across reboot and
6975 reconfiguration.
6976
6977 If you @emph{do} want to have a preset password for an account, then
6978 this field must contain the encrypted password, as a string.
6979 @xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
6980 on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
6981 Manual}, for information on Guile's @code{crypt} procedure.
6982
6983 @end table
6984 @end deftp
6985
6986 User group declarations are even simpler:
6987
6988 @example
6989 (user-group (name "students"))
6990 @end example
6991
6992 @deftp {Data Type} user-group
6993 This type is for, well, user groups. There are just a few fields:
6994
6995 @table @asis
6996 @item @code{name}
6997 The name of the group.
6998
6999 @item @code{id} (default: @code{#f})
7000 The group identifier (a number). If @code{#f}, a new number is
7001 automatically allocated when the group is created.
7002
7003 @item @code{system?} (default: @code{#f})
7004 This Boolean value indicates whether the group is a ``system'' group.
7005 System groups have low numerical IDs.
7006
7007 @item @code{password} (default: @code{#f})
7008 What, user groups can have a password? Well, apparently yes. Unless
7009 @code{#f}, this field specifies the password of the group.
7010
7011 @end table
7012 @end deftp
7013
7014 For convenience, a variable lists all the basic user groups one may
7015 expect:
7016
7017 @defvr {Scheme Variable} %base-groups
7018 This is the list of basic user groups that users and/or packages expect
7019 to be present on the system. This includes groups such as ``root'',
7020 ``wheel'', and ``users'', as well as groups used to control access to
7021 specific devices such as ``audio'', ``disk'', and ``cdrom''.
7022 @end defvr
7023
7024 @defvr {Scheme Variable} %base-user-accounts
7025 This is the list of basic system accounts that programs may expect to
7026 find on a GNU/Linux system, such as the ``nobody'' account.
7027
7028 Note that the ``root'' account is not included here. It is a
7029 special-case and is automatically added whether or not it is specified.
7030 @end defvr
7031
7032 @node Locales
7033 @subsection Locales
7034
7035 @cindex locale
7036 A @dfn{locale} defines cultural conventions for a particular language
7037 and region of the world (@pxref{Locales,,, libc, The GNU C Library
7038 Reference Manual}). Each locale has a name that typically has the form
7039 @code{@var{language}_@var{territory}.@var{codeset}}---e.g.,
7040 @code{fr_LU.utf8} designates the locale for the French language, with
7041 cultural conventions from Luxembourg, and using the UTF-8 encoding.
7042
7043 @cindex locale definition
7044 Usually, you will want to specify the default locale for the machine
7045 using the @code{locale} field of the @code{operating-system} declaration
7046 (@pxref{operating-system Reference, @code{locale}}).
7047
7048 The selected locale is automatically added to the @dfn{locale
7049 definitions} known to the system if needed, with its codeset inferred
7050 from its name---e.g., @code{bo_CN.utf8} will be assumed to use the
7051 @code{UTF-8} codeset. Additional locale definitions can be specified in
7052 the @code{locale-definitions} slot of @code{operating-system}---this is
7053 useful, for instance, if the codeset could not be inferred from the
7054 locale name. The default set of locale definitions includes some widely
7055 used locales, but not all the available locales, in order to save space.
7056
7057 For instance, to add the North Frisian locale for Germany, the value of
7058 that field may be:
7059
7060 @example
7061 (cons (locale-definition
7062 (name "fy_DE.utf8") (source "fy_DE"))
7063 %default-locale-definitions)
7064 @end example
7065
7066 Likewise, to save space, one might want @code{locale-definitions} to
7067 list only the locales that are actually used, as in:
7068
7069 @example
7070 (list (locale-definition
7071 (name "ja_JP.eucjp") (source "ja_JP")
7072 (charset "EUC-JP")))
7073 @end example
7074
7075 @vindex LOCPATH
7076 The compiled locale definitions are available at
7077 @file{/run/current-system/locale/X.Y}, where @code{X.Y} is the libc
7078 version, which is the default location where the GNU@tie{}libc provided
7079 by Guix looks for locale data. This can be overridden using the
7080 @code{LOCPATH} environment variable (@pxref{locales-and-locpath,
7081 @code{LOCPATH} and locale packages}).
7082
7083 The @code{locale-definition} form is provided by the @code{(gnu system
7084 locale)} module. Details are given below.
7085
7086 @deftp {Data Type} locale-definition
7087 This is the data type of a locale definition.
7088
7089 @table @asis
7090
7091 @item @code{name}
7092 The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
7093 Reference Manual}, for more information on locale names.
7094
7095 @item @code{source}
7096 The name of the source for that locale. This is typically the
7097 @code{@var{language}_@var{territory}} part of the locale name.
7098
7099 @item @code{charset} (default: @code{"UTF-8"})
7100 The ``character set'' or ``code set'' for that locale,
7101 @uref{http://www.iana.org/assignments/character-sets, as defined by
7102 IANA}.
7103
7104 @end table
7105 @end deftp
7106
7107 @defvr {Scheme Variable} %default-locale-definitions
7108 A list of commonly used UTF-8 locales, used as the default
7109 value of the @code{locale-definitions} field of @code{operating-system}
7110 declarations.
7111
7112 @cindex locale name
7113 @cindex normalized codeset in locale names
7114 These locale definitions use the @dfn{normalized codeset} for the part
7115 that follows the dot in the name (@pxref{Using gettextized software,
7116 normalized codeset,, libc, The GNU C Library Reference Manual}). So for
7117 instance it has @code{uk_UA.utf8} but @emph{not}, say,
7118 @code{uk_UA.UTF-8}.
7119 @end defvr
7120
7121 @subsubsection Locale Data Compatibility Considerations
7122
7123 @cindex incompatibility, of locale data
7124 @code{operating-system} declarations provide a @code{locale-libcs} field
7125 to specify the GNU@tie{}libc packages that are used to compile locale
7126 declarations (@pxref{operating-system Reference}). ``Why would I
7127 care?'', you may ask. Well, it turns out that the binary format of
7128 locale data is occasionally incompatible from one libc version to
7129 another.
7130
7131 @c See <https://sourceware.org/ml/libc-alpha/2015-09/msg00575.html>
7132 @c and <https://lists.gnu.org/archive/html/guix-devel/2015-08/msg00737.html>.
7133 For instance, a program linked against libc version 2.21 is unable to
7134 read locale data produced with libc 2.22; worse, that program
7135 @emph{aborts} instead of simply ignoring the incompatible locale
7136 data@footnote{Versions 2.23 and later of GNU@tie{}libc will simply skip
7137 the incompatible locale data, which is already an improvement.}.
7138 Similarly, a program linked against libc 2.22 can read most, but not
7139 all, the locale data from libc 2.21 (specifically, @code{LC_COLLATE}
7140 data is incompatible); thus calls to @code{setlocale} may fail, but
7141 programs will not abort.
7142
7143 The ``problem'' in GuixSD is that users have a lot of freedom: They can
7144 choose whether and when to upgrade software in their profiles, and might
7145 be using a libc version different from the one the system administrator
7146 used to build the system-wide locale data.
7147
7148 Fortunately, unprivileged users can also install their own locale data
7149 and define @var{GUIX_LOCPATH} accordingly (@pxref{locales-and-locpath,
7150 @code{GUIX_LOCPATH} and locale packages}).
7151
7152 Still, it is best if the system-wide locale data at
7153 @file{/run/current-system/locale} is built for all the libc versions
7154 actually in use on the system, so that all the programs can access
7155 it---this is especially crucial on a multi-user system. To do that, the
7156 administrator can specify several libc packages in the
7157 @code{locale-libcs} field of @code{operating-system}:
7158
7159 @example
7160 (use-package-modules base)
7161
7162 (operating-system
7163 ;; @dots{}
7164 (locale-libcs (list glibc-2.21 (canonical-package glibc))))
7165 @end example
7166
7167 This example would lead to a system containing locale definitions for
7168 both libc 2.21 and the current version of libc in
7169 @file{/run/current-system/locale}.
7170
7171
7172 @node Services
7173 @subsection Services
7174
7175 @cindex system services
7176 An important part of preparing an @code{operating-system} declaration is
7177 listing @dfn{system services} and their configuration (@pxref{Using the
7178 Configuration System}). System services are typically daemons launched
7179 when the system boots, or other actions needed at that time---e.g.,
7180 configuring network access.
7181
7182 Services are managed by the GNU@tie{}Shepherd (@pxref{Introduction,,,
7183 shepherd, The GNU Shepherd Manual}). On a running system, the
7184 @command{herd} command allows you to list the available services, show
7185 their status, start and stop them, or do other specific operations
7186 (@pxref{Jump Start,,, shepherd, The GNU Shepherd Manual}). For example:
7187
7188 @example
7189 # herd status
7190 @end example
7191
7192 The above command, run as @code{root}, lists the currently defined
7193 services. The @command{herd doc} command shows a synopsis of the given
7194 service:
7195
7196 @example
7197 # herd doc nscd
7198 Run libc's name service cache daemon (nscd).
7199 @end example
7200
7201 The @command{start}, @command{stop}, and @command{restart} sub-commands
7202 have the effect you would expect. For instance, the commands below stop
7203 the nscd service and restart the Xorg display server:
7204
7205 @example
7206 # herd stop nscd
7207 Service nscd has been stopped.
7208 # herd restart xorg-server
7209 Service xorg-server has been stopped.
7210 Service xorg-server has been started.
7211 @end example
7212
7213 The following sections document the available services, starting with
7214 the core services, that may be used in an @code{operating-system}
7215 declaration.
7216
7217 @menu
7218 * Base Services:: Essential system services.
7219 * Scheduled Job Execution:: The mcron service.
7220 * Networking Services:: Network setup, SSH daemon, etc.
7221 * X Window:: Graphical display.
7222 * Desktop Services:: D-Bus and desktop services.
7223 * Database Services:: SQL databases.
7224 * Mail Services:: IMAP, POP3, SMTP, and all that.
7225 * Web Services:: Web servers.
7226 * Various Services:: Other services.
7227 @end menu
7228
7229 @node Base Services
7230 @subsubsection Base Services
7231
7232 The @code{(gnu services base)} module provides definitions for the basic
7233 services that one expects from the system. The services exported by
7234 this module are listed below.
7235
7236 @defvr {Scheme Variable} %base-services
7237 This variable contains a list of basic services (@pxref{Service Types
7238 and Services}, for more information on service objects) one would
7239 expect from the system: a login service (mingetty) on each tty, syslogd,
7240 the libc name service cache daemon (nscd), the udev device manager, and
7241 more.
7242
7243 This is the default value of the @code{services} field of
7244 @code{operating-system} declarations. Usually, when customizing a
7245 system, you will want to append services to @var{%base-services}, like
7246 this:
7247
7248 @example
7249 (cons* (avahi-service) (lsh-service) %base-services)
7250 @end example
7251 @end defvr
7252
7253 @deffn {Scheme Procedure} host-name-service @var{name}
7254 Return a service that sets the host name to @var{name}.
7255 @end deffn
7256
7257 @deffn {Scheme Procedure} mingetty-service @var{config}
7258 Return a service to run mingetty according to @var{config}, a
7259 @code{<mingetty-configuration>} object, which specifies the tty to run, among
7260 other things.
7261 @end deffn
7262
7263 @deftp {Data Type} mingetty-configuration
7264 This is the data type representing the configuration of Mingetty, which
7265 implements console log-in.
7266
7267 @table @asis
7268
7269 @item @code{tty}
7270 The name of the console this Mingetty runs on---e.g., @code{"tty1"}.
7271
7272 @item @code{motd}
7273 A file-like object containing the ``message of the day''.
7274
7275 @item @code{auto-login} (default: @code{#f})
7276 When true, this field must be a string denoting the user name under
7277 which the system automatically logs in. When it is @code{#f}, a
7278 user name and password must be entered to log in.
7279
7280 @item @code{login-program} (default: @code{#f})
7281 This must be either @code{#f}, in which case the default log-in program
7282 is used (@command{login} from the Shadow tool suite), or a gexp denoting
7283 the name of the log-in program.
7284
7285 @item @code{login-pause?} (default: @code{#f})
7286 When set to @code{#t} in conjunction with @var{auto-login}, the user
7287 will have to press a key before the log-in shell is launched.
7288
7289 @item @code{mingetty} (default: @var{mingetty})
7290 The Mingetty package to use.
7291
7292 @end table
7293 @end deftp
7294
7295 @cindex name service cache daemon
7296 @cindex nscd
7297 @deffn {Scheme Procedure} nscd-service [@var{config}] [#:glibc glibc] @
7298 [#:name-services '()]
7299 Return a service that runs the libc name service cache daemon (nscd) with the
7300 given @var{config}---an @code{<nscd-configuration>} object. @xref{Name
7301 Service Switch}, for an example.
7302 @end deffn
7303
7304 @defvr {Scheme Variable} %nscd-default-configuration
7305 This is the default @code{<nscd-configuration>} value (see below) used
7306 by @code{nscd-service}. It uses the caches defined by
7307 @var{%nscd-default-caches}; see below.
7308 @end defvr
7309
7310 @deftp {Data Type} nscd-configuration
7311 This is the data type representing the name service cache daemon (nscd)
7312 configuration.
7313
7314 @table @asis
7315
7316 @item @code{name-services} (default: @code{'()})
7317 List of packages denoting @dfn{name services} that must be visible to
7318 the nscd---e.g., @code{(list @var{nss-mdns})}.
7319
7320 @item @code{glibc} (default: @var{glibc})
7321 Package object denoting the GNU C Library providing the @command{nscd}
7322 command.
7323
7324 @item @code{log-file} (default: @code{"/var/log/nscd.log"})
7325 Name of the nscd log file. This is where debugging output goes when
7326 @code{debug-level} is strictly positive.
7327
7328 @item @code{debug-level} (default: @code{0})
7329 Integer denoting the debugging levels. Higher numbers mean that more
7330 debugging output is logged.
7331
7332 @item @code{caches} (default: @var{%nscd-default-caches})
7333 List of @code{<nscd-cache>} objects denoting things to be cached; see
7334 below.
7335
7336 @end table
7337 @end deftp
7338
7339 @deftp {Data Type} nscd-cache
7340 Data type representing a cache database of nscd and its parameters.
7341
7342 @table @asis
7343
7344 @item @code{database}
7345 This is a symbol representing the name of the database to be cached.
7346 Valid values are @code{passwd}, @code{group}, @code{hosts}, and
7347 @code{services}, which designate the corresponding NSS database
7348 (@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
7349
7350 @item @code{positive-time-to-live}
7351 @itemx @code{negative-time-to-live} (default: @code{20})
7352 A number representing the number of seconds during which a positive or
7353 negative lookup result remains in cache.
7354
7355 @item @code{check-files?} (default: @code{#t})
7356 Whether to check for updates of the files corresponding to
7357 @var{database}.
7358
7359 For instance, when @var{database} is @code{hosts}, setting this flag
7360 instructs nscd to check for updates in @file{/etc/hosts} and to take
7361 them into account.
7362
7363 @item @code{persistent?} (default: @code{#t})
7364 Whether the cache should be stored persistently on disk.
7365
7366 @item @code{shared?} (default: @code{#t})
7367 Whether the cache should be shared among users.
7368
7369 @item @code{max-database-size} (default: 32@tie{}MiB)
7370 Maximum size in bytes of the database cache.
7371
7372 @c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
7373 @c settings, so leave them out.
7374
7375 @end table
7376 @end deftp
7377
7378 @defvr {Scheme Variable} %nscd-default-caches
7379 List of @code{<nscd-cache>} objects used by default by
7380 @code{nscd-configuration} (see above).
7381
7382 It enables persistent and aggressive caching of service and host name
7383 lookups. The latter provides better host name lookup performance,
7384 resilience in the face of unreliable name servers, and also better
7385 privacy---often the result of host name lookups is in local cache, so
7386 external name servers do not even need to be queried.
7387 @end defvr
7388
7389
7390 @deffn {Scheme Procedure} syslog-service @
7391 [#:config-file @var{%default-syslog.conf}]
7392 Return a service that runs @command{syslogd}. If the configuration file
7393 name @var{config-file} is not specified, use some reasonable default
7394 settings.
7395
7396 @xref{syslogd invocation,,, inetutils, GNU Inetutils}, for more
7397 information on the configuration file syntax.
7398 @end deffn
7399
7400 @anchor{guix-configuration-type}
7401 @deftp {Data Type} guix-configuration
7402 This data type represents the configuration of the Guix build daemon.
7403 @xref{Invoking guix-daemon}, for more information.
7404
7405 @table @asis
7406 @item @code{guix} (default: @var{guix})
7407 The Guix package to use.
7408
7409 @item @code{build-group} (default: @code{"guixbuild"})
7410 Name of the group for build user accounts.
7411
7412 @item @code{build-accounts} (default: @code{10})
7413 Number of build user accounts to create.
7414
7415 @item @code{authorize-key?} (default: @code{#t})
7416 Whether to authorize the substitute key for @code{hydra.gnu.org}
7417 (@pxref{Substitutes}).
7418
7419 @item @code{use-substitutes?} (default: @code{#t})
7420 Whether to use substitutes.
7421
7422 @item @code{substitute-urls} (default: @var{%default-substitute-urls})
7423 The list of URLs where to look for substitutes by default.
7424
7425 @item @code{extra-options} (default: @code{'()})
7426 List of extra command-line options for @command{guix-daemon}.
7427
7428 @item @code{lsof} (default: @var{lsof})
7429 @itemx @code{lsh} (default: @var{lsh})
7430 The lsof and lsh packages to use.
7431
7432 @end table
7433 @end deftp
7434
7435 @deffn {Scheme Procedure} guix-service @var{config}
7436 Return a service that runs the Guix build daemon according to
7437 @var{config}.
7438 @end deffn
7439
7440 @deffn {Scheme Procedure} udev-service [#:udev udev]
7441 Run @var{udev}, which populates the @file{/dev} directory dynamically.
7442 @end deffn
7443
7444 @deffn {Scheme Procedure} urandom-seed-service @var{#f}
7445 Save some entropy in @var{%random-seed-file} to seed @file{/dev/urandom}
7446 when rebooting.
7447 @end deffn
7448
7449 @defvr {Scheme Variable} %random-seed-file
7450 This is the name of the file where some random bytes are saved by
7451 @var{urandom-seed-service} to seed @file{/dev/urandom} when rebooting.
7452 It defaults to @file{/var/lib/random-seed}.
7453 @end defvr
7454
7455 @deffn {Scheme Procedure} console-keymap-service @var{files} ...
7456 @cindex keyboard layout
7457 Return a service to load console keymaps from @var{files} using
7458 @command{loadkeys} command. Most likely, you want to load some default
7459 keymap, which can be done like this:
7460
7461 @example
7462 (console-keymap-service "dvorak")
7463 @end example
7464
7465 Or, for example, for a Swedish keyboard, you may need to combine
7466 the following keymaps:
7467 @example
7468 (console-keymap-service "se-lat6" "se-fi-lat6")
7469 @end example
7470
7471 Also you can specify a full file name (or file names) of your keymap(s).
7472 See @code{man loadkeys} for details.
7473
7474 @end deffn
7475
7476 @deffn {Scheme Procedure} gpm-service [#:gpm @var{gpm}] @
7477 [#:options]
7478 Run @var{gpm}, the general-purpose mouse daemon, with the given
7479 command-line @var{options}. GPM allows users to use the mouse in the console,
7480 notably to select, copy, and paste text. The default value of @var{options}
7481 uses the @code{ps2} protocol, which works for both USB and PS/2 mice.
7482
7483 This service is not part of @var{%base-services}.
7484 @end deffn
7485
7486 @anchor{guix-publish-service}
7487 @deffn {Scheme Procedure} guix-publish-service [#:guix @var{guix}] @
7488 [#:port 80] [#:host "localhost"]
7489 Return a service that runs @command{guix publish} listening on @var{host}
7490 and @var{port} (@pxref{Invoking guix publish}).
7491
7492 This assumes that @file{/etc/guix} already contains a signing key pair as
7493 created by @command{guix archive --generate-key} (@pxref{Invoking guix
7494 archive}). If that is not the case, the service will fail to start.
7495 @end deffn
7496
7497 @anchor{rngd-service}
7498 @deffn {Scheme Procedure} rngd-service [#:rng-tools @var{rng-tools}] @
7499 [#:device "/dev/hwrng"]
7500 Return a service that runs the @command{rngd} program from @var{rng-tools}
7501 to add @var{device} to the kernel's entropy pool. The service will fail if
7502 @var{device} does not exist.
7503 @end deffn
7504
7505 @node Scheduled Job Execution
7506 @subsubsection Scheduled Job Execution
7507
7508 @cindex cron
7509 @cindex scheduling jobs
7510 The @code{(gnu services mcron)} module provides an interface to
7511 GNU@tie{}mcron, a daemon to run jobs at scheduled times (@pxref{Top,,,
7512 mcron, GNU@tie{}mcron}). GNU@tie{}mcron is similar to the traditional
7513 Unix @command{cron} daemon; the main difference is that it is
7514 implemented in Guile Scheme, which provides a lot of flexibility when
7515 specifying the scheduling of jobs and their actions.
7516
7517 The example below defines an operating system that runs the
7518 @command{updatedb} (@pxref{Invoking updatedb,,, find, Finding Files})
7519 and the @command{guix gc} commands (@pxref{Invoking guix gc}) daily, as
7520 well as the @command{mkid} command on behalf of an unprivileged user
7521 (@pxref{mkid invocation,,, idutils, ID Database Utilities}). It uses
7522 gexps to introduce job definitions that are passed to mcron
7523 (@pxref{G-Expressions}).
7524
7525 @lisp
7526 (use-modules (guix) (gnu) (gnu services mcron))
7527 (use-package-modules base idutils)
7528
7529 (define updatedb-job
7530 ;; Run 'updatedb' at 3AM every day. Here we write the
7531 ;; job's action as a Scheme procedure.
7532 #~(job '(next-hour '(3))
7533 (lambda ()
7534 (execl (string-append #$findutils "/bin/updatedb")
7535 "updatedb"
7536 "--prunepaths=/tmp /var/tmp /gnu/store"))))
7537
7538 (define garbage-collector-job
7539 ;; Collect garbage 5 minutes after midnight every day.
7540 ;; The job's action is a shell command.
7541 #~(job "5 0 * * *" ;Vixie cron syntax
7542 "guix gc -F 1G"))
7543
7544 (define idutils-jobs
7545 ;; Update the index database as user "charlie" at 12:15PM
7546 ;; and 19:15PM. This runs from the user's home directory.
7547 #~(job '(next-minute-from (next-hour '(12 19)) '(15))
7548 (string-append #$idutils "/bin/mkid src")
7549 #:user "charlie"))
7550
7551 (operating-system
7552 ;; @dots{}
7553 (services (cons (mcron-service (list garbage-collector-job
7554 updatedb-job
7555 idutils-job))
7556 %base-services)))
7557 @end lisp
7558
7559 @xref{Guile Syntax, mcron job specifications,, mcron, GNU@tie{}mcron},
7560 for more information on mcron job specifications. Below is the
7561 reference of the mcron service.
7562
7563 @deffn {Scheme Procedure} mcron-service @var{jobs} [#:mcron @var{mcron2}]
7564 Return an mcron service running @var{mcron} that schedules @var{jobs}, a
7565 list of gexps denoting mcron job specifications.
7566
7567 This is a shorthand for:
7568 @example
7569 (service mcron-service-type
7570 (mcron-configuration (mcron mcron) (jobs jobs)))
7571 @end example
7572 @end deffn
7573
7574 @defvr {Scheme Variable} mcron-service-type
7575 This is the type of the @code{mcron} service, whose value is an
7576 @code{mcron-configuration} object.
7577
7578 This service type can be the target of a service extension that provides
7579 it additional job specifications (@pxref{Service Composition}). In
7580 other words, it is possible to define services that provide addition
7581 mcron jobs to run.
7582 @end defvr
7583
7584 @deftp {Data Type} mcron-configuration
7585 Data type representing the configuration of mcron.
7586
7587 @table @asis
7588 @item @code{mcron} (default: @var{mcron2})
7589 The mcron package to use.
7590
7591 @item @code{jobs}
7592 This is a list of gexps (@pxref{G-Expressions}), where each gexp
7593 corresponds to an mcron job specification (@pxref{Syntax, mcron job
7594 specifications,, mcron, GNU@tie{}mcron}).
7595 @end table
7596 @end deftp
7597
7598
7599 @node Networking Services
7600 @subsubsection Networking Services
7601
7602 The @code{(gnu services networking)} module provides services to configure
7603 the network interface.
7604
7605 @cindex DHCP, networking service
7606 @deffn {Scheme Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
7607 Return a service that runs @var{dhcp}, a Dynamic Host Configuration
7608 Protocol (DHCP) client, on all the non-loopback network interfaces.
7609 @end deffn
7610
7611 @deffn {Scheme Procedure} static-networking-service @var{interface} @var{ip} @
7612 [#:gateway #f] [#:name-servers @code{'()}]
7613 Return a service that starts @var{interface} with address @var{ip}. If
7614 @var{gateway} is true, it must be a string specifying the default network
7615 gateway.
7616 @end deffn
7617
7618 @cindex wicd
7619 @cindex network management
7620 @deffn {Scheme Procedure} wicd-service [#:wicd @var{wicd}]
7621 Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a network
7622 management daemon that aims to simplify wired and wireless networking.
7623
7624 This service adds the @var{wicd} package to the global profile, providing
7625 several commands to interact with the daemon and configure networking:
7626 @command{wicd-client}, a graphical user interface, and the @command{wicd-cli}
7627 and @command{wicd-curses} user interfaces.
7628 @end deffn
7629
7630 @cindex NetworkManager
7631 @deffn {Scheme Procedure} network-manager-service @
7632 [#:network-manager @var{network-manager}]
7633 Return a service that runs NetworkManager, a network connection manager
7634 attempting to keep network connectivity active when available.
7635 @end deffn
7636
7637 @cindex Connman
7638 @deffn {Scheme Procedure} connman-service @
7639 [#:connman @var{connman}]
7640 Return a service that runs @url{https://01.org/connman,Connman}, a network
7641 connection manager.
7642
7643 This service adds the @var{connman} package to the global profile, providing
7644 several the @command{connmanctl} command to interact with the daemon and
7645 configure networking."
7646 @end deffn
7647
7648 @deffn {Scheme Procedure} ntp-service [#:ntp @var{ntp}] @
7649 [#:name-service @var{%ntp-servers}]
7650 Return a service that runs the daemon from @var{ntp}, the
7651 @uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
7652 keep the system clock synchronized with that of @var{servers}.
7653 @end deffn
7654
7655 @defvr {Scheme Variable} %ntp-servers
7656 List of host names used as the default NTP servers.
7657 @end defvr
7658
7659 @deffn {Scheme Procedure} tor-service [@var{config-file}] [#:tor @var{tor}]
7660 Return a service to run the @uref{https://torproject.org, Tor} anonymous
7661 networking daemon.
7662
7663 The daemon runs as the @code{tor} unprivileged user. It is passed
7664 @var{config-file}, a file-like object, with an additional @code{User tor} line
7665 and lines for hidden services added via @code{tor-hidden-service}. Run
7666 @command{man tor} for information about the configuration file.
7667 @end deffn
7668
7669 @cindex hidden service
7670 @deffn {Scheme Procedure} tor-hidden-service @var{name} @var{mapping}
7671 Define a new Tor @dfn{hidden service} called @var{name} and implementing
7672 @var{mapping}. @var{mapping} is a list of port/host tuples, such as:
7673
7674 @example
7675 '((22 "127.0.0.1:22")
7676 (80 "127.0.0.1:8080"))
7677 @end example
7678
7679 In this example, port 22 of the hidden service is mapped to local port 22, and
7680 port 80 is mapped to local port 8080.
7681
7682 This creates a @file{/var/lib/tor/hidden-services/@var{name}} directory, where
7683 the @file{hostname} file contains the @code{.onion} host name for the hidden
7684 service.
7685
7686 See @uref{https://www.torproject.org/docs/tor-hidden-service.html.en, the Tor
7687 project's documentation} for more information.
7688 @end deffn
7689
7690 @deffn {Scheme Procedure} bitlbee-service [#:bitlbee bitlbee] @
7691 [#:interface "127.0.0.1"] [#:port 6667] @
7692 [#:extra-settings ""]
7693 Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
7694 acts as a gateway between IRC and chat networks.
7695
7696 The daemon will listen to the interface corresponding to the IP address
7697 specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
7698 local clients can connect, whereas @code{0.0.0.0} means that connections can
7699 come from any networking interface.
7700
7701 In addition, @var{extra-settings} specifies a string to append to the
7702 configuration file.
7703 @end deffn
7704
7705 Furthermore, @code{(gnu services ssh)} provides the following service.
7706
7707 @deffn {Scheme Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
7708 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
7709 [#:allow-empty-passwords? #f] [#:root-login? #f] @
7710 [#:syslog-output? #t] [#:x11-forwarding? #t] @
7711 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
7712 [#:public-key-authentication? #t] [#:initialize? #t]
7713 Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
7714 @var{host-key} must designate a file containing the host key, and readable
7715 only by root.
7716
7717 When @var{daemonic?} is true, @command{lshd} will detach from the
7718 controlling terminal and log its output to syslogd, unless one sets
7719 @var{syslog-output?} to false. Obviously, it also makes lsh-service
7720 depend on existence of syslogd service. When @var{pid-file?} is true,
7721 @command{lshd} writes its PID to the file called @var{pid-file}.
7722
7723 When @var{initialize?} is true, automatically create the seed and host key
7724 upon service activation if they do not exist yet. This may take long and
7725 require interaction.
7726
7727 When @var{initialize?} is false, it is up to the user to initialize the
7728 randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
7729 a key pair with the private key stored in file @var{host-key} (@pxref{lshd
7730 basics,,, lsh, LSH Manual}).
7731
7732 When @var{interfaces} is empty, lshd listens for connections on all the
7733 network interfaces; otherwise, @var{interfaces} must be a list of host names
7734 or addresses.
7735
7736 @var{allow-empty-passwords?} specifies whether to accept log-ins with empty
7737 passwords, and @var{root-login?} specifies whether to accept log-ins as
7738 root.
7739
7740 The other options should be self-descriptive.
7741 @end deffn
7742
7743 @defvr {Scheme Variable} %facebook-host-aliases
7744 This variable contains a string for use in @file{/etc/hosts}
7745 (@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
7746 line contains a entry that maps a known server name of the Facebook
7747 on-line service---e.g., @code{www.facebook.com}---to the local
7748 host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
7749
7750 This variable is typically used in the @code{hosts-file} field of an
7751 @code{operating-system} declaration (@pxref{operating-system Reference,
7752 @file{/etc/hosts}}):
7753
7754 @example
7755 (use-modules (gnu) (guix))
7756
7757 (operating-system
7758 (host-name "mymachine")
7759 ;; ...
7760 (hosts-file
7761 ;; Create a /etc/hosts file with aliases for "localhost"
7762 ;; and "mymachine", as well as for Facebook servers.
7763 (plain-file "hosts"
7764 (string-append (local-host-aliases host-name)
7765 %facebook-host-aliases))))
7766 @end example
7767
7768 This mechanism can prevent programs running locally, such as Web
7769 browsers, from accessing Facebook.
7770 @end defvr
7771
7772 The @code{(gnu services avahi)} provides the following definition.
7773
7774 @deffn {Scheme Procedure} avahi-service [#:avahi @var{avahi}] @
7775 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
7776 [#:ipv6? #t] [#:wide-area? #f] @
7777 [#:domains-to-browse '()] [#:debug? #f]
7778 Return a service that runs @command{avahi-daemon}, a system-wide
7779 mDNS/DNS-SD responder that allows for service discovery and
7780 "zero-configuration" host name lookups (see @uref{http://avahi.org/}), and
7781 extends the name service cache daemon (nscd) so that it can resolve
7782 @code{.local} host names using
7783 @uref{http://0pointer.de/lennart/projects/nss-mdns/, nss-mdns}. Additionally,
7784 add the @var{avahi} package to the system profile so that commands such as
7785 @command{avahi-browse} are directly usable.
7786
7787 If @var{host-name} is different from @code{#f}, use that as the host name to
7788 publish for this machine; otherwise, use the machine's actual host name.
7789
7790 When @var{publish?} is true, publishing of host names and services is allowed;
7791 in particular, avahi-daemon will publish the machine's host name and IP
7792 address via mDNS on the local network.
7793
7794 When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
7795
7796 Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
7797 sockets.
7798 @end deffn
7799
7800
7801 @node X Window
7802 @subsubsection X Window
7803
7804 Support for the X Window graphical display system---specifically
7805 Xorg---is provided by the @code{(gnu services xorg)} module. Note that
7806 there is no @code{xorg-service} procedure. Instead, the X server is
7807 started by the @dfn{login manager}, currently SLiM.
7808
7809 @deffn {Scheme Procedure} slim-service [#:allow-empty-passwords? #f] @
7810 [#:auto-login? #f] [#:default-user ""] [#:startx] @
7811 [#:theme @var{%default-slim-theme}] @
7812 [#:theme-name @var{%default-slim-theme-name}]
7813 Return a service that spawns the SLiM graphical login manager, which in
7814 turn starts the X display server with @var{startx}, a command as returned by
7815 @code{xorg-start-command}.
7816
7817 @cindex X session
7818
7819 SLiM automatically looks for session types described by the @file{.desktop}
7820 files in @file{/run/current-system/profile/share/xsessions} and allows users
7821 to choose a session from the log-in screen using @kbd{F1}. Packages such as
7822 @var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
7823 adding them to the system-wide set of packages automatically makes them
7824 available at the log-in screen.
7825
7826 In addition, @file{~/.xsession} files are honored. When available,
7827 @file{~/.xsession} must be an executable that starts a window manager
7828 and/or other X clients.
7829
7830 When @var{allow-empty-passwords?} is true, allow logins with an empty
7831 password. When @var{auto-login?} is true, log in automatically as
7832 @var{default-user}.
7833
7834 If @var{theme} is @code{#f}, use the default log-in theme; otherwise
7835 @var{theme} must be a gexp denoting the name of a directory containing the
7836 theme to use. In that case, @var{theme-name} specifies the name of the
7837 theme.
7838 @end deffn
7839
7840 @defvr {Scheme Variable} %default-theme
7841 @defvrx {Scheme Variable} %default-theme-name
7842 The G-Expression denoting the default SLiM theme and its name.
7843 @end defvr
7844
7845 @deffn {Scheme Procedure} xorg-start-command [#:guile] @
7846 [#:configuration-file #f] [#:xorg-server @var{xorg-server}]
7847 Return a derivation that builds a @var{guile} script to start the X server
7848 from @var{xorg-server}. @var{configuration-file} is the server configuration
7849 file or a derivation that builds it; when omitted, the result of
7850 @code{xorg-configuration-file} is used.
7851
7852 Usually the X server is started by a login manager.
7853 @end deffn
7854
7855 @deffn {Scheme Procedure} xorg-configuration-file @
7856 [#:drivers '()] [#:resolutions '()] [#:extra-config '()]
7857 Return a configuration file for the Xorg server containing search paths for
7858 all the common drivers.
7859
7860 @var{drivers} must be either the empty list, in which case Xorg chooses a
7861 graphics driver automatically, or a list of driver names that will be tried in
7862 this order---e.g., @code{(\"modesetting\" \"vesa\")}.
7863
7864 Likewise, when @var{resolutions} is the empty list, Xorg chooses an
7865 appropriate screen resolution; otherwise, it must be a list of
7866 resolutions---e.g., @code{((1024 768) (640 480))}.
7867
7868 Last, @var{extra-config} is a list of strings or objects appended to the
7869 @code{text-file*} argument list. It is used to pass extra text to be added
7870 verbatim to the configuration file.
7871 @end deffn
7872
7873 @deffn {Scheme Procedure} screen-locker-service @var{package} [@var{name}]
7874 Add @var{package}, a package for a screen-locker or screen-saver whose
7875 command is @var{program}, to the set of setuid programs and add a PAM entry
7876 for it. For example:
7877
7878 @lisp
7879 (screen-locker-service xlockmore "xlock")
7880 @end lisp
7881
7882 makes the good ol' XlockMore usable.
7883 @end deffn
7884
7885
7886 @node Desktop Services
7887 @subsubsection Desktop Services
7888
7889 The @code{(gnu services desktop)} module provides services that are
7890 usually useful in the context of a ``desktop'' setup---that is, on a
7891 machine running a graphical display server, possibly with graphical user
7892 interfaces, etc. It also defines services that provide specific desktop
7893 environments like GNOME and XFCE.
7894
7895 To simplify things, the module defines a variable containing the set of
7896 services that users typically expect on a machine with a graphical
7897 environment and networking:
7898
7899 @defvr {Scheme Variable} %desktop-services
7900 This is a list of services that builds upon @var{%base-services} and
7901 adds or adjusts services for a typical ``desktop'' setup.
7902
7903 In particular, it adds a graphical login manager (@pxref{X Window,
7904 @code{slim-service}}), screen lockers,
7905 a network management tool (@pxref{Networking
7906 Services, @code{wicd-service}}), energy and color management services,
7907 the @code{elogind} login and seat manager, the Polkit privilege service,
7908 the GeoClue location service, an NTP client (@pxref{Networking
7909 Services}), the Avahi daemon, and has the name service switch service
7910 configured to be able to use @code{nss-mdns} (@pxref{Name Service
7911 Switch, mDNS}).
7912 @end defvr
7913
7914 The @var{%desktop-services} variable can be used as the @code{services}
7915 field of an @code{operating-system} declaration (@pxref{operating-system
7916 Reference, @code{services}}).
7917
7918 Additionally, the @code{gnome-desktop-service} and
7919 @code{xfce-desktop-service} procedures can add GNOME and/or XFCE to a
7920 system. To ``add GNOME'' means that system-level services like the
7921 backlight adjustment helpers and the power management utilities are
7922 added to the system, extending @code{polkit} and @code{dbus}
7923 appropriately, allowing GNOME to operate with elevated privileges on a
7924 limited number of special-purpose system interfaces. Additionally,
7925 adding a service made by @code{gnome-desktop-service} adds the GNOME
7926 metapackage to the system profile. Likewise, adding the XFCE service
7927 not only adds the @code{xfce} metapackage to the system profile, but it
7928 also gives the Thunar file manager the ability to open a ``root-mode''
7929 file management window, if the user authenticates using the
7930 administrator's password via the standard polkit graphical interface.
7931
7932 @deffn {Scheme Procedure} gnome-desktop-service
7933 Return a service that adds the @code{gnome} package to the system
7934 profile, and extends polkit with the actions from
7935 @code{gnome-settings-daemon}.
7936 @end deffn
7937
7938 @deffn {Scheme Procedure} xfce-desktop-service
7939 Return a service that adds the @code{xfce} package to the system profile,
7940 and extends polkit with the abilit for @code{thunar} to manipulate the
7941 file system as root from within a user session, after the user has
7942 authenticated with the administrator's password.
7943 @end deffn
7944
7945 Because the GNOME and XFCE desktop services pull in so many packages,
7946 the default @code{%desktop-services} variable doesn't include either of
7947 them by default. To add GNOME or XFCE, just @code{cons} them onto
7948 @code{%desktop-services} in the @code{services} field of your
7949 @code{operating-system}:
7950
7951 @example
7952 (use-modules (gnu))
7953 (use-service-modules desktop)
7954 (operating-system
7955 ...
7956 ;; cons* adds items to the list given as its last argument.
7957 (services (cons* (gnome-desktop-service)
7958 (xfce-desktop-service)
7959 %desktop-services))
7960 ...)
7961 @end example
7962
7963 These desktop environments will then be available as options in the
7964 graphical login window.
7965
7966 The actual service definitions included in @code{%desktop-services} and
7967 provided by @code{(gnu services dbus)} and @code{(gnu services desktop)}
7968 are described below.
7969
7970 @deffn {Scheme Procedure} dbus-service [#:dbus @var{dbus}] [#:services '()]
7971 Return a service that runs the ``system bus'', using @var{dbus}, with
7972 support for @var{services}.
7973
7974 @uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
7975 facility. Its system bus is used to allow system services to communicate
7976 and to be notified of system-wide events.
7977
7978 @var{services} must be a list of packages that provide an
7979 @file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
7980 and policy files. For example, to allow avahi-daemon to use the system bus,
7981 @var{services} must be equal to @code{(list avahi)}.
7982 @end deffn
7983
7984 @deffn {Scheme Procedure} elogind-service [#:config @var{config}]
7985 Return a service that runs the @code{elogind} login and
7986 seat management daemon. @uref{https://github.com/andywingo/elogind,
7987 Elogind} exposes a D-Bus interface that can be used to know which users
7988 are logged in, know what kind of sessions they have open, suspend the
7989 system, inhibit system suspend, reboot the system, and other tasks.
7990
7991 Elogind handles most system-level power events for a computer, for
7992 example suspending the system when a lid is closed, or shutting it down
7993 when the power button is pressed.
7994
7995 The @var{config} keyword argument specifies the configuration for
7996 elogind, and should be the result of an @code{(elogind-configuration
7997 (@var{parameter} @var{value})...)} invocation. Available parameters and
7998 their default values are:
7999
8000 @table @code
8001 @item kill-user-processes?
8002 @code{#f}
8003 @item kill-only-users
8004 @code{()}
8005 @item kill-exclude-users
8006 @code{("root")}
8007 @item inhibit-delay-max-seconds
8008 @code{5}
8009 @item handle-power-key
8010 @code{poweroff}
8011 @item handle-suspend-key
8012 @code{suspend}
8013 @item handle-hibernate-key
8014 @code{hibernate}
8015 @item handle-lid-switch
8016 @code{suspend}
8017 @item handle-lid-switch-docked
8018 @code{ignore}
8019 @item power-key-ignore-inhibited?
8020 @code{#f}
8021 @item suspend-key-ignore-inhibited?
8022 @code{#f}
8023 @item hibernate-key-ignore-inhibited?
8024 @code{#f}
8025 @item lid-switch-ignore-inhibited?
8026 @code{#t}
8027 @item holdoff-timeout-seconds
8028 @code{30}
8029 @item idle-action
8030 @code{ignore}
8031 @item idle-action-seconds
8032 @code{(* 30 60)}
8033 @item runtime-directory-size-percent
8034 @code{10}
8035 @item runtime-directory-size
8036 @code{#f}
8037 @item remove-ipc?
8038 @code{#t}
8039 @item suspend-state
8040 @code{("mem" "standby" "freeze")}
8041 @item suspend-mode
8042 @code{()}
8043 @item hibernate-state
8044 @code{("disk")}
8045 @item hibernate-mode
8046 @code{("platform" "shutdown")}
8047 @item hybrid-sleep-state
8048 @code{("disk")}
8049 @item hybrid-sleep-mode
8050 @code{("suspend" "platform" "shutdown")}
8051 @end table
8052 @end deffn
8053
8054 @deffn {Scheme Procedure} polkit-service @
8055 [#:polkit @var{polkit}]
8056 Return a service that runs the
8057 @uref{http://www.freedesktop.org/wiki/Software/polkit/, Polkit privilege
8058 management service}, which allows system administrators to grant access to
8059 privileged operations in a structured way. By querying the Polkit service, a
8060 privileged system component can know when it should grant additional
8061 capabilities to ordinary users. For example, an ordinary user can be granted
8062 the capability to suspend the system if the user is logged in locally.
8063 @end deffn
8064
8065 @deffn {Scheme Procedure} upower-service [#:upower @var{upower}] @
8066 [#:watts-up-pro? #f] @
8067 [#:poll-batteries? #t] @
8068 [#:ignore-lid? #f] @
8069 [#:use-percentage-for-policy? #f] @
8070 [#:percentage-low 10] @
8071 [#:percentage-critical 3] @
8072 [#:percentage-action 2] @
8073 [#:time-low 1200] @
8074 [#:time-critical 300] @
8075 [#:time-action 120] @
8076 [#:critical-power-action 'hybrid-sleep]
8077 Return a service that runs @uref{http://upower.freedesktop.org/,
8078 @command{upowerd}}, a system-wide monitor for power consumption and battery
8079 levels, with the given configuration settings. It implements the
8080 @code{org.freedesktop.UPower} D-Bus interface, and is notably used by
8081 GNOME.
8082 @end deffn
8083
8084 @deffn {Scheme Procedure} udisks-service [#:udisks @var{udisks}]
8085 Return a service for @uref{http://udisks.freedesktop.org/docs/latest/,
8086 UDisks}, a @dfn{disk management} daemon that provides user interfaces with
8087 notifications and ways to mount/unmount disks. Programs that talk to UDisks
8088 include the @command{udisksctl} command, part of UDisks, and GNOME Disks.
8089 @end deffn
8090
8091 @deffn {Scheme Procedure} colord-service [#:colord @var{colord}]
8092 Return a service that runs @command{colord}, a system service with a D-Bus
8093 interface to manage the color profiles of input and output devices such as
8094 screens and scanners. It is notably used by the GNOME Color Manager graphical
8095 tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
8096 site} for more information.
8097 @end deffn
8098
8099 @deffn {Scheme Procedure} geoclue-application name [#:allowed? #t] [#:system? #f] [#:users '()]
8100 Return a configuration allowing an application to access GeoClue
8101 location data. @var{name} is the Desktop ID of the application, without
8102 the @code{.desktop} part. If @var{allowed?} is true, the application
8103 will have access to location information by default. The boolean
8104 @var{system?} value indicates whether an application is a system component
8105 or not. Finally @var{users} is a list of UIDs of all users for which
8106 this application is allowed location info access. An empty users list
8107 means that all users are allowed.
8108 @end deffn
8109
8110 @defvr {Scheme Variable} %standard-geoclue-applications
8111 The standard list of well-known GeoClue application configurations,
8112 granting authority to the GNOME date-and-time utility to ask for the
8113 current location in order to set the time zone, and allowing the
8114 IceCat and Epiphany web browsers to request location information.
8115 IceCat and Epiphany both query the user before allowing a web page to
8116 know the user's location.
8117 @end defvr
8118
8119 @deffn {Scheme Procedure} geoclue-service [#:colord @var{colord}] @
8120 [#:whitelist '()] @
8121 [#:wifi-geolocation-url "https://location.services.mozilla.com/v1/geolocate?key=geoclue"] @
8122 [#:submit-data? #f]
8123 [#:wifi-submission-url "https://location.services.mozilla.com/v1/submit?key=geoclue"] @
8124 [#:submission-nick "geoclue"] @
8125 [#:applications %standard-geoclue-applications]
8126 Return a service that runs the GeoClue location service. This service
8127 provides a D-Bus interface to allow applications to request access to a
8128 user's physical location, and optionally to add information to online
8129 location databases. See
8130 @uref{https://wiki.freedesktop.org/www/Software/GeoClue/, the GeoClue
8131 web site} for more information.
8132 @end deffn
8133
8134 @deffn {Scheme Procedure} bluetooth-service [#:bluez @var{bluez}]
8135 Return a service that runs the @command{bluetoothd} daemon, which manages
8136 all the Bluetooth devices and provides a number of D-Bus interfaces.
8137
8138 Users need to be in the @code{lp} group to access the D-Bus service.
8139 @end deffn
8140
8141 @node Database Services
8142 @subsubsection Database Services
8143
8144 The @code{(gnu services databases)} module provides the following services.
8145
8146 @deffn {Scheme Procedure} postgresql-service [#:postgresql postgresql] @
8147 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
8148 Return a service that runs @var{postgresql}, the PostgreSQL database
8149 server.
8150
8151 The PostgreSQL daemon loads its runtime configuration from
8152 @var{config-file} and stores the database cluster in
8153 @var{data-directory}.
8154 @end deffn
8155
8156 @deffn {Scheme Procedure} mysql-service [#:config (mysql-configuration)]
8157 Return a service that runs @command{mysqld}, the MySQL or MariaDB
8158 database server.
8159
8160 The optional @var{config} argument specifies the configuration for
8161 @command{mysqld}, which should be a @code{<mysql-configuraiton>} object.
8162 @end deffn
8163
8164 @deftp {Data Type} mysql-configuration
8165 Data type representing the configuration of @var{mysql-service}.
8166
8167 @table @asis
8168 @item @code{mysql} (default: @var{mariadb})
8169 Package object of the MySQL database server, can be either @var{mariadb}
8170 or @var{mysql}.
8171
8172 For MySQL, a temorary root password will be displayed at activation time.
8173 For MariaDB, the root password is empty.
8174 @end table
8175 @end deftp
8176
8177 @node Mail Services
8178 @subsubsection Mail Services
8179
8180 The @code{(gnu services mail)} module provides Guix service definitions
8181 for mail services. Currently the only implemented service is Dovecot,
8182 an IMAP, POP3, and LMTP server.
8183
8184 Guix does not yet have a mail transfer agent (MTA), although for some
8185 lightweight purposes the @code{esmtp} relay-only MTA may suffice. Help
8186 is needed to properly integrate a full MTA, such as Postfix. Patches
8187 welcome!
8188
8189 To add an IMAP/POP3 server to a GuixSD system, add a
8190 @code{dovecot-service} to the operating system definition:
8191
8192 @deffn {Scheme Procedure} dovecot-service [#:config (dovecot-configuration)]
8193 Return a service that runs the Dovecot IMAP/POP3/LMTP mail server.
8194 @end deffn
8195
8196 By default, Dovecot does not need much configuration; the default
8197 configuration object created by @code{(dovecot-configuration)} will
8198 suffice if your mail is delivered to @code{~/Maildir}. A self-signed
8199 certificate will be generated for TLS-protected connections, though
8200 Dovecot will also listen on cleartext ports by default. There are a
8201 number of options, though, which mail administrators might need to change,
8202 and as is the case with other services, Guix allows the system
8203 administrator to specify these parameters via a uniform Scheme interface.
8204
8205 For example, to specify that mail is located at @code{maildir~/.mail},
8206 one would instantiate the Dovecot service like this:
8207
8208 @example
8209 (dovecot-service #:config
8210 (dovecot-configuration
8211 (mail-location "maildir:~/.mail")))
8212 @end example
8213
8214 The available configuration parameters follow. Each parameter
8215 definition is preceded by its type; for example, @samp{string-list foo}
8216 indicates that the @code{foo} parameter should be specified as a list of
8217 strings. There is also a way to specify the configuration as a string,
8218 if you have an old @code{dovecot.conf} file that you want to port over
8219 from some other system; see the end for more details.
8220
8221 @c The following documentation was initially generated by
8222 @c (generate-documentation) in (gnu services mail). Manually maintained
8223 @c documentation is better, so we shouldn't hesitate to edit below as
8224 @c needed. However if the change you want to make to this documentation
8225 @c can be done in an automated way, it's probably easier to change
8226 @c (generate-documentation) than to make it below and have to deal with
8227 @c the churn as dovecot updates.
8228
8229 Available @code{dovecot-configuration} fields are:
8230
8231 @deftypevr {@code{dovecot-configuration} parameter} package dovecot
8232 The dovecot package.
8233 @end deftypevr
8234
8235 @deftypevr {@code{dovecot-configuration} parameter} comma-separated-string-list listen
8236 A list of IPs or hosts where to listen for connections. @samp{*}
8237 listens on all IPv4 interfaces, @samp{::} listens on all IPv6
8238 interfaces. If you want to specify non-default ports or anything more
8239 complex, customize the address and port fields of the
8240 @samp{inet-listener} of the specific services you are interested in.
8241 @end deftypevr
8242
8243 @deftypevr {@code{dovecot-configuration} parameter} protocol-configuration-list protocols
8244 List of protocols we want to serve. Available protocols include
8245 @samp{imap}, @samp{pop3}, and @samp{lmtp}.
8246
8247 Available @code{protocol-configuration} fields are:
8248
8249 @deftypevr {@code{protocol-configuration} parameter} string name
8250 The name of the protocol.
8251 @end deftypevr
8252
8253 @deftypevr {@code{protocol-configuration} parameter} string auth-socket-path
8254 UNIX socket path to the master authentication server to find users.
8255 This is used by imap (for shared users) and lda.
8256 It defaults to @samp{"/var/run/dovecot/auth-userdb"}.
8257 @end deftypevr
8258
8259 @deftypevr {@code{protocol-configuration} parameter} space-separated-string-list mail-plugins
8260 Space separated list of plugins to load.
8261 @end deftypevr
8262
8263 @deftypevr {@code{protocol-configuration} parameter} non-negative-integer mail-max-userip-connections
8264 Maximum number of IMAP connections allowed for a user from each IP
8265 address. NOTE: The username is compared case-sensitively.
8266 Defaults to @samp{10}.
8267 @end deftypevr
8268
8269 @end deftypevr
8270
8271 @deftypevr {@code{dovecot-configuration} parameter} service-configuration-list services
8272 List of services to enable. Available services include @samp{imap},
8273 @samp{imap-login}, @samp{pop3}, @samp{pop3-login}, @samp{auth}, and
8274 @samp{lmtp}.
8275
8276 Available @code{service-configuration} fields are:
8277
8278 @deftypevr {@code{service-configuration} parameter} string kind
8279 The service kind. Valid values include @code{director},
8280 @code{imap-login}, @code{pop3-login}, @code{lmtp}, @code{imap},
8281 @code{pop3}, @code{auth}, @code{auth-worker}, @code{dict},
8282 @code{tcpwrap}, @code{quota-warning}, or anything else.
8283 @end deftypevr
8284
8285 @deftypevr {@code{service-configuration} parameter} listener-configuration-list listeners
8286 Listeners for the service. A listener is either a
8287 @code{unix-listener-configuration}, a @code{fifo-listener-configuration}, or
8288 an @code{inet-listener-configuration}.
8289 Defaults to @samp{()}.
8290
8291 Available @code{unix-listener-configuration} fields are:
8292
8293 @deftypevr {@code{unix-listener-configuration} parameter} file-name path
8294 The file name on which to listen.
8295 @end deftypevr
8296
8297 @deftypevr {@code{unix-listener-configuration} parameter} string mode
8298 The access mode for the socket.
8299 Defaults to @samp{"0600"}.
8300 @end deftypevr
8301
8302 @deftypevr {@code{unix-listener-configuration} parameter} string user
8303 The user to own the socket.
8304 Defaults to @samp{""}.
8305 @end deftypevr
8306
8307 @deftypevr {@code{unix-listener-configuration} parameter} string group
8308 The group to own the socket.
8309 Defaults to @samp{""}.
8310 @end deftypevr
8311
8312
8313 Available @code{fifo-listener-configuration} fields are:
8314
8315 @deftypevr {@code{fifo-listener-configuration} parameter} file-name path
8316 The file name on which to listen.
8317 @end deftypevr
8318
8319 @deftypevr {@code{fifo-listener-configuration} parameter} string mode
8320 The access mode for the socket.
8321 Defaults to @samp{"0600"}.
8322 @end deftypevr
8323
8324 @deftypevr {@code{fifo-listener-configuration} parameter} string user
8325 The user to own the socket.
8326 Defaults to @samp{""}.
8327 @end deftypevr
8328
8329 @deftypevr {@code{fifo-listener-configuration} parameter} string group
8330 The group to own the socket.
8331 Defaults to @samp{""}.
8332 @end deftypevr
8333
8334
8335 Available @code{inet-listener-configuration} fields are:
8336
8337 @deftypevr {@code{inet-listener-configuration} parameter} string protocol
8338 The protocol to listen for.
8339 @end deftypevr
8340
8341 @deftypevr {@code{inet-listener-configuration} parameter} string address
8342 The address on which to listen, or empty for all addresses.
8343 Defaults to @samp{""}.
8344 @end deftypevr
8345
8346 @deftypevr {@code{inet-listener-configuration} parameter} non-negative-integer port
8347 The port on which to listen.
8348 @end deftypevr
8349
8350 @deftypevr {@code{inet-listener-configuration} parameter} boolean ssl?
8351 Whether to use SSL for this service; @samp{yes}, @samp{no}, or
8352 @samp{required}.
8353 Defaults to @samp{#t}.
8354 @end deftypevr
8355
8356 @end deftypevr
8357
8358 @deftypevr {@code{service-configuration} parameter} non-negative-integer service-count
8359 Number of connections to handle before starting a new process.
8360 Typically the only useful values are 0 (unlimited) or 1. 1 is more
8361 secure, but 0 is faster. <doc/wiki/LoginProcess.txt>.
8362 Defaults to @samp{1}.
8363 @end deftypevr
8364
8365 @deftypevr {@code{service-configuration} parameter} non-negative-integer process-min-avail
8366 Number of processes to always keep waiting for more connections.
8367 Defaults to @samp{0}.
8368 @end deftypevr
8369
8370 @deftypevr {@code{service-configuration} parameter} non-negative-integer vsz-limit
8371 If you set @samp{service-count 0}, you probably need to grow
8372 this.
8373 Defaults to @samp{256000000}.
8374 @end deftypevr
8375
8376 @end deftypevr
8377
8378 @deftypevr {@code{dovecot-configuration} parameter} dict-configuration dict
8379 Dict configuration, as created by the @code{dict-configuration}
8380 constructor.
8381
8382 Available @code{dict-configuration} fields are:
8383
8384 @deftypevr {@code{dict-configuration} parameter} free-form-fields entries
8385 A list of key-value pairs that this dict should hold.
8386 Defaults to @samp{()}.
8387 @end deftypevr
8388
8389 @end deftypevr
8390
8391 @deftypevr {@code{dovecot-configuration} parameter} passdb-configuration-list passdbs
8392 A list of passdb configurations, each one created by the
8393 @code{passdb-configuration} constructor.
8394
8395 Available @code{passdb-configuration} fields are:
8396
8397 @deftypevr {@code{passdb-configuration} parameter} string driver
8398 The driver that the passdb should use. Valid values include
8399 @samp{pam}, @samp{passwd}, @samp{shadow}, @samp{bsdauth}, and
8400 @samp{static}.
8401 Defaults to @samp{"pam"}.
8402 @end deftypevr
8403
8404 @deftypevr {@code{passdb-configuration} parameter} free-form-args args
8405 A list of key-value args to the passdb driver.
8406 Defaults to @samp{()}.
8407 @end deftypevr
8408
8409 @end deftypevr
8410
8411 @deftypevr {@code{dovecot-configuration} parameter} userdb-configuration-list userdbs
8412 List of userdb configurations, each one created by the
8413 @code{userdb-configuration} constructor.
8414
8415 Available @code{userdb-configuration} fields are:
8416
8417 @deftypevr {@code{userdb-configuration} parameter} string driver
8418 The driver that the userdb should use. Valid values include
8419 @samp{passwd} and @samp{static}.
8420 Defaults to @samp{"passwd"}.
8421 @end deftypevr
8422
8423 @deftypevr {@code{userdb-configuration} parameter} free-form-args args
8424 A list of key-value args to the userdb driver.
8425 Defaults to @samp{()}.
8426 @end deftypevr
8427
8428 @deftypevr {@code{userdb-configuration} parameter} free-form-args override-fields
8429 Override fields from passwd.
8430 Defaults to @samp{()}.
8431 @end deftypevr
8432
8433 @end deftypevr
8434
8435 @deftypevr {@code{dovecot-configuration} parameter} plugin-configuration plugin-configuration
8436 Plug-in configuration, created by the @code{plugin-configuration}
8437 constructor.
8438 @end deftypevr
8439
8440 @deftypevr {@code{dovecot-configuration} parameter} list-of-namespace-configuration namespaces
8441 List of namespaces. Each item in the list is created by the
8442 @code{namespace-configuration} constructor.
8443
8444 Available @code{namespace-configuration} fields are:
8445
8446 @deftypevr {@code{namespace-configuration} parameter} string name
8447 Name for this namespace.
8448 @end deftypevr
8449
8450 @deftypevr {@code{namespace-configuration} parameter} string type
8451 Namespace type: @samp{private}, @samp{shared} or @samp{public}.
8452 Defaults to @samp{"private"}.
8453 @end deftypevr
8454
8455 @deftypevr {@code{namespace-configuration} parameter} string separator
8456 Hierarchy separator to use. You should use the same separator for
8457 all namespaces or some clients get confused. @samp{/} is usually a good
8458 one. The default however depends on the underlying mail storage
8459 format.
8460 Defaults to @samp{""}.
8461 @end deftypevr
8462
8463 @deftypevr {@code{namespace-configuration} parameter} string prefix
8464 Prefix required to access this namespace. This needs to be
8465 different for all namespaces. For example @samp{Public/}.
8466 Defaults to @samp{""}.
8467 @end deftypevr
8468
8469 @deftypevr {@code{namespace-configuration} parameter} string location
8470 Physical location of the mailbox. This is in the same format as
8471 mail_location, which is also the default for it.
8472 Defaults to @samp{""}.
8473 @end deftypevr
8474
8475 @deftypevr {@code{namespace-configuration} parameter} boolean inbox?
8476 There can be only one INBOX, and this setting defines which
8477 namespace has it.
8478 Defaults to @samp{#f}.
8479 @end deftypevr
8480
8481 @deftypevr {@code{namespace-configuration} parameter} boolean hidden?
8482 If namespace is hidden, it's not advertised to clients via NAMESPACE
8483 extension. You'll most likely also want to set @samp{list? #f}. This is mostly
8484 useful when converting from another server with different namespaces
8485 which you want to deprecate but still keep working. For example you can
8486 create hidden namespaces with prefixes @samp{~/mail/}, @samp{~%u/mail/}
8487 and @samp{mail/}.
8488 Defaults to @samp{#f}.
8489 @end deftypevr
8490
8491 @deftypevr {@code{namespace-configuration} parameter} boolean list?
8492 Show the mailboxes under this namespace with the LIST command. This
8493 makes the namespace visible for clients that do not support the NAMESPACE
8494 extension. The special @code{children} value lists child mailboxes, but
8495 hides the namespace prefix.
8496 Defaults to @samp{#t}.
8497 @end deftypevr
8498
8499 @deftypevr {@code{namespace-configuration} parameter} boolean subscriptions?
8500 Namespace handles its own subscriptions. If set to @code{#f}, the
8501 parent namespace handles them. The empty prefix should always have this
8502 as @code{#t}).
8503 Defaults to @samp{#t}.
8504 @end deftypevr
8505
8506 @deftypevr {@code{namespace-configuration} parameter} mailbox-configuration-list mailboxes
8507 List of predefined mailboxes in this namespace.
8508 Defaults to @samp{()}.
8509
8510 Available @code{mailbox-configuration} fields are:
8511
8512 @deftypevr {@code{mailbox-configuration} parameter} string name
8513 Name for this mailbox.
8514 @end deftypevr
8515
8516 @deftypevr {@code{mailbox-configuration} parameter} string auto
8517 @samp{create} will automatically create this mailbox.
8518 @samp{subscribe} will both create and subscribe to the mailbox.
8519 Defaults to @samp{"no"}.
8520 @end deftypevr
8521
8522 @deftypevr {@code{mailbox-configuration} parameter} space-separated-string-list special-use
8523 List of IMAP @code{SPECIAL-USE} attributes as specified by RFC 6154.
8524 Valid values are @code{\All}, @code{\Archive}, @code{\Drafts},
8525 @code{\Flagged}, @code{\Junk}, @code{\Sent}, and @code{\Trash}.
8526 Defaults to @samp{()}.
8527 @end deftypevr
8528
8529 @end deftypevr
8530
8531 @end deftypevr
8532
8533 @deftypevr {@code{dovecot-configuration} parameter} file-name base-dir
8534 Base directory where to store runtime data.
8535 Defaults to @samp{"/var/run/dovecot/"}.
8536 @end deftypevr
8537
8538 @deftypevr {@code{dovecot-configuration} parameter} string login-greeting
8539 Greeting message for clients.
8540 Defaults to @samp{"Dovecot ready."}.
8541 @end deftypevr
8542
8543 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-trusted-networks
8544 List of trusted network ranges. Connections from these IPs are
8545 allowed to override their IP addresses and ports (for logging and for
8546 authentication checks). @samp{disable-plaintext-auth} is also ignored
8547 for these networks. Typically you would specify your IMAP proxy servers
8548 here.
8549 Defaults to @samp{()}.
8550 @end deftypevr
8551
8552 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-access-sockets
8553 List of login access check sockets (e.g. tcpwrap).
8554 Defaults to @samp{()}.
8555 @end deftypevr
8556
8557 @deftypevr {@code{dovecot-configuration} parameter} boolean verbose-proctitle?
8558 Show more verbose process titles (in ps). Currently shows user name
8559 and IP address. Useful for seeing who is actually using the IMAP
8560 processes (e.g. shared mailboxes or if the same uid is used for multiple
8561 accounts).
8562 Defaults to @samp{#f}.
8563 @end deftypevr
8564
8565 @deftypevr {@code{dovecot-configuration} parameter} boolean shutdown-clients?
8566 Should all processes be killed when Dovecot master process shuts down.
8567 Setting this to @code{#f} means that Dovecot can be upgraded without
8568 forcing existing client connections to close (although that could also
8569 be a problem if the upgrade is e.g. due to a security fix).
8570 Defaults to @samp{#t}.
8571 @end deftypevr
8572
8573 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer doveadm-worker-count
8574 If non-zero, run mail commands via this many connections to doveadm
8575 server, instead of running them directly in the same process.
8576 Defaults to @samp{0}.
8577 @end deftypevr
8578
8579 @deftypevr {@code{dovecot-configuration} parameter} string doveadm-socket-path
8580 UNIX socket or host:port used for connecting to doveadm server.
8581 Defaults to @samp{"doveadm-server"}.
8582 @end deftypevr
8583
8584 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list import-environment
8585 List of environment variables that are preserved on Dovecot startup
8586 and passed down to all of its child processes. You can also give
8587 key=value pairs to always set specific settings.
8588 @end deftypevr
8589
8590 @deftypevr {@code{dovecot-configuration} parameter} boolean disable-plaintext-auth?
8591 Disable LOGIN command and all other plaintext authentications unless
8592 SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP
8593 matches the local IP (i.e. you're connecting from the same computer),
8594 the connection is considered secure and plaintext authentication is
8595 allowed. See also ssl=required setting.
8596 Defaults to @samp{#t}.
8597 @end deftypevr
8598
8599 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer auth-cache-size
8600 Authentication cache size (e.g. @samp{#e10e6}). 0 means it's disabled.
8601 Note that bsdauth, PAM and vpopmail require @samp{cache-key} to be set
8602 for caching to be used.
8603 Defaults to @samp{0}.
8604 @end deftypevr
8605
8606 @deftypevr {@code{dovecot-configuration} parameter} string auth-cache-ttl
8607 Time to live for cached data. After TTL expires the cached record
8608 is no longer used, *except* if the main database lookup returns internal
8609 failure. We also try to handle password changes automatically: If
8610 user's previous authentication was successful, but this one wasn't, the
8611 cache isn't used. For now this works only with plaintext
8612 authentication.
8613 Defaults to @samp{"1 hour"}.
8614 @end deftypevr
8615
8616 @deftypevr {@code{dovecot-configuration} parameter} string auth-cache-negative-ttl
8617 TTL for negative hits (user not found, password mismatch).
8618 0 disables caching them completely.
8619 Defaults to @samp{"1 hour"}.
8620 @end deftypevr
8621
8622 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list auth-realms
8623 List of realms for SASL authentication mechanisms that need them.
8624 You can leave it empty if you don't want to support multiple realms.
8625 Many clients simply use the first one listed here, so keep the default
8626 realm first.
8627 Defaults to @samp{()}.
8628 @end deftypevr
8629
8630 @deftypevr {@code{dovecot-configuration} parameter} string auth-default-realm
8631 Default realm/domain to use if none was specified. This is used for
8632 both SASL realms and appending @@domain to username in plaintext
8633 logins.
8634 Defaults to @samp{""}.
8635 @end deftypevr
8636
8637 @deftypevr {@code{dovecot-configuration} parameter} string auth-username-chars
8638 List of allowed characters in username. If the user-given username
8639 contains a character not listed in here, the login automatically fails.
8640 This is just an extra check to make sure user can't exploit any
8641 potential quote escaping vulnerabilities with SQL/LDAP databases. If
8642 you want to allow all characters, set this value to empty.
8643 Defaults to @samp{"abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@@"}.
8644 @end deftypevr
8645
8646 @deftypevr {@code{dovecot-configuration} parameter} string auth-username-translation
8647 Username character translations before it's looked up from
8648 databases. The value contains series of from -> to characters. For
8649 example @samp{#@@/@@} means that @samp{#} and @samp{/} characters are
8650 translated to @samp{@@}.
8651 Defaults to @samp{""}.
8652 @end deftypevr
8653
8654 @deftypevr {@code{dovecot-configuration} parameter} string auth-username-format
8655 Username formatting before it's looked up from databases. You can
8656 use the standard variables here, e.g. %Lu would lowercase the username,
8657 %n would drop away the domain if it was given, or @samp{%n-AT-%d} would
8658 change the @samp{@@} into @samp{-AT-}. This translation is done after
8659 @samp{auth-username-translation} changes.
8660 Defaults to @samp{"%Lu"}.
8661 @end deftypevr
8662
8663 @deftypevr {@code{dovecot-configuration} parameter} string auth-master-user-separator
8664 If you want to allow master users to log in by specifying the master
8665 username within the normal username string (i.e. not using SASL
8666 mechanism's support for it), you can specify the separator character
8667 here. The format is then <username><separator><master username>.
8668 UW-IMAP uses @samp{*} as the separator, so that could be a good
8669 choice.
8670 Defaults to @samp{""}.
8671 @end deftypevr
8672
8673 @deftypevr {@code{dovecot-configuration} parameter} string auth-anonymous-username
8674 Username to use for users logging in with ANONYMOUS SASL
8675 mechanism.
8676 Defaults to @samp{"anonymous"}.
8677 @end deftypevr
8678
8679 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer auth-worker-max-count
8680 Maximum number of dovecot-auth worker processes. They're used to
8681 execute blocking passdb and userdb queries (e.g. MySQL and PAM).
8682 They're automatically created and destroyed as needed.
8683 Defaults to @samp{30}.
8684 @end deftypevr
8685
8686 @deftypevr {@code{dovecot-configuration} parameter} string auth-gssapi-hostname
8687 Host name to use in GSSAPI principal names. The default is to use
8688 the name returned by gethostname(). Use @samp{$ALL} (with quotes) to
8689 allow all keytab entries.
8690 Defaults to @samp{""}.
8691 @end deftypevr
8692
8693 @deftypevr {@code{dovecot-configuration} parameter} string auth-krb5-keytab
8694 Kerberos keytab to use for the GSSAPI mechanism. Will use the
8695 system default (usually /etc/krb5.keytab) if not specified. You may
8696 need to change the auth service to run as root to be able to read this
8697 file.
8698 Defaults to @samp{""}.
8699 @end deftypevr
8700
8701 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-use-winbind?
8702 Do NTLM and GSS-SPNEGO authentication using Samba's winbind daemon
8703 and @samp{ntlm-auth} helper.
8704 <doc/wiki/Authentication/Mechanisms/Winbind.txt>.
8705 Defaults to @samp{#f}.
8706 @end deftypevr
8707
8708 @deftypevr {@code{dovecot-configuration} parameter} file-name auth-winbind-helper-path
8709 Path for Samba's @samp{ntlm-auth} helper binary.
8710 Defaults to @samp{"/usr/bin/ntlm_auth"}.
8711 @end deftypevr
8712
8713 @deftypevr {@code{dovecot-configuration} parameter} string auth-failure-delay
8714 Time to delay before replying to failed authentications.
8715 Defaults to @samp{"2 secs"}.
8716 @end deftypevr
8717
8718 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-ssl-require-client-cert?
8719 Require a valid SSL client certificate or the authentication
8720 fails.
8721 Defaults to @samp{#f}.
8722 @end deftypevr
8723
8724 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-ssl-username-from-cert?
8725 Take the username from client's SSL certificate, using
8726 @code{X509_NAME_get_text_by_NID()} which returns the subject's DN's
8727 CommonName.
8728 Defaults to @samp{#f}.
8729 @end deftypevr
8730
8731 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list auth-mechanisms
8732 List of wanted authentication mechanisms. Supported mechanisms are:
8733 @samp{plain}, @samp{login}, @samp{digest-md5}, @samp{cram-md5},
8734 @samp{ntlm}, @samp{rpa}, @samp{apop}, @samp{anonymous}, @samp{gssapi},
8735 @samp{otp}, @samp{skey}, and @samp{gss-spnego}. NOTE: See also
8736 @samp{disable-plaintext-auth} setting.
8737 @end deftypevr
8738
8739 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list director-servers
8740 List of IPs or hostnames to all director servers, including ourself.
8741 Ports can be specified as ip:port. The default port is the same as what
8742 director service's @samp{inet-listener} is using.
8743 Defaults to @samp{()}.
8744 @end deftypevr
8745
8746 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list director-mail-servers
8747 List of IPs or hostnames to all backend mail servers. Ranges are
8748 allowed too, like 10.0.0.10-10.0.0.30.
8749 Defaults to @samp{()}.
8750 @end deftypevr
8751
8752 @deftypevr {@code{dovecot-configuration} parameter} string director-user-expire
8753 How long to redirect users to a specific server after it no longer
8754 has any connections.
8755 Defaults to @samp{"15 min"}.
8756 @end deftypevr
8757
8758 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer director-doveadm-port
8759 TCP/IP port that accepts doveadm connections (instead of director
8760 connections) If you enable this, you'll also need to add
8761 @samp{inet-listener} for the port.
8762 Defaults to @samp{0}.
8763 @end deftypevr
8764
8765 @deftypevr {@code{dovecot-configuration} parameter} string director-username-hash
8766 How the username is translated before being hashed. Useful values
8767 include %Ln if user can log in with or without @@domain, %Ld if mailboxes
8768 are shared within domain.
8769 Defaults to @samp{"%Lu"}.
8770 @end deftypevr
8771
8772 @deftypevr {@code{dovecot-configuration} parameter} string log-path
8773 Log file to use for error messages. @samp{syslog} logs to syslog,
8774 @samp{/dev/stderr} logs to stderr.
8775 Defaults to @samp{"syslog"}.
8776 @end deftypevr
8777
8778 @deftypevr {@code{dovecot-configuration} parameter} string info-log-path
8779 Log file to use for informational messages. Defaults to
8780 @samp{log-path}.
8781 Defaults to @samp{""}.
8782 @end deftypevr
8783
8784 @deftypevr {@code{dovecot-configuration} parameter} string debug-log-path
8785 Log file to use for debug messages. Defaults to
8786 @samp{info-log-path}.
8787 Defaults to @samp{""}.
8788 @end deftypevr
8789
8790 @deftypevr {@code{dovecot-configuration} parameter} string syslog-facility
8791 Syslog facility to use if you're logging to syslog. Usually if you
8792 don't want to use @samp{mail}, you'll use local0..local7. Also other
8793 standard facilities are supported.
8794 Defaults to @samp{"mail"}.
8795 @end deftypevr
8796
8797 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-verbose?
8798 Log unsuccessful authentication attempts and the reasons why they
8799 failed.
8800 Defaults to @samp{#f}.
8801 @end deftypevr
8802
8803 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-verbose-passwords?
8804 In case of password mismatches, log the attempted password. Valid
8805 values are no, plain and sha1. sha1 can be useful for detecting brute
8806 force password attempts vs. user simply trying the same password over
8807 and over again. You can also truncate the value to n chars by appending
8808 ":n" (e.g. sha1:6).
8809 Defaults to @samp{#f}.
8810 @end deftypevr
8811
8812 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-debug?
8813 Even more verbose logging for debugging purposes. Shows for example
8814 SQL queries.
8815 Defaults to @samp{#f}.
8816 @end deftypevr
8817
8818 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-debug-passwords?
8819 In case of password mismatches, log the passwords and used scheme so
8820 the problem can be debugged. Enabling this also enables
8821 @samp{auth-debug}.
8822 Defaults to @samp{#f}.
8823 @end deftypevr
8824
8825 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-debug?
8826 Enable mail process debugging. This can help you figure out why
8827 Dovecot isn't finding your mails.
8828 Defaults to @samp{#f}.
8829 @end deftypevr
8830
8831 @deftypevr {@code{dovecot-configuration} parameter} boolean verbose-ssl?
8832 Show protocol level SSL errors.
8833 Defaults to @samp{#f}.
8834 @end deftypevr
8835
8836 @deftypevr {@code{dovecot-configuration} parameter} string log-timestamp
8837 Prefix for each line written to log file. % codes are in
8838 strftime(3) format.
8839 Defaults to @samp{"\"%b %d %H:%M:%S \""}.
8840 @end deftypevr
8841
8842 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-log-format-elements
8843 List of elements we want to log. The elements which have a
8844 non-empty variable value are joined together to form a comma-separated
8845 string.
8846 @end deftypevr
8847
8848 @deftypevr {@code{dovecot-configuration} parameter} string login-log-format
8849 Login log format. %s contains @samp{login-log-format-elements}
8850 string, %$ contains the data we want to log.
8851 Defaults to @samp{"%$: %s"}.
8852 @end deftypevr
8853
8854 @deftypevr {@code{dovecot-configuration} parameter} string mail-log-prefix
8855 Log prefix for mail processes. See doc/wiki/Variables.txt for list
8856 of possible variables you can use.
8857 Defaults to @samp{"\"%s(%u): \""}.
8858 @end deftypevr
8859
8860 @deftypevr {@code{dovecot-configuration} parameter} string deliver-log-format
8861 Format to use for logging mail deliveries. You can use variables:
8862 @table @code
8863 @item %$
8864 Delivery status message (e.g. @samp{saved to INBOX})
8865 @item %m
8866 Message-ID
8867 @item %s
8868 Subject
8869 @item %f
8870 From address
8871 @item %p
8872 Physical size
8873 @item %w
8874 Virtual size.
8875 @end table
8876 Defaults to @samp{"msgid=%m: %$"}.
8877 @end deftypevr
8878
8879 @deftypevr {@code{dovecot-configuration} parameter} string mail-location
8880 Location for users' mailboxes. The default is empty, which means
8881 that Dovecot tries to find the mailboxes automatically. This won't work
8882 if the user doesn't yet have any mail, so you should explicitly tell
8883 Dovecot the full location.
8884
8885 If you're using mbox, giving a path to the INBOX
8886 file (e.g. /var/mail/%u) isn't enough. You'll also need to tell Dovecot
8887 where the other mailboxes are kept. This is called the "root mail
8888 directory", and it must be the first path given in the
8889 @samp{mail-location} setting.
8890
8891 There are a few special variables you can use, eg.:
8892
8893 @table @samp
8894 @item %u
8895 username
8896 @item %n
8897 user part in user@@domain, same as %u if there's no domain
8898 @item %d
8899 domain part in user@@domain, empty if there's no domain
8900 @item %h
8901 home director
8902 @end table
8903
8904 See doc/wiki/Variables.txt for full list. Some examples:
8905 @table @samp
8906 @item maildir:~/Maildir
8907 @item mbox:~/mail:INBOX=/var/mail/%u
8908 @item mbox:/var/mail/%d/%1n/%n:INDEX=/var/indexes/%d/%1n/%
8909 @end table
8910 Defaults to @samp{""}.
8911 @end deftypevr
8912
8913 @deftypevr {@code{dovecot-configuration} parameter} string mail-uid
8914 System user and group used to access mails. If you use multiple,
8915 userdb can override these by returning uid or gid fields. You can use
8916 either numbers or names. <doc/wiki/UserIds.txt>.
8917 Defaults to @samp{""}.
8918 @end deftypevr
8919
8920 @deftypevr {@code{dovecot-configuration} parameter} string mail-gid
8921
8922 Defaults to @samp{""}.
8923 @end deftypevr
8924
8925 @deftypevr {@code{dovecot-configuration} parameter} string mail-privileged-group
8926 Group to enable temporarily for privileged operations. Currently
8927 this is used only with INBOX when either its initial creation or
8928 dotlocking fails. Typically this is set to "mail" to give access to
8929 /var/mail.
8930 Defaults to @samp{""}.
8931 @end deftypevr
8932
8933 @deftypevr {@code{dovecot-configuration} parameter} string mail-access-groups
8934 Grant access to these supplementary groups for mail processes.
8935 Typically these are used to set up access to shared mailboxes. Note
8936 that it may be dangerous to set these if users can create
8937 symlinks (e.g. if "mail" group is set here, ln -s /var/mail ~/mail/var
8938 could allow a user to delete others' mailboxes, or ln -s
8939 /secret/shared/box ~/mail/mybox would allow reading it).
8940 Defaults to @samp{""}.
8941 @end deftypevr
8942
8943 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-full-filesystem-access?
8944 Allow full filesystem access to clients. There's no access checks
8945 other than what the operating system does for the active UID/GID. It
8946 works with both maildir and mboxes, allowing you to prefix mailboxes
8947 names with e.g. /path/ or ~user/.
8948 Defaults to @samp{#f}.
8949 @end deftypevr
8950
8951 @deftypevr {@code{dovecot-configuration} parameter} boolean mmap-disable?
8952 Don't use mmap() at all. This is required if you store indexes to
8953 shared filesystems (NFS or clustered filesystem).
8954 Defaults to @samp{#f}.
8955 @end deftypevr
8956
8957 @deftypevr {@code{dovecot-configuration} parameter} boolean dotlock-use-excl?
8958 Rely on @samp{O_EXCL} to work when creating dotlock files. NFS
8959 supports @samp{O_EXCL} since version 3, so this should be safe to use
8960 nowadays by default.
8961 Defaults to @samp{#t}.
8962 @end deftypevr
8963
8964 @deftypevr {@code{dovecot-configuration} parameter} string mail-fsync
8965 When to use fsync() or fdatasync() calls:
8966 @table @code
8967 @item optimized
8968 Whenever necessary to avoid losing important data
8969 @item always
8970 Useful with e.g. NFS when write()s are delayed
8971 @item never
8972 Never use it (best performance, but crashes can lose data).
8973 @end table
8974 Defaults to @samp{"optimized"}.
8975 @end deftypevr
8976
8977 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-nfs-storage?
8978 Mail storage exists in NFS. Set this to yes to make Dovecot flush
8979 NFS caches whenever needed. If you're using only a single mail server
8980 this isn't needed.
8981 Defaults to @samp{#f}.
8982 @end deftypevr
8983
8984 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-nfs-index?
8985 Mail index files also exist in NFS. Setting this to yes requires
8986 @samp{mmap-disable? #t} and @samp{fsync-disable? #f}.
8987 Defaults to @samp{#f}.
8988 @end deftypevr
8989
8990 @deftypevr {@code{dovecot-configuration} parameter} string lock-method
8991 Locking method for index files. Alternatives are fcntl, flock and
8992 dotlock. Dotlocking uses some tricks which may create more disk I/O
8993 than other locking methods. NFS users: flock doesn't work, remember to
8994 change @samp{mmap-disable}.
8995 Defaults to @samp{"fcntl"}.
8996 @end deftypevr
8997
8998 @deftypevr {@code{dovecot-configuration} parameter} file-name mail-temp-dir
8999 Directory in which LDA/LMTP temporarily stores incoming mails >128
9000 kB.
9001 Defaults to @samp{"/tmp"}.
9002 @end deftypevr
9003
9004 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer first-valid-uid
9005 Valid UID range for users. This is mostly to make sure that users can't
9006 log in as daemons or other system users. Note that denying root logins is
9007 hardcoded to dovecot binary and can't be done even if @samp{first-valid-uid}
9008 is set to 0.
9009 Defaults to @samp{500}.
9010 @end deftypevr
9011
9012 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer last-valid-uid
9013
9014 Defaults to @samp{0}.
9015 @end deftypevr
9016
9017 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer first-valid-gid
9018 Valid GID range for users. Users having non-valid GID as primary group ID
9019 aren't allowed to log in. If user belongs to supplementary groups with
9020 non-valid GIDs, those groups are not set.
9021 Defaults to @samp{1}.
9022 @end deftypevr
9023
9024 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer last-valid-gid
9025
9026 Defaults to @samp{0}.
9027 @end deftypevr
9028
9029 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-max-keyword-length
9030 Maximum allowed length for mail keyword name. It's only forced when
9031 trying to create new keywords.
9032 Defaults to @samp{50}.
9033 @end deftypevr
9034
9035 @deftypevr {@code{dovecot-configuration} parameter} colon-separated-file-name-list valid-chroot-dirs
9036 List of directories under which chrooting is allowed for mail
9037 processes (i.e. /var/mail will allow chrooting to /var/mail/foo/bar
9038 too). This setting doesn't affect @samp{login-chroot}
9039 @samp{mail-chroot} or auth chroot settings. If this setting is empty,
9040 "/./" in home dirs are ignored. WARNING: Never add directories here
9041 which local users can modify, that may lead to root exploit. Usually
9042 this should be done only if you don't allow shell access for users.
9043 <doc/wiki/Chrooting.txt>.
9044 Defaults to @samp{()}.
9045 @end deftypevr
9046
9047 @deftypevr {@code{dovecot-configuration} parameter} string mail-chroot
9048 Default chroot directory for mail processes. This can be overridden
9049 for specific users in user database by giving /./ in user's home
9050 directory (e.g. /home/./user chroots into /home). Note that usually
9051 there is no real need to do chrooting, Dovecot doesn't allow users to
9052 access files outside their mail directory anyway. If your home
9053 directories are prefixed with the chroot directory, append "/." to
9054 @samp{mail-chroot}. <doc/wiki/Chrooting.txt>.
9055 Defaults to @samp{""}.
9056 @end deftypevr
9057
9058 @deftypevr {@code{dovecot-configuration} parameter} file-name auth-socket-path
9059 UNIX socket path to master authentication server to find users.
9060 This is used by imap (for shared users) and lda.
9061 Defaults to @samp{"/var/run/dovecot/auth-userdb"}.
9062 @end deftypevr
9063
9064 @deftypevr {@code{dovecot-configuration} parameter} file-name mail-plugin-dir
9065 Directory where to look up mail plugins.
9066 Defaults to @samp{"/usr/lib/dovecot"}.
9067 @end deftypevr
9068
9069 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mail-plugins
9070 List of plugins to load for all services. Plugins specific to IMAP,
9071 LDA, etc. are added to this list in their own .conf files.
9072 Defaults to @samp{()}.
9073 @end deftypevr
9074
9075 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-cache-min-mail-count
9076 The minimum number of mails in a mailbox before updates are done to
9077 cache file. This allows optimizing Dovecot's behavior to do less disk
9078 writes at the cost of more disk reads.
9079 Defaults to @samp{0}.
9080 @end deftypevr
9081
9082 @deftypevr {@code{dovecot-configuration} parameter} string mailbox-idle-check-interval
9083 When IDLE command is running, mailbox is checked once in a while to
9084 see if there are any new mails or other changes. This setting defines
9085 the minimum time to wait between those checks. Dovecot can also use
9086 dnotify, inotify and kqueue to find out immediately when changes
9087 occur.
9088 Defaults to @samp{"30 secs"}.
9089 @end deftypevr
9090
9091 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-save-crlf?
9092 Save mails with CR+LF instead of plain LF. This makes sending those
9093 mails take less CPU, especially with sendfile() syscall with Linux and
9094 FreeBSD. But it also creates a bit more disk I/O which may just make it
9095 slower. Also note that if other software reads the mboxes/maildirs,
9096 they may handle the extra CRs wrong and cause problems.
9097 Defaults to @samp{#f}.
9098 @end deftypevr
9099
9100 @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-stat-dirs?
9101 By default LIST command returns all entries in maildir beginning
9102 with a dot. Enabling this option makes Dovecot return only entries
9103 which are directories. This is done by stat()ing each entry, so it
9104 causes more disk I/O.
9105 (For systems setting struct @samp{dirent->d_type} this check is free
9106 and it's done always regardless of this setting).
9107 Defaults to @samp{#f}.
9108 @end deftypevr
9109
9110 @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-copy-with-hardlinks?
9111 When copying a message, do it with hard links whenever possible.
9112 This makes the performance much better, and it's unlikely to have any
9113 side effects.
9114 Defaults to @samp{#t}.
9115 @end deftypevr
9116
9117 @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-very-dirty-syncs?
9118 Assume Dovecot is the only MUA accessing Maildir: Scan cur/
9119 directory only when its mtime changes unexpectedly or when we can't find
9120 the mail otherwise.
9121 Defaults to @samp{#f}.
9122 @end deftypevr
9123
9124 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mbox-read-locks
9125 Which locking methods to use for locking mbox. There are four
9126 available:
9127
9128 @table @code
9129 @item dotlock
9130 Create <mailbox>.lock file. This is the oldest and most NFS-safe
9131 solution. If you want to use /var/mail/ like directory, the users will
9132 need write access to that directory.
9133 @item dotlock-try
9134 Same as dotlock, but if it fails because of permissions or because there
9135 isn't enough disk space, just skip it.
9136 @item fcntl
9137 Use this if possible. Works with NFS too if lockd is used.
9138 @item flock
9139 May not exist in all systems. Doesn't work with NFS.
9140 @item lockf
9141 May not exist in all systems. Doesn't work with NFS.
9142 @end table
9143
9144 You can use multiple locking methods; if you do the order they're declared
9145 in is important to avoid deadlocks if other MTAs/MUAs are using multiple
9146 locking methods as well. Some operating systems don't allow using some of
9147 them simultaneously.
9148 @end deftypevr
9149
9150 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mbox-write-locks
9151
9152 @end deftypevr
9153
9154 @deftypevr {@code{dovecot-configuration} parameter} string mbox-lock-timeout
9155 Maximum time to wait for lock (all of them) before aborting.
9156 Defaults to @samp{"5 mins"}.
9157 @end deftypevr
9158
9159 @deftypevr {@code{dovecot-configuration} parameter} string mbox-dotlock-change-timeout
9160 If dotlock exists but the mailbox isn't modified in any way,
9161 override the lock file after this much time.
9162 Defaults to @samp{"2 mins"}.
9163 @end deftypevr
9164
9165 @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-dirty-syncs?
9166 When mbox changes unexpectedly we have to fully read it to find out
9167 what changed. If the mbox is large this can take a long time. Since
9168 the change is usually just a newly appended mail, it'd be faster to
9169 simply read the new mails. If this setting is enabled, Dovecot does
9170 this but still safely fallbacks to re-reading the whole mbox file
9171 whenever something in mbox isn't how it's expected to be. The only real
9172 downside to this setting is that if some other MUA changes message
9173 flags, Dovecot doesn't notice it immediately. Note that a full sync is
9174 done with SELECT, EXAMINE, EXPUNGE and CHECK commands.
9175 Defaults to @samp{#t}.
9176 @end deftypevr
9177
9178 @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-very-dirty-syncs?
9179 Like @samp{mbox-dirty-syncs}, but don't do full syncs even with SELECT,
9180 EXAMINE, EXPUNGE or CHECK commands. If this is set,
9181 @samp{mbox-dirty-syncs} is ignored.
9182 Defaults to @samp{#f}.
9183 @end deftypevr
9184
9185 @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-lazy-writes?
9186 Delay writing mbox headers until doing a full write sync (EXPUNGE
9187 and CHECK commands and when closing the mailbox). This is especially
9188 useful for POP3 where clients often delete all mails. The downside is
9189 that our changes aren't immediately visible to other MUAs.
9190 Defaults to @samp{#t}.
9191 @end deftypevr
9192
9193 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mbox-min-index-size
9194 If mbox size is smaller than this (e.g. 100k), don't write index
9195 files. If an index file already exists it's still read, just not
9196 updated.
9197 Defaults to @samp{0}.
9198 @end deftypevr
9199
9200 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mdbox-rotate-size
9201 Maximum dbox file size until it's rotated.
9202 Defaults to @samp{2000000}.
9203 @end deftypevr
9204
9205 @deftypevr {@code{dovecot-configuration} parameter} string mdbox-rotate-interval
9206 Maximum dbox file age until it's rotated. Typically in days. Day
9207 begins from midnight, so 1d = today, 2d = yesterday, etc. 0 = check
9208 disabled.
9209 Defaults to @samp{"1d"}.
9210 @end deftypevr
9211
9212 @deftypevr {@code{dovecot-configuration} parameter} boolean mdbox-preallocate-space?
9213 When creating new mdbox files, immediately preallocate their size to
9214 @samp{mdbox-rotate-size}. This setting currently works only in Linux
9215 with some filesystems (ext4, xfs).
9216 Defaults to @samp{#f}.
9217 @end deftypevr
9218
9219 @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-dir
9220 sdbox and mdbox support saving mail attachments to external files,
9221 which also allows single instance storage for them. Other backends
9222 don't support this for now.
9223
9224 WARNING: This feature hasn't been tested much yet. Use at your own risk.
9225
9226 Directory root where to store mail attachments. Disabled, if empty.
9227 Defaults to @samp{""}.
9228 @end deftypevr
9229
9230 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-attachment-min-size
9231 Attachments smaller than this aren't saved externally. It's also
9232 possible to write a plugin to disable saving specific attachments
9233 externally.
9234 Defaults to @samp{128000}.
9235 @end deftypevr
9236
9237 @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-fs
9238 Filesystem backend to use for saving attachments:
9239 @table @code
9240 @item posix
9241 No SiS done by Dovecot (but this might help FS's own deduplication)
9242 @item sis posix
9243 SiS with immediate byte-by-byte comparison during saving
9244 @item sis-queue posix
9245 SiS with delayed comparison and deduplication.
9246 @end table
9247 Defaults to @samp{"sis posix"}.
9248 @end deftypevr
9249
9250 @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-hash
9251 Hash format to use in attachment filenames. You can add any text and
9252 variables: @code{%@{md4@}}, @code{%@{md5@}}, @code{%@{sha1@}},
9253 @code{%@{sha256@}}, @code{%@{sha512@}}, @code{%@{size@}}. Variables can be
9254 truncated, e.g. @code{%@{sha256:80@}} returns only first 80 bits.
9255 Defaults to @samp{"%@{sha1@}"}.
9256 @end deftypevr
9257
9258 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-process-limit
9259
9260 Defaults to @samp{100}.
9261 @end deftypevr
9262
9263 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-client-limit
9264
9265 Defaults to @samp{1000}.
9266 @end deftypevr
9267
9268 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-vsz-limit
9269 Default VSZ (virtual memory size) limit for service processes.
9270 This is mainly intended to catch and kill processes that leak memory
9271 before they eat up everything.
9272 Defaults to @samp{256000000}.
9273 @end deftypevr
9274
9275 @deftypevr {@code{dovecot-configuration} parameter} string default-login-user
9276 Login user is internally used by login processes. This is the most
9277 untrusted user in Dovecot system. It shouldn't have access to anything
9278 at all.
9279 Defaults to @samp{"dovenull"}.
9280 @end deftypevr
9281
9282 @deftypevr {@code{dovecot-configuration} parameter} string default-internal-user
9283 Internal user is used by unprivileged processes. It should be
9284 separate from login user, so that login processes can't disturb other
9285 processes.
9286 Defaults to @samp{"dovecot"}.
9287 @end deftypevr
9288
9289 @deftypevr {@code{dovecot-configuration} parameter} string ssl?
9290 SSL/TLS support: yes, no, required. <doc/wiki/SSL.txt>.
9291 Defaults to @samp{"required"}.
9292 @end deftypevr
9293
9294 @deftypevr {@code{dovecot-configuration} parameter} string ssl-cert
9295 PEM encoded X.509 SSL/TLS certificate (public key).
9296 Defaults to @samp{"</etc/dovecot/default.pem"}.
9297 @end deftypevr
9298
9299 @deftypevr {@code{dovecot-configuration} parameter} string ssl-key
9300 PEM encoded SSL/TLS private key. The key is opened before
9301 dropping root privileges, so keep the key file unreadable by anyone but
9302 root.
9303 Defaults to @samp{"</etc/dovecot/private/default.pem"}.
9304 @end deftypevr
9305
9306 @deftypevr {@code{dovecot-configuration} parameter} string ssl-key-password
9307 If key file is password protected, give the password here.
9308 Alternatively give it when starting dovecot with -p parameter. Since
9309 this file is often world-readable, you may want to place this setting
9310 instead to a different.
9311 Defaults to @samp{""}.
9312 @end deftypevr
9313
9314 @deftypevr {@code{dovecot-configuration} parameter} string ssl-ca
9315 PEM encoded trusted certificate authority. Set this only if you
9316 intend to use @samp{ssl-verify-client-cert? #t}. The file should
9317 contain the CA certificate(s) followed by the matching
9318 CRL(s). (e.g. @samp{ssl-ca </etc/ssl/certs/ca.pem}).
9319 Defaults to @samp{""}.
9320 @end deftypevr
9321
9322 @deftypevr {@code{dovecot-configuration} parameter} boolean ssl-require-crl?
9323 Require that CRL check succeeds for client certificates.
9324 Defaults to @samp{#t}.
9325 @end deftypevr
9326
9327 @deftypevr {@code{dovecot-configuration} parameter} boolean ssl-verify-client-cert?
9328 Request client to send a certificate. If you also want to require
9329 it, set @samp{auth-ssl-require-client-cert? #t} in auth section.
9330 Defaults to @samp{#f}.
9331 @end deftypevr
9332
9333 @deftypevr {@code{dovecot-configuration} parameter} string ssl-cert-username-field
9334 Which field from certificate to use for username. commonName and
9335 x500UniqueIdentifier are the usual choices. You'll also need to set
9336 @samp{auth-ssl-username-from-cert? #t}.
9337 Defaults to @samp{"commonName"}.
9338 @end deftypevr
9339
9340 @deftypevr {@code{dovecot-configuration} parameter} hours ssl-parameters-regenerate
9341 How often to regenerate the SSL parameters file. Generation is
9342 quite CPU intensive operation. The value is in hours, 0 disables
9343 regeneration entirely.
9344 Defaults to @samp{168}.
9345 @end deftypevr
9346
9347 @deftypevr {@code{dovecot-configuration} parameter} string ssl-protocols
9348 SSL protocols to use.
9349 Defaults to @samp{"!SSLv2"}.
9350 @end deftypevr
9351
9352 @deftypevr {@code{dovecot-configuration} parameter} string ssl-cipher-list
9353 SSL ciphers to use.
9354 Defaults to @samp{"ALL:!LOW:!SSLv2:!EXP:!aNULL"}.
9355 @end deftypevr
9356
9357 @deftypevr {@code{dovecot-configuration} parameter} string ssl-crypto-device
9358 SSL crypto device to use, for valid values run "openssl engine".
9359 Defaults to @samp{""}.
9360 @end deftypevr
9361
9362 @deftypevr {@code{dovecot-configuration} parameter} string postmaster-address
9363 Address to use when sending rejection mails.
9364 Default is postmaster@@<your domain>. %d expands to recipient domain.
9365 Defaults to @samp{""}.
9366 @end deftypevr
9367
9368 @deftypevr {@code{dovecot-configuration} parameter} string hostname
9369 Hostname to use in various parts of sent mails (e.g. in Message-Id)
9370 and in LMTP replies. Default is the system's real hostname@@domain.
9371 Defaults to @samp{""}.
9372 @end deftypevr
9373
9374 @deftypevr {@code{dovecot-configuration} parameter} boolean quota-full-tempfail?
9375 If user is over quota, return with temporary failure instead of
9376 bouncing the mail.
9377 Defaults to @samp{#f}.
9378 @end deftypevr
9379
9380 @deftypevr {@code{dovecot-configuration} parameter} file-name sendmail-path
9381 Binary to use for sending mails.
9382 Defaults to @samp{"/usr/sbin/sendmail"}.
9383 @end deftypevr
9384
9385 @deftypevr {@code{dovecot-configuration} parameter} string submission-host
9386 If non-empty, send mails via this SMTP host[:port] instead of
9387 sendmail.
9388 Defaults to @samp{""}.
9389 @end deftypevr
9390
9391 @deftypevr {@code{dovecot-configuration} parameter} string rejection-subject
9392 Subject: header to use for rejection mails. You can use the same
9393 variables as for @samp{rejection-reason} below.
9394 Defaults to @samp{"Rejected: %s"}.
9395 @end deftypevr
9396
9397 @deftypevr {@code{dovecot-configuration} parameter} string rejection-reason
9398 Human readable error message for rejection mails. You can use
9399 variables:
9400
9401 @table @code
9402 @item %n
9403 CRLF
9404 @item %r
9405 reason
9406 @item %s
9407 original subject
9408 @item %t
9409 recipient
9410 @end table
9411 Defaults to @samp{"Your message to <%t> was automatically rejected:%n%r"}.
9412 @end deftypevr
9413
9414 @deftypevr {@code{dovecot-configuration} parameter} string recipient-delimiter
9415 Delimiter character between local-part and detail in email
9416 address.
9417 Defaults to @samp{"+"}.
9418 @end deftypevr
9419
9420 @deftypevr {@code{dovecot-configuration} parameter} string lda-original-recipient-header
9421 Header where the original recipient address (SMTP's RCPT TO:
9422 address) is taken from if not available elsewhere. With dovecot-lda -a
9423 parameter overrides this. A commonly used header for this is
9424 X-Original-To.
9425 Defaults to @samp{""}.
9426 @end deftypevr
9427
9428 @deftypevr {@code{dovecot-configuration} parameter} boolean lda-mailbox-autocreate?
9429 Should saving a mail to a nonexistent mailbox automatically create
9430 it?.
9431 Defaults to @samp{#f}.
9432 @end deftypevr
9433
9434 @deftypevr {@code{dovecot-configuration} parameter} boolean lda-mailbox-autosubscribe?
9435 Should automatically created mailboxes be also automatically
9436 subscribed?.
9437 Defaults to @samp{#f}.
9438 @end deftypevr
9439
9440 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer imap-max-line-length
9441 Maximum IMAP command line length. Some clients generate very long
9442 command lines with huge mailboxes, so you may need to raise this if you
9443 get "Too long argument" or "IMAP command line too large" errors
9444 often.
9445 Defaults to @samp{64000}.
9446 @end deftypevr
9447
9448 @deftypevr {@code{dovecot-configuration} parameter} string imap-logout-format
9449 IMAP logout format string:
9450 @table @code
9451 @item %i
9452 total number of bytes read from client
9453 @item %o
9454 total number of bytes sent to client.
9455 @end table
9456 Defaults to @samp{"in=%i out=%o"}.
9457 @end deftypevr
9458
9459 @deftypevr {@code{dovecot-configuration} parameter} string imap-capability
9460 Override the IMAP CAPABILITY response. If the value begins with '+',
9461 add the given capabilities on top of the defaults (e.g. +XFOO XBAR).
9462 Defaults to @samp{""}.
9463 @end deftypevr
9464
9465 @deftypevr {@code{dovecot-configuration} parameter} string imap-idle-notify-interval
9466 How long to wait between "OK Still here" notifications when client
9467 is IDLEing.
9468 Defaults to @samp{"2 mins"}.
9469 @end deftypevr
9470
9471 @deftypevr {@code{dovecot-configuration} parameter} string imap-id-send
9472 ID field names and values to send to clients. Using * as the value
9473 makes Dovecot use the default value. The following fields have default
9474 values currently: name, version, os, os-version, support-url,
9475 support-email.
9476 Defaults to @samp{""}.
9477 @end deftypevr
9478
9479 @deftypevr {@code{dovecot-configuration} parameter} string imap-id-log
9480 ID fields sent by client to log. * means everything.
9481 Defaults to @samp{""}.
9482 @end deftypevr
9483
9484 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list imap-client-workarounds
9485 Workarounds for various client bugs:
9486
9487 @table @code
9488 @item delay-newmail
9489 Send EXISTS/RECENT new mail notifications only when replying to NOOP and
9490 CHECK commands. Some clients ignore them otherwise, for example OSX
9491 Mail (<v2.1). Outlook Express breaks more badly though, without this it
9492 may show user "Message no longer in server" errors. Note that OE6
9493 still breaks even with this workaround if synchronization is set to
9494 "Headers Only".
9495
9496 @item tb-extra-mailbox-sep
9497 Thunderbird gets somehow confused with LAYOUT=fs (mbox and dbox) and
9498 adds extra @samp{/} suffixes to mailbox names. This option causes Dovecot to
9499 ignore the extra @samp{/} instead of treating it as invalid mailbox name.
9500
9501 @item tb-lsub-flags
9502 Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox).
9503 This makes Thunderbird realize they aren't selectable and show them
9504 greyed out, instead of only later giving "not selectable" popup error.
9505 @end table
9506 Defaults to @samp{()}.
9507 @end deftypevr
9508
9509 @deftypevr {@code{dovecot-configuration} parameter} string imap-urlauth-host
9510 Host allowed in URLAUTH URLs sent by client. "*" allows all.
9511 Defaults to @samp{""}.
9512 @end deftypevr
9513
9514
9515 Whew! Lots of configuration options. The nice thing about it though is
9516 that GuixSD has a complete interface to Dovecot's configuration
9517 language. This allows not only a nice way to declare configurations,
9518 but also offers reflective capabilities as well: users can write code to
9519 inspect and transform configurations from within Scheme.
9520
9521 However, it could be that you just want to get a @code{dovecot.conf} up
9522 and running. In that case, you can pass an
9523 @code{opaque-dovecot-configuration} as the @code{#:config} paramter to
9524 @code{dovecot-service}. As its name indicates, an opaque configuration
9525 does not have easy reflective capabilities.
9526
9527 Available @code{opaque-dovecot-configuration} fields are:
9528
9529 @deftypevr {@code{opaque-dovecot-configuration} parameter} package dovecot
9530 The dovecot package.
9531 @end deftypevr
9532
9533 @deftypevr {@code{opaque-dovecot-configuration} parameter} string string
9534 The contents of the @code{dovecot.conf}, as a string.
9535 @end deftypevr
9536
9537 For example, if your @code{dovecot.conf} is just the empty string, you
9538 could instantiate a dovecot service like this:
9539
9540 @example
9541 (dovecot-service #:config
9542 (opaque-dovecot-configuration
9543 (string "")))
9544 @end example
9545
9546 @node Web Services
9547 @subsubsection Web Services
9548
9549 The @code{(gnu services web)} module provides the following service:
9550
9551 @deffn {Scheme Procedure} nginx-service [#:nginx nginx] @
9552 [#:log-directory ``/var/log/nginx''] @
9553 [#:run-directory ``/var/run/nginx''] @
9554 [#:config-file]
9555
9556 Return a service that runs @var{nginx}, the nginx web server.
9557
9558 The nginx daemon loads its runtime configuration from @var{config-file}.
9559 Log files are written to @var{log-directory} and temporary runtime data
9560 files are written to @var{run-directory}. For proper operation, these
9561 arguments should match what is in @var{config-file} to ensure that the
9562 directories are created when the service is activated.
9563
9564 @end deffn
9565
9566 @node Various Services
9567 @subsubsection Various Services
9568
9569 The @code{(gnu services lirc)} module provides the following service.
9570
9571 @deffn {Scheme Procedure} lirc-service [#:lirc lirc] @
9572 [#:device #f] [#:driver #f] [#:config-file #f] @
9573 [#:extra-options '()]
9574 Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
9575 decodes infrared signals from remote controls.
9576
9577 Optionally, @var{device}, @var{driver} and @var{config-file}
9578 (configuration file name) may be specified. See @command{lircd} manual
9579 for details.
9580
9581 Finally, @var{extra-options} is a list of additional command-line options
9582 passed to @command{lircd}.
9583 @end deffn
9584
9585 @subsubsection Dictionary Services
9586 The @code{(gnu services dict)} module provides the following service:
9587
9588 @deffn {Scheme Procedure} dicod-service [#:config (dicod-configuration)]
9589 Return a service that runs the @command{dicod} daemon, an implementation
9590 of DICT server (@pxref{Dicod,,, dico, GNU Dico Manual}).
9591
9592 The optional @var{config} argument specifies the configuration for
9593 @command{dicod}, which should be a @code{<dicod-configuration>} object, by
9594 default it serves the GNU Collaborative International Dictonary of English.
9595
9596 You can add @command{open localhost} to your @file{~/.dico} file to make
9597 @code{localhost} the default server for @command{dico} client
9598 (@pxref{Initialization File,,, dico, GNU Dico Manual}).
9599 @end deffn
9600
9601 @deftp {Data Type} dicod-configuration
9602 Data type representing the configuration of dicod.
9603
9604 @table @asis
9605 @item @code{dico} (default: @var{dico})
9606 Package object of the GNU Dico dictionary server.
9607
9608 @item @code{interfaces} (default: @var{'("localhost")})
9609 This is the list of IP addresses and ports and possibly socket file
9610 names to listen to (@pxref{Server Settings, @code{listen} directive,,
9611 dico, GNU Dico Manual}).
9612
9613 @item @code{databases} (default: @var{(list %dicod-database:gcide)})
9614 List of @code{<dicod-database>} objects denoting dictionaries to be served.
9615 @end table
9616 @end deftp
9617
9618 @deftp {Data Type} dicod-database
9619 Data type representing a dictionary database.
9620
9621 @table @asis
9622 @item @code{name}
9623 Name of the database, will be used in DICT commands.
9624
9625 @item @code{module}
9626 Name of the dicod module used by this database
9627 (@pxref{Modules,,, dico, GNU Dico Manual}).
9628
9629 @item @code{options}
9630 List of strings or gexps representing the arguments for the module handler
9631 (@pxref{Handlers,,, dico, GNU Dico Manual}).
9632 @end table
9633 @end deftp
9634
9635 @defvr {Scheme Variable} %dicod-database:gcide
9636 A @code{<dicod-database>} object serving the GNU Collaborative International
9637 Dictonary of English using the @code{gcide} package.
9638 @end defvr
9639
9640 @node Setuid Programs
9641 @subsection Setuid Programs
9642
9643 @cindex setuid programs
9644 Some programs need to run with ``root'' privileges, even when they are
9645 launched by unprivileged users. A notorious example is the
9646 @command{passwd} program, which users can run to change their
9647 password, and which needs to access the @file{/etc/passwd} and
9648 @file{/etc/shadow} files---something normally restricted to root, for
9649 obvious security reasons. To address that, these executables are
9650 @dfn{setuid-root}, meaning that they always run with root privileges
9651 (@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
9652 for more info about the setuid mechanism.)
9653
9654 The store itself @emph{cannot} contain setuid programs: that would be a
9655 security issue since any user on the system can write derivations that
9656 populate the store (@pxref{The Store}). Thus, a different mechanism is
9657 used: instead of changing the setuid bit directly on files that are in
9658 the store, we let the system administrator @emph{declare} which programs
9659 should be setuid root.
9660
9661 The @code{setuid-programs} field of an @code{operating-system}
9662 declaration contains a list of G-expressions denoting the names of
9663 programs to be setuid-root (@pxref{Using the Configuration System}).
9664 For instance, the @command{passwd} program, which is part of the Shadow
9665 package, can be designated by this G-expression (@pxref{G-Expressions}):
9666
9667 @example
9668 #~(string-append #$shadow "/bin/passwd")
9669 @end example
9670
9671 A default set of setuid programs is defined by the
9672 @code{%setuid-programs} variable of the @code{(gnu system)} module.
9673
9674 @defvr {Scheme Variable} %setuid-programs
9675 A list of G-expressions denoting common programs that are setuid-root.
9676
9677 The list includes commands such as @command{passwd}, @command{ping},
9678 @command{su}, and @command{sudo}.
9679 @end defvr
9680
9681 Under the hood, the actual setuid programs are created in the
9682 @file{/run/setuid-programs} directory at system activation time. The
9683 files in this directory refer to the ``real'' binaries, which are in the
9684 store.
9685
9686 @node X.509 Certificates
9687 @subsection X.509 Certificates
9688
9689 @cindex HTTPS, certificates
9690 @cindex X.509 certificates
9691 @cindex TLS
9692 Web servers available over HTTPS (that is, HTTP over the transport-layer
9693 security mechanism, TLS) send client programs an @dfn{X.509 certificate}
9694 that the client can then use to @emph{authenticate} the server. To do
9695 that, clients verify that the server's certificate is signed by a
9696 so-called @dfn{certificate authority} (CA). But to verify the CA's
9697 signature, clients must have first acquired the CA's certificate.
9698
9699 Web browsers such as GNU@tie{}IceCat include their own set of CA
9700 certificates, such that they are able to verify CA signatures
9701 out-of-the-box.
9702
9703 However, most other programs that can talk HTTPS---@command{wget},
9704 @command{git}, @command{w3m}, etc.---need to be told where CA
9705 certificates can be found.
9706
9707 @cindex @code{nss-certs}
9708 In GuixSD, this is done by adding a package that provides certificates
9709 to the @code{packages} field of the @code{operating-system} declaration
9710 (@pxref{operating-system Reference}). GuixSD includes one such package,
9711 @code{nss-certs}, which is a set of CA certificates provided as part of
9712 Mozilla's Network Security Services.
9713
9714 Note that it is @emph{not} part of @var{%base-packages}, so you need to
9715 explicitly add it. The @file{/etc/ssl/certs} directory, which is where
9716 most applications and libraries look for certificates by default, points
9717 to the certificates installed globally.
9718
9719 Unprivileged users, including users of Guix on a foreign distro,
9720 can also install their own certificate package in
9721 their profile. A number of environment variables need to be defined so
9722 that applications and libraries know where to find them. Namely, the
9723 OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
9724 variables. Some applications add their own environment variables; for
9725 instance, the Git version control system honors the certificate bundle
9726 pointed to by the @code{GIT_SSL_CAINFO} environment variable. Thus, you
9727 would typically run something like:
9728
9729 @example
9730 $ guix package -i nss-certs
9731 $ export SSL_CERT_DIR="$HOME/.guix-profile/etc/ssl/certs"
9732 $ export SSL_CERT_FILE="$HOME/.guix-profile/etc/ssl/certs/ca-certificates.crt"
9733 $ export GIT_SSL_CAINFO="$SSL_CERT_FILE"
9734 @end example
9735
9736 @node Name Service Switch
9737 @subsection Name Service Switch
9738
9739 @cindex name service switch
9740 @cindex NSS
9741 The @code{(gnu system nss)} module provides bindings to the
9742 configuration file of the libc @dfn{name service switch} or @dfn{NSS}
9743 (@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
9744 Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
9745 extended with new ``name'' lookup methods for system databases, which
9746 includes host names, service names, user accounts, and more (@pxref{Name
9747 Service Switch, System Databases and Name Service Switch,, libc, The GNU
9748 C Library Reference Manual}).
9749
9750 The NSS configuration specifies, for each system database, which lookup
9751 method is to be used, and how the various methods are chained
9752 together---for instance, under which circumstances NSS should try the
9753 next method in the list. The NSS configuration is given in the
9754 @code{name-service-switch} field of @code{operating-system} declarations
9755 (@pxref{operating-system Reference, @code{name-service-switch}}).
9756
9757 @cindex nss-mdns
9758 @cindex .local, host name lookup
9759 As an example, the declaration below configures the NSS to use the
9760 @uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
9761 back-end}, which supports host name lookups over multicast DNS (mDNS)
9762 for host names ending in @code{.local}:
9763
9764 @example
9765 (name-service-switch
9766 (hosts (list %files ;first, check /etc/hosts
9767
9768 ;; If the above did not succeed, try
9769 ;; with 'mdns_minimal'.
9770 (name-service
9771 (name "mdns_minimal")
9772
9773 ;; 'mdns_minimal' is authoritative for
9774 ;; '.local'. When it returns "not found",
9775 ;; no need to try the next methods.
9776 (reaction (lookup-specification
9777 (not-found => return))))
9778
9779 ;; Then fall back to DNS.
9780 (name-service
9781 (name "dns"))
9782
9783 ;; Finally, try with the "full" 'mdns'.
9784 (name-service
9785 (name "mdns")))))
9786 @end example
9787
9788 Do not worry: the @code{%mdns-host-lookup-nss} variable (see below)
9789 contains this configuration, so you will not have to type it if all you
9790 want is to have @code{.local} host lookup working.
9791
9792 Note that, in this case, in addition to setting the
9793 @code{name-service-switch} of the @code{operating-system} declaration,
9794 you also need to use @code{avahi-service} (@pxref{Networking Services,
9795 @code{avahi-service}}), or @var{%desktop-services}, which includes it
9796 (@pxref{Desktop Services}). Doing this makes @code{nss-mdns} accessible
9797 to the name service cache daemon (@pxref{Base Services,
9798 @code{nscd-service}}).
9799
9800 For convenience, the following variables provide typical NSS
9801 configurations.
9802
9803 @defvr {Scheme Variable} %default-nss
9804 This is the default name service switch configuration, a
9805 @code{name-service-switch} object.
9806 @end defvr
9807
9808 @defvr {Scheme Variable} %mdns-host-lookup-nss
9809 This is the name service switch configuration with support for host name
9810 lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
9811 @end defvr
9812
9813 The reference for name service switch configuration is given below. It
9814 is a direct mapping of the configuration file format of the C library , so
9815 please refer to the C library manual for more information (@pxref{NSS
9816 Configuration File,,, libc, The GNU C Library Reference Manual}).
9817 Compared to the configuration file format of libc NSS, it has the advantage
9818 not only of adding this warm parenthetic feel that we like, but also
9819 static checks: you will know about syntax errors and typos as soon as you
9820 run @command{guix system}.
9821
9822 @deftp {Data Type} name-service-switch
9823
9824 This is the data type representation the configuration of libc's name
9825 service switch (NSS). Each field below represents one of the supported
9826 system databases.
9827
9828 @table @code
9829 @item aliases
9830 @itemx ethers
9831 @itemx group
9832 @itemx gshadow
9833 @itemx hosts
9834 @itemx initgroups
9835 @itemx netgroup
9836 @itemx networks
9837 @itemx password
9838 @itemx public-key
9839 @itemx rpc
9840 @itemx services
9841 @itemx shadow
9842 The system databases handled by the NSS. Each of these fields must be a
9843 list of @code{<name-service>} objects (see below).
9844 @end table
9845 @end deftp
9846
9847 @deftp {Data Type} name-service
9848
9849 This is the data type representing an actual name service and the
9850 associated lookup action.
9851
9852 @table @code
9853 @item name
9854 A string denoting the name service (@pxref{Services in the NSS
9855 configuration,,, libc, The GNU C Library Reference Manual}).
9856
9857 Note that name services listed here must be visible to nscd. This is
9858 achieved by passing the @code{#:name-services} argument to
9859 @code{nscd-service} the list of packages providing the needed name
9860 services (@pxref{Base Services, @code{nscd-service}}).
9861
9862 @item reaction
9863 An action specified using the @code{lookup-specification} macro
9864 (@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
9865 Reference Manual}). For example:
9866
9867 @example
9868 (lookup-specification (unavailable => continue)
9869 (success => return))
9870 @end example
9871 @end table
9872 @end deftp
9873
9874 @node Initial RAM Disk
9875 @subsection Initial RAM Disk
9876
9877 @cindex initial RAM disk (initrd)
9878 @cindex initrd (initial RAM disk)
9879 For bootstrapping purposes, the Linux-Libre kernel is passed an
9880 @dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
9881 root file system as well as an initialization script. The latter is
9882 responsible for mounting the real root file system, and for loading any
9883 kernel modules that may be needed to achieve that.
9884
9885 The @code{initrd} field of an @code{operating-system} declaration allows
9886 you to specify which initrd you would like to use. The @code{(gnu
9887 system linux-initrd)} module provides two ways to build an initrd: the
9888 high-level @code{base-initrd} procedure, and the low-level
9889 @code{expression->initrd} procedure.
9890
9891 The @code{base-initrd} procedure is intended to cover most common uses.
9892 For example, if you want to add a bunch of kernel modules to be loaded
9893 at boot time, you can define the @code{initrd} field of the operating
9894 system declaration like this:
9895
9896 @example
9897 (initrd (lambda (file-systems . rest)
9898 ;; Create a standard initrd that has modules "foo.ko"
9899 ;; and "bar.ko", as well as their dependencies, in
9900 ;; addition to the modules available by default.
9901 (apply base-initrd file-systems
9902 #:extra-modules '("foo" "bar")
9903 rest)))
9904 @end example
9905
9906 The @code{base-initrd} procedure also handles common use cases that
9907 involves using the system as a QEMU guest, or as a ``live'' system with
9908 volatile root file system.
9909
9910 The initial RAM disk produced by @code{base-initrd} honors several
9911 options passed on the Linux kernel command line (that is, arguments
9912 passed @i{via} the @code{linux} command of GRUB, or the
9913 @code{-append} option) of QEMU, notably:
9914
9915 @table @code
9916 @item --load=@var{boot}
9917 Tell the initial RAM disk to load @var{boot}, a file containing a Scheme
9918 program, once it has mounted the root file system.
9919
9920 GuixSD uses this option to yield control to a boot program that runs the
9921 service activation programs and then spawns the GNU@tie{}Shepherd, the
9922 initialization system.
9923
9924 @item --root=@var{root}
9925 Mount @var{root} as the root file system. @var{root} can be a
9926 device name like @code{/dev/sda1}, a partition label, or a partition
9927 UUID.
9928
9929 @item --system=@var{system}
9930 Have @file{/run/booted-system} and @file{/run/current-system} point to
9931 @var{system}.
9932
9933 @item modprobe.blacklist=@var{modules}@dots{}
9934 @cindex module, black-listing
9935 @cindex black list, of kernel modules
9936 Instruct the initial RAM disk as well as the @command{modprobe} command
9937 (from the kmod package) to refuse to load @var{modules}. @var{modules}
9938 must be a comma-separated list of module names---e.g.,
9939 @code{usbkbd,9pnet}.
9940
9941 @item --repl
9942 Start a read-eval-print loop (REPL) from the initial RAM disk before it
9943 tries to load kernel modules and to mount the root file system. Our
9944 marketing team calls it @dfn{boot-to-Guile}. The Schemer in you will
9945 love it. @xref{Using Guile Interactively,,, guile, GNU Guile Reference
9946 Manual}, for more information on Guile's REPL.
9947
9948 @end table
9949
9950 Now that you know all the features that initial RAM disks produced by
9951 @code{base-initrd} provide, here is how to use it and customize it
9952 further.
9953
9954 @deffn {Monadic Procedure} base-initrd @var{file-systems} @
9955 [#:qemu-networking? #f] [#:virtio? #t] [#:volatile-root? #f] @
9956 [#:extra-modules '()] [#:mapped-devices '()]
9957 Return a monadic derivation that builds a generic initrd. @var{file-systems} is
9958 a list of file systems to be mounted by the initrd, possibly in addition to
9959 the root file system specified on the kernel command line via @code{--root}.
9960 @var{mapped-devices} is a list of device mappings to realize before
9961 @var{file-systems} are mounted (@pxref{Mapped Devices}).
9962
9963 When @var{qemu-networking?} is true, set up networking with the standard QEMU
9964 parameters. When @var{virtio?} is true, load additional modules so that the
9965 initrd can be used as a QEMU guest with para-virtualized I/O drivers.
9966
9967 When @var{volatile-root?} is true, the root file system is writable but any changes
9968 to it are lost.
9969
9970 The initrd is automatically populated with all the kernel modules necessary
9971 for @var{file-systems} and for the given options. However, additional kernel
9972 modules can be listed in @var{extra-modules}. They will be added to the initrd, and
9973 loaded at boot time in the order in which they appear.
9974 @end deffn
9975
9976 Needless to say, the initrds we produce and use embed a
9977 statically-linked Guile, and the initialization program is a Guile
9978 program. That gives a lot of flexibility. The
9979 @code{expression->initrd} procedure builds such an initrd, given the
9980 program to run in that initrd.
9981
9982 @deffn {Monadic Procedure} expression->initrd @var{exp} @
9983 [#:guile %guile-static-stripped] [#:name "guile-initrd"] @
9984 [#:modules '()]
9985 Return a derivation that builds a Linux initrd (a gzipped cpio archive)
9986 containing @var{guile} and that evaluates @var{exp}, a G-expression,
9987 upon booting. All the derivations referenced by @var{exp} are
9988 automatically copied to the initrd.
9989
9990 @var{modules} is a list of Guile module names to be embedded in the
9991 initrd.
9992 @end deffn
9993
9994 @node GRUB Configuration
9995 @subsection GRUB Configuration
9996
9997 @cindex GRUB
9998 @cindex boot loader
9999
10000 The operating system uses GNU@tie{}GRUB as its boot loader
10001 (@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
10002 configured using a @code{grub-configuration} declaration. This data type
10003 is exported by the @code{(gnu system grub)} module and described below.
10004
10005 @deftp {Data Type} grub-configuration
10006 The type of a GRUB configuration declaration.
10007
10008 @table @asis
10009
10010 @item @code{device}
10011 This is a string denoting the boot device. It must be a device name
10012 understood by the @command{grub-install} command, such as
10013 @code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
10014 GNU GRUB Manual}).
10015
10016 @item @code{menu-entries} (default: @code{()})
10017 A possibly empty list of @code{menu-entry} objects (see below), denoting
10018 entries to appear in the GRUB boot menu, in addition to the current
10019 system entry and the entry pointing to previous system generations.
10020
10021 @item @code{default-entry} (default: @code{0})
10022 The index of the default boot menu entry. Index 0 is for the entry of the
10023 current system.
10024
10025 @item @code{timeout} (default: @code{5})
10026 The number of seconds to wait for keyboard input before booting. Set to
10027 0 to boot immediately, and to -1 to wait indefinitely.
10028
10029 @item @code{theme} (default: @var{%default-theme})
10030 The @code{grub-theme} object describing the theme to use.
10031 @end table
10032
10033 @end deftp
10034
10035 Should you want to list additional boot menu entries @i{via} the
10036 @code{menu-entries} field above, you will need to create them with the
10037 @code{menu-entry} form:
10038
10039 @deftp {Data Type} menu-entry
10040 The type of an entry in the GRUB boot menu.
10041
10042 @table @asis
10043
10044 @item @code{label}
10045 The label to show in the menu---e.g., @code{"GNU"}.
10046
10047 @item @code{linux}
10048 The Linux kernel to boot.
10049
10050 @item @code{linux-arguments} (default: @code{()})
10051 The list of extra Linux kernel command-line arguments---e.g.,
10052 @code{("console=ttyS0")}.
10053
10054 @item @code{initrd}
10055 A G-Expression or string denoting the file name of the initial RAM disk
10056 to use (@pxref{G-Expressions}).
10057
10058 @end table
10059 @end deftp
10060
10061 @c FIXME: Write documentation once it's stable.
10062 Themes are created using the @code{grub-theme} form, which is not
10063 documented yet.
10064
10065 @defvr {Scheme Variable} %default-theme
10066 This is the default GRUB theme used by the operating system, with a
10067 fancy background image displaying the GNU and Guix logos.
10068 @end defvr
10069
10070
10071 @node Invoking guix system
10072 @subsection Invoking @code{guix system}
10073
10074 Once you have written an operating system declaration as seen in the
10075 previous section, it can be @dfn{instantiated} using the @command{guix
10076 system} command. The synopsis is:
10077
10078 @example
10079 guix system @var{options}@dots{} @var{action} @var{file}
10080 @end example
10081
10082 @var{file} must be the name of a file containing an
10083 @code{operating-system} declaration. @var{action} specifies how the
10084 operating system is instantiated. Currently the following values are
10085 supported:
10086
10087 @table @code
10088 @item reconfigure
10089 Build the operating system described in @var{file}, activate it, and
10090 switch to it@footnote{This action is usable only on systems already
10091 running GuixSD.}.
10092
10093 This effects all the configuration specified in @var{file}: user
10094 accounts, system services, global package list, setuid programs, etc.
10095 The command starts system services specified in @var{file} that are not
10096 currently running; if a service is currently running, it does not
10097 attempt to upgrade it since this would not be possible without stopping it
10098 first.
10099
10100 It also adds a GRUB menu entry for the new OS configuration, and moves
10101 entries for older configurations to a submenu---unless
10102 @option{--no-grub} is passed.
10103
10104 @quotation Note
10105 @c The paragraph below refers to the problem discussed at
10106 @c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
10107 It is highly recommended to run @command{guix pull} once before you run
10108 @command{guix system reconfigure} for the first time (@pxref{Invoking
10109 guix pull}). Failing to do that you would see an older version of Guix
10110 once @command{reconfigure} has completed.
10111 @end quotation
10112
10113 @item build
10114 Build the derivation of the operating system, which includes all the
10115 configuration files and programs needed to boot and run the system.
10116 This action does not actually install anything.
10117
10118 @item init
10119 Populate the given directory with all the files necessary to run the
10120 operating system specified in @var{file}. This is useful for first-time
10121 installations of GuixSD. For instance:
10122
10123 @example
10124 guix system init my-os-config.scm /mnt
10125 @end example
10126
10127 copies to @file{/mnt} all the store items required by the configuration
10128 specified in @file{my-os-config.scm}. This includes configuration
10129 files, packages, and so on. It also creates other essential files
10130 needed for the system to operate correctly---e.g., the @file{/etc},
10131 @file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
10132
10133 This command also installs GRUB on the device specified in
10134 @file{my-os-config}, unless the @option{--no-grub} option was passed.
10135
10136 @item vm
10137 @cindex virtual machine
10138 @cindex VM
10139 @anchor{guix system vm}
10140 Build a virtual machine that contains the operating system declared in
10141 @var{file}, and return a script to run that virtual machine (VM).
10142 Arguments given to the script are passed to QEMU.
10143
10144 The VM shares its store with the host system.
10145
10146 Additional file systems can be shared between the host and the VM using
10147 the @code{--share} and @code{--expose} command-line options: the former
10148 specifies a directory to be shared with write access, while the latter
10149 provides read-only access to the shared directory.
10150
10151 The example below creates a VM in which the user's home directory is
10152 accessible read-only, and where the @file{/exchange} directory is a
10153 read-write mapping of @file{$HOME/tmp} on the host:
10154
10155 @example
10156 guix system vm my-config.scm \
10157 --expose=$HOME --share=$HOME/tmp=/exchange
10158 @end example
10159
10160 On GNU/Linux, the default is to boot directly to the kernel; this has
10161 the advantage of requiring only a very tiny root disk image since the
10162 store of the host can then be mounted.
10163
10164 The @code{--full-boot} option forces a complete boot sequence, starting
10165 with the bootloader. This requires more disk space since a root image
10166 containing at least the kernel, initrd, and bootloader data files must
10167 be created. The @code{--image-size} option can be used to specify the
10168 size of the image.
10169
10170 @item vm-image
10171 @itemx disk-image
10172 Return a virtual machine or disk image of the operating system declared
10173 in @var{file} that stands alone. Use the @option{--image-size} option
10174 to specify the size of the image.
10175
10176 When using @code{vm-image}, the returned image is in qcow2 format, which
10177 the QEMU emulator can efficiently use. @xref{Running GuixSD in a VM},
10178 for more information on how to run the image in a virtual machine.
10179
10180 When using @code{disk-image}, a raw disk image is produced; it can be
10181 copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
10182 the device corresponding to a USB stick, one can copy the image to it
10183 using the following command:
10184
10185 @example
10186 # dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
10187 @end example
10188
10189 @item container
10190 Return a script to run the operating system declared in @var{file}
10191 within a container. Containers are a set of lightweight isolation
10192 mechanisms provided by the kernel Linux-libre. Containers are
10193 substantially less resource-demanding than full virtual machines since
10194 the kernel, shared objects, and other resources can be shared with the
10195 host system; this also means they provide thinner isolation.
10196
10197 Currently, the script must be run as root in order to support more than
10198 a single user and group. The container shares its store with the host
10199 system.
10200
10201 As with the @code{vm} action (@pxref{guix system vm}), additional file
10202 systems to be shared between the host and container can be specified
10203 using the @option{--share} and @option{--expose} options:
10204
10205 @example
10206 guix system container my-config.scm \
10207 --expose=$HOME --share=$HOME/tmp=/exchange
10208 @end example
10209
10210 @quotation Note
10211 This option requires Linux-libre 3.19 or newer.
10212 @end quotation
10213
10214 @end table
10215
10216 @var{options} can contain any of the common build options (@pxref{Common
10217 Build Options}). In addition, @var{options} can contain one of the
10218 following:
10219
10220 @table @option
10221 @item --system=@var{system}
10222 @itemx -s @var{system}
10223 Attempt to build for @var{system} instead of the host system type.
10224 This works as per @command{guix build} (@pxref{Invoking guix build}).
10225
10226 @item --derivation
10227 @itemx -d
10228 Return the derivation file name of the given operating system without
10229 building anything.
10230
10231 @item --image-size=@var{size}
10232 For the @code{vm-image} and @code{disk-image} actions, create an image
10233 of the given @var{size}. @var{size} may be a number of bytes, or it may
10234 include a unit as a suffix (@pxref{Block size, size specifications,,
10235 coreutils, GNU Coreutils}).
10236
10237 @item --on-error=@var{strategy}
10238 Apply @var{strategy} when an error occurs when reading @var{file}.
10239 @var{strategy} may be one of the following:
10240
10241 @table @code
10242 @item nothing-special
10243 Report the error concisely and exit. This is the default strategy.
10244
10245 @item backtrace
10246 Likewise, but also display a backtrace.
10247
10248 @item debug
10249 Report the error and enter Guile's debugger. From there, you can run
10250 commands such as @code{,bt} to get a backtrace, @code{,locals} to
10251 display local variable values, and more generally inspect the state of the
10252 program. @xref{Debug Commands,,, guile, GNU Guile Reference Manual}, for
10253 a list of available debugging commands.
10254 @end table
10255 @end table
10256
10257 @quotation Note
10258 All the actions above, except @code{build} and @code{init},
10259 can use KVM support in the Linux-libre kernel. Specifically, if the
10260 machine has hardware virtualization support, the corresponding
10261 KVM kernel module should be loaded, and the @file{/dev/kvm} device node
10262 must exist and be readable and writable by the user and by the
10263 build users of the daemon (@pxref{Build Environment Setup}).
10264 @end quotation
10265
10266 Once you have built, configured, re-configured, and re-re-configured
10267 your GuixSD installation, you may find it useful to list the operating
10268 system generations available on disk---and that you can choose from the
10269 GRUB boot menu:
10270
10271 @table @code
10272
10273 @item list-generations
10274 List a summary of each generation of the operating system available on
10275 disk, in a human-readable way. This is similar to the
10276 @option{--list-generations} option of @command{guix package}
10277 (@pxref{Invoking guix package}).
10278
10279 Optionally, one can specify a pattern, with the same syntax that is used
10280 in @command{guix package --list-generations}, to restrict the list of
10281 generations displayed. For instance, the following command displays
10282 generations that are up to 10 days old:
10283
10284 @example
10285 $ guix system list-generations 10d
10286 @end example
10287
10288 @end table
10289
10290 The @command{guix system} command has even more to offer! The following
10291 sub-commands allow you to visualize how your system services relate to
10292 each other:
10293
10294 @anchor{system-extension-graph}
10295 @table @code
10296
10297 @item extension-graph
10298 Emit in Dot/Graphviz format to standard output the @dfn{service
10299 extension graph} of the operating system defined in @var{file}
10300 (@pxref{Service Composition}, for more information on service
10301 extensions.)
10302
10303 The command:
10304
10305 @example
10306 $ guix system extension-graph @var{file} | dot -Tpdf > services.pdf
10307 @end example
10308
10309 produces a PDF file showing the extension relations among services.
10310
10311 @anchor{system-shepherd-graph}
10312 @item shepherd-graph
10313 Emit in Dot/Graphviz format to standard output the @dfn{dependency
10314 graph} of shepherd services of the operating system defined in
10315 @var{file}. @xref{Shepherd Services}, for more information and for an
10316 example graph.
10317
10318 @end table
10319
10320 @node Running GuixSD in a VM
10321 @subsection Running GuixSD in a Virtual Machine
10322
10323 One way to run GuixSD in a virtual machine (VM) is to build a GuixSD
10324 virtual machine image using @command{guix system vm-image}
10325 (@pxref{Invoking guix system}). The returned image is in qcow2 format,
10326 which the @uref{http://qemu.org/, QEMU emulator} can efficiently use.
10327
10328 To run the image in QEMU, copy it out of the store (@pxref{The Store})
10329 and give yourself permission to write to the copy. When invoking QEMU,
10330 you must choose a system emulator that is suitable for your hardware
10331 platform. Here is a minimal QEMU invocation that will boot the result
10332 of @command{guix system vm-image} on x86_64 hardware:
10333
10334 @example
10335 $ qemu-system-x86_64 \
10336 -net user -net nic,model=virtio \
10337 -enable-kvm -m 256 /tmp/qemu-image
10338 @end example
10339
10340 Here is what each of these options means:
10341
10342 @table @code
10343 @item qemu-system-x86_64
10344 This specifies the hardware platform to emulate. This should match the
10345 host.
10346
10347 @item -net user
10348 Enable the unprivileged user-mode network stack. The guest OS can
10349 access the host but not vice versa. This is the simplest way to get the
10350 guest OS online. If you do not choose a network stack, the boot will
10351 fail.
10352
10353 @item -net nic,model=virtio
10354 You must create a network interface of a given model. If you do not
10355 create a NIC, the boot will fail. Assuming your hardware platform is
10356 x86_64, you can get a list of available NIC models by running
10357 @command{qemu-system-x86_64 -net nic,model=help}.
10358
10359 @item -enable-kvm
10360 If your system has hardware virtualization extensions, enabling the
10361 virtual machine support (KVM) of the Linux kernel will make things run
10362 faster.
10363
10364 @item -m 256
10365 RAM available to the guest OS, in mebibytes. Defaults to 128@tie{}MiB,
10366 which may be insufficent for some operations.
10367
10368 @item /tmp/qemu-image
10369 The file name of the qcow2 image.
10370 @end table
10371
10372 @node Defining Services
10373 @subsection Defining Services
10374
10375 The previous sections show the available services and how one can combine
10376 them in an @code{operating-system} declaration. But how do we define
10377 them in the first place? And what is a service anyway?
10378
10379 @menu
10380 * Service Composition:: The model for composing services.
10381 * Service Types and Services:: Types and services.
10382 * Service Reference:: API reference.
10383 * Shepherd Services:: A particular type of service.
10384 @end menu
10385
10386 @node Service Composition
10387 @subsubsection Service Composition
10388
10389 @cindex services
10390 @cindex daemons
10391 Here we define a @dfn{service} as, broadly, something that extends the
10392 functionality of the operating system. Often a service is a process---a
10393 @dfn{daemon}---started when the system boots: a secure shell server, a
10394 Web server, the Guix build daemon, etc. Sometimes a service is a daemon
10395 whose execution can be triggered by another daemon---e.g., an FTP server
10396 started by @command{inetd} or a D-Bus service activated by
10397 @command{dbus-daemon}. Occasionally, a service does not map to a
10398 daemon. For instance, the ``account'' service collects user accounts
10399 and makes sure they exist when the system runs; the ``udev'' service
10400 collects device management rules and makes them available to the eudev
10401 daemon; the @file{/etc} service populates the @file{/etc} directory
10402 of the system.
10403
10404 @cindex service extensions
10405 GuixSD services are connected by @dfn{extensions}. For instance, the
10406 secure shell service @emph{extends} the Shepherd---the GuixSD
10407 initialization system, running as PID@tie{}1---by giving it the command
10408 lines to start and stop the secure shell daemon (@pxref{Networking
10409 Services, @code{lsh-service}}); the UPower service extends the D-Bus
10410 service by passing it its @file{.service} specification, and extends the
10411 udev service by passing it device management rules (@pxref{Desktop
10412 Services, @code{upower-service}}); the Guix daemon service extends the
10413 Shepherd by passing it the command lines to start and stop the daemon,
10414 and extends the account service by passing it a list of required build
10415 user accounts (@pxref{Base Services}).
10416
10417 All in all, services and their ``extends'' relations form a directed
10418 acyclic graph (DAG). If we represent services as boxes and extensions
10419 as arrows, a typical system might provide something like this:
10420
10421 @image{images/service-graph,,5in,Typical service extension graph.}
10422
10423 @cindex system service
10424 At the bottom, we see the @dfn{system service}, which produces the
10425 directory containing everything to run and boot the system, as returned
10426 by the @command{guix system build} command. @xref{Service Reference},
10427 to learn about the other service types shown here.
10428 @xref{system-extension-graph, the @command{guix system extension-graph}
10429 command}, for information on how to generate this representation for a
10430 particular operating system definition.
10431
10432 @cindex service types
10433 Technically, developers can define @dfn{service types} to express these
10434 relations. There can be any number of services of a given type on the
10435 system---for instance, a system running two instances of the GNU secure
10436 shell server (lsh) has two instances of @var{lsh-service-type}, with
10437 different parameters.
10438
10439 The following section describes the programming interface for service
10440 types and services.
10441
10442 @node Service Types and Services
10443 @subsubsection Service Types and Services
10444
10445 A @dfn{service type} is a node in the DAG described above. Let us start
10446 with a simple example, the service type for the Guix build daemon
10447 (@pxref{Invoking guix-daemon}):
10448
10449 @example
10450 (define guix-service-type
10451 (service-type
10452 (name 'guix)
10453 (extensions
10454 (list (service-extension shepherd-root-service-type guix-shepherd-service)
10455 (service-extension account-service-type guix-accounts)
10456 (service-extension activation-service-type guix-activation)))))
10457 @end example
10458
10459 @noindent
10460 It defines two things:
10461
10462 @enumerate
10463 @item
10464 A name, whose sole purpose is to make inspection and debugging easier.
10465
10466 @item
10467 A list of @dfn{service extensions}, where each extension designates the
10468 target service type and a procedure that, given the parameters of the
10469 service, returns a list of objects to extend the service of that type.
10470
10471 Every service type has at least one service extension. The only
10472 exception is the @dfn{boot service type}, which is the ultimate service.
10473 @end enumerate
10474
10475 In this example, @var{guix-service-type} extends three services:
10476
10477 @table @var
10478 @item shepherd-root-service-type
10479 The @var{guix-shepherd-service} procedure defines how the Shepherd
10480 service is extended. Namely, it returns a @code{<shepherd-service>}
10481 object that defines how @command{guix-daemon} is started and stopped
10482 (@pxref{Shepherd Services}).
10483
10484 @item account-service-type
10485 This extension for this service is computed by @var{guix-accounts},
10486 which returns a list of @code{user-group} and @code{user-account}
10487 objects representing the build user accounts (@pxref{Invoking
10488 guix-daemon}).
10489
10490 @item activation-service-type
10491 Here @var{guix-activation} is a procedure that returns a gexp, which is
10492 a code snippet to run at ``activation time''---e.g., when the service is
10493 booted.
10494 @end table
10495
10496 A service of this type is instantiated like this:
10497
10498 @example
10499 (service guix-service-type
10500 (guix-configuration
10501 (build-accounts 5)
10502 (use-substitutes? #f)))
10503 @end example
10504
10505 The second argument to the @code{service} form is a value representing
10506 the parameters of this specific service instance.
10507 @xref{guix-configuration-type, @code{guix-configuration}}, for
10508 information about the @code{guix-configuration} data type.
10509
10510 @var{guix-service-type} is quite simple because it extends other
10511 services but is not extensible itself.
10512
10513 @c @subsubsubsection Extensible Service Types
10514
10515 The service type for an @emph{extensible} service looks like this:
10516
10517 @example
10518 (define udev-service-type
10519 (service-type (name 'udev)
10520 (extensions
10521 (list (service-extension shepherd-root-service-type
10522 udev-shepherd-service)))
10523
10524 (compose concatenate) ;concatenate the list of rules
10525 (extend (lambda (config rules)
10526 (match config
10527 (($ <udev-configuration> udev initial-rules)
10528 (udev-configuration
10529 (udev udev) ;the udev package to use
10530 (rules (append initial-rules rules)))))))))
10531 @end example
10532
10533 This is the service type for the
10534 @uref{https://wiki.gentoo.org/wiki/Project:Eudev, eudev device
10535 management daemon}. Compared to the previous example, in addition to an
10536 extension of @var{shepherd-root-service-type}, we see two new fields:
10537
10538 @table @code
10539 @item compose
10540 This is the procedure to @dfn{compose} the list of extensions to
10541 services of this type.
10542
10543 Services can extend the udev service by passing it lists of rules; we
10544 compose those extensions simply by concatenating them.
10545
10546 @item extend
10547 This procedure defines how the value of the service is @dfn{extended} with
10548 the composition of the extensions.
10549
10550 Udev extensions are composed into a list of rules, but the udev service
10551 value is itself a @code{<udev-configuration>} record. So here, we
10552 extend that record by appending the list of rules it contains to the
10553 list of contributed rules.
10554 @end table
10555
10556 There can be only one instance of an extensible service type such as
10557 @var{udev-service-type}. If there were more, the
10558 @code{service-extension} specifications would be ambiguous.
10559
10560 Still here? The next section provides a reference of the programming
10561 interface for services.
10562
10563 @node Service Reference
10564 @subsubsection Service Reference
10565
10566 We have seen an overview of service types (@pxref{Service Types and
10567 Services}). This section provides a reference on how to manipulate
10568 services and service types. This interface is provided by the
10569 @code{(gnu services)} module.
10570
10571 @deffn {Scheme Procedure} service @var{type} @var{value}
10572 Return a new service of @var{type}, a @code{<service-type>} object (see
10573 below.) @var{value} can be any object; it represents the parameters of
10574 this particular service instance.
10575 @end deffn
10576
10577 @deffn {Scheme Procedure} service? @var{obj}
10578 Return true if @var{obj} is a service.
10579 @end deffn
10580
10581 @deffn {Scheme Procedure} service-kind @var{service}
10582 Return the type of @var{service}---i.e., a @code{<service-type>} object.
10583 @end deffn
10584
10585 @deffn {Scheme Procedure} service-parameters @var{service}
10586 Return the value associated with @var{service}. It represents its
10587 parameters.
10588 @end deffn
10589
10590 Here is an example of how a service is created and manipulated:
10591
10592 @example
10593 (define s
10594 (service nginx-service-type
10595 (nginx-configuration
10596 (nginx nginx)
10597 (log-directory log-directory)
10598 (run-directory run-directory)
10599 (file config-file))))
10600
10601 (service? s)
10602 @result{} #t
10603
10604 (eq? (service-kind s) nginx-service-type)
10605 @result{} #t
10606 @end example
10607
10608 The @code{modify-services} form provides a handy way to change the
10609 parameters of some of the services of a list such as
10610 @var{%base-services} (@pxref{Base Services, @code{%base-services}}). It
10611 evalutes to a list of services. Of course, you could always use
10612 standard list combinators such as @code{map} and @code{fold} to do that
10613 (@pxref{SRFI-1, List Library,, guile, GNU Guile Reference Manual});
10614 @code{modify-services} simply provides a more concise form for this
10615 common pattern.
10616
10617 @deffn {Scheme Syntax} modify-services @var{services} @
10618 (@var{type} @var{variable} => @var{body}) @dots{}
10619
10620 Modify the services listed in @var{services} according to the given
10621 clauses. Each clause has the form:
10622
10623 @example
10624 (@var{type} @var{variable} => @var{body})
10625 @end example
10626
10627 where @var{type} is a service type---e.g.,
10628 @code{guix-service-type}---and @var{variable} is an identifier that is
10629 bound within the @var{body} to the service parameters---e.g., a
10630 @code{guix-configuration} instance---of the original service of that
10631 @var{type}.
10632
10633 The @var{body} should evaluate to the new service parameters, which will
10634 be used to configure the new service. This new service will replace the
10635 original in the resulting list. Because a service's service parameters
10636 are created using @code{define-record-type*}, you can write a succint
10637 @var{body} that evaluates to the new service parameters by using the
10638 @code{inherit} feature that @code{define-record-type*} provides.
10639
10640 @xref{Using the Configuration System}, for example usage.
10641
10642 @end deffn
10643
10644 Next comes the programming interface for service types. This is
10645 something you want to know when writing new service definitions, but not
10646 necessarily when simply looking for ways to customize your
10647 @code{operating-system} declaration.
10648
10649 @deftp {Data Type} service-type
10650 @cindex service type
10651 This is the representation of a @dfn{service type} (@pxref{Service Types
10652 and Services}).
10653
10654 @table @asis
10655 @item @code{name}
10656 This is a symbol, used only to simplify inspection and debugging.
10657
10658 @item @code{extensions}
10659 A non-empty list of @code{<service-extension>} objects (see below).
10660
10661 @item @code{compose} (default: @code{#f})
10662 If this is @code{#f}, then the service type denotes services that cannot
10663 be extended---i.e., services that do not receive ``values'' from other
10664 services.
10665
10666 Otherwise, it must be a one-argument procedure. The procedure is called
10667 by @code{fold-services} and is passed a list of values collected from
10668 extensions. It must return a value that is a valid parameter value for
10669 the service instance.
10670
10671 @item @code{extend} (default: @code{#f})
10672 If this is @code{#f}, services of this type cannot be extended.
10673
10674 Otherwise, it must be a two-argument procedure: @code{fold-services}
10675 calls it, passing it the initial value of the service as the first argument
10676 and the result of applying @code{compose} to the extension values as the
10677 second argument.
10678 @end table
10679
10680 @xref{Service Types and Services}, for examples.
10681 @end deftp
10682
10683 @deffn {Scheme Procedure} service-extension @var{target-type} @
10684 @var{compute}
10685 Return a new extension for services of type @var{target-type}.
10686 @var{compute} must be a one-argument procedure: @code{fold-services}
10687 calls it, passing it the value associated with the service that provides
10688 the extension; it must return a valid value for the target service.
10689 @end deffn
10690
10691 @deffn {Scheme Procedure} service-extension? @var{obj}
10692 Return true if @var{obj} is a service extension.
10693 @end deffn
10694
10695 At the core of the service abstraction lies the @code{fold-services}
10696 procedure, which is responsible for ``compiling'' a list of services
10697 down to a single directory that contains everything needed to boot and
10698 run the system---the directory shown by the @command{guix system build}
10699 command (@pxref{Invoking guix system}). In essence, it propagates
10700 service extensions down the service graph, updating each node parameters
10701 on the way, until it reaches the root node.
10702
10703 @deffn {Scheme Procedure} fold-services @var{services} @
10704 [#:target-type @var{system-service-type}]
10705 Fold @var{services} by propagating their extensions down to the root of
10706 type @var{target-type}; return the root service adjusted accordingly.
10707 @end deffn
10708
10709 Lastly, the @code{(gnu services)} module also defines several essential
10710 service types, some of which are listed below.
10711
10712 @defvr {Scheme Variable} system-service-type
10713 This is the root of the service graph. It produces the system directory
10714 as returned by the @command{guix system build} command.
10715 @end defvr
10716
10717 @defvr {Scheme Variable} boot-service-type
10718 The type of the ``boot service'', which produces the @dfn{boot script}.
10719 The boot script is what the initial RAM disk runs when booting.
10720 @end defvr
10721
10722 @defvr {Scheme Variable} etc-service-type
10723 The type of the @file{/etc} service. This service can be extended by
10724 passing it name/file tuples such as:
10725
10726 @example
10727 (list `("issue" ,(plain-file "issue" "Welcome!\n")))
10728 @end example
10729
10730 In this example, the effect would be to add an @file{/etc/issue} file
10731 pointing to the given file.
10732 @end defvr
10733
10734 @defvr {Scheme Variable} setuid-program-service-type
10735 Type for the ``setuid-program service''. This service collects lists of
10736 executable file names, passed as gexps, and adds them to the set of
10737 setuid-root programs on the system (@pxref{Setuid Programs}).
10738 @end defvr
10739
10740 @defvr {Scheme Variable} profile-service-type
10741 Type of the service that populates the @dfn{system profile}---i.e., the
10742 programs under @file{/run/current-system/profile}. Other services can
10743 extend it by passing it lists of packages to add to the system profile.
10744 @end defvr
10745
10746
10747 @node Shepherd Services
10748 @subsubsection Shepherd Services
10749
10750 @cindex PID 1
10751 @cindex init system
10752 The @code{(gnu services shepherd)} module provides a way to define
10753 services managed by the GNU@tie{}Shepherd, which is the GuixSD
10754 initialization system---the first process that is started when the
10755 system boots, also known as PID@tie{}1
10756 (@pxref{Introduction,,, shepherd, The GNU Shepherd Manual}).
10757
10758 Services in the Shepherd can depend on each other. For instance, the
10759 SSH daemon may need to be started after the syslog daemon has been
10760 started, which in turn can only happen once all the file systems have
10761 been mounted. The simple operating system defined earlier (@pxref{Using
10762 the Configuration System}) results in a service graph like this:
10763
10764 @image{images/shepherd-graph,,5in,Typical shepherd service graph.}
10765
10766 You can actually generate such a graph for any operating system
10767 definition using the @command{guix system shepherd-graph} command
10768 (@pxref{system-shepherd-graph, @command{guix system shepherd-graph}}).
10769
10770 The @var{%shepherd-root-service} is a service object representing
10771 PID@tie{}1, of type @var{shepherd-root-service-type}; it can be extended
10772 by passing it lists of @code{<shepherd-service>} objects.
10773
10774 @deftp {Data Type} shepherd-service
10775 The data type representing a service managed by the Shepherd.
10776
10777 @table @asis
10778 @item @code{provision}
10779 This is a list of symbols denoting what the service provides.
10780
10781 These are the names that may be passed to @command{herd start},
10782 @command{herd status}, and similar commands (@pxref{Invoking herd,,,
10783 shepherd, The GNU Shepherd Manual}). @xref{Slots of services, the
10784 @code{provides} slot,, shepherd, The GNU Shepherd Manual}, for details.
10785
10786 @item @code{requirements} (default: @code{'()})
10787 List of symbols denoting the Shepherd services this one depends on.
10788
10789 @item @code{respawn?} (default: @code{#t})
10790 Whether to restart the service when it stops, for instance when the
10791 underlying process dies.
10792
10793 @item @code{start}
10794 @itemx @code{stop} (default: @code{#~(const #f)})
10795 The @code{start} and @code{stop} fields refer to the Shepherd's
10796 facilities to start and stop processes (@pxref{Service De- and
10797 Constructors,,, shepherd, The GNU Shepherd Manual}). They are given as
10798 G-expressions that get expanded in the Shepherd configuration file
10799 (@pxref{G-Expressions}).
10800
10801 @item @code{documentation}
10802 A documentation string, as shown when running:
10803
10804 @example
10805 herd doc @var{service-name}
10806 @end example
10807
10808 where @var{service-name} is one of the symbols in @var{provision}
10809 (@pxref{Invoking herd,,, shepherd, The GNU Shepherd Manual}).
10810
10811 @item @code{modules} (default: @var{%default-modules})
10812 This is the list of modules that must be in scope when @code{start} and
10813 @code{stop} are evaluated.
10814
10815 @item @code{imported-modules} (default: @var{%default-imported-modules})
10816 This is the list of modules to import in the execution environment of
10817 the Shepherd.
10818
10819 @end table
10820 @end deftp
10821
10822 @defvr {Scheme Variable} shepherd-root-service-type
10823 The service type for the Shepherd ``root service''---i.e., PID@tie{}1.
10824
10825 This is the service type that extensions target when they want to create
10826 shepherd services (@pxref{Service Types and Services}, for an example).
10827 Each extension must pass a list of @code{<shepherd-service>}.
10828 @end defvr
10829
10830 @defvr {Scheme Variable} %shepherd-root-service
10831 This service represents PID@tie{}1.
10832 @end defvr
10833
10834
10835 @node Installing Debugging Files
10836 @section Installing Debugging Files
10837
10838 @cindex debugging files
10839 Program binaries, as produced by the GCC compilers for instance, are
10840 typically written in the ELF format, with a section containing
10841 @dfn{debugging information}. Debugging information is what allows the
10842 debugger, GDB, to map binary code to source code; it is required to
10843 debug a compiled program in good conditions.
10844
10845 The problem with debugging information is that is takes up a fair amount
10846 of disk space. For example, debugging information for the GNU C Library
10847 weighs in at more than 60 MiB. Thus, as a user, keeping all the
10848 debugging info of all the installed programs is usually not an option.
10849 Yet, space savings should not come at the cost of an impediment to
10850 debugging---especially in the GNU system, which should make it easier
10851 for users to exert their computing freedom (@pxref{GNU Distribution}).
10852
10853 Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
10854 mechanism that allows users to get the best of both worlds: debugging
10855 information can be stripped from the binaries and stored in separate
10856 files. GDB is then able to load debugging information from those files,
10857 when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
10858 with GDB}).
10859
10860 The GNU distribution takes advantage of this by storing debugging
10861 information in the @code{lib/debug} sub-directory of a separate package
10862 output unimaginatively called @code{debug} (@pxref{Packages with
10863 Multiple Outputs}). Users can choose to install the @code{debug} output
10864 of a package when they need it. For instance, the following command
10865 installs the debugging information for the GNU C Library and for GNU
10866 Guile:
10867
10868 @example
10869 guix package -i glibc:debug guile:debug
10870 @end example
10871
10872 GDB must then be told to look for debug files in the user's profile, by
10873 setting the @code{debug-file-directory} variable (consider setting it
10874 from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
10875 GDB}):
10876
10877 @example
10878 (gdb) set debug-file-directory ~/.guix-profile/lib/debug
10879 @end example
10880
10881 From there on, GDB will pick up debugging information from the
10882 @code{.debug} files under @file{~/.guix-profile/lib/debug}.
10883
10884 In addition, you will most likely want GDB to be able to show the source
10885 code being debugged. To do that, you will have to unpack the source
10886 code of the package of interest (obtained with @code{guix build
10887 --source}, @pxref{Invoking guix build}), and to point GDB to that source
10888 directory using the @code{directory} command (@pxref{Source Path,
10889 @code{directory},, gdb, Debugging with GDB}).
10890
10891 @c XXX: keep me up-to-date
10892 The @code{debug} output mechanism in Guix is implemented by the
10893 @code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
10894 opt-in---debugging information is available only for the packages
10895 with definitions explicitly declaring a @code{debug} output. This may be
10896 changed to opt-out in the future if our build farm servers can handle
10897 the load. To check whether a package has a @code{debug} output, use
10898 @command{guix package --list-available} (@pxref{Invoking guix package}).
10899
10900
10901 @node Security Updates
10902 @section Security Updates
10903
10904 @cindex security updates
10905 @cindex security vulnerabilities
10906 Occasionally, important security vulnerabilities are discovered in software
10907 packages and must be patched. Guix developers try hard to keep track of
10908 known vulnerabilities and to apply fixes as soon as possible in the
10909 @code{master} branch of Guix (we do not yet provide a ``stable'' branch
10910 containing only security updates.) The @command{guix lint} tool helps
10911 developers find out about vulnerable versions of software packages in the
10912 distribution:
10913
10914 @smallexample
10915 $ guix lint -c cve
10916 gnu/packages/base.scm:652:2: glibc-2.21: probably vulnerable to CVE-2015-1781, CVE-2015-7547
10917 gnu/packages/gcc.scm:334:2: gcc-4.9.3: probably vulnerable to CVE-2015-5276
10918 gnu/packages/image.scm:312:2: openjpeg-2.1.0: probably vulnerable to CVE-2016-1923, CVE-2016-1924
10919 @dots{}
10920 @end smallexample
10921
10922 @xref{Invoking guix lint}, for more information.
10923
10924 @quotation Note
10925 As of version @value{VERSION}, the feature described below is considered
10926 ``beta''.
10927 @end quotation
10928
10929 Guix follows a functional
10930 package management discipline (@pxref{Introduction}), which implies
10931 that, when a package is changed, @emph{every package that depends on it}
10932 must be rebuilt. This can significantly slow down the deployment of
10933 fixes in core packages such as libc or Bash, since basically the whole
10934 distribution would need to be rebuilt. Using pre-built binaries helps
10935 (@pxref{Substitutes}), but deployment may still take more time than
10936 desired.
10937
10938 @cindex grafts
10939 To address this, Guix implements @dfn{grafts}, a mechanism that allows
10940 for fast deployment of critical updates without the costs associated
10941 with a whole-distribution rebuild. The idea is to rebuild only the
10942 package that needs to be patched, and then to ``graft'' it onto packages
10943 explicitly installed by the user and that were previously referring to
10944 the original package. The cost of grafting is typically very low, and
10945 order of magnitudes lower than a full rebuild of the dependency chain.
10946
10947 @cindex replacements of packages, for grafts
10948 For instance, suppose a security update needs to be applied to Bash.
10949 Guix developers will provide a package definition for the ``fixed''
10950 Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
10951 Packages}). Then, the original package definition is augmented with a
10952 @code{replacement} field pointing to the package containing the bug fix:
10953
10954 @example
10955 (define bash
10956 (package
10957 (name "bash")
10958 ;; @dots{}
10959 (replacement bash-fixed)))
10960 @end example
10961
10962 From there on, any package depending directly or indirectly on Bash---as
10963 reported by @command{guix gc --requisites} (@pxref{Invoking guix
10964 gc})---that is installed is automatically ``rewritten'' to refer to
10965 @var{bash-fixed} instead of @var{bash}. This grafting process takes
10966 time proportional to the size of the package, usually less than a
10967 minute for an ``average'' package on a recent machine. Grafting is
10968 recursive: when an indirect dependency requires grafting, then grafting
10969 ``propagates'' up to the package that the user is installing.
10970
10971 Currently, the graft and the package it replaces (@var{bash-fixed} and
10972 @var{bash} in the example above) must have the exact same @code{name}
10973 and @code{version} fields. This restriction mostly comes from the fact
10974 that grafting works by patching files, including binary files, directly.
10975 Other restrictions may apply: for instance, when adding a graft to a
10976 package providing a shared library, the original shared library and its
10977 replacement must have the same @code{SONAME} and be binary-compatible.
10978
10979 The @option{--no-grafts} command-line option allows you to forcefully
10980 avoid grafting (@pxref{Common Build Options, @option{--no-grafts}}).
10981 Thus, the command:
10982
10983 @example
10984 guix build bash --no-grafts
10985 @end example
10986
10987 @noindent
10988 returns the store file name of the original Bash, whereas:
10989
10990 @example
10991 guix build bash
10992 @end example
10993
10994 @noindent
10995 returns the store file name of the ``fixed'', replacement Bash. This
10996 allows you to distinguish between the two variants of Bash.
10997
10998 To verify which Bash your whole profile refers to, you can run
10999 (@pxref{Invoking guix gc}):
11000
11001 @example
11002 guix gc -R `readlink -f ~/.guix-profile` | grep bash
11003 @end example
11004
11005 @noindent
11006 @dots{} and compare the store file names that you get with those above.
11007 Likewise for a complete GuixSD system generation:
11008
11009 @example
11010 guix gc -R `guix system build my-config.scm` | grep bash
11011 @end example
11012
11013 Lastly, to check which Bash running processes are using, you can use the
11014 @command{lsof} command:
11015
11016 @example
11017 lsof | grep /gnu/store/.*bash
11018 @end example
11019
11020
11021 @node Package Modules
11022 @section Package Modules
11023
11024 From a programming viewpoint, the package definitions of the
11025 GNU distribution are provided by Guile modules in the @code{(gnu packages
11026 @dots{})} name space@footnote{Note that packages under the @code{(gnu
11027 packages @dots{})} module name space are not necessarily ``GNU
11028 packages''. This module naming scheme follows the usual Guile module
11029 naming convention: @code{gnu} means that these modules are distributed
11030 as part of the GNU system, and @code{packages} identifies modules that
11031 define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
11032 Reference Manual}). For instance, the @code{(gnu packages emacs)}
11033 module exports a variable named @code{emacs}, which is bound to a
11034 @code{<package>} object (@pxref{Defining Packages}).
11035
11036 The @code{(gnu packages @dots{})} module name space is
11037 automatically scanned for packages by the command-line tools. For
11038 instance, when running @code{guix package -i emacs}, all the @code{(gnu
11039 packages @dots{})} modules are scanned until one that exports a package
11040 object whose name is @code{emacs} is found. This package search
11041 facility is implemented in the @code{(gnu packages)} module.
11042
11043 @cindex customization, of packages
11044 @cindex package module search path
11045 Users can store package definitions in modules with different
11046 names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
11047 name and module name must match. For instance, the @code{(my-packages
11048 emacs)} module must be stored in a @file{my-packages/emacs.scm} file
11049 relative to the load path specified with @option{--load-path} or
11050 @code{GUIX_PACKAGE_PATH}. @xref{Modules and the File System,,,
11051 guile, GNU Guile Reference Manual}, for details.}. These package definitions
11052 will not be visible by default. Users can invoke commands such as
11053 @command{guix package} and @command{guix build} with the
11054 @code{-e} option so that they know where to find the package. Better
11055 yet, they can use the
11056 @code{-L} option of these commands to make those modules visible
11057 (@pxref{Invoking guix build, @code{--load-path}}), or define the
11058 @code{GUIX_PACKAGE_PATH} environment variable. This environment
11059 variable makes it easy to extend or customize the distribution and is
11060 honored by all the user interfaces.
11061
11062 @defvr {Environment Variable} GUIX_PACKAGE_PATH
11063 This is a colon-separated list of directories to search for additional
11064 package modules. Directories listed in this variable take precedence
11065 over the own modules of the distribution.
11066 @end defvr
11067
11068 The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
11069 each package is built based solely on other packages in the
11070 distribution. The root of this dependency graph is a small set of
11071 @dfn{bootstrap binaries}, provided by the @code{(gnu packages
11072 bootstrap)} module. For more information on bootstrapping,
11073 @pxref{Bootstrapping}.
11074
11075 @node Packaging Guidelines
11076 @section Packaging Guidelines
11077
11078 The GNU distribution is nascent and may well lack some of your favorite
11079 packages. This section describes how you can help make the distribution
11080 grow. @xref{Contributing}, for additional information on how you can
11081 help.
11082
11083 Free software packages are usually distributed in the form of
11084 @dfn{source code tarballs}---typically @file{tar.gz} files that contain
11085 all the source files. Adding a package to the distribution means
11086 essentially two things: adding a @dfn{recipe} that describes how to
11087 build the package, including a list of other packages required to build
11088 it, and adding @dfn{package metadata} along with that recipe, such as a
11089 description and licensing information.
11090
11091 In Guix all this information is embodied in @dfn{package definitions}.
11092 Package definitions provide a high-level view of the package. They are
11093 written using the syntax of the Scheme programming language; in fact,
11094 for each package we define a variable bound to the package definition,
11095 and export that variable from a module (@pxref{Package Modules}).
11096 However, in-depth Scheme knowledge is @emph{not} a prerequisite for
11097 creating packages. For more information on package definitions,
11098 @pxref{Defining Packages}.
11099
11100 Once a package definition is in place, stored in a file in the Guix
11101 source tree, it can be tested using the @command{guix build} command
11102 (@pxref{Invoking guix build}). For example, assuming the new package is
11103 called @code{gnew}, you may run this command from the Guix build tree
11104 (@pxref{Running Guix Before It Is Installed}):
11105
11106 @example
11107 ./pre-inst-env guix build gnew --keep-failed
11108 @end example
11109
11110 Using @code{--keep-failed} makes it easier to debug build failures since
11111 it provides access to the failed build tree. Another useful
11112 command-line option when debugging is @code{--log-file}, to access the
11113 build log.
11114
11115 If the package is unknown to the @command{guix} command, it may be that
11116 the source file contains a syntax error, or lacks a @code{define-public}
11117 clause to export the package variable. To figure it out, you may load
11118 the module from Guile to get more information about the actual error:
11119
11120 @example
11121 ./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
11122 @end example
11123
11124 Once your package builds correctly, please send us a patch
11125 (@pxref{Contributing}). Well, if you need help, we will be happy to
11126 help you too. Once the patch is committed in the Guix repository, the
11127 new package automatically gets built on the supported platforms by
11128 @url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
11129 system}.
11130
11131 @cindex substituter
11132 Users can obtain the new package definition simply by running
11133 @command{guix pull} (@pxref{Invoking guix pull}). When
11134 @code{hydra.gnu.org} is done building the package, installing the
11135 package automatically downloads binaries from there
11136 (@pxref{Substitutes}). The only place where human intervention is
11137 needed is to review and apply the patch.
11138
11139
11140 @menu
11141 * Software Freedom:: What may go into the distribution.
11142 * Package Naming:: What's in a name?
11143 * Version Numbers:: When the name is not enough.
11144 * Synopses and Descriptions:: Helping users find the right package.
11145 * Python Modules:: Taming the snake.
11146 * Perl Modules:: Little pearls.
11147 * Java Packages:: Coffee break.
11148 * Fonts:: Fond of fonts.
11149 @end menu
11150
11151 @node Software Freedom
11152 @subsection Software Freedom
11153
11154 @c Adapted from http://www.gnu.org/philosophy/philosophy.html.
11155
11156 The GNU operating system has been developed so that users can have
11157 freedom in their computing. GNU is @dfn{free software}, meaning that
11158 users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
11159 essential freedoms}: to run the program, to study and change the program
11160 in source code form, to redistribute exact copies, and to distribute
11161 modified versions. Packages found in the GNU distribution provide only
11162 software that conveys these four freedoms.
11163
11164 In addition, the GNU distribution follow the
11165 @url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
11166 software distribution guidelines}. Among other things, these guidelines
11167 reject non-free firmware, recommendations of non-free software, and
11168 discuss ways to deal with trademarks and patents.
11169
11170 Some otherwise free upstream package sources contain a small and optional
11171 subset that violates the above guidelines, for instance because this subset
11172 is itself non-free code. When that happens, the offending items are removed
11173 with appropriate patches or code snippets in the @code{origin} form of the
11174 package (@pxref{Defining Packages}). This way, @code{guix
11175 build --source} returns the ``freed'' source rather than the unmodified
11176 upstream source.
11177
11178
11179 @node Package Naming
11180 @subsection Package Naming
11181
11182 A package has actually two names associated with it:
11183 First, there is the name of the @emph{Scheme variable}, the one following
11184 @code{define-public}. By this name, the package can be made known in the
11185 Scheme code, for instance as input to another package. Second, there is
11186 the string in the @code{name} field of a package definition. This name
11187 is used by package management commands such as
11188 @command{guix package} and @command{guix build}.
11189
11190 Both are usually the same and correspond to the lowercase conversion of
11191 the project name chosen upstream, with underscores replaced with
11192 hyphens. For instance, GNUnet is available as @code{gnunet}, and
11193 SDL_net as @code{sdl-net}.
11194
11195 We do not add @code{lib} prefixes for library packages, unless these are
11196 already part of the official project name. But @pxref{Python
11197 Modules} and @ref{Perl Modules} for special rules concerning modules for
11198 the Python and Perl languages.
11199
11200 Font package names are handled differently, @pxref{Fonts}.
11201
11202
11203 @node Version Numbers
11204 @subsection Version Numbers
11205
11206 We usually package only the latest version of a given free software
11207 project. But sometimes, for instance for incompatible library versions,
11208 two (or more) versions of the same package are needed. These require
11209 different Scheme variable names. We use the name as defined
11210 in @ref{Package Naming}
11211 for the most recent version; previous versions use the same name, suffixed
11212 by @code{-} and the smallest prefix of the version number that may
11213 distinguish the two versions.
11214
11215 The name inside the package definition is the same for all versions of a
11216 package and does not contain any version number.
11217
11218 For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
11219
11220 @example
11221 (define-public gtk+
11222 (package
11223 (name "gtk+")
11224 (version "3.9.12")
11225 ...))
11226 (define-public gtk+-2
11227 (package
11228 (name "gtk+")
11229 (version "2.24.20")
11230 ...))
11231 @end example
11232 If we also wanted GTK+ 3.8.2, this would be packaged as
11233 @example
11234 (define-public gtk+-3.8
11235 (package
11236 (name "gtk+")
11237 (version "3.8.2")
11238 ...))
11239 @end example
11240
11241 @c See <https://lists.gnu.org/archive/html/guix-devel/2016-01/msg00425.html>,
11242 @c for a discussion of what follows.
11243 @cindex version number, for VCS snapshots
11244 Occasionally, we package snapshots of upstream's version control system
11245 (VCS) instead of formal releases. This should remain exceptional,
11246 because it is up to upstream developers to clarify what the stable
11247 release is. Yet, it is sometimes necessary. So, what should we put in
11248 the @code{version} field?
11249
11250 Clearly, we need to make the commit identifier of the VCS snapshot
11251 visible in the version string, but we also need to make sure that the
11252 version string is monotonically increasing so that @command{guix package
11253 --upgrade} can determine which version is newer. Since commit
11254 identifiers, notably with Git, are not monotonically increasing, we add
11255 a revision number that we increase each time we upgrade to a newer
11256 snapshot. The resulting version string looks like this:
11257
11258 @example
11259 2.0.11-3.cabba9e
11260 ^ ^ ^
11261 | | `-- upstream commit ID
11262 | |
11263 | `--- Guix package revision
11264 |
11265 latest upstream version
11266 @end example
11267
11268 It is a good idea to strip commit identifiers in the @code{version}
11269 field to, say, 7 digits. It avoids an aesthetic annoyance (assuming
11270 aesthetics have a role to play here) as well as problems related to OS
11271 limits such as the maximum shebang length (127 bytes for the Linux
11272 kernel.) It is best to use the full commit identifiers in
11273 @code{origin}s, though, to avoid ambiguities. A typical package
11274 definition may look like this:
11275
11276 @example
11277 (define my-package
11278 (let ((commit "c3f29bc928d5900971f65965feaae59e1272a3f7"))
11279 (package
11280 (version (string-append "0.9-1."
11281 (string-take commit 7)))
11282 (source (origin
11283 (method git-fetch)
11284 (uri (git-reference
11285 (url "git://example.org/my-package.git")
11286 (commit commit)))
11287 (sha256 (base32 "1mbikn@dots{}"))
11288 (file-name (string-append "my-package-" version
11289 "-checkout"))))
11290 ;; @dots{}
11291 )))
11292 @end example
11293
11294 @node Synopses and Descriptions
11295 @subsection Synopses and Descriptions
11296
11297 As we have seen before, each package in GNU@tie{}Guix includes a
11298 synopsis and a description (@pxref{Defining Packages}). Synopses and
11299 descriptions are important: They are what @command{guix package
11300 --search} searches, and a crucial piece of information to help users
11301 determine whether a given package suits their needs. Consequently,
11302 packagers should pay attention to what goes into them.
11303
11304 Synopses must start with a capital letter and must not end with a
11305 period. They must not start with ``a'' or ``the'', which usually does
11306 not bring anything; for instance, prefer ``File-frobbing tool'' over ``A
11307 tool that frobs files''. The synopsis should say what the package
11308 is---e.g., ``Core GNU utilities (file, text, shell)''---or what it is
11309 used for---e.g., the synopsis for GNU@tie{}grep is ``Print lines
11310 matching a pattern''.
11311
11312 Keep in mind that the synopsis must be meaningful for a very wide
11313 audience. For example, ``Manipulate alignments in the SAM format''
11314 might make sense for a seasoned bioinformatics researcher, but might be
11315 fairly unhelpful or even misleading to a non-specialized audience. It
11316 is a good idea to come up with a synopsis that gives an idea of the
11317 application domain of the package. In this example, this might give
11318 something like ``Manipulate nucleotide sequence alignments'', which
11319 hopefully gives the user a better idea of whether this is what they are
11320 looking for.
11321
11322 Descriptions should take between five and ten lines. Use full
11323 sentences, and avoid using acronyms without first introducing them.
11324 Please avoid marketing phrases such as ``world-leading'',
11325 ``industrial-strength'', and ``next-generation'', and avoid superlatives
11326 like ``the most advanced''---they are not helpful to users looking for a
11327 package and may even sound suspicious. Instead, try to be factual,
11328 mentioning use cases and features.
11329
11330 @cindex Texinfo markup, in package descriptions
11331 Descriptions can include Texinfo markup, which is useful to introduce
11332 ornaments such as @code{@@code} or @code{@@dfn}, bullet lists, or
11333 hyperlinks (@pxref{Overview,,, texinfo, GNU Texinfo}). However you
11334 should be careful when using some characters for example @samp{@@} and
11335 curly braces which are the basic special characters in Texinfo
11336 (@pxref{Special Characters,,, texinfo, GNU Texinfo}). User interfaces
11337 such as @command{guix package --show} take care of rendering it
11338 appropriately.
11339
11340 Synopses and descriptions are translated by volunteers
11341 @uref{http://translationproject.org/domain/guix-packages.html, at the
11342 Translation Project} so that as many users as possible can read them in
11343 their native language. User interfaces search them and display them in
11344 the language specified by the current locale.
11345
11346 Translation is a lot of work so, as a packager, please pay even more
11347 attention to your synopses and descriptions as every change may entail
11348 additional work for translators. In order to help them, it is possible
11349 to make recommendations or instructions visible to them by inserting
11350 special comments like this (@pxref{xgettext Invocation,,, gettext, GNU
11351 Gettext}):
11352
11353 @example
11354 ;; TRANSLATORS: "X11 resize-and-rotate" should not be translated.
11355 (description "ARandR is designed to provide a simple visual front end
11356 for the X11 resize-and-rotate (RandR) extension. @dots{}")
11357 @end example
11358
11359
11360 @node Python Modules
11361 @subsection Python Modules
11362
11363 We currently package Python 2 and Python 3, under the Scheme variable names
11364 @code{python-2} and @code{python} as explained in @ref{Version Numbers}.
11365 To avoid confusion and naming clashes with other programming languages, it
11366 seems desirable that the name of a package for a Python module contains
11367 the word @code{python}.
11368
11369 Some modules are compatible with only one version of Python, others with both.
11370 If the package Foo compiles only with Python 3, we name it
11371 @code{python-foo}; if it compiles only with Python 2, we name it
11372 @code{python2-foo}. If it is compatible with both versions, we create two
11373 packages with the corresponding names.
11374
11375 If a project already contains the word @code{python}, we drop this;
11376 for instance, the module python-dateutil is packaged under the names
11377 @code{python-dateutil} and @code{python2-dateutil}. If the project name
11378 starts with @code{py} (e.g. @code{pytz}), we keep it and prefix it as
11379 described above.
11380
11381
11382 @node Perl Modules
11383 @subsection Perl Modules
11384
11385 Perl programs standing for themselves are named as any other package,
11386 using the lowercase upstream name.
11387 For Perl packages containing a single class, we use the lowercase class name,
11388 replace all occurrences of @code{::} by dashes and prepend the prefix
11389 @code{perl-}.
11390 So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
11391 Modules containing several classes keep their lowercase upstream name and
11392 are also prepended by @code{perl-}. Such modules tend to have the word
11393 @code{perl} somewhere in their name, which gets dropped in favor of the
11394 prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
11395
11396
11397 @node Java Packages
11398 @subsection Java Packages
11399
11400 Java programs standing for themselves are named as any other package,
11401 using the lowercase upstream name.
11402
11403 To avoid confusion and naming clashes with other programming languages,
11404 it is desirable that the name of a package for a Java package is
11405 prefixed with @code{java-}. If a project already contains the word
11406 @code{java}, we drop this; for instance, the package @code{ngsjava} is
11407 packaged under the name @code{java-ngs}.
11408
11409 For Java packages containing a single class or a small class hierarchy,
11410 we use the lowercase class name, replace all occurrences of @code{.} by
11411 dashes and prepend the prefix @code{java-}. So the class
11412 @code{apache.commons.cli} becomes package
11413 @code{java-apache-commons-cli}.
11414
11415
11416 @node Fonts
11417 @subsection Fonts
11418
11419 For fonts that are in general not installed by a user for typesetting
11420 purposes, or that are distributed as part of a larger software package,
11421 we rely on the general packaging rules for software; for instance, this
11422 applies to the fonts delivered as part of the X.Org system or fonts that
11423 are part of TeX Live.
11424
11425 To make it easier for a user to search for fonts, names for other packages
11426 containing only fonts are constructed as follows, independently of the
11427 upstream package name.
11428
11429 The name of a package containing only one font family starts with
11430 @code{font-}; it is followed by the foundry name and a dash @code{-}
11431 if the foundry is known, and the font family name, in which spaces are
11432 replaced by dashes (and as usual, all upper case letters are transformed
11433 to lower case).
11434 For example, the Gentium font family by SIL is packaged under the name
11435 @code{font-sil-gentium}.
11436
11437 For a package containing several font families, the name of the collection
11438 is used in the place of the font family name.
11439 For instance, the Liberation fonts consist of three families,
11440 Liberation Sans, Liberation Serif and Liberation Mono.
11441 These could be packaged separately under the names
11442 @code{font-liberation-sans} and so on; but as they are distributed together
11443 under a common name, we prefer to package them together as
11444 @code{font-liberation}.
11445
11446 In the case where several formats of the same font family or font collection
11447 are packaged separately, a short form of the format, prepended by a dash,
11448 is added to the package name. We use @code{-ttf} for TrueType fonts,
11449 @code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
11450 fonts.
11451
11452
11453
11454 @node Bootstrapping
11455 @section Bootstrapping
11456
11457 @c Adapted from the ELS 2013 paper.
11458
11459 @cindex bootstrapping
11460
11461 Bootstrapping in our context refers to how the distribution gets built
11462 ``from nothing''. Remember that the build environment of a derivation
11463 contains nothing but its declared inputs (@pxref{Introduction}). So
11464 there's an obvious chicken-and-egg problem: how does the first package
11465 get built? How does the first compiler get compiled? Note that this is
11466 a question of interest only to the curious hacker, not to the regular
11467 user, so you can shamelessly skip this section if you consider yourself
11468 a ``regular user''.
11469
11470 @cindex bootstrap binaries
11471 The GNU system is primarily made of C code, with libc at its core. The
11472 GNU build system itself assumes the availability of a Bourne shell and
11473 command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
11474 `grep'. Furthermore, build programs---programs that run
11475 @code{./configure}, @code{make}, etc.---are written in Guile Scheme
11476 (@pxref{Derivations}). Consequently, to be able to build anything at
11477 all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
11478 Binutils, libc, and the other packages mentioned above---the
11479 @dfn{bootstrap binaries}.
11480
11481 These bootstrap binaries are ``taken for granted'', though we can also
11482 re-create them if needed (more on that later).
11483
11484 @unnumberedsubsec Preparing to Use the Bootstrap Binaries
11485
11486 @c As of Emacs 24.3, Info-mode displays the image, but since it's a
11487 @c large image, it's hard to scroll. Oh well.
11488 @image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
11489
11490 The figure above shows the very beginning of the dependency graph of the
11491 distribution, corresponding to the package definitions of the @code{(gnu
11492 packages bootstrap)} module. A similar figure can be generated with
11493 @command{guix graph} (@pxref{Invoking guix graph}), along the lines of:
11494
11495 @example
11496 guix graph -t derivation \
11497 -e '(@@@@ (gnu packages bootstrap) %bootstrap-gcc)' \
11498 | dot -Tps > t.ps
11499 @end example
11500
11501 At this level of detail, things are
11502 slightly complex. First, Guile itself consists of an ELF executable,
11503 along with many source and compiled Scheme files that are dynamically
11504 loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
11505 tarball shown in this graph. This tarball is part of Guix's ``source''
11506 distribution, and gets inserted into the store with @code{add-to-store}
11507 (@pxref{The Store}).
11508
11509 But how do we write a derivation that unpacks this tarball and adds it
11510 to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
11511 derivation---the first one that gets built---uses @code{bash} as its
11512 builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
11513 @code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
11514 @file{xz}, and @file{mkdir} are statically-linked binaries, also part of
11515 the Guix source distribution, whose sole purpose is to allow the Guile
11516 tarball to be unpacked.
11517
11518 Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
11519 Guile that can be used to run subsequent build programs. Its first task
11520 is to download tarballs containing the other pre-built binaries---this
11521 is what the @code{.tar.xz.drv} derivations do. Guix modules such as
11522 @code{ftp-client.scm} are used for this purpose. The
11523 @code{module-import.drv} derivations import those modules in a directory
11524 in the store, using the original layout. The
11525 @code{module-import-compiled.drv} derivations compile those modules, and
11526 write them in an output directory with the right layout. This
11527 corresponds to the @code{#:modules} argument of
11528 @code{build-expression->derivation} (@pxref{Derivations}).
11529
11530 Finally, the various tarballs are unpacked by the
11531 derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
11532 etc., at which point we have a working C tool chain.
11533
11534
11535 @unnumberedsubsec Building the Build Tools
11536
11537 Bootstrapping is complete when we have a full tool chain that does not
11538 depend on the pre-built bootstrap tools discussed above. This
11539 no-dependency requirement is verified by checking whether the files of
11540 the final tool chain contain references to the @file{/gnu/store}
11541 directories of the bootstrap inputs. The process that leads to this
11542 ``final'' tool chain is described by the package definitions found in
11543 the @code{(gnu packages commencement)} module.
11544
11545 The @command{guix graph} command allows us to ``zoom out'' compared to
11546 the graph above, by looking at the level of package objects instead of
11547 individual derivations---remember that a package may translate to
11548 several derivations, typically one derivation to download its source,
11549 one to build the Guile modules it needs, and one to actually build the
11550 package from source. The command:
11551
11552 @example
11553 guix graph -t bag \
11554 -e '(@@@@ (gnu packages commencement)
11555 glibc-final-with-bootstrap-bash)' | dot -Tps > t.ps
11556 @end example
11557
11558 @noindent
11559 produces the dependency graph leading to the ``final'' C
11560 library@footnote{You may notice the @code{glibc-intermediate} label,
11561 suggesting that it is not @emph{quite} final, but as a good
11562 approximation, we will consider it final.}, depicted below.
11563
11564 @image{images/bootstrap-packages,6in,,Dependency graph of the early packages}
11565
11566 @c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
11567 The first tool that gets built with the bootstrap binaries is
11568 GNU@tie{}Make---noted @code{make-boot0} above---which is a prerequisite
11569 for all the following packages. From there Findutils and Diffutils get
11570 built.
11571
11572 Then come the first-stage Binutils and GCC, built as pseudo cross
11573 tools---i.e., with @code{--target} equal to @code{--host}. They are
11574 used to build libc. Thanks to this cross-build trick, this libc is
11575 guaranteed not to hold any reference to the initial tool chain.
11576
11577 From there the final Binutils and GCC (not shown above) are built.
11578 GCC uses @code{ld}
11579 from the final Binutils, and links programs against the just-built libc.
11580 This tool chain is used to build the other packages used by Guix and by
11581 the GNU Build System: Guile, Bash, Coreutils, etc.
11582
11583 And voilà! At this point we have the complete set of build tools that
11584 the GNU Build System expects. These are in the @code{%final-inputs}
11585 variable of the @code{(gnu packages commencement)} module, and are
11586 implicitly used by any package that uses @code{gnu-build-system}
11587 (@pxref{Build Systems, @code{gnu-build-system}}).
11588
11589
11590 @unnumberedsubsec Building the Bootstrap Binaries
11591
11592 Because the final tool chain does not depend on the bootstrap binaries,
11593 those rarely need to be updated. Nevertheless, it is useful to have an
11594 automated way to produce them, should an update occur, and this is what
11595 the @code{(gnu packages make-bootstrap)} module provides.
11596
11597 The following command builds the tarballs containing the bootstrap
11598 binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
11599 of Coreutils and other basic command-line tools):
11600
11601 @example
11602 guix build bootstrap-tarballs
11603 @end example
11604
11605 The generated tarballs are those that should be referred to in the
11606 @code{(gnu packages bootstrap)} module mentioned at the beginning of
11607 this section.
11608
11609 Still here? Then perhaps by now you've started to wonder: when do we
11610 reach a fixed point? That is an interesting question! The answer is
11611 unknown, but if you would like to investigate further (and have
11612 significant computational and storage resources to do so), then let us
11613 know.
11614
11615 @node Porting
11616 @section Porting to a New Platform
11617
11618 As discussed above, the GNU distribution is self-contained, and
11619 self-containment is achieved by relying on pre-built ``bootstrap
11620 binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
11621 operating system kernel, CPU architecture, and application binary
11622 interface (ABI). Thus, to port the distribution to a platform that is
11623 not yet supported, one must build those bootstrap binaries, and update
11624 the @code{(gnu packages bootstrap)} module to use them on that platform.
11625
11626 Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
11627 When everything goes well, and assuming the GNU tool chain supports the
11628 target platform, this can be as simple as running a command like this
11629 one:
11630
11631 @example
11632 guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
11633 @end example
11634
11635 For this to work, the @code{glibc-dynamic-linker} procedure in
11636 @code{(gnu packages bootstrap)} must be augmented to return the right
11637 file name for libc's dynamic linker on that platform; likewise,
11638 @code{system->linux-architecture} in @code{(gnu packages linux)} must be
11639 taught about the new platform.
11640
11641 Once these are built, the @code{(gnu packages bootstrap)} module needs
11642 to be updated to refer to these binaries on the target platform. That
11643 is, the hashes and URLs of the bootstrap tarballs for the new platform
11644 must be added alongside those of the currently supported platforms. The
11645 bootstrap Guile tarball is treated specially: it is expected to be
11646 available locally, and @file{gnu/local.mk} has rules do download it for
11647 the supported architectures; a rule for the new platform must be added
11648 as well.
11649
11650 In practice, there may be some complications. First, it may be that the
11651 extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
11652 above) is not recognized by all the GNU tools. Typically, glibc
11653 recognizes some of these, whereas GCC uses an extra @code{--with-abi}
11654 configure flag (see @code{gcc.scm} for examples of how to handle this).
11655 Second, some of the required packages could fail to build for that
11656 platform. Lastly, the generated binaries could be broken for some
11657 reason.
11658
11659 @c *********************************************************************
11660 @include contributing.texi
11661
11662 @c *********************************************************************
11663 @node Acknowledgments
11664 @chapter Acknowledgments
11665
11666 Guix is based on the @uref{http://nixos.org/nix/, Nix package manager},
11667 which was designed and
11668 implemented by Eelco Dolstra, with contributions from other people (see
11669 the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
11670 management, and promoted unprecedented features, such as transactional
11671 package upgrades and rollbacks, per-user profiles, and referentially
11672 transparent build processes. Without this work, Guix would not exist.
11673
11674 The Nix-based software distributions, Nixpkgs and NixOS, have also been
11675 an inspiration for Guix.
11676
11677 GNU@tie{}Guix itself is a collective work with contributions from a
11678 number of people. See the @file{AUTHORS} file in Guix for more
11679 information on these fine people. The @file{THANKS} file lists people
11680 who have helped by reporting bugs, taking care of the infrastructure,
11681 providing artwork and themes, making suggestions, and more---thank you!
11682
11683
11684 @c *********************************************************************
11685 @node GNU Free Documentation License
11686 @appendix GNU Free Documentation License
11687
11688 @include fdl-1.3.texi
11689
11690 @c *********************************************************************
11691 @node Concept Index
11692 @unnumbered Concept Index
11693 @printindex cp
11694
11695 @node Programming Index
11696 @unnumbered Programming Index
11697 @syncodeindex tp fn
11698 @syncodeindex vr fn
11699 @printindex fn
11700
11701 @bye
11702
11703 @c Local Variables:
11704 @c ispell-local-dictionary: "american";
11705 @c End: