system: grub: Allow arbitrary kernel file names in 'menu-entry'.
[jackhill/guix/guix.git] / doc / guix.texi
1 \input texinfo
2 @c -*-texinfo-*-
3
4 @c %**start of header
5 @setfilename guix.info
6 @documentencoding UTF-8
7 @settitle GNU Guix Reference Manual
8 @c %**end of header
9
10 @include version.texi
11
12 @c Identifier of the OpenPGP key used to sign tarballs and such.
13 @set OPENPGP-SIGNING-KEY-ID 090B11993D9AEBB5
14
15 @copying
16 Copyright @copyright{} 2012, 2013, 2014, 2015, 2016 Ludovic Courtès@*
17 Copyright @copyright{} 2013, 2014, 2016 Andreas Enge@*
18 Copyright @copyright{} 2013 Nikita Karetnikov@*
19 Copyright @copyright{} 2014, 2015, 2016 Alex Kost@*
20 Copyright @copyright{} 2015, 2016 Mathieu Lirzin@*
21 Copyright @copyright{} 2014 Pierre-Antoine Rault@*
22 Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer@*
23 Copyright @copyright{} 2015, 2016 Leo Famulari@*
24 Copyright @copyright{} 2015, 2016 Ricardo Wurmus@*
25 Copyright @copyright{} 2016 Ben Woodcroft@*
26 Copyright @copyright{} 2016 Chris Marusich@*
27 Copyright @copyright{} 2016 Efraim Flashner@*
28 Copyright @copyright{} 2016 John Darrington@*
29 Copyright @copyright{} 2016 ng0
30
31 Permission is granted to copy, distribute and/or modify this document
32 under the terms of the GNU Free Documentation License, Version 1.3 or
33 any later version published by the Free Software Foundation; with no
34 Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
35 copy of the license is included in the section entitled ``GNU Free
36 Documentation License''.
37 @end copying
38
39 @dircategory System administration
40 @direntry
41 * Guix: (guix). Manage installed software and system configuration.
42 * guix package: (guix)Invoking guix package. Installing, removing, and upgrading packages.
43 * guix build: (guix)Invoking guix build. Building packages.
44 * guix gc: (guix)Invoking guix gc. Reclaiming unused disk space.
45 * guix pull: (guix)Invoking guix pull. Update the list of available packages.
46 * guix system: (guix)Invoking guix system. Manage the operating system configuration.
47 @end direntry
48
49 @dircategory Software development
50 @direntry
51 * guix environment: (guix)Invoking guix environment. Building development environments with Guix.
52 @end direntry
53
54 @dircategory Emacs
55 @direntry
56 * Guix user interface: (guix)Emacs Interface. Package management from the comfort of Emacs.
57 @end direntry
58
59
60 @titlepage
61 @title GNU Guix Reference Manual
62 @subtitle Using the GNU Guix Functional Package Manager
63 @author The GNU Guix Developers
64
65 @page
66 @vskip 0pt plus 1filll
67 Edition @value{EDITION} @*
68 @value{UPDATED} @*
69
70 @insertcopying
71 @end titlepage
72
73 @contents
74
75 @c *********************************************************************
76 @node Top
77 @top GNU Guix
78
79 This document describes GNU Guix version @value{VERSION}, a functional
80 package management tool written for the GNU system.
81
82 @menu
83 * Introduction:: What is Guix about?
84 * Installation:: Installing Guix.
85 * Package Management:: Package installation, upgrade, etc.
86 * Emacs Interface:: Using Guix from Emacs.
87 * Programming Interface:: Using Guix in Scheme.
88 * Utilities:: Package management commands.
89 * GNU Distribution:: Software for your friendly GNU system.
90 * Contributing:: Your help needed!
91
92 * Acknowledgments:: Thanks!
93 * GNU Free Documentation License:: The license of this manual.
94 * Concept Index:: Concepts.
95 * Programming Index:: Data types, functions, and variables.
96
97 @detailmenu
98 --- The Detailed Node Listing ---
99
100 Installation
101
102 * Binary Installation:: Getting Guix running in no time!
103 * Requirements:: Software needed to build and run Guix.
104 * Running the Test Suite:: Testing Guix.
105 * Setting Up the Daemon:: Preparing the build daemon's environment.
106 * Invoking guix-daemon:: Running the build daemon.
107 * Application Setup:: Application-specific setup.
108
109 Setting Up the Daemon
110
111 * Build Environment Setup:: Preparing the isolated build environment.
112 * Daemon Offload Setup:: Offloading builds to remote machines.
113
114 Package Management
115
116 * Features:: How Guix will make your life brighter.
117 * Invoking guix package:: Package installation, removal, etc.
118 * Substitutes:: Downloading pre-built binaries.
119 * Packages with Multiple Outputs:: Single source package, multiple outputs.
120 * Invoking guix gc:: Running the garbage collector.
121 * Invoking guix pull:: Fetching the latest Guix and distribution.
122 * Invoking guix archive:: Exporting and importing store files.
123
124 Emacs Interface
125
126 * Initial Setup: Emacs Initial Setup. Preparing @file{~/.emacs}.
127 * Package Management: Emacs Package Management. Managing packages and generations.
128 * Licenses: Emacs Licenses. Interface for licenses of Guix packages.
129 * Package Source Locations: Emacs Package Locations. Interface for package location files.
130 * Popup Interface: Emacs Popup Interface. Magit-like interface for guix commands.
131 * Prettify Mode: Emacs Prettify. Abbreviating @file{/gnu/store/@dots{}} file names.
132 * Build Log Mode: Emacs Build Log. Highlighting Guix build logs.
133 * Completions: Emacs Completions. Completing @command{guix} shell command.
134 * Development: Emacs Development. Tools for Guix developers.
135 * Hydra: Emacs Hydra. Interface for Guix build farm.
136
137 Programming Interface
138
139 * Defining Packages:: Defining new packages.
140 * Build Systems:: Specifying how packages are built.
141 * The Store:: Manipulating the package store.
142 * Derivations:: Low-level interface to package derivations.
143 * The Store Monad:: Purely functional interface to the store.
144 * G-Expressions:: Manipulating build expressions.
145
146 Defining Packages
147
148 * package Reference:: The package data type.
149 * origin Reference:: The origin data type.
150
151 Utilities
152
153 * Invoking guix build:: Building packages from the command line.
154 * Invoking guix edit:: Editing package definitions.
155 * Invoking guix download:: Downloading a file and printing its hash.
156 * Invoking guix hash:: Computing the cryptographic hash of a file.
157 * Invoking guix import:: Importing package definitions.
158 * Invoking guix refresh:: Updating package definitions.
159 * Invoking guix lint:: Finding errors in package definitions.
160 * Invoking guix size:: Profiling disk usage.
161 * Invoking guix graph:: Visualizing the graph of packages.
162 * Invoking guix environment:: Setting up development environments.
163 * Invoking guix publish:: Sharing substitutes.
164 * Invoking guix challenge:: Challenging substitute servers.
165 * Invoking guix container:: Process isolation.
166
167 Invoking @command{guix build}
168
169 * Common Build Options:: Build options for most commands.
170 * Package Transformation Options:: Creating variants of packages.
171 * Additional Build Options:: Options specific to 'guix build'.
172
173 GNU Distribution
174
175 * System Installation:: Installing the whole operating system.
176 * System Configuration:: Configuring the operating system.
177 * Installing Debugging Files:: Feeding the debugger.
178 * Security Updates:: Deploying security fixes quickly.
179 * Package Modules:: Packages from the programmer's viewpoint.
180 * Packaging Guidelines:: Growing the distribution.
181 * Bootstrapping:: GNU/Linux built from scratch.
182 * Porting:: Targeting another platform or kernel.
183
184 System Installation
185
186 * Limitations:: What you can expect.
187 * Hardware Considerations:: Supported hardware.
188 * USB Stick Installation:: Preparing the installation medium.
189 * Preparing for Installation:: Networking, partitioning, etc.
190 * Proceeding with the Installation:: The real thing.
191 * Installing GuixSD in a VM:: GuixSD playground.
192 * Building the Installation Image:: How this comes to be.
193
194 System Configuration
195
196 * Using the Configuration System:: Customizing your GNU system.
197 * operating-system Reference:: Detail of operating-system declarations.
198 * File Systems:: Configuring file system mounts.
199 * Mapped Devices:: Block device extra processing.
200 * User Accounts:: Specifying user accounts.
201 * Locales:: Language and cultural convention settings.
202 * Services:: Specifying system services.
203 * Setuid Programs:: Programs running with root privileges.
204 * X.509 Certificates:: Authenticating HTTPS servers.
205 * Name Service Switch:: Configuring libc's name service switch.
206 * Initial RAM Disk:: Linux-Libre bootstrapping.
207 * GRUB Configuration:: Configuring the boot loader.
208 * Invoking guix system:: Instantiating a system configuration.
209 * Running GuixSD in a VM:: How to run GuixSD in a virtual machine.
210 * Defining Services:: Adding new service definitions.
211
212 Services
213
214 * Base Services:: Essential system services.
215 * Scheduled Job Execution:: The mcron service.
216 * Networking Services:: Network setup, SSH daemon, etc.
217 * X Window:: Graphical display.
218 * Desktop Services:: D-Bus and desktop services.
219 * Database Services:: SQL databases.
220 * Mail Services:: IMAP, POP3, SMTP, and all that.
221 * Web Services:: Web servers.
222 * Various Services:: Other services.
223
224 Defining Services
225
226 * Service Composition:: The model for composing services.
227 * Service Types and Services:: Types and services.
228 * Service Reference:: API reference.
229 * Shepherd Services:: A particular type of service.
230
231 Packaging Guidelines
232
233 * Software Freedom:: What may go into the distribution.
234 * Package Naming:: What's in a name?
235 * Version Numbers:: When the name is not enough.
236 * Synopses and Descriptions:: Helping users find the right package.
237 * Python Modules:: Taming the snake.
238 * Perl Modules:: Little pearls.
239 * Java Packages:: Coffee break.
240 * Fonts:: Fond of fonts.
241
242 Contributing
243
244 * Building from Git:: The latest and greatest.
245 * Running Guix Before It Is Installed:: Hacker tricks.
246 * The Perfect Setup:: The right tools.
247 * Coding Style:: Hygiene of the contributor.
248 * Submitting Patches:: Share your work.
249
250 Coding Style
251
252 * Programming Paradigm:: How to compose your elements.
253 * Modules:: Where to store your code?
254 * Data Types and Pattern Matching:: Implementing data structures.
255 * Formatting Code:: Writing conventions.
256
257 @end detailmenu
258 @end menu
259
260 @c *********************************************************************
261 @node Introduction
262 @chapter Introduction
263
264 @cindex purpose
265 GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks''
266 using the international phonetic alphabet (IPA).} is a package
267 management tool for the GNU system. Guix makes it easy for unprivileged
268 users to install, upgrade, or remove packages, to roll back to a
269 previous package set, to build packages from source, and generally
270 assists with the creation and maintenance of software environments.
271
272 @cindex user interfaces
273 Guix provides a command-line package management interface
274 (@pxref{Invoking guix package}), a set of command-line utilities
275 (@pxref{Utilities}), a visual user interface in Emacs (@pxref{Emacs
276 Interface}), as well as Scheme programming interfaces
277 (@pxref{Programming Interface}).
278 @cindex build daemon
279 Its @dfn{build daemon} is responsible for building packages on behalf of
280 users (@pxref{Setting Up the Daemon}) and for downloading pre-built
281 binaries from authorized sources (@pxref{Substitutes}).
282
283 @cindex extensibility of the distribution
284 @cindex customization of packages
285 Guix includes package definitions for many GNU and non-GNU packages, all
286 of which @uref{https://www.gnu.org/philosophy/free-sw.html, respect the
287 user's computing freedom}. It is @emph{extensible}: users can write
288 their own package definitions (@pxref{Defining Packages}) and make them
289 available as independent package modules (@pxref{Package Modules}). It
290 is also @emph{customizable}: users can @emph{derive} specialized package
291 definitions from existing ones, including from the command line
292 (@pxref{Package Transformation Options}).
293
294 @cindex Guix System Distribution
295 @cindex GuixSD
296 You can install GNU@tie{}Guix on top of an existing GNU/Linux system
297 where it complements the available tools without interference
298 (@pxref{Installation}), or you can use it as part of the standalone
299 @dfn{Guix System Distribution} or GuixSD (@pxref{GNU Distribution}).
300 With GNU@tie{}GuixSD, you @emph{declare} all aspects of the operating
301 system configuration and Guix takes care of instantiating the
302 configuration in a transactional, reproducible, and stateless fashion
303 (@pxref{System Configuration}).
304
305 @cindex functional package management
306 Under the hood, Guix implements the @dfn{functional package management}
307 discipline pioneered by Nix (@pxref{Acknowledgments}).
308 In Guix, the package build and installation process is seen
309 as a @emph{function}, in the mathematical sense. That function takes inputs,
310 such as build scripts, a compiler, and libraries, and
311 returns an installed package. As a pure function, its result depends
312 solely on its inputs---for instance, it cannot refer to software or
313 scripts that were not explicitly passed as inputs. A build function
314 always produces the same result when passed a given set of inputs. It
315 cannot alter the environment of the running system in
316 any way; for instance, it cannot create, modify, or delete files outside
317 of its build and installation directories. This is achieved by running
318 build processes in isolated environments (or @dfn{containers}), where only their
319 explicit inputs are visible.
320
321 @cindex store
322 The result of package build functions is @dfn{cached} in the file
323 system, in a special directory called @dfn{the store} (@pxref{The
324 Store}). Each package is installed in a directory of its own in the
325 store---by default under @file{/gnu/store}. The directory name contains
326 a hash of all the inputs used to build that package; thus, changing an
327 input yields a different directory name.
328
329 This approach is the foundation for the salient features of Guix: support
330 for transactional package upgrade and rollback, per-user installation, and
331 garbage collection of packages (@pxref{Features}).
332
333
334 @c *********************************************************************
335 @node Installation
336 @chapter Installation
337
338 GNU Guix is available for download from its website at
339 @url{http://www.gnu.org/software/guix/}. This section describes the
340 software requirements of Guix, as well as how to install it and get
341 ready to use it.
342
343 Note that this section is concerned with the installation of the package
344 manager, which can be done on top of a running GNU/Linux system. If,
345 instead, you want to install the complete GNU operating system,
346 @pxref{System Installation}.
347
348 @cindex foreign distro
349 When installed on a running GNU/Linux system---thereafter called a
350 @dfn{foreign distro}---GNU@tie{}Guix complements the available tools
351 without interference. Its data lives exclusively in two directories,
352 usually @file{/gnu/store} and @file{/var/guix}; other files on your
353 system, such as @file{/etc}, are left untouched.
354
355 @menu
356 * Binary Installation:: Getting Guix running in no time!
357 * Requirements:: Software needed to build and run Guix.
358 * Running the Test Suite:: Testing Guix.
359 * Setting Up the Daemon:: Preparing the build daemon's environment.
360 * Invoking guix-daemon:: Running the build daemon.
361 * Application Setup:: Application-specific setup.
362 @end menu
363
364 @node Binary Installation
365 @section Binary Installation
366
367 This section describes how to install Guix on an arbitrary system from a
368 self-contained tarball providing binaries for Guix and for all its
369 dependencies. This is often quicker than installing from source, which
370 is described in the next sections. The only requirement is to have
371 GNU@tie{}tar and Xz.
372
373 Installing goes along these lines:
374
375 @enumerate
376 @item
377 Download the binary tarball from
378 @indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz},
379 where @var{system} is @code{x86_64-linux} for an @code{x86_64} machine
380 already running the kernel Linux, and so on.
381
382 @c The following is somewhat duplicated in ``System Installation''.
383 Make sure to download the associated @file{.sig} file and to verify the
384 authenticity of the tarball against it, along these lines:
385
386 @example
387 $ wget ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz.sig
388 $ gpg --verify guix-binary-@value{VERSION}.@var{system}.tar.xz.sig
389 @end example
390
391 If that command fails because you do not have the required public key,
392 then run this command to import it:
393
394 @example
395 $ gpg --keyserver pgp.mit.edu --recv-keys @value{OPENPGP-SIGNING-KEY-ID}
396 @end example
397
398 @noindent
399 and rerun the @code{gpg --verify} command.
400 @c end authentication part
401
402 @item
403 As @code{root}, run:
404
405 @example
406 # cd /tmp
407 # tar --warning=no-timestamp -xf \
408 guix-binary-@value{VERSION}.@var{system}.tar.xz
409 # mv var/guix /var/ && mv gnu /
410 @end example
411
412 This creates @file{/gnu/store} (@pxref{The Store}) and @file{/var/guix}.
413 The latter contains a ready-to-use profile for @code{root} (see next
414 step.)
415
416 Do @emph{not} unpack the tarball on a working Guix system since that
417 would overwrite its own essential files.
418
419 The @code{--warning=no-timestamp} option makes sure GNU@tie{}tar does
420 not emit warnings about ``implausibly old time stamps'' (such
421 warnings were triggered by GNU@tie{}tar 1.26 and older; recent
422 versions are fine.)
423 They stem from the fact that all the
424 files in the archive have their modification time set to zero (which
425 means January 1st, 1970.) This is done on purpose to make sure the
426 archive content is independent of its creation time, thus making it
427 reproducible.
428
429 @item
430 Make @code{root}'s profile available under @file{~/.guix-profile}:
431
432 @example
433 # ln -sf /var/guix/profiles/per-user/root/guix-profile \
434 ~root/.guix-profile
435 @end example
436
437 @item
438 Create the group and user accounts for build users as explained below
439 (@pxref{Build Environment Setup}).
440
441 @item
442 Run the daemon, and set it to automatically start on boot.
443
444 If your host distro uses the systemd init system, this can be achieved
445 with these commands:
446
447 @example
448 # cp ~root/.guix-profile/lib/systemd/system/guix-daemon.service \
449 /etc/systemd/system/
450 # systemctl start guix-daemon && systemctl enable guix-daemon
451 @end example
452
453 If your host distro uses the Upstart init system:
454
455 @example
456 # cp ~root/.guix-profile/lib/upstart/system/guix-daemon.conf /etc/init/
457 # start guix-daemon
458 @end example
459
460 Otherwise, you can still start the daemon manually with:
461
462 @example
463 # ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild
464 @end example
465
466 @item
467 Make the @command{guix} command available to other users on the machine,
468 for instance with:
469
470 @example
471 # mkdir -p /usr/local/bin
472 # cd /usr/local/bin
473 # ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix
474 @end example
475
476 It is also a good idea to make the Info version of this manual available
477 there:
478
479 @example
480 # mkdir -p /usr/local/share/info
481 # cd /usr/local/share/info
482 # for i in /var/guix/profiles/per-user/root/guix-profile/share/info/* ;
483 do ln -s $i ; done
484 @end example
485
486 That way, assuming @file{/usr/local/share/info} is in the search path,
487 running @command{info guix} will open this manual (@pxref{Other Info
488 Directories,,, texinfo, GNU Texinfo}, for more details on changing the
489 Info search path.)
490
491 @item
492 To use substitutes from @code{hydra.gnu.org} or one of its mirrors
493 (@pxref{Substitutes}), authorize them:
494
495 @example
496 # guix archive --authorize < ~root/.guix-profile/share/guix/hydra.gnu.org.pub
497 @end example
498 @end enumerate
499
500 This completes root-level install of Guix. Each user will need to
501 perform additional steps to make their Guix environment ready for use,
502 @pxref{Application Setup}.
503
504 You can confirm that Guix is working by installing a sample package into
505 the root profile:
506
507 @example
508 # guix package -i hello
509 @end example
510
511 The @code{guix} package must remain available in @code{root}'s profile,
512 or it would become subject to garbage collection---in which case you
513 would find yourself badly handicapped by the lack of the @command{guix}
514 command. In other words, do not remove @code{guix} by running
515 @code{guix package -r guix}.
516
517 The binary installation tarball can be (re)produced and verified simply
518 by running the following command in the Guix source tree:
519
520 @example
521 make guix-binary.@var{system}.tar.xz
522 @end example
523
524
525 @node Requirements
526 @section Requirements
527
528 This section lists requirements when building Guix from source. The
529 build procedure for Guix is the same as for other GNU software, and is
530 not covered here. Please see the files @file{README} and @file{INSTALL}
531 in the Guix source tree for additional details.
532
533 GNU Guix depends on the following packages:
534
535 @itemize
536 @item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later;
537 @item @url{http://gnupg.org/, GNU libgcrypt};
538 @item @url{http://www.gnu.org/software/make/, GNU Make}.
539 @end itemize
540
541 The following dependencies are optional:
542
543 @itemize
544 @item
545 Installing @uref{http://gnutls.org/, GnuTLS-Guile} will allow you to
546 access @code{https} URLs for substitutes, which is highly recommended
547 (@pxref{Substitutes}). It also allows you to access HTTPS URLs with the
548 @command{guix download} command (@pxref{Invoking guix download}), the
549 @command{guix import pypi} command, and the @command{guix import cpan}
550 command. @xref{Guile Preparations, how to install the GnuTLS bindings
551 for Guile,, gnutls-guile, GnuTLS-Guile}.
552
553 @item
554 Installing
555 @url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will
556 allow you to use the @command{guix import pypi} command (@pxref{Invoking
557 guix import}). It is of
558 interest primarily for developers and not for casual users.
559
560 @item
561 When @url{http://zlib.net, zlib} is available, @command{guix publish}
562 can compress build byproducts (@pxref{Invoking guix publish}).
563 @end itemize
564
565 Unless @code{--disable-daemon} was passed to @command{configure}, the
566 following packages are also needed:
567
568 @itemize
569 @item @url{http://sqlite.org, SQLite 3};
570 @item @url{http://www.bzip.org, libbz2};
571 @item @url{http://gcc.gnu.org, GCC's g++}, with support for the
572 C++11 standard.
573 @end itemize
574
575 When configuring Guix on a system that already has a Guix installation,
576 be sure to specify the same state directory as the existing installation
577 using the @code{--localstatedir} option of the @command{configure}
578 script (@pxref{Directory Variables, @code{localstatedir},, standards,
579 GNU Coding Standards}). The @command{configure} script protects against
580 unintended misconfiguration of @var{localstatedir} so you do not
581 inadvertently corrupt your store (@pxref{The Store}).
582
583 When a working installation of @url{http://nixos.org/nix/, the Nix package
584 manager} is available, you
585 can instead configure Guix with @code{--disable-daemon}. In that case,
586 Nix replaces the three dependencies above.
587
588 Guix is compatible with Nix, so it is possible to share the same store
589 between both. To do so, you must pass @command{configure} not only the
590 same @code{--with-store-dir} value, but also the same
591 @code{--localstatedir} value. The latter is essential because it
592 specifies where the database that stores metadata about the store is
593 located, among other things. The default values for Nix are
594 @code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}.
595 Note that @code{--disable-daemon} is not required if
596 your goal is to share the store with Nix.
597
598 @node Running the Test Suite
599 @section Running the Test Suite
600
601 After a successful @command{configure} and @code{make} run, it is a good
602 idea to run the test suite. It can help catch issues with the setup or
603 environment, or bugs in Guix itself---and really, reporting test
604 failures is a good way to help improve the software. To run the test
605 suite, type:
606
607 @example
608 make check
609 @end example
610
611 Test cases can run in parallel: you can use the @code{-j} option of
612 GNU@tie{}make to speed things up. The first run may take a few minutes
613 on a recent machine; subsequent runs will be faster because the store
614 that is created for test purposes will already have various things in
615 cache.
616
617 It is also possible to run a subset of the tests by defining the
618 @code{TESTS} makefile variable as in this example:
619
620 @example
621 make check TESTS="tests/store.scm tests/cpio.scm"
622 @end example
623
624 By default, tests results are displayed at a file level. In order to
625 see the details of every individual test cases, it is possible to define
626 the @code{SCM_LOG_DRIVER_FLAGS} makefile variable as in this example:
627
628 @example
629 make check TESTS="tests/base64.scm" SCM_LOG_DRIVER_FLAGS="--brief=no"
630 @end example
631
632 Upon failure, please email @email{bug-guix@@gnu.org} and attach the
633 @file{test-suite.log} file. Please specify the Guix version being used
634 as well as version numbers of the dependencies (@pxref{Requirements}) in
635 your message.
636
637 Guix also comes with a whole-system test suite that tests complete
638 GuixSD operating system instances. It can only run on systems where
639 Guix is already installed, using:
640
641 @example
642 make check-system
643 @end example
644
645 @noindent
646 or, again, by defining @code{TESTS} to select a subset of tests to run:
647
648 @example
649 make check-system TESTS="basic mcron"
650 @end example
651
652 These system tests are defined in the @code{(gnu tests @dots{})}
653 modules. They work by running the operating systems under test with
654 lightweight instrumentation in a virtual machine (VM). They can be
655 computationally intensive or rather cheap, depending on whether
656 substitutes are available for their dependencies (@pxref{Substitutes}).
657 Some of them require a lot of storage space to hold VM images.
658
659 Again in case of test failures, please send @email{bug-guix@@gnu.org}
660 all the details.
661
662 @node Setting Up the Daemon
663 @section Setting Up the Daemon
664
665 @cindex daemon
666 Operations such as building a package or running the garbage collector
667 are all performed by a specialized process, the @dfn{build daemon}, on
668 behalf of clients. Only the daemon may access the store and its
669 associated database. Thus, any operation that manipulates the store
670 goes through the daemon. For instance, command-line tools such as
671 @command{guix package} and @command{guix build} communicate with the
672 daemon (@i{via} remote procedure calls) to instruct it what to do.
673
674 The following sections explain how to prepare the build daemon's
675 environment. See also @ref{Substitutes}, for information on how to allow
676 the daemon to download pre-built binaries.
677
678 @menu
679 * Build Environment Setup:: Preparing the isolated build environment.
680 * Daemon Offload Setup:: Offloading builds to remote machines.
681 @end menu
682
683 @node Build Environment Setup
684 @subsection Build Environment Setup
685
686 In a standard multi-user setup, Guix and its daemon---the
687 @command{guix-daemon} program---are installed by the system
688 administrator; @file{/gnu/store} is owned by @code{root} and
689 @command{guix-daemon} runs as @code{root}. Unprivileged users may use
690 Guix tools to build packages or otherwise access the store, and the
691 daemon will do it on their behalf, ensuring that the store is kept in a
692 consistent state, and allowing built packages to be shared among users.
693
694 @cindex build users
695 When @command{guix-daemon} runs as @code{root}, you may not want package
696 build processes themselves to run as @code{root} too, for obvious
697 security reasons. To avoid that, a special pool of @dfn{build users}
698 should be created for use by build processes started by the daemon.
699 These build users need not have a shell and a home directory: they will
700 just be used when the daemon drops @code{root} privileges in build
701 processes. Having several such users allows the daemon to launch
702 distinct build processes under separate UIDs, which guarantees that they
703 do not interfere with each other---an essential feature since builds are
704 regarded as pure functions (@pxref{Introduction}).
705
706 On a GNU/Linux system, a build user pool may be created like this (using
707 Bash syntax and the @code{shadow} commands):
708
709 @c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html
710 @c for why `-G' is needed.
711 @example
712 # groupadd --system guixbuild
713 # for i in `seq -w 1 10`;
714 do
715 useradd -g guixbuild -G guixbuild \
716 -d /var/empty -s `which nologin` \
717 -c "Guix build user $i" --system \
718 guixbuilder$i;
719 done
720 @end example
721
722 @noindent
723 The number of build users determines how many build jobs may run in
724 parallel, as specified by the @option{--max-jobs} option
725 (@pxref{Invoking guix-daemon, @option{--max-jobs}}). To use
726 @command{guix system vm} and related commands, you may need to add the
727 build users to the @code{kvm} group so they can access @file{/dev/kvm},
728 using @code{-G guixbuild,kvm} instead of @code{-G guixbuild}
729 (@pxref{Invoking guix system}).
730
731 The @code{guix-daemon} program may then be run as @code{root} with the
732 following command@footnote{If your machine uses the systemd init system,
733 dropping the @file{@var{prefix}/lib/systemd/system/guix-daemon.service}
734 file in @file{/etc/systemd/system} will ensure that
735 @command{guix-daemon} is automatically started. Similarly, if your
736 machine uses the Upstart init system, drop the
737 @file{@var{prefix}/lib/upstart/system/guix-daemon.conf}
738 file in @file{/etc/init}.}:
739
740 @example
741 # guix-daemon --build-users-group=guixbuild
742 @end example
743
744 @cindex chroot
745 @noindent
746 This way, the daemon starts build processes in a chroot, under one of
747 the @code{guixbuilder} users. On GNU/Linux, by default, the chroot
748 environment contains nothing but:
749
750 @c Keep this list in sync with libstore/build.cc! -----------------------
751 @itemize
752 @item
753 a minimal @code{/dev} directory, created mostly independently from the
754 host @code{/dev}@footnote{``Mostly'', because while the set of files
755 that appear in the chroot's @code{/dev} is fixed, most of these files
756 can only be created if the host has them.};
757
758 @item
759 the @code{/proc} directory; it only shows the processes of the container
760 since a separate PID name space is used;
761
762 @item
763 @file{/etc/passwd} with an entry for the current user and an entry for
764 user @file{nobody};
765
766 @item
767 @file{/etc/group} with an entry for the user's group;
768
769 @item
770 @file{/etc/hosts} with an entry that maps @code{localhost} to
771 @code{127.0.0.1};
772
773 @item
774 a writable @file{/tmp} directory.
775 @end itemize
776
777 You can influence the directory where the daemon stores build trees
778 @i{via} the @code{TMPDIR} environment variable. However, the build tree
779 within the chroot is always called @file{/tmp/guix-build-@var{name}.drv-0},
780 where @var{name} is the derivation name---e.g., @code{coreutils-8.24}.
781 This way, the value of @code{TMPDIR} does not leak inside build
782 environments, which avoids discrepancies in cases where build processes
783 capture the name of their build tree.
784
785 @vindex http_proxy
786 The daemon also honors the @code{http_proxy} environment variable for
787 HTTP downloads it performs, be it for fixed-output derivations
788 (@pxref{Derivations}) or for substitutes (@pxref{Substitutes}).
789
790 If you are installing Guix as an unprivileged user, it is still possible
791 to run @command{guix-daemon} provided you pass @code{--disable-chroot}.
792 However, build processes will not be isolated from one another, and not
793 from the rest of the system. Thus, build processes may interfere with
794 each other, and may access programs, libraries, and other files
795 available on the system---making it much harder to view them as
796 @emph{pure} functions.
797
798
799 @node Daemon Offload Setup
800 @subsection Using the Offload Facility
801
802 @cindex offloading
803 @cindex build hook
804 When desired, the build daemon can @dfn{offload}
805 derivation builds to other machines
806 running Guix, using the @code{offload} @dfn{build hook}. When that
807 feature is enabled, a list of user-specified build machines is read from
808 @file{/etc/guix/machines.scm}; every time a build is requested, for
809 instance via @code{guix build}, the daemon attempts to offload it to one
810 of the machines that satisfy the constraints of the derivation, in
811 particular its system type---e.g., @file{x86_64-linux}. Missing
812 prerequisites for the build are copied over SSH to the target machine,
813 which then proceeds with the build; upon success the output(s) of the
814 build are copied back to the initial machine.
815
816 The @file{/etc/guix/machines.scm} file typically looks like this:
817
818 @example
819 (list (build-machine
820 (name "eightysix.example.org")
821 (system "x86_64-linux")
822 (user "bob")
823 (speed 2.)) ; incredibly fast!
824
825 (build-machine
826 (name "meeps.example.org")
827 (system "mips64el-linux")
828 (user "alice")
829 (private-key
830 (string-append (getenv "HOME")
831 "/.lsh/identity-for-guix"))))
832 @end example
833
834 @noindent
835 In the example above we specify a list of two build machines, one for
836 the @code{x86_64} architecture and one for the @code{mips64el}
837 architecture.
838
839 In fact, this file is---not surprisingly!---a Scheme file that is
840 evaluated when the @code{offload} hook is started. Its return value
841 must be a list of @code{build-machine} objects. While this example
842 shows a fixed list of build machines, one could imagine, say, using
843 DNS-SD to return a list of potential build machines discovered in the
844 local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using
845 Avahi in Guile Scheme Programs}). The @code{build-machine} data type is
846 detailed below.
847
848 @deftp {Data Type} build-machine
849 This data type represents build machines to which the daemon may offload
850 builds. The important fields are:
851
852 @table @code
853
854 @item name
855 The host name of the remote machine.
856
857 @item system
858 The system type of the remote machine---e.g., @code{"x86_64-linux"}.
859
860 @item user
861 The user account to use when connecting to the remote machine over SSH.
862 Note that the SSH key pair must @emph{not} be passphrase-protected, to
863 allow non-interactive logins.
864
865 @end table
866
867 A number of optional fields may be specified:
868
869 @table @code
870
871 @item port
872 Port number of SSH server on the machine (default: 22).
873
874 @item private-key
875 The SSH private key file to use when connecting to the machine.
876
877 Currently offloading uses GNU@tie{}lsh as its SSH client
878 (@pxref{Invoking lsh,,, GNU lsh Manual}). Thus, the key file here must
879 be an lsh key file. This may change in the future, though.
880
881 @item parallel-builds
882 The number of builds that may run in parallel on the machine (1 by
883 default.)
884
885 @item speed
886 A ``relative speed factor''. The offload scheduler will tend to prefer
887 machines with a higher speed factor.
888
889 @item features
890 A list of strings denoting specific features supported by the machine.
891 An example is @code{"kvm"} for machines that have the KVM Linux modules
892 and corresponding hardware support. Derivations can request features by
893 name, and they will be scheduled on matching build machines.
894
895 @end table
896 @end deftp
897
898 The @code{guix} command must be in the search path on the build
899 machines, since offloading works by invoking the @code{guix archive} and
900 @code{guix build} commands. In addition, the Guix modules must be in
901 @code{$GUILE_LOAD_PATH} on the build machine---you can check whether
902 this is the case by running:
903
904 @example
905 lsh build-machine guile -c "'(use-modules (guix config))'"
906 @end example
907
908 There is one last thing to do once @file{machines.scm} is in place. As
909 explained above, when offloading, files are transferred back and forth
910 between the machine stores. For this to work, you first need to
911 generate a key pair on each machine to allow the daemon to export signed
912 archives of files from the store (@pxref{Invoking guix archive}):
913
914 @example
915 # guix archive --generate-key
916 @end example
917
918 @noindent
919 Each build machine must authorize the key of the master machine so that
920 it accepts store items it receives from the master:
921
922 @example
923 # guix archive --authorize < master-public-key.txt
924 @end example
925
926 @noindent
927 Likewise, the master machine must authorize the key of each build machine.
928
929 All the fuss with keys is here to express pairwise mutual trust
930 relations between the master and the build machines. Concretely, when
931 the master receives files from a build machine (and @i{vice versa}), its
932 build daemon can make sure they are genuine, have not been tampered
933 with, and that they are signed by an authorized key.
934
935
936 @node Invoking guix-daemon
937 @section Invoking @command{guix-daemon}
938
939 The @command{guix-daemon} program implements all the functionality to
940 access the store. This includes launching build processes, running the
941 garbage collector, querying the availability of a build result, etc. It
942 is normally run as @code{root} like this:
943
944 @example
945 # guix-daemon --build-users-group=guixbuild
946 @end example
947
948 @noindent
949 For details on how to set it up, @pxref{Setting Up the Daemon}.
950
951 @cindex chroot
952 @cindex container, build environment
953 @cindex build environment
954 @cindex reproducible builds
955 By default, @command{guix-daemon} launches build processes under
956 different UIDs, taken from the build group specified with
957 @code{--build-users-group}. In addition, each build process is run in a
958 chroot environment that only contains the subset of the store that the
959 build process depends on, as specified by its derivation
960 (@pxref{Programming Interface, derivation}), plus a set of specific
961 system directories. By default, the latter contains @file{/dev} and
962 @file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a
963 @dfn{container}: in addition to having its own file system tree, it has
964 a separate mount name space, its own PID name space, network name space,
965 etc. This helps achieve reproducible builds (@pxref{Features}).
966
967 When the daemon performs a build on behalf of the user, it creates a
968 build directory under @file{/tmp} or under the directory specified by
969 its @code{TMPDIR} environment variable; this directory is shared with
970 the container for the duration of the build. Be aware that using a
971 directory other than @file{/tmp} can affect build results---for example,
972 with a longer directory name, a build process that uses Unix-domain
973 sockets might hit the name length limitation for @code{sun_path}, which
974 it would otherwise not hit.
975
976 The build directory is automatically deleted upon completion, unless the
977 build failed and the client specified @option{--keep-failed}
978 (@pxref{Invoking guix build, @option{--keep-failed}}).
979
980 The following command-line options are supported:
981
982 @table @code
983 @item --build-users-group=@var{group}
984 Take users from @var{group} to run build processes (@pxref{Setting Up
985 the Daemon, build users}).
986
987 @item --no-substitutes
988 @cindex substitutes
989 Do not use substitutes for build products. That is, always build things
990 locally instead of allowing downloads of pre-built binaries
991 (@pxref{Substitutes}).
992
993 By default substitutes are used, unless the client---such as the
994 @command{guix package} command---is explicitly invoked with
995 @code{--no-substitutes}.
996
997 When the daemon runs with @code{--no-substitutes}, clients can still
998 explicitly enable substitution @i{via} the @code{set-build-options}
999 remote procedure call (@pxref{The Store}).
1000
1001 @item --substitute-urls=@var{urls}
1002 @anchor{daemon-substitute-urls}
1003 Consider @var{urls} the default whitespace-separated list of substitute
1004 source URLs. When this option is omitted,
1005 @indicateurl{https://mirror.hydra.gnu.org https://hydra.gnu.org} is used
1006 (@code{mirror.hydra.gnu.org} is a mirror of @code{hydra.gnu.org}).
1007
1008 This means that substitutes may be downloaded from @var{urls}, as long
1009 as they are signed by a trusted signature (@pxref{Substitutes}).
1010
1011 @cindex build hook
1012 @item --no-build-hook
1013 Do not use the @dfn{build hook}.
1014
1015 The build hook is a helper program that the daemon can start and to
1016 which it submits build requests. This mechanism is used to offload
1017 builds to other machines (@pxref{Daemon Offload Setup}).
1018
1019 @item --cache-failures
1020 Cache build failures. By default, only successful builds are cached.
1021
1022 When this option is used, @command{guix gc --list-failures} can be used
1023 to query the set of store items marked as failed; @command{guix gc
1024 --clear-failures} removes store items from the set of cached failures.
1025 @xref{Invoking guix gc}.
1026
1027 @item --cores=@var{n}
1028 @itemx -c @var{n}
1029 Use @var{n} CPU cores to build each derivation; @code{0} means as many
1030 as available.
1031
1032 The default value is @code{0}, but it may be overridden by clients, such
1033 as the @code{--cores} option of @command{guix build} (@pxref{Invoking
1034 guix build}).
1035
1036 The effect is to define the @code{NIX_BUILD_CORES} environment variable
1037 in the build process, which can then use it to exploit internal
1038 parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}.
1039
1040 @item --max-jobs=@var{n}
1041 @itemx -M @var{n}
1042 Allow at most @var{n} build jobs in parallel. The default value is
1043 @code{1}. Setting it to @code{0} means that no builds will be performed
1044 locally; instead, the daemon will offload builds (@pxref{Daemon Offload
1045 Setup}), or simply fail.
1046
1047 @item --rounds=@var{N}
1048 Build each derivation @var{n} times in a row, and raise an error if
1049 consecutive build results are not bit-for-bit identical. Note that this
1050 setting can be overridden by clients such as @command{guix build}
1051 (@pxref{Invoking guix build}).
1052
1053 When used in conjunction with @option{--keep-failed}, the differing
1054 output is kept in the store, under @file{/gnu/store/@dots{}-check}.
1055 This makes it easy to look for differences between the two results.
1056
1057 @item --debug
1058 Produce debugging output.
1059
1060 This is useful to debug daemon start-up issues, but then it may be
1061 overridden by clients, for example the @code{--verbosity} option of
1062 @command{guix build} (@pxref{Invoking guix build}).
1063
1064 @item --chroot-directory=@var{dir}
1065 Add @var{dir} to the build chroot.
1066
1067 Doing this may change the result of build processes---for instance if
1068 they use optional dependencies found in @var{dir} when it is available,
1069 and not otherwise. For that reason, it is not recommended to do so.
1070 Instead, make sure that each derivation declares all the inputs that it
1071 needs.
1072
1073 @item --disable-chroot
1074 Disable chroot builds.
1075
1076 Using this option is not recommended since, again, it would allow build
1077 processes to gain access to undeclared dependencies. It is necessary,
1078 though, when @command{guix-daemon} is running under an unprivileged user
1079 account.
1080
1081 @item --disable-log-compression
1082 Disable compression of the build logs.
1083
1084 Unless @code{--lose-logs} is used, all the build logs are kept in the
1085 @var{localstatedir}. To save space, the daemon automatically compresses
1086 them with bzip2 by default. This option disables that.
1087
1088 @item --disable-deduplication
1089 @cindex deduplication
1090 Disable automatic file ``deduplication'' in the store.
1091
1092 By default, files added to the store are automatically ``deduplicated'':
1093 if a newly added file is identical to another one found in the store,
1094 the daemon makes the new file a hard link to the other file. This can
1095 noticeably reduce disk usage, at the expense of slightly increased
1096 input/output load at the end of a build process. This option disables
1097 this optimization.
1098
1099 @item --gc-keep-outputs[=yes|no]
1100 Tell whether the garbage collector (GC) must keep outputs of live
1101 derivations.
1102
1103 When set to ``yes'', the GC will keep the outputs of any live derivation
1104 available in the store---the @code{.drv} files. The default is ``no'',
1105 meaning that derivation outputs are kept only if they are GC roots.
1106
1107 @item --gc-keep-derivations[=yes|no]
1108 Tell whether the garbage collector (GC) must keep derivations
1109 corresponding to live outputs.
1110
1111 When set to ``yes'', as is the case by default, the GC keeps
1112 derivations---i.e., @code{.drv} files---as long as at least one of their
1113 outputs is live. This allows users to keep track of the origins of
1114 items in their store. Setting it to ``no'' saves a bit of disk space.
1115
1116 Note that when both @code{--gc-keep-derivations} and
1117 @code{--gc-keep-outputs} are used, the effect is to keep all the build
1118 prerequisites (the sources, compiler, libraries, and other build-time
1119 tools) of live objects in the store, regardless of whether these
1120 prerequisites are live. This is convenient for developers since it
1121 saves rebuilds or downloads.
1122
1123 @item --impersonate-linux-2.6
1124 On Linux-based systems, impersonate Linux 2.6. This means that the
1125 kernel's @code{uname} system call will report 2.6 as the release number.
1126
1127 This might be helpful to build programs that (usually wrongfully) depend
1128 on the kernel version number.
1129
1130 @item --lose-logs
1131 Do not keep build logs. By default they are kept under
1132 @code{@var{localstatedir}/guix/log}.
1133
1134 @item --system=@var{system}
1135 Assume @var{system} as the current system type. By default it is the
1136 architecture/kernel pair found at configure time, such as
1137 @code{x86_64-linux}.
1138
1139 @item --listen=@var{socket}
1140 Listen for connections on @var{socket}, the file name of a Unix-domain
1141 socket. The default socket is
1142 @file{@var{localstatedir}/daemon-socket/socket}. This option is only
1143 useful in exceptional circumstances, such as if you need to run several
1144 daemons on the same machine.
1145 @end table
1146
1147
1148 @node Application Setup
1149 @section Application Setup
1150
1151 @cindex foreign distro
1152 When using Guix on top of GNU/Linux distribution other than GuixSD---a
1153 so-called @dfn{foreign distro}---a few additional steps are needed to
1154 get everything in place. Here are some of them.
1155
1156 @subsection Locales
1157
1158 @anchor{locales-and-locpath}
1159 @cindex locales, when not on GuixSD
1160 @vindex LOCPATH
1161 @vindex GUIX_LOCPATH
1162 Packages installed @i{via} Guix will not use the locale data of the
1163 host system. Instead, you must first install one of the locale packages
1164 available with Guix and then define the @code{GUIX_LOCPATH} environment
1165 variable:
1166
1167 @example
1168 $ guix package -i glibc-locales
1169 $ export GUIX_LOCPATH=$HOME/.guix-profile/lib/locale
1170 @end example
1171
1172 Note that the @code{glibc-locales} package contains data for all the
1173 locales supported by the GNU@tie{}libc and weighs in at around
1174 110@tie{}MiB. Alternatively, the @code{glibc-utf8-locales} is smaller but
1175 limited to a few UTF-8 locales.
1176
1177 The @code{GUIX_LOCPATH} variable plays a role similar to @code{LOCPATH}
1178 (@pxref{Locale Names, @code{LOCPATH},, libc, The GNU C Library Reference
1179 Manual}). There are two important differences though:
1180
1181 @enumerate
1182 @item
1183 @code{GUIX_LOCPATH} is honored only by the libc in Guix, and not by the libc
1184 provided by foreign distros. Thus, using @code{GUIX_LOCPATH} allows you
1185 to make sure the programs of the foreign distro will not end up loading
1186 incompatible locale data.
1187
1188 @item
1189 libc suffixes each entry of @code{GUIX_LOCPATH} with @code{/X.Y}, where
1190 @code{X.Y} is the libc version---e.g., @code{2.22}. This means that,
1191 should your Guix profile contain a mixture of programs linked against
1192 different libc version, each libc version will only try to load locale
1193 data in the right format.
1194 @end enumerate
1195
1196 This is important because the locale data format used by different libc
1197 versions may be incompatible.
1198
1199 @subsection X11 Fonts
1200
1201 The majority of graphical applications use Fontconfig to locate and
1202 load fonts and perform X11-client-side rendering. The @code{fontconfig}
1203 package in Guix looks for fonts in @file{$HOME/.guix-profile}
1204 by default. Thus, to allow graphical applications installed with Guix
1205 to display fonts, you have to install fonts with Guix as well.
1206 Essential font packages include @code{gs-fonts}, @code{font-dejavu}, and
1207 @code{font-gnu-freefont-ttf}.
1208
1209 To display text written in Chinese languages, Japanese, or Korean in
1210 graphical applications, consider installing
1211 @code{font-adobe-source-han-sans} or @code{font-wqy-zenhei}. The former
1212 has multiple outputs, one per language family (@pxref{Packages with
1213 Multiple Outputs}). For instance, the following command installs fonts
1214 for Chinese languages:
1215
1216 @example
1217 guix package -i font-adobe-source-han-sans:cn
1218 @end example
1219
1220 Older programs such as @command{xterm} do not use Fontconfig and instead
1221 rely on server-side font rendering. Such programs require to specify a
1222 full name of a font using XLFD (X Logical Font Description), like this:
1223
1224 @example
1225 -*-dejavu sans-medium-r-normal-*-*-100-*-*-*-*-*-1
1226 @end example
1227
1228 To be able to use such full names for the TrueType fonts installed in
1229 your Guix profile, you need to extend the font path of the X server:
1230
1231 @example
1232 xset +fp ~/.guix-profile/share/fonts/truetype
1233 @end example
1234
1235 After that, you can run @code{xlsfonts} (from @code{xlsfonts} package)
1236 to make sure your TrueType fonts are listed there.
1237
1238 @subsection X.509 Certificates
1239
1240 The @code{nss-certs} package provides X.509 certificates, which allow
1241 programs to authenticate Web servers accessed over HTTPS.
1242
1243 When using Guix on a foreign distro, you can install this package and
1244 define the relevant environment variables so that packages know where to
1245 look for certificates. @xref{X.509 Certificates}, for detailed
1246 information.
1247
1248 @subsection Emacs Packages
1249
1250 When you install Emacs packages with Guix, the elisp files may be placed
1251 either in @file{$HOME/.guix-profile/share/emacs/site-lisp/} or in
1252 sub-directories of
1253 @file{$HOME/.guix-profile/share/emacs/site-lisp/guix.d/}. The latter
1254 directory exists because potentially there may exist thousands of Emacs
1255 packages and storing all their files in a single directory may be not
1256 reliable (because of name conflicts). So we think using a separate
1257 directory for each package is a good idea. It is very similar to how
1258 the Emacs package system organizes the file structure (@pxref{Package
1259 Files,,, emacs, The GNU Emacs Manual}).
1260
1261 By default, Emacs (installed with Guix) ``knows'' where these packages
1262 are placed, so you do not need to perform any configuration. If, for
1263 some reason, you want to avoid auto-loading Emacs packages installed
1264 with Guix, you can do so by running Emacs with @code{--no-site-file}
1265 option (@pxref{Init File,,, emacs, The GNU Emacs Manual}).
1266
1267 @c TODO What else?
1268
1269 @c *********************************************************************
1270 @node Package Management
1271 @chapter Package Management
1272
1273 The purpose of GNU Guix is to allow users to easily install, upgrade, and
1274 remove software packages, without having to know about their build
1275 procedures or dependencies. Guix also goes beyond this obvious set of
1276 features.
1277
1278 This chapter describes the main features of Guix, as well as the package
1279 management tools it provides. Two user interfaces are provided for
1280 routine package management tasks: A command-line interface described below
1281 (@pxref{Invoking guix package, @code{guix package}}), as well as a visual user
1282 interface in Emacs described in a subsequent chapter (@pxref{Emacs Interface}).
1283
1284 @menu
1285 * Features:: How Guix will make your life brighter.
1286 * Invoking guix package:: Package installation, removal, etc.
1287 * Substitutes:: Downloading pre-built binaries.
1288 * Packages with Multiple Outputs:: Single source package, multiple outputs.
1289 * Invoking guix gc:: Running the garbage collector.
1290 * Invoking guix pull:: Fetching the latest Guix and distribution.
1291 * Invoking guix archive:: Exporting and importing store files.
1292 @end menu
1293
1294 @node Features
1295 @section Features
1296
1297 When using Guix, each package ends up in the @dfn{package store}, in its
1298 own directory---something that resembles
1299 @file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string
1300 (note that Guix comes with an Emacs extension to shorten those file
1301 names, @pxref{Emacs Prettify}.)
1302
1303 Instead of referring to these directories, users have their own
1304 @dfn{profile}, which points to the packages that they actually want to
1305 use. These profiles are stored within each user's home directory, at
1306 @code{$HOME/.guix-profile}.
1307
1308 For example, @code{alice} installs GCC 4.7.2. As a result,
1309 @file{/home/alice/.guix-profile/bin/gcc} points to
1310 @file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine,
1311 @code{bob} had already installed GCC 4.8.0. The profile of @code{bob}
1312 simply continues to point to
1313 @file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC
1314 coexist on the same system without any interference.
1315
1316 The @command{guix package} command is the central tool to manage
1317 packages (@pxref{Invoking guix package}). It operates on the per-user
1318 profiles, and can be used @emph{with normal user privileges}.
1319
1320 The command provides the obvious install, remove, and upgrade
1321 operations. Each invocation is actually a @emph{transaction}: either
1322 the specified operation succeeds, or nothing happens. Thus, if the
1323 @command{guix package} process is terminated during the transaction,
1324 or if a power outage occurs during the transaction, then the user's
1325 profile remains in its previous state, and remains usable.
1326
1327 In addition, any package transaction may be @emph{rolled back}. So, if,
1328 for example, an upgrade installs a new version of a package that turns
1329 out to have a serious bug, users may roll back to the previous instance
1330 of their profile, which was known to work well. Similarly, the global
1331 system configuration on GuixSD is subject to
1332 transactional upgrades and roll-back
1333 (@pxref{Using the Configuration System}).
1334
1335 All packages in the package store may be @emph{garbage-collected}.
1336 Guix can determine which packages are still referenced by user
1337 profiles, and remove those that are provably no longer referenced
1338 (@pxref{Invoking guix gc}). Users may also explicitly remove old
1339 generations of their profile so that the packages they refer to can be
1340 collected.
1341
1342 @cindex reproducibility
1343 @cindex reproducible builds
1344 Finally, Guix takes a @dfn{purely functional} approach to package
1345 management, as described in the introduction (@pxref{Introduction}).
1346 Each @file{/gnu/store} package directory name contains a hash of all the
1347 inputs that were used to build that package---compiler, libraries, build
1348 scripts, etc. This direct correspondence allows users to make sure a
1349 given package installation matches the current state of their
1350 distribution. It also helps maximize @dfn{build reproducibility}:
1351 thanks to the isolated build environments that are used, a given build
1352 is likely to yield bit-identical files when performed on different
1353 machines (@pxref{Invoking guix-daemon, container}).
1354
1355 @cindex substitutes
1356 This foundation allows Guix to support @dfn{transparent binary/source
1357 deployment}. When a pre-built binary for a @file{/gnu/store} item is
1358 available from an external source---a @dfn{substitute}, Guix just
1359 downloads it and unpacks it;
1360 otherwise, it builds the package from source, locally
1361 (@pxref{Substitutes}). Because build results are usually bit-for-bit
1362 reproducible, users do not have to trust servers that provide
1363 substitutes: they can force a local build and @emph{challenge} providers
1364 (@pxref{Invoking guix challenge}).
1365
1366 Control over the build environment is a feature that is also useful for
1367 developers. The @command{guix environment} command allows developers of
1368 a package to quickly set up the right development environment for their
1369 package, without having to manually install the dependencies of the
1370 package into their profile (@pxref{Invoking guix environment}).
1371
1372 @node Invoking guix package
1373 @section Invoking @command{guix package}
1374
1375 The @command{guix package} command is the tool that allows users to
1376 install, upgrade, and remove packages, as well as rolling back to
1377 previous configurations. It operates only on the user's own profile,
1378 and works with normal user privileges (@pxref{Features}). Its syntax
1379 is:
1380
1381 @example
1382 guix package @var{options}
1383 @end example
1384
1385 Primarily, @var{options} specifies the operations to be performed during
1386 the transaction. Upon completion, a new profile is created, but
1387 previous @dfn{generations} of the profile remain available, should the user
1388 want to roll back.
1389
1390 For example, to remove @code{lua} and install @code{guile} and
1391 @code{guile-cairo} in a single transaction:
1392
1393 @example
1394 guix package -r lua -i guile guile-cairo
1395 @end example
1396
1397 @command{guix package} also supports a @dfn{declarative approach}
1398 whereby the user specifies the exact set of packages to be available and
1399 passes it @i{via} the @option{--manifest} option
1400 (@pxref{profile-manifest, @option{--manifest}}).
1401
1402 For each user, a symlink to the user's default profile is automatically
1403 created in @file{$HOME/.guix-profile}. This symlink always points to the
1404 current generation of the user's default profile. Thus, users can add
1405 @file{$HOME/.guix-profile/bin} to their @code{PATH} environment
1406 variable, and so on.
1407 @cindex search paths
1408 If you are not using the Guix System Distribution, consider adding the
1409 following lines to your @file{~/.bash_profile} (@pxref{Bash Startup
1410 Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned
1411 shells get all the right environment variable definitions:
1412
1413 @example
1414 GUIX_PROFILE="$HOME/.guix-profile" \
1415 source "$HOME/.guix-profile/etc/profile"
1416 @end example
1417
1418 In a multi-user setup, user profiles are stored in a place registered as
1419 a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points
1420 to (@pxref{Invoking guix gc}). That directory is normally
1421 @code{@var{localstatedir}/profiles/per-user/@var{user}}, where
1422 @var{localstatedir} is the value passed to @code{configure} as
1423 @code{--localstatedir}, and @var{user} is the user name. The
1424 @file{per-user} directory is created when @command{guix-daemon} is
1425 started, and the @var{user} sub-directory is created by @command{guix
1426 package}.
1427
1428 The @var{options} can be among the following:
1429
1430 @table @code
1431
1432 @item --install=@var{package} @dots{}
1433 @itemx -i @var{package} @dots{}
1434 Install the specified @var{package}s.
1435
1436 Each @var{package} may specify either a simple package name, such as
1437 @code{guile}, or a package name followed by an at-sign and version number,
1438 such as @code{guile@@1.8.8} or simply @code{guile@@1.8} (in the latter
1439 case, the newest version prefixed by @code{1.8} is selected.)
1440
1441 If no version number is specified, the
1442 newest available version will be selected. In addition, @var{package}
1443 may contain a colon, followed by the name of one of the outputs of the
1444 package, as in @code{gcc:doc} or @code{binutils@@2.22:lib}
1445 (@pxref{Packages with Multiple Outputs}). Packages with a corresponding
1446 name (and optionally version) are searched for among the GNU
1447 distribution modules (@pxref{Package Modules}).
1448
1449 @cindex propagated inputs
1450 Sometimes packages have @dfn{propagated inputs}: these are dependencies
1451 that automatically get installed along with the required package
1452 (@pxref{package-propagated-inputs, @code{propagated-inputs} in
1453 @code{package} objects}, for information about propagated inputs in
1454 package definitions).
1455
1456 @anchor{package-cmd-propagated-inputs}
1457 An example is the GNU MPC library: its C header files refer to those of
1458 the GNU MPFR library, which in turn refer to those of the GMP library.
1459 Thus, when installing MPC, the MPFR and GMP libraries also get installed
1460 in the profile; removing MPC also removes MPFR and GMP---unless they had
1461 also been explicitly installed by the user.
1462
1463 Besides, packages sometimes rely on the definition of environment
1464 variables for their search paths (see explanation of
1465 @code{--search-paths} below). Any missing or possibly incorrect
1466 environment variable definitions are reported here.
1467
1468 @item --install-from-expression=@var{exp}
1469 @itemx -e @var{exp}
1470 Install the package @var{exp} evaluates to.
1471
1472 @var{exp} must be a Scheme expression that evaluates to a
1473 @code{<package>} object. This option is notably useful to disambiguate
1474 between same-named variants of a package, with expressions such as
1475 @code{(@@ (gnu packages base) guile-final)}.
1476
1477 Note that this option installs the first output of the specified
1478 package, which may be insufficient when needing a specific output of a
1479 multiple-output package.
1480
1481 @item --install-from-file=@var{file}
1482 @itemx -f @var{file}
1483 Install the package that the code within @var{file} evaluates to.
1484
1485 As an example, @var{file} might contain a definition like this
1486 (@pxref{Defining Packages}):
1487
1488 @example
1489 @verbatiminclude package-hello.scm
1490 @end example
1491
1492 Developers may find it useful to include such a @file{guix.scm} file
1493 in the root of their project source tree that can be used to test
1494 development snapshots and create reproducible development environments
1495 (@pxref{Invoking guix environment}).
1496
1497 @item --remove=@var{package} @dots{}
1498 @itemx -r @var{package} @dots{}
1499 Remove the specified @var{package}s.
1500
1501 As for @code{--install}, each @var{package} may specify a version number
1502 and/or output name in addition to the package name. For instance,
1503 @code{-r glibc:debug} would remove the @code{debug} output of
1504 @code{glibc}.
1505
1506 @item --upgrade[=@var{regexp} @dots{}]
1507 @itemx -u [@var{regexp} @dots{}]
1508 Upgrade all the installed packages. If one or more @var{regexp}s are
1509 specified, upgrade only installed packages whose name matches a
1510 @var{regexp}. Also see the @code{--do-not-upgrade} option below.
1511
1512 Note that this upgrades package to the latest version of packages found
1513 in the distribution currently installed. To update your distribution,
1514 you should regularly run @command{guix pull} (@pxref{Invoking guix
1515 pull}).
1516
1517 @item --do-not-upgrade[=@var{regexp} @dots{}]
1518 When used together with the @code{--upgrade} option, do @emph{not}
1519 upgrade any packages whose name matches a @var{regexp}. For example, to
1520 upgrade all packages in the current profile except those containing the
1521 substring ``emacs'':
1522
1523 @example
1524 $ guix package --upgrade . --do-not-upgrade emacs
1525 @end example
1526
1527 @item @anchor{profile-manifest}--manifest=@var{file}
1528 @itemx -m @var{file}
1529 @cindex profile declaration
1530 @cindex profile manifest
1531 Create a new generation of the profile from the manifest object
1532 returned by the Scheme code in @var{file}.
1533
1534 This allows you to @emph{declare} the profile's contents rather than
1535 constructing it through a sequence of @code{--install} and similar
1536 commands. The advantage is that @var{file} can be put under version
1537 control, copied to different machines to reproduce the same profile, and
1538 so on.
1539
1540 @c FIXME: Add reference to (guix profile) documentation when available.
1541 @var{file} must return a @dfn{manifest} object, which is roughly a list
1542 of packages:
1543
1544 @findex packages->manifest
1545 @example
1546 (use-package-modules guile emacs)
1547
1548 (packages->manifest
1549 (list emacs
1550 guile-2.0
1551 ;; Use a specific package output.
1552 (list guile-2.0 "debug")))
1553 @end example
1554
1555 @item --roll-back
1556 Roll back to the previous @dfn{generation} of the profile---i.e., undo
1557 the last transaction.
1558
1559 When combined with options such as @code{--install}, roll back occurs
1560 before any other actions.
1561
1562 When rolling back from the first generation that actually contains
1563 installed packages, the profile is made to point to the @dfn{zeroth
1564 generation}, which contains no files apart from its own metadata.
1565
1566 After having rolled back, installing, removing, or upgrading packages
1567 overwrites previous future generations. Thus, the history of the
1568 generations in a profile is always linear.
1569
1570 @item --switch-generation=@var{pattern}
1571 @itemx -S @var{pattern}
1572 Switch to a particular generation defined by @var{pattern}.
1573
1574 @var{pattern} may be either a generation number or a number prefixed
1575 with ``+'' or ``-''. The latter means: move forward/backward by a
1576 specified number of generations. For example, if you want to return to
1577 the latest generation after @code{--roll-back}, use
1578 @code{--switch-generation=+1}.
1579
1580 The difference between @code{--roll-back} and
1581 @code{--switch-generation=-1} is that @code{--switch-generation} will
1582 not make a zeroth generation, so if a specified generation does not
1583 exist, the current generation will not be changed.
1584
1585 @item --search-paths[=@var{kind}]
1586 @cindex search paths
1587 Report environment variable definitions, in Bash syntax, that may be
1588 needed in order to use the set of installed packages. These environment
1589 variables are used to specify @dfn{search paths} for files used by some
1590 of the installed packages.
1591
1592 For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
1593 environment variables to be defined so it can look for headers and
1594 libraries in the user's profile (@pxref{Environment Variables,,, gcc,
1595 Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C
1596 library are installed in the profile, then @code{--search-paths} will
1597 suggest setting these variables to @code{@var{profile}/include} and
1598 @code{@var{profile}/lib}, respectively.
1599
1600 The typical use case is to define these environment variables in the
1601 shell:
1602
1603 @example
1604 $ eval `guix package --search-paths`
1605 @end example
1606
1607 @var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix},
1608 meaning that the returned environment variable definitions will either
1609 be exact settings, or prefixes or suffixes of the current value of these
1610 variables. When omitted, @var{kind} defaults to @code{exact}.
1611
1612 This option can also be used to compute the @emph{combined} search paths
1613 of several profiles. Consider this example:
1614
1615 @example
1616 $ guix package -p foo -i guile
1617 $ guix package -p bar -i guile-json
1618 $ guix package -p foo -p bar --search-paths
1619 @end example
1620
1621 The last command above reports about the @code{GUILE_LOAD_PATH}
1622 variable, even though, taken individually, neither @file{foo} nor
1623 @file{bar} would lead to that recommendation.
1624
1625
1626 @item --profile=@var{profile}
1627 @itemx -p @var{profile}
1628 Use @var{profile} instead of the user's default profile.
1629
1630 @item --verbose
1631 Produce verbose output. In particular, emit the build log of the
1632 environment on the standard error port.
1633
1634 @item --bootstrap
1635 Use the bootstrap Guile to build the profile. This option is only
1636 useful to distribution developers.
1637
1638 @end table
1639
1640 In addition to these actions, @command{guix package} supports the
1641 following options to query the current state of a profile, or the
1642 availability of packages:
1643
1644 @table @option
1645
1646 @item --search=@var{regexp}
1647 @itemx -s @var{regexp}
1648 @cindex searching for packages
1649 List the available packages whose name, synopsis, or description matches
1650 @var{regexp}. Print all the metadata of matching packages in
1651 @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
1652 GNU recutils manual}).
1653
1654 This allows specific fields to be extracted using the @command{recsel}
1655 command, for instance:
1656
1657 @example
1658 $ guix package -s malloc | recsel -p name,version
1659 name: glibc
1660 version: 2.17
1661
1662 name: libgc
1663 version: 7.2alpha6
1664 @end example
1665
1666 Similarly, to show the name of all the packages available under the
1667 terms of the GNU@tie{}LGPL version 3:
1668
1669 @example
1670 $ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
1671 name: elfutils
1672
1673 name: gmp
1674 @dots{}
1675 @end example
1676
1677 It is also possible to refine search results using several @code{-s}
1678 flags. For example, the following command returns a list of board
1679 games:
1680
1681 @example
1682 $ guix package -s '\<board\>' -s game | recsel -p name
1683 name: gnubg
1684 @dots{}
1685 @end example
1686
1687 If we were to omit @code{-s game}, we would also get software packages
1688 that deal with printed circuit boards; removing the angle brackets
1689 around @code{board} would further add packages that have to do with
1690 keyboards.
1691
1692 And now for a more elaborate example. The following command searches
1693 for cryptographic libraries, filters out Haskell, Perl, Python, and Ruby
1694 libraries, and prints the name and synopsis of the matching packages:
1695
1696 @example
1697 $ guix package -s crypto -s library | \
1698 recsel -e '! (name ~ "^(ghc|perl|python|ruby)")' -p name,synopsis
1699 @end example
1700
1701 @noindent
1702 @xref{Selection Expressions,,, recutils, GNU recutils manual}, for more
1703 information on @dfn{selection expressions} for @code{recsel -e}.
1704
1705 @item --show=@var{package}
1706 Show details about @var{package}, taken from the list of available packages, in
1707 @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
1708 recutils manual}).
1709
1710 @example
1711 $ guix package --show=python | recsel -p name,version
1712 name: python
1713 version: 2.7.6
1714
1715 name: python
1716 version: 3.3.5
1717 @end example
1718
1719 You may also specify the full name of a package to only get details about a
1720 specific version of it:
1721 @example
1722 $ guix package --show=python@@3.4 | recsel -p name,version
1723 name: python
1724 version: 3.4.3
1725 @end example
1726
1727
1728
1729 @item --list-installed[=@var{regexp}]
1730 @itemx -I [@var{regexp}]
1731 List the currently installed packages in the specified profile, with the
1732 most recently installed packages shown last. When @var{regexp} is
1733 specified, list only installed packages whose name matches @var{regexp}.
1734
1735 For each installed package, print the following items, separated by
1736 tabs: the package name, its version string, the part of the package that
1737 is installed (for instance, @code{out} for the default output,
1738 @code{include} for its headers, etc.), and the path of this package in
1739 the store.
1740
1741 @item --list-available[=@var{regexp}]
1742 @itemx -A [@var{regexp}]
1743 List packages currently available in the distribution for this system
1744 (@pxref{GNU Distribution}). When @var{regexp} is specified, list only
1745 installed packages whose name matches @var{regexp}.
1746
1747 For each package, print the following items separated by tabs: its name,
1748 its version string, the parts of the package (@pxref{Packages with
1749 Multiple Outputs}), and the source location of its definition.
1750
1751 @item --list-generations[=@var{pattern}]
1752 @itemx -l [@var{pattern}]
1753 Return a list of generations along with their creation dates; for each
1754 generation, show the installed packages, with the most recently
1755 installed packages shown last. Note that the zeroth generation is never
1756 shown.
1757
1758 For each installed package, print the following items, separated by
1759 tabs: the name of a package, its version string, the part of the package
1760 that is installed (@pxref{Packages with Multiple Outputs}), and the
1761 location of this package in the store.
1762
1763 When @var{pattern} is used, the command returns only matching
1764 generations. Valid patterns include:
1765
1766 @itemize
1767 @item @emph{Integers and comma-separated integers}. Both patterns denote
1768 generation numbers. For instance, @code{--list-generations=1} returns
1769 the first one.
1770
1771 And @code{--list-generations=1,8,2} outputs three generations in the
1772 specified order. Neither spaces nor trailing commas are allowed.
1773
1774 @item @emph{Ranges}. @code{--list-generations=2..9} prints the
1775 specified generations and everything in between. Note that the start of
1776 a range must be smaller than its end.
1777
1778 It is also possible to omit the endpoint. For example,
1779 @code{--list-generations=2..}, returns all generations starting from the
1780 second one.
1781
1782 @item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks,
1783 or months by passing an integer along with the first letter of the
1784 duration. For example, @code{--list-generations=20d} lists generations
1785 that are up to 20 days old.
1786 @end itemize
1787
1788 @item --delete-generations[=@var{pattern}]
1789 @itemx -d [@var{pattern}]
1790 When @var{pattern} is omitted, delete all generations except the current
1791 one.
1792
1793 This command accepts the same patterns as @option{--list-generations}.
1794 When @var{pattern} is specified, delete the matching generations. When
1795 @var{pattern} specifies a duration, generations @emph{older} than the
1796 specified duration match. For instance, @code{--delete-generations=1m}
1797 deletes generations that are more than one month old.
1798
1799 If the current generation matches, it is @emph{not} deleted. Also, the
1800 zeroth generation is never deleted.
1801
1802 Note that deleting generations prevents rolling back to them.
1803 Consequently, this command must be used with care.
1804
1805 @end table
1806
1807 Finally, since @command{guix package} may actually start build
1808 processes, it supports all the common build options (@pxref{Common Build
1809 Options}). It also supports package transformation options, such as
1810 @option{--with-source} (@pxref{Package Transformation Options}).
1811 However, note that package transformations are lost when upgrading; to
1812 preserve transformations across upgrades, you should define your own
1813 package variant in a Guile module and add it to @code{GUIX_PACKAGE_PATH}
1814 (@pxref{Defining Packages}).
1815
1816
1817 @node Substitutes
1818 @section Substitutes
1819
1820 @cindex substitutes
1821 @cindex pre-built binaries
1822 Guix supports transparent source/binary deployment, which means that it
1823 can either build things locally, or download pre-built items from a
1824 server. We call these pre-built items @dfn{substitutes}---they are
1825 substitutes for local build results. In many cases, downloading a
1826 substitute is much faster than building things locally.
1827
1828 Substitutes can be anything resulting from a derivation build
1829 (@pxref{Derivations}). Of course, in the common case, they are
1830 pre-built package binaries, but source tarballs, for instance, which
1831 also result from derivation builds, can be available as substitutes.
1832
1833 The @code{hydra.gnu.org} server is a front-end to a build farm that
1834 builds packages from the GNU distribution continuously for some
1835 architectures, and makes them available as substitutes (@pxref{Emacs
1836 Hydra}, for information on how to query the continuous integration
1837 server). This is the
1838 default source of substitutes; it can be overridden by passing the
1839 @option{--substitute-urls} option either to @command{guix-daemon}
1840 (@pxref{daemon-substitute-urls,, @code{guix-daemon --substitute-urls}})
1841 or to client tools such as @command{guix package}
1842 (@pxref{client-substitute-urls,, client @option{--substitute-urls}
1843 option}).
1844
1845 Substitute URLs can be either HTTP or HTTPS@footnote{For HTTPS access,
1846 the Guile bindings of GnuTLS must be installed. @xref{Requirements}.}
1847 HTTPS is recommended because communications are encrypted; conversely,
1848 using HTTP makes all communications visible to an eavesdropper, who
1849 could use the information gathered to determine, for instance, whether
1850 your system has unpatched security vulnerabilities.
1851
1852 @cindex security
1853 @cindex digital signatures
1854 To allow Guix to download substitutes from @code{hydra.gnu.org} or a
1855 mirror thereof, you
1856 must add its public key to the access control list (ACL) of archive
1857 imports, using the @command{guix archive} command (@pxref{Invoking guix
1858 archive}). Doing so implies that you trust @code{hydra.gnu.org} to not
1859 be compromised and to serve genuine substitutes.
1860
1861 This public key is installed along with Guix, in
1862 @code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
1863 the installation prefix of Guix. If you installed Guix from source,
1864 make sure you checked the GPG signature of
1865 @file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
1866 Then, you can run something like this:
1867
1868 @example
1869 # guix archive --authorize < hydra.gnu.org.pub
1870 @end example
1871
1872 Once this is in place, the output of a command like @code{guix build}
1873 should change from something like:
1874
1875 @example
1876 $ guix build emacs --dry-run
1877 The following derivations would be built:
1878 /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
1879 /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
1880 /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
1881 /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
1882 @dots{}
1883 @end example
1884
1885 @noindent
1886 to something like:
1887
1888 @example
1889 $ guix build emacs --dry-run
1890 The following files would be downloaded:
1891 /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
1892 /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
1893 /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
1894 /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
1895 @dots{}
1896 @end example
1897
1898 @noindent
1899 This indicates that substitutes from @code{hydra.gnu.org} are usable and
1900 will be downloaded, when possible, for future builds.
1901
1902 Guix ignores substitutes that are not signed, or that are not signed by
1903 one of the keys listed in the ACL. It also detects and raises an error
1904 when attempting to use a substitute that has been tampered with.
1905
1906 @vindex http_proxy
1907 Substitutes are downloaded over HTTP or HTTPS.
1908 The @code{http_proxy} environment
1909 variable can be set in the environment of @command{guix-daemon} and is
1910 honored for downloads of substitutes. Note that the value of
1911 @code{http_proxy} in the environment where @command{guix build},
1912 @command{guix package}, and other client commands are run has
1913 @emph{absolutely no effect}.
1914
1915 When using HTTPS, the server's X.509 certificate is @emph{not} validated
1916 (in other words, the server is not authenticated), contrary to what
1917 HTTPS clients such as Web browsers usually do. This is because Guix
1918 authenticates substitute information itself, as explained above, which
1919 is what we care about (whereas X.509 certificates are about
1920 authenticating bindings between domain names and public keys.)
1921
1922 The substitute mechanism can be disabled globally by running
1923 @code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
1924 guix-daemon}). It can also be disabled temporarily by passing the
1925 @code{--no-substitutes} option to @command{guix package}, @command{guix
1926 build}, and other command-line tools.
1927
1928
1929 @unnumberedsubsec On Trusting Binaries
1930
1931 Today, each individual's control over their own computing is at the
1932 mercy of institutions, corporations, and groups with enough power and
1933 determination to subvert the computing infrastructure and exploit its
1934 weaknesses. While using @code{hydra.gnu.org} substitutes can be
1935 convenient, we encourage users to also build on their own, or even run
1936 their own build farm, such that @code{hydra.gnu.org} is less of an
1937 interesting target. One way to help is by publishing the software you
1938 build using @command{guix publish} so that others have one more choice
1939 of server to download substitutes from (@pxref{Invoking guix publish}).
1940
1941 Guix has the foundations to maximize build reproducibility
1942 (@pxref{Features}). In most cases, independent builds of a given
1943 package or derivation should yield bit-identical results. Thus, through
1944 a diverse set of independent package builds, we can strengthen the
1945 integrity of our systems. The @command{guix challenge} command aims to
1946 help users assess substitute servers, and to assist developers in
1947 finding out about non-deterministic package builds (@pxref{Invoking guix
1948 challenge}). Similarly, the @option{--check} option of @command{guix
1949 build} allows users to check whether previously-installed substitutes
1950 are genuine by rebuilding them locally (@pxref{build-check,
1951 @command{guix build --check}}).
1952
1953 In the future, we want Guix to have support to publish and retrieve
1954 binaries to/from other users, in a peer-to-peer fashion. If you would
1955 like to discuss this project, join us on @email{guix-devel@@gnu.org}.
1956
1957
1958 @node Packages with Multiple Outputs
1959 @section Packages with Multiple Outputs
1960
1961 @cindex multiple-output packages
1962 @cindex package outputs
1963
1964 Often, packages defined in Guix have a single @dfn{output}---i.e., the
1965 source package leads to exactly one directory in the store. When running
1966 @command{guix package -i glibc}, one installs the default output of the
1967 GNU libc package; the default output is called @code{out}, but its name
1968 can be omitted as shown in this command. In this particular case, the
1969 default output of @code{glibc} contains all the C header files, shared
1970 libraries, static libraries, Info documentation, and other supporting
1971 files.
1972
1973 Sometimes it is more appropriate to separate the various types of files
1974 produced from a single source package into separate outputs. For
1975 instance, the GLib C library (used by GTK+ and related packages)
1976 installs more than 20 MiB of reference documentation as HTML pages.
1977 To save space for users who do not need it, the documentation goes to a
1978 separate output, called @code{doc}. To install the main GLib output,
1979 which contains everything but the documentation, one would run:
1980
1981 @example
1982 guix package -i glib
1983 @end example
1984
1985 The command to install its documentation is:
1986
1987 @example
1988 guix package -i glib:doc
1989 @end example
1990
1991 Some packages install programs with different ``dependency footprints''.
1992 For instance, the WordNet package installs both command-line tools and
1993 graphical user interfaces (GUIs). The former depend solely on the C
1994 library, whereas the latter depend on Tcl/Tk and the underlying X
1995 libraries. In this case, we leave the command-line tools in the default
1996 output, whereas the GUIs are in a separate output. This allows users
1997 who do not need the GUIs to save space. The @command{guix size} command
1998 can help find out about such situations (@pxref{Invoking guix size}).
1999 @command{guix graph} can also be helpful (@pxref{Invoking guix graph}).
2000
2001 There are several such multiple-output packages in the GNU distribution.
2002 Other conventional output names include @code{lib} for libraries and
2003 possibly header files, @code{bin} for stand-alone programs, and
2004 @code{debug} for debugging information (@pxref{Installing Debugging
2005 Files}). The outputs of a packages are listed in the third column of
2006 the output of @command{guix package --list-available} (@pxref{Invoking
2007 guix package}).
2008
2009
2010 @node Invoking guix gc
2011 @section Invoking @command{guix gc}
2012
2013 @cindex garbage collector
2014 Packages that are installed, but not used, may be @dfn{garbage-collected}.
2015 The @command{guix gc} command allows users to explicitly run the garbage
2016 collector to reclaim space from the @file{/gnu/store} directory. It is
2017 the @emph{only} way to remove files from @file{/gnu/store}---removing
2018 files or directories manually may break it beyond repair!
2019
2020 The garbage collector has a set of known @dfn{roots}: any file under
2021 @file{/gnu/store} reachable from a root is considered @dfn{live} and
2022 cannot be deleted; any other file is considered @dfn{dead} and may be
2023 deleted. The set of garbage collector roots includes default user
2024 profiles, and may be augmented with @command{guix build --root}, for
2025 example (@pxref{Invoking guix build}).
2026
2027 Prior to running @code{guix gc --collect-garbage} to make space, it is
2028 often useful to remove old generations from user profiles; that way, old
2029 package builds referenced by those generations can be reclaimed. This
2030 is achieved by running @code{guix package --delete-generations}
2031 (@pxref{Invoking guix package}).
2032
2033 The @command{guix gc} command has three modes of operation: it can be
2034 used to garbage-collect any dead files (the default), to delete specific
2035 files (the @code{--delete} option), to print garbage-collector
2036 information, or for more advanced queries. The garbage collection
2037 options are as follows:
2038
2039 @table @code
2040 @item --collect-garbage[=@var{min}]
2041 @itemx -C [@var{min}]
2042 Collect garbage---i.e., unreachable @file{/gnu/store} files and
2043 sub-directories. This is the default operation when no option is
2044 specified.
2045
2046 When @var{min} is given, stop once @var{min} bytes have been collected.
2047 @var{min} may be a number of bytes, or it may include a unit as a
2048 suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
2049 (@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
2050
2051 When @var{min} is omitted, collect all the garbage.
2052
2053 @item --free-space=@var{free}
2054 @itemx -F @var{free}
2055 Collect garbage until @var{free} space is available under
2056 @file{/gnu/store}, if possible; @var{free} denotes storage space, such
2057 as @code{500MiB}, as described above.
2058
2059 When @var{free} or more is already available in @file{/gnu/store}, do
2060 nothing and exit immediately.
2061
2062 @item --delete
2063 @itemx -d
2064 Attempt to delete all the store files and directories specified as
2065 arguments. This fails if some of the files are not in the store, or if
2066 they are still live.
2067
2068 @item --list-failures
2069 List store items corresponding to cached build failures.
2070
2071 This prints nothing unless the daemon was started with
2072 @option{--cache-failures} (@pxref{Invoking guix-daemon,
2073 @option{--cache-failures}}).
2074
2075 @item --clear-failures
2076 Remove the specified store items from the failed-build cache.
2077
2078 Again, this option only makes sense when the daemon is started with
2079 @option{--cache-failures}. Otherwise, it does nothing.
2080
2081 @item --list-dead
2082 Show the list of dead files and directories still present in the
2083 store---i.e., files and directories no longer reachable from any root.
2084
2085 @item --list-live
2086 Show the list of live store files and directories.
2087
2088 @end table
2089
2090 In addition, the references among existing store files can be queried:
2091
2092 @table @code
2093
2094 @item --references
2095 @itemx --referrers
2096 List the references (respectively, the referrers) of store files given
2097 as arguments.
2098
2099 @item --requisites
2100 @itemx -R
2101 @cindex closure
2102 List the requisites of the store files passed as arguments. Requisites
2103 include the store files themselves, their references, and the references
2104 of these, recursively. In other words, the returned list is the
2105 @dfn{transitive closure} of the store files.
2106
2107 @xref{Invoking guix size}, for a tool to profile the size of the closure
2108 of an element. @xref{Invoking guix graph}, for a tool to visualize
2109 the graph of references.
2110
2111 @end table
2112
2113 Lastly, the following options allow you to check the integrity of the
2114 store and to control disk usage.
2115
2116 @table @option
2117
2118 @item --verify[=@var{options}]
2119 @cindex integrity, of the store
2120 @cindex integrity checking
2121 Verify the integrity of the store.
2122
2123 By default, make sure that all the store items marked as valid in the
2124 database of the daemon actually exist in @file{/gnu/store}.
2125
2126 When provided, @var{options} must be a comma-separated list containing one
2127 or more of @code{contents} and @code{repair}.
2128
2129 When passing @option{--verify=contents}, the daemon computes the
2130 content hash of each store item and compares it against its hash in the
2131 database. Hash mismatches are reported as data corruptions. Because it
2132 traverses @emph{all the files in the store}, this command can take a
2133 long time, especially on systems with a slow disk drive.
2134
2135 @cindex repairing the store
2136 Using @option{--verify=repair} or @option{--verify=contents,repair}
2137 causes the daemon to try to repair corrupt store items by fetching
2138 substitutes for them (@pxref{Substitutes}). Because repairing is not
2139 atomic, and thus potentially dangerous, it is available only to the
2140 system administrator.
2141
2142 @item --optimize
2143 @cindex deduplication
2144 Optimize the store by hard-linking identical files---this is
2145 @dfn{deduplication}.
2146
2147 The daemon performs deduplication after each successful build or archive
2148 import, unless it was started with @code{--disable-deduplication}
2149 (@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus,
2150 this option is primarily useful when the daemon was running with
2151 @code{--disable-deduplication}.
2152
2153 @end table
2154
2155 @node Invoking guix pull
2156 @section Invoking @command{guix pull}
2157
2158 Packages are installed or upgraded to the latest version available in
2159 the distribution currently available on your local machine. To update
2160 that distribution, along with the Guix tools, you must run @command{guix
2161 pull}: the command downloads the latest Guix source code and package
2162 descriptions, and deploys it.
2163
2164 On completion, @command{guix package} will use packages and package
2165 versions from this just-retrieved copy of Guix. Not only that, but all
2166 the Guix commands and Scheme modules will also be taken from that latest
2167 version. New @command{guix} sub-commands added by the update also
2168 become available.
2169
2170 Any user can update their Guix copy using @command{guix pull}, and the
2171 effect is limited to the user who run @command{guix pull}. For
2172 instance, when user @code{root} runs @command{guix pull}, this has no
2173 effect on the version of Guix that user @code{alice} sees, and vice
2174 versa@footnote{Under the hood, @command{guix pull} updates the
2175 @file{~/.config/guix/latest} symbolic link to point to the latest Guix,
2176 and the @command{guix} command loads code from there.}.
2177
2178 The @command{guix pull} command is usually invoked with no arguments,
2179 but it supports the following options:
2180
2181 @table @code
2182 @item --verbose
2183 Produce verbose output, writing build logs to the standard error output.
2184
2185 @item --url=@var{url}
2186 Download the source tarball of Guix from @var{url}.
2187
2188 By default, the tarball is taken from its canonical address at
2189 @code{gnu.org}, for the stable branch of Guix.
2190
2191 @item --bootstrap
2192 Use the bootstrap Guile to build the latest Guix. This option is only
2193 useful to Guix developers.
2194 @end table
2195
2196
2197 @node Invoking guix archive
2198 @section Invoking @command{guix archive}
2199
2200 The @command{guix archive} command allows users to @dfn{export} files
2201 from the store into a single archive, and to later @dfn{import} them.
2202 In particular, it allows store files to be transferred from one machine
2203 to the store on another machine.
2204
2205 To export store files as an archive to standard output, run:
2206
2207 @example
2208 guix archive --export @var{options} @var{specifications}...
2209 @end example
2210
2211 @var{specifications} may be either store file names or package
2212 specifications, as for @command{guix package} (@pxref{Invoking guix
2213 package}). For instance, the following command creates an archive
2214 containing the @code{gui} output of the @code{git} package and the main
2215 output of @code{emacs}:
2216
2217 @example
2218 guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
2219 @end example
2220
2221 If the specified packages are not built yet, @command{guix archive}
2222 automatically builds them. The build process may be controlled with the
2223 common build options (@pxref{Common Build Options}).
2224
2225 To transfer the @code{emacs} package to a machine connected over SSH,
2226 one would run:
2227
2228 @example
2229 guix archive --export -r emacs | ssh the-machine guix archive --import
2230 @end example
2231
2232 @noindent
2233 Similarly, a complete user profile may be transferred from one machine
2234 to another like this:
2235
2236 @example
2237 guix archive --export -r $(readlink -f ~/.guix-profile) | \
2238 ssh the-machine guix-archive --import
2239 @end example
2240
2241 @noindent
2242 However, note that, in both examples, all of @code{emacs} and the
2243 profile as well as all of their dependencies are transferred (due to
2244 @code{-r}), regardless of what is already available in the store on the
2245 target machine. The @code{--missing} option can help figure out which
2246 items are missing from the target store.
2247
2248 Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
2249 comparable in spirit to `tar', but with a few noteworthy differences
2250 that make it more appropriate for our purposes. First, rather than
2251 recording all Unix metadata for each file, the Nar format only mentions
2252 the file type (regular, directory, or symbolic link); Unix permissions
2253 and owner/group are dismissed. Second, the order in which directory
2254 entries are stored always follows the order of file names according to
2255 the C locale collation order. This makes archive production fully
2256 deterministic.
2257
2258 When exporting, the daemon digitally signs the contents of the archive,
2259 and that digital signature is appended. When importing, the daemon
2260 verifies the signature and rejects the import in case of an invalid
2261 signature or if the signing key is not authorized.
2262 @c FIXME: Add xref to daemon doc about signatures.
2263
2264 The main options are:
2265
2266 @table @code
2267 @item --export
2268 Export the specified store files or packages (see below.) Write the
2269 resulting archive to the standard output.
2270
2271 Dependencies are @emph{not} included in the output, unless
2272 @code{--recursive} is passed.
2273
2274 @item -r
2275 @itemx --recursive
2276 When combined with @code{--export}, this instructs @command{guix
2277 archive} to include dependencies of the given items in the archive.
2278 Thus, the resulting archive is self-contained: it contains the closure
2279 of the exported store items.
2280
2281 @item --import
2282 Read an archive from the standard input, and import the files listed
2283 therein into the store. Abort if the archive has an invalid digital
2284 signature, or if it is signed by a public key not among the authorized
2285 keys (see @code{--authorize} below.)
2286
2287 @item --missing
2288 Read a list of store file names from the standard input, one per line,
2289 and write on the standard output the subset of these files missing from
2290 the store.
2291
2292 @item --generate-key[=@var{parameters}]
2293 @cindex signing, archives
2294 Generate a new key pair for the daemon. This is a prerequisite before
2295 archives can be exported with @code{--export}. Note that this operation
2296 usually takes time, because it needs to gather enough entropy to
2297 generate the key pair.
2298
2299 The generated key pair is typically stored under @file{/etc/guix}, in
2300 @file{signing-key.pub} (public key) and @file{signing-key.sec} (private
2301 key, which must be kept secret.) When @var{parameters} is omitted,
2302 an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
2303 versions before 1.6.0, it is a 4096-bit RSA key.
2304 Alternatively, @var{parameters} can specify
2305 @code{genkey} parameters suitable for Libgcrypt (@pxref{General
2306 public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
2307 Libgcrypt Reference Manual}).
2308
2309 @item --authorize
2310 @cindex authorizing, archives
2311 Authorize imports signed by the public key passed on standard input.
2312 The public key must be in ``s-expression advanced format''---i.e., the
2313 same format as the @file{signing-key.pub} file.
2314
2315 The list of authorized keys is kept in the human-editable file
2316 @file{/etc/guix/acl}. The file contains
2317 @url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
2318 s-expressions''} and is structured as an access-control list in the
2319 @url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
2320 (SPKI)}.
2321
2322 @item --extract=@var{directory}
2323 @itemx -x @var{directory}
2324 Read a single-item archive as served by substitute servers
2325 (@pxref{Substitutes}) and extract it to @var{directory}. This is a
2326 low-level operation needed in only very narrow use cases; see below.
2327
2328 For example, the following command extracts the substitute for Emacs
2329 served by @code{hydra.gnu.org} to @file{/tmp/emacs}:
2330
2331 @example
2332 $ wget -O - \
2333 https://hydra.gnu.org/nar/@dots{}-emacs-24.5 \
2334 | bunzip2 | guix archive -x /tmp/emacs
2335 @end example
2336
2337 Single-item archives are different from multiple-item archives produced
2338 by @command{guix archive --export}; they contain a single store item,
2339 and they do @emph{not} embed a signature. Thus this operation does
2340 @emph{no} signature verification and its output should be considered
2341 unsafe.
2342
2343 The primary purpose of this operation is to facilitate inspection of
2344 archive contents coming from possibly untrusted substitute servers.
2345
2346 @end table
2347
2348 @c *********************************************************************
2349 @include emacs.texi
2350
2351 @c *********************************************************************
2352 @node Programming Interface
2353 @chapter Programming Interface
2354
2355 GNU Guix provides several Scheme programming interfaces (APIs) to
2356 define, build, and query packages. The first interface allows users to
2357 write high-level package definitions. These definitions refer to
2358 familiar packaging concepts, such as the name and version of a package,
2359 its build system, and its dependencies. These definitions can then be
2360 turned into concrete build actions.
2361
2362 Build actions are performed by the Guix daemon, on behalf of users. In a
2363 standard setup, the daemon has write access to the store---the
2364 @file{/gnu/store} directory---whereas users do not. The recommended
2365 setup also has the daemon perform builds in chroots, under a specific
2366 build users, to minimize interference with the rest of the system.
2367
2368 @cindex derivation
2369 Lower-level APIs are available to interact with the daemon and the
2370 store. To instruct the daemon to perform a build action, users actually
2371 provide it with a @dfn{derivation}. A derivation is a low-level
2372 representation of the build actions to be taken, and the environment in
2373 which they should occur---derivations are to package definitions what
2374 assembly is to C programs. The term ``derivation'' comes from the fact
2375 that build results @emph{derive} from them.
2376
2377 This chapter describes all these APIs in turn, starting from high-level
2378 package definitions.
2379
2380 @menu
2381 * Defining Packages:: Defining new packages.
2382 * Build Systems:: Specifying how packages are built.
2383 * The Store:: Manipulating the package store.
2384 * Derivations:: Low-level interface to package derivations.
2385 * The Store Monad:: Purely functional interface to the store.
2386 * G-Expressions:: Manipulating build expressions.
2387 @end menu
2388
2389 @node Defining Packages
2390 @section Defining Packages
2391
2392 The high-level interface to package definitions is implemented in the
2393 @code{(guix packages)} and @code{(guix build-system)} modules. As an
2394 example, the package definition, or @dfn{recipe}, for the GNU Hello
2395 package looks like this:
2396
2397 @example
2398 (define-module (gnu packages hello)
2399 #:use-module (guix packages)
2400 #:use-module (guix download)
2401 #:use-module (guix build-system gnu)
2402 #:use-module (guix licenses)
2403 #:use-module (gnu packages gawk))
2404
2405 (define-public hello
2406 (package
2407 (name "hello")
2408 (version "2.10")
2409 (source (origin
2410 (method url-fetch)
2411 (uri (string-append "mirror://gnu/hello/hello-" version
2412 ".tar.gz"))
2413 (sha256
2414 (base32
2415 "0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i"))))
2416 (build-system gnu-build-system)
2417 (arguments '(#:configure-flags '("--enable-silent-rules")))
2418 (inputs `(("gawk" ,gawk)))
2419 (synopsis "Hello, GNU world: An example GNU package")
2420 (description "Guess what GNU Hello prints!")
2421 (home-page "http://www.gnu.org/software/hello/")
2422 (license gpl3+)))
2423 @end example
2424
2425 @noindent
2426 Without being a Scheme expert, the reader may have guessed the meaning
2427 of the various fields here. This expression binds the variable
2428 @code{hello} to a @code{<package>} object, which is essentially a record
2429 (@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
2430 This package object can be inspected using procedures found in the
2431 @code{(guix packages)} module; for instance, @code{(package-name hello)}
2432 returns---surprise!---@code{"hello"}.
2433
2434 With luck, you may be able to import part or all of the definition of
2435 the package you are interested in from another repository, using the
2436 @code{guix import} command (@pxref{Invoking guix import}).
2437
2438 In the example above, @var{hello} is defined in a module of its own,
2439 @code{(gnu packages hello)}. Technically, this is not strictly
2440 necessary, but it is convenient to do so: all the packages defined in
2441 modules under @code{(gnu packages @dots{})} are automatically known to
2442 the command-line tools (@pxref{Package Modules}).
2443
2444 There are a few points worth noting in the above package definition:
2445
2446 @itemize
2447 @item
2448 The @code{source} field of the package is an @code{<origin>} object
2449 (@pxref{origin Reference}, for the complete reference).
2450 Here, the @code{url-fetch} method from @code{(guix download)} is used,
2451 meaning that the source is a file to be downloaded over FTP or HTTP.
2452
2453 The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
2454 the GNU mirrors defined in @code{(guix download)}.
2455
2456 The @code{sha256} field specifies the expected SHA256 hash of the file
2457 being downloaded. It is mandatory, and allows Guix to check the
2458 integrity of the file. The @code{(base32 @dots{})} form introduces the
2459 base32 representation of the hash. You can obtain this information with
2460 @code{guix download} (@pxref{Invoking guix download}) and @code{guix
2461 hash} (@pxref{Invoking guix hash}).
2462
2463 @cindex patches
2464 When needed, the @code{origin} form can also have a @code{patches} field
2465 listing patches to be applied, and a @code{snippet} field giving a
2466 Scheme expression to modify the source code.
2467
2468 @item
2469 @cindex GNU Build System
2470 The @code{build-system} field specifies the procedure to build the
2471 package (@pxref{Build Systems}). Here, @var{gnu-build-system}
2472 represents the familiar GNU Build System, where packages may be
2473 configured, built, and installed with the usual @code{./configure &&
2474 make && make check && make install} command sequence.
2475
2476 @item
2477 The @code{arguments} field specifies options for the build system
2478 (@pxref{Build Systems}). Here it is interpreted by
2479 @var{gnu-build-system} as a request run @file{configure} with the
2480 @code{--enable-silent-rules} flag.
2481
2482 @cindex quote
2483 @cindex quoting
2484 @findex '
2485 @findex quote
2486 What about these quote (@code{'}) characters? They are Scheme syntax to
2487 introduce a literal list; @code{'} is synonymous with @code{quote}.
2488 @xref{Expression Syntax, quoting,, guile, GNU Guile Reference Manual},
2489 for details. Here the value of the @code{arguments} field is a list of
2490 arguments passed to the build system down the road, as with @code{apply}
2491 (@pxref{Fly Evaluation, @code{apply},, guile, GNU Guile Reference
2492 Manual}).
2493
2494 The hash-colon (@code{#:}) sequence defines a Scheme @dfn{keyword}
2495 (@pxref{Keywords,,, guile, GNU Guile Reference Manual}), and
2496 @code{#:configure-flags} is a keyword used to pass a keyword argument
2497 to the build system (@pxref{Coding With Keywords,,, guile, GNU Guile
2498 Reference Manual}).
2499
2500 @item
2501 The @code{inputs} field specifies inputs to the build process---i.e.,
2502 build-time or run-time dependencies of the package. Here, we define an
2503 input called @code{"gawk"} whose value is that of the @var{gawk}
2504 variable; @var{gawk} is itself bound to a @code{<package>} object.
2505
2506 @cindex backquote (quasiquote)
2507 @findex `
2508 @findex quasiquote
2509 @cindex comma (unquote)
2510 @findex ,
2511 @findex unquote
2512 @findex ,@@
2513 @findex unquote-splicing
2514 Again, @code{`} (a backquote, synonymous with @code{quasiquote}) allows
2515 us to introduce a literal list in the @code{inputs} field, while
2516 @code{,} (a comma, synonymous with @code{unquote}) allows us to insert a
2517 value in that list (@pxref{Expression Syntax, unquote,, guile, GNU Guile
2518 Reference Manual}).
2519
2520 Note that GCC, Coreutils, Bash, and other essential tools do not need to
2521 be specified as inputs here. Instead, @var{gnu-build-system} takes care
2522 of ensuring that they are present (@pxref{Build Systems}).
2523
2524 However, any other dependencies need to be specified in the
2525 @code{inputs} field. Any dependency not specified here will simply be
2526 unavailable to the build process, possibly leading to a build failure.
2527 @end itemize
2528
2529 @xref{package Reference}, for a full description of possible fields.
2530
2531 Once a package definition is in place, the
2532 package may actually be built using the @code{guix build} command-line
2533 tool (@pxref{Invoking guix build}). You can easily jump back to the
2534 package definition using the @command{guix edit} command
2535 (@pxref{Invoking guix edit}).
2536 @xref{Packaging Guidelines}, for
2537 more information on how to test package definitions, and
2538 @ref{Invoking guix lint}, for information on how to check a definition
2539 for style conformance.
2540
2541 Finally, updating the package definition to a new upstream version
2542 can be partly automated by the @command{guix refresh} command
2543 (@pxref{Invoking guix refresh}).
2544
2545 Behind the scenes, a derivation corresponding to the @code{<package>}
2546 object is first computed by the @code{package-derivation} procedure.
2547 That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
2548 The build actions it prescribes may then be realized by using the
2549 @code{build-derivations} procedure (@pxref{The Store}).
2550
2551 @deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
2552 Return the @code{<derivation>} object of @var{package} for @var{system}
2553 (@pxref{Derivations}).
2554
2555 @var{package} must be a valid @code{<package>} object, and @var{system}
2556 must be a string denoting the target system type---e.g.,
2557 @code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store}
2558 must be a connection to the daemon, which operates on the store
2559 (@pxref{The Store}).
2560 @end deffn
2561
2562 @noindent
2563 @cindex cross-compilation
2564 Similarly, it is possible to compute a derivation that cross-builds a
2565 package for some other system:
2566
2567 @deffn {Scheme Procedure} package-cross-derivation @var{store} @
2568 @var{package} @var{target} [@var{system}]
2569 Return the @code{<derivation>} object of @var{package} cross-built from
2570 @var{system} to @var{target}.
2571
2572 @var{target} must be a valid GNU triplet denoting the target hardware
2573 and operating system, such as @code{"mips64el-linux-gnu"}
2574 (@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
2575 Configure and Build System}).
2576 @end deffn
2577
2578 @cindex package transformations
2579 @cindex input rewriting
2580 @cindex dependency tree rewriting
2581 Packages can be manipulated in arbitrary ways. An example of a useful
2582 transformation is @dfn{input rewriting}, whereby the dependency tree of
2583 a package is rewritten by replacing specific inputs by others:
2584
2585 @deffn {Scheme Procedure} package-input-rewriting @var{replacements} @
2586 [@var{rewrite-name}]
2587 Return a procedure that, when passed a package, replaces its direct and
2588 indirect dependencies (but not its implicit inputs) according to
2589 @var{replacements}. @var{replacements} is a list of package pairs; the
2590 first element of each pair is the package to replace, and the second one
2591 is the replacement.
2592
2593 Optionally, @var{rewrite-name} is a one-argument procedure that takes
2594 the name of a package and returns its new name after rewrite.
2595 @end deffn
2596
2597 @noindent
2598 Consider this example:
2599
2600 @example
2601 (define libressl-instead-of-openssl
2602 ;; This is a procedure to replace OPENSSL by LIBRESSL,
2603 ;; recursively.
2604 (package-input-rewriting `((,openssl . ,libressl))))
2605
2606 (define git-with-libressl
2607 (libressl-instead-of-openssl git))
2608 @end example
2609
2610 @noindent
2611 Here we first define a rewriting procedure that replaces @var{openssl}
2612 with @var{libressl}. Then we use it to define a @dfn{variant} of the
2613 @var{git} package that uses @var{libressl} instead of @var{openssl}.
2614 This is exactly what the @option{--with-input} command-line option does
2615 (@pxref{Package Transformation Options, @option{--with-input}}).
2616
2617 @menu
2618 * package Reference :: The package data type.
2619 * origin Reference:: The origin data type.
2620 @end menu
2621
2622
2623 @node package Reference
2624 @subsection @code{package} Reference
2625
2626 This section summarizes all the options available in @code{package}
2627 declarations (@pxref{Defining Packages}).
2628
2629 @deftp {Data Type} package
2630 This is the data type representing a package recipe.
2631
2632 @table @asis
2633 @item @code{name}
2634 The name of the package, as a string.
2635
2636 @item @code{version}
2637 The version of the package, as a string.
2638
2639 @item @code{source}
2640 An object telling how the source code for the package should be
2641 acquired. Most of the time, this is an @code{origin} object, which
2642 denotes a file fetched from the Internet (@pxref{origin Reference}). It
2643 can also be any other ``file-like'' object such as a @code{local-file},
2644 which denotes a file from the local file system (@pxref{G-Expressions,
2645 @code{local-file}}).
2646
2647 @item @code{build-system}
2648 The build system that should be used to build the package (@pxref{Build
2649 Systems}).
2650
2651 @item @code{arguments} (default: @code{'()})
2652 The arguments that should be passed to the build system. This is a
2653 list, typically containing sequential keyword-value pairs.
2654
2655 @item @code{inputs} (default: @code{'()})
2656 @itemx @code{native-inputs} (default: @code{'()})
2657 @itemx @code{propagated-inputs} (default: @code{'()})
2658 @cindex inputs, of packages
2659 These fields list dependencies of the package. Each one is a list of
2660 tuples, where each tuple has a label for the input (a string) as its
2661 first element, a package, origin, or derivation as its second element,
2662 and optionally the name of the output thereof that should be used, which
2663 defaults to @code{"out"} (@pxref{Packages with Multiple Outputs}, for
2664 more on package outputs). For example, the list below specifies three
2665 inputs:
2666
2667 @example
2668 `(("libffi" ,libffi)
2669 ("libunistring" ,libunistring)
2670 ("glib:bin" ,glib "bin")) ;the "bin" output of Glib
2671 @end example
2672
2673 @cindex cross compilation, package dependencies
2674 The distinction between @code{native-inputs} and @code{inputs} is
2675 necessary when considering cross-compilation. When cross-compiling,
2676 dependencies listed in @code{inputs} are built for the @emph{target}
2677 architecture; conversely, dependencies listed in @code{native-inputs}
2678 are built for the architecture of the @emph{build} machine.
2679
2680 @code{native-inputs} is typically used to list tools needed at
2681 build time, but not at run time, such as Autoconf, Automake, pkg-config,
2682 Gettext, or Bison. @command{guix lint} can report likely mistakes in
2683 this area (@pxref{Invoking guix lint}).
2684
2685 @anchor{package-propagated-inputs}
2686 Lastly, @code{propagated-inputs} is similar to @code{inputs}, but the
2687 specified packages will be automatically installed alongside the package
2688 they belong to (@pxref{package-cmd-propagated-inputs, @command{guix
2689 package}}, for information on how @command{guix package} deals with
2690 propagated inputs.)
2691
2692 For example this is necessary when a C/C++ library needs headers of
2693 another library to compile, or when a pkg-config file refers to another
2694 one @i{via} its @code{Requires} field.
2695
2696 Another example where @code{propagated-inputs} is useful is for languages
2697 that lack a facility to record the run-time search path akin to the
2698 @code{RUNPATH} of ELF files; this includes Guile, Python, Perl, GHC, and
2699 more. To ensure that libraries written in those languages can find
2700 library code they depend on at run time, run-time dependencies must be
2701 listed in @code{propagated-inputs} rather than @code{inputs}.
2702
2703 @item @code{self-native-input?} (default: @code{#f})
2704 This is a Boolean field telling whether the package should use itself as
2705 a native input when cross-compiling.
2706
2707 @item @code{outputs} (default: @code{'("out")})
2708 The list of output names of the package. @xref{Packages with Multiple
2709 Outputs}, for typical uses of additional outputs.
2710
2711 @item @code{native-search-paths} (default: @code{'()})
2712 @itemx @code{search-paths} (default: @code{'()})
2713 A list of @code{search-path-specification} objects describing
2714 search-path environment variables honored by the package.
2715
2716 @item @code{replacement} (default: @code{#f})
2717 This must be either @code{#f} or a package object that will be used as a
2718 @dfn{replacement} for this package. @xref{Security Updates, grafts},
2719 for details.
2720
2721 @item @code{synopsis}
2722 A one-line description of the package.
2723
2724 @item @code{description}
2725 A more elaborate description of the package.
2726
2727 @item @code{license}
2728 The license of the package; a value from @code{(guix licenses)},
2729 or a list of such values.
2730
2731 @item @code{home-page}
2732 The URL to the home-page of the package, as a string.
2733
2734 @item @code{supported-systems} (default: @var{%supported-systems})
2735 The list of systems supported by the package, as strings of the form
2736 @code{architecture-kernel}, for example @code{"x86_64-linux"}.
2737
2738 @item @code{maintainers} (default: @code{'()})
2739 The list of maintainers of the package, as @code{maintainer} objects.
2740
2741 @item @code{location} (default: source location of the @code{package} form)
2742 The source location of the package. It is useful to override this when
2743 inheriting from another package, in which case this field is not
2744 automatically corrected.
2745 @end table
2746 @end deftp
2747
2748
2749 @node origin Reference
2750 @subsection @code{origin} Reference
2751
2752 This section summarizes all the options available in @code{origin}
2753 declarations (@pxref{Defining Packages}).
2754
2755 @deftp {Data Type} origin
2756 This is the data type representing a source code origin.
2757
2758 @table @asis
2759 @item @code{uri}
2760 An object containing the URI of the source. The object type depends on
2761 the @code{method} (see below). For example, when using the
2762 @var{url-fetch} method of @code{(guix download)}, the valid @code{uri}
2763 values are: a URL represented as a string, or a list thereof.
2764
2765 @item @code{method}
2766 A procedure that handles the URI.
2767
2768 Examples include:
2769
2770 @table @asis
2771 @item @var{url-fetch} from @code{(guix download)}
2772 download a file from the HTTP, HTTPS, or FTP URL specified in the
2773 @code{uri} field;
2774
2775 @vindex git-fetch
2776 @item @var{git-fetch} from @code{(guix git-download)}
2777 clone the Git version control repository, and check out the revision
2778 specified in the @code{uri} field as a @code{git-reference} object; a
2779 @code{git-reference} looks like this:
2780
2781 @example
2782 (git-reference
2783 (url "git://git.debian.org/git/pkg-shadow/shadow")
2784 (commit "v4.1.5.1"))
2785 @end example
2786 @end table
2787
2788 @item @code{sha256}
2789 A bytevector containing the SHA-256 hash of the source. Typically the
2790 @code{base32} form is used here to generate the bytevector from a
2791 base-32 string.
2792
2793 You can obtain this information using @code{guix download}
2794 (@pxref{Invoking guix download}) or @code{guix hash} (@pxref{Invoking
2795 guix hash}).
2796
2797 @item @code{file-name} (default: @code{#f})
2798 The file name under which the source code should be saved. When this is
2799 @code{#f}, a sensible default value will be used in most cases. In case
2800 the source is fetched from a URL, the file name from the URL will be
2801 used. For version control checkouts, it is recommended to provide the
2802 file name explicitly because the default is not very descriptive.
2803
2804 @item @code{patches} (default: @code{'()})
2805 A list of file names containing patches to be applied to the source.
2806
2807 @item @code{snippet} (default: @code{#f})
2808 A G-expression (@pxref{G-Expressions}) or S-expression that will be run
2809 in the source directory. This is a convenient way to modify the source,
2810 sometimes more convenient than a patch.
2811
2812 @item @code{patch-flags} (default: @code{'("-p1")})
2813 A list of command-line flags that should be passed to the @code{patch}
2814 command.
2815
2816 @item @code{patch-inputs} (default: @code{#f})
2817 Input packages or derivations to the patching process. When this is
2818 @code{#f}, the usual set of inputs necessary for patching are provided,
2819 such as GNU@tie{}Patch.
2820
2821 @item @code{modules} (default: @code{'()})
2822 A list of Guile modules that should be loaded during the patching
2823 process and while running the code in the @code{snippet} field.
2824
2825 @item @code{patch-guile} (default: @code{#f})
2826 The Guile package that should be used in the patching process. When
2827 this is @code{#f}, a sensible default is used.
2828 @end table
2829 @end deftp
2830
2831
2832 @node Build Systems
2833 @section Build Systems
2834
2835 @cindex build system
2836 Each package definition specifies a @dfn{build system} and arguments for
2837 that build system (@pxref{Defining Packages}). This @code{build-system}
2838 field represents the build procedure of the package, as well as implicit
2839 dependencies of that build procedure.
2840
2841 Build systems are @code{<build-system>} objects. The interface to
2842 create and manipulate them is provided by the @code{(guix build-system)}
2843 module, and actual build systems are exported by specific modules.
2844
2845 @cindex bag (low-level package representation)
2846 Under the hood, build systems first compile package objects to
2847 @dfn{bags}. A @dfn{bag} is like a package, but with less
2848 ornamentation---in other words, a bag is a lower-level representation of
2849 a package, which includes all the inputs of that package, including some
2850 that were implicitly added by the build system. This intermediate
2851 representation is then compiled to a derivation (@pxref{Derivations}).
2852
2853 Build systems accept an optional list of @dfn{arguments}. In package
2854 definitions, these are passed @i{via} the @code{arguments} field
2855 (@pxref{Defining Packages}). They are typically keyword arguments
2856 (@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
2857 Guile Reference Manual}). The value of these arguments is usually
2858 evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
2859 by the daemon (@pxref{Derivations}).
2860
2861 The main build system is @var{gnu-build-system}, which implements the
2862 standard build procedure for GNU and many other packages. It
2863 is provided by the @code{(guix build-system gnu)} module.
2864
2865 @defvr {Scheme Variable} gnu-build-system
2866 @var{gnu-build-system} represents the GNU Build System, and variants
2867 thereof (@pxref{Configuration, configuration and makefile conventions,,
2868 standards, GNU Coding Standards}).
2869
2870 @cindex build phases
2871 In a nutshell, packages using it are configured, built, and installed with
2872 the usual @code{./configure && make && make check && make install}
2873 command sequence. In practice, a few additional steps are often needed.
2874 All these steps are split up in separate @dfn{phases},
2875 notably@footnote{Please see the @code{(guix build gnu-build-system)}
2876 modules for more details about the build phases.}:
2877
2878 @table @code
2879 @item unpack
2880 Unpack the source tarball, and change the current directory to the
2881 extracted source tree. If the source is actually a directory, copy it
2882 to the build tree, and enter that directory.
2883
2884 @item patch-source-shebangs
2885 Patch shebangs encountered in source files so they refer to the right
2886 store file names. For instance, this changes @code{#!/bin/sh} to
2887 @code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
2888
2889 @item configure
2890 Run the @file{configure} script with a number of default options, such
2891 as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
2892 by the @code{#:configure-flags} argument.
2893
2894 @item build
2895 Run @code{make} with the list of flags specified with
2896 @code{#:make-flags}. If the @code{#:parallel-build?} argument is true
2897 (the default), build with @code{make -j}.
2898
2899 @item check
2900 Run @code{make check}, or some other target specified with
2901 @code{#:test-target}, unless @code{#:tests? #f} is passed. If the
2902 @code{#:parallel-tests?} argument is true (the default), run @code{make
2903 check -j}.
2904
2905 @item install
2906 Run @code{make install} with the flags listed in @code{#:make-flags}.
2907
2908 @item patch-shebangs
2909 Patch shebangs on the installed executable files.
2910
2911 @item strip
2912 Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
2913 is false), copying them to the @code{debug} output when available
2914 (@pxref{Installing Debugging Files}).
2915 @end table
2916
2917 @vindex %standard-phases
2918 The build-side module @code{(guix build gnu-build-system)} defines
2919 @var{%standard-phases} as the default list of build phases.
2920 @var{%standard-phases} is a list of symbol/procedure pairs, where the
2921 procedure implements the actual phase.
2922
2923 The list of phases used for a particular package can be changed with the
2924 @code{#:phases} parameter. For instance, passing:
2925
2926 @example
2927 #:phases (modify-phases %standard-phases (delete 'configure))
2928 @end example
2929
2930 means that all the phases described above will be used, except the
2931 @code{configure} phase.
2932
2933 In addition, this build system ensures that the ``standard'' environment
2934 for GNU packages is available. This includes tools such as GCC, libc,
2935 Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
2936 build-system gnu)} module for a complete list). We call these the
2937 @dfn{implicit inputs} of a package, because package definitions do not
2938 have to mention them.
2939 @end defvr
2940
2941 Other @code{<build-system>} objects are defined to support other
2942 conventions and tools used by free software packages. They inherit most
2943 of @var{gnu-build-system}, and differ mainly in the set of inputs
2944 implicitly added to the build process, and in the list of phases
2945 executed. Some of these build systems are listed below.
2946
2947 @defvr {Scheme Variable} ant-build-system
2948 This variable is exported by @code{(guix build-system ant)}. It
2949 implements the build procedure for Java packages that can be built with
2950 @url{http://ant.apache.org/, Ant build tool}.
2951
2952 It adds both @code{ant} and the @dfn{Java Development Kit} (JDK) as
2953 provided by the @code{icedtea} package to the set of inputs. Different
2954 packages can be specified with the @code{#:ant} and @code{#:jdk}
2955 parameters, respectively.
2956
2957 When the original package does not provide a suitable Ant build file,
2958 the parameter @code{#:jar-name} can be used to generate a minimal Ant
2959 build file @file{build.xml} with tasks to build the specified jar
2960 archive.
2961
2962 The parameter @code{#:build-target} can be used to specify the Ant task
2963 that should be run during the @code{build} phase. By default the
2964 ``jar'' task will be run.
2965
2966 @end defvr
2967
2968 @defvr {Scheme Variable} cmake-build-system
2969 This variable is exported by @code{(guix build-system cmake)}. It
2970 implements the build procedure for packages using the
2971 @url{http://www.cmake.org, CMake build tool}.
2972
2973 It automatically adds the @code{cmake} package to the set of inputs.
2974 Which package is used can be specified with the @code{#:cmake}
2975 parameter.
2976
2977 The @code{#:configure-flags} parameter is taken as a list of flags
2978 passed to the @command{cmake} command. The @code{#:build-type}
2979 parameter specifies in abstract terms the flags passed to the compiler;
2980 it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
2981 debugging information''), which roughly means that code is compiled with
2982 @code{-O2 -g}, as is the case for Autoconf-based packages by default.
2983 @end defvr
2984
2985 @defvr {Scheme Variable} glib-or-gtk-build-system
2986 This variable is exported by @code{(guix build-system glib-or-gtk)}. It
2987 is intended for use with packages making use of GLib or GTK+.
2988
2989 This build system adds the following two phases to the ones defined by
2990 @var{gnu-build-system}:
2991
2992 @table @code
2993 @item glib-or-gtk-wrap
2994 The phase @code{glib-or-gtk-wrap} ensures that programs in
2995 @file{bin/} are able to find GLib ``schemas'' and
2996 @uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
2997 modules}. This is achieved by wrapping the programs in launch scripts
2998 that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
2999 environment variables.
3000
3001 It is possible to exclude specific package outputs from that wrapping
3002 process by listing their names in the
3003 @code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful
3004 when an output is known not to contain any GLib or GTK+ binaries, and
3005 where wrapping would gratuitously add a dependency of that output on
3006 GLib and GTK+.
3007
3008 @item glib-or-gtk-compile-schemas
3009 The phase @code{glib-or-gtk-compile-schemas} makes sure that all
3010 @uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
3011 GSettings schemas} of GLib are compiled. Compilation is performed by the
3012 @command{glib-compile-schemas} program. It is provided by the package
3013 @code{glib:bin} which is automatically imported by the build system.
3014 The @code{glib} package providing @command{glib-compile-schemas} can be
3015 specified with the @code{#:glib} parameter.
3016 @end table
3017
3018 Both phases are executed after the @code{install} phase.
3019 @end defvr
3020
3021 @defvr {Scheme Variable} python-build-system
3022 This variable is exported by @code{(guix build-system python)}. It
3023 implements the more or less standard build procedure used by Python
3024 packages, which consists in running @code{python setup.py build} and
3025 then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
3026
3027 For packages that install stand-alone Python programs under @code{bin/},
3028 it takes care of wrapping these programs so that their @code{PYTHONPATH}
3029 environment variable points to all the Python libraries they depend on.
3030
3031 Which Python package is used to perform the build can be specified with
3032 the @code{#:python} parameter. This is a useful way to force a package
3033 to be built for a specific version of the Python interpreter, which
3034 might be necessary if the package is only compatible with a single
3035 interpreter version.
3036 @end defvr
3037
3038 @defvr {Scheme Variable} perl-build-system
3039 This variable is exported by @code{(guix build-system perl)}. It
3040 implements the standard build procedure for Perl packages, which either
3041 consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
3042 followed by @code{Build} and @code{Build install}; or in running
3043 @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
3044 @code{make} and @code{make install}, depending on which of
3045 @code{Build.PL} or @code{Makefile.PL} is present in the package
3046 distribution. Preference is given to the former if both @code{Build.PL}
3047 and @code{Makefile.PL} exist in the package distribution. This
3048 preference can be reversed by specifying @code{#t} for the
3049 @code{#:make-maker?} parameter.
3050
3051 The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
3052 passes flags specified by the @code{#:make-maker-flags} or
3053 @code{#:module-build-flags} parameter, respectively.
3054
3055 Which Perl package is used can be specified with @code{#:perl}.
3056 @end defvr
3057
3058 @defvr {Scheme Variable} r-build-system
3059 This variable is exported by @code{(guix build-system r)}. It
3060 implements the build procedure used by @uref{http://r-project.org, R}
3061 packages, which essentially is little more than running @code{R CMD
3062 INSTALL --library=/gnu/store/@dots{}} in an environment where
3063 @code{R_LIBS_SITE} contains the paths to all R package inputs. Tests
3064 are run after installation using the R function
3065 @code{tools::testInstalledPackage}.
3066 @end defvr
3067
3068 @defvr {Scheme Variable} ruby-build-system
3069 This variable is exported by @code{(guix build-system ruby)}. It
3070 implements the RubyGems build procedure used by Ruby packages, which
3071 involves running @code{gem build} followed by @code{gem install}.
3072
3073 The @code{source} field of a package that uses this build system
3074 typically references a gem archive, since this is the format that Ruby
3075 developers use when releasing their software. The build system unpacks
3076 the gem archive, potentially patches the source, runs the test suite,
3077 repackages the gem, and installs it. Additionally, directories and
3078 tarballs may be referenced to allow building unreleased gems from Git or
3079 a traditional source release tarball.
3080
3081 Which Ruby package is used can be specified with the @code{#:ruby}
3082 parameter. A list of additional flags to be passed to the @command{gem}
3083 command can be specified with the @code{#:gem-flags} parameter.
3084 @end defvr
3085
3086 @defvr {Scheme Variable} waf-build-system
3087 This variable is exported by @code{(guix build-system waf)}. It
3088 implements a build procedure around the @code{waf} script. The common
3089 phases---@code{configure}, @code{build}, and @code{install}---are
3090 implemented by passing their names as arguments to the @code{waf}
3091 script.
3092
3093 The @code{waf} script is executed by the Python interpreter. Which
3094 Python package is used to run the script can be specified with the
3095 @code{#:python} parameter.
3096 @end defvr
3097
3098 @defvr {Scheme Variable} haskell-build-system
3099 This variable is exported by @code{(guix build-system haskell)}. It
3100 implements the Cabal build procedure used by Haskell packages, which
3101 involves running @code{runhaskell Setup.hs configure
3102 --prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}.
3103 Instead of installing the package by running @code{runhaskell Setup.hs
3104 install}, to avoid trying to register libraries in the read-only
3105 compiler store directory, the build system uses @code{runhaskell
3106 Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In
3107 addition, the build system generates the package documentation by
3108 running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f}
3109 is passed. Optional Haddock parameters can be passed with the help of
3110 the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is
3111 not found, the build system looks for @code{Setup.lhs} instead.
3112
3113 Which Haskell compiler is used can be specified with the @code{#:haskell}
3114 parameter which defaults to @code{ghc}.
3115 @end defvr
3116
3117 @defvr {Scheme Variable} emacs-build-system
3118 This variable is exported by @code{(guix build-system emacs)}. It
3119 implements an installation procedure similar to the packaging system
3120 of Emacs itself (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
3121
3122 It first creates the @code{@var{package}-autoloads.el} file, then it
3123 byte compiles all Emacs Lisp files. Differently from the Emacs
3124 packaging system, the Info documentation files are moved to the standard
3125 documentation directory and the @file{dir} file is deleted. Each
3126 package is installed in its own directory under
3127 @file{share/emacs/site-lisp/guix.d}.
3128 @end defvr
3129
3130 Lastly, for packages that do not need anything as sophisticated, a
3131 ``trivial'' build system is provided. It is trivial in the sense that
3132 it provides basically no support: it does not pull any implicit inputs,
3133 and does not have a notion of build phases.
3134
3135 @defvr {Scheme Variable} trivial-build-system
3136 This variable is exported by @code{(guix build-system trivial)}.
3137
3138 This build system requires a @code{#:builder} argument. This argument
3139 must be a Scheme expression that builds the package output(s)---as
3140 with @code{build-expression->derivation} (@pxref{Derivations,
3141 @code{build-expression->derivation}}).
3142 @end defvr
3143
3144 @node The Store
3145 @section The Store
3146
3147 @cindex store
3148 @cindex store items
3149 @cindex store paths
3150
3151 Conceptually, the @dfn{store} is the place where derivations that have
3152 been built successfully are stored---by default, @file{/gnu/store}.
3153 Sub-directories in the store are referred to as @dfn{store items} or
3154 sometimes @dfn{store paths}. The store has an associated database that
3155 contains information such as the store paths referred to by each store
3156 path, and the list of @emph{valid} store items---results of successful
3157 builds. This database resides in @file{@var{localstatedir}/guix/db},
3158 where @var{localstatedir} is the state directory specified @i{via}
3159 @option{--localstatedir} at configure time, usually @file{/var}.
3160
3161 The store is @emph{always} accessed by the daemon on behalf of its clients
3162 (@pxref{Invoking guix-daemon}). To manipulate the store, clients
3163 connect to the daemon over a Unix-domain socket, send requests to it,
3164 and read the result---these are remote procedure calls, or RPCs.
3165
3166 @quotation Note
3167 Users must @emph{never} modify files under @file{/gnu/store} directly.
3168 This would lead to inconsistencies and break the immutability
3169 assumptions of Guix's functional model (@pxref{Introduction}).
3170
3171 @xref{Invoking guix gc, @command{guix gc --verify}}, for information on
3172 how to check the integrity of the store and attempt recovery from
3173 accidental modifications.
3174 @end quotation
3175
3176 The @code{(guix store)} module provides procedures to connect to the
3177 daemon, and to perform RPCs. These are described below.
3178
3179 @deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]
3180 Connect to the daemon over the Unix-domain socket at @var{file}. When
3181 @var{reserve-space?} is true, instruct it to reserve a little bit of
3182 extra space on the file system so that the garbage collector can still
3183 operate should the disk become full. Return a server object.
3184
3185 @var{file} defaults to @var{%default-socket-path}, which is the normal
3186 location given the options that were passed to @command{configure}.
3187 @end deffn
3188
3189 @deffn {Scheme Procedure} close-connection @var{server}
3190 Close the connection to @var{server}.
3191 @end deffn
3192
3193 @defvr {Scheme Variable} current-build-output-port
3194 This variable is bound to a SRFI-39 parameter, which refers to the port
3195 where build and error logs sent by the daemon should be written.
3196 @end defvr
3197
3198 Procedures that make RPCs all take a server object as their first
3199 argument.
3200
3201 @deffn {Scheme Procedure} valid-path? @var{server} @var{path}
3202 @cindex invalid store items
3203 Return @code{#t} when @var{path} designates a valid store item and
3204 @code{#f} otherwise (an invalid item may exist on disk but still be
3205 invalid, for instance because it is the result of an aborted or failed
3206 build.)
3207
3208 A @code{&nix-protocol-error} condition is raised if @var{path} is not
3209 prefixed by the store directory (@file{/gnu/store}).
3210 @end deffn
3211
3212 @deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}]
3213 Add @var{text} under file @var{name} in the store, and return its store
3214 path. @var{references} is the list of store paths referred to by the
3215 resulting store path.
3216 @end deffn
3217
3218 @deffn {Scheme Procedure} build-derivations @var{server} @var{derivations}
3219 Build @var{derivations} (a list of @code{<derivation>} objects or
3220 derivation paths), and return when the worker is done building them.
3221 Return @code{#t} on success.
3222 @end deffn
3223
3224 Note that the @code{(guix monads)} module provides a monad as well as
3225 monadic versions of the above procedures, with the goal of making it
3226 more convenient to work with code that accesses the store (@pxref{The
3227 Store Monad}).
3228
3229 @c FIXME
3230 @i{This section is currently incomplete.}
3231
3232 @node Derivations
3233 @section Derivations
3234
3235 @cindex derivations
3236 Low-level build actions and the environment in which they are performed
3237 are represented by @dfn{derivations}. A derivation contains the
3238 following pieces of information:
3239
3240 @itemize
3241 @item
3242 The outputs of the derivation---derivations produce at least one file or
3243 directory in the store, but may produce more.
3244
3245 @item
3246 The inputs of the derivations, which may be other derivations or plain
3247 files in the store (patches, build scripts, etc.)
3248
3249 @item
3250 The system type targeted by the derivation---e.g., @code{x86_64-linux}.
3251
3252 @item
3253 The file name of a build script in the store, along with the arguments
3254 to be passed.
3255
3256 @item
3257 A list of environment variables to be defined.
3258
3259 @end itemize
3260
3261 @cindex derivation path
3262 Derivations allow clients of the daemon to communicate build actions to
3263 the store. They exist in two forms: as an in-memory representation,
3264 both on the client- and daemon-side, and as files in the store whose
3265 name end in @code{.drv}---these files are referred to as @dfn{derivation
3266 paths}. Derivations paths can be passed to the @code{build-derivations}
3267 procedure to perform the build actions they prescribe (@pxref{The
3268 Store}).
3269
3270 The @code{(guix derivations)} module provides a representation of
3271 derivations as Scheme objects, along with procedures to create and
3272 otherwise manipulate derivations. The lowest-level primitive to create
3273 a derivation is the @code{derivation} procedure:
3274
3275 @deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
3276 @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
3277 [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
3278 [#:system (%current-system)] [#:references-graphs #f] @
3279 [#:allowed-references #f] [#:disallowed-references #f] @
3280 [#:leaked-env-vars #f] [#:local-build? #f] @
3281 [#:substitutable? #t]
3282 Build a derivation with the given arguments, and return the resulting
3283 @code{<derivation>} object.
3284
3285 When @var{hash} and @var{hash-algo} are given, a
3286 @dfn{fixed-output derivation} is created---i.e., one whose result is
3287 known in advance, such as a file download. If, in addition,
3288 @var{recursive?} is true, then that fixed output may be an executable
3289 file or a directory and @var{hash} must be the hash of an archive
3290 containing this output.
3291
3292 When @var{references-graphs} is true, it must be a list of file
3293 name/store path pairs. In that case, the reference graph of each store
3294 path is exported in the build environment in the corresponding file, in
3295 a simple text format.
3296
3297 When @var{allowed-references} is true, it must be a list of store items
3298 or outputs that the derivation's output may refer to. Likewise,
3299 @var{disallowed-references}, if true, must be a list of things the
3300 outputs may @emph{not} refer to.
3301
3302 When @var{leaked-env-vars} is true, it must be a list of strings
3303 denoting environment variables that are allowed to ``leak'' from the
3304 daemon's environment to the build environment. This is only applicable
3305 to fixed-output derivations---i.e., when @var{hash} is true. The main
3306 use is to allow variables such as @code{http_proxy} to be passed to
3307 derivations that download files.
3308
3309 When @var{local-build?} is true, declare that the derivation is not a
3310 good candidate for offloading and should rather be built locally
3311 (@pxref{Daemon Offload Setup}). This is the case for small derivations
3312 where the costs of data transfers would outweigh the benefits.
3313
3314 When @var{substitutable?} is false, declare that substitutes of the
3315 derivation's output should not be used (@pxref{Substitutes}). This is
3316 useful, for instance, when building packages that capture details of the
3317 host CPU instruction set.
3318 @end deffn
3319
3320 @noindent
3321 Here's an example with a shell script as its builder, assuming
3322 @var{store} is an open connection to the daemon, and @var{bash} points
3323 to a Bash executable in the store:
3324
3325 @lisp
3326 (use-modules (guix utils)
3327 (guix store)
3328 (guix derivations))
3329
3330 (let ((builder ; add the Bash script to the store
3331 (add-text-to-store store "my-builder.sh"
3332 "echo hello world > $out\n" '())))
3333 (derivation store "foo"
3334 bash `("-e" ,builder)
3335 #:inputs `((,bash) (,builder))
3336 #:env-vars '(("HOME" . "/homeless"))))
3337 @result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
3338 @end lisp
3339
3340 As can be guessed, this primitive is cumbersome to use directly. A
3341 better approach is to write build scripts in Scheme, of course! The
3342 best course of action for that is to write the build code as a
3343 ``G-expression'', and to pass it to @code{gexp->derivation}. For more
3344 information, @pxref{G-Expressions}.
3345
3346 Once upon a time, @code{gexp->derivation} did not exist and constructing
3347 derivations with build code written in Scheme was achieved with
3348 @code{build-expression->derivation}, documented below. This procedure
3349 is now deprecated in favor of the much nicer @code{gexp->derivation}.
3350
3351 @deffn {Scheme Procedure} build-expression->derivation @var{store} @
3352 @var{name} @var{exp} @
3353 [#:system (%current-system)] [#:inputs '()] @
3354 [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
3355 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
3356 [#:references-graphs #f] [#:allowed-references #f] @
3357 [#:disallowed-references #f] @
3358 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
3359 Return a derivation that executes Scheme expression @var{exp} as a
3360 builder for derivation @var{name}. @var{inputs} must be a list of
3361 @code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
3362 @code{"out"} is assumed. @var{modules} is a list of names of Guile
3363 modules from the current search path to be copied in the store,
3364 compiled, and made available in the load path during the execution of
3365 @var{exp}---e.g., @code{((guix build utils) (guix build
3366 gnu-build-system))}.
3367
3368 @var{exp} is evaluated in an environment where @code{%outputs} is bound
3369 to a list of output/path pairs, and where @code{%build-inputs} is bound
3370 to a list of string/output-path pairs made from @var{inputs}.
3371 Optionally, @var{env-vars} is a list of string pairs specifying the name
3372 and value of environment variables visible to the builder. The builder
3373 terminates by passing the result of @var{exp} to @code{exit}; thus, when
3374 @var{exp} returns @code{#f}, the build is considered to have failed.
3375
3376 @var{exp} is built using @var{guile-for-build} (a derivation). When
3377 @var{guile-for-build} is omitted or is @code{#f}, the value of the
3378 @code{%guile-for-build} fluid is used instead.
3379
3380 See the @code{derivation} procedure for the meaning of
3381 @var{references-graphs}, @var{allowed-references},
3382 @var{disallowed-references}, @var{local-build?}, and
3383 @var{substitutable?}.
3384 @end deffn
3385
3386 @noindent
3387 Here's an example of a single-output derivation that creates a directory
3388 containing one file:
3389
3390 @lisp
3391 (let ((builder '(let ((out (assoc-ref %outputs "out")))
3392 (mkdir out) ; create /gnu/store/@dots{}-goo
3393 (call-with-output-file (string-append out "/test")
3394 (lambda (p)
3395 (display '(hello guix) p))))))
3396 (build-expression->derivation store "goo" builder))
3397
3398 @result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
3399 @end lisp
3400
3401
3402 @node The Store Monad
3403 @section The Store Monad
3404
3405 @cindex monad
3406
3407 The procedures that operate on the store described in the previous
3408 sections all take an open connection to the build daemon as their first
3409 argument. Although the underlying model is functional, they either have
3410 side effects or depend on the current state of the store.
3411
3412 The former is inconvenient: the connection to the build daemon has to be
3413 carried around in all those functions, making it impossible to compose
3414 functions that do not take that parameter with functions that do. The
3415 latter can be problematic: since store operations have side effects
3416 and/or depend on external state, they have to be properly sequenced.
3417
3418 @cindex monadic values
3419 @cindex monadic functions
3420 This is where the @code{(guix monads)} module comes in. This module
3421 provides a framework for working with @dfn{monads}, and a particularly
3422 useful monad for our uses, the @dfn{store monad}. Monads are a
3423 construct that allows two things: associating ``context'' with values
3424 (in our case, the context is the store), and building sequences of
3425 computations (here computations include accesses to the store). Values
3426 in a monad---values that carry this additional context---are called
3427 @dfn{monadic values}; procedures that return such values are called
3428 @dfn{monadic procedures}.
3429
3430 Consider this ``normal'' procedure:
3431
3432 @example
3433 (define (sh-symlink store)
3434 ;; Return a derivation that symlinks the 'bash' executable.
3435 (let* ((drv (package-derivation store bash))
3436 (out (derivation->output-path drv))
3437 (sh (string-append out "/bin/bash")))
3438 (build-expression->derivation store "sh"
3439 `(symlink ,sh %output))))
3440 @end example
3441
3442 Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten
3443 as a monadic function:
3444
3445 @example
3446 (define (sh-symlink)
3447 ;; Same, but return a monadic value.
3448 (mlet %store-monad ((drv (package->derivation bash)))
3449 (gexp->derivation "sh"
3450 #~(symlink (string-append #$drv "/bin/bash")
3451 #$output))))
3452 @end example
3453
3454 There are several things to note in the second version: the @code{store}
3455 parameter is now implicit and is ``threaded'' in the calls to the
3456 @code{package->derivation} and @code{gexp->derivation} monadic
3457 procedures, and the monadic value returned by @code{package->derivation}
3458 is @dfn{bound} using @code{mlet} instead of plain @code{let}.
3459
3460 As it turns out, the call to @code{package->derivation} can even be
3461 omitted since it will take place implicitly, as we will see later
3462 (@pxref{G-Expressions}):
3463
3464 @example
3465 (define (sh-symlink)
3466 (gexp->derivation "sh"
3467 #~(symlink (string-append #$bash "/bin/bash")
3468 #$output)))
3469 @end example
3470
3471 @c See
3472 @c <https://syntaxexclamation.wordpress.com/2014/06/26/escaping-continuations/>
3473 @c for the funny quote.
3474 Calling the monadic @code{sh-symlink} has no effect. As someone once
3475 said, ``you exit a monad like you exit a building on fire: by running''.
3476 So, to exit the monad and get the desired effect, one must use
3477 @code{run-with-store}:
3478
3479 @example
3480 (run-with-store (open-connection) (sh-symlink))
3481 @result{} /gnu/store/...-sh-symlink
3482 @end example
3483
3484 Note that the @code{(guix monad-repl)} module extends the Guile REPL with
3485 new ``meta-commands'' to make it easier to deal with monadic procedures:
3486 @code{run-in-store}, and @code{enter-store-monad}. The former is used
3487 to ``run'' a single monadic value through the store:
3488
3489 @example
3490 scheme@@(guile-user)> ,run-in-store (package->derivation hello)
3491 $1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
3492 @end example
3493
3494 The latter enters a recursive REPL, where all the return values are
3495 automatically run through the store:
3496
3497 @example
3498 scheme@@(guile-user)> ,enter-store-monad
3499 store-monad@@(guile-user) [1]> (package->derivation hello)
3500 $2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
3501 store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
3502 $3 = "/gnu/store/@dots{}-foo"
3503 store-monad@@(guile-user) [1]> ,q
3504 scheme@@(guile-user)>
3505 @end example
3506
3507 @noindent
3508 Note that non-monadic values cannot be returned in the
3509 @code{store-monad} REPL.
3510
3511 The main syntactic forms to deal with monads in general are provided by
3512 the @code{(guix monads)} module and are described below.
3513
3514 @deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
3515 Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
3516 in @var{monad}.
3517 @end deffn
3518
3519 @deffn {Scheme Syntax} return @var{val}
3520 Return a monadic value that encapsulates @var{val}.
3521 @end deffn
3522
3523 @deffn {Scheme Syntax} >>= @var{mval} @var{mproc} ...
3524 @dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
3525 procedures @var{mproc}@dots{}@footnote{This operation is commonly
3526 referred to as ``bind'', but that name denotes an unrelated procedure in
3527 Guile. Thus we use this somewhat cryptic symbol inherited from the
3528 Haskell language.}. There can be one @var{mproc} or several of them, as
3529 in this example:
3530
3531 @example
3532 (run-with-state
3533 (with-monad %state-monad
3534 (>>= (return 1)
3535 (lambda (x) (return (+ 1 x)))
3536 (lambda (x) (return (* 2 x)))))
3537 'some-state)
3538
3539 @result{} 4
3540 @result{} some-state
3541 @end example
3542 @end deffn
3543
3544 @deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
3545 @var{body} ...
3546 @deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
3547 @var{body} ...
3548 Bind the variables @var{var} to the monadic values @var{mval} in
3549 @var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the
3550 ``normal'' value @var{val}, as per @code{let}.
3551
3552 @code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
3553 (@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
3554 @end deffn
3555
3556 @deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
3557 Bind @var{mexp} and the following monadic expressions in sequence,
3558 returning the result of the last expression.
3559
3560 This is akin to @code{mlet}, except that the return values of the
3561 monadic expressions are ignored. In that sense, it is analogous to
3562 @code{begin}, but applied to monadic expressions.
3563 @end deffn
3564
3565 @cindex state monad
3566 The @code{(guix monads)} module provides the @dfn{state monad}, which
3567 allows an additional value---the state---to be @emph{threaded} through
3568 monadic procedure calls.
3569
3570 @defvr {Scheme Variable} %state-monad
3571 The state monad. Procedures in the state monad can access and change
3572 the state that is threaded.
3573
3574 Consider the example below. The @code{square} procedure returns a value
3575 in the state monad. It returns the square of its argument, but also
3576 increments the current state value:
3577
3578 @example
3579 (define (square x)
3580 (mlet %state-monad ((count (current-state)))
3581 (mbegin %state-monad
3582 (set-current-state (+ 1 count))
3583 (return (* x x)))))
3584
3585 (run-with-state (sequence %state-monad (map square (iota 3))) 0)
3586 @result{} (0 1 4)
3587 @result{} 3
3588 @end example
3589
3590 When ``run'' through @var{%state-monad}, we obtain that additional state
3591 value, which is the number of @code{square} calls.
3592 @end defvr
3593
3594 @deffn {Monadic Procedure} current-state
3595 Return the current state as a monadic value.
3596 @end deffn
3597
3598 @deffn {Monadic Procedure} set-current-state @var{value}
3599 Set the current state to @var{value} and return the previous state as a
3600 monadic value.
3601 @end deffn
3602
3603 @deffn {Monadic Procedure} state-push @var{value}
3604 Push @var{value} to the current state, which is assumed to be a list,
3605 and return the previous state as a monadic value.
3606 @end deffn
3607
3608 @deffn {Monadic Procedure} state-pop
3609 Pop a value from the current state and return it as a monadic value.
3610 The state is assumed to be a list.
3611 @end deffn
3612
3613 @deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
3614 Run monadic value @var{mval} starting with @var{state} as the initial
3615 state. Return two values: the resulting value, and the resulting state.
3616 @end deffn
3617
3618 The main interface to the store monad, provided by the @code{(guix
3619 store)} module, is as follows.
3620
3621 @defvr {Scheme Variable} %store-monad
3622 The store monad---an alias for @var{%state-monad}.
3623
3624 Values in the store monad encapsulate accesses to the store. When its
3625 effect is needed, a value of the store monad must be ``evaluated'' by
3626 passing it to the @code{run-with-store} procedure (see below.)
3627 @end defvr
3628
3629 @deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
3630 Run @var{mval}, a monadic value in the store monad, in @var{store}, an
3631 open store connection.
3632 @end deffn
3633
3634 @deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}]
3635 Return as a monadic value the absolute file name in the store of the file
3636 containing @var{text}, a string. @var{references} is a list of store items that the
3637 resulting text file refers to; it defaults to the empty list.
3638 @end deffn
3639
3640 @deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
3641 [#:recursive? #t] [#:select? (const #t)]
3642 Return the name of @var{file} once interned in the store. Use
3643 @var{name} as its store name, or the basename of @var{file} if
3644 @var{name} is omitted.
3645
3646 When @var{recursive?} is true, the contents of @var{file} are added
3647 recursively; if @var{file} designates a flat file and @var{recursive?}
3648 is true, its contents are added, and its permission bits are kept.
3649
3650 When @var{recursive?} is true, call @code{(@var{select?} @var{file}
3651 @var{stat})} for each directory entry, where @var{file} is the entry's
3652 absolute file name and @var{stat} is the result of @code{lstat}; exclude
3653 entries for which @var{select?} does not return true.
3654
3655 The example below adds a file to the store, under two different names:
3656
3657 @example
3658 (run-with-store (open-connection)
3659 (mlet %store-monad ((a (interned-file "README"))
3660 (b (interned-file "README" "LEGU-MIN")))
3661 (return (list a b))))
3662
3663 @result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
3664 @end example
3665
3666 @end deffn
3667
3668 The @code{(guix packages)} module exports the following package-related
3669 monadic procedures:
3670
3671 @deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
3672 [#:system (%current-system)] [#:target #f] @
3673 [#:output "out"]
3674 Return as a monadic
3675 value in the absolute file name of @var{file} within the @var{output}
3676 directory of @var{package}. When @var{file} is omitted, return the name
3677 of the @var{output} directory of @var{package}. When @var{target} is
3678 true, use it as a cross-compilation target triplet.
3679 @end deffn
3680
3681 @deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
3682 @deffnx {Monadic Procedure} package->cross-derivation @var{package} @
3683 @var{target} [@var{system}]
3684 Monadic version of @code{package-derivation} and
3685 @code{package-cross-derivation} (@pxref{Defining Packages}).
3686 @end deffn
3687
3688
3689 @node G-Expressions
3690 @section G-Expressions
3691
3692 @cindex G-expression
3693 @cindex build code quoting
3694 So we have ``derivations'', which represent a sequence of build actions
3695 to be performed to produce an item in the store (@pxref{Derivations}).
3696 These build actions are performed when asking the daemon to actually
3697 build the derivations; they are run by the daemon in a container
3698 (@pxref{Invoking guix-daemon}).
3699
3700 @cindex strata of code
3701 It should come as no surprise that we like to write these build actions
3702 in Scheme. When we do that, we end up with two @dfn{strata} of Scheme
3703 code@footnote{The term @dfn{stratum} in this context was coined by
3704 Manuel Serrano et al.@: in the context of their work on Hop. Oleg
3705 Kiselyov, who has written insightful
3706 @url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
3707 on this topic}, refers to this kind of code generation as
3708 @dfn{staging}.}: the ``host code''---code that defines packages, talks
3709 to the daemon, etc.---and the ``build code''---code that actually
3710 performs build actions, such as making directories, invoking
3711 @command{make}, etc.
3712
3713 To describe a derivation and its build actions, one typically needs to
3714 embed build code inside host code. It boils down to manipulating build
3715 code as data, and the homoiconicity of Scheme---code has a direct
3716 representation as data---comes in handy for that. But we need more than
3717 the normal @code{quasiquote} mechanism in Scheme to construct build
3718 expressions.
3719
3720 The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
3721 S-expressions adapted to build expressions. G-expressions, or
3722 @dfn{gexps}, consist essentially of three syntactic forms: @code{gexp},
3723 @code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
3724 @code{#$}, and @code{#$@@}), which are comparable to
3725 @code{quasiquote}, @code{unquote}, and @code{unquote-splicing},
3726 respectively (@pxref{Expression Syntax, @code{quasiquote},, guile,
3727 GNU Guile Reference Manual}). However, there are major differences:
3728
3729 @itemize
3730 @item
3731 Gexps are meant to be written to a file and run or manipulated by other
3732 processes.
3733
3734 @item
3735 When a high-level object such as a package or derivation is unquoted
3736 inside a gexp, the result is as if its output file name had been
3737 introduced.
3738
3739 @item
3740 Gexps carry information about the packages or derivations they refer to,
3741 and these dependencies are automatically added as inputs to the build
3742 processes that use them.
3743 @end itemize
3744
3745 @cindex lowering, of high-level objects in gexps
3746 This mechanism is not limited to package and derivation
3747 objects: @dfn{compilers} able to ``lower'' other high-level objects to
3748 derivations or files in the store can be defined,
3749 such that these objects can also be inserted
3750 into gexps. For example, a useful type of high-level objects that can be
3751 inserted in a gexp is ``file-like objects'', which make it easy to
3752 add files to the store and to refer to them in
3753 derivations and such (see @code{local-file} and @code{plain-file}
3754 below.)
3755
3756 To illustrate the idea, here is an example of a gexp:
3757
3758 @example
3759 (define build-exp
3760 #~(begin
3761 (mkdir #$output)
3762 (chdir #$output)
3763 (symlink (string-append #$coreutils "/bin/ls")
3764 "list-files")))
3765 @end example
3766
3767 This gexp can be passed to @code{gexp->derivation}; we obtain a
3768 derivation that builds a directory containing exactly one symlink to
3769 @file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
3770
3771 @example
3772 (gexp->derivation "the-thing" build-exp)
3773 @end example
3774
3775 As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
3776 substituted to the reference to the @var{coreutils} package in the
3777 actual build code, and @var{coreutils} is automatically made an input to
3778 the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp
3779 output)}) is replaced by a string containing the directory name of the
3780 output of the derivation.
3781
3782 @cindex cross compilation
3783 In a cross-compilation context, it is useful to distinguish between
3784 references to the @emph{native} build of a package---that can run on the
3785 host---versus references to cross builds of a package. To that end, the
3786 @code{#+} plays the same role as @code{#$}, but is a reference to a
3787 native package build:
3788
3789 @example
3790 (gexp->derivation "vi"
3791 #~(begin
3792 (mkdir #$output)
3793 (system* (string-append #+coreutils "/bin/ln")
3794 "-s"
3795 (string-append #$emacs "/bin/emacs")
3796 (string-append #$output "/bin/vi")))
3797 #:target "mips64el-linux")
3798 @end example
3799
3800 @noindent
3801 In the example above, the native build of @var{coreutils} is used, so
3802 that @command{ln} can actually run on the host; but then the
3803 cross-compiled build of @var{emacs} is referenced.
3804
3805 @cindex imported modules, for gexps
3806 @findex with-imported-modules
3807 Another gexp feature is @dfn{imported modules}: sometimes you want to be
3808 able to use certain Guile modules from the ``host environment'' in the
3809 gexp, so those modules should be imported in the ``build environment''.
3810 The @code{with-imported-modules} form allows you to express that:
3811
3812 @example
3813 (let ((build (with-imported-modules '((guix build utils))
3814 #~(begin
3815 (use-modules (guix build utils))
3816 (mkdir-p (string-append #$output "/bin"))))))
3817 (gexp->derivation "empty-dir"
3818 #~(begin
3819 #$build
3820 (display "success!\n")
3821 #t)))
3822 @end example
3823
3824 @noindent
3825 In this example, the @code{(guix build utils)} module is automatically
3826 pulled into the isolated build environment of our gexp, such that
3827 @code{(use-modules (guix build utils))} works as expected.
3828
3829 @cindex module closure
3830 @findex source-module-closure
3831 Usually you want the @emph{closure} of the module to be imported---i.e.,
3832 the module itself and all the modules it depends on---rather than just
3833 the module; failing to do that, attempts to use the module will fail
3834 because of missing dependent modules. The @code{source-module-closure}
3835 procedure computes the closure of a module by looking at its source file
3836 headers, which comes in handy in this case:
3837
3838 @example
3839 (use-modules (guix modules)) ;for 'source-module-closure'
3840
3841 (with-imported-modules (source-module-closure
3842 '((guix build utils)
3843 (gnu build vm)))
3844 (gexp->derivation "something-with-vms"
3845 #~(begin
3846 (use-modules (guix build utils)
3847 (gnu build vm))
3848 @dots{})))
3849 @end example
3850
3851 The syntactic form to construct gexps is summarized below.
3852
3853 @deffn {Scheme Syntax} #~@var{exp}
3854 @deffnx {Scheme Syntax} (gexp @var{exp})
3855 Return a G-expression containing @var{exp}. @var{exp} may contain one
3856 or more of the following forms:
3857
3858 @table @code
3859 @item #$@var{obj}
3860 @itemx (ungexp @var{obj})
3861 Introduce a reference to @var{obj}. @var{obj} may have one of the
3862 supported types, for example a package or a
3863 derivation, in which case the @code{ungexp} form is replaced by its
3864 output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
3865
3866 If @var{obj} is a list, it is traversed and references to supported
3867 objects are substituted similarly.
3868
3869 If @var{obj} is another gexp, its contents are inserted and its
3870 dependencies are added to those of the containing gexp.
3871
3872 If @var{obj} is another kind of object, it is inserted as is.
3873
3874 @item #$@var{obj}:@var{output}
3875 @itemx (ungexp @var{obj} @var{output})
3876 This is like the form above, but referring explicitly to the
3877 @var{output} of @var{obj}---this is useful when @var{obj} produces
3878 multiple outputs (@pxref{Packages with Multiple Outputs}).
3879
3880 @item #+@var{obj}
3881 @itemx #+@var{obj}:output
3882 @itemx (ungexp-native @var{obj})
3883 @itemx (ungexp-native @var{obj} @var{output})
3884 Same as @code{ungexp}, but produces a reference to the @emph{native}
3885 build of @var{obj} when used in a cross compilation context.
3886
3887 @item #$output[:@var{output}]
3888 @itemx (ungexp output [@var{output}])
3889 Insert a reference to derivation output @var{output}, or to the main
3890 output when @var{output} is omitted.
3891
3892 This only makes sense for gexps passed to @code{gexp->derivation}.
3893
3894 @item #$@@@var{lst}
3895 @itemx (ungexp-splicing @var{lst})
3896 Like the above, but splices the contents of @var{lst} inside the
3897 containing list.
3898
3899 @item #+@@@var{lst}
3900 @itemx (ungexp-native-splicing @var{lst})
3901 Like the above, but refers to native builds of the objects listed in
3902 @var{lst}.
3903
3904 @end table
3905
3906 G-expressions created by @code{gexp} or @code{#~} are run-time objects
3907 of the @code{gexp?} type (see below.)
3908 @end deffn
3909
3910 @deffn {Scheme Syntax} with-imported-modules @var{modules} @var{body}@dots{}
3911 Mark the gexps defined in @var{body}@dots{} as requiring @var{modules}
3912 in their execution environment. @var{modules} must be a list of Guile
3913 module names, such as @code{'((guix build utils) (guix build gremlin))}.
3914
3915 This form has @emph{lexical} scope: it has an effect on the gexps
3916 directly defined in @var{body}@dots{}, but not on those defined, say, in
3917 procedures called from @var{body}@dots{}.
3918 @end deffn
3919
3920 @deffn {Scheme Procedure} gexp? @var{obj}
3921 Return @code{#t} if @var{obj} is a G-expression.
3922 @end deffn
3923
3924 G-expressions are meant to be written to disk, either as code building
3925 some derivation, or as plain files in the store. The monadic procedures
3926 below allow you to do that (@pxref{The Store Monad}, for more
3927 information about monads.)
3928
3929 @deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
3930 [#:system (%current-system)] [#:target #f] [#:graft? #t] @
3931 [#:hash #f] [#:hash-algo #f] @
3932 [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
3933 [#:module-path @var{%load-path}] @
3934 [#:references-graphs #f] [#:allowed-references #f] @
3935 [#:disallowed-references #f] @
3936 [#:leaked-env-vars #f] @
3937 [#:script-name (string-append @var{name} "-builder")] @
3938 [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f]
3939 Return a derivation @var{name} that runs @var{exp} (a gexp) with
3940 @var{guile-for-build} (a derivation) on @var{system}; @var{exp} is
3941 stored in a file called @var{script-name}. When @var{target} is true,
3942 it is used as the cross-compilation target triplet for packages referred
3943 to by @var{exp}.
3944
3945 @var{modules} is deprecated in favor of @code{with-imported-modules}.
3946 Its meaning is to
3947 make @var{modules} available in the evaluation context of @var{exp};
3948 @var{modules} is a list of names of Guile modules searched in
3949 @var{module-path} to be copied in the store, compiled, and made available in
3950 the load path during the execution of @var{exp}---e.g., @code{((guix
3951 build utils) (guix build gnu-build-system))}.
3952
3953 @var{graft?} determines whether packages referred to by @var{exp} should be grafted when
3954 applicable.
3955
3956 When @var{references-graphs} is true, it must be a list of tuples of one of the
3957 following forms:
3958
3959 @example
3960 (@var{file-name} @var{package})
3961 (@var{file-name} @var{package} @var{output})
3962 (@var{file-name} @var{derivation})
3963 (@var{file-name} @var{derivation} @var{output})
3964 (@var{file-name} @var{store-item})
3965 @end example
3966
3967 The right-hand-side of each element of @var{references-graphs} is automatically made
3968 an input of the build process of @var{exp}. In the build environment, each
3969 @var{file-name} contains the reference graph of the corresponding item, in a simple
3970 text format.
3971
3972 @var{allowed-references} must be either @code{#f} or a list of output names and packages.
3973 In the latter case, the list denotes store items that the result is allowed to
3974 refer to. Any reference to another store item will lead to a build error.
3975 Similarly for @var{disallowed-references}, which can list items that must not be
3976 referenced by the outputs.
3977
3978 The other arguments are as for @code{derivation} (@pxref{Derivations}).
3979 @end deffn
3980
3981 @cindex file-like objects
3982 The @code{local-file}, @code{plain-file}, @code{computed-file},
3983 @code{program-file}, and @code{scheme-file} procedures below return
3984 @dfn{file-like objects}. That is, when unquoted in a G-expression,
3985 these objects lead to a file in the store. Consider this G-expression:
3986
3987 @example
3988 #~(system* #$(file-append glibc "/sbin/nscd") "-f"
3989 #$(local-file "/tmp/my-nscd.conf"))
3990 @end example
3991
3992 The effect here is to ``intern'' @file{/tmp/my-nscd.conf} by copying it
3993 to the store. Once expanded, for instance @i{via}
3994 @code{gexp->derivation}, the G-expression refers to that copy under
3995 @file{/gnu/store}; thus, modifying or removing the file in @file{/tmp}
3996 does not have any effect on what the G-expression does.
3997 @code{plain-file} can be used similarly; it differs in that the file
3998 content is directly passed as a string.
3999
4000 @deffn {Scheme Procedure} local-file @var{file} [@var{name}] @
4001 [#:recursive? #f] [#:select? (const #t)]
4002 Return an object representing local file @var{file} to add to the store; this
4003 object can be used in a gexp. If @var{file} is a relative file name, it is looked
4004 up relative to the source file where this form appears. @var{file} will be added to
4005 the store under @var{name}--by default the base name of @var{file}.
4006
4007 When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file}
4008 designates a flat file and @var{recursive?} is true, its contents are added, and its
4009 permission bits are kept.
4010
4011 When @var{recursive?} is true, call @code{(@var{select?} @var{file}
4012 @var{stat})} for each directory entry, where @var{file} is the entry's
4013 absolute file name and @var{stat} is the result of @code{lstat}; exclude
4014 entries for which @var{select?} does not return true.
4015
4016 This is the declarative counterpart of the @code{interned-file} monadic
4017 procedure (@pxref{The Store Monad, @code{interned-file}}).
4018 @end deffn
4019
4020 @deffn {Scheme Procedure} plain-file @var{name} @var{content}
4021 Return an object representing a text file called @var{name} with the given
4022 @var{content} (a string) to be added to the store.
4023
4024 This is the declarative counterpart of @code{text-file}.
4025 @end deffn
4026
4027 @deffn {Scheme Procedure} computed-file @var{name} @var{gexp} @
4028 [#:options '(#:local-build? #t)]
4029 Return an object representing the store item @var{name}, a file or
4030 directory computed by @var{gexp}. @var{options}
4031 is a list of additional arguments to pass to @code{gexp->derivation}.
4032
4033 This is the declarative counterpart of @code{gexp->derivation}.
4034 @end deffn
4035
4036 @deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
4037 Return an executable script @var{name} that runs @var{exp} using
4038 @var{guile}, with @var{exp}'s imported modules in its search path.
4039
4040 The example below builds a script that simply invokes the @command{ls}
4041 command:
4042
4043 @example
4044 (use-modules (guix gexp) (gnu packages base))
4045
4046 (gexp->script "list-files"
4047 #~(execl #$(file-append coreutils "/bin/ls")
4048 "ls"))
4049 @end example
4050
4051 When ``running'' it through the store (@pxref{The Store Monad,
4052 @code{run-with-store}}), we obtain a derivation that produces an
4053 executable file @file{/gnu/store/@dots{}-list-files} along these lines:
4054
4055 @example
4056 #!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
4057 !#
4058 (execl "/gnu/store/@dots{}-coreutils-8.22"/bin/ls" "ls")
4059 @end example
4060 @end deffn
4061
4062 @deffn {Scheme Procedure} program-file @var{name} @var{exp} @
4063 [#:guile #f]
4064 Return an object representing the executable store item @var{name} that
4065 runs @var{gexp}. @var{guile} is the Guile package used to execute that
4066 script.
4067
4068 This is the declarative counterpart of @code{gexp->script}.
4069 @end deffn
4070
4071 @deffn {Monadic Procedure} gexp->file @var{name} @var{exp} @
4072 [#:set-load-path? #t]
4073 Return a derivation that builds a file @var{name} containing @var{exp}.
4074 When @var{set-load-path?} is true, emit code in the resulting file to
4075 set @code{%load-path} and @code{%load-compiled-path} to honor
4076 @var{exp}'s imported modules.
4077
4078 The resulting file holds references to all the dependencies of @var{exp}
4079 or a subset thereof.
4080 @end deffn
4081
4082 @deffn {Scheme Procedure} scheme-file @var{name} @var{exp}
4083 Return an object representing the Scheme file @var{name} that contains
4084 @var{exp}.
4085
4086 This is the declarative counterpart of @code{gexp->file}.
4087 @end deffn
4088
4089 @deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
4090 Return as a monadic value a derivation that builds a text file
4091 containing all of @var{text}. @var{text} may list, in addition to
4092 strings, objects of any type that can be used in a gexp: packages,
4093 derivations, local file objects, etc. The resulting store file holds
4094 references to all these.
4095
4096 This variant should be preferred over @code{text-file} anytime the file
4097 to create will reference items from the store. This is typically the
4098 case when building a configuration file that embeds store file names,
4099 like this:
4100
4101 @example
4102 (define (profile.sh)
4103 ;; Return the name of a shell script in the store that
4104 ;; initializes the 'PATH' environment variable.
4105 (text-file* "profile.sh"
4106 "export PATH=" coreutils "/bin:"
4107 grep "/bin:" sed "/bin\n"))
4108 @end example
4109
4110 In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
4111 will reference @var{coreutils}, @var{grep}, and @var{sed}, thereby
4112 preventing them from being garbage-collected during its lifetime.
4113 @end deffn
4114
4115 @deffn {Scheme Procedure} mixed-text-file @var{name} @var{text} @dots{}
4116 Return an object representing store file @var{name} containing
4117 @var{text}. @var{text} is a sequence of strings and file-like objects,
4118 as in:
4119
4120 @example
4121 (mixed-text-file "profile"
4122 "export PATH=" coreutils "/bin:" grep "/bin")
4123 @end example
4124
4125 This is the declarative counterpart of @code{text-file*}.
4126 @end deffn
4127
4128 @deffn {Scheme Procedure} file-append @var{obj} @var{suffix} @dots{}
4129 Return a file-like object that expands to the concatenation of @var{obj}
4130 and @var{suffix}, where @var{obj} is a lowerable object and each
4131 @var{suffix} is a string.
4132
4133 As an example, consider this gexp:
4134
4135 @example
4136 (gexp->script "run-uname"
4137 #~(system* #$(file-append coreutils
4138 "/bin/uname")))
4139 @end example
4140
4141 The same effect could be achieved with:
4142
4143 @example
4144 (gexp->script "run-uname"
4145 #~(system* (string-append #$coreutils
4146 "/bin/uname")))
4147 @end example
4148
4149 There is one difference though: in the @code{file-append} case, the
4150 resulting script contains the absolute file name as a string, whereas in
4151 the second case, the resulting script contains a @code{(string-append
4152 @dots{})} expression to construct the file name @emph{at run time}.
4153 @end deffn
4154
4155
4156 Of course, in addition to gexps embedded in ``host'' code, there are
4157 also modules containing build tools. To make it clear that they are
4158 meant to be used in the build stratum, these modules are kept in the
4159 @code{(guix build @dots{})} name space.
4160
4161 @cindex lowering, of high-level objects in gexps
4162 Internally, high-level objects are @dfn{lowered}, using their compiler,
4163 to either derivations or store items. For instance, lowering a package
4164 yields a derivation, and lowering a @code{plain-file} yields a store
4165 item. This is achieved using the @code{lower-object} monadic procedure.
4166
4167 @deffn {Monadic Procedure} lower-object @var{obj} [@var{system}] @
4168 [#:target #f]
4169 Return as a value in @var{%store-monad} the derivation or store item
4170 corresponding to @var{obj} for @var{system}, cross-compiling for
4171 @var{target} if @var{target} is true. @var{obj} must be an object that
4172 has an associated gexp compiler, such as a @code{<package>}.
4173 @end deffn
4174
4175
4176 @c *********************************************************************
4177 @node Utilities
4178 @chapter Utilities
4179
4180 This section describes Guix command-line utilities. Some of them are
4181 primarily targeted at developers and users who write new package
4182 definitions, while others are more generally useful. They complement
4183 the Scheme programming interface of Guix in a convenient way.
4184
4185 @menu
4186 * Invoking guix build:: Building packages from the command line.
4187 * Invoking guix edit:: Editing package definitions.
4188 * Invoking guix download:: Downloading a file and printing its hash.
4189 * Invoking guix hash:: Computing the cryptographic hash of a file.
4190 * Invoking guix import:: Importing package definitions.
4191 * Invoking guix refresh:: Updating package definitions.
4192 * Invoking guix lint:: Finding errors in package definitions.
4193 * Invoking guix size:: Profiling disk usage.
4194 * Invoking guix graph:: Visualizing the graph of packages.
4195 * Invoking guix environment:: Setting up development environments.
4196 * Invoking guix publish:: Sharing substitutes.
4197 * Invoking guix challenge:: Challenging substitute servers.
4198 * Invoking guix container:: Process isolation.
4199 @end menu
4200
4201 @node Invoking guix build
4202 @section Invoking @command{guix build}
4203
4204 The @command{guix build} command builds packages or derivations and
4205 their dependencies, and prints the resulting store paths. Note that it
4206 does not modify the user's profile---this is the job of the
4207 @command{guix package} command (@pxref{Invoking guix package}). Thus,
4208 it is mainly useful for distribution developers.
4209
4210 The general syntax is:
4211
4212 @example
4213 guix build @var{options} @var{package-or-derivation}@dots{}
4214 @end example
4215
4216 As an example, the following command builds the latest versions of Emacs
4217 and of Guile, displays their build logs, and finally displays the
4218 resulting directories:
4219
4220 @example
4221 guix build emacs guile
4222 @end example
4223
4224 Similarly, the following command builds all the available packages:
4225
4226 @example
4227 guix build --quiet --keep-going \
4228 `guix package -A | cut -f1,2 --output-delimiter=@@`
4229 @end example
4230
4231 @var{package-or-derivation} may be either the name of a package found in
4232 the software distribution such as @code{coreutils} or
4233 @code{coreutils-8.20}, or a derivation such as
4234 @file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a
4235 package with the corresponding name (and optionally version) is searched
4236 for among the GNU distribution modules (@pxref{Package Modules}).
4237
4238 Alternatively, the @code{--expression} option may be used to specify a
4239 Scheme expression that evaluates to a package; this is useful when
4240 disambiguating among several same-named packages or package variants is
4241 needed.
4242
4243 There may be zero or more @var{options}. The available options are
4244 described in the subsections below.
4245
4246 @menu
4247 * Common Build Options:: Build options for most commands.
4248 * Package Transformation Options:: Creating variants of packages.
4249 * Additional Build Options:: Options specific to 'guix build'.
4250 @end menu
4251
4252 @node Common Build Options
4253 @subsection Common Build Options
4254
4255 A number of options that control the build process are common to
4256 @command{guix build} and other commands that can spawn builds, such as
4257 @command{guix package} or @command{guix archive}. These are the
4258 following:
4259
4260 @table @code
4261
4262 @item --load-path=@var{directory}
4263 @itemx -L @var{directory}
4264 Add @var{directory} to the front of the package module search path
4265 (@pxref{Package Modules}).
4266
4267 This allows users to define their own packages and make them visible to
4268 the command-line tools.
4269
4270 @item --keep-failed
4271 @itemx -K
4272 Keep the build tree of failed builds. Thus, if a build fails, its build
4273 tree is kept under @file{/tmp}, in a directory whose name is shown at
4274 the end of the build log. This is useful when debugging build issues.
4275
4276 @item --keep-going
4277 @itemx -k
4278 Keep going when some of the derivations fail to build; return only once
4279 all the builds have either completed or failed.
4280
4281 The default behavior is to stop as soon as one of the specified
4282 derivations has failed.
4283
4284 @item --dry-run
4285 @itemx -n
4286 Do not build the derivations.
4287
4288 @item --fallback
4289 When substituting a pre-built binary fails, fall back to building
4290 packages locally.
4291
4292 @item --substitute-urls=@var{urls}
4293 @anchor{client-substitute-urls}
4294 Consider @var{urls} the whitespace-separated list of substitute source
4295 URLs, overriding the default list of URLs of @command{guix-daemon}
4296 (@pxref{daemon-substitute-urls,, @command{guix-daemon} URLs}).
4297
4298 This means that substitutes may be downloaded from @var{urls}, provided
4299 they are signed by a key authorized by the system administrator
4300 (@pxref{Substitutes}).
4301
4302 When @var{urls} is the empty string, substitutes are effectively
4303 disabled.
4304
4305 @item --no-substitutes
4306 Do not use substitutes for build products. That is, always build things
4307 locally instead of allowing downloads of pre-built binaries
4308 (@pxref{Substitutes}).
4309
4310 @item --no-grafts
4311 Do not ``graft'' packages. In practice, this means that package updates
4312 available as grafts are not applied. @xref{Security Updates}, for more
4313 information on grafts.
4314
4315 @item --rounds=@var{n}
4316 Build each derivation @var{n} times in a row, and raise an error if
4317 consecutive build results are not bit-for-bit identical.
4318
4319 This is a useful way to detect non-deterministic builds processes.
4320 Non-deterministic build processes are a problem because they make it
4321 practically impossible for users to @emph{verify} whether third-party
4322 binaries are genuine. @xref{Invoking guix challenge}, for more.
4323
4324 Note that, currently, the differing build results are not kept around,
4325 so you will have to manually investigate in case of an error---e.g., by
4326 stashing one of the build results with @code{guix archive --export}
4327 (@pxref{Invoking guix archive}), then rebuilding, and finally comparing
4328 the two results.
4329
4330 @item --no-build-hook
4331 Do not attempt to offload builds @i{via} the ``build hook'' of the daemon
4332 (@pxref{Daemon Offload Setup}). That is, always build things locally
4333 instead of offloading builds to remote machines.
4334
4335 @item --max-silent-time=@var{seconds}
4336 When the build or substitution process remains silent for more than
4337 @var{seconds}, terminate it and report a build failure.
4338
4339 @item --timeout=@var{seconds}
4340 Likewise, when the build or substitution process lasts for more than
4341 @var{seconds}, terminate it and report a build failure.
4342
4343 By default there is no timeout. This behavior can be restored with
4344 @code{--timeout=0}.
4345
4346 @item --verbosity=@var{level}
4347 Use the given verbosity level. @var{level} must be an integer between 0
4348 and 5; higher means more verbose output. Setting a level of 4 or more
4349 may be helpful when debugging setup issues with the build daemon.
4350
4351 @item --cores=@var{n}
4352 @itemx -c @var{n}
4353 Allow the use of up to @var{n} CPU cores for the build. The special
4354 value @code{0} means to use as many CPU cores as available.
4355
4356 @item --max-jobs=@var{n}
4357 @itemx -M @var{n}
4358 Allow at most @var{n} build jobs in parallel. @xref{Invoking
4359 guix-daemon, @code{--max-jobs}}, for details about this option and the
4360 equivalent @command{guix-daemon} option.
4361
4362 @end table
4363
4364 Behind the scenes, @command{guix build} is essentially an interface to
4365 the @code{package-derivation} procedure of the @code{(guix packages)}
4366 module, and to the @code{build-derivations} procedure of the @code{(guix
4367 derivations)} module.
4368
4369 In addition to options explicitly passed on the command line,
4370 @command{guix build} and other @command{guix} commands that support
4371 building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
4372
4373 @defvr {Environment Variable} GUIX_BUILD_OPTIONS
4374 Users can define this variable to a list of command line options that
4375 will automatically be used by @command{guix build} and other
4376 @command{guix} commands that can perform builds, as in the example
4377 below:
4378
4379 @example
4380 $ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
4381 @end example
4382
4383 These options are parsed independently, and the result is appended to
4384 the parsed command-line options.
4385 @end defvr
4386
4387
4388 @node Package Transformation Options
4389 @subsection Package Transformation Options
4390
4391 @cindex package variants
4392 Another set of command-line options supported by @command{guix build}
4393 and also @command{guix package} are @dfn{package transformation
4394 options}. These are options that make it possible to define @dfn{package
4395 variants}---for instance, packages built from different source code.
4396 This is a convenient way to create customized packages on the fly
4397 without having to type in the definitions of package variants
4398 (@pxref{Defining Packages}).
4399
4400 @table @code
4401
4402 @item --with-source=@var{source}
4403 Use @var{source} as the source of the corresponding package.
4404 @var{source} must be a file name or a URL, as for @command{guix
4405 download} (@pxref{Invoking guix download}).
4406
4407 The ``corresponding package'' is taken to be the one specified on the
4408 command line the name of which matches the base of @var{source}---e.g.,
4409 if @var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
4410 package is @code{guile}. Likewise, the version string is inferred from
4411 @var{source}; in the previous example, it is @code{2.0.10}.
4412
4413 This option allows users to try out versions of packages other than the
4414 one provided by the distribution. The example below downloads
4415 @file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
4416 the @code{ed} package:
4417
4418 @example
4419 guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
4420 @end example
4421
4422 As a developer, @code{--with-source} makes it easy to test release
4423 candidates:
4424
4425 @example
4426 guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
4427 @end example
4428
4429 @dots{} or to build from a checkout in a pristine environment:
4430
4431 @example
4432 $ git clone git://git.sv.gnu.org/guix.git
4433 $ guix build guix --with-source=./guix
4434 @end example
4435
4436 @item --with-input=@var{package}=@var{replacement}
4437 Replace dependency on @var{package} by a dependency on
4438 @var{replacement}. @var{package} must be a package name, and
4439 @var{replacement} must be a package specification such as @code{guile}
4440 or @code{guile@@1.8}.
4441
4442 For instance, the following command builds Guix, but replaces its
4443 dependency on the current stable version of Guile with a dependency on
4444 the development version of Guile, @code{guile-next}:
4445
4446 @example
4447 guix build --with-input=guile=guile-next guix
4448 @end example
4449
4450 This is a recursive, deep replacement. So in this example, both
4451 @code{guix} and its dependency @code{guile-json} (which also depends on
4452 @code{guile}) get rebuilt against @code{guile-next}.
4453
4454 This is implemented using the @code{package-input-rewriting} Scheme
4455 procedure (@pxref{Defining Packages, @code{package-input-rewriting}}).
4456 @end table
4457
4458 @node Additional Build Options
4459 @subsection Additional Build Options
4460
4461 The command-line options presented below are specific to @command{guix
4462 build}.
4463
4464 @table @code
4465
4466 @item --quiet
4467 @itemx -q
4468 Build quietly, without displaying the build log. Upon completion, the
4469 build log is kept in @file{/var} (or similar) and can always be
4470 retrieved using the @option{--log-file} option.
4471
4472 @item --file=@var{file}
4473 @itemx -f @var{file}
4474
4475 Build the package or derivation that the code within @var{file}
4476 evaluates to.
4477
4478 As an example, @var{file} might contain a package definition like this
4479 (@pxref{Defining Packages}):
4480
4481 @example
4482 @verbatiminclude package-hello.scm
4483 @end example
4484
4485 @item --expression=@var{expr}
4486 @itemx -e @var{expr}
4487 Build the package or derivation @var{expr} evaluates to.
4488
4489 For example, @var{expr} may be @code{(@@ (gnu packages guile)
4490 guile-1.8)}, which unambiguously designates this specific variant of
4491 version 1.8 of Guile.
4492
4493 Alternatively, @var{expr} may be a G-expression, in which case it is used
4494 as a build program passed to @code{gexp->derivation}
4495 (@pxref{G-Expressions}).
4496
4497 Lastly, @var{expr} may refer to a zero-argument monadic procedure
4498 (@pxref{The Store Monad}). The procedure must return a derivation as a
4499 monadic value, which is then passed through @code{run-with-store}.
4500
4501 @item --source
4502 @itemx -S
4503 Build the source derivations of the packages, rather than the packages
4504 themselves.
4505
4506 For instance, @code{guix build -S gcc} returns something like
4507 @file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is the GCC
4508 source tarball.
4509
4510 The returned source tarball is the result of applying any patches and
4511 code snippets specified in the package @code{origin} (@pxref{Defining
4512 Packages}).
4513
4514 @item --sources
4515 Fetch and return the source of @var{package-or-derivation} and all their
4516 dependencies, recursively. This is a handy way to obtain a local copy
4517 of all the source code needed to build @var{packages}, allowing you to
4518 eventually build them even without network access. It is an extension
4519 of the @code{--source} option and can accept one of the following
4520 optional argument values:
4521
4522 @table @code
4523 @item package
4524 This value causes the @code{--sources} option to behave in the same way
4525 as the @code{--source} option.
4526
4527 @item all
4528 Build the source derivations of all packages, including any source that
4529 might be listed as @code{inputs}. This is the default value.
4530
4531 @example
4532 $ guix build --sources tzdata
4533 The following derivations will be built:
4534 /gnu/store/@dots{}-tzdata2015b.tar.gz.drv
4535 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
4536 @end example
4537
4538 @item transitive
4539 Build the source derivations of all packages, as well of all transitive
4540 inputs to the packages. This can be used e.g. to
4541 prefetch package source for later offline building.
4542
4543 @example
4544 $ guix build --sources=transitive tzdata
4545 The following derivations will be built:
4546 /gnu/store/@dots{}-tzcode2015b.tar.gz.drv
4547 /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv
4548 /gnu/store/@dots{}-grep-2.21.tar.xz.drv
4549 /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv
4550 /gnu/store/@dots{}-make-4.1.tar.xz.drv
4551 /gnu/store/@dots{}-bash-4.3.tar.xz.drv
4552 @dots{}
4553 @end example
4554
4555 @end table
4556
4557 @item --system=@var{system}
4558 @itemx -s @var{system}
4559 Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
4560 the system type of the build host.
4561
4562 An example use of this is on Linux-based systems, which can emulate
4563 different personalities. For instance, passing
4564 @code{--system=i686-linux} on an @code{x86_64-linux} system allows users
4565 to build packages in a complete 32-bit environment.
4566
4567 @item --target=@var{triplet}
4568 @cindex cross-compilation
4569 Cross-build for @var{triplet}, which must be a valid GNU triplet, such
4570 as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
4571 configuration triplets,, configure, GNU Configure and Build System}).
4572
4573 @anchor{build-check}
4574 @item --check
4575 @cindex determinism, checking
4576 @cindex reproducibility, checking
4577 Rebuild @var{package-or-derivation}, which are already available in the
4578 store, and raise an error if the build results are not bit-for-bit
4579 identical.
4580
4581 This mechanism allows you to check whether previously installed
4582 substitutes are genuine (@pxref{Substitutes}), or whether the build result
4583 of a package is deterministic. @xref{Invoking guix challenge}, for more
4584 background information and tools.
4585
4586 When used in conjunction with @option{--keep-failed}, the differing
4587 output is kept in the store, under @file{/gnu/store/@dots{}-check}.
4588 This makes it easy to look for differences between the two results.
4589
4590 @item --derivations
4591 @itemx -d
4592 Return the derivation paths, not the output paths, of the given
4593 packages.
4594
4595 @item --root=@var{file}
4596 @itemx -r @var{file}
4597 Make @var{file} a symlink to the result, and register it as a garbage
4598 collector root.
4599
4600 @item --log-file
4601 Return the build log file names or URLs for the given
4602 @var{package-or-derivation}, or raise an error if build logs are
4603 missing.
4604
4605 This works regardless of how packages or derivations are specified. For
4606 instance, the following invocations are equivalent:
4607
4608 @example
4609 guix build --log-file `guix build -d guile`
4610 guix build --log-file `guix build guile`
4611 guix build --log-file guile
4612 guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
4613 @end example
4614
4615 If a log is unavailable locally, and unless @code{--no-substitutes} is
4616 passed, the command looks for a corresponding log on one of the
4617 substitute servers (as specified with @code{--substitute-urls}.)
4618
4619 So for instance, imagine you want to see the build log of GDB on MIPS,
4620 but you are actually on an @code{x86_64} machine:
4621
4622 @example
4623 $ guix build --log-file gdb -s mips64el-linux
4624 https://hydra.gnu.org/log/@dots{}-gdb-7.10
4625 @end example
4626
4627 You can freely access a huge library of build logs!
4628 @end table
4629
4630
4631 @node Invoking guix edit
4632 @section Invoking @command{guix edit}
4633
4634 @cindex package definition, editing
4635 So many packages, so many source files! The @command{guix edit} command
4636 facilitates the life of users and packagers by pointing their editor at
4637 the source file containing the definition of the specified packages.
4638 For instance:
4639
4640 @example
4641 guix edit gcc@@4.9 vim
4642 @end example
4643
4644 @noindent
4645 launches the program specified in the @code{VISUAL} or in the
4646 @code{EDITOR} environment variable to view the recipe of GCC@tie{}4.9.3
4647 and that of Vim.
4648
4649 If you are using a Guix Git checkout (@pxref{Building from Git}), or
4650 have created your own packages on @code{GUIX_PACKAGE_PATH}
4651 (@pxref{Defining Packages}), you will be able to edit the package
4652 recipes. Otherwise, you will be able to examine the read-only recipes
4653 for packages currently in the store.
4654
4655 If you are using Emacs, note that the Emacs user interface provides the
4656 @kbd{M-x guix-edit} command and a similar functionality in the ``package
4657 info'' and ``package list'' buffers created by the @kbd{M-x
4658 guix-search-by-name} and similar commands (@pxref{Emacs Commands}).
4659
4660
4661 @node Invoking guix download
4662 @section Invoking @command{guix download}
4663
4664 When writing a package definition, developers typically need to download
4665 a source tarball, compute its SHA256 hash, and write that
4666 hash in the package definition (@pxref{Defining Packages}). The
4667 @command{guix download} tool helps with this task: it downloads a file
4668 from the given URI, adds it to the store, and prints both its file name
4669 in the store and its SHA256 hash.
4670
4671 The fact that the downloaded file is added to the store saves bandwidth:
4672 when the developer eventually tries to build the newly defined package
4673 with @command{guix build}, the source tarball will not have to be
4674 downloaded again because it is already in the store. It is also a
4675 convenient way to temporarily stash files, which may be deleted
4676 eventually (@pxref{Invoking guix gc}).
4677
4678 The @command{guix download} command supports the same URIs as used in
4679 package definitions. In particular, it supports @code{mirror://} URIs.
4680 @code{https} URIs (HTTP over TLS) are supported @emph{provided} the
4681 Guile bindings for GnuTLS are available in the user's environment; when
4682 they are not available, an error is raised. @xref{Guile Preparations,
4683 how to install the GnuTLS bindings for Guile,, gnutls-guile,
4684 GnuTLS-Guile}, for more information.
4685
4686 The following option is available:
4687
4688 @table @code
4689 @item --format=@var{fmt}
4690 @itemx -f @var{fmt}
4691 Write the hash in the format specified by @var{fmt}. For more
4692 information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
4693 @end table
4694
4695 @node Invoking guix hash
4696 @section Invoking @command{guix hash}
4697
4698 The @command{guix hash} command computes the SHA256 hash of a file.
4699 It is primarily a convenience tool for anyone contributing to the
4700 distribution: it computes the cryptographic hash of a file, which can be
4701 used in the definition of a package (@pxref{Defining Packages}).
4702
4703 The general syntax is:
4704
4705 @example
4706 guix hash @var{option} @var{file}
4707 @end example
4708
4709 @command{guix hash} has the following options:
4710
4711 @table @code
4712
4713 @item --format=@var{fmt}
4714 @itemx -f @var{fmt}
4715 Write the hash in the format specified by @var{fmt}.
4716
4717 Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
4718 (@code{hex} and @code{hexadecimal} can be used as well).
4719
4720 If the @option{--format} option is not specified, @command{guix hash}
4721 will output the hash in @code{nix-base32}. This representation is used
4722 in the definitions of packages.
4723
4724 @item --recursive
4725 @itemx -r
4726 Compute the hash on @var{file} recursively.
4727
4728 In this case, the hash is computed on an archive containing @var{file},
4729 including its children if it is a directory. Some of the metadata of
4730 @var{file} is part of the archive; for instance, when @var{file} is a
4731 regular file, the hash is different depending on whether @var{file} is
4732 executable or not. Metadata such as time stamps has no impact on the
4733 hash (@pxref{Invoking guix archive}).
4734 @c FIXME: Replace xref above with xref to an ``Archive'' section when
4735 @c it exists.
4736
4737 @item --exclude-vcs
4738 @itemx -x
4739 When combined with @option{--recursive}, exclude version control system
4740 directories (@file{.bzr}, @file{.git}, @file{.hg}, etc.)
4741
4742 @vindex git-fetch
4743 As an example, here is how you would compute the hash of a Git checkout,
4744 which is useful when using the @code{git-fetch} method (@pxref{origin
4745 Reference}):
4746
4747 @example
4748 $ git clone http://example.org/foo.git
4749 $ cd foo
4750 $ guix hash -rx .
4751 @end example
4752 @end table
4753
4754 @node Invoking guix import
4755 @section Invoking @command{guix import}
4756
4757 @cindex importing packages
4758 @cindex package import
4759 @cindex package conversion
4760 The @command{guix import} command is useful for people who would like to
4761 add a package to the distribution with as little work as
4762 possible---a legitimate demand. The command knows of a few
4763 repositories from which it can ``import'' package metadata. The result
4764 is a package definition, or a template thereof, in the format we know
4765 (@pxref{Defining Packages}).
4766
4767 The general syntax is:
4768
4769 @example
4770 guix import @var{importer} @var{options}@dots{}
4771 @end example
4772
4773 @var{importer} specifies the source from which to import package
4774 metadata, and @var{options} specifies a package identifier and other
4775 options specific to @var{importer}. Currently, the available
4776 ``importers'' are:
4777
4778 @table @code
4779 @item gnu
4780 Import metadata for the given GNU package. This provides a template
4781 for the latest version of that GNU package, including the hash of its
4782 source tarball, and its canonical synopsis and description.
4783
4784 Additional information such as the package dependencies and its
4785 license needs to be figured out manually.
4786
4787 For example, the following command returns a package definition for
4788 GNU@tie{}Hello:
4789
4790 @example
4791 guix import gnu hello
4792 @end example
4793
4794 Specific command-line options are:
4795
4796 @table @code
4797 @item --key-download=@var{policy}
4798 As for @code{guix refresh}, specify the policy to handle missing OpenPGP
4799 keys when verifying the package signature. @xref{Invoking guix
4800 refresh, @code{--key-download}}.
4801 @end table
4802
4803 @item pypi
4804 @cindex pypi
4805 Import metadata from the @uref{https://pypi.python.org/, Python Package
4806 Index}@footnote{This functionality requires Guile-JSON to be installed.
4807 @xref{Requirements}.}. Information is taken from the JSON-formatted
4808 description available at @code{pypi.python.org} and usually includes all
4809 the relevant information, including package dependencies. For maximum
4810 efficiency, it is recommended to install the @command{unzip} utility, so
4811 that the importer can unzip Python wheels and gather data from them.
4812
4813 The command below imports metadata for the @code{itsdangerous} Python
4814 package:
4815
4816 @example
4817 guix import pypi itsdangerous
4818 @end example
4819
4820 @item gem
4821 @cindex gem
4822 Import metadata from @uref{https://rubygems.org/,
4823 RubyGems}@footnote{This functionality requires Guile-JSON to be
4824 installed. @xref{Requirements}.}. Information is taken from the
4825 JSON-formatted description available at @code{rubygems.org} and includes
4826 most relevant information, including runtime dependencies. There are
4827 some caveats, however. The metadata doesn't distinguish between
4828 synopses and descriptions, so the same string is used for both fields.
4829 Additionally, the details of non-Ruby dependencies required to build
4830 native extensions is unavailable and left as an exercise to the
4831 packager.
4832
4833 The command below imports metadata for the @code{rails} Ruby package:
4834
4835 @example
4836 guix import gem rails
4837 @end example
4838
4839 @item cpan
4840 @cindex CPAN
4841 Import metadata from @uref{https://www.metacpan.org/, MetaCPAN}@footnote{This
4842 functionality requires Guile-JSON to be installed.
4843 @xref{Requirements}.}.
4844 Information is taken from the JSON-formatted metadata provided through
4845 @uref{https://api.metacpan.org/, MetaCPAN's API} and includes most
4846 relevant information, such as module dependencies. License information
4847 should be checked closely. If Perl is available in the store, then the
4848 @code{corelist} utility will be used to filter core modules out of the
4849 list of dependencies.
4850
4851 The command command below imports metadata for the @code{Acme::Boolean}
4852 Perl module:
4853
4854 @example
4855 guix import cpan Acme::Boolean
4856 @end example
4857
4858 @item cran
4859 @cindex CRAN
4860 @cindex Bioconductor
4861 Import metadata from @uref{http://cran.r-project.org/, CRAN}, the
4862 central repository for the @uref{http://r-project.org, GNU@tie{}R
4863 statistical and graphical environment}.
4864
4865 Information is extracted from the @code{DESCRIPTION} file of the package.
4866
4867 The command command below imports metadata for the @code{Cairo}
4868 R package:
4869
4870 @example
4871 guix import cran Cairo
4872 @end example
4873
4874 When @code{--archive=bioconductor} is added, metadata is imported from
4875 @uref{http://www.bioconductor.org/, Bioconductor}, a repository of R
4876 packages for for the analysis and comprehension of high-throughput
4877 genomic data in bioinformatics.
4878
4879 Information is extracted from the @code{DESCRIPTION} file of a package
4880 published on the web interface of the Bioconductor SVN repository.
4881
4882 The command below imports metadata for the @code{GenomicRanges}
4883 R package:
4884
4885 @example
4886 guix import cran --archive=bioconductor GenomicRanges
4887 @end example
4888
4889 @item nix
4890 Import metadata from a local copy of the source of the
4891 @uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This
4892 relies on the @command{nix-instantiate} command of
4893 @uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are
4894 typically written in a mixture of Nix-language and Bash code. This
4895 command only imports the high-level package structure that is written in
4896 the Nix language. It normally includes all the basic fields of a
4897 package definition.
4898
4899 When importing a GNU package, the synopsis and descriptions are replaced
4900 by their canonical upstream variant.
4901
4902 Usually, you will first need to do:
4903
4904 @example
4905 export NIX_REMOTE=daemon
4906 @end example
4907
4908 @noindent
4909 so that @command{nix-instantiate} does not try to open the Nix database.
4910
4911 As an example, the command below imports the package definition of
4912 LibreOffice (more precisely, it imports the definition of the package
4913 bound to the @code{libreoffice} top-level attribute):
4914
4915 @example
4916 guix import nix ~/path/to/nixpkgs libreoffice
4917 @end example
4918
4919 @item hackage
4920 @cindex hackage
4921 Import metadata from the Haskell community's central package archive
4922 @uref{https://hackage.haskell.org/, Hackage}. Information is taken from
4923 Cabal files and includes all the relevant information, including package
4924 dependencies.
4925
4926 Specific command-line options are:
4927
4928 @table @code
4929 @item --stdin
4930 @itemx -s
4931 Read a Cabal file from standard input.
4932 @item --no-test-dependencies
4933 @itemx -t
4934 Do not include dependencies required only by the test suites.
4935 @item --cabal-environment=@var{alist}
4936 @itemx -e @var{alist}
4937 @var{alist} is a Scheme alist defining the environment in which the
4938 Cabal conditionals are evaluated. The accepted keys are: @code{os},
4939 @code{arch}, @code{impl} and a string representing the name of a flag.
4940 The value associated with a flag has to be either the symbol
4941 @code{true} or @code{false}. The value associated with other keys
4942 has to conform to the Cabal file format definition. The default value
4943 associated with the keys @code{os}, @code{arch} and @code{impl} is
4944 @samp{linux}, @samp{x86_64} and @samp{ghc}, respectively.
4945 @end table
4946
4947 The command below imports metadata for the latest version of the
4948 @code{HTTP} Haskell package without including test dependencies and
4949 specifying the value of the flag @samp{network-uri} as @code{false}:
4950
4951 @example
4952 guix import hackage -t -e "'((\"network-uri\" . false))" HTTP
4953 @end example
4954
4955 A specific package version may optionally be specified by following the
4956 package name by an at-sign and a version number as in the following example:
4957
4958 @example
4959 guix import hackage mtl@@2.1.3.1
4960 @end example
4961
4962 @item elpa
4963 @cindex elpa
4964 Import metadata from an Emacs Lisp Package Archive (ELPA) package
4965 repository (@pxref{Packages,,, emacs, The GNU Emacs Manual}).
4966
4967 Specific command-line options are:
4968
4969 @table @code
4970 @item --archive=@var{repo}
4971 @itemx -a @var{repo}
4972 @var{repo} identifies the archive repository from which to retrieve the
4973 information. Currently the supported repositories and their identifiers
4974 are:
4975 @itemize -
4976 @item
4977 @uref{http://elpa.gnu.org/packages, GNU}, selected by the @code{gnu}
4978 identifier. This is the default.
4979
4980 @item
4981 @uref{http://stable.melpa.org/packages, MELPA-Stable}, selected by the
4982 @code{melpa-stable} identifier.
4983
4984 @item
4985 @uref{http://melpa.org/packages, MELPA}, selected by the @code{melpa}
4986 identifier.
4987 @end itemize
4988 @end table
4989 @end table
4990
4991 The structure of the @command{guix import} code is modular. It would be
4992 useful to have more importers for other package formats, and your help
4993 is welcome here (@pxref{Contributing}).
4994
4995 @node Invoking guix refresh
4996 @section Invoking @command{guix refresh}
4997
4998 The primary audience of the @command{guix refresh} command is developers
4999 of the GNU software distribution. By default, it reports any packages
5000 provided by the distribution that are outdated compared to the latest
5001 upstream version, like this:
5002
5003 @example
5004 $ guix refresh
5005 gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1
5006 gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0
5007 @end example
5008
5009 It does so by browsing the FTP directory of each package and determining
5010 the highest version number of the source tarballs therein. The command
5011 knows how to update specific types of packages: GNU packages, ELPA
5012 packages, etc.---see the documentation for @option{--type} below. The
5013 are many packages, though, for which it lacks a method to determine
5014 whether a new upstream release is available. However, the mechanism is
5015 extensible, so feel free to get in touch with us to add a new method!
5016
5017 When passed @code{--update}, it modifies distribution source files to
5018 update the version numbers and source tarball hashes of those package
5019 recipes (@pxref{Defining Packages}). This is achieved by downloading
5020 each package's latest source tarball and its associated OpenPGP
5021 signature, authenticating the downloaded tarball against its signature
5022 using @command{gpg}, and finally computing its hash. When the public
5023 key used to sign the tarball is missing from the user's keyring, an
5024 attempt is made to automatically retrieve it from a public key server;
5025 when this is successful, the key is added to the user's keyring; otherwise,
5026 @command{guix refresh} reports an error.
5027
5028 The following options are supported:
5029
5030 @table @code
5031
5032 @item --expression=@var{expr}
5033 @itemx -e @var{expr}
5034 Consider the package @var{expr} evaluates to.
5035
5036 This is useful to precisely refer to a package, as in this example:
5037
5038 @example
5039 guix refresh -l -e '(@@@@ (gnu packages commencement) glibc-final)'
5040 @end example
5041
5042 This command lists the dependents of the ``final'' libc (essentially all
5043 the packages.)
5044
5045 @item --update
5046 @itemx -u
5047 Update distribution source files (package recipes) in place. This is
5048 usually run from a checkout of the Guix source tree (@pxref{Running
5049 Guix Before It Is Installed}):
5050
5051 @example
5052 $ ./pre-inst-env guix refresh -s non-core
5053 @end example
5054
5055 @xref{Defining Packages}, for more information on package definitions.
5056
5057 @item --select=[@var{subset}]
5058 @itemx -s @var{subset}
5059 Select all the packages in @var{subset}, one of @code{core} or
5060 @code{non-core}.
5061
5062 The @code{core} subset refers to all the packages at the core of the
5063 distribution---i.e., packages that are used to build ``everything
5064 else''. This includes GCC, libc, Binutils, Bash, etc. Usually,
5065 changing one of these packages in the distribution entails a rebuild of
5066 all the others. Thus, such updates are an inconvenience to users in
5067 terms of build time or bandwidth used to achieve the upgrade.
5068
5069 The @code{non-core} subset refers to the remaining packages. It is
5070 typically useful in cases where an update of the core packages would be
5071 inconvenient.
5072
5073 @item --type=@var{updater}
5074 @itemx -t @var{updater}
5075 Select only packages handled by @var{updater} (may be a comma-separated
5076 list of updaters). Currently, @var{updater} may be one of:
5077
5078 @table @code
5079 @item gnu
5080 the updater for GNU packages;
5081 @item gnome
5082 the updater for GNOME packages;
5083 @item kde
5084 the updater for KDE packages;
5085 @item xorg
5086 the updater for X.org packages;
5087 @item elpa
5088 the updater for @uref{http://elpa.gnu.org/, ELPA} packages;
5089 @item cran
5090 the updater for @uref{http://cran.r-project.org/, CRAN} packages;
5091 @item bioconductor
5092 the updater for @uref{http://www.bioconductor.org/, Bioconductor} R packages;
5093 @item pypi
5094 the updater for @uref{https://pypi.python.org, PyPI} packages.
5095 @item gem
5096 the updater for @uref{https://rubygems.org, RubyGems} packages.
5097 @item github
5098 the updater for @uref{https://github.com, GitHub} packages.
5099 @item hackage
5100 the updater for @uref{https://hackage.haskell.org, Hackage} packages.
5101 @end table
5102
5103 For instance, the following command only checks for updates of Emacs
5104 packages hosted at @code{elpa.gnu.org} and for updates of CRAN packages:
5105
5106 @example
5107 $ guix refresh --type=elpa,cran
5108 gnu/packages/statistics.scm:819:13: r-testthat would be upgraded from 0.10.0 to 0.11.0
5109 gnu/packages/emacs.scm:856:13: emacs-auctex would be upgraded from 11.88.6 to 11.88.9
5110 @end example
5111
5112 @end table
5113
5114 In addition, @command{guix refresh} can be passed one or more package
5115 names, as in this example:
5116
5117 @example
5118 $ ./pre-inst-env guix refresh -u emacs idutils gcc-4.8.4
5119 @end example
5120
5121 @noindent
5122 The command above specifically updates the @code{emacs} and
5123 @code{idutils} packages. The @code{--select} option would have no
5124 effect in this case.
5125
5126 When considering whether to upgrade a package, it is sometimes
5127 convenient to know which packages would be affected by the upgrade and
5128 should be checked for compatibility. For this the following option may
5129 be used when passing @command{guix refresh} one or more package names:
5130
5131 @table @code
5132
5133 @item --list-updaters
5134 @itemx -L
5135 List available updaters and exit (see @option{--type} above.)
5136
5137 @item --list-dependent
5138 @itemx -l
5139 List top-level dependent packages that would need to be rebuilt as a
5140 result of upgrading one or more packages.
5141
5142 @end table
5143
5144 Be aware that the @code{--list-dependent} option only
5145 @emph{approximates} the rebuilds that would be required as a result of
5146 an upgrade. More rebuilds might be required under some circumstances.
5147
5148 @example
5149 $ guix refresh --list-dependent flex
5150 Building the following 120 packages would ensure 213 dependent packages are rebuilt:
5151 hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{}
5152 @end example
5153
5154 The command above lists a set of packages that could be built to check
5155 for compatibility with an upgraded @code{flex} package.
5156
5157 The following options can be used to customize GnuPG operation:
5158
5159 @table @code
5160
5161 @item --gpg=@var{command}
5162 Use @var{command} as the GnuPG 2.x command. @var{command} is searched
5163 for in @code{$PATH}.
5164
5165 @item --key-download=@var{policy}
5166 Handle missing OpenPGP keys according to @var{policy}, which may be one
5167 of:
5168
5169 @table @code
5170 @item always
5171 Always download missing OpenPGP keys from the key server, and add them
5172 to the user's GnuPG keyring.
5173
5174 @item never
5175 Never try to download missing OpenPGP keys. Instead just bail out.
5176
5177 @item interactive
5178 When a package signed with an unknown OpenPGP key is encountered, ask
5179 the user whether to download it or not. This is the default behavior.
5180 @end table
5181
5182 @item --key-server=@var{host}
5183 Use @var{host} as the OpenPGP key server when importing a public key.
5184
5185 @end table
5186
5187 The @code{github} updater uses the
5188 @uref{https://developer.github.com/v3/, GitHub API} to query for new
5189 releases. When used repeatedly e.g. when refreshing all packages,
5190 GitHub will eventually refuse to answer any further API requests. By
5191 default 60 API requests per hour are allowed, and a full refresh on all
5192 GitHub packages in Guix requires more than this. Authentication with
5193 GitHub through the use of an API token alleviates these limits. To use
5194 an API token, set the environment variable @code{GUIX_GITHUB_TOKEN} to a
5195 token procured from @uref{https://github.com/settings/tokens} or
5196 otherwise.
5197
5198
5199 @node Invoking guix lint
5200 @section Invoking @command{guix lint}
5201 The @command{guix lint} command is meant to help package developers avoid
5202 common errors and use a consistent style. It runs a number of checks on
5203 a given set of packages in order to find common mistakes in their
5204 definitions. Available @dfn{checkers} include (see
5205 @code{--list-checkers} for a complete list):
5206
5207 @table @code
5208 @item synopsis
5209 @itemx description
5210 Validate certain typographical and stylistic rules about package
5211 descriptions and synopses.
5212
5213 @item inputs-should-be-native
5214 Identify inputs that should most likely be native inputs.
5215
5216 @item source
5217 @itemx home-page
5218 @itemx source-file-name
5219 Probe @code{home-page} and @code{source} URLs and report those that are
5220 invalid. Check that the source file name is meaningful, e.g. is not
5221 just a version number or ``git-checkout'', without a declared
5222 @code{file-name} (@pxref{origin Reference}).
5223
5224 @item cve
5225 @cindex security vulnerabilities
5226 @cindex CVE, Common Vulnerabilities and Exposures
5227 Report known vulnerabilities found in the Common Vulnerabilities and
5228 Exposures (CVE) databases of the current and past year
5229 @uref{https://nvd.nist.gov/download.cfm#CVE_FEED, published by the US
5230 NIST}.
5231
5232 To view information about a particular vulnerability, visit pages such as:
5233
5234 @itemize
5235 @item
5236 @indicateurl{https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-YYYY-ABCD}
5237 @item
5238 @indicateurl{https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-YYYY-ABCD}
5239 @end itemize
5240
5241 @noindent
5242 where @code{CVE-YYYY-ABCD} is the CVE identifier---e.g.,
5243 @code{CVE-2015-7554}.
5244
5245 Package developers can specify in package recipes the
5246 @uref{https://nvd.nist.gov/cpe.cfm,Common Platform Enumeration (CPE)}
5247 name and version of the package when they differ from the name that Guix
5248 uses, as in this example:
5249
5250 @example
5251 (package
5252 (name "grub")
5253 ;; @dots{}
5254 ;; CPE calls this package "grub2".
5255 (properties '((cpe-name . "grub2"))))
5256 @end example
5257
5258 @item formatting
5259 Warn about obvious source code formatting issues: trailing white space,
5260 use of tabulations, etc.
5261 @end table
5262
5263 The general syntax is:
5264
5265 @example
5266 guix lint @var{options} @var{package}@dots{}
5267 @end example
5268
5269 If no package is given on the command line, then all packages are checked.
5270 The @var{options} may be zero or more of the following:
5271
5272 @table @code
5273 @item --list-checkers
5274 @itemx -l
5275 List and describe all the available checkers that will be run on packages
5276 and exit.
5277
5278 @item --checkers
5279 @itemx -c
5280 Only enable the checkers specified in a comma-separated list using the
5281 names returned by @code{--list-checkers}.
5282
5283 @end table
5284
5285 @node Invoking guix size
5286 @section Invoking @command{guix size}
5287
5288 The @command{guix size} command helps package developers profile the
5289 disk usage of packages. It is easy to overlook the impact of an
5290 additional dependency added to a package, or the impact of using a
5291 single output for a package that could easily be split (@pxref{Packages
5292 with Multiple Outputs}). Such are the typical issues that
5293 @command{guix size} can highlight.
5294
5295 The command can be passed a package specification such as @code{gcc-4.8}
5296 or @code{guile:debug}, or a file name in the store. Consider this
5297 example:
5298
5299 @example
5300 $ guix size coreutils
5301 store item total self
5302 /gnu/store/@dots{}-coreutils-8.23 70.0 13.9 19.8%
5303 /gnu/store/@dots{}-gmp-6.0.0a 55.3 2.5 3.6%
5304 /gnu/store/@dots{}-acl-2.2.52 53.7 0.5 0.7%
5305 /gnu/store/@dots{}-attr-2.4.46 53.2 0.3 0.5%
5306 /gnu/store/@dots{}-gcc-4.8.4-lib 52.9 15.7 22.4%
5307 /gnu/store/@dots{}-glibc-2.21 37.2 37.2 53.1%
5308 @end example
5309
5310 @cindex closure
5311 The store items listed here constitute the @dfn{transitive closure} of
5312 Coreutils---i.e., Coreutils and all its dependencies, recursively---as
5313 would be returned by:
5314
5315 @example
5316 $ guix gc -R /gnu/store/@dots{}-coreutils-8.23
5317 @end example
5318
5319 Here the output shows three columns next to store items. The first column,
5320 labeled ``total'', shows the size in mebibytes (MiB) of the closure of
5321 the store item---that is, its own size plus the size of all its
5322 dependencies. The next column, labeled ``self'', shows the size of the
5323 item itself. The last column shows the ratio of the size of the item
5324 itself to the space occupied by all the items listed here.
5325
5326 In this example, we see that the closure of Coreutils weighs in at
5327 70@tie{}MiB, half of which is taken by libc. (That libc represents a
5328 large fraction of the closure is not a problem @i{per se} because it is
5329 always available on the system anyway.)
5330
5331 When the package passed to @command{guix size} is available in the
5332 store, @command{guix size} queries the daemon to determine its
5333 dependencies, and measures its size in the store, similar to @command{du
5334 -ms --apparent-size} (@pxref{du invocation,,, coreutils, GNU
5335 Coreutils}).
5336
5337 When the given package is @emph{not} in the store, @command{guix size}
5338 reports information based on the available substitutes
5339 (@pxref{Substitutes}). This makes it possible it to profile disk usage of
5340 store items that are not even on disk, only available remotely.
5341
5342 You can also specify several package names:
5343
5344 @example
5345 $ guix size coreutils grep sed bash
5346 store item total self
5347 /gnu/store/@dots{}-coreutils-8.24 77.8 13.8 13.4%
5348 /gnu/store/@dots{}-grep-2.22 73.1 0.8 0.8%
5349 /gnu/store/@dots{}-bash-4.3.42 72.3 4.7 4.6%
5350 /gnu/store/@dots{}-readline-6.3 67.6 1.2 1.2%
5351 @dots{}
5352 total: 102.3 MiB
5353 @end example
5354
5355 @noindent
5356 In this example we see that the combination of the four packages takes
5357 102.3@tie{}MiB in total, which is much less than the sum of each closure
5358 since they have a lot of dependencies in common.
5359
5360 The available options are:
5361
5362 @table @option
5363
5364 @item --substitute-urls=@var{urls}
5365 Use substitute information from @var{urls}.
5366 @xref{client-substitute-urls, the same option for @code{guix build}}.
5367
5368 @item --map-file=@var{file}
5369 Write a graphical map of disk usage in PNG format to @var{file}.
5370
5371 For the example above, the map looks like this:
5372
5373 @image{images/coreutils-size-map,5in,, map of Coreutils disk usage
5374 produced by @command{guix size}}
5375
5376 This option requires that
5377 @uref{http://wingolog.org/software/guile-charting/, Guile-Charting} be
5378 installed and visible in Guile's module search path. When that is not
5379 the case, @command{guix size} fails as it tries to load it.
5380
5381 @item --system=@var{system}
5382 @itemx -s @var{system}
5383 Consider packages for @var{system}---e.g., @code{x86_64-linux}.
5384
5385 @end table
5386
5387 @node Invoking guix graph
5388 @section Invoking @command{guix graph}
5389
5390 @cindex DAG
5391 Packages and their dependencies form a @dfn{graph}, specifically a
5392 directed acyclic graph (DAG). It can quickly become difficult to have a
5393 mental model of the package DAG, so the @command{guix graph} command
5394 provides a visual representation of the DAG. @command{guix graph}
5395 emits a DAG representation in the input format of
5396 @uref{http://www.graphviz.org/, Graphviz}, so its output can be passed
5397 directly to the @command{dot} command of Graphviz. The general
5398 syntax is:
5399
5400 @example
5401 guix graph @var{options} @var{package}@dots{}
5402 @end example
5403
5404 For example, the following command generates a PDF file representing the
5405 package DAG for the GNU@tie{}Core Utilities, showing its build-time
5406 dependencies:
5407
5408 @example
5409 guix graph coreutils | dot -Tpdf > dag.pdf
5410 @end example
5411
5412 The output looks like this:
5413
5414 @image{images/coreutils-graph,2in,,Dependency graph of the GNU Coreutils}
5415
5416 Nice little graph, no?
5417
5418 But there is more than one graph! The one above is concise: it is the
5419 graph of package objects, omitting implicit inputs such as GCC, libc,
5420 grep, etc. It is often useful to have such a concise graph, but
5421 sometimes one may want to see more details. @command{guix graph} supports
5422 several types of graphs, allowing you to choose the level of detail:
5423
5424 @table @code
5425 @item package
5426 This is the default type used in the example above. It shows the DAG of
5427 package objects, excluding implicit dependencies. It is concise, but
5428 filters out many details.
5429
5430 @item bag-emerged
5431 This is the package DAG, @emph{including} implicit inputs.
5432
5433 For instance, the following command:
5434
5435 @example
5436 guix graph --type=bag-emerged coreutils | dot -Tpdf > dag.pdf
5437 @end example
5438
5439 ... yields this bigger graph:
5440
5441 @image{images/coreutils-bag-graph,,5in,Detailed dependency graph of the GNU Coreutils}
5442
5443 At the bottom of the graph, we see all the implicit inputs of
5444 @var{gnu-build-system} (@pxref{Build Systems, @code{gnu-build-system}}).
5445
5446 Now, note that the dependencies of these implicit inputs---that is, the
5447 @dfn{bootstrap dependencies} (@pxref{Bootstrapping})---are not shown
5448 here, for conciseness.
5449
5450 @item bag
5451 Similar to @code{bag-emerged}, but this time including all the bootstrap
5452 dependencies.
5453
5454 @item bag-with-origins
5455 Similar to @code{bag}, but also showing origins and their dependencies.
5456
5457 @item derivations
5458 This is the most detailed representation: It shows the DAG of
5459 derivations (@pxref{Derivations}) and plain store items. Compared to
5460 the above representation, many additional nodes are visible, including
5461 build scripts, patches, Guile modules, etc.
5462
5463 For this type of graph, it is also possible to pass a @file{.drv} file
5464 name instead of a package name, as in:
5465
5466 @example
5467 guix graph -t derivation `guix system build -d my-config.scm`
5468 @end example
5469 @end table
5470
5471 All the types above correspond to @emph{build-time dependencies}. The
5472 following graph type represents the @emph{run-time dependencies}:
5473
5474 @table @code
5475 @item references
5476 This is the graph of @dfn{references} of a package output, as returned
5477 by @command{guix gc --references} (@pxref{Invoking guix gc}).
5478
5479 If the given package output is not available in the store, @command{guix
5480 graph} attempts to obtain dependency information from substitutes.
5481
5482 Here you can also pass a store file name instead of a package name. For
5483 example, the command below produces the reference graph of your profile
5484 (which can be big!):
5485
5486 @example
5487 guix graph -t references `readlink -f ~/.guix-profile`
5488 @end example
5489 @end table
5490
5491 The available options are the following:
5492
5493 @table @option
5494 @item --type=@var{type}
5495 @itemx -t @var{type}
5496 Produce a graph output of @var{type}, where @var{type} must be one of
5497 the values listed above.
5498
5499 @item --list-types
5500 List the supported graph types.
5501
5502 @item --expression=@var{expr}
5503 @itemx -e @var{expr}
5504 Consider the package @var{expr} evaluates to.
5505
5506 This is useful to precisely refer to a package, as in this example:
5507
5508 @example
5509 guix graph -e '(@@@@ (gnu packages commencement) gnu-make-final)'
5510 @end example
5511 @end table
5512
5513
5514 @node Invoking guix environment
5515 @section Invoking @command{guix environment}
5516
5517 @cindex reproducible build environments
5518 @cindex development environments
5519 The purpose of @command{guix environment} is to assist hackers in
5520 creating reproducible development environments without polluting their
5521 package profile. The @command{guix environment} tool takes one or more
5522 packages, builds all of their inputs, and creates a shell
5523 environment to use them.
5524
5525 The general syntax is:
5526
5527 @example
5528 guix environment @var{options} @var{package}@dots{}
5529 @end example
5530
5531 The following example spawns a new shell set up for the development of
5532 GNU@tie{}Guile:
5533
5534 @example
5535 guix environment guile
5536 @end example
5537
5538 If the needed dependencies are not built yet, @command{guix environment}
5539 automatically builds them. The environment of the new shell is an augmented
5540 version of the environment that @command{guix environment} was run in.
5541 It contains the necessary search paths for building the given package
5542 added to the existing environment variables. To create a ``pure''
5543 environment, in which the original environment variables have been unset,
5544 use the @code{--pure} option@footnote{Users sometimes wrongfully augment
5545 environment variables such as @code{PATH} in their @file{~/.bashrc}
5546 file. As a consequence, when @code{guix environment} launches it, Bash
5547 may read @file{~/.bashrc}, thereby introducing ``impurities'' in these
5548 environment variables. It is an error to define such environment
5549 variables in @file{.bashrc}; instead, they should be defined in
5550 @file{.bash_profile}, which is sourced only by log-in shells.
5551 @xref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}, for
5552 details on Bash start-up files.}.
5553
5554 @vindex GUIX_ENVIRONMENT
5555 @command{guix environment} defines the @code{GUIX_ENVIRONMENT}
5556 variable in the shell it spawns; its value is the file name of the
5557 profile of this environment. This allows users to, say, define a
5558 specific prompt for development environments in their @file{.bashrc}
5559 (@pxref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}):
5560
5561 @example
5562 if [ -n "$GUIX_ENVIRONMENT" ]
5563 then
5564 export PS1="\u@@\h \w [dev]\$ "
5565 fi
5566 @end example
5567
5568 @noindent
5569 ... or to browse the profile:
5570
5571 @example
5572 $ ls "$GUIX_ENVIRONMENT/bin"
5573 @end example
5574
5575 Additionally, more than one package may be specified, in which case the
5576 union of the inputs for the given packages are used. For example, the
5577 command below spawns a shell where all of the dependencies of both Guile
5578 and Emacs are available:
5579
5580 @example
5581 guix environment guile emacs
5582 @end example
5583
5584 Sometimes an interactive shell session is not desired. An arbitrary
5585 command may be invoked by placing the @code{--} token to separate the
5586 command from the rest of the arguments:
5587
5588 @example
5589 guix environment guile -- make -j4
5590 @end example
5591
5592 In other situations, it is more convenient to specify the list of
5593 packages needed in the environment. For example, the following command
5594 runs @command{python} from an environment containing Python@tie{}2.7 and
5595 NumPy:
5596
5597 @example
5598 guix environment --ad-hoc python2-numpy python-2.7 -- python
5599 @end example
5600
5601 Furthermore, one might want the dependencies of a package and also some
5602 additional packages that are not build-time or runtime dependencies, but
5603 are useful when developing nonetheless. Because of this, the
5604 @code{--ad-hoc} flag is positional. Packages appearing before
5605 @code{--ad-hoc} are interpreted as packages whose dependencies will be
5606 added to the environment. Packages appearing after are interpreted as
5607 packages that will be added to the environment directly. For example,
5608 the following command creates a Guix development environment that
5609 additionally includes Git and strace:
5610
5611 @example
5612 guix environment guix --ad-hoc git strace
5613 @end example
5614
5615 Sometimes it is desirable to isolate the environment as much as
5616 possible, for maximal purity and reproducibility. In particular, when
5617 using Guix on a host distro that is not GuixSD, it is desirable to
5618 prevent access to @file{/usr/bin} and other system-wide resources from
5619 the development environment. For example, the following command spawns
5620 a Guile REPL in a ``container'' where only the store and the current
5621 working directory are mounted:
5622
5623 @example
5624 guix environment --ad-hoc --container guile -- guile
5625 @end example
5626
5627 @quotation Note
5628 The @code{--container} option requires Linux-libre 3.19 or newer.
5629 @end quotation
5630
5631 The available options are summarized below.
5632
5633 @table @code
5634 @item --expression=@var{expr}
5635 @itemx -e @var{expr}
5636 Create an environment for the package or list of packages that
5637 @var{expr} evaluates to.
5638
5639 For example, running:
5640
5641 @example
5642 guix environment -e '(@@ (gnu packages maths) petsc-openmpi)'
5643 @end example
5644
5645 starts a shell with the environment for this specific variant of the
5646 PETSc package.
5647
5648 Running:
5649
5650 @example
5651 guix environment --ad-hoc -e '(@@ (gnu) %base-packages)'
5652 @end example
5653
5654 starts a shell with all the GuixSD base packages available.
5655
5656 The above commands only the use default output of the given packages.
5657 To select other outputs, two element tuples can be specified:
5658
5659 @example
5660 guix environment --ad-hoc -e '(list (@ (gnu packages bash) bash) "include")'
5661 @end example
5662
5663 @item --load=@var{file}
5664 @itemx -l @var{file}
5665 Create an environment for the package or list of packages that the code
5666 within @var{file} evaluates to.
5667
5668 As an example, @var{file} might contain a definition like this
5669 (@pxref{Defining Packages}):
5670
5671 @example
5672 @verbatiminclude environment-gdb.scm
5673 @end example
5674
5675 @item --ad-hoc
5676 Include all specified packages in the resulting environment, as if an
5677 @i{ad hoc} package were defined with them as inputs. This option is
5678 useful for quickly creating an environment without having to write a
5679 package expression to contain the desired inputs.
5680
5681 For instance, the command:
5682
5683 @example
5684 guix environment --ad-hoc guile guile-sdl -- guile
5685 @end example
5686
5687 runs @command{guile} in an environment where Guile and Guile-SDL are
5688 available.
5689
5690 Note that this example implicitly asks for the default output of
5691 @code{guile} and @code{guile-sdl}, but it is possible to ask for a
5692 specific output---e.g., @code{glib:bin} asks for the @code{bin} output
5693 of @code{glib} (@pxref{Packages with Multiple Outputs}).
5694
5695 This option may be composed with the default behavior of @command{guix
5696 environment}. Packages appearing before @code{--ad-hoc} are interpreted
5697 as packages whose dependencies will be added to the environment, the
5698 default behavior. Packages appearing after are interpreted as packages
5699 that will be added to the environment directly.
5700
5701 @item --pure
5702 Unset existing environment variables when building the new environment.
5703 This has the effect of creating an environment in which search paths
5704 only contain package inputs.
5705
5706 @item --search-paths
5707 Display the environment variable definitions that make up the
5708 environment.
5709
5710 @item --system=@var{system}
5711 @itemx -s @var{system}
5712 Attempt to build for @var{system}---e.g., @code{i686-linux}.
5713
5714 @item --container
5715 @itemx -C
5716 @cindex container
5717 Run @var{command} within an isolated container. The current working
5718 directory outside the container is mapped inside the container.
5719 Additionally, a dummy home directory is created that matches the current
5720 user's home directory, and @file{/etc/passwd} is configured accordingly.
5721 The spawned process runs as the current user outside the container, but
5722 has root privileges in the context of the container.
5723
5724 @item --network
5725 @itemx -N
5726 For containers, share the network namespace with the host system.
5727 Containers created without this flag only have access to the loopback
5728 device.
5729
5730 @item --expose=@var{source}[=@var{target}]
5731 For containers, expose the file system @var{source} from the host system
5732 as the read-only file system @var{target} within the container. If
5733 @var{target} is not specified, @var{source} is used as the target mount
5734 point in the container.
5735
5736 The example below spawns a Guile REPL in a container in which the user's
5737 home directory is accessible read-only via the @file{/exchange}
5738 directory:
5739
5740 @example
5741 guix environment --container --expose=$HOME=/exchange guile -- guile
5742 @end example
5743
5744 @item --share=@var{source}[=@var{target}]
5745 For containers, share the file system @var{source} from the host system
5746 as the writable file system @var{target} within the container. If
5747 @var{target} is not specified, @var{source} is used as the target mount
5748 point in the container.
5749
5750 The example below spawns a Guile REPL in a container in which the user's
5751 home directory is accessible for both reading and writing via the
5752 @file{/exchange} directory:
5753
5754 @example
5755 guix environment --container --share=$HOME=/exchange guile -- guile
5756 @end example
5757 @end table
5758
5759 It also supports all of the common build options that @command{guix
5760 build} supports (@pxref{Common Build Options}).
5761
5762 @node Invoking guix publish
5763 @section Invoking @command{guix publish}
5764
5765 The purpose of @command{guix publish} is to enable users to easily share
5766 their store with others, who can then use it as a substitute server
5767 (@pxref{Substitutes}).
5768
5769 When @command{guix publish} runs, it spawns an HTTP server which allows
5770 anyone with network access to obtain substitutes from it. This means
5771 that any machine running Guix can also act as if it were a build farm,
5772 since the HTTP interface is compatible with Hydra, the software behind
5773 the @code{hydra.gnu.org} build farm.
5774
5775 For security, each substitute is signed, allowing recipients to check
5776 their authenticity and integrity (@pxref{Substitutes}). Because
5777 @command{guix publish} uses the signing key of the system, which is only
5778 readable by the system administrator, it must be started as root; the
5779 @code{--user} option makes it drop root privileges early on.
5780
5781 The signing key pair must be generated before @command{guix publish} is
5782 launched, using @command{guix archive --generate-key} (@pxref{Invoking
5783 guix archive}).
5784
5785 The general syntax is:
5786
5787 @example
5788 guix publish @var{options}@dots{}
5789 @end example
5790
5791 Running @command{guix publish} without any additional arguments will
5792 spawn an HTTP server on port 8080:
5793
5794 @example
5795 guix publish
5796 @end example
5797
5798 Once a publishing server has been authorized (@pxref{Invoking guix
5799 archive}), the daemon may download substitutes from it:
5800
5801 @example
5802 guix-daemon --substitute-urls=http://example.org:8080
5803 @end example
5804
5805 As a bonus, @command{guix publish} also serves as a content-addressed
5806 mirror for source files referenced in @code{origin} records
5807 (@pxref{origin Reference}). For instance, assuming @command{guix
5808 publish} is running on @code{example.org}, the following URL returns the
5809 raw @file{hello-2.10.tar.gz} file with the given SHA256 hash
5810 (represented in @code{nix-base32} format, @pxref{Invoking guix hash}):
5811
5812 @example
5813 http://example.org/file/hello-2.10.tar.gz/sha256/0ssi1@dots{}ndq1i
5814 @end example
5815
5816 Obviously, these URLs only work for files that are in the store; in
5817 other cases, they return 404 (``Not Found'').
5818
5819 The following options are available:
5820
5821 @table @code
5822 @item --port=@var{port}
5823 @itemx -p @var{port}
5824 Listen for HTTP requests on @var{port}.
5825
5826 @item --listen=@var{host}
5827 Listen on the network interface for @var{host}. The default is to
5828 accept connections from any interface.
5829
5830 @item --user=@var{user}
5831 @itemx -u @var{user}
5832 Change privileges to @var{user} as soon as possible---i.e., once the
5833 server socket is open and the signing key has been read.
5834
5835 @item --compression[=@var{level}]
5836 @itemx -C [@var{level}]
5837 Compress data using the given @var{level}. When @var{level} is zero,
5838 disable compression. The range 1 to 9 corresponds to different gzip
5839 compression levels: 1 is the fastest, and 9 is the best (CPU-intensive).
5840 The default is 3.
5841
5842 Compression occurs on the fly and the compressed streams are not
5843 cached. Thus, to reduce load on the machine that runs @command{guix
5844 publish}, it may be a good idea to choose a low compression level, or to
5845 run @command{guix publish} behind a caching proxy.
5846
5847 @item --ttl=@var{ttl}
5848 Produce @code{Cache-Control} HTTP headers that advertise a time-to-live
5849 (TTL) of @var{ttl}. @var{ttl} must denote a duration: @code{5d} means 5
5850 days, @code{1m} means 1 month, and so on.
5851
5852 This allows the user's Guix to keep substitute information in cache for
5853 @var{ttl}. However, note that @code{guix publish} does not itself
5854 guarantee that the store items it provides will indeed remain available
5855 for as long as @var{ttl}.
5856
5857 @item --repl[=@var{port}]
5858 @itemx -r [@var{port}]
5859 Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile
5860 Reference Manual}) on @var{port} (37146 by default). This is used
5861 primarily for debugging a running @command{guix publish} server.
5862 @end table
5863
5864 Enabling @command{guix publish} on a GuixSD system is a one-liner: just
5865 add a call to @code{guix-publish-service} in the @code{services} field
5866 of the @code{operating-system} declaration (@pxref{guix-publish-service,
5867 @code{guix-publish-service}}).
5868
5869
5870 @node Invoking guix challenge
5871 @section Invoking @command{guix challenge}
5872
5873 @cindex reproducible builds
5874 @cindex verifiable builds
5875
5876 Do the binaries provided by this server really correspond to the source
5877 code it claims to build? Is a package build process deterministic?
5878 These are the questions the @command{guix challenge} command attempts to
5879 answer.
5880
5881 The former is obviously an important question: Before using a substitute
5882 server (@pxref{Substitutes}), one had better @emph{verify} that it
5883 provides the right binaries, and thus @emph{challenge} it. The latter
5884 is what enables the former: If package builds are deterministic, then
5885 independent builds of the package should yield the exact same result,
5886 bit for bit; if a server provides a binary different from the one
5887 obtained locally, it may be either corrupt or malicious.
5888
5889 We know that the hash that shows up in @file{/gnu/store} file names is
5890 the hash of all the inputs of the process that built the file or
5891 directory---compilers, libraries, build scripts,
5892 etc. (@pxref{Introduction}). Assuming deterministic build processes,
5893 one store file name should map to exactly one build output.
5894 @command{guix challenge} checks whether there is, indeed, a single
5895 mapping by comparing the build outputs of several independent builds of
5896 any given store item.
5897
5898 The command output looks like this:
5899
5900 @smallexample
5901 $ guix challenge --substitute-urls="https://hydra.gnu.org https://guix.example.org"
5902 updating list of substitutes from 'https://hydra.gnu.org'... 100.0%
5903 updating list of substitutes from 'https://guix.example.org'... 100.0%
5904 /gnu/store/@dots{}-openssl-1.0.2d contents differ:
5905 local hash: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q
5906 https://hydra.gnu.org/nar/@dots{}-openssl-1.0.2d: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q
5907 https://guix.example.org/nar/@dots{}-openssl-1.0.2d: 1zy4fmaaqcnjrzzajkdn3f5gmjk754b43qkq47llbyak9z0qjyim
5908 /gnu/store/@dots{}-git-2.5.0 contents differ:
5909 local hash: 00p3bmryhjxrhpn2gxs2fy0a15lnip05l97205pgbk5ra395hyha
5910 https://hydra.gnu.org/nar/@dots{}-git-2.5.0: 069nb85bv4d4a6slrwjdy8v1cn4cwspm3kdbmyb81d6zckj3nq9f
5911 https://guix.example.org/nar/@dots{}-git-2.5.0: 0mdqa9w1p6cmli6976v4wi0sw9r4p5prkj7lzfd1877wk11c9c73
5912 /gnu/store/@dots{}-pius-2.1.1 contents differ:
5913 local hash: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax
5914 https://hydra.gnu.org/nar/@dots{}-pius-2.1.1: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax
5915 https://guix.example.org/nar/@dots{}-pius-2.1.1: 1cy25x1a4fzq5rk0pmvc8xhwyffnqz95h2bpvqsz2mpvlbccy0gs
5916 @end smallexample
5917
5918 @noindent
5919 In this example, @command{guix challenge} first scans the store to
5920 determine the set of locally-built derivations---as opposed to store
5921 items that were downloaded from a substitute server---and then queries
5922 all the substitute servers. It then reports those store items for which
5923 the servers obtained a result different from the local build.
5924
5925 @cindex non-determinism, in package builds
5926 As an example, @code{guix.example.org} always gets a different answer.
5927 Conversely, @code{hydra.gnu.org} agrees with local builds, except in the
5928 case of Git. This might indicate that the build process of Git is
5929 non-deterministic, meaning that its output varies as a function of
5930 various things that Guix does not fully control, in spite of building
5931 packages in isolated environments (@pxref{Features}). Most common
5932 sources of non-determinism include the addition of timestamps in build
5933 results, the inclusion of random numbers, and directory listings sorted
5934 by inode number. See @uref{https://reproducible-builds.org/docs/}, for
5935 more information.
5936
5937 To find out what is wrong with this Git binary, we can do something along
5938 these lines (@pxref{Invoking guix archive}):
5939
5940 @example
5941 $ wget -q -O - https://hydra.gnu.org/nar/@dots{}-git-2.5.0 \
5942 | guix archive -x /tmp/git
5943 $ diff -ur --no-dereference /gnu/store/@dots{}-git.2.5.0 /tmp/git
5944 @end example
5945
5946 This command shows the difference between the files resulting from the
5947 local build, and the files resulting from the build on
5948 @code{hydra.gnu.org} (@pxref{Overview, Comparing and Merging Files,,
5949 diffutils, Comparing and Merging Files}). The @command{diff} command
5950 works great for text files. When binary files differ, a better option
5951 is @uref{https://diffoscope.org/, Diffoscope}, a tool that helps
5952 visualize differences for all kinds of files.
5953
5954 Once you have done that work, you can tell whether the differences are due
5955 to a non-deterministic build process or to a malicious server. We try
5956 hard to remove sources of non-determinism in packages to make it easier
5957 to verify substitutes, but of course, this is a process that
5958 involves not just Guix, but a large part of the free software community.
5959 In the meantime, @command{guix challenge} is one tool to help address
5960 the problem.
5961
5962 If you are writing packages for Guix, you are encouraged to check
5963 whether @code{hydra.gnu.org} and other substitute servers obtain the
5964 same build result as you did with:
5965
5966 @example
5967 $ guix challenge @var{package}
5968 @end example
5969
5970 @noindent
5971 where @var{package} is a package specification such as
5972 @code{guile@@2.0} or @code{glibc:debug}.
5973
5974 The general syntax is:
5975
5976 @example
5977 guix challenge @var{options} [@var{packages}@dots{}]
5978 @end example
5979
5980 When a difference is found between the hash of a locally-built item and
5981 that of a server-provided substitute, or among substitutes provided by
5982 different servers, the command displays it as in the example above and
5983 its exit code is 2 (other non-zero exit codes denote other kinds of
5984 errors.)
5985
5986 The one option that matters is:
5987
5988 @table @code
5989
5990 @item --substitute-urls=@var{urls}
5991 Consider @var{urls} the whitespace-separated list of substitute source
5992 URLs to compare to.
5993
5994 @end table
5995
5996
5997 @node Invoking guix container
5998 @section Invoking @command{guix container}
5999 @cindex container
6000
6001 @quotation Note
6002 As of version @value{VERSION}, this tool is experimental. The interface
6003 is subject to radical change in the future.
6004 @end quotation
6005
6006 The purpose of @command{guix container} is to manipulate processes
6007 running within an isolated environment, commonly known as a
6008 ``container'', typically created by the @command{guix environment}
6009 (@pxref{Invoking guix environment}) and @command{guix system container}
6010 (@pxref{Invoking guix system}) commands.
6011
6012 The general syntax is:
6013
6014 @example
6015 guix container @var{action} @var{options}@dots{}
6016 @end example
6017
6018 @var{action} specifies the operation to perform with a container, and
6019 @var{options} specifies the context-specific arguments for the action.
6020
6021 The following actions are available:
6022
6023 @table @code
6024 @item exec
6025 Execute a command within the context of a running container.
6026
6027 The syntax is:
6028
6029 @example
6030 guix container exec @var{pid} @var{program} @var{arguments}@dots{}
6031 @end example
6032
6033 @var{pid} specifies the process ID of the running container.
6034 @var{program} specifies an executable file name within the root file
6035 system of the container. @var{arguments} are the additional options that
6036 will be passed to @var{program}.
6037
6038 The following command launches an interactive login shell inside a
6039 GuixSD container, started by @command{guix system container}, and whose
6040 process ID is 9001:
6041
6042 @example
6043 guix container exec 9001 /run/current-system/profile/bin/bash --login
6044 @end example
6045
6046 Note that the @var{pid} cannot be the parent process of a container. It
6047 must be PID 1 of the container or one of its child processes.
6048
6049 @end table
6050
6051 @c *********************************************************************
6052 @node GNU Distribution
6053 @chapter GNU Distribution
6054
6055 @cindex Guix System Distribution
6056 @cindex GuixSD
6057 Guix comes with a distribution of the GNU system consisting entirely of
6058 free software@footnote{The term ``free'' here refers to the
6059 @url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to
6060 users of that software}.}. The
6061 distribution can be installed on its own (@pxref{System Installation}),
6062 but it is also possible to install Guix as a package manager on top of
6063 an installed GNU/Linux system (@pxref{Installation}). To distinguish
6064 between the two, we refer to the standalone distribution as the Guix
6065 System Distribution, or GuixSD.
6066
6067 The distribution provides core GNU packages such as GNU libc, GCC, and
6068 Binutils, as well as many GNU and non-GNU applications. The complete
6069 list of available packages can be browsed
6070 @url{http://www.gnu.org/software/guix/packages,on-line} or by
6071 running @command{guix package} (@pxref{Invoking guix package}):
6072
6073 @example
6074 guix package --list-available
6075 @end example
6076
6077 Our goal is to provide a practical 100% free software distribution of
6078 Linux-based and other variants of GNU, with a focus on the promotion and
6079 tight integration of GNU components, and an emphasis on programs and
6080 tools that help users exert that freedom.
6081
6082 Packages are currently available on the following platforms:
6083
6084 @table @code
6085
6086 @item x86_64-linux
6087 Intel/AMD @code{x86_64} architecture, Linux-Libre kernel;
6088
6089 @item i686-linux
6090 Intel 32-bit architecture (IA32), Linux-Libre kernel;
6091
6092 @item armhf-linux
6093 ARMv7-A architecture with hard float, Thumb-2 and NEON,
6094 using the EABI hard-float application binary interface (ABI),
6095 and Linux-Libre kernel.
6096
6097 @item mips64el-linux
6098 little-endian 64-bit MIPS processors, specifically the Loongson series,
6099 n32 ABI, and Linux-Libre kernel.
6100
6101 @end table
6102
6103 GuixSD itself is currently only available on @code{i686} and @code{x86_64}.
6104
6105 @noindent
6106 For information on porting to other architectures or kernels,
6107 @pxref{Porting}.
6108
6109 @menu
6110 * System Installation:: Installing the whole operating system.
6111 * System Configuration:: Configuring the operating system.
6112 * Installing Debugging Files:: Feeding the debugger.
6113 * Security Updates:: Deploying security fixes quickly.
6114 * Package Modules:: Packages from the programmer's viewpoint.
6115 * Packaging Guidelines:: Growing the distribution.
6116 * Bootstrapping:: GNU/Linux built from scratch.
6117 * Porting:: Targeting another platform or kernel.
6118 @end menu
6119
6120 Building this distribution is a cooperative effort, and you are invited
6121 to join! @xref{Contributing}, for information about how you can help.
6122
6123 @node System Installation
6124 @section System Installation
6125
6126 @cindex Guix System Distribution
6127 This section explains how to install the Guix System Distribution (GuixSD)
6128 on a machine. The Guix package manager can
6129 also be installed on top of a running GNU/Linux system,
6130 @pxref{Installation}.
6131
6132 @ifinfo
6133 @quotation Note
6134 @c This paragraph is for people reading this from tty2 of the
6135 @c installation image.
6136 You are reading this documentation with an Info reader. For details on
6137 how to use it, hit the @key{RET} key (``return'' or ``enter'') on the
6138 link that follows: @pxref{Top, Info reader,, info-stnd, Stand-alone GNU
6139 Info}. Hit @kbd{l} afterwards to come back here.
6140
6141 Alternately, run @command{info info} in another tty to keep the manual
6142 available.
6143 @end quotation
6144 @end ifinfo
6145
6146 @menu
6147 * Limitations:: What you can expect.
6148 * Hardware Considerations:: Supported hardware.
6149 * USB Stick Installation:: Preparing the installation medium.
6150 * Preparing for Installation:: Networking, partitioning, etc.
6151 * Proceeding with the Installation:: The real thing.
6152 * Installing GuixSD in a VM:: GuixSD playground.
6153 * Building the Installation Image:: How this comes to be.
6154 @end menu
6155
6156 @node Limitations
6157 @subsection Limitations
6158
6159 As of version @value{VERSION}, the Guix System Distribution (GuixSD) is
6160 not production-ready. It may contain bugs and lack important
6161 features. Thus, if you are looking for a stable production system that
6162 respects your freedom as a computer user, a good solution at this point
6163 is to consider @url{http://www.gnu.org/distros/free-distros.html, one of
6164 the more established GNU/Linux distributions}. We hope you can soon switch
6165 to the GuixSD without fear, of course. In the meantime, you can
6166 also keep using your distribution and try out the package manager on top
6167 of it (@pxref{Installation}).
6168
6169 Before you proceed with the installation, be aware of the following
6170 noteworthy limitations applicable to version @value{VERSION}:
6171
6172 @itemize
6173 @item
6174 The installation process does not include a graphical user interface and
6175 requires familiarity with GNU/Linux (see the following subsections to
6176 get a feel of what that means.)
6177
6178 @item
6179 Support for the Logical Volume Manager (LVM) is missing.
6180
6181 @item
6182 Few system services are currently supported out-of-the-box
6183 (@pxref{Services}).
6184
6185 @item
6186 More than 4,000 packages are available, but you may
6187 occasionally find that a useful package is missing.
6188
6189 @item
6190 GNOME, Xfce, and Enlightenment are available (@pxref{Desktop Services}),
6191 as well as a number of X11 window managers. However, some graphical
6192 applications may be missing, as well as KDE.
6193 @end itemize
6194
6195 You have been warned! But more than a disclaimer, this is an invitation
6196 to report issues (and success stories!), and to join us in improving it.
6197 @xref{Contributing}, for more info.
6198
6199
6200 @node Hardware Considerations
6201 @subsection Hardware Considerations
6202
6203 @cindex hardware support on GuixSD
6204 GNU@tie{}GuixSD focuses on respecting the user's computing freedom. It
6205 builds around the kernel Linux-libre, which means that only hardware for
6206 which free software drivers and firmware exist is supported. Nowadays,
6207 a wide range of off-the-shelf hardware is supported on
6208 GNU/Linux-libre---from keyboards to graphics cards to scanners and
6209 Ethernet controllers. Unfortunately, there are still areas where
6210 hardware vendors deny users control over their own computing, and such
6211 hardware is not supported on GuixSD.
6212
6213 @cindex WiFi, hardware support
6214 One of the main areas where free drivers or firmware are lacking is WiFi
6215 devices. WiFi devices known to work include those using Atheros chips
6216 (AR9271 and AR7010), which corresponds to the @code{ath9k} Linux-libre
6217 driver, and for which free firmware exists and is available
6218 out-of-the-box on GuixSD, as part of @var{%base-firmware}
6219 (@pxref{operating-system Reference, @code{firmware}}).
6220
6221 @cindex RYF, Respects Your Freedom
6222 The @uref{https://www.fsf.org/, Free Software Foundation} runs
6223 @uref{https://www.fsf.org/ryf, @dfn{Respects Your Freedom}} (RYF), a
6224 certification program for hardware products that respect your freedom
6225 and your privacy and ensure that you have control over your device. We
6226 encourage you to check the list of RYF-certified devices.
6227
6228 Another useful resource is the @uref{https://www.h-node.org/, H-Node}
6229 web site. It contains a catalog of hardware devices with information
6230 about their support in GNU/Linux.
6231
6232
6233 @node USB Stick Installation
6234 @subsection USB Stick Installation
6235
6236 An installation image for USB sticks can be downloaded from
6237 @indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz},
6238 where @var{system} is one of:
6239
6240 @table @code
6241 @item x86_64-linux
6242 for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs;
6243
6244 @item i686-linux
6245 for a 32-bit GNU/Linux system on Intel-compatible CPUs.
6246 @end table
6247
6248 @c start duplication of authentication part from ``Binary Installation''
6249 Make sure to download the associated @file{.sig} file and to verify the
6250 authenticity of the image against it, along these lines:
6251
6252 @example
6253 $ wget ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz.sig
6254 $ gpg --verify guixsd-usb-install-@value{VERSION}.@var{system}.xz.sig
6255 @end example
6256
6257 If that command fails because you do not have the required public key,
6258 then run this command to import it:
6259
6260 @example
6261 $ gpg --keyserver pgp.mit.edu --recv-keys @value{OPENPGP-SIGNING-KEY-ID}
6262 @end example
6263
6264 @noindent
6265 and rerun the @code{gpg --verify} command.
6266 @c end duplication
6267
6268 This image contains a single partition with the tools necessary for an
6269 installation. It is meant to be copied @emph{as is} to a large-enough
6270 USB stick.
6271
6272 To copy the image to a USB stick, follow these steps:
6273
6274 @enumerate
6275 @item
6276 Decompress the image using the @command{xz} command:
6277
6278 @example
6279 xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz
6280 @end example
6281
6282 @item
6283 Insert a USB stick of 1@tie{}GiB or more into your machine, and determine
6284 its device name. Assuming that the USB stick is known as @file{/dev/sdX},
6285 copy the image with:
6286
6287 @example
6288 dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX
6289 @end example
6290
6291 Access to @file{/dev/sdX} usually requires root privileges.
6292 @end enumerate
6293
6294 Once this is done, you should be able to reboot the system and boot from
6295 the USB stick. The latter usually requires you to get in the BIOS' boot
6296 menu, where you can choose to boot from the USB stick.
6297
6298 @xref{Installing GuixSD in a VM}, if, instead, you would like to install
6299 GuixSD in a virtual machine (VM).
6300
6301 @node Preparing for Installation
6302 @subsection Preparing for Installation
6303
6304 Once you have successfully booted the image on the USB stick, you should
6305 end up with a root prompt. Several console TTYs are configured and can
6306 be used to run commands as root. TTY2 shows this documentation,
6307 browsable using the Info reader commands (@pxref{Top,,, info-stnd,
6308 Stand-alone GNU Info}). The installation system runs the GPM mouse
6309 daemon, which allows you to select text with the left mouse button and
6310 to paste it with the middle button.
6311
6312 @quotation Note
6313 Installation requires access to the Internet so that any missing
6314 dependencies of your system configuration can be downloaded. See the
6315 ``Networking'' section below.
6316 @end quotation
6317
6318 The installation system includes many common tools needed for this task.
6319 But it is also a full-blown GuixSD system, which means that you can
6320 install additional packages, should you need it, using @command{guix
6321 package} (@pxref{Invoking guix package}).
6322
6323 @subsubsection Keyboard Layout
6324
6325 @cindex keyboard layout
6326 The installation image uses the US qwerty keyboard layout. If you want
6327 to change it, you can use the @command{loadkeys} command. For example,
6328 the following command selects the Dvorak keyboard layout:
6329
6330 @example
6331 loadkeys dvorak
6332 @end example
6333
6334 See the files under @file{/run/current-system/profile/share/keymaps} for
6335 a list of available keyboard layouts. Run @command{man loadkeys} for
6336 more information.
6337
6338 @subsubsection Networking
6339
6340 Run the following command see what your network interfaces are called:
6341
6342 @example
6343 ifconfig -a
6344 @end example
6345
6346 @noindent
6347 @dots{} or, using the GNU/Linux-specific @command{ip} command:
6348
6349 @example
6350 ip a
6351 @end example
6352
6353 @c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20
6354 Wired interfaces have a name starting with @samp{e}; for example, the
6355 interface corresponding to the first on-board Ethernet controller is
6356 called @samp{eno1}. Wireless interfaces have a name starting with
6357 @samp{w}, like @samp{w1p2s0}.
6358
6359 @table @asis
6360 @item Wired connection
6361 To configure a wired network run the following command, substituting
6362 @var{interface} with the name of the wired interface you want to use.
6363
6364 @example
6365 ifconfig @var{interface} up
6366 @end example
6367
6368 @item Wireless connection
6369 To configure wireless networking, you can create a configuration file
6370 for the @command{wpa_supplicant} configuration tool (its location is not
6371 important) using one of the available text editors such as
6372 @command{zile}:
6373
6374 @example
6375 zile wpa_supplicant.conf
6376 @end example
6377
6378 As an example, the following stanza can go to this file and will work
6379 for many wireless networks, provided you give the actual SSID and
6380 passphrase for the network you are connecting to:
6381
6382 @example
6383 network=@{
6384 ssid="@var{my-ssid}"
6385 key_mgmt=WPA-PSK
6386 psk="the network's secret passphrase"
6387 @}
6388 @end example
6389
6390 Start the wireless service and run it in the background with the
6391 following command (substitute @var{interface} with the name of the
6392 network interface you want to use):
6393
6394 @example
6395 wpa_supplicant -c wpa_supplicant.conf -i @var{interface} -B
6396 @end example
6397
6398 Run @command{man wpa_supplicant} for more information.
6399 @end table
6400
6401 At this point, you need to acquire an IP address. On a network where IP
6402 addresses are automatically assigned @i{via} DHCP, you can run:
6403
6404 @example
6405 dhclient -v @var{interface}
6406 @end example
6407
6408 Try to ping a server to see if networking is up and running:
6409
6410 @example
6411 ping -c 3 gnu.org
6412 @end example
6413
6414 Setting up network access is almost always a requirement because the
6415 image does not contain all the software and tools that may be needed.
6416
6417 @subsubsection Disk Partitioning
6418
6419 Unless this has already been done, the next step is to partition, and
6420 then format the target partition(s).
6421
6422 The installation image includes several partitioning tools, including
6423 Parted (@pxref{Overview,,, parted, GNU Parted User Manual}),
6424 @command{fdisk}, and @command{cfdisk}. Run it and set up your disk with
6425 the partition layout you want:
6426
6427 @example
6428 cfdisk
6429 @end example
6430
6431 Once you are done partitioning the target hard disk drive, you have to
6432 create a file system on the relevant partition(s)@footnote{Currently
6433 GuixSD pretty much assumes an ext4 file system. In particular, code
6434 that reads partition UUIDs and labels only works with ext4. This will
6435 be fixed in the future.}.
6436
6437 Preferably, assign partitions a label so that you can easily and
6438 reliably refer to them in @code{file-system} declarations (@pxref{File
6439 Systems}). This is typically done using the @code{-L} option of
6440 @command{mkfs.ext4} and related commands. So, assuming the target root
6441 partition lives at @file{/dev/sda1}, a file system with the label
6442 @code{my-root} can be created with:
6443
6444 @example
6445 mkfs.ext4 -L my-root /dev/sda1
6446 @end example
6447
6448 @c FIXME: Uncomment this once GRUB fully supports encrypted roots.
6449 @c A typical command sequence may be:
6450 @c
6451 @c @example
6452 @c # fdisk /dev/sdX
6453 @c @dots{} Create partitions etc.@dots{}
6454 @c # cryptsetup luksFormat /dev/sdX1
6455 @c # cryptsetup open --type luks /dev/sdX1 my-partition
6456 @c # mkfs.ext4 -L my-root /dev/mapper/my-partition
6457 @c @end example
6458
6459 In addition to e2fsprogs, the suite of tools to manipulate
6460 ext2/ext3/ext4 file systems, the installation image includes
6461 Cryptsetup/LUKS for disk encryption.
6462
6463 Once that is done, mount the target root partition under @file{/mnt}
6464 with a command like (again, assuming @file{/dev/sda1} is the root
6465 partition):
6466
6467 @example
6468 mount /dev/sda1 /mnt
6469 @end example
6470
6471 Finally, if you plan to use one or more swap partitions (@pxref{Memory
6472 Concepts, swap space,, libc, The GNU C Library Reference Manual}), make
6473 sure to initialize them with @command{mkswap}. Assuming you have one
6474 swap partition on @file{/dev/sda2}, you would run:
6475
6476 @example
6477 mkswap /dev/sda2
6478 @end example
6479
6480 @node Proceeding with the Installation
6481 @subsection Proceeding with the Installation
6482
6483 With the target partitions ready and the target root mounted on
6484 @file{/mnt}, we're ready to go. First, run:
6485
6486 @example
6487 herd start cow-store /mnt
6488 @end example
6489
6490 This makes @file{/gnu/store} copy-on-write, such that packages added to it
6491 during the installation phase are written to the target disk on @file{/mnt}
6492 rather than kept in memory. This is necessary because the first phase of
6493 the @command{guix system init} command (see below) entails downloads or
6494 builds to @file{/gnu/store} which, initially, is an in-memory file system.
6495
6496 Next, you have to edit a file and
6497 provide the declaration of the operating system to be installed. To
6498 that end, the installation system comes with three text editors: GNU nano
6499 (@pxref{Top,,, nano, GNU nano Manual}), GNU Zile (an Emacs clone), and
6500 nvi (a clone of the original BSD @command{vi} editor).
6501 We strongly recommend storing that file on the target root file system, say,
6502 as @file{/mnt/etc/config.scm}. Failing to do that, you will have lost your
6503 configuration file once you have rebooted into the newly-installed system.
6504
6505 @xref{Using the Configuration System}, for an overview of the
6506 configuration file. The example configurations discussed in that
6507 section are available under @file{/etc/configuration} in the
6508 installation image. Thus, to get started with a system configuration
6509 providing a graphical display server (a ``desktop'' system), you can run
6510 something along these lines:
6511
6512 @example
6513 # mkdir /mnt/etc
6514 # cp /etc/configuration/desktop.scm /mnt/etc/config.scm
6515 # zile /mnt/etc/config.scm
6516 @end example
6517
6518 You should pay attention to what your configuration file contains, and
6519 in particular:
6520
6521 @itemize
6522 @item
6523 Make sure the @code{grub-configuration} form refers to the device you
6524 want to install GRUB on.
6525
6526 @item
6527 Be sure that your partition labels match the value of their respective
6528 @code{device} fields in your @code{file-system} configuration, assuming
6529 your @code{file-system} configuration sets the value of @code{title} to
6530 @code{'label}.
6531 @end itemize
6532
6533 Once you are done preparing the configuration file, the new system must
6534 be initialized (remember that the target root file system is mounted
6535 under @file{/mnt}):
6536
6537 @example
6538 guix system init /mnt/etc/config.scm /mnt
6539 @end example
6540
6541 @noindent
6542 This copies all the necessary files and installs GRUB on
6543 @file{/dev/sdX}, unless you pass the @option{--no-grub} option. For
6544 more information, @pxref{Invoking guix system}. This command may trigger
6545 downloads or builds of missing packages, which can take some time.
6546
6547 Once that command has completed---and hopefully succeeded!---you can run
6548 @command{reboot} and boot into the new system. The @code{root} password
6549 in the new system is initially empty; other users' passwords need to be
6550 initialized by running the @command{passwd} command as @code{root},
6551 unless your configuration specifies otherwise
6552 (@pxref{user-account-password, user account passwords}).
6553
6554 Join us on @code{#guix} on the Freenode IRC network or on
6555 @file{guix-devel@@gnu.org} to share your experience---good or not so
6556 good.
6557
6558 @node Installing GuixSD in a VM
6559 @subsection Installing GuixSD in a Virtual Machine
6560
6561 @cindex virtual machine, GuixSD installation
6562 If you'd like to install GuixSD in a virtual machine (VM) rather than on
6563 your beloved machine, this section is for you.
6564
6565 To boot a @uref{http://qemu.org/,QEMU} VM for installing GuixSD in a
6566 disk image, follow these steps:
6567
6568 @enumerate
6569 @item
6570 First, retrieve the GuixSD installation image as described previously
6571 (@pxref{USB Stick Installation}).
6572
6573 @item
6574 Create a disk image that will hold the installed system. To make a
6575 qcow2-formatted disk image, use the @command{qemu-img} command:
6576
6577 @example
6578 qemu-img create -f qcow2 guixsd.img 5G
6579 @end example
6580
6581 This will create a 5GB file.
6582
6583 @item
6584 Boot the USB installation image in an VM:
6585
6586 @example
6587 qemu-system-x86_64 -m 1024 -smp 1 \
6588 -net default -net nic,model=virtio -boot menu=on \
6589 -drive file=guixsd.img \
6590 -drive file=guixsd-usb-install-@value{VERSION}.@var{system}
6591 @end example
6592
6593 In the VM console, quickly press the @kbd{F12} key to enter the boot
6594 menu. Then press the @kbd{2} key and the @kbd{RET} key to validate your
6595 selection.
6596
6597 @item
6598 You're now root in the VM, proceed with the installation process.
6599 @xref{Preparing for Installation}, and follow the instructions.
6600 @end enumerate
6601
6602 Once installation is complete, you can boot the system that's on your
6603 @file{guixsd.img} image. @xref{Running GuixSD in a VM}, for how to do
6604 that.
6605
6606 @node Building the Installation Image
6607 @subsection Building the Installation Image
6608
6609 The installation image described above was built using the @command{guix
6610 system} command, specifically:
6611
6612 @c FIXME: 1G is too much; see <http://bugs.gnu.org/23077>.
6613 @example
6614 guix system disk-image --image-size=1G gnu/system/install.scm
6615 @end example
6616
6617 Have a look at @file{gnu/system/install.scm} in the source tree,
6618 and see also @ref{Invoking guix system} for more information
6619 about the installation image.
6620
6621 @node System Configuration
6622 @section System Configuration
6623
6624 @cindex system configuration
6625 The Guix System Distribution supports a consistent whole-system configuration
6626 mechanism. By that we mean that all aspects of the global system
6627 configuration---such as the available system services, timezone and
6628 locale settings, user accounts---are declared in a single place. Such
6629 a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected.
6630
6631 One of the advantages of putting all the system configuration under the
6632 control of Guix is that it supports transactional system upgrades, and
6633 makes it possible to roll back to a previous system instantiation,
6634 should something go wrong with the new one (@pxref{Features}). Another
6635 advantage is that it makes it easy to replicate the exact same configuration
6636 across different machines, or at different points in time, without
6637 having to resort to additional administration tools layered on top of
6638 the own tools of the system.
6639 @c Yes, we're talking of Puppet, Chef, & co. here. ↑
6640
6641 This section describes this mechanism. First we focus on the system
6642 administrator's viewpoint---explaining how the system is configured and
6643 instantiated. Then we show how this mechanism can be extended, for
6644 instance to support new system services.
6645
6646 @menu
6647 * Using the Configuration System:: Customizing your GNU system.
6648 * operating-system Reference:: Detail of operating-system declarations.
6649 * File Systems:: Configuring file system mounts.
6650 * Mapped Devices:: Block device extra processing.
6651 * User Accounts:: Specifying user accounts.
6652 * Locales:: Language and cultural convention settings.
6653 * Services:: Specifying system services.
6654 * Setuid Programs:: Programs running with root privileges.
6655 * X.509 Certificates:: Authenticating HTTPS servers.
6656 * Name Service Switch:: Configuring libc's name service switch.
6657 * Initial RAM Disk:: Linux-Libre bootstrapping.
6658 * GRUB Configuration:: Configuring the boot loader.
6659 * Invoking guix system:: Instantiating a system configuration.
6660 * Running GuixSD in a VM:: How to run GuixSD in a virtual machine.
6661 * Defining Services:: Adding new service definitions.
6662 @end menu
6663
6664 @node Using the Configuration System
6665 @subsection Using the Configuration System
6666
6667 The operating system is configured by providing an
6668 @code{operating-system} declaration in a file that can then be passed to
6669 the @command{guix system} command (@pxref{Invoking guix system}). A
6670 simple setup, with the default system services, the default Linux-Libre
6671 kernel, initial RAM disk, and boot loader looks like this:
6672
6673 @findex operating-system
6674 @lisp
6675 @include os-config-bare-bones.texi
6676 @end lisp
6677
6678 This example should be self-describing. Some of the fields defined
6679 above, such as @code{host-name} and @code{bootloader}, are mandatory.
6680 Others, such as @code{packages} and @code{services}, can be omitted, in
6681 which case they get a default value.
6682
6683 Below we discuss the effect of some of the most important fields
6684 (@pxref{operating-system Reference}, for details about all the available
6685 fields), and how to @dfn{instantiate} the operating system using
6686 @command{guix system}.
6687
6688 @unnumberedsubsubsec Globally-Visible Packages
6689
6690 @vindex %base-packages
6691 The @code{packages} field lists packages that will be globally visible
6692 on the system, for all user accounts---i.e., in every user's @code{PATH}
6693 environment variable---in addition to the per-user profiles
6694 (@pxref{Invoking guix package}). The @var{%base-packages} variable
6695 provides all the tools one would expect for basic user and administrator
6696 tasks---including the GNU Core Utilities, the GNU Networking Utilities,
6697 the GNU Zile lightweight text editor, @command{find}, @command{grep},
6698 etc. The example above adds tcpdump to those, taken from the @code{(gnu
6699 packages admin)} module (@pxref{Package Modules}).
6700
6701 @findex specification->package
6702 Referring to packages by variable name, like @var{tcpdump} above, has
6703 the advantage of being unambiguous; it also allows typos and such to be
6704 diagnosed right away as ``unbound variables''. The downside is that one
6705 needs to know which module defines which package, and to augment the
6706 @code{use-package-modules} line accordingly. To avoid that, one can use
6707 the @code{specification->package} procedure of the @code{(gnu packages)}
6708 module, which returns the best package for a given name or name and
6709 version:
6710
6711 @lisp
6712 (use-modules (gnu packages))
6713
6714 (operating-system
6715 ;; ...
6716 (packages (append (map specification->package
6717 '("tcpdump" "htop" "gnupg@@2.0"))
6718 %base-packages)))
6719 @end lisp
6720
6721 @unnumberedsubsubsec System Services
6722
6723 @vindex %base-services
6724 The @code{services} field lists @dfn{system services} to be made
6725 available when the system starts (@pxref{Services}).
6726 The @code{operating-system} declaration above specifies that, in
6727 addition to the basic services, we want the @command{lshd} secure shell
6728 daemon listening on port 2222 (@pxref{Networking Services,
6729 @code{lsh-service}}). Under the hood,
6730 @code{lsh-service} arranges so that @code{lshd} is started with the
6731 right command-line options, possibly with supporting configuration files
6732 generated as needed (@pxref{Defining Services}).
6733
6734 @cindex customization, of services
6735 @findex modify-services
6736 Occasionally, instead of using the base services as is, you will want to
6737 customize them. To do this, use @code{modify-services} (@pxref{Service
6738 Reference, @code{modify-services}}) to modify the list.
6739
6740 For example, suppose you want to modify @code{guix-daemon} and Mingetty
6741 (the console log-in) in the @var{%base-services} list (@pxref{Base
6742 Services, @code{%base-services}}). To do that, you can write the
6743 following in your operating system declaration:
6744
6745 @lisp
6746 (define %my-services
6747 ;; My very own list of services.
6748 (modify-services %base-services
6749 (guix-service-type config =>
6750 (guix-configuration
6751 (inherit config)
6752 (use-substitutes? #f)
6753 (extra-options '("--gc-keep-derivations"))))
6754 (mingetty-service-type config =>
6755 (mingetty-configuration
6756 (inherit config)
6757 (motd (plain-file "motd" "Howdy!"))))))
6758
6759 (operating-system
6760 ;; @dots{}
6761 (services %my-services))
6762 @end lisp
6763
6764 This changes the configuration---i.e., the service parameters---of the
6765 @code{guix-service-type} instance, and that of all the
6766 @code{mingetty-service-type} instances in the @var{%base-services} list.
6767 Observe how this is accomplished: first, we arrange for the original
6768 configuration to be bound to the identifier @code{config} in the
6769 @var{body}, and then we write the @var{body} so that it evaluates to the
6770 desired configuration. In particular, notice how we use @code{inherit}
6771 to create a new configuration which has the same values as the old
6772 configuration, but with a few modifications.
6773
6774 The configuration for a typical ``desktop'' usage, with the X11 display
6775 server, GNOME and Xfce (users can choose which of these desktop
6776 environments to use at the log-in screen by pressing @kbd{F1}), network
6777 management, power management, and more, would look like this:
6778
6779 @lisp
6780 @include os-config-desktop.texi
6781 @end lisp
6782
6783 A graphical environment with a choice of lightweight window managers
6784 instead of full-blown desktop environments would look like this:
6785
6786 @lisp
6787 @include os-config-lightweight-desktop.texi
6788 @end lisp
6789
6790 @xref{Desktop Services}, for the exact list of services provided by
6791 @var{%desktop-services}. @xref{X.509 Certificates}, for background
6792 information about the @code{nss-certs} package that is used here.
6793
6794 Again, @var{%desktop-services} is just a list of service objects. If
6795 you want to remove services from there, you can do so using the
6796 procedures for list filtering (@pxref{SRFI-1 Filtering and
6797 Partitioning,,, guile, GNU Guile Reference Manual}). For instance, the
6798 following expression returns a list that contains all the services in
6799 @var{%desktop-services} minus the Avahi service:
6800
6801 @example
6802 (remove (lambda (service)
6803 (eq? (service-kind service) avahi-service-type))
6804 %desktop-services)
6805 @end example
6806
6807 @unnumberedsubsubsec Instantiating the System
6808
6809 Assuming the @code{operating-system} declaration
6810 is stored in the @file{my-system-config.scm}
6811 file, the @command{guix system reconfigure my-system-config.scm} command
6812 instantiates that configuration, and makes it the default GRUB boot
6813 entry (@pxref{Invoking guix system}).
6814
6815 The normal way to change the system configuration is by updating this
6816 file and re-running @command{guix system reconfigure}. One should never
6817 have to touch files in @command{/etc} or to run commands that modify the
6818 system state such as @command{useradd} or @command{grub-install}. In
6819 fact, you must avoid that since that would not only void your warranty
6820 but also prevent you from rolling back to previous versions of your
6821 system, should you ever need to.
6822
6823 @cindex roll-back, of the operating system
6824 Speaking of roll-back, each time you run @command{guix system
6825 reconfigure}, a new @dfn{generation} of the system is created---without
6826 modifying or deleting previous generations. Old system generations get
6827 an entry in the GRUB boot menu, allowing you to boot them in case
6828 something went wrong with the latest generation. Reassuring, no? The
6829 @command{guix system list-generations} command lists the system
6830 generations available on disk.
6831
6832 @unnumberedsubsubsec The Programming Interface
6833
6834 At the Scheme level, the bulk of an @code{operating-system} declaration
6835 is instantiated with the following monadic procedure (@pxref{The Store
6836 Monad}):
6837
6838 @deffn {Monadic Procedure} operating-system-derivation os
6839 Return a derivation that builds @var{os}, an @code{operating-system}
6840 object (@pxref{Derivations}).
6841
6842 The output of the derivation is a single directory that refers to all
6843 the packages, configuration files, and other supporting files needed to
6844 instantiate @var{os}.
6845 @end deffn
6846
6847 This procedure is provided by the @code{(gnu system)} module. Along
6848 with @code{(gnu services)} (@pxref{Services}), this module contains the
6849 guts of GuixSD. Make sure to visit it!
6850
6851
6852 @node operating-system Reference
6853 @subsection @code{operating-system} Reference
6854
6855 This section summarizes all the options available in
6856 @code{operating-system} declarations (@pxref{Using the Configuration
6857 System}).
6858
6859 @deftp {Data Type} operating-system
6860 This is the data type representing an operating system configuration.
6861 By that, we mean all the global system configuration, not per-user
6862 configuration (@pxref{Using the Configuration System}).
6863
6864 @table @asis
6865 @item @code{kernel} (default: @var{linux-libre})
6866 The package object of the operating system kernel to use@footnote{Currently
6867 only the Linux-libre kernel is supported. In the future, it will be
6868 possible to use the GNU@tie{}Hurd.}.
6869
6870 @item @code{kernel-arguments} (default: @code{'()})
6871 List of strings or gexps representing additional arguments to pass on
6872 the command-line of the kernel---e.g., @code{("console=ttyS0")}.
6873
6874 @item @code{bootloader}
6875 The system bootloader configuration object. @xref{GRUB Configuration}.
6876
6877 @item @code{initrd} (default: @code{base-initrd})
6878 A two-argument monadic procedure that returns an initial RAM disk for
6879 the Linux kernel. @xref{Initial RAM Disk}.
6880
6881 @item @code{firmware} (default: @var{%base-firmware})
6882 @cindex firmware
6883 List of firmware packages loadable by the operating system kernel.
6884
6885 The default includes firmware needed for Atheros-based WiFi devices
6886 (Linux-libre module @code{ath9k}). @xref{Hardware Considerations}, for
6887 more info on supported hardware.
6888
6889 @item @code{host-name}
6890 The host name.
6891
6892 @item @code{hosts-file}
6893 @cindex hosts file
6894 A file-like object (@pxref{G-Expressions, file-like objects}) for use as
6895 @file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library
6896 Reference Manual}). The default is a file with entries for
6897 @code{localhost} and @var{host-name}.
6898
6899 @item @code{mapped-devices} (default: @code{'()})
6900 A list of mapped devices. @xref{Mapped Devices}.
6901
6902 @item @code{file-systems}
6903 A list of file systems. @xref{File Systems}.
6904
6905 @item @code{swap-devices} (default: @code{'()})
6906 @cindex swap devices
6907 A list of strings identifying devices to be used for ``swap space''
6908 (@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}).
6909 For example, @code{'("/dev/sda3")}.
6910
6911 @item @code{users} (default: @code{%base-user-accounts})
6912 @itemx @code{groups} (default: @var{%base-groups})
6913 List of user accounts and groups. @xref{User Accounts}.
6914
6915 @item @code{skeletons} (default: @code{(default-skeletons)})
6916 A list target file name/file-like object tuples (@pxref{G-Expressions,
6917 file-like objects}). These are the skeleton files that will be added to
6918 the home directory of newly-created user accounts.
6919
6920 For instance, a valid value may look like this:
6921
6922 @example
6923 `((".bashrc" ,(plain-file "bashrc" "echo Hello\n"))
6924 (".guile" ,(plain-file "guile"
6925 "(use-modules (ice-9 readline))
6926 (activate-readline)")))
6927 @end example
6928
6929 @item @code{issue} (default: @var{%default-issue})
6930 A string denoting the contents of the @file{/etc/issue} file, which is
6931 displayed when users log in on a text console.
6932
6933 @item @code{packages} (default: @var{%base-packages})
6934 The set of packages installed in the global profile, which is accessible
6935 at @file{/run/current-system/profile}.
6936
6937 The default set includes core utilities and it is good practice to
6938 install non-core utilities in user profiles (@pxref{Invoking guix
6939 package}).
6940
6941 @item @code{timezone}
6942 A timezone identifying string---e.g., @code{"Europe/Paris"}.
6943
6944 You can run the @command{tzselect} command to find out which timezone
6945 string corresponds to your region. Choosing an invalid timezone name
6946 causes @command{guix system} to fail.
6947
6948 @item @code{locale} (default: @code{"en_US.utf8"})
6949 The name of the default locale (@pxref{Locale Names,,, libc, The GNU C
6950 Library Reference Manual}). @xref{Locales}, for more information.
6951
6952 @item @code{locale-definitions} (default: @var{%default-locale-definitions})
6953 The list of locale definitions to be compiled and that may be used at
6954 run time. @xref{Locales}.
6955
6956 @item @code{locale-libcs} (default: @code{(list @var{glibc})})
6957 The list of GNU@tie{}libc packages whose locale data and tools are used
6958 to build the locale definitions. @xref{Locales}, for compatibility
6959 considerations that justify this option.
6960
6961 @item @code{name-service-switch} (default: @var{%default-nss})
6962 Configuration of the libc name service switch (NSS)---a
6963 @code{<name-service-switch>} object. @xref{Name Service Switch}, for
6964 details.
6965
6966 @item @code{services} (default: @var{%base-services})
6967 A list of service objects denoting system services. @xref{Services}.
6968
6969 @item @code{pam-services} (default: @code{(base-pam-services)})
6970 @cindex PAM
6971 @cindex pluggable authentication modules
6972 Linux @dfn{pluggable authentication module} (PAM) services.
6973 @c FIXME: Add xref to PAM services section.
6974
6975 @item @code{setuid-programs} (default: @var{%setuid-programs})
6976 List of string-valued G-expressions denoting setuid programs.
6977 @xref{Setuid Programs}.
6978
6979 @item @code{sudoers-file} (default: @var{%sudoers-specification})
6980 @cindex sudoers file
6981 The contents of the @file{/etc/sudoers} file as a file-like object
6982 (@pxref{G-Expressions, @code{local-file} and @code{plain-file}}).
6983
6984 This file specifies which users can use the @command{sudo} command, what
6985 they are allowed to do, and what privileges they may gain. The default
6986 is that only @code{root} and members of the @code{wheel} group may use
6987 @code{sudo}.
6988
6989 @end table
6990 @end deftp
6991
6992 @node File Systems
6993 @subsection File Systems
6994
6995 The list of file systems to be mounted is specified in the
6996 @code{file-systems} field of the operating system declaration
6997 (@pxref{Using the Configuration System}). Each file system is declared
6998 using the @code{file-system} form, like this:
6999
7000 @example
7001 (file-system
7002 (mount-point "/home")
7003 (device "/dev/sda3")
7004 (type "ext4"))
7005 @end example
7006
7007 As usual, some of the fields are mandatory---those shown in the example
7008 above---while others can be omitted. These are described below.
7009
7010 @deftp {Data Type} file-system
7011 Objects of this type represent file systems to be mounted. They
7012 contain the following members:
7013
7014 @table @asis
7015 @item @code{type}
7016 This is a string specifying the type of the file system---e.g.,
7017 @code{"ext4"}.
7018
7019 @item @code{mount-point}
7020 This designates the place where the file system is to be mounted.
7021
7022 @item @code{device}
7023 This names the ``source'' of the file system. By default it is the name
7024 of a node under @file{/dev}, but its meaning depends on the @code{title}
7025 field described below.
7026
7027 @item @code{title} (default: @code{'device})
7028 This is a symbol that specifies how the @code{device} field is to be
7029 interpreted.
7030
7031 When it is the symbol @code{device}, then the @code{device} field is
7032 interpreted as a file name; when it is @code{label}, then @code{device}
7033 is interpreted as a partition label name; when it is @code{uuid},
7034 @code{device} is interpreted as a partition unique identifier (UUID).
7035
7036 UUIDs may be converted from their string representation (as shown by the
7037 @command{tune2fs -l} command) using the @code{uuid} form@footnote{The
7038 @code{uuid} form expects 16-byte UUIDs as defined in
7039 @uref{https://tools.ietf.org/html/rfc4122, RFC@tie{}4122}. This is the
7040 form of UUID used by the ext2 family of file systems and others, but it
7041 is different from ``UUIDs'' found in FAT file systems, for instance.},
7042 like this:
7043
7044 @example
7045 (file-system
7046 (mount-point "/home")
7047 (type "ext4")
7048 (title 'uuid)
7049 (device (uuid "4dab5feb-d176-45de-b287-9b0a6e4c01cb")))
7050 @end example
7051
7052 The @code{label} and @code{uuid} options offer a way to refer to disk
7053 partitions without having to hard-code their actual device
7054 name@footnote{Note that, while it is tempting to use
7055 @file{/dev/disk/by-uuid} and similar device names to achieve the same
7056 result, this is not recommended: These special device nodes are created
7057 by the udev daemon and may be unavailable at the time the device is
7058 mounted.}.
7059
7060 However, when the source of a file system is a mapped device (@pxref{Mapped
7061 Devices}), its @code{device} field @emph{must} refer to the mapped
7062 device name---e.g., @file{/dev/mapper/root-partition}---and consequently
7063 @code{title} must be set to @code{'device}. This is required so that
7064 the system knows that mounting the file system depends on having the
7065 corresponding device mapping established.
7066
7067 @item @code{flags} (default: @code{'()})
7068 This is a list of symbols denoting mount flags. Recognized flags
7069 include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow
7070 access to special files), @code{no-suid} (ignore setuid and setgid
7071 bits), and @code{no-exec} (disallow program execution.)
7072
7073 @item @code{options} (default: @code{#f})
7074 This is either @code{#f}, or a string denoting mount options.
7075
7076 @item @code{mount?} (default: @code{#t})
7077 This value indicates whether to automatically mount the file system when
7078 the system is brought up. When set to @code{#f}, the file system gets
7079 an entry in @file{/etc/fstab} (read by the @command{mount} command) but
7080 is not automatically mounted.
7081
7082 @item @code{needed-for-boot?} (default: @code{#f})
7083 This Boolean value indicates whether the file system is needed when
7084 booting. If that is true, then the file system is mounted when the
7085 initial RAM disk (initrd) is loaded. This is always the case, for
7086 instance, for the root file system.
7087
7088 @item @code{check?} (default: @code{#t})
7089 This Boolean indicates whether the file system needs to be checked for
7090 errors before being mounted.
7091
7092 @item @code{create-mount-point?} (default: @code{#f})
7093 When true, the mount point is created if it does not exist yet.
7094
7095 @item @code{dependencies} (default: @code{'()})
7096 This is a list of @code{<file-system>} objects representing file systems
7097 that must be mounted before (and unmounted after) this one.
7098
7099 As an example, consider a hierarchy of mounts: @file{/sys/fs/cgroup} is
7100 a dependency of @file{/sys/fs/cgroup/cpu} and
7101 @file{/sys/fs/cgroup/memory}.
7102
7103 @end table
7104 @end deftp
7105
7106 The @code{(gnu system file-systems)} exports the following useful
7107 variables.
7108
7109 @defvr {Scheme Variable} %base-file-systems
7110 These are essential file systems that are required on normal systems,
7111 such as @var{%pseudo-terminal-file-system} and @var{%immutable-store} (see
7112 below.) Operating system declarations should always contain at least
7113 these.
7114 @end defvr
7115
7116 @defvr {Scheme Variable} %pseudo-terminal-file-system
7117 This is the file system to be mounted as @file{/dev/pts}. It supports
7118 @dfn{pseudo-terminals} created @i{via} @code{openpty} and similar
7119 functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference
7120 Manual}). Pseudo-terminals are used by terminal emulators such as
7121 @command{xterm}.
7122 @end defvr
7123
7124 @defvr {Scheme Variable} %shared-memory-file-system
7125 This file system is mounted as @file{/dev/shm} and is used to support
7126 memory sharing across processes (@pxref{Memory-mapped I/O,
7127 @code{shm_open},, libc, The GNU C Library Reference Manual}).
7128 @end defvr
7129
7130 @defvr {Scheme Variable} %immutable-store
7131 This file system performs a read-only ``bind mount'' of
7132 @file{/gnu/store}, making it read-only for all the users including
7133 @code{root}. This prevents against accidental modification by software
7134 running as @code{root} or by system administrators.
7135
7136 The daemon itself is still able to write to the store: it remounts it
7137 read-write in its own ``name space.''
7138 @end defvr
7139
7140 @defvr {Scheme Variable} %binary-format-file-system
7141 The @code{binfmt_misc} file system, which allows handling of arbitrary
7142 executable file types to be delegated to user space. This requires the
7143 @code{binfmt.ko} kernel module to be loaded.
7144 @end defvr
7145
7146 @defvr {Scheme Variable} %fuse-control-file-system
7147 The @code{fusectl} file system, which allows unprivileged users to mount
7148 and unmount user-space FUSE file systems. This requires the
7149 @code{fuse.ko} kernel module to be loaded.
7150 @end defvr
7151
7152 @node Mapped Devices
7153 @subsection Mapped Devices
7154
7155 @cindex device mapping
7156 @cindex mapped devices
7157 The Linux kernel has a notion of @dfn{device mapping}: a block device,
7158 such as a hard disk partition, can be @dfn{mapped} into another device,
7159 usually in @code{/dev/mapper/},
7160 with additional processing over the data that flows through
7161 it@footnote{Note that the GNU@tie{}Hurd makes no difference between the
7162 concept of a ``mapped device'' and that of a file system: both boil down
7163 to @emph{translating} input/output operations made on a file to
7164 operations on its backing store. Thus, the Hurd implements mapped
7165 devices, like file systems, using the generic @dfn{translator} mechanism
7166 (@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A
7167 typical example is encryption device mapping: all writes to the mapped
7168 device are encrypted, and all reads are deciphered, transparently.
7169 Guix extends this notion by considering any device or set of devices that
7170 are @dfn{transformed} in some way to create a new device; for instance,
7171 RAID devices are obtained by @dfn{assembling} several other devices, such
7172 as hard disks or partitions, into a new one that behaves as one partition.
7173 Other examples, not yet implemented, are LVM logical volumes.
7174
7175 Mapped devices are declared using the @code{mapped-device} form,
7176 defined as follows; for examples, see below.
7177
7178 @deftp {Data Type} mapped-device
7179 Objects of this type represent device mappings that will be made when
7180 the system boots up.
7181
7182 @table @code
7183 @item source
7184 This is either a string specifying the name of the block device to be mapped,
7185 such as @code{"/dev/sda3"}, or a list of such strings when several devices
7186 need to be assembled for creating a new one.
7187
7188 @item target
7189 This string specifies the name of the resulting mapped device. For
7190 kernel mappers such as encrypted devices of type @code{luks-device-mapping},
7191 specifying @code{"my-partition"} leads to the creation of
7192 the @code{"/dev/mapper/my-partition"} device.
7193 For RAID devices of type @code{raid-device-mapping}, the full device name
7194 such as @code{"/dev/md0"} needs to be given.
7195
7196 @item type
7197 This must be a @code{mapped-device-kind} object, which specifies how
7198 @var{source} is mapped to @var{target}.
7199 @end table
7200 @end deftp
7201
7202 @defvr {Scheme Variable} luks-device-mapping
7203 This defines LUKS block device encryption using the @command{cryptsetup}
7204 command from the package with the same name. It relies on the
7205 @code{dm-crypt} Linux kernel module.
7206 @end defvr
7207
7208 @defvr {Scheme Variable} raid-device-mapping
7209 This defines a RAID device, which is assembled using the @code{mdadm}
7210 command from the package with the same name. It requires a Linux kernel
7211 module for the appropriate RAID level to be loaded, such as @code{raid456}
7212 for RAID-4, RAID-5 or RAID-6, or @code{raid10} for RAID-10.
7213 @end defvr
7214
7215 @cindex disk encryption
7216 @cindex LUKS
7217 The following example specifies a mapping from @file{/dev/sda3} to
7218 @file{/dev/mapper/home} using LUKS---the
7219 @url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a
7220 standard mechanism for disk encryption.
7221 The @file{/dev/mapper/home}
7222 device can then be used as the @code{device} of a @code{file-system}
7223 declaration (@pxref{File Systems}).
7224
7225 @example
7226 (mapped-device
7227 (source "/dev/sda3")
7228 (target "home")
7229 (type luks-device-mapping))
7230 @end example
7231
7232 Alternatively, to become independent of device numbering, one may obtain
7233 the LUKS UUID (@dfn{unique identifier}) of the source device by a
7234 command like:
7235
7236 @example
7237 cryptsetup luksUUID /dev/sda3
7238 @end example
7239
7240 and use it as follows:
7241
7242 @example
7243 (mapped-device
7244 (source (uuid "cb67fc72-0d54-4c88-9d4b-b225f30b0f44"))
7245 (target "home")
7246 (type luks-device-mapping))
7247 @end example
7248
7249 A RAID device formed of the partitions @file{/dev/sda1} and @file{/dev/sdb1}
7250 may be declared as follows:
7251
7252 @example
7253 (mapped-device
7254 (source (list "/dev/sda1" "/dev/sdb1"))
7255 (target "/dev/md0")
7256 (type raid-device-mapping))
7257 @end example
7258
7259 The @file{/dev/md0} device can then be used as the @code{device} of a
7260 @code{file-system} declaration (@pxref{File Systems}).
7261 Note that the RAID level need not be given; it is chosen during the
7262 initial creation and formatting of the RAID device and is determined
7263 automatically later.
7264
7265
7266 @node User Accounts
7267 @subsection User Accounts
7268
7269 User accounts and groups are entirely managed through the
7270 @code{operating-system} declaration. They are specified with the
7271 @code{user-account} and @code{user-group} forms:
7272
7273 @example
7274 (user-account
7275 (name "alice")
7276 (group "users")
7277 (supplementary-groups '("wheel" ;allow use of sudo, etc.
7278 "audio" ;sound card
7279 "video" ;video devices such as webcams
7280 "cdrom")) ;the good ol' CD-ROM
7281 (comment "Bob's sister")
7282 (home-directory "/home/alice"))
7283 @end example
7284
7285 When booting or upon completion of @command{guix system reconfigure},
7286 the system ensures that only the user accounts and groups specified in
7287 the @code{operating-system} declaration exist, and with the specified
7288 properties. Thus, account or group creations or modifications made by
7289 directly invoking commands such as @command{useradd} are lost upon
7290 reconfiguration or reboot. This ensures that the system remains exactly
7291 as declared.
7292
7293 @deftp {Data Type} user-account
7294 Objects of this type represent user accounts. The following members may
7295 be specified:
7296
7297 @table @asis
7298 @item @code{name}
7299 The name of the user account.
7300
7301 @item @code{group}
7302 This is the name (a string) or identifier (a number) of the user group
7303 this account belongs to.
7304
7305 @item @code{supplementary-groups} (default: @code{'()})
7306 Optionally, this can be defined as a list of group names that this
7307 account belongs to.
7308
7309 @item @code{uid} (default: @code{#f})
7310 This is the user ID for this account (a number), or @code{#f}. In the
7311 latter case, a number is automatically chosen by the system when the
7312 account is created.
7313
7314 @item @code{comment} (default: @code{""})
7315 A comment about the account, such as the account owner's full name.
7316
7317 @item @code{home-directory}
7318 This is the name of the home directory for the account.
7319
7320 @item @code{create-home-directory?} (default: @code{#t})
7321 Indicates whether the home directory of this account should be created
7322 if it does not exist yet.
7323
7324 @item @code{shell} (default: Bash)
7325 This is a G-expression denoting the file name of a program to be used as
7326 the shell (@pxref{G-Expressions}).
7327
7328 @item @code{system?} (default: @code{#f})
7329 This Boolean value indicates whether the account is a ``system''
7330 account. System accounts are sometimes treated specially; for instance,
7331 graphical login managers do not list them.
7332
7333 @anchor{user-account-password}
7334 @item @code{password} (default: @code{#f})
7335 You would normally leave this field to @code{#f}, initialize user
7336 passwords as @code{root} with the @command{passwd} command, and then let
7337 users change it with @command{passwd}. Passwords set with
7338 @command{passwd} are of course preserved across reboot and
7339 reconfiguration.
7340
7341 If you @emph{do} want to have a preset password for an account, then
7342 this field must contain the encrypted password, as a string.
7343 @xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information
7344 on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference
7345 Manual}, for information on Guile's @code{crypt} procedure.
7346
7347 @end table
7348 @end deftp
7349
7350 User group declarations are even simpler:
7351
7352 @example
7353 (user-group (name "students"))
7354 @end example
7355
7356 @deftp {Data Type} user-group
7357 This type is for, well, user groups. There are just a few fields:
7358
7359 @table @asis
7360 @item @code{name}
7361 The name of the group.
7362
7363 @item @code{id} (default: @code{#f})
7364 The group identifier (a number). If @code{#f}, a new number is
7365 automatically allocated when the group is created.
7366
7367 @item @code{system?} (default: @code{#f})
7368 This Boolean value indicates whether the group is a ``system'' group.
7369 System groups have low numerical IDs.
7370
7371 @item @code{password} (default: @code{#f})
7372 What, user groups can have a password? Well, apparently yes. Unless
7373 @code{#f}, this field specifies the password of the group.
7374
7375 @end table
7376 @end deftp
7377
7378 For convenience, a variable lists all the basic user groups one may
7379 expect:
7380
7381 @defvr {Scheme Variable} %base-groups
7382 This is the list of basic user groups that users and/or packages expect
7383 to be present on the system. This includes groups such as ``root'',
7384 ``wheel'', and ``users'', as well as groups used to control access to
7385 specific devices such as ``audio'', ``disk'', and ``cdrom''.
7386 @end defvr
7387
7388 @defvr {Scheme Variable} %base-user-accounts
7389 This is the list of basic system accounts that programs may expect to
7390 find on a GNU/Linux system, such as the ``nobody'' account.
7391
7392 Note that the ``root'' account is not included here. It is a
7393 special-case and is automatically added whether or not it is specified.
7394 @end defvr
7395
7396 @node Locales
7397 @subsection Locales
7398
7399 @cindex locale
7400 A @dfn{locale} defines cultural conventions for a particular language
7401 and region of the world (@pxref{Locales,,, libc, The GNU C Library
7402 Reference Manual}). Each locale has a name that typically has the form
7403 @code{@var{language}_@var{territory}.@var{codeset}}---e.g.,
7404 @code{fr_LU.utf8} designates the locale for the French language, with
7405 cultural conventions from Luxembourg, and using the UTF-8 encoding.
7406
7407 @cindex locale definition
7408 Usually, you will want to specify the default locale for the machine
7409 using the @code{locale} field of the @code{operating-system} declaration
7410 (@pxref{operating-system Reference, @code{locale}}).
7411
7412 The selected locale is automatically added to the @dfn{locale
7413 definitions} known to the system if needed, with its codeset inferred
7414 from its name---e.g., @code{bo_CN.utf8} will be assumed to use the
7415 @code{UTF-8} codeset. Additional locale definitions can be specified in
7416 the @code{locale-definitions} slot of @code{operating-system}---this is
7417 useful, for instance, if the codeset could not be inferred from the
7418 locale name. The default set of locale definitions includes some widely
7419 used locales, but not all the available locales, in order to save space.
7420
7421 For instance, to add the North Frisian locale for Germany, the value of
7422 that field may be:
7423
7424 @example
7425 (cons (locale-definition
7426 (name "fy_DE.utf8") (source "fy_DE"))
7427 %default-locale-definitions)
7428 @end example
7429
7430 Likewise, to save space, one might want @code{locale-definitions} to
7431 list only the locales that are actually used, as in:
7432
7433 @example
7434 (list (locale-definition
7435 (name "ja_JP.eucjp") (source "ja_JP")
7436 (charset "EUC-JP")))
7437 @end example
7438
7439 @vindex LOCPATH
7440 The compiled locale definitions are available at
7441 @file{/run/current-system/locale/X.Y}, where @code{X.Y} is the libc
7442 version, which is the default location where the GNU@tie{}libc provided
7443 by Guix looks for locale data. This can be overridden using the
7444 @code{LOCPATH} environment variable (@pxref{locales-and-locpath,
7445 @code{LOCPATH} and locale packages}).
7446
7447 The @code{locale-definition} form is provided by the @code{(gnu system
7448 locale)} module. Details are given below.
7449
7450 @deftp {Data Type} locale-definition
7451 This is the data type of a locale definition.
7452
7453 @table @asis
7454
7455 @item @code{name}
7456 The name of the locale. @xref{Locale Names,,, libc, The GNU C Library
7457 Reference Manual}, for more information on locale names.
7458
7459 @item @code{source}
7460 The name of the source for that locale. This is typically the
7461 @code{@var{language}_@var{territory}} part of the locale name.
7462
7463 @item @code{charset} (default: @code{"UTF-8"})
7464 The ``character set'' or ``code set'' for that locale,
7465 @uref{http://www.iana.org/assignments/character-sets, as defined by
7466 IANA}.
7467
7468 @end table
7469 @end deftp
7470
7471 @defvr {Scheme Variable} %default-locale-definitions
7472 A list of commonly used UTF-8 locales, used as the default
7473 value of the @code{locale-definitions} field of @code{operating-system}
7474 declarations.
7475
7476 @cindex locale name
7477 @cindex normalized codeset in locale names
7478 These locale definitions use the @dfn{normalized codeset} for the part
7479 that follows the dot in the name (@pxref{Using gettextized software,
7480 normalized codeset,, libc, The GNU C Library Reference Manual}). So for
7481 instance it has @code{uk_UA.utf8} but @emph{not}, say,
7482 @code{uk_UA.UTF-8}.
7483 @end defvr
7484
7485 @subsubsection Locale Data Compatibility Considerations
7486
7487 @cindex incompatibility, of locale data
7488 @code{operating-system} declarations provide a @code{locale-libcs} field
7489 to specify the GNU@tie{}libc packages that are used to compile locale
7490 declarations (@pxref{operating-system Reference}). ``Why would I
7491 care?'', you may ask. Well, it turns out that the binary format of
7492 locale data is occasionally incompatible from one libc version to
7493 another.
7494
7495 @c See <https://sourceware.org/ml/libc-alpha/2015-09/msg00575.html>
7496 @c and <https://lists.gnu.org/archive/html/guix-devel/2015-08/msg00737.html>.
7497 For instance, a program linked against libc version 2.21 is unable to
7498 read locale data produced with libc 2.22; worse, that program
7499 @emph{aborts} instead of simply ignoring the incompatible locale
7500 data@footnote{Versions 2.23 and later of GNU@tie{}libc will simply skip
7501 the incompatible locale data, which is already an improvement.}.
7502 Similarly, a program linked against libc 2.22 can read most, but not
7503 all, of the locale data from libc 2.21 (specifically, @code{LC_COLLATE}
7504 data is incompatible); thus calls to @code{setlocale} may fail, but
7505 programs will not abort.
7506
7507 The ``problem'' in GuixSD is that users have a lot of freedom: They can
7508 choose whether and when to upgrade software in their profiles, and might
7509 be using a libc version different from the one the system administrator
7510 used to build the system-wide locale data.
7511
7512 Fortunately, unprivileged users can also install their own locale data
7513 and define @var{GUIX_LOCPATH} accordingly (@pxref{locales-and-locpath,
7514 @code{GUIX_LOCPATH} and locale packages}).
7515
7516 Still, it is best if the system-wide locale data at
7517 @file{/run/current-system/locale} is built for all the libc versions
7518 actually in use on the system, so that all the programs can access
7519 it---this is especially crucial on a multi-user system. To do that, the
7520 administrator can specify several libc packages in the
7521 @code{locale-libcs} field of @code{operating-system}:
7522
7523 @example
7524 (use-package-modules base)
7525
7526 (operating-system
7527 ;; @dots{}
7528 (locale-libcs (list glibc-2.21 (canonical-package glibc))))
7529 @end example
7530
7531 This example would lead to a system containing locale definitions for
7532 both libc 2.21 and the current version of libc in
7533 @file{/run/current-system/locale}.
7534
7535
7536 @node Services
7537 @subsection Services
7538
7539 @cindex system services
7540 An important part of preparing an @code{operating-system} declaration is
7541 listing @dfn{system services} and their configuration (@pxref{Using the
7542 Configuration System}). System services are typically daemons launched
7543 when the system boots, or other actions needed at that time---e.g.,
7544 configuring network access.
7545
7546 GuixSD has a broad definition of ``service'' (@pxref{Service
7547 Composition}), but many services are managed by the GNU@tie{}Shepherd
7548 (@pxref{Shepherd Services}). On a running system, the @command{herd}
7549 command allows you to list the available services, show their status,
7550 start and stop them, or do other specific operations (@pxref{Jump
7551 Start,,, shepherd, The GNU Shepherd Manual}). For example:
7552
7553 @example
7554 # herd status
7555 @end example
7556
7557 The above command, run as @code{root}, lists the currently defined
7558 services. The @command{herd doc} command shows a synopsis of the given
7559 service:
7560
7561 @example
7562 # herd doc nscd
7563 Run libc's name service cache daemon (nscd).
7564 @end example
7565
7566 The @command{start}, @command{stop}, and @command{restart} sub-commands
7567 have the effect you would expect. For instance, the commands below stop
7568 the nscd service and restart the Xorg display server:
7569
7570 @example
7571 # herd stop nscd
7572 Service nscd has been stopped.
7573 # herd restart xorg-server
7574 Service xorg-server has been stopped.
7575 Service xorg-server has been started.
7576 @end example
7577
7578 The following sections document the available services, starting with
7579 the core services, that may be used in an @code{operating-system}
7580 declaration.
7581
7582 @menu
7583 * Base Services:: Essential system services.
7584 * Scheduled Job Execution:: The mcron service.
7585 * Networking Services:: Network setup, SSH daemon, etc.
7586 * X Window:: Graphical display.
7587 * Desktop Services:: D-Bus and desktop services.
7588 * Database Services:: SQL databases.
7589 * Mail Services:: IMAP, POP3, SMTP, and all that.
7590 * Web Services:: Web servers.
7591 * Various Services:: Other services.
7592 @end menu
7593
7594 @node Base Services
7595 @subsubsection Base Services
7596
7597 The @code{(gnu services base)} module provides definitions for the basic
7598 services that one expects from the system. The services exported by
7599 this module are listed below.
7600
7601 @defvr {Scheme Variable} %base-services
7602 This variable contains a list of basic services (@pxref{Service Types
7603 and Services}, for more information on service objects) one would
7604 expect from the system: a login service (mingetty) on each tty, syslogd,
7605 the libc name service cache daemon (nscd), the udev device manager, and
7606 more.
7607
7608 This is the default value of the @code{services} field of
7609 @code{operating-system} declarations. Usually, when customizing a
7610 system, you will want to append services to @var{%base-services}, like
7611 this:
7612
7613 @example
7614 (cons* (avahi-service) (lsh-service) %base-services)
7615 @end example
7616 @end defvr
7617
7618 @deffn {Scheme Procedure} host-name-service @var{name}
7619 Return a service that sets the host name to @var{name}.
7620 @end deffn
7621
7622 @deffn {Scheme Procedure} mingetty-service @var{config}
7623 Return a service to run mingetty according to @var{config}, a
7624 @code{<mingetty-configuration>} object, which specifies the tty to run, among
7625 other things.
7626 @end deffn
7627
7628 @deftp {Data Type} mingetty-configuration
7629 This is the data type representing the configuration of Mingetty, which
7630 implements console log-in.
7631
7632 @table @asis
7633
7634 @item @code{tty}
7635 The name of the console this Mingetty runs on---e.g., @code{"tty1"}.
7636
7637 @item @code{motd}
7638 A file-like object containing the ``message of the day''.
7639
7640 @item @code{auto-login} (default: @code{#f})
7641 When true, this field must be a string denoting the user name under
7642 which the system automatically logs in. When it is @code{#f}, a
7643 user name and password must be entered to log in.
7644
7645 @item @code{login-program} (default: @code{#f})
7646 This must be either @code{#f}, in which case the default log-in program
7647 is used (@command{login} from the Shadow tool suite), or a gexp denoting
7648 the name of the log-in program.
7649
7650 @item @code{login-pause?} (default: @code{#f})
7651 When set to @code{#t} in conjunction with @var{auto-login}, the user
7652 will have to press a key before the log-in shell is launched.
7653
7654 @item @code{mingetty} (default: @var{mingetty})
7655 The Mingetty package to use.
7656
7657 @end table
7658 @end deftp
7659
7660 @cindex name service cache daemon
7661 @cindex nscd
7662 @deffn {Scheme Procedure} nscd-service [@var{config}] [#:glibc glibc] @
7663 [#:name-services '()]
7664 Return a service that runs the libc name service cache daemon (nscd) with the
7665 given @var{config}---an @code{<nscd-configuration>} object. @xref{Name
7666 Service Switch}, for an example.
7667 @end deffn
7668
7669 @defvr {Scheme Variable} %nscd-default-configuration
7670 This is the default @code{<nscd-configuration>} value (see below) used
7671 by @code{nscd-service}. It uses the caches defined by
7672 @var{%nscd-default-caches}; see below.
7673 @end defvr
7674
7675 @deftp {Data Type} nscd-configuration
7676 This is the data type representing the name service cache daemon (nscd)
7677 configuration.
7678
7679 @table @asis
7680
7681 @item @code{name-services} (default: @code{'()})
7682 List of packages denoting @dfn{name services} that must be visible to
7683 the nscd---e.g., @code{(list @var{nss-mdns})}.
7684
7685 @item @code{glibc} (default: @var{glibc})
7686 Package object denoting the GNU C Library providing the @command{nscd}
7687 command.
7688
7689 @item @code{log-file} (default: @code{"/var/log/nscd.log"})
7690 Name of the nscd log file. This is where debugging output goes when
7691 @code{debug-level} is strictly positive.
7692
7693 @item @code{debug-level} (default: @code{0})
7694 Integer denoting the debugging levels. Higher numbers mean that more
7695 debugging output is logged.
7696
7697 @item @code{caches} (default: @var{%nscd-default-caches})
7698 List of @code{<nscd-cache>} objects denoting things to be cached; see
7699 below.
7700
7701 @end table
7702 @end deftp
7703
7704 @deftp {Data Type} nscd-cache
7705 Data type representing a cache database of nscd and its parameters.
7706
7707 @table @asis
7708
7709 @item @code{database}
7710 This is a symbol representing the name of the database to be cached.
7711 Valid values are @code{passwd}, @code{group}, @code{hosts}, and
7712 @code{services}, which designate the corresponding NSS database
7713 (@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}).
7714
7715 @item @code{positive-time-to-live}
7716 @itemx @code{negative-time-to-live} (default: @code{20})
7717 A number representing the number of seconds during which a positive or
7718 negative lookup result remains in cache.
7719
7720 @item @code{check-files?} (default: @code{#t})
7721 Whether to check for updates of the files corresponding to
7722 @var{database}.
7723
7724 For instance, when @var{database} is @code{hosts}, setting this flag
7725 instructs nscd to check for updates in @file{/etc/hosts} and to take
7726 them into account.
7727
7728 @item @code{persistent?} (default: @code{#t})
7729 Whether the cache should be stored persistently on disk.
7730
7731 @item @code{shared?} (default: @code{#t})
7732 Whether the cache should be shared among users.
7733
7734 @item @code{max-database-size} (default: 32@tie{}MiB)
7735 Maximum size in bytes of the database cache.
7736
7737 @c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert
7738 @c settings, so leave them out.
7739
7740 @end table
7741 @end deftp
7742
7743 @defvr {Scheme Variable} %nscd-default-caches
7744 List of @code{<nscd-cache>} objects used by default by
7745 @code{nscd-configuration} (see above).
7746
7747 It enables persistent and aggressive caching of service and host name
7748 lookups. The latter provides better host name lookup performance,
7749 resilience in the face of unreliable name servers, and also better
7750 privacy---often the result of host name lookups is in local cache, so
7751 external name servers do not even need to be queried.
7752 @end defvr
7753
7754 @anchor{syslog-configuration-type}
7755 @deftp {Data Type} syslog-configuration
7756 This data type represents the configuration of the syslog daemon.
7757
7758 @table @asis
7759 @item @code{syslogd} (default: @code{#~(string-append #$inetutils "/libexec/syslogd")})
7760 The syslog daemon to use.
7761
7762 @item @code{config-file} (default: @code{%default-syslog.conf})
7763 The syslog configuration file to use.
7764
7765 @end table
7766 @end deftp
7767
7768 @anchor{syslog-service}
7769 @deffn {Scheme Procedure} syslog-service @var{config}
7770 Return a service that runs a syslog daemon according to @var{config}.
7771
7772 @xref{syslogd invocation,,, inetutils, GNU Inetutils}, for more
7773 information on the configuration file syntax.
7774 @end deffn
7775
7776 @anchor{guix-configuration-type}
7777 @deftp {Data Type} guix-configuration
7778 This data type represents the configuration of the Guix build daemon.
7779 @xref{Invoking guix-daemon}, for more information.
7780
7781 @table @asis
7782 @item @code{guix} (default: @var{guix})
7783 The Guix package to use.
7784
7785 @item @code{build-group} (default: @code{"guixbuild"})
7786 Name of the group for build user accounts.
7787
7788 @item @code{build-accounts} (default: @code{10})
7789 Number of build user accounts to create.
7790
7791 @item @code{authorize-key?} (default: @code{#t})
7792 Whether to authorize the substitute keys listed in
7793 @code{authorized-keys}---by default that of @code{hydra.gnu.org}
7794 (@pxref{Substitutes}).
7795
7796 @vindex %default-authorized-guix-keys
7797 @item @code{authorized-keys} (default: @var{%default-authorized-guix-keys})
7798 The list of authorized key files for archive imports, as a list of
7799 string-valued gexps (@pxref{Invoking guix archive}). By default, it
7800 contains that of @code{hydra.gnu.org} (@pxref{Substitutes}).
7801
7802 @item @code{use-substitutes?} (default: @code{#t})
7803 Whether to use substitutes.
7804
7805 @item @code{substitute-urls} (default: @var{%default-substitute-urls})
7806 The list of URLs where to look for substitutes by default.
7807
7808 @item @code{extra-options} (default: @code{'()})
7809 List of extra command-line options for @command{guix-daemon}.
7810
7811 @item @code{lsof} (default: @var{lsof})
7812 @itemx @code{lsh} (default: @var{lsh})
7813 The lsof and lsh packages to use.
7814
7815 @end table
7816 @end deftp
7817
7818 @deffn {Scheme Procedure} guix-service @var{config}
7819 Return a service that runs the Guix build daemon according to
7820 @var{config}.
7821 @end deffn
7822
7823 @deffn {Scheme Procedure} udev-service [#:udev udev]
7824 Run @var{udev}, which populates the @file{/dev} directory dynamically.
7825 @end deffn
7826
7827 @deffn {Scheme Procedure} urandom-seed-service @var{#f}
7828 Save some entropy in @var{%random-seed-file} to seed @file{/dev/urandom}
7829 when rebooting.
7830 @end deffn
7831
7832 @defvr {Scheme Variable} %random-seed-file
7833 This is the name of the file where some random bytes are saved by
7834 @var{urandom-seed-service} to seed @file{/dev/urandom} when rebooting.
7835 It defaults to @file{/var/lib/random-seed}.
7836 @end defvr
7837
7838 @deffn {Scheme Procedure} console-keymap-service @var{files} ...
7839 @cindex keyboard layout
7840 Return a service to load console keymaps from @var{files} using
7841 @command{loadkeys} command. Most likely, you want to load some default
7842 keymap, which can be done like this:
7843
7844 @example
7845 (console-keymap-service "dvorak")
7846 @end example
7847
7848 Or, for example, for a Swedish keyboard, you may need to combine
7849 the following keymaps:
7850 @example
7851 (console-keymap-service "se-lat6" "se-fi-lat6")
7852 @end example
7853
7854 Also you can specify a full file name (or file names) of your keymap(s).
7855 See @code{man loadkeys} for details.
7856
7857 @end deffn
7858
7859 @deffn {Scheme Procedure} gpm-service [#:gpm @var{gpm}] @
7860 [#:options]
7861 Run @var{gpm}, the general-purpose mouse daemon, with the given
7862 command-line @var{options}. GPM allows users to use the mouse in the console,
7863 notably to select, copy, and paste text. The default value of @var{options}
7864 uses the @code{ps2} protocol, which works for both USB and PS/2 mice.
7865
7866 This service is not part of @var{%base-services}.
7867 @end deffn
7868
7869 @anchor{guix-publish-service}
7870 @deffn {Scheme Procedure} guix-publish-service [#:guix @var{guix}] @
7871 [#:port 80] [#:host "localhost"]
7872 Return a service that runs @command{guix publish} listening on @var{host}
7873 and @var{port} (@pxref{Invoking guix publish}).
7874
7875 This assumes that @file{/etc/guix} already contains a signing key pair as
7876 created by @command{guix archive --generate-key} (@pxref{Invoking guix
7877 archive}). If that is not the case, the service will fail to start.
7878 @end deffn
7879
7880 @anchor{rngd-service}
7881 @deffn {Scheme Procedure} rngd-service [#:rng-tools @var{rng-tools}] @
7882 [#:device "/dev/hwrng"]
7883 Return a service that runs the @command{rngd} program from @var{rng-tools}
7884 to add @var{device} to the kernel's entropy pool. The service will fail if
7885 @var{device} does not exist.
7886 @end deffn
7887
7888 @anchor{pam-limits-service}
7889 @cindex session limits
7890 @cindex ulimit
7891 @cindex priority
7892 @deffn {Scheme Procedure} pam-limits-service [#:limits @var{limits}]
7893
7894 Return a service that installs a configuration file for the
7895 @uref{http://linux-pam.org/Linux-PAM-html/sag-pam_limits.html,
7896 @code{pam_limits} module}. The procedure optionally takes a list of
7897 @code{pam-limits-entry} values, which can be used to specify
7898 @code{ulimit} limits and nice priority limits to user sessions.
7899
7900 The following limits definition sets two hard and soft limits for all
7901 login sessions of users in the @code{realtime} group:
7902
7903 @example
7904 (pam-limits-service
7905 (list
7906 (pam-limits-entry "@@realtime" 'both 'rtprio 99)
7907 (pam-limits-entry "@@realtime" 'both 'memlock 'unlimited)))
7908 @end example
7909
7910 The first entry increases the maximum realtime priority for
7911 non-privileged processes; the second entry lifts any restriction of the
7912 maximum address space that can be locked in memory. These settings are
7913 commonly used for real-time audio systems.
7914 @end deffn
7915
7916 @node Scheduled Job Execution
7917 @subsubsection Scheduled Job Execution
7918
7919 @cindex cron
7920 @cindex scheduling jobs
7921 The @code{(gnu services mcron)} module provides an interface to
7922 GNU@tie{}mcron, a daemon to run jobs at scheduled times (@pxref{Top,,,
7923 mcron, GNU@tie{}mcron}). GNU@tie{}mcron is similar to the traditional
7924 Unix @command{cron} daemon; the main difference is that it is
7925 implemented in Guile Scheme, which provides a lot of flexibility when
7926 specifying the scheduling of jobs and their actions.
7927
7928 The example below defines an operating system that runs the
7929 @command{updatedb} (@pxref{Invoking updatedb,,, find, Finding Files})
7930 and the @command{guix gc} commands (@pxref{Invoking guix gc}) daily, as
7931 well as the @command{mkid} command on behalf of an unprivileged user
7932 (@pxref{mkid invocation,,, idutils, ID Database Utilities}). It uses
7933 gexps to introduce job definitions that are passed to mcron
7934 (@pxref{G-Expressions}).
7935
7936 @lisp
7937 (use-modules (guix) (gnu) (gnu services mcron))
7938 (use-package-modules base idutils)
7939
7940 (define updatedb-job
7941 ;; Run 'updatedb' at 3AM every day. Here we write the
7942 ;; job's action as a Scheme procedure.
7943 #~(job '(next-hour '(3))
7944 (lambda ()
7945 (execl (string-append #$findutils "/bin/updatedb")
7946 "updatedb"
7947 "--prunepaths=/tmp /var/tmp /gnu/store"))))
7948
7949 (define garbage-collector-job
7950 ;; Collect garbage 5 minutes after midnight every day.
7951 ;; The job's action is a shell command.
7952 #~(job "5 0 * * *" ;Vixie cron syntax
7953 "guix gc -F 1G"))
7954
7955 (define idutils-job
7956 ;; Update the index database as user "charlie" at 12:15PM
7957 ;; and 19:15PM. This runs from the user's home directory.
7958 #~(job '(next-minute-from (next-hour '(12 19)) '(15))
7959 (string-append #$idutils "/bin/mkid src")
7960 #:user "charlie"))
7961
7962 (operating-system
7963 ;; @dots{}
7964 (services (cons (mcron-service (list garbage-collector-job
7965 updatedb-job
7966 idutils-job))
7967 %base-services)))
7968 @end lisp
7969
7970 @xref{Guile Syntax, mcron job specifications,, mcron, GNU@tie{}mcron},
7971 for more information on mcron job specifications. Below is the
7972 reference of the mcron service.
7973
7974 @deffn {Scheme Procedure} mcron-service @var{jobs} [#:mcron @var{mcron2}]
7975 Return an mcron service running @var{mcron} that schedules @var{jobs}, a
7976 list of gexps denoting mcron job specifications.
7977
7978 This is a shorthand for:
7979 @example
7980 (service mcron-service-type
7981 (mcron-configuration (mcron mcron) (jobs jobs)))
7982 @end example
7983 @end deffn
7984
7985 @defvr {Scheme Variable} mcron-service-type
7986 This is the type of the @code{mcron} service, whose value is an
7987 @code{mcron-configuration} object.
7988
7989 This service type can be the target of a service extension that provides
7990 it additional job specifications (@pxref{Service Composition}). In
7991 other words, it is possible to define services that provide additional
7992 mcron jobs to run.
7993 @end defvr
7994
7995 @deftp {Data Type} mcron-configuration
7996 Data type representing the configuration of mcron.
7997
7998 @table @asis
7999 @item @code{mcron} (default: @var{mcron2})
8000 The mcron package to use.
8001
8002 @item @code{jobs}
8003 This is a list of gexps (@pxref{G-Expressions}), where each gexp
8004 corresponds to an mcron job specification (@pxref{Syntax, mcron job
8005 specifications,, mcron, GNU@tie{}mcron}).
8006 @end table
8007 @end deftp
8008
8009
8010 @node Networking Services
8011 @subsubsection Networking Services
8012
8013 The @code{(gnu services networking)} module provides services to configure
8014 the network interface.
8015
8016 @cindex DHCP, networking service
8017 @deffn {Scheme Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}]
8018 Return a service that runs @var{dhcp}, a Dynamic Host Configuration
8019 Protocol (DHCP) client, on all the non-loopback network interfaces.
8020 @end deffn
8021
8022 @deffn {Scheme Procedure} static-networking-service @var{interface} @var{ip} @
8023 [#:gateway #f] [#:name-servers @code{'()}]
8024 Return a service that starts @var{interface} with address @var{ip}. If
8025 @var{gateway} is true, it must be a string specifying the default network
8026 gateway.
8027 @end deffn
8028
8029 @cindex wicd
8030 @cindex network management
8031 @deffn {Scheme Procedure} wicd-service [#:wicd @var{wicd}]
8032 Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a network
8033 management daemon that aims to simplify wired and wireless networking.
8034
8035 This service adds the @var{wicd} package to the global profile, providing
8036 several commands to interact with the daemon and configure networking:
8037 @command{wicd-client}, a graphical user interface, and the @command{wicd-cli}
8038 and @command{wicd-curses} user interfaces.
8039 @end deffn
8040
8041 @cindex NetworkManager
8042 @deffn {Scheme Procedure} network-manager-service @
8043 [#:network-manager @var{network-manager}]
8044 Return a service that runs NetworkManager, a network connection manager
8045 attempting to keep network connectivity active when available.
8046 @end deffn
8047
8048 @cindex Connman
8049 @deffn {Scheme Procedure} connman-service @
8050 [#:connman @var{connman}]
8051 Return a service that runs @url{https://01.org/connman,Connman}, a network
8052 connection manager.
8053
8054 This service adds the @var{connman} package to the global profile, providing
8055 several the @command{connmanctl} command to interact with the daemon and
8056 configure networking."
8057 @end deffn
8058
8059 @deffn {Scheme Procedure} ntp-service [#:ntp @var{ntp}] @
8060 [#:servers @var{%ntp-servers}]
8061 Return a service that runs the daemon from @var{ntp}, the
8062 @uref{http://www.ntp.org, Network Time Protocol package}. The daemon will
8063 keep the system clock synchronized with that of @var{servers}.
8064 @end deffn
8065
8066 @defvr {Scheme Variable} %ntp-servers
8067 List of host names used as the default NTP servers.
8068 @end defvr
8069
8070 @deffn {Scheme Procedure} tor-service [@var{config-file}] [#:tor @var{tor}]
8071 Return a service to run the @uref{https://torproject.org, Tor} anonymous
8072 networking daemon.
8073
8074 The daemon runs as the @code{tor} unprivileged user. It is passed
8075 @var{config-file}, a file-like object, with an additional @code{User tor} line
8076 and lines for hidden services added via @code{tor-hidden-service}. Run
8077 @command{man tor} for information about the configuration file.
8078 @end deffn
8079
8080 @cindex hidden service
8081 @deffn {Scheme Procedure} tor-hidden-service @var{name} @var{mapping}
8082 Define a new Tor @dfn{hidden service} called @var{name} and implementing
8083 @var{mapping}. @var{mapping} is a list of port/host tuples, such as:
8084
8085 @example
8086 '((22 "127.0.0.1:22")
8087 (80 "127.0.0.1:8080"))
8088 @end example
8089
8090 In this example, port 22 of the hidden service is mapped to local port 22, and
8091 port 80 is mapped to local port 8080.
8092
8093 This creates a @file{/var/lib/tor/hidden-services/@var{name}} directory, where
8094 the @file{hostname} file contains the @code{.onion} host name for the hidden
8095 service.
8096
8097 See @uref{https://www.torproject.org/docs/tor-hidden-service.html.en, the Tor
8098 project's documentation} for more information.
8099 @end deffn
8100
8101 @deffn {Scheme Procedure} bitlbee-service [#:bitlbee bitlbee] @
8102 [#:interface "127.0.0.1"] [#:port 6667] @
8103 [#:extra-settings ""]
8104 Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that
8105 acts as a gateway between IRC and chat networks.
8106
8107 The daemon will listen to the interface corresponding to the IP address
8108 specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only
8109 local clients can connect, whereas @code{0.0.0.0} means that connections can
8110 come from any networking interface.
8111
8112 In addition, @var{extra-settings} specifies a string to append to the
8113 configuration file.
8114 @end deffn
8115
8116 Furthermore, @code{(gnu services ssh)} provides the following services.
8117
8118 @deffn {Scheme Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @
8119 [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @
8120 [#:allow-empty-passwords? #f] [#:root-login? #f] @
8121 [#:syslog-output? #t] [#:x11-forwarding? #t] @
8122 [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @
8123 [#:public-key-authentication? #t] [#:initialize? #t]
8124 Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}.
8125 @var{host-key} must designate a file containing the host key, and readable
8126 only by root.
8127
8128 When @var{daemonic?} is true, @command{lshd} will detach from the
8129 controlling terminal and log its output to syslogd, unless one sets
8130 @var{syslog-output?} to false. Obviously, it also makes lsh-service
8131 depend on existence of syslogd service. When @var{pid-file?} is true,
8132 @command{lshd} writes its PID to the file called @var{pid-file}.
8133
8134 When @var{initialize?} is true, automatically create the seed and host key
8135 upon service activation if they do not exist yet. This may take long and
8136 require interaction.
8137
8138 When @var{initialize?} is false, it is up to the user to initialize the
8139 randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create
8140 a key pair with the private key stored in file @var{host-key} (@pxref{lshd
8141 basics,,, lsh, LSH Manual}).
8142
8143 When @var{interfaces} is empty, lshd listens for connections on all the
8144 network interfaces; otherwise, @var{interfaces} must be a list of host names
8145 or addresses.
8146
8147 @var{allow-empty-passwords?} specifies whether to accept log-ins with empty
8148 passwords, and @var{root-login?} specifies whether to accept log-ins as
8149 root.
8150
8151 The other options should be self-descriptive.
8152 @end deffn
8153
8154 @deffn {Scheme Procedure} dropbear-service [@var{config}]
8155 Run the @uref{https://matt.ucc.asn.au/dropbear/dropbear.html,Dropbear SSH
8156 daemon} with the given @var{config}, a @code{<dropbear-configuration>}
8157 object.
8158
8159 For example, to specify a Dropbear service listening on port 1234, add
8160 this call to the operating system's @code{services} field:
8161
8162 @example
8163 (dropbear-service (dropbear-configuration
8164 (port-number 1234)))
8165 @end example
8166 @end deffn
8167
8168 @deftp {Data Type} dropbear-configuration
8169 This data type represents the configuration of a Dropbear SSH daemon.
8170
8171 @table @asis
8172 @item @code{dropbear} (default: @var{dropbear})
8173 The Dropbear package to use.
8174
8175 @item @code{port-number} (default: 22)
8176 The TCP port where the daemon waits for incoming connections.
8177
8178 @item @code{syslog-output?} (default: @code{#t})
8179 Whether to enable syslog output.
8180
8181 @item @code{pid-file} (default: @code{"/var/run/dropbear.pid"})
8182 File name of the daemon's PID file.
8183
8184 @item @code{root-login?} (default: @code{#f})
8185 Whether to allow @code{root} logins.
8186
8187 @item @code{allow-empty-passwords?} (default: @code{#f})
8188 Whether to allow empty passwords.
8189
8190 @item @code{password-authentication?} (default: @code{#t})
8191 Whether to enable password-based authentication.
8192 @end table
8193 @end deftp
8194
8195 @defvr {Scheme Variable} %facebook-host-aliases
8196 This variable contains a string for use in @file{/etc/hosts}
8197 (@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each
8198 line contains a entry that maps a known server name of the Facebook
8199 on-line service---e.g., @code{www.facebook.com}---to the local
8200 host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}.
8201
8202 This variable is typically used in the @code{hosts-file} field of an
8203 @code{operating-system} declaration (@pxref{operating-system Reference,
8204 @file{/etc/hosts}}):
8205
8206 @example
8207 (use-modules (gnu) (guix))
8208
8209 (operating-system
8210 (host-name "mymachine")
8211 ;; ...
8212 (hosts-file
8213 ;; Create a /etc/hosts file with aliases for "localhost"
8214 ;; and "mymachine", as well as for Facebook servers.
8215 (plain-file "hosts"
8216 (string-append (local-host-aliases host-name)
8217 %facebook-host-aliases))))
8218 @end example
8219
8220 This mechanism can prevent programs running locally, such as Web
8221 browsers, from accessing Facebook.
8222 @end defvr
8223
8224 The @code{(gnu services avahi)} provides the following definition.
8225
8226 @deffn {Scheme Procedure} avahi-service [#:avahi @var{avahi}] @
8227 [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @
8228 [#:ipv6? #t] [#:wide-area? #f] @
8229 [#:domains-to-browse '()] [#:debug? #f]
8230 Return a service that runs @command{avahi-daemon}, a system-wide
8231 mDNS/DNS-SD responder that allows for service discovery and
8232 "zero-configuration" host name lookups (see @uref{http://avahi.org/}), and
8233 extends the name service cache daemon (nscd) so that it can resolve
8234 @code{.local} host names using
8235 @uref{http://0pointer.de/lennart/projects/nss-mdns/, nss-mdns}. Additionally,
8236 add the @var{avahi} package to the system profile so that commands such as
8237 @command{avahi-browse} are directly usable.
8238
8239 If @var{host-name} is different from @code{#f}, use that as the host name to
8240 publish for this machine; otherwise, use the machine's actual host name.
8241
8242 When @var{publish?} is true, publishing of host names and services is allowed;
8243 in particular, avahi-daemon will publish the machine's host name and IP
8244 address via mDNS on the local network.
8245
8246 When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled.
8247
8248 Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6
8249 sockets.
8250 @end deffn
8251
8252
8253 @node X Window
8254 @subsubsection X Window
8255
8256 Support for the X Window graphical display system---specifically
8257 Xorg---is provided by the @code{(gnu services xorg)} module. Note that
8258 there is no @code{xorg-service} procedure. Instead, the X server is
8259 started by the @dfn{login manager}, currently SLiM.
8260
8261 @deftp {Data Type} sddm-configuration
8262 This is the data type representing the sddm service configuration.
8263
8264 @table @asis
8265 @item @code{display-server} (default: "x11")
8266 Select display server to use for the greeter. Valid values are "x11"
8267 or "wayland".
8268
8269 @item @code{numlock} (default: "on")
8270 Valid values are "on", "off" or "none".
8271
8272 @item @code{halt-command} (default @code{#~(string-apppend #$shepherd "/sbin/halt")})
8273 Command to run when halting.
8274
8275 @item @code{reboot-command} (default @code{#~(string-append #$shepherd "/sbin/reboot")})
8276 Command to run when rebooting.
8277
8278 @item @code{theme} (default "maldives")
8279 Theme to use. Default themes provided by SDDM are "elarun" or "maldives".
8280
8281 @item @code{themes-directory} (default "/run/current-system/profile/share/sddm/themes")
8282 Directory to look for themes.
8283
8284 @item @code{faces-directory} (default "/run/current-system/profile/share/sddm/faces")
8285 Directory to look for faces.
8286
8287 @item @code{default-path} (default "/run/current-system/profile/bin")
8288 Default PATH to use.
8289
8290 @item @code{minimum-uid} (default 1000)
8291 Minimum UID to display in SDDM.
8292
8293 @item @code{maximum-uid} (default 2000)
8294 Maximum UID to display in SDDM
8295
8296 @item @code{remember-last-user?} (default #t)
8297 Remember last user.
8298
8299 @item @code{remember-last-session?} (default #t)
8300 Remember last session.
8301
8302 @item @code{hide-users} (default "")
8303 Usernames to hide from SDDM greeter.
8304
8305 @item @code{hide-shells} (default @code{#~(string-append #$shadow "/sbin/nologin")})
8306 Users with shells listed will be hidden from the SDDM greeter.
8307
8308 @item @code{session-command} (default @code{#~(string-append #$sddm "/share/sddm/scripts/wayland-session")})
8309 Script to run before starting a wayland session.
8310
8311 @item @code{sessions-directory} (default "/run/current-system/profile/share/wayland-sessions")
8312 Directory to look for desktop files starting wayland sessions.
8313
8314 @item @code{xorg-server-path} (default @code{xorg-start-command})
8315 Path to xorg-server.
8316
8317 @item @code{xauth-path} (default @code{#~(string-append #$xauth "/bin/xauth")})
8318 Path to xauth.
8319
8320 @item @code{xephyr-path} (default @code{#~(string-append #$xorg-server "/bin/Xephyr")})
8321 Path to Xephyr.
8322
8323 @item @code{xdisplay-start} (default @code{#~(string-append #$sddm "/share/sddm/scripts/Xsetup")})
8324 Script to run after starting xorg-server.
8325
8326 @item @code{xdisplay-stop} (default @code{#~(string-append #$sddm "/share/sddm/scripts/Xstop")})
8327 Script to run before stopping xorg-server.
8328
8329 @item @code{xsession-command} (default: @code{xinitr })
8330 Script to run before starting a X session.
8331
8332 @item @code{xsessions-directory} (default: "/run/current-system/profile/share/xsessions")
8333 Directory to look for desktop files starting X sessions.
8334
8335 @item @code{minimum-vt} (default: 7)
8336 Minimum VT to use.
8337
8338 @item @code{xserver-arguments} (default "-nolisten tcp")
8339 Arguments to pass to xorg-server.
8340
8341 @item @code{auto-login-user} (default "")
8342 User to use for auto-login.
8343
8344 @item @code{auto-login-session} (default "")
8345 Desktop file to use for auto-login.
8346
8347 @item @code{relogin?} (default #f)
8348 Relogin after logout.
8349
8350 @end table
8351 @end deftp
8352
8353 @deffn {Scheme Procedure} sddm-service config
8354 Return a service that spawns the SDDM graphical login manager for config of
8355 type @code{<sddm-configuration>}.
8356
8357 @example
8358 (sddm-service (sddm-configuration
8359 (auto-login-user "Alice")
8360 (auto-login-session "xfce.desktop")))
8361 @end example
8362 @end deffn
8363
8364 @deffn {Scheme Procedure} slim-service [#:allow-empty-passwords? #f] @
8365 [#:auto-login? #f] [#:default-user ""] [#:startx] @
8366 [#:theme @var{%default-slim-theme}] @
8367 [#:theme-name @var{%default-slim-theme-name}]
8368 Return a service that spawns the SLiM graphical login manager, which in
8369 turn starts the X display server with @var{startx}, a command as returned by
8370 @code{xorg-start-command}.
8371
8372 @cindex X session
8373
8374 SLiM automatically looks for session types described by the @file{.desktop}
8375 files in @file{/run/current-system/profile/share/xsessions} and allows users
8376 to choose a session from the log-in screen using @kbd{F1}. Packages such as
8377 @var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files;
8378 adding them to the system-wide set of packages automatically makes them
8379 available at the log-in screen.
8380
8381 In addition, @file{~/.xsession} files are honored. When available,
8382 @file{~/.xsession} must be an executable that starts a window manager
8383 and/or other X clients.
8384
8385 When @var{allow-empty-passwords?} is true, allow logins with an empty
8386 password. When @var{auto-login?} is true, log in automatically as
8387 @var{default-user}.
8388
8389 If @var{theme} is @code{#f}, use the default log-in theme; otherwise
8390 @var{theme} must be a gexp denoting the name of a directory containing the
8391 theme to use. In that case, @var{theme-name} specifies the name of the
8392 theme.
8393 @end deffn
8394
8395 @defvr {Scheme Variable} %default-theme
8396 @defvrx {Scheme Variable} %default-theme-name
8397 The G-Expression denoting the default SLiM theme and its name.
8398 @end defvr
8399
8400 @deffn {Scheme Procedure} xorg-start-command [#:guile] @
8401 [#:configuration-file #f] [#:xorg-server @var{xorg-server}]
8402 Return a derivation that builds a @var{guile} script to start the X server
8403 from @var{xorg-server}. @var{configuration-file} is the server configuration
8404 file or a derivation that builds it; when omitted, the result of
8405 @code{xorg-configuration-file} is used.
8406
8407 Usually the X server is started by a login manager.
8408 @end deffn
8409
8410 @deffn {Scheme Procedure} xorg-configuration-file @
8411 [#:drivers '()] [#:resolutions '()] [#:extra-config '()]
8412 Return a configuration file for the Xorg server containing search paths for
8413 all the common drivers.
8414
8415 @var{drivers} must be either the empty list, in which case Xorg chooses a
8416 graphics driver automatically, or a list of driver names that will be tried in
8417 this order---e.g., @code{(\"modesetting\" \"vesa\")}.
8418
8419 Likewise, when @var{resolutions} is the empty list, Xorg chooses an
8420 appropriate screen resolution; otherwise, it must be a list of
8421 resolutions---e.g., @code{((1024 768) (640 480))}.
8422
8423 Last, @var{extra-config} is a list of strings or objects appended to the
8424 @code{text-file*} argument list. It is used to pass extra text to be added
8425 verbatim to the configuration file.
8426 @end deffn
8427
8428 @deffn {Scheme Procedure} screen-locker-service @var{package} [@var{name}]
8429 Add @var{package}, a package for a screen-locker or screen-saver whose
8430 command is @var{program}, to the set of setuid programs and add a PAM entry
8431 for it. For example:
8432
8433 @lisp
8434 (screen-locker-service xlockmore "xlock")
8435 @end lisp
8436
8437 makes the good ol' XlockMore usable.
8438 @end deffn
8439
8440
8441 @node Desktop Services
8442 @subsubsection Desktop Services
8443
8444 The @code{(gnu services desktop)} module provides services that are
8445 usually useful in the context of a ``desktop'' setup---that is, on a
8446 machine running a graphical display server, possibly with graphical user
8447 interfaces, etc. It also defines services that provide specific desktop
8448 environments like GNOME and XFCE.
8449
8450 To simplify things, the module defines a variable containing the set of
8451 services that users typically expect on a machine with a graphical
8452 environment and networking:
8453
8454 @defvr {Scheme Variable} %desktop-services
8455 This is a list of services that builds upon @var{%base-services} and
8456 adds or adjusts services for a typical ``desktop'' setup.
8457
8458 In particular, it adds a graphical login manager (@pxref{X Window,
8459 @code{slim-service}}), screen lockers,
8460 a network management tool (@pxref{Networking
8461 Services, @code{wicd-service}}), energy and color management services,
8462 the @code{elogind} login and seat manager, the Polkit privilege service,
8463 the GeoClue location service, an NTP client (@pxref{Networking
8464 Services}), the Avahi daemon, and has the name service switch service
8465 configured to be able to use @code{nss-mdns} (@pxref{Name Service
8466 Switch, mDNS}).
8467 @end defvr
8468
8469 The @var{%desktop-services} variable can be used as the @code{services}
8470 field of an @code{operating-system} declaration (@pxref{operating-system
8471 Reference, @code{services}}).
8472
8473 Additionally, the @code{gnome-desktop-service} and
8474 @code{xfce-desktop-service} procedures can add GNOME and/or XFCE to a
8475 system. To ``add GNOME'' means that system-level services like the
8476 backlight adjustment helpers and the power management utilities are
8477 added to the system, extending @code{polkit} and @code{dbus}
8478 appropriately, allowing GNOME to operate with elevated privileges on a
8479 limited number of special-purpose system interfaces. Additionally,
8480 adding a service made by @code{gnome-desktop-service} adds the GNOME
8481 metapackage to the system profile. Likewise, adding the XFCE service
8482 not only adds the @code{xfce} metapackage to the system profile, but it
8483 also gives the Thunar file manager the ability to open a ``root-mode''
8484 file management window, if the user authenticates using the
8485 administrator's password via the standard polkit graphical interface.
8486
8487 @deffn {Scheme Procedure} gnome-desktop-service
8488 Return a service that adds the @code{gnome} package to the system
8489 profile, and extends polkit with the actions from
8490 @code{gnome-settings-daemon}.
8491 @end deffn
8492
8493 @deffn {Scheme Procedure} xfce-desktop-service
8494 Return a service that adds the @code{xfce} package to the system profile,
8495 and extends polkit with the ability for @code{thunar} to manipulate the
8496 file system as root from within a user session, after the user has
8497 authenticated with the administrator's password.
8498 @end deffn
8499
8500 Because the GNOME and XFCE desktop services pull in so many packages,
8501 the default @code{%desktop-services} variable doesn't include either of
8502 them by default. To add GNOME or XFCE, just @code{cons} them onto
8503 @code{%desktop-services} in the @code{services} field of your
8504 @code{operating-system}:
8505
8506 @example
8507 (use-modules (gnu))
8508 (use-service-modules desktop)
8509 (operating-system
8510 ...
8511 ;; cons* adds items to the list given as its last argument.
8512 (services (cons* (gnome-desktop-service)
8513 (xfce-desktop-service)
8514 %desktop-services))
8515 ...)
8516 @end example
8517
8518 These desktop environments will then be available as options in the
8519 graphical login window.
8520
8521 The actual service definitions included in @code{%desktop-services} and
8522 provided by @code{(gnu services dbus)} and @code{(gnu services desktop)}
8523 are described below.
8524
8525 @deffn {Scheme Procedure} dbus-service [#:dbus @var{dbus}] [#:services '()]
8526 Return a service that runs the ``system bus'', using @var{dbus}, with
8527 support for @var{services}.
8528
8529 @uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication
8530 facility. Its system bus is used to allow system services to communicate
8531 and to be notified of system-wide events.
8532
8533 @var{services} must be a list of packages that provide an
8534 @file{etc/dbus-1/system.d} directory containing additional D-Bus configuration
8535 and policy files. For example, to allow avahi-daemon to use the system bus,
8536 @var{services} must be equal to @code{(list avahi)}.
8537 @end deffn
8538
8539 @deffn {Scheme Procedure} elogind-service [#:config @var{config}]
8540 Return a service that runs the @code{elogind} login and
8541 seat management daemon. @uref{https://github.com/andywingo/elogind,
8542 Elogind} exposes a D-Bus interface that can be used to know which users
8543 are logged in, know what kind of sessions they have open, suspend the
8544 system, inhibit system suspend, reboot the system, and other tasks.
8545
8546 Elogind handles most system-level power events for a computer, for
8547 example suspending the system when a lid is closed, or shutting it down
8548 when the power button is pressed.
8549
8550 The @var{config} keyword argument specifies the configuration for
8551 elogind, and should be the result of an @code{(elogind-configuration
8552 (@var{parameter} @var{value})...)} invocation. Available parameters and
8553 their default values are:
8554
8555 @table @code
8556 @item kill-user-processes?
8557 @code{#f}
8558 @item kill-only-users
8559 @code{()}
8560 @item kill-exclude-users
8561 @code{("root")}
8562 @item inhibit-delay-max-seconds
8563 @code{5}
8564 @item handle-power-key
8565 @code{poweroff}
8566 @item handle-suspend-key
8567 @code{suspend}
8568 @item handle-hibernate-key
8569 @code{hibernate}
8570 @item handle-lid-switch
8571 @code{suspend}
8572 @item handle-lid-switch-docked
8573 @code{ignore}
8574 @item power-key-ignore-inhibited?
8575 @code{#f}
8576 @item suspend-key-ignore-inhibited?
8577 @code{#f}
8578 @item hibernate-key-ignore-inhibited?
8579 @code{#f}
8580 @item lid-switch-ignore-inhibited?
8581 @code{#t}
8582 @item holdoff-timeout-seconds
8583 @code{30}
8584 @item idle-action
8585 @code{ignore}
8586 @item idle-action-seconds
8587 @code{(* 30 60)}
8588 @item runtime-directory-size-percent
8589 @code{10}
8590 @item runtime-directory-size
8591 @code{#f}
8592 @item remove-ipc?
8593 @code{#t}
8594 @item suspend-state
8595 @code{("mem" "standby" "freeze")}
8596 @item suspend-mode
8597 @code{()}
8598 @item hibernate-state
8599 @code{("disk")}
8600 @item hibernate-mode
8601 @code{("platform" "shutdown")}
8602 @item hybrid-sleep-state
8603 @code{("disk")}
8604 @item hybrid-sleep-mode
8605 @code{("suspend" "platform" "shutdown")}
8606 @end table
8607 @end deffn
8608
8609 @deffn {Scheme Procedure} polkit-service @
8610 [#:polkit @var{polkit}]
8611 Return a service that runs the
8612 @uref{http://www.freedesktop.org/wiki/Software/polkit/, Polkit privilege
8613 management service}, which allows system administrators to grant access to
8614 privileged operations in a structured way. By querying the Polkit service, a
8615 privileged system component can know when it should grant additional
8616 capabilities to ordinary users. For example, an ordinary user can be granted
8617 the capability to suspend the system if the user is logged in locally.
8618 @end deffn
8619
8620 @deffn {Scheme Procedure} upower-service [#:upower @var{upower}] @
8621 [#:watts-up-pro? #f] @
8622 [#:poll-batteries? #t] @
8623 [#:ignore-lid? #f] @
8624 [#:use-percentage-for-policy? #f] @
8625 [#:percentage-low 10] @
8626 [#:percentage-critical 3] @
8627 [#:percentage-action 2] @
8628 [#:time-low 1200] @
8629 [#:time-critical 300] @
8630 [#:time-action 120] @
8631 [#:critical-power-action 'hybrid-sleep]
8632 Return a service that runs @uref{http://upower.freedesktop.org/,
8633 @command{upowerd}}, a system-wide monitor for power consumption and battery
8634 levels, with the given configuration settings. It implements the
8635 @code{org.freedesktop.UPower} D-Bus interface, and is notably used by
8636 GNOME.
8637 @end deffn
8638
8639 @deffn {Scheme Procedure} udisks-service [#:udisks @var{udisks}]
8640 Return a service for @uref{http://udisks.freedesktop.org/docs/latest/,
8641 UDisks}, a @dfn{disk management} daemon that provides user interfaces with
8642 notifications and ways to mount/unmount disks. Programs that talk to UDisks
8643 include the @command{udisksctl} command, part of UDisks, and GNOME Disks.
8644 @end deffn
8645
8646 @deffn {Scheme Procedure} colord-service [#:colord @var{colord}]
8647 Return a service that runs @command{colord}, a system service with a D-Bus
8648 interface to manage the color profiles of input and output devices such as
8649 screens and scanners. It is notably used by the GNOME Color Manager graphical
8650 tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web
8651 site} for more information.
8652 @end deffn
8653
8654 @deffn {Scheme Procedure} geoclue-application name [#:allowed? #t] [#:system? #f] [#:users '()]
8655 Return a configuration allowing an application to access GeoClue
8656 location data. @var{name} is the Desktop ID of the application, without
8657 the @code{.desktop} part. If @var{allowed?} is true, the application
8658 will have access to location information by default. The boolean
8659 @var{system?} value indicates whether an application is a system component
8660 or not. Finally @var{users} is a list of UIDs of all users for which
8661 this application is allowed location info access. An empty users list
8662 means that all users are allowed.
8663 @end deffn
8664
8665 @defvr {Scheme Variable} %standard-geoclue-applications
8666 The standard list of well-known GeoClue application configurations,
8667 granting authority to the GNOME date-and-time utility to ask for the
8668 current location in order to set the time zone, and allowing the
8669 IceCat and Epiphany web browsers to request location information.
8670 IceCat and Epiphany both query the user before allowing a web page to
8671 know the user's location.
8672 @end defvr
8673
8674 @deffn {Scheme Procedure} geoclue-service [#:colord @var{colord}] @
8675 [#:whitelist '()] @
8676 [#:wifi-geolocation-url "https://location.services.mozilla.com/v1/geolocate?key=geoclue"] @
8677 [#:submit-data? #f]
8678 [#:wifi-submission-url "https://location.services.mozilla.com/v1/submit?key=geoclue"] @
8679 [#:submission-nick "geoclue"] @
8680 [#:applications %standard-geoclue-applications]
8681 Return a service that runs the GeoClue location service. This service
8682 provides a D-Bus interface to allow applications to request access to a
8683 user's physical location, and optionally to add information to online
8684 location databases. See
8685 @uref{https://wiki.freedesktop.org/www/Software/GeoClue/, the GeoClue
8686 web site} for more information.
8687 @end deffn
8688
8689 @deffn {Scheme Procedure} bluetooth-service [#:bluez @var{bluez}]
8690 Return a service that runs the @command{bluetoothd} daemon, which manages
8691 all the Bluetooth devices and provides a number of D-Bus interfaces.
8692
8693 Users need to be in the @code{lp} group to access the D-Bus service.
8694 @end deffn
8695
8696 @node Database Services
8697 @subsubsection Database Services
8698
8699 The @code{(gnu services databases)} module provides the following services.
8700
8701 @deffn {Scheme Procedure} postgresql-service [#:postgresql postgresql] @
8702 [#:config-file] [#:data-directory ``/var/lib/postgresql/data'']
8703 Return a service that runs @var{postgresql}, the PostgreSQL database
8704 server.
8705
8706 The PostgreSQL daemon loads its runtime configuration from
8707 @var{config-file} and stores the database cluster in
8708 @var{data-directory}.
8709 @end deffn
8710
8711 @deffn {Scheme Procedure} mysql-service [#:config (mysql-configuration)]
8712 Return a service that runs @command{mysqld}, the MySQL or MariaDB
8713 database server.
8714
8715 The optional @var{config} argument specifies the configuration for
8716 @command{mysqld}, which should be a @code{<mysql-configuraiton>} object.
8717 @end deffn
8718
8719 @deftp {Data Type} mysql-configuration
8720 Data type representing the configuration of @var{mysql-service}.
8721
8722 @table @asis
8723 @item @code{mysql} (default: @var{mariadb})
8724 Package object of the MySQL database server, can be either @var{mariadb}
8725 or @var{mysql}.
8726
8727 For MySQL, a temporary root password will be displayed at activation time.
8728 For MariaDB, the root password is empty.
8729 @end table
8730 @end deftp
8731
8732 @node Mail Services
8733 @subsubsection Mail Services
8734
8735 The @code{(gnu services mail)} module provides Guix service definitions
8736 for mail services. Currently the only implemented service is Dovecot,
8737 an IMAP, POP3, and LMTP server.
8738
8739 Guix does not yet have a mail transfer agent (MTA), although for some
8740 lightweight purposes the @code{esmtp} relay-only MTA may suffice. Help
8741 is needed to properly integrate a full MTA, such as Postfix. Patches
8742 welcome!
8743
8744 To add an IMAP/POP3 server to a GuixSD system, add a
8745 @code{dovecot-service} to the operating system definition:
8746
8747 @deffn {Scheme Procedure} dovecot-service [#:config (dovecot-configuration)]
8748 Return a service that runs the Dovecot IMAP/POP3/LMTP mail server.
8749 @end deffn
8750
8751 By default, Dovecot does not need much configuration; the default
8752 configuration object created by @code{(dovecot-configuration)} will
8753 suffice if your mail is delivered to @code{~/Maildir}. A self-signed
8754 certificate will be generated for TLS-protected connections, though
8755 Dovecot will also listen on cleartext ports by default. There are a
8756 number of options, though, which mail administrators might need to change,
8757 and as is the case with other services, Guix allows the system
8758 administrator to specify these parameters via a uniform Scheme interface.
8759
8760 For example, to specify that mail is located at @code{maildir~/.mail},
8761 one would instantiate the Dovecot service like this:
8762
8763 @example
8764 (dovecot-service #:config
8765 (dovecot-configuration
8766 (mail-location "maildir:~/.mail")))
8767 @end example
8768
8769 The available configuration parameters follow. Each parameter
8770 definition is preceded by its type; for example, @samp{string-list foo}
8771 indicates that the @code{foo} parameter should be specified as a list of
8772 strings. There is also a way to specify the configuration as a string,
8773 if you have an old @code{dovecot.conf} file that you want to port over
8774 from some other system; see the end for more details.
8775
8776 @c The following documentation was initially generated by
8777 @c (generate-documentation) in (gnu services mail). Manually maintained
8778 @c documentation is better, so we shouldn't hesitate to edit below as
8779 @c needed. However if the change you want to make to this documentation
8780 @c can be done in an automated way, it's probably easier to change
8781 @c (generate-documentation) than to make it below and have to deal with
8782 @c the churn as dovecot updates.
8783
8784 Available @code{dovecot-configuration} fields are:
8785
8786 @deftypevr {@code{dovecot-configuration} parameter} package dovecot
8787 The dovecot package.
8788 @end deftypevr
8789
8790 @deftypevr {@code{dovecot-configuration} parameter} comma-separated-string-list listen
8791 A list of IPs or hosts where to listen for connections. @samp{*}
8792 listens on all IPv4 interfaces, @samp{::} listens on all IPv6
8793 interfaces. If you want to specify non-default ports or anything more
8794 complex, customize the address and port fields of the
8795 @samp{inet-listener} of the specific services you are interested in.
8796 @end deftypevr
8797
8798 @deftypevr {@code{dovecot-configuration} parameter} protocol-configuration-list protocols
8799 List of protocols we want to serve. Available protocols include
8800 @samp{imap}, @samp{pop3}, and @samp{lmtp}.
8801
8802 Available @code{protocol-configuration} fields are:
8803
8804 @deftypevr {@code{protocol-configuration} parameter} string name
8805 The name of the protocol.
8806 @end deftypevr
8807
8808 @deftypevr {@code{protocol-configuration} parameter} string auth-socket-path
8809 UNIX socket path to the master authentication server to find users.
8810 This is used by imap (for shared users) and lda.
8811 It defaults to @samp{"/var/run/dovecot/auth-userdb"}.
8812 @end deftypevr
8813
8814 @deftypevr {@code{protocol-configuration} parameter} space-separated-string-list mail-plugins
8815 Space separated list of plugins to load.
8816 @end deftypevr
8817
8818 @deftypevr {@code{protocol-configuration} parameter} non-negative-integer mail-max-userip-connections
8819 Maximum number of IMAP connections allowed for a user from each IP
8820 address. NOTE: The username is compared case-sensitively.
8821 Defaults to @samp{10}.
8822 @end deftypevr
8823
8824 @end deftypevr
8825
8826 @deftypevr {@code{dovecot-configuration} parameter} service-configuration-list services
8827 List of services to enable. Available services include @samp{imap},
8828 @samp{imap-login}, @samp{pop3}, @samp{pop3-login}, @samp{auth}, and
8829 @samp{lmtp}.
8830
8831 Available @code{service-configuration} fields are:
8832
8833 @deftypevr {@code{service-configuration} parameter} string kind
8834 The service kind. Valid values include @code{director},
8835 @code{imap-login}, @code{pop3-login}, @code{lmtp}, @code{imap},
8836 @code{pop3}, @code{auth}, @code{auth-worker}, @code{dict},
8837 @code{tcpwrap}, @code{quota-warning}, or anything else.
8838 @end deftypevr
8839
8840 @deftypevr {@code{service-configuration} parameter} listener-configuration-list listeners
8841 Listeners for the service. A listener is either a
8842 @code{unix-listener-configuration}, a @code{fifo-listener-configuration}, or
8843 an @code{inet-listener-configuration}.
8844 Defaults to @samp{()}.
8845
8846 Available @code{unix-listener-configuration} fields are:
8847
8848 @deftypevr {@code{unix-listener-configuration} parameter} file-name path
8849 The file name on which to listen.
8850 @end deftypevr
8851
8852 @deftypevr {@code{unix-listener-configuration} parameter} string mode
8853 The access mode for the socket.
8854 Defaults to @samp{"0600"}.
8855 @end deftypevr
8856
8857 @deftypevr {@code{unix-listener-configuration} parameter} string user
8858 The user to own the socket.
8859 Defaults to @samp{""}.
8860 @end deftypevr
8861
8862 @deftypevr {@code{unix-listener-configuration} parameter} string group
8863 The group to own the socket.
8864 Defaults to @samp{""}.
8865 @end deftypevr
8866
8867
8868 Available @code{fifo-listener-configuration} fields are:
8869
8870 @deftypevr {@code{fifo-listener-configuration} parameter} file-name path
8871 The file name on which to listen.
8872 @end deftypevr
8873
8874 @deftypevr {@code{fifo-listener-configuration} parameter} string mode
8875 The access mode for the socket.
8876 Defaults to @samp{"0600"}.
8877 @end deftypevr
8878
8879 @deftypevr {@code{fifo-listener-configuration} parameter} string user
8880 The user to own the socket.
8881 Defaults to @samp{""}.
8882 @end deftypevr
8883
8884 @deftypevr {@code{fifo-listener-configuration} parameter} string group
8885 The group to own the socket.
8886 Defaults to @samp{""}.
8887 @end deftypevr
8888
8889
8890 Available @code{inet-listener-configuration} fields are:
8891
8892 @deftypevr {@code{inet-listener-configuration} parameter} string protocol
8893 The protocol to listen for.
8894 @end deftypevr
8895
8896 @deftypevr {@code{inet-listener-configuration} parameter} string address
8897 The address on which to listen, or empty for all addresses.
8898 Defaults to @samp{""}.
8899 @end deftypevr
8900
8901 @deftypevr {@code{inet-listener-configuration} parameter} non-negative-integer port
8902 The port on which to listen.
8903 @end deftypevr
8904
8905 @deftypevr {@code{inet-listener-configuration} parameter} boolean ssl?
8906 Whether to use SSL for this service; @samp{yes}, @samp{no}, or
8907 @samp{required}.
8908 Defaults to @samp{#t}.
8909 @end deftypevr
8910
8911 @end deftypevr
8912
8913 @deftypevr {@code{service-configuration} parameter} non-negative-integer service-count
8914 Number of connections to handle before starting a new process.
8915 Typically the only useful values are 0 (unlimited) or 1. 1 is more
8916 secure, but 0 is faster. <doc/wiki/LoginProcess.txt>.
8917 Defaults to @samp{1}.
8918 @end deftypevr
8919
8920 @deftypevr {@code{service-configuration} parameter} non-negative-integer process-min-avail
8921 Number of processes to always keep waiting for more connections.
8922 Defaults to @samp{0}.
8923 @end deftypevr
8924
8925 @deftypevr {@code{service-configuration} parameter} non-negative-integer vsz-limit
8926 If you set @samp{service-count 0}, you probably need to grow
8927 this.
8928 Defaults to @samp{256000000}.
8929 @end deftypevr
8930
8931 @end deftypevr
8932
8933 @deftypevr {@code{dovecot-configuration} parameter} dict-configuration dict
8934 Dict configuration, as created by the @code{dict-configuration}
8935 constructor.
8936
8937 Available @code{dict-configuration} fields are:
8938
8939 @deftypevr {@code{dict-configuration} parameter} free-form-fields entries
8940 A list of key-value pairs that this dict should hold.
8941 Defaults to @samp{()}.
8942 @end deftypevr
8943
8944 @end deftypevr
8945
8946 @deftypevr {@code{dovecot-configuration} parameter} passdb-configuration-list passdbs
8947 A list of passdb configurations, each one created by the
8948 @code{passdb-configuration} constructor.
8949
8950 Available @code{passdb-configuration} fields are:
8951
8952 @deftypevr {@code{passdb-configuration} parameter} string driver
8953 The driver that the passdb should use. Valid values include
8954 @samp{pam}, @samp{passwd}, @samp{shadow}, @samp{bsdauth}, and
8955 @samp{static}.
8956 Defaults to @samp{"pam"}.
8957 @end deftypevr
8958
8959 @deftypevr {@code{passdb-configuration} parameter} free-form-args args
8960 A list of key-value args to the passdb driver.
8961 Defaults to @samp{()}.
8962 @end deftypevr
8963
8964 @end deftypevr
8965
8966 @deftypevr {@code{dovecot-configuration} parameter} userdb-configuration-list userdbs
8967 List of userdb configurations, each one created by the
8968 @code{userdb-configuration} constructor.
8969
8970 Available @code{userdb-configuration} fields are:
8971
8972 @deftypevr {@code{userdb-configuration} parameter} string driver
8973 The driver that the userdb should use. Valid values include
8974 @samp{passwd} and @samp{static}.
8975 Defaults to @samp{"passwd"}.
8976 @end deftypevr
8977
8978 @deftypevr {@code{userdb-configuration} parameter} free-form-args args
8979 A list of key-value args to the userdb driver.
8980 Defaults to @samp{()}.
8981 @end deftypevr
8982
8983 @deftypevr {@code{userdb-configuration} parameter} free-form-args override-fields
8984 Override fields from passwd.
8985 Defaults to @samp{()}.
8986 @end deftypevr
8987
8988 @end deftypevr
8989
8990 @deftypevr {@code{dovecot-configuration} parameter} plugin-configuration plugin-configuration
8991 Plug-in configuration, created by the @code{plugin-configuration}
8992 constructor.
8993 @end deftypevr
8994
8995 @deftypevr {@code{dovecot-configuration} parameter} list-of-namespace-configuration namespaces
8996 List of namespaces. Each item in the list is created by the
8997 @code{namespace-configuration} constructor.
8998
8999 Available @code{namespace-configuration} fields are:
9000
9001 @deftypevr {@code{namespace-configuration} parameter} string name
9002 Name for this namespace.
9003 @end deftypevr
9004
9005 @deftypevr {@code{namespace-configuration} parameter} string type
9006 Namespace type: @samp{private}, @samp{shared} or @samp{public}.
9007 Defaults to @samp{"private"}.
9008 @end deftypevr
9009
9010 @deftypevr {@code{namespace-configuration} parameter} string separator
9011 Hierarchy separator to use. You should use the same separator for
9012 all namespaces or some clients get confused. @samp{/} is usually a good
9013 one. The default however depends on the underlying mail storage
9014 format.
9015 Defaults to @samp{""}.
9016 @end deftypevr
9017
9018 @deftypevr {@code{namespace-configuration} parameter} string prefix
9019 Prefix required to access this namespace. This needs to be
9020 different for all namespaces. For example @samp{Public/}.
9021 Defaults to @samp{""}.
9022 @end deftypevr
9023
9024 @deftypevr {@code{namespace-configuration} parameter} string location
9025 Physical location of the mailbox. This is in the same format as
9026 mail_location, which is also the default for it.
9027 Defaults to @samp{""}.
9028 @end deftypevr
9029
9030 @deftypevr {@code{namespace-configuration} parameter} boolean inbox?
9031 There can be only one INBOX, and this setting defines which
9032 namespace has it.
9033 Defaults to @samp{#f}.
9034 @end deftypevr
9035
9036 @deftypevr {@code{namespace-configuration} parameter} boolean hidden?
9037 If namespace is hidden, it's not advertised to clients via NAMESPACE
9038 extension. You'll most likely also want to set @samp{list? #f}. This is mostly
9039 useful when converting from another server with different namespaces
9040 which you want to deprecate but still keep working. For example you can
9041 create hidden namespaces with prefixes @samp{~/mail/}, @samp{~%u/mail/}
9042 and @samp{mail/}.
9043 Defaults to @samp{#f}.
9044 @end deftypevr
9045
9046 @deftypevr {@code{namespace-configuration} parameter} boolean list?
9047 Show the mailboxes under this namespace with the LIST command. This
9048 makes the namespace visible for clients that do not support the NAMESPACE
9049 extension. The special @code{children} value lists child mailboxes, but
9050 hides the namespace prefix.
9051 Defaults to @samp{#t}.
9052 @end deftypevr
9053
9054 @deftypevr {@code{namespace-configuration} parameter} boolean subscriptions?
9055 Namespace handles its own subscriptions. If set to @code{#f}, the
9056 parent namespace handles them. The empty prefix should always have this
9057 as @code{#t}).
9058 Defaults to @samp{#t}.
9059 @end deftypevr
9060
9061 @deftypevr {@code{namespace-configuration} parameter} mailbox-configuration-list mailboxes
9062 List of predefined mailboxes in this namespace.
9063 Defaults to @samp{()}.
9064
9065 Available @code{mailbox-configuration} fields are:
9066
9067 @deftypevr {@code{mailbox-configuration} parameter} string name
9068 Name for this mailbox.
9069 @end deftypevr
9070
9071 @deftypevr {@code{mailbox-configuration} parameter} string auto
9072 @samp{create} will automatically create this mailbox.
9073 @samp{subscribe} will both create and subscribe to the mailbox.
9074 Defaults to @samp{"no"}.
9075 @end deftypevr
9076
9077 @deftypevr {@code{mailbox-configuration} parameter} space-separated-string-list special-use
9078 List of IMAP @code{SPECIAL-USE} attributes as specified by RFC 6154.
9079 Valid values are @code{\All}, @code{\Archive}, @code{\Drafts},
9080 @code{\Flagged}, @code{\Junk}, @code{\Sent}, and @code{\Trash}.
9081 Defaults to @samp{()}.
9082 @end deftypevr
9083
9084 @end deftypevr
9085
9086 @end deftypevr
9087
9088 @deftypevr {@code{dovecot-configuration} parameter} file-name base-dir
9089 Base directory where to store runtime data.
9090 Defaults to @samp{"/var/run/dovecot/"}.
9091 @end deftypevr
9092
9093 @deftypevr {@code{dovecot-configuration} parameter} string login-greeting
9094 Greeting message for clients.
9095 Defaults to @samp{"Dovecot ready."}.
9096 @end deftypevr
9097
9098 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-trusted-networks
9099 List of trusted network ranges. Connections from these IPs are
9100 allowed to override their IP addresses and ports (for logging and for
9101 authentication checks). @samp{disable-plaintext-auth} is also ignored
9102 for these networks. Typically you would specify your IMAP proxy servers
9103 here.
9104 Defaults to @samp{()}.
9105 @end deftypevr
9106
9107 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-access-sockets
9108 List of login access check sockets (e.g. tcpwrap).
9109 Defaults to @samp{()}.
9110 @end deftypevr
9111
9112 @deftypevr {@code{dovecot-configuration} parameter} boolean verbose-proctitle?
9113 Show more verbose process titles (in ps). Currently shows user name
9114 and IP address. Useful for seeing who is actually using the IMAP
9115 processes (e.g. shared mailboxes or if the same uid is used for multiple
9116 accounts).
9117 Defaults to @samp{#f}.
9118 @end deftypevr
9119
9120 @deftypevr {@code{dovecot-configuration} parameter} boolean shutdown-clients?
9121 Should all processes be killed when Dovecot master process shuts down.
9122 Setting this to @code{#f} means that Dovecot can be upgraded without
9123 forcing existing client connections to close (although that could also
9124 be a problem if the upgrade is e.g. due to a security fix).
9125 Defaults to @samp{#t}.
9126 @end deftypevr
9127
9128 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer doveadm-worker-count
9129 If non-zero, run mail commands via this many connections to doveadm
9130 server, instead of running them directly in the same process.
9131 Defaults to @samp{0}.
9132 @end deftypevr
9133
9134 @deftypevr {@code{dovecot-configuration} parameter} string doveadm-socket-path
9135 UNIX socket or host:port used for connecting to doveadm server.
9136 Defaults to @samp{"doveadm-server"}.
9137 @end deftypevr
9138
9139 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list import-environment
9140 List of environment variables that are preserved on Dovecot startup
9141 and passed down to all of its child processes. You can also give
9142 key=value pairs to always set specific settings.
9143 @end deftypevr
9144
9145 @deftypevr {@code{dovecot-configuration} parameter} boolean disable-plaintext-auth?
9146 Disable LOGIN command and all other plaintext authentications unless
9147 SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP
9148 matches the local IP (i.e. you're connecting from the same computer),
9149 the connection is considered secure and plaintext authentication is
9150 allowed. See also ssl=required setting.
9151 Defaults to @samp{#t}.
9152 @end deftypevr
9153
9154 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer auth-cache-size
9155 Authentication cache size (e.g. @samp{#e10e6}). 0 means it's disabled.
9156 Note that bsdauth, PAM and vpopmail require @samp{cache-key} to be set
9157 for caching to be used.
9158 Defaults to @samp{0}.
9159 @end deftypevr
9160
9161 @deftypevr {@code{dovecot-configuration} parameter} string auth-cache-ttl
9162 Time to live for cached data. After TTL expires the cached record
9163 is no longer used, *except* if the main database lookup returns internal
9164 failure. We also try to handle password changes automatically: If
9165 user's previous authentication was successful, but this one wasn't, the
9166 cache isn't used. For now this works only with plaintext
9167 authentication.
9168 Defaults to @samp{"1 hour"}.
9169 @end deftypevr
9170
9171 @deftypevr {@code{dovecot-configuration} parameter} string auth-cache-negative-ttl
9172 TTL for negative hits (user not found, password mismatch).
9173 0 disables caching them completely.
9174 Defaults to @samp{"1 hour"}.
9175 @end deftypevr
9176
9177 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list auth-realms
9178 List of realms for SASL authentication mechanisms that need them.
9179 You can leave it empty if you don't want to support multiple realms.
9180 Many clients simply use the first one listed here, so keep the default
9181 realm first.
9182 Defaults to @samp{()}.
9183 @end deftypevr
9184
9185 @deftypevr {@code{dovecot-configuration} parameter} string auth-default-realm
9186 Default realm/domain to use if none was specified. This is used for
9187 both SASL realms and appending @@domain to username in plaintext
9188 logins.
9189 Defaults to @samp{""}.
9190 @end deftypevr
9191
9192 @deftypevr {@code{dovecot-configuration} parameter} string auth-username-chars
9193 List of allowed characters in username. If the user-given username
9194 contains a character not listed in here, the login automatically fails.
9195 This is just an extra check to make sure user can't exploit any
9196 potential quote escaping vulnerabilities with SQL/LDAP databases. If
9197 you want to allow all characters, set this value to empty.
9198 Defaults to @samp{"abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@@"}.
9199 @end deftypevr
9200
9201 @deftypevr {@code{dovecot-configuration} parameter} string auth-username-translation
9202 Username character translations before it's looked up from
9203 databases. The value contains series of from -> to characters. For
9204 example @samp{#@@/@@} means that @samp{#} and @samp{/} characters are
9205 translated to @samp{@@}.
9206 Defaults to @samp{""}.
9207 @end deftypevr
9208
9209 @deftypevr {@code{dovecot-configuration} parameter} string auth-username-format
9210 Username formatting before it's looked up from databases. You can
9211 use the standard variables here, e.g. %Lu would lowercase the username,
9212 %n would drop away the domain if it was given, or @samp{%n-AT-%d} would
9213 change the @samp{@@} into @samp{-AT-}. This translation is done after
9214 @samp{auth-username-translation} changes.
9215 Defaults to @samp{"%Lu"}.
9216 @end deftypevr
9217
9218 @deftypevr {@code{dovecot-configuration} parameter} string auth-master-user-separator
9219 If you want to allow master users to log in by specifying the master
9220 username within the normal username string (i.e. not using SASL
9221 mechanism's support for it), you can specify the separator character
9222 here. The format is then <username><separator><master username>.
9223 UW-IMAP uses @samp{*} as the separator, so that could be a good
9224 choice.
9225 Defaults to @samp{""}.
9226 @end deftypevr
9227
9228 @deftypevr {@code{dovecot-configuration} parameter} string auth-anonymous-username
9229 Username to use for users logging in with ANONYMOUS SASL
9230 mechanism.
9231 Defaults to @samp{"anonymous"}.
9232 @end deftypevr
9233
9234 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer auth-worker-max-count
9235 Maximum number of dovecot-auth worker processes. They're used to
9236 execute blocking passdb and userdb queries (e.g. MySQL and PAM).
9237 They're automatically created and destroyed as needed.
9238 Defaults to @samp{30}.
9239 @end deftypevr
9240
9241 @deftypevr {@code{dovecot-configuration} parameter} string auth-gssapi-hostname
9242 Host name to use in GSSAPI principal names. The default is to use
9243 the name returned by gethostname(). Use @samp{$ALL} (with quotes) to
9244 allow all keytab entries.
9245 Defaults to @samp{""}.
9246 @end deftypevr
9247
9248 @deftypevr {@code{dovecot-configuration} parameter} string auth-krb5-keytab
9249 Kerberos keytab to use for the GSSAPI mechanism. Will use the
9250 system default (usually /etc/krb5.keytab) if not specified. You may
9251 need to change the auth service to run as root to be able to read this
9252 file.
9253 Defaults to @samp{""}.
9254 @end deftypevr
9255
9256 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-use-winbind?
9257 Do NTLM and GSS-SPNEGO authentication using Samba's winbind daemon
9258 and @samp{ntlm-auth} helper.
9259 <doc/wiki/Authentication/Mechanisms/Winbind.txt>.
9260 Defaults to @samp{#f}.
9261 @end deftypevr
9262
9263 @deftypevr {@code{dovecot-configuration} parameter} file-name auth-winbind-helper-path
9264 Path for Samba's @samp{ntlm-auth} helper binary.
9265 Defaults to @samp{"/usr/bin/ntlm_auth"}.
9266 @end deftypevr
9267
9268 @deftypevr {@code{dovecot-configuration} parameter} string auth-failure-delay
9269 Time to delay before replying to failed authentications.
9270 Defaults to @samp{"2 secs"}.
9271 @end deftypevr
9272
9273 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-ssl-require-client-cert?
9274 Require a valid SSL client certificate or the authentication
9275 fails.
9276 Defaults to @samp{#f}.
9277 @end deftypevr
9278
9279 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-ssl-username-from-cert?
9280 Take the username from client's SSL certificate, using
9281 @code{X509_NAME_get_text_by_NID()} which returns the subject's DN's
9282 CommonName.
9283 Defaults to @samp{#f}.
9284 @end deftypevr
9285
9286 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list auth-mechanisms
9287 List of wanted authentication mechanisms. Supported mechanisms are:
9288 @samp{plain}, @samp{login}, @samp{digest-md5}, @samp{cram-md5},
9289 @samp{ntlm}, @samp{rpa}, @samp{apop}, @samp{anonymous}, @samp{gssapi},
9290 @samp{otp}, @samp{skey}, and @samp{gss-spnego}. NOTE: See also
9291 @samp{disable-plaintext-auth} setting.
9292 @end deftypevr
9293
9294 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list director-servers
9295 List of IPs or hostnames to all director servers, including ourself.
9296 Ports can be specified as ip:port. The default port is the same as what
9297 director service's @samp{inet-listener} is using.
9298 Defaults to @samp{()}.
9299 @end deftypevr
9300
9301 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list director-mail-servers
9302 List of IPs or hostnames to all backend mail servers. Ranges are
9303 allowed too, like 10.0.0.10-10.0.0.30.
9304 Defaults to @samp{()}.
9305 @end deftypevr
9306
9307 @deftypevr {@code{dovecot-configuration} parameter} string director-user-expire
9308 How long to redirect users to a specific server after it no longer
9309 has any connections.
9310 Defaults to @samp{"15 min"}.
9311 @end deftypevr
9312
9313 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer director-doveadm-port
9314 TCP/IP port that accepts doveadm connections (instead of director
9315 connections) If you enable this, you'll also need to add
9316 @samp{inet-listener} for the port.
9317 Defaults to @samp{0}.
9318 @end deftypevr
9319
9320 @deftypevr {@code{dovecot-configuration} parameter} string director-username-hash
9321 How the username is translated before being hashed. Useful values
9322 include %Ln if user can log in with or without @@domain, %Ld if mailboxes
9323 are shared within domain.
9324 Defaults to @samp{"%Lu"}.
9325 @end deftypevr
9326
9327 @deftypevr {@code{dovecot-configuration} parameter} string log-path
9328 Log file to use for error messages. @samp{syslog} logs to syslog,
9329 @samp{/dev/stderr} logs to stderr.
9330 Defaults to @samp{"syslog"}.
9331 @end deftypevr
9332
9333 @deftypevr {@code{dovecot-configuration} parameter} string info-log-path
9334 Log file to use for informational messages. Defaults to
9335 @samp{log-path}.
9336 Defaults to @samp{""}.
9337 @end deftypevr
9338
9339 @deftypevr {@code{dovecot-configuration} parameter} string debug-log-path
9340 Log file to use for debug messages. Defaults to
9341 @samp{info-log-path}.
9342 Defaults to @samp{""}.
9343 @end deftypevr
9344
9345 @deftypevr {@code{dovecot-configuration} parameter} string syslog-facility
9346 Syslog facility to use if you're logging to syslog. Usually if you
9347 don't want to use @samp{mail}, you'll use local0..local7. Also other
9348 standard facilities are supported.
9349 Defaults to @samp{"mail"}.
9350 @end deftypevr
9351
9352 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-verbose?
9353 Log unsuccessful authentication attempts and the reasons why they
9354 failed.
9355 Defaults to @samp{#f}.
9356 @end deftypevr
9357
9358 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-verbose-passwords?
9359 In case of password mismatches, log the attempted password. Valid
9360 values are no, plain and sha1. sha1 can be useful for detecting brute
9361 force password attempts vs. user simply trying the same password over
9362 and over again. You can also truncate the value to n chars by appending
9363 ":n" (e.g. sha1:6).
9364 Defaults to @samp{#f}.
9365 @end deftypevr
9366
9367 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-debug?
9368 Even more verbose logging for debugging purposes. Shows for example
9369 SQL queries.
9370 Defaults to @samp{#f}.
9371 @end deftypevr
9372
9373 @deftypevr {@code{dovecot-configuration} parameter} boolean auth-debug-passwords?
9374 In case of password mismatches, log the passwords and used scheme so
9375 the problem can be debugged. Enabling this also enables
9376 @samp{auth-debug}.
9377 Defaults to @samp{#f}.
9378 @end deftypevr
9379
9380 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-debug?
9381 Enable mail process debugging. This can help you figure out why
9382 Dovecot isn't finding your mails.
9383 Defaults to @samp{#f}.
9384 @end deftypevr
9385
9386 @deftypevr {@code{dovecot-configuration} parameter} boolean verbose-ssl?
9387 Show protocol level SSL errors.
9388 Defaults to @samp{#f}.
9389 @end deftypevr
9390
9391 @deftypevr {@code{dovecot-configuration} parameter} string log-timestamp
9392 Prefix for each line written to log file. % codes are in
9393 strftime(3) format.
9394 Defaults to @samp{"\"%b %d %H:%M:%S \""}.
9395 @end deftypevr
9396
9397 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-log-format-elements
9398 List of elements we want to log. The elements which have a
9399 non-empty variable value are joined together to form a comma-separated
9400 string.
9401 @end deftypevr
9402
9403 @deftypevr {@code{dovecot-configuration} parameter} string login-log-format
9404 Login log format. %s contains @samp{login-log-format-elements}
9405 string, %$ contains the data we want to log.
9406 Defaults to @samp{"%$: %s"}.
9407 @end deftypevr
9408
9409 @deftypevr {@code{dovecot-configuration} parameter} string mail-log-prefix
9410 Log prefix for mail processes. See doc/wiki/Variables.txt for list
9411 of possible variables you can use.
9412 Defaults to @samp{"\"%s(%u): \""}.
9413 @end deftypevr
9414
9415 @deftypevr {@code{dovecot-configuration} parameter} string deliver-log-format
9416 Format to use for logging mail deliveries. You can use variables:
9417 @table @code
9418 @item %$
9419 Delivery status message (e.g. @samp{saved to INBOX})
9420 @item %m
9421 Message-ID
9422 @item %s
9423 Subject
9424 @item %f
9425 From address
9426 @item %p
9427 Physical size
9428 @item %w
9429 Virtual size.
9430 @end table
9431 Defaults to @samp{"msgid=%m: %$"}.
9432 @end deftypevr
9433
9434 @deftypevr {@code{dovecot-configuration} parameter} string mail-location
9435 Location for users' mailboxes. The default is empty, which means
9436 that Dovecot tries to find the mailboxes automatically. This won't work
9437 if the user doesn't yet have any mail, so you should explicitly tell
9438 Dovecot the full location.
9439
9440 If you're using mbox, giving a path to the INBOX
9441 file (e.g. /var/mail/%u) isn't enough. You'll also need to tell Dovecot
9442 where the other mailboxes are kept. This is called the "root mail
9443 directory", and it must be the first path given in the
9444 @samp{mail-location} setting.
9445
9446 There are a few special variables you can use, eg.:
9447
9448 @table @samp
9449 @item %u
9450 username
9451 @item %n
9452 user part in user@@domain, same as %u if there's no domain
9453 @item %d
9454 domain part in user@@domain, empty if there's no domain
9455 @item %h
9456 home director
9457 @end table
9458
9459 See doc/wiki/Variables.txt for full list. Some examples:
9460 @table @samp
9461 @item maildir:~/Maildir
9462 @item mbox:~/mail:INBOX=/var/mail/%u
9463 @item mbox:/var/mail/%d/%1n/%n:INDEX=/var/indexes/%d/%1n/%
9464 @end table
9465 Defaults to @samp{""}.
9466 @end deftypevr
9467
9468 @deftypevr {@code{dovecot-configuration} parameter} string mail-uid
9469 System user and group used to access mails. If you use multiple,
9470 userdb can override these by returning uid or gid fields. You can use
9471 either numbers or names. <doc/wiki/UserIds.txt>.
9472 Defaults to @samp{""}.
9473 @end deftypevr
9474
9475 @deftypevr {@code{dovecot-configuration} parameter} string mail-gid
9476
9477 Defaults to @samp{""}.
9478 @end deftypevr
9479
9480 @deftypevr {@code{dovecot-configuration} parameter} string mail-privileged-group
9481 Group to enable temporarily for privileged operations. Currently
9482 this is used only with INBOX when either its initial creation or
9483 dotlocking fails. Typically this is set to "mail" to give access to
9484 /var/mail.
9485 Defaults to @samp{""}.
9486 @end deftypevr
9487
9488 @deftypevr {@code{dovecot-configuration} parameter} string mail-access-groups
9489 Grant access to these supplementary groups for mail processes.
9490 Typically these are used to set up access to shared mailboxes. Note
9491 that it may be dangerous to set these if users can create
9492 symlinks (e.g. if "mail" group is set here, ln -s /var/mail ~/mail/var
9493 could allow a user to delete others' mailboxes, or ln -s
9494 /secret/shared/box ~/mail/mybox would allow reading it).
9495 Defaults to @samp{""}.
9496 @end deftypevr
9497
9498 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-full-filesystem-access?
9499 Allow full filesystem access to clients. There's no access checks
9500 other than what the operating system does for the active UID/GID. It
9501 works with both maildir and mboxes, allowing you to prefix mailboxes
9502 names with e.g. /path/ or ~user/.
9503 Defaults to @samp{#f}.
9504 @end deftypevr
9505
9506 @deftypevr {@code{dovecot-configuration} parameter} boolean mmap-disable?
9507 Don't use mmap() at all. This is required if you store indexes to
9508 shared filesystems (NFS or clustered filesystem).
9509 Defaults to @samp{#f}.
9510 @end deftypevr
9511
9512 @deftypevr {@code{dovecot-configuration} parameter} boolean dotlock-use-excl?
9513 Rely on @samp{O_EXCL} to work when creating dotlock files. NFS
9514 supports @samp{O_EXCL} since version 3, so this should be safe to use
9515 nowadays by default.
9516 Defaults to @samp{#t}.
9517 @end deftypevr
9518
9519 @deftypevr {@code{dovecot-configuration} parameter} string mail-fsync
9520 When to use fsync() or fdatasync() calls:
9521 @table @code
9522 @item optimized
9523 Whenever necessary to avoid losing important data
9524 @item always
9525 Useful with e.g. NFS when write()s are delayed
9526 @item never
9527 Never use it (best performance, but crashes can lose data).
9528 @end table
9529 Defaults to @samp{"optimized"}.
9530 @end deftypevr
9531
9532 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-nfs-storage?
9533 Mail storage exists in NFS. Set this to yes to make Dovecot flush
9534 NFS caches whenever needed. If you're using only a single mail server
9535 this isn't needed.
9536 Defaults to @samp{#f}.
9537 @end deftypevr
9538
9539 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-nfs-index?
9540 Mail index files also exist in NFS. Setting this to yes requires
9541 @samp{mmap-disable? #t} and @samp{fsync-disable? #f}.
9542 Defaults to @samp{#f}.
9543 @end deftypevr
9544
9545 @deftypevr {@code{dovecot-configuration} parameter} string lock-method
9546 Locking method for index files. Alternatives are fcntl, flock and
9547 dotlock. Dotlocking uses some tricks which may create more disk I/O
9548 than other locking methods. NFS users: flock doesn't work, remember to
9549 change @samp{mmap-disable}.
9550 Defaults to @samp{"fcntl"}.
9551 @end deftypevr
9552
9553 @deftypevr {@code{dovecot-configuration} parameter} file-name mail-temp-dir
9554 Directory in which LDA/LMTP temporarily stores incoming mails >128
9555 kB.
9556 Defaults to @samp{"/tmp"}.
9557 @end deftypevr
9558
9559 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer first-valid-uid
9560 Valid UID range for users. This is mostly to make sure that users can't
9561 log in as daemons or other system users. Note that denying root logins is
9562 hardcoded to dovecot binary and can't be done even if @samp{first-valid-uid}
9563 is set to 0.
9564 Defaults to @samp{500}.
9565 @end deftypevr
9566
9567 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer last-valid-uid
9568
9569 Defaults to @samp{0}.
9570 @end deftypevr
9571
9572 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer first-valid-gid
9573 Valid GID range for users. Users having non-valid GID as primary group ID
9574 aren't allowed to log in. If user belongs to supplementary groups with
9575 non-valid GIDs, those groups are not set.
9576 Defaults to @samp{1}.
9577 @end deftypevr
9578
9579 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer last-valid-gid
9580
9581 Defaults to @samp{0}.
9582 @end deftypevr
9583
9584 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-max-keyword-length
9585 Maximum allowed length for mail keyword name. It's only forced when
9586 trying to create new keywords.
9587 Defaults to @samp{50}.
9588 @end deftypevr
9589
9590 @deftypevr {@code{dovecot-configuration} parameter} colon-separated-file-name-list valid-chroot-dirs
9591 List of directories under which chrooting is allowed for mail
9592 processes (i.e. /var/mail will allow chrooting to /var/mail/foo/bar
9593 too). This setting doesn't affect @samp{login-chroot}
9594 @samp{mail-chroot} or auth chroot settings. If this setting is empty,
9595 "/./" in home dirs are ignored. WARNING: Never add directories here
9596 which local users can modify, that may lead to root exploit. Usually
9597 this should be done only if you don't allow shell access for users.
9598 <doc/wiki/Chrooting.txt>.
9599 Defaults to @samp{()}.
9600 @end deftypevr
9601
9602 @deftypevr {@code{dovecot-configuration} parameter} string mail-chroot
9603 Default chroot directory for mail processes. This can be overridden
9604 for specific users in user database by giving /./ in user's home
9605 directory (e.g. /home/./user chroots into /home). Note that usually
9606 there is no real need to do chrooting, Dovecot doesn't allow users to
9607 access files outside their mail directory anyway. If your home
9608 directories are prefixed with the chroot directory, append "/." to
9609 @samp{mail-chroot}. <doc/wiki/Chrooting.txt>.
9610 Defaults to @samp{""}.
9611 @end deftypevr
9612
9613 @deftypevr {@code{dovecot-configuration} parameter} file-name auth-socket-path
9614 UNIX socket path to master authentication server to find users.
9615 This is used by imap (for shared users) and lda.
9616 Defaults to @samp{"/var/run/dovecot/auth-userdb"}.
9617 @end deftypevr
9618
9619 @deftypevr {@code{dovecot-configuration} parameter} file-name mail-plugin-dir
9620 Directory where to look up mail plugins.
9621 Defaults to @samp{"/usr/lib/dovecot"}.
9622 @end deftypevr
9623
9624 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mail-plugins
9625 List of plugins to load for all services. Plugins specific to IMAP,
9626 LDA, etc. are added to this list in their own .conf files.
9627 Defaults to @samp{()}.
9628 @end deftypevr
9629
9630 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-cache-min-mail-count
9631 The minimum number of mails in a mailbox before updates are done to
9632 cache file. This allows optimizing Dovecot's behavior to do less disk
9633 writes at the cost of more disk reads.
9634 Defaults to @samp{0}.
9635 @end deftypevr
9636
9637 @deftypevr {@code{dovecot-configuration} parameter} string mailbox-idle-check-interval
9638 When IDLE command is running, mailbox is checked once in a while to
9639 see if there are any new mails or other changes. This setting defines
9640 the minimum time to wait between those checks. Dovecot can also use
9641 dnotify, inotify and kqueue to find out immediately when changes
9642 occur.
9643 Defaults to @samp{"30 secs"}.
9644 @end deftypevr
9645
9646 @deftypevr {@code{dovecot-configuration} parameter} boolean mail-save-crlf?
9647 Save mails with CR+LF instead of plain LF. This makes sending those
9648 mails take less CPU, especially with sendfile() syscall with Linux and
9649 FreeBSD. But it also creates a bit more disk I/O which may just make it
9650 slower. Also note that if other software reads the mboxes/maildirs,
9651 they may handle the extra CRs wrong and cause problems.
9652 Defaults to @samp{#f}.
9653 @end deftypevr
9654
9655 @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-stat-dirs?
9656 By default LIST command returns all entries in maildir beginning
9657 with a dot. Enabling this option makes Dovecot return only entries
9658 which are directories. This is done by stat()ing each entry, so it
9659 causes more disk I/O.
9660 (For systems setting struct @samp{dirent->d_type} this check is free
9661 and it's done always regardless of this setting).
9662 Defaults to @samp{#f}.
9663 @end deftypevr
9664
9665 @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-copy-with-hardlinks?
9666 When copying a message, do it with hard links whenever possible.
9667 This makes the performance much better, and it's unlikely to have any
9668 side effects.
9669 Defaults to @samp{#t}.
9670 @end deftypevr
9671
9672 @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-very-dirty-syncs?
9673 Assume Dovecot is the only MUA accessing Maildir: Scan cur/
9674 directory only when its mtime changes unexpectedly or when we can't find
9675 the mail otherwise.
9676 Defaults to @samp{#f}.
9677 @end deftypevr
9678
9679 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mbox-read-locks
9680 Which locking methods to use for locking mbox. There are four
9681 available:
9682
9683 @table @code
9684 @item dotlock
9685 Create <mailbox>.lock file. This is the oldest and most NFS-safe
9686 solution. If you want to use /var/mail/ like directory, the users will
9687 need write access to that directory.
9688 @item dotlock-try
9689 Same as dotlock, but if it fails because of permissions or because there
9690 isn't enough disk space, just skip it.
9691 @item fcntl
9692 Use this if possible. Works with NFS too if lockd is used.
9693 @item flock
9694 May not exist in all systems. Doesn't work with NFS.
9695 @item lockf
9696 May not exist in all systems. Doesn't work with NFS.
9697 @end table
9698
9699 You can use multiple locking methods; if you do the order they're declared
9700 in is important to avoid deadlocks if other MTAs/MUAs are using multiple
9701 locking methods as well. Some operating systems don't allow using some of
9702 them simultaneously.
9703 @end deftypevr
9704
9705 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mbox-write-locks
9706
9707 @end deftypevr
9708
9709 @deftypevr {@code{dovecot-configuration} parameter} string mbox-lock-timeout
9710 Maximum time to wait for lock (all of them) before aborting.
9711 Defaults to @samp{"5 mins"}.
9712 @end deftypevr
9713
9714 @deftypevr {@code{dovecot-configuration} parameter} string mbox-dotlock-change-timeout
9715 If dotlock exists but the mailbox isn't modified in any way,
9716 override the lock file after this much time.
9717 Defaults to @samp{"2 mins"}.
9718 @end deftypevr
9719
9720 @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-dirty-syncs?
9721 When mbox changes unexpectedly we have to fully read it to find out
9722 what changed. If the mbox is large this can take a long time. Since
9723 the change is usually just a newly appended mail, it'd be faster to
9724 simply read the new mails. If this setting is enabled, Dovecot does
9725 this but still safely fallbacks to re-reading the whole mbox file
9726 whenever something in mbox isn't how it's expected to be. The only real
9727 downside to this setting is that if some other MUA changes message
9728 flags, Dovecot doesn't notice it immediately. Note that a full sync is
9729 done with SELECT, EXAMINE, EXPUNGE and CHECK commands.
9730 Defaults to @samp{#t}.
9731 @end deftypevr
9732
9733 @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-very-dirty-syncs?
9734 Like @samp{mbox-dirty-syncs}, but don't do full syncs even with SELECT,
9735 EXAMINE, EXPUNGE or CHECK commands. If this is set,
9736 @samp{mbox-dirty-syncs} is ignored.
9737 Defaults to @samp{#f}.
9738 @end deftypevr
9739
9740 @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-lazy-writes?
9741 Delay writing mbox headers until doing a full write sync (EXPUNGE
9742 and CHECK commands and when closing the mailbox). This is especially
9743 useful for POP3 where clients often delete all mails. The downside is
9744 that our changes aren't immediately visible to other MUAs.
9745 Defaults to @samp{#t}.
9746 @end deftypevr
9747
9748 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mbox-min-index-size
9749 If mbox size is smaller than this (e.g. 100k), don't write index
9750 files. If an index file already exists it's still read, just not
9751 updated.
9752 Defaults to @samp{0}.
9753 @end deftypevr
9754
9755 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mdbox-rotate-size
9756 Maximum dbox file size until it's rotated.
9757 Defaults to @samp{2000000}.
9758 @end deftypevr
9759
9760 @deftypevr {@code{dovecot-configuration} parameter} string mdbox-rotate-interval
9761 Maximum dbox file age until it's rotated. Typically in days. Day
9762 begins from midnight, so 1d = today, 2d = yesterday, etc. 0 = check
9763 disabled.
9764 Defaults to @samp{"1d"}.
9765 @end deftypevr
9766
9767 @deftypevr {@code{dovecot-configuration} parameter} boolean mdbox-preallocate-space?
9768 When creating new mdbox files, immediately preallocate their size to
9769 @samp{mdbox-rotate-size}. This setting currently works only in Linux
9770 with some filesystems (ext4, xfs).
9771 Defaults to @samp{#f}.
9772 @end deftypevr
9773
9774 @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-dir
9775 sdbox and mdbox support saving mail attachments to external files,
9776 which also allows single instance storage for them. Other backends
9777 don't support this for now.
9778
9779 WARNING: This feature hasn't been tested much yet. Use at your own risk.
9780
9781 Directory root where to store mail attachments. Disabled, if empty.
9782 Defaults to @samp{""}.
9783 @end deftypevr
9784
9785 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-attachment-min-size
9786 Attachments smaller than this aren't saved externally. It's also
9787 possible to write a plugin to disable saving specific attachments
9788 externally.
9789 Defaults to @samp{128000}.
9790 @end deftypevr
9791
9792 @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-fs
9793 Filesystem backend to use for saving attachments:
9794 @table @code
9795 @item posix
9796 No SiS done by Dovecot (but this might help FS's own deduplication)
9797 @item sis posix
9798 SiS with immediate byte-by-byte comparison during saving
9799 @item sis-queue posix
9800 SiS with delayed comparison and deduplication.
9801 @end table
9802 Defaults to @samp{"sis posix"}.
9803 @end deftypevr
9804
9805 @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-hash
9806 Hash format to use in attachment filenames. You can add any text and
9807 variables: @code{%@{md4@}}, @code{%@{md5@}}, @code{%@{sha1@}},
9808 @code{%@{sha256@}}, @code{%@{sha512@}}, @code{%@{size@}}. Variables can be
9809 truncated, e.g. @code{%@{sha256:80@}} returns only first 80 bits.
9810 Defaults to @samp{"%@{sha1@}"}.
9811 @end deftypevr
9812
9813 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-process-limit
9814
9815 Defaults to @samp{100}.
9816 @end deftypevr
9817
9818 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-client-limit
9819
9820 Defaults to @samp{1000}.
9821 @end deftypevr
9822
9823 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-vsz-limit
9824 Default VSZ (virtual memory size) limit for service processes.
9825 This is mainly intended to catch and kill processes that leak memory
9826 before they eat up everything.
9827 Defaults to @samp{256000000}.
9828 @end deftypevr
9829
9830 @deftypevr {@code{dovecot-configuration} parameter} string default-login-user
9831 Login user is internally used by login processes. This is the most
9832 untrusted user in Dovecot system. It shouldn't have access to anything
9833 at all.
9834 Defaults to @samp{"dovenull"}.
9835 @end deftypevr
9836
9837 @deftypevr {@code{dovecot-configuration} parameter} string default-internal-user
9838 Internal user is used by unprivileged processes. It should be
9839 separate from login user, so that login processes can't disturb other
9840 processes.
9841 Defaults to @samp{"dovecot"}.
9842 @end deftypevr
9843
9844 @deftypevr {@code{dovecot-configuration} parameter} string ssl?
9845 SSL/TLS support: yes, no, required. <doc/wiki/SSL.txt>.
9846 Defaults to @samp{"required"}.
9847 @end deftypevr
9848
9849 @deftypevr {@code{dovecot-configuration} parameter} string ssl-cert
9850 PEM encoded X.509 SSL/TLS certificate (public key).
9851 Defaults to @samp{"</etc/dovecot/default.pem"}.
9852 @end deftypevr
9853
9854 @deftypevr {@code{dovecot-configuration} parameter} string ssl-key
9855 PEM encoded SSL/TLS private key. The key is opened before
9856 dropping root privileges, so keep the key file unreadable by anyone but
9857 root.
9858 Defaults to @samp{"</etc/dovecot/private/default.pem"}.
9859 @end deftypevr
9860
9861 @deftypevr {@code{dovecot-configuration} parameter} string ssl-key-password
9862 If key file is password protected, give the password here.
9863 Alternatively give it when starting dovecot with -p parameter. Since
9864 this file is often world-readable, you may want to place this setting
9865 instead to a different.
9866 Defaults to @samp{""}.
9867 @end deftypevr
9868
9869 @deftypevr {@code{dovecot-configuration} parameter} string ssl-ca
9870 PEM encoded trusted certificate authority. Set this only if you
9871 intend to use @samp{ssl-verify-client-cert? #t}. The file should
9872 contain the CA certificate(s) followed by the matching
9873 CRL(s). (e.g. @samp{ssl-ca </etc/ssl/certs/ca.pem}).
9874 Defaults to @samp{""}.
9875 @end deftypevr
9876
9877 @deftypevr {@code{dovecot-configuration} parameter} boolean ssl-require-crl?
9878 Require that CRL check succeeds for client certificates.
9879 Defaults to @samp{#t}.
9880 @end deftypevr
9881
9882 @deftypevr {@code{dovecot-configuration} parameter} boolean ssl-verify-client-cert?
9883 Request client to send a certificate. If you also want to require
9884 it, set @samp{auth-ssl-require-client-cert? #t} in auth section.
9885 Defaults to @samp{#f}.
9886 @end deftypevr
9887
9888 @deftypevr {@code{dovecot-configuration} parameter} string ssl-cert-username-field
9889 Which field from certificate to use for username. commonName and
9890 x500UniqueIdentifier are the usual choices. You'll also need to set
9891 @samp{auth-ssl-username-from-cert? #t}.
9892 Defaults to @samp{"commonName"}.
9893 @end deftypevr
9894
9895 @deftypevr {@code{dovecot-configuration} parameter} hours ssl-parameters-regenerate
9896 How often to regenerate the SSL parameters file. Generation is
9897 quite CPU intensive operation. The value is in hours, 0 disables
9898 regeneration entirely.
9899 Defaults to @samp{168}.
9900 @end deftypevr
9901
9902 @deftypevr {@code{dovecot-configuration} parameter} string ssl-protocols
9903 SSL protocols to use.
9904 Defaults to @samp{"!SSLv2"}.
9905 @end deftypevr
9906
9907 @deftypevr {@code{dovecot-configuration} parameter} string ssl-cipher-list
9908 SSL ciphers to use.
9909 Defaults to @samp{"ALL:!LOW:!SSLv2:!EXP:!aNULL"}.
9910 @end deftypevr
9911
9912 @deftypevr {@code{dovecot-configuration} parameter} string ssl-crypto-device
9913 SSL crypto device to use, for valid values run "openssl engine".
9914 Defaults to @samp{""}.
9915 @end deftypevr
9916
9917 @deftypevr {@code{dovecot-configuration} parameter} string postmaster-address
9918 Address to use when sending rejection mails.
9919 Default is postmaster@@<your domain>. %d expands to recipient domain.
9920 Defaults to @samp{""}.
9921 @end deftypevr
9922
9923 @deftypevr {@code{dovecot-configuration} parameter} string hostname
9924 Hostname to use in various parts of sent mails (e.g. in Message-Id)
9925 and in LMTP replies. Default is the system's real hostname@@domain.
9926 Defaults to @samp{""}.
9927 @end deftypevr
9928
9929 @deftypevr {@code{dovecot-configuration} parameter} boolean quota-full-tempfail?
9930 If user is over quota, return with temporary failure instead of
9931 bouncing the mail.
9932 Defaults to @samp{#f}.
9933 @end deftypevr
9934
9935 @deftypevr {@code{dovecot-configuration} parameter} file-name sendmail-path
9936 Binary to use for sending mails.
9937 Defaults to @samp{"/usr/sbin/sendmail"}.
9938 @end deftypevr
9939
9940 @deftypevr {@code{dovecot-configuration} parameter} string submission-host
9941 If non-empty, send mails via this SMTP host[:port] instead of
9942 sendmail.
9943 Defaults to @samp{""}.
9944 @end deftypevr
9945
9946 @deftypevr {@code{dovecot-configuration} parameter} string rejection-subject
9947 Subject: header to use for rejection mails. You can use the same
9948 variables as for @samp{rejection-reason} below.
9949 Defaults to @samp{"Rejected: %s"}.
9950 @end deftypevr
9951
9952 @deftypevr {@code{dovecot-configuration} parameter} string rejection-reason
9953 Human readable error message for rejection mails. You can use
9954 variables:
9955
9956 @table @code
9957 @item %n
9958 CRLF
9959 @item %r
9960 reason
9961 @item %s
9962 original subject
9963 @item %t
9964 recipient
9965 @end table
9966 Defaults to @samp{"Your message to <%t> was automatically rejected:%n%r"}.
9967 @end deftypevr
9968
9969 @deftypevr {@code{dovecot-configuration} parameter} string recipient-delimiter
9970 Delimiter character between local-part and detail in email
9971 address.
9972 Defaults to @samp{"+"}.
9973 @end deftypevr
9974
9975 @deftypevr {@code{dovecot-configuration} parameter} string lda-original-recipient-header
9976 Header where the original recipient address (SMTP's RCPT TO:
9977 address) is taken from if not available elsewhere. With dovecot-lda -a
9978 parameter overrides this. A commonly used header for this is
9979 X-Original-To.
9980 Defaults to @samp{""}.
9981 @end deftypevr
9982
9983 @deftypevr {@code{dovecot-configuration} parameter} boolean lda-mailbox-autocreate?
9984 Should saving a mail to a nonexistent mailbox automatically create
9985 it?.
9986 Defaults to @samp{#f}.
9987 @end deftypevr
9988
9989 @deftypevr {@code{dovecot-configuration} parameter} boolean lda-mailbox-autosubscribe?
9990 Should automatically created mailboxes be also automatically
9991 subscribed?.
9992 Defaults to @samp{#f}.
9993 @end deftypevr
9994
9995 @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer imap-max-line-length
9996 Maximum IMAP command line length. Some clients generate very long
9997 command lines with huge mailboxes, so you may need to raise this if you
9998 get "Too long argument" or "IMAP command line too large" errors
9999 often.
10000 Defaults to @samp{64000}.
10001 @end deftypevr
10002
10003 @deftypevr {@code{dovecot-configuration} parameter} string imap-logout-format
10004 IMAP logout format string:
10005 @table @code
10006 @item %i
10007 total number of bytes read from client
10008 @item %o
10009 total number of bytes sent to client.
10010 @end table
10011 Defaults to @samp{"in=%i out=%o"}.
10012 @end deftypevr
10013
10014 @deftypevr {@code{dovecot-configuration} parameter} string imap-capability
10015 Override the IMAP CAPABILITY response. If the value begins with '+',
10016 add the given capabilities on top of the defaults (e.g. +XFOO XBAR).
10017 Defaults to @samp{""}.
10018 @end deftypevr
10019
10020 @deftypevr {@code{dovecot-configuration} parameter} string imap-idle-notify-interval
10021 How long to wait between "OK Still here" notifications when client
10022 is IDLEing.
10023 Defaults to @samp{"2 mins"}.
10024 @end deftypevr
10025
10026 @deftypevr {@code{dovecot-configuration} parameter} string imap-id-send
10027 ID field names and values to send to clients. Using * as the value
10028 makes Dovecot use the default value. The following fields have default
10029 values currently: name, version, os, os-version, support-url,
10030 support-email.
10031 Defaults to @samp{""}.
10032 @end deftypevr
10033
10034 @deftypevr {@code{dovecot-configuration} parameter} string imap-id-log
10035 ID fields sent by client to log. * means everything.
10036 Defaults to @samp{""}.
10037 @end deftypevr
10038
10039 @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list imap-client-workarounds
10040 Workarounds for various client bugs:
10041
10042 @table @code
10043 @item delay-newmail
10044 Send EXISTS/RECENT new mail notifications only when replying to NOOP and
10045 CHECK commands. Some clients ignore them otherwise, for example OSX
10046 Mail (<v2.1). Outlook Express breaks more badly though, without this it
10047 may show user "Message no longer in server" errors. Note that OE6
10048 still breaks even with this workaround if synchronization is set to
10049 "Headers Only".
10050
10051 @item tb-extra-mailbox-sep
10052 Thunderbird gets somehow confused with LAYOUT=fs (mbox and dbox) and
10053 adds extra @samp{/} suffixes to mailbox names. This option causes Dovecot to
10054 ignore the extra @samp{/} instead of treating it as invalid mailbox name.
10055
10056 @item tb-lsub-flags
10057 Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox).
10058 This makes Thunderbird realize they aren't selectable and show them
10059 greyed out, instead of only later giving "not selectable" popup error.
10060 @end table
10061 Defaults to @samp{()}.
10062 @end deftypevr
10063
10064 @deftypevr {@code{dovecot-configuration} parameter} string imap-urlauth-host
10065 Host allowed in URLAUTH URLs sent by client. "*" allows all.
10066 Defaults to @samp{""}.
10067 @end deftypevr
10068
10069
10070 Whew! Lots of configuration options. The nice thing about it though is
10071 that GuixSD has a complete interface to Dovecot's configuration
10072 language. This allows not only a nice way to declare configurations,
10073 but also offers reflective capabilities as well: users can write code to
10074 inspect and transform configurations from within Scheme.
10075
10076 However, it could be that you just want to get a @code{dovecot.conf} up
10077 and running. In that case, you can pass an
10078 @code{opaque-dovecot-configuration} as the @code{#:config} parameter to
10079 @code{dovecot-service}. As its name indicates, an opaque configuration
10080 does not have easy reflective capabilities.
10081
10082 Available @code{opaque-dovecot-configuration} fields are:
10083
10084 @deftypevr {@code{opaque-dovecot-configuration} parameter} package dovecot
10085 The dovecot package.
10086 @end deftypevr
10087
10088 @deftypevr {@code{opaque-dovecot-configuration} parameter} string string
10089 The contents of the @code{dovecot.conf}, as a string.
10090 @end deftypevr
10091
10092 For example, if your @code{dovecot.conf} is just the empty string, you
10093 could instantiate a dovecot service like this:
10094
10095 @example
10096 (dovecot-service #:config
10097 (opaque-dovecot-configuration
10098 (string "")))
10099 @end example
10100
10101 @node Web Services
10102 @subsubsection Web Services
10103
10104 The @code{(gnu services web)} module provides the following service:
10105
10106 @deffn {Scheme Procedure} nginx-service [#:nginx nginx] @
10107 [#:log-directory ``/var/log/nginx''] @
10108 [#:run-directory ``/var/run/nginx''] @
10109 [#:config-file]
10110
10111 Return a service that runs @var{nginx}, the nginx web server.
10112
10113 The nginx daemon loads its runtime configuration from @var{config-file}.
10114 Log files are written to @var{log-directory} and temporary runtime data
10115 files are written to @var{run-directory}. For proper operation, these
10116 arguments should match what is in @var{config-file} to ensure that the
10117 directories are created when the service is activated.
10118
10119 @end deffn
10120
10121 @node Various Services
10122 @subsubsection Various Services
10123
10124
10125 @subsubheading RPC Bind Service
10126 @cindex rpcbind
10127
10128 The @code{(gnu services nfs)} module provides the following:
10129
10130 @defvr {Scheme Variable} rpcbind-service-type
10131 A service type for the RPC portmapper daemon.
10132 @end defvr
10133
10134
10135 @deftp {Data Type} rpcbind-configuration
10136 Data type representing the configuration of the RPC Bind Service.
10137 This type has the following parameters:
10138 @table @asis
10139 @item @code{rpcbind} (default: @code{rpcbind})
10140 The rpcbind package to use.
10141
10142 @item @code{warm-start?} (default: @code{#t})
10143 If this parameter is @code{#t}, then the daemon will read a
10144 state file on startup thus reloading state information saved by a previous
10145 instance.
10146 @end table
10147 @end deftp
10148
10149 @cindex lirc
10150 @subsubheading Lirc Service
10151
10152 The @code{(gnu services lirc)} module provides the following service.
10153
10154 @deffn {Scheme Procedure} lirc-service [#:lirc lirc] @
10155 [#:device #f] [#:driver #f] [#:config-file #f] @
10156 [#:extra-options '()]
10157 Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that
10158 decodes infrared signals from remote controls.
10159
10160 Optionally, @var{device}, @var{driver} and @var{config-file}
10161 (configuration file name) may be specified. See @command{lircd} manual
10162 for details.
10163
10164 Finally, @var{extra-options} is a list of additional command-line options
10165 passed to @command{lircd}.
10166 @end deffn
10167
10168 @cindex spice
10169 @subsubheading Spice Service
10170
10171 The @code{(gnu services spice)} module provides the following service.
10172
10173 @deffn {Scheme Procedure} spice-vdagent-service [#:spice-vdagent]
10174 Returns a service that runs @url{http://www.spice-space.org,VDAGENT}, a daemon
10175 that enables sharing the clipboard with a vm and setting the guest display
10176 resolution when the graphical console window resizes.
10177 @end deffn
10178
10179 @subsubsection Dictionary Services
10180 The @code{(gnu services dict)} module provides the following service:
10181
10182 @deffn {Scheme Procedure} dicod-service [#:config (dicod-configuration)]
10183 Return a service that runs the @command{dicod} daemon, an implementation
10184 of DICT server (@pxref{Dicod,,, dico, GNU Dico Manual}).
10185
10186 The optional @var{config} argument specifies the configuration for
10187 @command{dicod}, which should be a @code{<dicod-configuration>} object, by
10188 default it serves the GNU Collaborative International Dictonary of English.
10189
10190 You can add @command{open localhost} to your @file{~/.dico} file to make
10191 @code{localhost} the default server for @command{dico} client
10192 (@pxref{Initialization File,,, dico, GNU Dico Manual}).
10193 @end deffn
10194
10195 @deftp {Data Type} dicod-configuration
10196 Data type representing the configuration of dicod.
10197
10198 @table @asis
10199 @item @code{dico} (default: @var{dico})
10200 Package object of the GNU Dico dictionary server.
10201
10202 @item @code{interfaces} (default: @var{'("localhost")})
10203 This is the list of IP addresses and ports and possibly socket file
10204 names to listen to (@pxref{Server Settings, @code{listen} directive,,
10205 dico, GNU Dico Manual}).
10206
10207 @item @code{databases} (default: @var{(list %dicod-database:gcide)})
10208 List of @code{<dicod-database>} objects denoting dictionaries to be served.
10209 @end table
10210 @end deftp
10211
10212 @deftp {Data Type} dicod-database
10213 Data type representing a dictionary database.
10214
10215 @table @asis
10216 @item @code{name}
10217 Name of the database, will be used in DICT commands.
10218
10219 @item @code{module}
10220 Name of the dicod module used by this database
10221 (@pxref{Modules,,, dico, GNU Dico Manual}).
10222
10223 @item @code{options}
10224 List of strings or gexps representing the arguments for the module handler
10225 (@pxref{Handlers,,, dico, GNU Dico Manual}).
10226 @end table
10227 @end deftp
10228
10229 @defvr {Scheme Variable} %dicod-database:gcide
10230 A @code{<dicod-database>} object serving the GNU Collaborative International
10231 Dictonary of English using the @code{gcide} package.
10232 @end defvr
10233
10234 @node Setuid Programs
10235 @subsection Setuid Programs
10236
10237 @cindex setuid programs
10238 Some programs need to run with ``root'' privileges, even when they are
10239 launched by unprivileged users. A notorious example is the
10240 @command{passwd} program, which users can run to change their
10241 password, and which needs to access the @file{/etc/passwd} and
10242 @file{/etc/shadow} files---something normally restricted to root, for
10243 obvious security reasons. To address that, these executables are
10244 @dfn{setuid-root}, meaning that they always run with root privileges
10245 (@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual},
10246 for more info about the setuid mechanism.)
10247
10248 The store itself @emph{cannot} contain setuid programs: that would be a
10249 security issue since any user on the system can write derivations that
10250 populate the store (@pxref{The Store}). Thus, a different mechanism is
10251 used: instead of changing the setuid bit directly on files that are in
10252 the store, we let the system administrator @emph{declare} which programs
10253 should be setuid root.
10254
10255 The @code{setuid-programs} field of an @code{operating-system}
10256 declaration contains a list of G-expressions denoting the names of
10257 programs to be setuid-root (@pxref{Using the Configuration System}).
10258 For instance, the @command{passwd} program, which is part of the Shadow
10259 package, can be designated by this G-expression (@pxref{G-Expressions}):
10260
10261 @example
10262 #~(string-append #$shadow "/bin/passwd")
10263 @end example
10264
10265 A default set of setuid programs is defined by the
10266 @code{%setuid-programs} variable of the @code{(gnu system)} module.
10267
10268 @defvr {Scheme Variable} %setuid-programs
10269 A list of G-expressions denoting common programs that are setuid-root.
10270
10271 The list includes commands such as @command{passwd}, @command{ping},
10272 @command{su}, and @command{sudo}.
10273 @end defvr
10274
10275 Under the hood, the actual setuid programs are created in the
10276 @file{/run/setuid-programs} directory at system activation time. The
10277 files in this directory refer to the ``real'' binaries, which are in the
10278 store.
10279
10280 @node X.509 Certificates
10281 @subsection X.509 Certificates
10282
10283 @cindex HTTPS, certificates
10284 @cindex X.509 certificates
10285 @cindex TLS
10286 Web servers available over HTTPS (that is, HTTP over the transport-layer
10287 security mechanism, TLS) send client programs an @dfn{X.509 certificate}
10288 that the client can then use to @emph{authenticate} the server. To do
10289 that, clients verify that the server's certificate is signed by a
10290 so-called @dfn{certificate authority} (CA). But to verify the CA's
10291 signature, clients must have first acquired the CA's certificate.
10292
10293 Web browsers such as GNU@tie{}IceCat include their own set of CA
10294 certificates, such that they are able to verify CA signatures
10295 out-of-the-box.
10296
10297 However, most other programs that can talk HTTPS---@command{wget},
10298 @command{git}, @command{w3m}, etc.---need to be told where CA
10299 certificates can be found.
10300
10301 @cindex @code{nss-certs}
10302 In GuixSD, this is done by adding a package that provides certificates
10303 to the @code{packages} field of the @code{operating-system} declaration
10304 (@pxref{operating-system Reference}). GuixSD includes one such package,
10305 @code{nss-certs}, which is a set of CA certificates provided as part of
10306 Mozilla's Network Security Services.
10307
10308 Note that it is @emph{not} part of @var{%base-packages}, so you need to
10309 explicitly add it. The @file{/etc/ssl/certs} directory, which is where
10310 most applications and libraries look for certificates by default, points
10311 to the certificates installed globally.
10312
10313 Unprivileged users, including users of Guix on a foreign distro,
10314 can also install their own certificate package in
10315 their profile. A number of environment variables need to be defined so
10316 that applications and libraries know where to find them. Namely, the
10317 OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE}
10318 variables. Some applications add their own environment variables; for
10319 instance, the Git version control system honors the certificate bundle
10320 pointed to by the @code{GIT_SSL_CAINFO} environment variable. Thus, you
10321 would typically run something like:
10322
10323 @example
10324 $ guix package -i nss-certs
10325 $ export SSL_CERT_DIR="$HOME/.guix-profile/etc/ssl/certs"
10326 $ export SSL_CERT_FILE="$HOME/.guix-profile/etc/ssl/certs/ca-certificates.crt"
10327 $ export GIT_SSL_CAINFO="$SSL_CERT_FILE"
10328 @end example
10329
10330 @node Name Service Switch
10331 @subsection Name Service Switch
10332
10333 @cindex name service switch
10334 @cindex NSS
10335 The @code{(gnu system nss)} module provides bindings to the
10336 configuration file of the libc @dfn{name service switch} or @dfn{NSS}
10337 (@pxref{NSS Configuration File,,, libc, The GNU C Library Reference
10338 Manual}). In a nutshell, the NSS is a mechanism that allows libc to be
10339 extended with new ``name'' lookup methods for system databases, which
10340 includes host names, service names, user accounts, and more (@pxref{Name
10341 Service Switch, System Databases and Name Service Switch,, libc, The GNU
10342 C Library Reference Manual}).
10343
10344 The NSS configuration specifies, for each system database, which lookup
10345 method is to be used, and how the various methods are chained
10346 together---for instance, under which circumstances NSS should try the
10347 next method in the list. The NSS configuration is given in the
10348 @code{name-service-switch} field of @code{operating-system} declarations
10349 (@pxref{operating-system Reference, @code{name-service-switch}}).
10350
10351 @cindex nss-mdns
10352 @cindex .local, host name lookup
10353 As an example, the declaration below configures the NSS to use the
10354 @uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns}
10355 back-end}, which supports host name lookups over multicast DNS (mDNS)
10356 for host names ending in @code{.local}:
10357
10358 @example
10359 (name-service-switch
10360 (hosts (list %files ;first, check /etc/hosts
10361
10362 ;; If the above did not succeed, try
10363 ;; with 'mdns_minimal'.
10364 (name-service
10365 (name "mdns_minimal")
10366
10367 ;; 'mdns_minimal' is authoritative for
10368 ;; '.local'. When it returns "not found",
10369 ;; no need to try the next methods.
10370 (reaction (lookup-specification
10371 (not-found => return))))
10372
10373 ;; Then fall back to DNS.
10374 (name-service
10375 (name "dns"))
10376
10377 ;; Finally, try with the "full" 'mdns'.
10378 (name-service
10379 (name "mdns")))))
10380 @end example
10381
10382 Do not worry: the @code{%mdns-host-lookup-nss} variable (see below)
10383 contains this configuration, so you will not have to type it if all you
10384 want is to have @code{.local} host lookup working.
10385
10386 Note that, in this case, in addition to setting the
10387 @code{name-service-switch} of the @code{operating-system} declaration,
10388 you also need to use @code{avahi-service} (@pxref{Networking Services,
10389 @code{avahi-service}}), or @var{%desktop-services}, which includes it
10390 (@pxref{Desktop Services}). Doing this makes @code{nss-mdns} accessible
10391 to the name service cache daemon (@pxref{Base Services,
10392 @code{nscd-service}}).
10393
10394 For convenience, the following variables provide typical NSS
10395 configurations.
10396
10397 @defvr {Scheme Variable} %default-nss
10398 This is the default name service switch configuration, a
10399 @code{name-service-switch} object.
10400 @end defvr
10401
10402 @defvr {Scheme Variable} %mdns-host-lookup-nss
10403 This is the name service switch configuration with support for host name
10404 lookup over multicast DNS (mDNS) for host names ending in @code{.local}.
10405 @end defvr
10406
10407 The reference for name service switch configuration is given below. It
10408 is a direct mapping of the configuration file format of the C library , so
10409 please refer to the C library manual for more information (@pxref{NSS
10410 Configuration File,,, libc, The GNU C Library Reference Manual}).
10411 Compared to the configuration file format of libc NSS, it has the advantage
10412 not only of adding this warm parenthetic feel that we like, but also
10413 static checks: you will know about syntax errors and typos as soon as you
10414 run @command{guix system}.
10415
10416 @deftp {Data Type} name-service-switch
10417
10418 This is the data type representation the configuration of libc's name
10419 service switch (NSS). Each field below represents one of the supported
10420 system databases.
10421
10422 @table @code
10423 @item aliases
10424 @itemx ethers
10425 @itemx group
10426 @itemx gshadow
10427 @itemx hosts
10428 @itemx initgroups
10429 @itemx netgroup
10430 @itemx networks
10431 @itemx password
10432 @itemx public-key
10433 @itemx rpc
10434 @itemx services
10435 @itemx shadow
10436 The system databases handled by the NSS. Each of these fields must be a
10437 list of @code{<name-service>} objects (see below).
10438 @end table
10439 @end deftp
10440
10441 @deftp {Data Type} name-service
10442
10443 This is the data type representing an actual name service and the
10444 associated lookup action.
10445
10446 @table @code
10447 @item name
10448 A string denoting the name service (@pxref{Services in the NSS
10449 configuration,,, libc, The GNU C Library Reference Manual}).
10450
10451 Note that name services listed here must be visible to nscd. This is
10452 achieved by passing the @code{#:name-services} argument to
10453 @code{nscd-service} the list of packages providing the needed name
10454 services (@pxref{Base Services, @code{nscd-service}}).
10455
10456 @item reaction
10457 An action specified using the @code{lookup-specification} macro
10458 (@pxref{Actions in the NSS configuration,,, libc, The GNU C Library
10459 Reference Manual}). For example:
10460
10461 @example
10462 (lookup-specification (unavailable => continue)
10463 (success => return))
10464 @end example
10465 @end table
10466 @end deftp
10467
10468 @node Initial RAM Disk
10469 @subsection Initial RAM Disk
10470
10471 @cindex initial RAM disk (initrd)
10472 @cindex initrd (initial RAM disk)
10473 For bootstrapping purposes, the Linux-Libre kernel is passed an
10474 @dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary
10475 root file system as well as an initialization script. The latter is
10476 responsible for mounting the real root file system, and for loading any
10477 kernel modules that may be needed to achieve that.
10478
10479 The @code{initrd} field of an @code{operating-system} declaration allows
10480 you to specify which initrd you would like to use. The @code{(gnu
10481 system linux-initrd)} module provides two ways to build an initrd: the
10482 high-level @code{base-initrd} procedure, and the low-level
10483 @code{expression->initrd} procedure.
10484
10485 The @code{base-initrd} procedure is intended to cover most common uses.
10486 For example, if you want to add a bunch of kernel modules to be loaded
10487 at boot time, you can define the @code{initrd} field of the operating
10488 system declaration like this:
10489
10490 @example
10491 (initrd (lambda (file-systems . rest)
10492 ;; Create a standard initrd that has modules "foo.ko"
10493 ;; and "bar.ko", as well as their dependencies, in
10494 ;; addition to the modules available by default.
10495 (apply base-initrd file-systems
10496 #:extra-modules '("foo" "bar")
10497 rest)))
10498 @end example
10499
10500 The @code{base-initrd} procedure also handles common use cases that
10501 involves using the system as a QEMU guest, or as a ``live'' system with
10502 volatile root file system.
10503
10504 The initial RAM disk produced by @code{base-initrd} honors several
10505 options passed on the Linux kernel command line (that is, arguments
10506 passed @i{via} the @code{linux} command of GRUB, or the
10507 @code{-append} option) of QEMU, notably:
10508
10509 @table @code
10510 @item --load=@var{boot}
10511 Tell the initial RAM disk to load @var{boot}, a file containing a Scheme
10512 program, once it has mounted the root file system.
10513
10514 GuixSD uses this option to yield control to a boot program that runs the
10515 service activation programs and then spawns the GNU@tie{}Shepherd, the
10516 initialization system.
10517
10518 @item --root=@var{root}
10519 Mount @var{root} as the root file system. @var{root} can be a
10520 device name like @code{/dev/sda1}, a partition label, or a partition
10521 UUID.
10522
10523 @item --system=@var{system}
10524 Have @file{/run/booted-system} and @file{/run/current-system} point to
10525 @var{system}.
10526
10527 @item modprobe.blacklist=@var{modules}@dots{}
10528 @cindex module, black-listing
10529 @cindex black list, of kernel modules
10530 Instruct the initial RAM disk as well as the @command{modprobe} command
10531 (from the kmod package) to refuse to load @var{modules}. @var{modules}
10532 must be a comma-separated list of module names---e.g.,
10533 @code{usbkbd,9pnet}.
10534
10535 @item --repl
10536 Start a read-eval-print loop (REPL) from the initial RAM disk before it
10537 tries to load kernel modules and to mount the root file system. Our
10538 marketing team calls it @dfn{boot-to-Guile}. The Schemer in you will
10539 love it. @xref{Using Guile Interactively,,, guile, GNU Guile Reference
10540 Manual}, for more information on Guile's REPL.
10541
10542 @end table
10543
10544 Now that you know all the features that initial RAM disks produced by
10545 @code{base-initrd} provide, here is how to use it and customize it
10546 further.
10547
10548 @deffn {Monadic Procedure} base-initrd @var{file-systems} @
10549 [#:qemu-networking? #f] [#:virtio? #t] [#:volatile-root? #f] @
10550 [#:extra-modules '()] [#:mapped-devices '()]
10551 Return a monadic derivation that builds a generic initrd. @var{file-systems} is
10552 a list of file systems to be mounted by the initrd, possibly in addition to
10553 the root file system specified on the kernel command line via @code{--root}.
10554 @var{mapped-devices} is a list of device mappings to realize before
10555 @var{file-systems} are mounted (@pxref{Mapped Devices}).
10556
10557 When @var{qemu-networking?} is true, set up networking with the standard QEMU
10558 parameters. When @var{virtio?} is true, load additional modules so that the
10559 initrd can be used as a QEMU guest with para-virtualized I/O drivers.
10560
10561 When @var{volatile-root?} is true, the root file system is writable but any changes
10562 to it are lost.
10563
10564 The initrd is automatically populated with all the kernel modules necessary
10565 for @var{file-systems} and for the given options. However, additional kernel
10566 modules can be listed in @var{extra-modules}. They will be added to the initrd, and
10567 loaded at boot time in the order in which they appear.
10568 @end deffn
10569
10570 Needless to say, the initrds we produce and use embed a
10571 statically-linked Guile, and the initialization program is a Guile
10572 program. That gives a lot of flexibility. The
10573 @code{expression->initrd} procedure builds such an initrd, given the
10574 program to run in that initrd.
10575
10576 @deffn {Monadic Procedure} expression->initrd @var{exp} @
10577 [#:guile %guile-static-stripped] [#:name "guile-initrd"]
10578 Return a derivation that builds a Linux initrd (a gzipped cpio archive)
10579 containing @var{guile} and that evaluates @var{exp}, a G-expression,
10580 upon booting. All the derivations referenced by @var{exp} are
10581 automatically copied to the initrd.
10582 @end deffn
10583
10584 @node GRUB Configuration
10585 @subsection GRUB Configuration
10586
10587 @cindex GRUB
10588 @cindex boot loader
10589
10590 The operating system uses GNU@tie{}GRUB as its boot loader
10591 (@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is
10592 configured using a @code{grub-configuration} declaration. This data type
10593 is exported by the @code{(gnu system grub)} module and described below.
10594
10595 @deftp {Data Type} grub-configuration
10596 The type of a GRUB configuration declaration.
10597
10598 @table @asis
10599
10600 @item @code{device}
10601 This is a string denoting the boot device. It must be a device name
10602 understood by the @command{grub-install} command, such as
10603 @code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub,
10604 GNU GRUB Manual}).
10605
10606 @item @code{menu-entries} (default: @code{()})
10607 A possibly empty list of @code{menu-entry} objects (see below), denoting
10608 entries to appear in the GRUB boot menu, in addition to the current
10609 system entry and the entry pointing to previous system generations.
10610
10611 @item @code{default-entry} (default: @code{0})
10612 The index of the default boot menu entry. Index 0 is for the entry of the
10613 current system.
10614
10615 @item @code{timeout} (default: @code{5})
10616 The number of seconds to wait for keyboard input before booting. Set to
10617 0 to boot immediately, and to -1 to wait indefinitely.
10618
10619 @item @code{theme} (default: @var{%default-theme})
10620 The @code{grub-theme} object describing the theme to use.
10621 @end table
10622
10623 @end deftp
10624
10625 @cindex dual boot
10626 @cindex boot menu
10627 Should you want to list additional boot menu entries @i{via} the
10628 @code{menu-entries} field above, you will need to create them with the
10629 @code{menu-entry} form. For example, imagine you want to be able to
10630 boot another distro (hard to imagine!), you can define a menu entry
10631 along these lines:
10632
10633 @example
10634 (menu-entry
10635 (label "The Other Distro")
10636 (linux "/boot/old/vmlinux-2.6.32")
10637 (linux-arguments '("root=/dev/sda2"))
10638 (initrd "/boot/old/initrd"))
10639 @end example
10640
10641 Details below.
10642
10643 @deftp {Data Type} menu-entry
10644 The type of an entry in the GRUB boot menu.
10645
10646 @table @asis
10647
10648 @item @code{label}
10649 The label to show in the menu---e.g., @code{"GNU"}.
10650
10651 @item @code{linux}
10652 The Linux kernel image to boot, for example:
10653
10654 @example
10655 (file-append linux-libre "/bzImage")
10656 @end example
10657
10658 @item @code{linux-arguments} (default: @code{()})
10659 The list of extra Linux kernel command-line arguments---e.g.,
10660 @code{("console=ttyS0")}.
10661
10662 @item @code{initrd}
10663 A G-Expression or string denoting the file name of the initial RAM disk
10664 to use (@pxref{G-Expressions}).
10665
10666 @end table
10667 @end deftp
10668
10669 @c FIXME: Write documentation once it's stable.
10670 Themes are created using the @code{grub-theme} form, which is not
10671 documented yet.
10672
10673 @defvr {Scheme Variable} %default-theme
10674 This is the default GRUB theme used by the operating system, with a
10675 fancy background image displaying the GNU and Guix logos.
10676 @end defvr
10677
10678
10679 @node Invoking guix system
10680 @subsection Invoking @code{guix system}
10681
10682 Once you have written an operating system declaration as seen in the
10683 previous section, it can be @dfn{instantiated} using the @command{guix
10684 system} command. The synopsis is:
10685
10686 @example
10687 guix system @var{options}@dots{} @var{action} @var{file}
10688 @end example
10689
10690 @var{file} must be the name of a file containing an
10691 @code{operating-system} declaration. @var{action} specifies how the
10692 operating system is instantiated. Currently the following values are
10693 supported:
10694
10695 @table @code
10696 @item reconfigure
10697 Build the operating system described in @var{file}, activate it, and
10698 switch to it@footnote{This action is usable only on systems already
10699 running GuixSD.}.
10700
10701 This effects all the configuration specified in @var{file}: user
10702 accounts, system services, global package list, setuid programs, etc.
10703 The command starts system services specified in @var{file} that are not
10704 currently running; if a service is currently running, it does not
10705 attempt to upgrade it since this would not be possible without stopping it
10706 first.
10707
10708 It also adds a GRUB menu entry for the new OS configuration, and moves
10709 entries for older configurations to a submenu---unless
10710 @option{--no-grub} is passed.
10711
10712 @quotation Note
10713 @c The paragraph below refers to the problem discussed at
10714 @c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>.
10715 It is highly recommended to run @command{guix pull} once before you run
10716 @command{guix system reconfigure} for the first time (@pxref{Invoking
10717 guix pull}). Failing to do that you would see an older version of Guix
10718 once @command{reconfigure} has completed.
10719 @end quotation
10720
10721 @item build
10722 Build the derivation of the operating system, which includes all the
10723 configuration files and programs needed to boot and run the system.
10724 This action does not actually install anything.
10725
10726 @item init
10727 Populate the given directory with all the files necessary to run the
10728 operating system specified in @var{file}. This is useful for first-time
10729 installations of GuixSD. For instance:
10730
10731 @example
10732 guix system init my-os-config.scm /mnt
10733 @end example
10734
10735 copies to @file{/mnt} all the store items required by the configuration
10736 specified in @file{my-os-config.scm}. This includes configuration
10737 files, packages, and so on. It also creates other essential files
10738 needed for the system to operate correctly---e.g., the @file{/etc},
10739 @file{/var}, and @file{/run} directories, and the @file{/bin/sh} file.
10740
10741 This command also installs GRUB on the device specified in
10742 @file{my-os-config}, unless the @option{--no-grub} option was passed.
10743
10744 @item vm
10745 @cindex virtual machine
10746 @cindex VM
10747 @anchor{guix system vm}
10748 Build a virtual machine that contains the operating system declared in
10749 @var{file}, and return a script to run that virtual machine (VM).
10750 Arguments given to the script are passed to QEMU.
10751
10752 The VM shares its store with the host system.
10753
10754 Additional file systems can be shared between the host and the VM using
10755 the @code{--share} and @code{--expose} command-line options: the former
10756 specifies a directory to be shared with write access, while the latter
10757 provides read-only access to the shared directory.
10758
10759 The example below creates a VM in which the user's home directory is
10760 accessible read-only, and where the @file{/exchange} directory is a
10761 read-write mapping of @file{$HOME/tmp} on the host:
10762
10763 @example
10764 guix system vm my-config.scm \
10765 --expose=$HOME --share=$HOME/tmp=/exchange
10766 @end example
10767
10768 On GNU/Linux, the default is to boot directly to the kernel; this has
10769 the advantage of requiring only a very tiny root disk image since the
10770 store of the host can then be mounted.
10771
10772 The @code{--full-boot} option forces a complete boot sequence, starting
10773 with the bootloader. This requires more disk space since a root image
10774 containing at least the kernel, initrd, and bootloader data files must
10775 be created. The @code{--image-size} option can be used to specify the
10776 size of the image.
10777
10778 @item vm-image
10779 @itemx disk-image
10780 Return a virtual machine or disk image of the operating system declared
10781 in @var{file} that stands alone. Use the @option{--image-size} option
10782 to specify the size of the image.
10783
10784 When using @code{vm-image}, the returned image is in qcow2 format, which
10785 the QEMU emulator can efficiently use. @xref{Running GuixSD in a VM},
10786 for more information on how to run the image in a virtual machine.
10787
10788 When using @code{disk-image}, a raw disk image is produced; it can be
10789 copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is
10790 the device corresponding to a USB stick, one can copy the image to it
10791 using the following command:
10792
10793 @example
10794 # dd if=$(guix system disk-image my-os.scm) of=/dev/sdc
10795 @end example
10796
10797 @item container
10798 Return a script to run the operating system declared in @var{file}
10799 within a container. Containers are a set of lightweight isolation
10800 mechanisms provided by the kernel Linux-libre. Containers are
10801 substantially less resource-demanding than full virtual machines since
10802 the kernel, shared objects, and other resources can be shared with the
10803 host system; this also means they provide thinner isolation.
10804
10805 Currently, the script must be run as root in order to support more than
10806 a single user and group. The container shares its store with the host
10807 system.
10808
10809 As with the @code{vm} action (@pxref{guix system vm}), additional file
10810 systems to be shared between the host and container can be specified
10811 using the @option{--share} and @option{--expose} options:
10812
10813 @example
10814 guix system container my-config.scm \
10815 --expose=$HOME --share=$HOME/tmp=/exchange
10816 @end example
10817
10818 @quotation Note
10819 This option requires Linux-libre 3.19 or newer.
10820 @end quotation
10821
10822 @end table
10823
10824 @var{options} can contain any of the common build options (@pxref{Common
10825 Build Options}). In addition, @var{options} can contain one of the
10826 following:
10827
10828 @table @option
10829 @item --system=@var{system}
10830 @itemx -s @var{system}
10831 Attempt to build for @var{system} instead of the host system type.
10832 This works as per @command{guix build} (@pxref{Invoking guix build}).
10833
10834 @item --derivation
10835 @itemx -d
10836 Return the derivation file name of the given operating system without
10837 building anything.
10838
10839 @item --image-size=@var{size}
10840 For the @code{vm-image} and @code{disk-image} actions, create an image
10841 of the given @var{size}. @var{size} may be a number of bytes, or it may
10842 include a unit as a suffix (@pxref{Block size, size specifications,,
10843 coreutils, GNU Coreutils}).
10844
10845 @item --on-error=@var{strategy}
10846 Apply @var{strategy} when an error occurs when reading @var{file}.
10847 @var{strategy} may be one of the following:
10848
10849 @table @code
10850 @item nothing-special
10851 Report the error concisely and exit. This is the default strategy.
10852
10853 @item backtrace
10854 Likewise, but also display a backtrace.
10855
10856 @item debug
10857 Report the error and enter Guile's debugger. From there, you can run
10858 commands such as @code{,bt} to get a backtrace, @code{,locals} to
10859 display local variable values, and more generally inspect the state of the
10860 program. @xref{Debug Commands,,, guile, GNU Guile Reference Manual}, for
10861 a list of available debugging commands.
10862 @end table
10863 @end table
10864
10865 @quotation Note
10866 All the actions above, except @code{build} and @code{init},
10867 can use KVM support in the Linux-libre kernel. Specifically, if the
10868 machine has hardware virtualization support, the corresponding
10869 KVM kernel module should be loaded, and the @file{/dev/kvm} device node
10870 must exist and be readable and writable by the user and by the
10871 build users of the daemon (@pxref{Build Environment Setup}).
10872 @end quotation
10873
10874 Once you have built, configured, re-configured, and re-re-configured
10875 your GuixSD installation, you may find it useful to list the operating
10876 system generations available on disk---and that you can choose from the
10877 GRUB boot menu:
10878
10879 @table @code
10880
10881 @item list-generations
10882 List a summary of each generation of the operating system available on
10883 disk, in a human-readable way. This is similar to the
10884 @option{--list-generations} option of @command{guix package}
10885 (@pxref{Invoking guix package}).
10886
10887 Optionally, one can specify a pattern, with the same syntax that is used
10888 in @command{guix package --list-generations}, to restrict the list of
10889 generations displayed. For instance, the following command displays
10890 generations that are up to 10 days old:
10891
10892 @example
10893 $ guix system list-generations 10d
10894 @end example
10895
10896 @end table
10897
10898 The @command{guix system} command has even more to offer! The following
10899 sub-commands allow you to visualize how your system services relate to
10900 each other:
10901
10902 @anchor{system-extension-graph}
10903 @table @code
10904
10905 @item extension-graph
10906 Emit in Dot/Graphviz format to standard output the @dfn{service
10907 extension graph} of the operating system defined in @var{file}
10908 (@pxref{Service Composition}, for more information on service
10909 extensions.)
10910
10911 The command:
10912
10913 @example
10914 $ guix system extension-graph @var{file} | dot -Tpdf > services.pdf
10915 @end example
10916
10917 produces a PDF file showing the extension relations among services.
10918
10919 @anchor{system-shepherd-graph}
10920 @item shepherd-graph
10921 Emit in Dot/Graphviz format to standard output the @dfn{dependency
10922 graph} of shepherd services of the operating system defined in
10923 @var{file}. @xref{Shepherd Services}, for more information and for an
10924 example graph.
10925
10926 @end table
10927
10928 @node Running GuixSD in a VM
10929 @subsection Running GuixSD in a Virtual Machine
10930
10931 One way to run GuixSD in a virtual machine (VM) is to build a GuixSD
10932 virtual machine image using @command{guix system vm-image}
10933 (@pxref{Invoking guix system}). The returned image is in qcow2 format,
10934 which the @uref{http://qemu.org/, QEMU emulator} can efficiently use.
10935
10936 To run the image in QEMU, copy it out of the store (@pxref{The Store})
10937 and give yourself permission to write to the copy. When invoking QEMU,
10938 you must choose a system emulator that is suitable for your hardware
10939 platform. Here is a minimal QEMU invocation that will boot the result
10940 of @command{guix system vm-image} on x86_64 hardware:
10941
10942 @example
10943 $ qemu-system-x86_64 \
10944 -net user -net nic,model=virtio \
10945 -enable-kvm -m 256 /tmp/qemu-image
10946 @end example
10947
10948 Here is what each of these options means:
10949
10950 @table @code
10951 @item qemu-system-x86_64
10952 This specifies the hardware platform to emulate. This should match the
10953 host.
10954
10955 @item -net user
10956 Enable the unprivileged user-mode network stack. The guest OS can
10957 access the host but not vice versa. This is the simplest way to get the
10958 guest OS online. If you do not choose a network stack, the boot will
10959 fail.
10960
10961 @item -net nic,model=virtio
10962 You must create a network interface of a given model. If you do not
10963 create a NIC, the boot will fail. Assuming your hardware platform is
10964 x86_64, you can get a list of available NIC models by running
10965 @command{qemu-system-x86_64 -net nic,model=help}.
10966
10967 @item -enable-kvm
10968 If your system has hardware virtualization extensions, enabling the
10969 virtual machine support (KVM) of the Linux kernel will make things run
10970 faster.
10971
10972 @item -m 256
10973 RAM available to the guest OS, in mebibytes. Defaults to 128@tie{}MiB,
10974 which may be insufficient for some operations.
10975
10976 @item /tmp/qemu-image
10977 The file name of the qcow2 image.
10978 @end table
10979
10980 @node Defining Services
10981 @subsection Defining Services
10982
10983 The previous sections show the available services and how one can combine
10984 them in an @code{operating-system} declaration. But how do we define
10985 them in the first place? And what is a service anyway?
10986
10987 @menu
10988 * Service Composition:: The model for composing services.
10989 * Service Types and Services:: Types and services.
10990 * Service Reference:: API reference.
10991 * Shepherd Services:: A particular type of service.
10992 @end menu
10993
10994 @node Service Composition
10995 @subsubsection Service Composition
10996
10997 @cindex services
10998 @cindex daemons
10999 Here we define a @dfn{service} as, broadly, something that extends the
11000 functionality of the operating system. Often a service is a process---a
11001 @dfn{daemon}---started when the system boots: a secure shell server, a
11002 Web server, the Guix build daemon, etc. Sometimes a service is a daemon
11003 whose execution can be triggered by another daemon---e.g., an FTP server
11004 started by @command{inetd} or a D-Bus service activated by
11005 @command{dbus-daemon}. Occasionally, a service does not map to a
11006 daemon. For instance, the ``account'' service collects user accounts
11007 and makes sure they exist when the system runs; the ``udev'' service
11008 collects device management rules and makes them available to the eudev
11009 daemon; the @file{/etc} service populates the @file{/etc} directory
11010 of the system.
11011
11012 @cindex service extensions
11013 GuixSD services are connected by @dfn{extensions}. For instance, the
11014 secure shell service @emph{extends} the Shepherd---the GuixSD
11015 initialization system, running as PID@tie{}1---by giving it the command
11016 lines to start and stop the secure shell daemon (@pxref{Networking
11017 Services, @code{lsh-service}}); the UPower service extends the D-Bus
11018 service by passing it its @file{.service} specification, and extends the
11019 udev service by passing it device management rules (@pxref{Desktop
11020 Services, @code{upower-service}}); the Guix daemon service extends the
11021 Shepherd by passing it the command lines to start and stop the daemon,
11022 and extends the account service by passing it a list of required build
11023 user accounts (@pxref{Base Services}).
11024
11025 All in all, services and their ``extends'' relations form a directed
11026 acyclic graph (DAG). If we represent services as boxes and extensions
11027 as arrows, a typical system might provide something like this:
11028
11029 @image{images/service-graph,,5in,Typical service extension graph.}
11030
11031 @cindex system service
11032 At the bottom, we see the @dfn{system service}, which produces the
11033 directory containing everything to run and boot the system, as returned
11034 by the @command{guix system build} command. @xref{Service Reference},
11035 to learn about the other service types shown here.
11036 @xref{system-extension-graph, the @command{guix system extension-graph}
11037 command}, for information on how to generate this representation for a
11038 particular operating system definition.
11039
11040 @cindex service types
11041 Technically, developers can define @dfn{service types} to express these
11042 relations. There can be any number of services of a given type on the
11043 system---for instance, a system running two instances of the GNU secure
11044 shell server (lsh) has two instances of @var{lsh-service-type}, with
11045 different parameters.
11046
11047 The following section describes the programming interface for service
11048 types and services.
11049
11050 @node Service Types and Services
11051 @subsubsection Service Types and Services
11052
11053 A @dfn{service type} is a node in the DAG described above. Let us start
11054 with a simple example, the service type for the Guix build daemon
11055 (@pxref{Invoking guix-daemon}):
11056
11057 @example
11058 (define guix-service-type
11059 (service-type
11060 (name 'guix)
11061 (extensions
11062 (list (service-extension shepherd-root-service-type guix-shepherd-service)
11063 (service-extension account-service-type guix-accounts)
11064 (service-extension activation-service-type guix-activation)))))
11065 @end example
11066
11067 @noindent
11068 It defines two things:
11069
11070 @enumerate
11071 @item
11072 A name, whose sole purpose is to make inspection and debugging easier.
11073
11074 @item
11075 A list of @dfn{service extensions}, where each extension designates the
11076 target service type and a procedure that, given the parameters of the
11077 service, returns a list of objects to extend the service of that type.
11078
11079 Every service type has at least one service extension. The only
11080 exception is the @dfn{boot service type}, which is the ultimate service.
11081 @end enumerate
11082
11083 In this example, @var{guix-service-type} extends three services:
11084
11085 @table @var
11086 @item shepherd-root-service-type
11087 The @var{guix-shepherd-service} procedure defines how the Shepherd
11088 service is extended. Namely, it returns a @code{<shepherd-service>}
11089 object that defines how @command{guix-daemon} is started and stopped
11090 (@pxref{Shepherd Services}).
11091
11092 @item account-service-type
11093 This extension for this service is computed by @var{guix-accounts},
11094 which returns a list of @code{user-group} and @code{user-account}
11095 objects representing the build user accounts (@pxref{Invoking
11096 guix-daemon}).
11097
11098 @item activation-service-type
11099 Here @var{guix-activation} is a procedure that returns a gexp, which is
11100 a code snippet to run at ``activation time''---e.g., when the service is
11101 booted.
11102 @end table
11103
11104 A service of this type is instantiated like this:
11105
11106 @example
11107 (service guix-service-type
11108 (guix-configuration
11109 (build-accounts 5)
11110 (use-substitutes? #f)))
11111 @end example
11112
11113 The second argument to the @code{service} form is a value representing
11114 the parameters of this specific service instance.
11115 @xref{guix-configuration-type, @code{guix-configuration}}, for
11116 information about the @code{guix-configuration} data type.
11117
11118 @var{guix-service-type} is quite simple because it extends other
11119 services but is not extensible itself.
11120
11121 @c @subsubsubsection Extensible Service Types
11122
11123 The service type for an @emph{extensible} service looks like this:
11124
11125 @example
11126 (define udev-service-type
11127 (service-type (name 'udev)
11128 (extensions
11129 (list (service-extension shepherd-root-service-type
11130 udev-shepherd-service)))
11131
11132 (compose concatenate) ;concatenate the list of rules
11133 (extend (lambda (config rules)
11134 (match config
11135 (($ <udev-configuration> udev initial-rules)
11136 (udev-configuration
11137 (udev udev) ;the udev package to use
11138 (rules (append initial-rules rules)))))))))
11139 @end example
11140
11141 This is the service type for the
11142 @uref{https://wiki.gentoo.org/wiki/Project:Eudev, eudev device
11143 management daemon}. Compared to the previous example, in addition to an
11144 extension of @var{shepherd-root-service-type}, we see two new fields:
11145
11146 @table @code
11147 @item compose
11148 This is the procedure to @dfn{compose} the list of extensions to
11149 services of this type.
11150
11151 Services can extend the udev service by passing it lists of rules; we
11152 compose those extensions simply by concatenating them.
11153
11154 @item extend
11155 This procedure defines how the value of the service is @dfn{extended} with
11156 the composition of the extensions.
11157
11158 Udev extensions are composed into a list of rules, but the udev service
11159 value is itself a @code{<udev-configuration>} record. So here, we
11160 extend that record by appending the list of rules it contains to the
11161 list of contributed rules.
11162 @end table
11163
11164 There can be only one instance of an extensible service type such as
11165 @var{udev-service-type}. If there were more, the
11166 @code{service-extension} specifications would be ambiguous.
11167
11168 Still here? The next section provides a reference of the programming
11169 interface for services.
11170
11171 @node Service Reference
11172 @subsubsection Service Reference
11173
11174 We have seen an overview of service types (@pxref{Service Types and
11175 Services}). This section provides a reference on how to manipulate
11176 services and service types. This interface is provided by the
11177 @code{(gnu services)} module.
11178
11179 @deffn {Scheme Procedure} service @var{type} @var{value}
11180 Return a new service of @var{type}, a @code{<service-type>} object (see
11181 below.) @var{value} can be any object; it represents the parameters of
11182 this particular service instance.
11183 @end deffn
11184
11185 @deffn {Scheme Procedure} service? @var{obj}
11186 Return true if @var{obj} is a service.
11187 @end deffn
11188
11189 @deffn {Scheme Procedure} service-kind @var{service}
11190 Return the type of @var{service}---i.e., a @code{<service-type>} object.
11191 @end deffn
11192
11193 @deffn {Scheme Procedure} service-parameters @var{service}
11194 Return the value associated with @var{service}. It represents its
11195 parameters.
11196 @end deffn
11197
11198 Here is an example of how a service is created and manipulated:
11199
11200 @example
11201 (define s
11202 (service nginx-service-type
11203 (nginx-configuration
11204 (nginx nginx)
11205 (log-directory log-directory)
11206 (run-directory run-directory)
11207 (file config-file))))
11208
11209 (service? s)
11210 @result{} #t
11211
11212 (eq? (service-kind s) nginx-service-type)
11213 @result{} #t
11214 @end example
11215
11216 The @code{modify-services} form provides a handy way to change the
11217 parameters of some of the services of a list such as
11218 @var{%base-services} (@pxref{Base Services, @code{%base-services}}). It
11219 evaluates to a list of services. Of course, you could always use
11220 standard list combinators such as @code{map} and @code{fold} to do that
11221 (@pxref{SRFI-1, List Library,, guile, GNU Guile Reference Manual});
11222 @code{modify-services} simply provides a more concise form for this
11223 common pattern.
11224
11225 @deffn {Scheme Syntax} modify-services @var{services} @
11226 (@var{type} @var{variable} => @var{body}) @dots{}
11227
11228 Modify the services listed in @var{services} according to the given
11229 clauses. Each clause has the form:
11230
11231 @example
11232 (@var{type} @var{variable} => @var{body})
11233 @end example
11234
11235 where @var{type} is a service type---e.g.,
11236 @code{guix-service-type}---and @var{variable} is an identifier that is
11237 bound within the @var{body} to the service parameters---e.g., a
11238 @code{guix-configuration} instance---of the original service of that
11239 @var{type}.
11240
11241 The @var{body} should evaluate to the new service parameters, which will
11242 be used to configure the new service. This new service will replace the
11243 original in the resulting list. Because a service's service parameters
11244 are created using @code{define-record-type*}, you can write a succinct
11245 @var{body} that evaluates to the new service parameters by using the
11246 @code{inherit} feature that @code{define-record-type*} provides.
11247
11248 @xref{Using the Configuration System}, for example usage.
11249
11250 @end deffn
11251
11252 Next comes the programming interface for service types. This is
11253 something you want to know when writing new service definitions, but not
11254 necessarily when simply looking for ways to customize your
11255 @code{operating-system} declaration.
11256
11257 @deftp {Data Type} service-type
11258 @cindex service type
11259 This is the representation of a @dfn{service type} (@pxref{Service Types
11260 and Services}).
11261
11262 @table @asis
11263 @item @code{name}
11264 This is a symbol, used only to simplify inspection and debugging.
11265
11266 @item @code{extensions}
11267 A non-empty list of @code{<service-extension>} objects (see below).
11268
11269 @item @code{compose} (default: @code{#f})
11270 If this is @code{#f}, then the service type denotes services that cannot
11271 be extended---i.e., services that do not receive ``values'' from other
11272 services.
11273
11274 Otherwise, it must be a one-argument procedure. The procedure is called
11275 by @code{fold-services} and is passed a list of values collected from
11276 extensions. It must return a value that is a valid parameter value for
11277 the service instance.
11278
11279 @item @code{extend} (default: @code{#f})
11280 If this is @code{#f}, services of this type cannot be extended.
11281
11282 Otherwise, it must be a two-argument procedure: @code{fold-services}
11283 calls it, passing it the initial value of the service as the first argument
11284 and the result of applying @code{compose} to the extension values as the
11285 second argument.
11286 @end table
11287
11288 @xref{Service Types and Services}, for examples.
11289 @end deftp
11290
11291 @deffn {Scheme Procedure} service-extension @var{target-type} @
11292 @var{compute}
11293 Return a new extension for services of type @var{target-type}.
11294 @var{compute} must be a one-argument procedure: @code{fold-services}
11295 calls it, passing it the value associated with the service that provides
11296 the extension; it must return a valid value for the target service.
11297 @end deffn
11298
11299 @deffn {Scheme Procedure} service-extension? @var{obj}
11300 Return true if @var{obj} is a service extension.
11301 @end deffn
11302
11303 At the core of the service abstraction lies the @code{fold-services}
11304 procedure, which is responsible for ``compiling'' a list of services
11305 down to a single directory that contains everything needed to boot and
11306 run the system---the directory shown by the @command{guix system build}
11307 command (@pxref{Invoking guix system}). In essence, it propagates
11308 service extensions down the service graph, updating each node parameters
11309 on the way, until it reaches the root node.
11310
11311 @deffn {Scheme Procedure} fold-services @var{services} @
11312 [#:target-type @var{system-service-type}]
11313 Fold @var{services} by propagating their extensions down to the root of
11314 type @var{target-type}; return the root service adjusted accordingly.
11315 @end deffn
11316
11317 Lastly, the @code{(gnu services)} module also defines several essential
11318 service types, some of which are listed below.
11319
11320 @defvr {Scheme Variable} system-service-type
11321 This is the root of the service graph. It produces the system directory
11322 as returned by the @command{guix system build} command.
11323 @end defvr
11324
11325 @defvr {Scheme Variable} boot-service-type
11326 The type of the ``boot service'', which produces the @dfn{boot script}.
11327 The boot script is what the initial RAM disk runs when booting.
11328 @end defvr
11329
11330 @defvr {Scheme Variable} etc-service-type
11331 The type of the @file{/etc} service. This service can be extended by
11332 passing it name/file tuples such as:
11333
11334 @example
11335 (list `("issue" ,(plain-file "issue" "Welcome!\n")))
11336 @end example
11337
11338 In this example, the effect would be to add an @file{/etc/issue} file
11339 pointing to the given file.
11340 @end defvr
11341
11342 @defvr {Scheme Variable} setuid-program-service-type
11343 Type for the ``setuid-program service''. This service collects lists of
11344 executable file names, passed as gexps, and adds them to the set of
11345 setuid-root programs on the system (@pxref{Setuid Programs}).
11346 @end defvr
11347
11348 @defvr {Scheme Variable} profile-service-type
11349 Type of the service that populates the @dfn{system profile}---i.e., the
11350 programs under @file{/run/current-system/profile}. Other services can
11351 extend it by passing it lists of packages to add to the system profile.
11352 @end defvr
11353
11354
11355 @node Shepherd Services
11356 @subsubsection Shepherd Services
11357
11358 @cindex PID 1
11359 @cindex init system
11360 The @code{(gnu services shepherd)} module provides a way to define
11361 services managed by the GNU@tie{}Shepherd, which is the GuixSD
11362 initialization system---the first process that is started when the
11363 system boots, also known as PID@tie{}1
11364 (@pxref{Introduction,,, shepherd, The GNU Shepherd Manual}).
11365
11366 Services in the Shepherd can depend on each other. For instance, the
11367 SSH daemon may need to be started after the syslog daemon has been
11368 started, which in turn can only happen once all the file systems have
11369 been mounted. The simple operating system defined earlier (@pxref{Using
11370 the Configuration System}) results in a service graph like this:
11371
11372 @image{images/shepherd-graph,,5in,Typical shepherd service graph.}
11373
11374 You can actually generate such a graph for any operating system
11375 definition using the @command{guix system shepherd-graph} command
11376 (@pxref{system-shepherd-graph, @command{guix system shepherd-graph}}).
11377
11378 The @var{%shepherd-root-service} is a service object representing
11379 PID@tie{}1, of type @var{shepherd-root-service-type}; it can be extended
11380 by passing it lists of @code{<shepherd-service>} objects.
11381
11382 @deftp {Data Type} shepherd-service
11383 The data type representing a service managed by the Shepherd.
11384
11385 @table @asis
11386 @item @code{provision}
11387 This is a list of symbols denoting what the service provides.
11388
11389 These are the names that may be passed to @command{herd start},
11390 @command{herd status}, and similar commands (@pxref{Invoking herd,,,
11391 shepherd, The GNU Shepherd Manual}). @xref{Slots of services, the
11392 @code{provides} slot,, shepherd, The GNU Shepherd Manual}, for details.
11393
11394 @item @code{requirements} (default: @code{'()})
11395 List of symbols denoting the Shepherd services this one depends on.
11396
11397 @item @code{respawn?} (default: @code{#t})
11398 Whether to restart the service when it stops, for instance when the
11399 underlying process dies.
11400
11401 @item @code{start}
11402 @itemx @code{stop} (default: @code{#~(const #f)})
11403 The @code{start} and @code{stop} fields refer to the Shepherd's
11404 facilities to start and stop processes (@pxref{Service De- and
11405 Constructors,,, shepherd, The GNU Shepherd Manual}). They are given as
11406 G-expressions that get expanded in the Shepherd configuration file
11407 (@pxref{G-Expressions}).
11408
11409 @item @code{documentation}
11410 A documentation string, as shown when running:
11411
11412 @example
11413 herd doc @var{service-name}
11414 @end example
11415
11416 where @var{service-name} is one of the symbols in @var{provision}
11417 (@pxref{Invoking herd,,, shepherd, The GNU Shepherd Manual}).
11418
11419 @item @code{modules} (default: @var{%default-modules})
11420 This is the list of modules that must be in scope when @code{start} and
11421 @code{stop} are evaluated.
11422
11423 @end table
11424 @end deftp
11425
11426 @defvr {Scheme Variable} shepherd-root-service-type
11427 The service type for the Shepherd ``root service''---i.e., PID@tie{}1.
11428
11429 This is the service type that extensions target when they want to create
11430 shepherd services (@pxref{Service Types and Services}, for an example).
11431 Each extension must pass a list of @code{<shepherd-service>}.
11432 @end defvr
11433
11434 @defvr {Scheme Variable} %shepherd-root-service
11435 This service represents PID@tie{}1.
11436 @end defvr
11437
11438
11439 @node Installing Debugging Files
11440 @section Installing Debugging Files
11441
11442 @cindex debugging files
11443 Program binaries, as produced by the GCC compilers for instance, are
11444 typically written in the ELF format, with a section containing
11445 @dfn{debugging information}. Debugging information is what allows the
11446 debugger, GDB, to map binary code to source code; it is required to
11447 debug a compiled program in good conditions.
11448
11449 The problem with debugging information is that is takes up a fair amount
11450 of disk space. For example, debugging information for the GNU C Library
11451 weighs in at more than 60 MiB. Thus, as a user, keeping all the
11452 debugging info of all the installed programs is usually not an option.
11453 Yet, space savings should not come at the cost of an impediment to
11454 debugging---especially in the GNU system, which should make it easier
11455 for users to exert their computing freedom (@pxref{GNU Distribution}).
11456
11457 Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a
11458 mechanism that allows users to get the best of both worlds: debugging
11459 information can be stripped from the binaries and stored in separate
11460 files. GDB is then able to load debugging information from those files,
11461 when they are available (@pxref{Separate Debug Files,,, gdb, Debugging
11462 with GDB}).
11463
11464 The GNU distribution takes advantage of this by storing debugging
11465 information in the @code{lib/debug} sub-directory of a separate package
11466 output unimaginatively called @code{debug} (@pxref{Packages with
11467 Multiple Outputs}). Users can choose to install the @code{debug} output
11468 of a package when they need it. For instance, the following command
11469 installs the debugging information for the GNU C Library and for GNU
11470 Guile:
11471
11472 @example
11473 guix package -i glibc:debug guile:debug
11474 @end example
11475
11476 GDB must then be told to look for debug files in the user's profile, by
11477 setting the @code{debug-file-directory} variable (consider setting it
11478 from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with
11479 GDB}):
11480
11481 @example
11482 (gdb) set debug-file-directory ~/.guix-profile/lib/debug
11483 @end example
11484
11485 From there on, GDB will pick up debugging information from the
11486 @code{.debug} files under @file{~/.guix-profile/lib/debug}.
11487
11488 In addition, you will most likely want GDB to be able to show the source
11489 code being debugged. To do that, you will have to unpack the source
11490 code of the package of interest (obtained with @code{guix build
11491 --source}, @pxref{Invoking guix build}), and to point GDB to that source
11492 directory using the @code{directory} command (@pxref{Source Path,
11493 @code{directory},, gdb, Debugging with GDB}).
11494
11495 @c XXX: keep me up-to-date
11496 The @code{debug} output mechanism in Guix is implemented by the
11497 @code{gnu-build-system} (@pxref{Build Systems}). Currently, it is
11498 opt-in---debugging information is available only for the packages
11499 with definitions explicitly declaring a @code{debug} output. This may be
11500 changed to opt-out in the future if our build farm servers can handle
11501 the load. To check whether a package has a @code{debug} output, use
11502 @command{guix package --list-available} (@pxref{Invoking guix package}).
11503
11504
11505 @node Security Updates
11506 @section Security Updates
11507
11508 @cindex security updates
11509 @cindex security vulnerabilities
11510 Occasionally, important security vulnerabilities are discovered in software
11511 packages and must be patched. Guix developers try hard to keep track of
11512 known vulnerabilities and to apply fixes as soon as possible in the
11513 @code{master} branch of Guix (we do not yet provide a ``stable'' branch
11514 containing only security updates.) The @command{guix lint} tool helps
11515 developers find out about vulnerable versions of software packages in the
11516 distribution:
11517
11518 @smallexample
11519 $ guix lint -c cve
11520 gnu/packages/base.scm:652:2: glibc-2.21: probably vulnerable to CVE-2015-1781, CVE-2015-7547
11521 gnu/packages/gcc.scm:334:2: gcc-4.9.3: probably vulnerable to CVE-2015-5276
11522 gnu/packages/image.scm:312:2: openjpeg-2.1.0: probably vulnerable to CVE-2016-1923, CVE-2016-1924
11523 @dots{}
11524 @end smallexample
11525
11526 @xref{Invoking guix lint}, for more information.
11527
11528 @quotation Note
11529 As of version @value{VERSION}, the feature described below is considered
11530 ``beta''.
11531 @end quotation
11532
11533 Guix follows a functional
11534 package management discipline (@pxref{Introduction}), which implies
11535 that, when a package is changed, @emph{every package that depends on it}
11536 must be rebuilt. This can significantly slow down the deployment of
11537 fixes in core packages such as libc or Bash, since basically the whole
11538 distribution would need to be rebuilt. Using pre-built binaries helps
11539 (@pxref{Substitutes}), but deployment may still take more time than
11540 desired.
11541
11542 @cindex grafts
11543 To address this, Guix implements @dfn{grafts}, a mechanism that allows
11544 for fast deployment of critical updates without the costs associated
11545 with a whole-distribution rebuild. The idea is to rebuild only the
11546 package that needs to be patched, and then to ``graft'' it onto packages
11547 explicitly installed by the user and that were previously referring to
11548 the original package. The cost of grafting is typically very low, and
11549 order of magnitudes lower than a full rebuild of the dependency chain.
11550
11551 @cindex replacements of packages, for grafts
11552 For instance, suppose a security update needs to be applied to Bash.
11553 Guix developers will provide a package definition for the ``fixed''
11554 Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining
11555 Packages}). Then, the original package definition is augmented with a
11556 @code{replacement} field pointing to the package containing the bug fix:
11557
11558 @example
11559 (define bash
11560 (package
11561 (name "bash")
11562 ;; @dots{}
11563 (replacement bash-fixed)))
11564 @end example
11565
11566 From there on, any package depending directly or indirectly on Bash---as
11567 reported by @command{guix gc --requisites} (@pxref{Invoking guix
11568 gc})---that is installed is automatically ``rewritten'' to refer to
11569 @var{bash-fixed} instead of @var{bash}. This grafting process takes
11570 time proportional to the size of the package, usually less than a
11571 minute for an ``average'' package on a recent machine. Grafting is
11572 recursive: when an indirect dependency requires grafting, then grafting
11573 ``propagates'' up to the package that the user is installing.
11574
11575 Currently, the graft and the package it replaces (@var{bash-fixed} and
11576 @var{bash} in the example above) must have the exact same @code{name}
11577 and @code{version} fields. This restriction mostly comes from the fact
11578 that grafting works by patching files, including binary files, directly.
11579 Other restrictions may apply: for instance, when adding a graft to a
11580 package providing a shared library, the original shared library and its
11581 replacement must have the same @code{SONAME} and be binary-compatible.
11582
11583 The @option{--no-grafts} command-line option allows you to forcefully
11584 avoid grafting (@pxref{Common Build Options, @option{--no-grafts}}).
11585 Thus, the command:
11586
11587 @example
11588 guix build bash --no-grafts
11589 @end example
11590
11591 @noindent
11592 returns the store file name of the original Bash, whereas:
11593
11594 @example
11595 guix build bash
11596 @end example
11597
11598 @noindent
11599 returns the store file name of the ``fixed'', replacement Bash. This
11600 allows you to distinguish between the two variants of Bash.
11601
11602 To verify which Bash your whole profile refers to, you can run
11603 (@pxref{Invoking guix gc}):
11604
11605 @example
11606 guix gc -R `readlink -f ~/.guix-profile` | grep bash
11607 @end example
11608
11609 @noindent
11610 @dots{} and compare the store file names that you get with those above.
11611 Likewise for a complete GuixSD system generation:
11612
11613 @example
11614 guix gc -R `guix system build my-config.scm` | grep bash
11615 @end example
11616
11617 Lastly, to check which Bash running processes are using, you can use the
11618 @command{lsof} command:
11619
11620 @example
11621 lsof | grep /gnu/store/.*bash
11622 @end example
11623
11624
11625 @node Package Modules
11626 @section Package Modules
11627
11628 From a programming viewpoint, the package definitions of the
11629 GNU distribution are provided by Guile modules in the @code{(gnu packages
11630 @dots{})} name space@footnote{Note that packages under the @code{(gnu
11631 packages @dots{})} module name space are not necessarily ``GNU
11632 packages''. This module naming scheme follows the usual Guile module
11633 naming convention: @code{gnu} means that these modules are distributed
11634 as part of the GNU system, and @code{packages} identifies modules that
11635 define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile
11636 Reference Manual}). For instance, the @code{(gnu packages emacs)}
11637 module exports a variable named @code{emacs}, which is bound to a
11638 @code{<package>} object (@pxref{Defining Packages}).
11639
11640 The @code{(gnu packages @dots{})} module name space is
11641 automatically scanned for packages by the command-line tools. For
11642 instance, when running @code{guix package -i emacs}, all the @code{(gnu
11643 packages @dots{})} modules are scanned until one that exports a package
11644 object whose name is @code{emacs} is found. This package search
11645 facility is implemented in the @code{(gnu packages)} module.
11646
11647 @cindex customization, of packages
11648 @cindex package module search path
11649 Users can store package definitions in modules with different
11650 names---e.g., @code{(my-packages emacs)}@footnote{Note that the file
11651 name and module name must match. For instance, the @code{(my-packages
11652 emacs)} module must be stored in a @file{my-packages/emacs.scm} file
11653 relative to the load path specified with @option{--load-path} or
11654 @code{GUIX_PACKAGE_PATH}. @xref{Modules and the File System,,,
11655 guile, GNU Guile Reference Manual}, for details.}. These package definitions
11656 will not be visible by default. Users can invoke commands such as
11657 @command{guix package} and @command{guix build} with the
11658 @code{-e} option so that they know where to find the package. Better
11659 yet, they can use the
11660 @code{-L} option of these commands to make those modules visible
11661 (@pxref{Invoking guix build, @code{--load-path}}), or define the
11662 @code{GUIX_PACKAGE_PATH} environment variable. This environment
11663 variable makes it easy to extend or customize the distribution and is
11664 honored by all the user interfaces.
11665
11666 @defvr {Environment Variable} GUIX_PACKAGE_PATH
11667 This is a colon-separated list of directories to search for additional
11668 package modules. Directories listed in this variable take precedence
11669 over the own modules of the distribution.
11670 @end defvr
11671
11672 The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}:
11673 each package is built based solely on other packages in the
11674 distribution. The root of this dependency graph is a small set of
11675 @dfn{bootstrap binaries}, provided by the @code{(gnu packages
11676 bootstrap)} module. For more information on bootstrapping,
11677 @pxref{Bootstrapping}.
11678
11679 @node Packaging Guidelines
11680 @section Packaging Guidelines
11681
11682 The GNU distribution is nascent and may well lack some of your favorite
11683 packages. This section describes how you can help make the distribution
11684 grow. @xref{Contributing}, for additional information on how you can
11685 help.
11686
11687 Free software packages are usually distributed in the form of
11688 @dfn{source code tarballs}---typically @file{tar.gz} files that contain
11689 all the source files. Adding a package to the distribution means
11690 essentially two things: adding a @dfn{recipe} that describes how to
11691 build the package, including a list of other packages required to build
11692 it, and adding @dfn{package metadata} along with that recipe, such as a
11693 description and licensing information.
11694
11695 In Guix all this information is embodied in @dfn{package definitions}.
11696 Package definitions provide a high-level view of the package. They are
11697 written using the syntax of the Scheme programming language; in fact,
11698 for each package we define a variable bound to the package definition,
11699 and export that variable from a module (@pxref{Package Modules}).
11700 However, in-depth Scheme knowledge is @emph{not} a prerequisite for
11701 creating packages. For more information on package definitions,
11702 @pxref{Defining Packages}.
11703
11704 Once a package definition is in place, stored in a file in the Guix
11705 source tree, it can be tested using the @command{guix build} command
11706 (@pxref{Invoking guix build}). For example, assuming the new package is
11707 called @code{gnew}, you may run this command from the Guix build tree
11708 (@pxref{Running Guix Before It Is Installed}):
11709
11710 @example
11711 ./pre-inst-env guix build gnew --keep-failed
11712 @end example
11713
11714 Using @code{--keep-failed} makes it easier to debug build failures since
11715 it provides access to the failed build tree. Another useful
11716 command-line option when debugging is @code{--log-file}, to access the
11717 build log.
11718
11719 If the package is unknown to the @command{guix} command, it may be that
11720 the source file contains a syntax error, or lacks a @code{define-public}
11721 clause to export the package variable. To figure it out, you may load
11722 the module from Guile to get more information about the actual error:
11723
11724 @example
11725 ./pre-inst-env guile -c '(use-modules (gnu packages gnew))'
11726 @end example
11727
11728 Once your package builds correctly, please send us a patch
11729 (@pxref{Contributing}). Well, if you need help, we will be happy to
11730 help you too. Once the patch is committed in the Guix repository, the
11731 new package automatically gets built on the supported platforms by
11732 @url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration
11733 system}.
11734
11735 @cindex substituter
11736 Users can obtain the new package definition simply by running
11737 @command{guix pull} (@pxref{Invoking guix pull}). When
11738 @code{hydra.gnu.org} is done building the package, installing the
11739 package automatically downloads binaries from there
11740 (@pxref{Substitutes}). The only place where human intervention is
11741 needed is to review and apply the patch.
11742
11743
11744 @menu
11745 * Software Freedom:: What may go into the distribution.
11746 * Package Naming:: What's in a name?
11747 * Version Numbers:: When the name is not enough.
11748 * Synopses and Descriptions:: Helping users find the right package.
11749 * Python Modules:: Taming the snake.
11750 * Perl Modules:: Little pearls.
11751 * Java Packages:: Coffee break.
11752 * Fonts:: Fond of fonts.
11753 @end menu
11754
11755 @node Software Freedom
11756 @subsection Software Freedom
11757
11758 @c Adapted from http://www.gnu.org/philosophy/philosophy.html.
11759
11760 The GNU operating system has been developed so that users can have
11761 freedom in their computing. GNU is @dfn{free software}, meaning that
11762 users have the @url{http://www.gnu.org/philosophy/free-sw.html,four
11763 essential freedoms}: to run the program, to study and change the program
11764 in source code form, to redistribute exact copies, and to distribute
11765 modified versions. Packages found in the GNU distribution provide only
11766 software that conveys these four freedoms.
11767
11768 In addition, the GNU distribution follow the
11769 @url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free
11770 software distribution guidelines}. Among other things, these guidelines
11771 reject non-free firmware, recommendations of non-free software, and
11772 discuss ways to deal with trademarks and patents.
11773
11774 Some otherwise free upstream package sources contain a small and optional
11775 subset that violates the above guidelines, for instance because this subset
11776 is itself non-free code. When that happens, the offending items are removed
11777 with appropriate patches or code snippets in the @code{origin} form of the
11778 package (@pxref{Defining Packages}). This way, @code{guix
11779 build --source} returns the ``freed'' source rather than the unmodified
11780 upstream source.
11781
11782
11783 @node Package Naming
11784 @subsection Package Naming
11785
11786 A package has actually two names associated with it:
11787 First, there is the name of the @emph{Scheme variable}, the one following
11788 @code{define-public}. By this name, the package can be made known in the
11789 Scheme code, for instance as input to another package. Second, there is
11790 the string in the @code{name} field of a package definition. This name
11791 is used by package management commands such as
11792 @command{guix package} and @command{guix build}.
11793
11794 Both are usually the same and correspond to the lowercase conversion of
11795 the project name chosen upstream, with underscores replaced with
11796 hyphens. For instance, GNUnet is available as @code{gnunet}, and
11797 SDL_net as @code{sdl-net}.
11798
11799 We do not add @code{lib} prefixes for library packages, unless these are
11800 already part of the official project name. But @pxref{Python
11801 Modules} and @ref{Perl Modules} for special rules concerning modules for
11802 the Python and Perl languages.
11803
11804 Font package names are handled differently, @pxref{Fonts}.
11805
11806
11807 @node Version Numbers
11808 @subsection Version Numbers
11809
11810 We usually package only the latest version of a given free software
11811 project. But sometimes, for instance for incompatible library versions,
11812 two (or more) versions of the same package are needed. These require
11813 different Scheme variable names. We use the name as defined
11814 in @ref{Package Naming}
11815 for the most recent version; previous versions use the same name, suffixed
11816 by @code{-} and the smallest prefix of the version number that may
11817 distinguish the two versions.
11818
11819 The name inside the package definition is the same for all versions of a
11820 package and does not contain any version number.
11821
11822 For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows:
11823
11824 @example
11825 (define-public gtk+
11826 (package
11827 (name "gtk+")
11828 (version "3.9.12")
11829 ...))
11830 (define-public gtk+-2
11831 (package
11832 (name "gtk+")
11833 (version "2.24.20")
11834 ...))
11835 @end example
11836 If we also wanted GTK+ 3.8.2, this would be packaged as
11837 @example
11838 (define-public gtk+-3.8
11839 (package
11840 (name "gtk+")
11841 (version "3.8.2")
11842 ...))
11843 @end example
11844
11845 @c See <https://lists.gnu.org/archive/html/guix-devel/2016-01/msg00425.html>,
11846 @c for a discussion of what follows.
11847 @cindex version number, for VCS snapshots
11848 Occasionally, we package snapshots of upstream's version control system
11849 (VCS) instead of formal releases. This should remain exceptional,
11850 because it is up to upstream developers to clarify what the stable
11851 release is. Yet, it is sometimes necessary. So, what should we put in
11852 the @code{version} field?
11853
11854 Clearly, we need to make the commit identifier of the VCS snapshot
11855 visible in the version string, but we also need to make sure that the
11856 version string is monotonically increasing so that @command{guix package
11857 --upgrade} can determine which version is newer. Since commit
11858 identifiers, notably with Git, are not monotonically increasing, we add
11859 a revision number that we increase each time we upgrade to a newer
11860 snapshot. The resulting version string looks like this:
11861
11862 @example
11863 2.0.11-3.cabba9e
11864 ^ ^ ^
11865 | | `-- upstream commit ID
11866 | |
11867 | `--- Guix package revision
11868 |
11869 latest upstream version
11870 @end example
11871
11872 It is a good idea to strip commit identifiers in the @code{version}
11873 field to, say, 7 digits. It avoids an aesthetic annoyance (assuming
11874 aesthetics have a role to play here) as well as problems related to OS
11875 limits such as the maximum shebang length (127 bytes for the Linux
11876 kernel.) It is best to use the full commit identifiers in
11877 @code{origin}s, though, to avoid ambiguities. A typical package
11878 definition may look like this:
11879
11880 @example
11881 (define my-package
11882 (let ((commit "c3f29bc928d5900971f65965feaae59e1272a3f7")
11883 (revision "1")) ;Guix package revision
11884 (package
11885 (version (string-append "0.9-" revision "."
11886 (string-take commit 7)))
11887 (source (origin
11888 (method git-fetch)
11889 (uri (git-reference
11890 (url "git://example.org/my-package.git")
11891 (commit commit)))
11892 (sha256 (base32 "1mbikn@dots{}"))
11893 (file-name (string-append "my-package-" version
11894 "-checkout"))))
11895 ;; @dots{}
11896 )))
11897 @end example
11898
11899 @node Synopses and Descriptions
11900 @subsection Synopses and Descriptions
11901
11902 As we have seen before, each package in GNU@tie{}Guix includes a
11903 synopsis and a description (@pxref{Defining Packages}). Synopses and
11904 descriptions are important: They are what @command{guix package
11905 --search} searches, and a crucial piece of information to help users
11906 determine whether a given package suits their needs. Consequently,
11907 packagers should pay attention to what goes into them.
11908
11909 Synopses must start with a capital letter and must not end with a
11910 period. They must not start with ``a'' or ``the'', which usually does
11911 not bring anything; for instance, prefer ``File-frobbing tool'' over ``A
11912 tool that frobs files''. The synopsis should say what the package
11913 is---e.g., ``Core GNU utilities (file, text, shell)''---or what it is
11914 used for---e.g., the synopsis for GNU@tie{}grep is ``Print lines
11915 matching a pattern''.
11916
11917 Keep in mind that the synopsis must be meaningful for a very wide
11918 audience. For example, ``Manipulate alignments in the SAM format''
11919 might make sense for a seasoned bioinformatics researcher, but might be
11920 fairly unhelpful or even misleading to a non-specialized audience. It
11921 is a good idea to come up with a synopsis that gives an idea of the
11922 application domain of the package. In this example, this might give
11923 something like ``Manipulate nucleotide sequence alignments'', which
11924 hopefully gives the user a better idea of whether this is what they are
11925 looking for.
11926
11927 Descriptions should take between five and ten lines. Use full
11928 sentences, and avoid using acronyms without first introducing them.
11929 Please avoid marketing phrases such as ``world-leading'',
11930 ``industrial-strength'', and ``next-generation'', and avoid superlatives
11931 like ``the most advanced''---they are not helpful to users looking for a
11932 package and may even sound suspicious. Instead, try to be factual,
11933 mentioning use cases and features.
11934
11935 @cindex Texinfo markup, in package descriptions
11936 Descriptions can include Texinfo markup, which is useful to introduce
11937 ornaments such as @code{@@code} or @code{@@dfn}, bullet lists, or
11938 hyperlinks (@pxref{Overview,,, texinfo, GNU Texinfo}). However you
11939 should be careful when using some characters for example @samp{@@} and
11940 curly braces which are the basic special characters in Texinfo
11941 (@pxref{Special Characters,,, texinfo, GNU Texinfo}). User interfaces
11942 such as @command{guix package --show} take care of rendering it
11943 appropriately.
11944
11945 Synopses and descriptions are translated by volunteers
11946 @uref{http://translationproject.org/domain/guix-packages.html, at the
11947 Translation Project} so that as many users as possible can read them in
11948 their native language. User interfaces search them and display them in
11949 the language specified by the current locale.
11950
11951 Translation is a lot of work so, as a packager, please pay even more
11952 attention to your synopses and descriptions as every change may entail
11953 additional work for translators. In order to help them, it is possible
11954 to make recommendations or instructions visible to them by inserting
11955 special comments like this (@pxref{xgettext Invocation,,, gettext, GNU
11956 Gettext}):
11957
11958 @example
11959 ;; TRANSLATORS: "X11 resize-and-rotate" should not be translated.
11960 (description "ARandR is designed to provide a simple visual front end
11961 for the X11 resize-and-rotate (RandR) extension. @dots{}")
11962 @end example
11963
11964
11965 @node Python Modules
11966 @subsection Python Modules
11967
11968 We currently package Python 2 and Python 3, under the Scheme variable names
11969 @code{python-2} and @code{python} as explained in @ref{Version Numbers}.
11970 To avoid confusion and naming clashes with other programming languages, it
11971 seems desirable that the name of a package for a Python module contains
11972 the word @code{python}.
11973
11974 Some modules are compatible with only one version of Python, others with both.
11975 If the package Foo compiles only with Python 3, we name it
11976 @code{python-foo}; if it compiles only with Python 2, we name it
11977 @code{python2-foo}. If it is compatible with both versions, we create two
11978 packages with the corresponding names.
11979
11980 If a project already contains the word @code{python}, we drop this;
11981 for instance, the module python-dateutil is packaged under the names
11982 @code{python-dateutil} and @code{python2-dateutil}. If the project name
11983 starts with @code{py} (e.g. @code{pytz}), we keep it and prefix it as
11984 described above.
11985
11986
11987 @node Perl Modules
11988 @subsection Perl Modules
11989
11990 Perl programs standing for themselves are named as any other package,
11991 using the lowercase upstream name.
11992 For Perl packages containing a single class, we use the lowercase class name,
11993 replace all occurrences of @code{::} by dashes and prepend the prefix
11994 @code{perl-}.
11995 So the class @code{XML::Parser} becomes @code{perl-xml-parser}.
11996 Modules containing several classes keep their lowercase upstream name and
11997 are also prepended by @code{perl-}. Such modules tend to have the word
11998 @code{perl} somewhere in their name, which gets dropped in favor of the
11999 prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}.
12000
12001
12002 @node Java Packages
12003 @subsection Java Packages
12004
12005 Java programs standing for themselves are named as any other package,
12006 using the lowercase upstream name.
12007
12008 To avoid confusion and naming clashes with other programming languages,
12009 it is desirable that the name of a package for a Java package is
12010 prefixed with @code{java-}. If a project already contains the word
12011 @code{java}, we drop this; for instance, the package @code{ngsjava} is
12012 packaged under the name @code{java-ngs}.
12013
12014 For Java packages containing a single class or a small class hierarchy,
12015 we use the lowercase class name, replace all occurrences of @code{.} by
12016 dashes and prepend the prefix @code{java-}. So the class
12017 @code{apache.commons.cli} becomes package
12018 @code{java-apache-commons-cli}.
12019
12020
12021 @node Fonts
12022 @subsection Fonts
12023
12024 For fonts that are in general not installed by a user for typesetting
12025 purposes, or that are distributed as part of a larger software package,
12026 we rely on the general packaging rules for software; for instance, this
12027 applies to the fonts delivered as part of the X.Org system or fonts that
12028 are part of TeX Live.
12029
12030 To make it easier for a user to search for fonts, names for other packages
12031 containing only fonts are constructed as follows, independently of the
12032 upstream package name.
12033
12034 The name of a package containing only one font family starts with
12035 @code{font-}; it is followed by the foundry name and a dash @code{-}
12036 if the foundry is known, and the font family name, in which spaces are
12037 replaced by dashes (and as usual, all upper case letters are transformed
12038 to lower case).
12039 For example, the Gentium font family by SIL is packaged under the name
12040 @code{font-sil-gentium}.
12041
12042 For a package containing several font families, the name of the collection
12043 is used in the place of the font family name.
12044 For instance, the Liberation fonts consist of three families,
12045 Liberation Sans, Liberation Serif and Liberation Mono.
12046 These could be packaged separately under the names
12047 @code{font-liberation-sans} and so on; but as they are distributed together
12048 under a common name, we prefer to package them together as
12049 @code{font-liberation}.
12050
12051 In the case where several formats of the same font family or font collection
12052 are packaged separately, a short form of the format, prepended by a dash,
12053 is added to the package name. We use @code{-ttf} for TrueType fonts,
12054 @code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1
12055 fonts.
12056
12057
12058
12059 @node Bootstrapping
12060 @section Bootstrapping
12061
12062 @c Adapted from the ELS 2013 paper.
12063
12064 @cindex bootstrapping
12065
12066 Bootstrapping in our context refers to how the distribution gets built
12067 ``from nothing''. Remember that the build environment of a derivation
12068 contains nothing but its declared inputs (@pxref{Introduction}). So
12069 there's an obvious chicken-and-egg problem: how does the first package
12070 get built? How does the first compiler get compiled? Note that this is
12071 a question of interest only to the curious hacker, not to the regular
12072 user, so you can shamelessly skip this section if you consider yourself
12073 a ``regular user''.
12074
12075 @cindex bootstrap binaries
12076 The GNU system is primarily made of C code, with libc at its core. The
12077 GNU build system itself assumes the availability of a Bourne shell and
12078 command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and
12079 `grep'. Furthermore, build programs---programs that run
12080 @code{./configure}, @code{make}, etc.---are written in Guile Scheme
12081 (@pxref{Derivations}). Consequently, to be able to build anything at
12082 all, from scratch, Guix relies on pre-built binaries of Guile, GCC,
12083 Binutils, libc, and the other packages mentioned above---the
12084 @dfn{bootstrap binaries}.
12085
12086 These bootstrap binaries are ``taken for granted'', though we can also
12087 re-create them if needed (more on that later).
12088
12089 @unnumberedsubsec Preparing to Use the Bootstrap Binaries
12090
12091 @c As of Emacs 24.3, Info-mode displays the image, but since it's a
12092 @c large image, it's hard to scroll. Oh well.
12093 @image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations}
12094
12095 The figure above shows the very beginning of the dependency graph of the
12096 distribution, corresponding to the package definitions of the @code{(gnu
12097 packages bootstrap)} module. A similar figure can be generated with
12098 @command{guix graph} (@pxref{Invoking guix graph}), along the lines of:
12099
12100 @example
12101 guix graph -t derivation \
12102 -e '(@@@@ (gnu packages bootstrap) %bootstrap-gcc)' \
12103 | dot -Tps > t.ps
12104 @end example
12105
12106 At this level of detail, things are
12107 slightly complex. First, Guile itself consists of an ELF executable,
12108 along with many source and compiled Scheme files that are dynamically
12109 loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz}
12110 tarball shown in this graph. This tarball is part of Guix's ``source''
12111 distribution, and gets inserted into the store with @code{add-to-store}
12112 (@pxref{The Store}).
12113
12114 But how do we write a derivation that unpacks this tarball and adds it
12115 to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv}
12116 derivation---the first one that gets built---uses @code{bash} as its
12117 builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls
12118 @code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar},
12119 @file{xz}, and @file{mkdir} are statically-linked binaries, also part of
12120 the Guix source distribution, whose sole purpose is to allow the Guile
12121 tarball to be unpacked.
12122
12123 Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning
12124 Guile that can be used to run subsequent build programs. Its first task
12125 is to download tarballs containing the other pre-built binaries---this
12126 is what the @code{.tar.xz.drv} derivations do. Guix modules such as
12127 @code{ftp-client.scm} are used for this purpose. The
12128 @code{module-import.drv} derivations import those modules in a directory
12129 in the store, using the original layout. The
12130 @code{module-import-compiled.drv} derivations compile those modules, and
12131 write them in an output directory with the right layout. This
12132 corresponds to the @code{#:modules} argument of
12133 @code{build-expression->derivation} (@pxref{Derivations}).
12134
12135 Finally, the various tarballs are unpacked by the
12136 derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv},
12137 etc., at which point we have a working C tool chain.
12138
12139
12140 @unnumberedsubsec Building the Build Tools
12141
12142 Bootstrapping is complete when we have a full tool chain that does not
12143 depend on the pre-built bootstrap tools discussed above. This
12144 no-dependency requirement is verified by checking whether the files of
12145 the final tool chain contain references to the @file{/gnu/store}
12146 directories of the bootstrap inputs. The process that leads to this
12147 ``final'' tool chain is described by the package definitions found in
12148 the @code{(gnu packages commencement)} module.
12149
12150 The @command{guix graph} command allows us to ``zoom out'' compared to
12151 the graph above, by looking at the level of package objects instead of
12152 individual derivations---remember that a package may translate to
12153 several derivations, typically one derivation to download its source,
12154 one to build the Guile modules it needs, and one to actually build the
12155 package from source. The command:
12156
12157 @example
12158 guix graph -t bag \
12159 -e '(@@@@ (gnu packages commencement)
12160 glibc-final-with-bootstrap-bash)' | dot -Tps > t.ps
12161 @end example
12162
12163 @noindent
12164 produces the dependency graph leading to the ``final'' C
12165 library@footnote{You may notice the @code{glibc-intermediate} label,
12166 suggesting that it is not @emph{quite} final, but as a good
12167 approximation, we will consider it final.}, depicted below.
12168
12169 @image{images/bootstrap-packages,6in,,Dependency graph of the early packages}
12170
12171 @c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>.
12172 The first tool that gets built with the bootstrap binaries is
12173 GNU@tie{}Make---noted @code{make-boot0} above---which is a prerequisite
12174 for all the following packages. From there Findutils and Diffutils get
12175 built.
12176
12177 Then come the first-stage Binutils and GCC, built as pseudo cross
12178 tools---i.e., with @code{--target} equal to @code{--host}. They are
12179 used to build libc. Thanks to this cross-build trick, this libc is
12180 guaranteed not to hold any reference to the initial tool chain.
12181
12182 From there the final Binutils and GCC (not shown above) are built.
12183 GCC uses @code{ld}
12184 from the final Binutils, and links programs against the just-built libc.
12185 This tool chain is used to build the other packages used by Guix and by
12186 the GNU Build System: Guile, Bash, Coreutils, etc.
12187
12188 And voilà! At this point we have the complete set of build tools that
12189 the GNU Build System expects. These are in the @code{%final-inputs}
12190 variable of the @code{(gnu packages commencement)} module, and are
12191 implicitly used by any package that uses @code{gnu-build-system}
12192 (@pxref{Build Systems, @code{gnu-build-system}}).
12193
12194
12195 @unnumberedsubsec Building the Bootstrap Binaries
12196
12197 Because the final tool chain does not depend on the bootstrap binaries,
12198 those rarely need to be updated. Nevertheless, it is useful to have an
12199 automated way to produce them, should an update occur, and this is what
12200 the @code{(gnu packages make-bootstrap)} module provides.
12201
12202 The following command builds the tarballs containing the bootstrap
12203 binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture
12204 of Coreutils and other basic command-line tools):
12205
12206 @example
12207 guix build bootstrap-tarballs
12208 @end example
12209
12210 The generated tarballs are those that should be referred to in the
12211 @code{(gnu packages bootstrap)} module mentioned at the beginning of
12212 this section.
12213
12214 Still here? Then perhaps by now you've started to wonder: when do we
12215 reach a fixed point? That is an interesting question! The answer is
12216 unknown, but if you would like to investigate further (and have
12217 significant computational and storage resources to do so), then let us
12218 know.
12219
12220 @node Porting
12221 @section Porting to a New Platform
12222
12223 As discussed above, the GNU distribution is self-contained, and
12224 self-containment is achieved by relying on pre-built ``bootstrap
12225 binaries'' (@pxref{Bootstrapping}). These binaries are specific to an
12226 operating system kernel, CPU architecture, and application binary
12227 interface (ABI). Thus, to port the distribution to a platform that is
12228 not yet supported, one must build those bootstrap binaries, and update
12229 the @code{(gnu packages bootstrap)} module to use them on that platform.
12230
12231 Fortunately, Guix can @emph{cross compile} those bootstrap binaries.
12232 When everything goes well, and assuming the GNU tool chain supports the
12233 target platform, this can be as simple as running a command like this
12234 one:
12235
12236 @example
12237 guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs
12238 @end example
12239
12240 For this to work, the @code{glibc-dynamic-linker} procedure in
12241 @code{(gnu packages bootstrap)} must be augmented to return the right
12242 file name for libc's dynamic linker on that platform; likewise,
12243 @code{system->linux-architecture} in @code{(gnu packages linux)} must be
12244 taught about the new platform.
12245
12246 Once these are built, the @code{(gnu packages bootstrap)} module needs
12247 to be updated to refer to these binaries on the target platform. That
12248 is, the hashes and URLs of the bootstrap tarballs for the new platform
12249 must be added alongside those of the currently supported platforms. The
12250 bootstrap Guile tarball is treated specially: it is expected to be
12251 available locally, and @file{gnu/local.mk} has rules do download it for
12252 the supported architectures; a rule for the new platform must be added
12253 as well.
12254
12255 In practice, there may be some complications. First, it may be that the
12256 extended GNU triplet that specifies an ABI (like the @code{eabi} suffix
12257 above) is not recognized by all the GNU tools. Typically, glibc
12258 recognizes some of these, whereas GCC uses an extra @code{--with-abi}
12259 configure flag (see @code{gcc.scm} for examples of how to handle this).
12260 Second, some of the required packages could fail to build for that
12261 platform. Lastly, the generated binaries could be broken for some
12262 reason.
12263
12264 @c *********************************************************************
12265 @include contributing.texi
12266
12267 @c *********************************************************************
12268 @node Acknowledgments
12269 @chapter Acknowledgments
12270
12271 Guix is based on the @uref{http://nixos.org/nix/, Nix package manager},
12272 which was designed and
12273 implemented by Eelco Dolstra, with contributions from other people (see
12274 the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package
12275 management, and promoted unprecedented features, such as transactional
12276 package upgrades and rollbacks, per-user profiles, and referentially
12277 transparent build processes. Without this work, Guix would not exist.
12278
12279 The Nix-based software distributions, Nixpkgs and NixOS, have also been
12280 an inspiration for Guix.
12281
12282 GNU@tie{}Guix itself is a collective work with contributions from a
12283 number of people. See the @file{AUTHORS} file in Guix for more
12284 information on these fine people. The @file{THANKS} file lists people
12285 who have helped by reporting bugs, taking care of the infrastructure,
12286 providing artwork and themes, making suggestions, and more---thank you!
12287
12288
12289 @c *********************************************************************
12290 @node GNU Free Documentation License
12291 @appendix GNU Free Documentation License
12292
12293 @include fdl-1.3.texi
12294
12295 @c *********************************************************************
12296 @node Concept Index
12297 @unnumbered Concept Index
12298 @printindex cp
12299
12300 @node Programming Index
12301 @unnumbered Programming Index
12302 @syncodeindex tp fn
12303 @syncodeindex vr fn
12304 @printindex fn
12305
12306 @bye
12307
12308 @c Local Variables:
12309 @c ispell-local-dictionary: "american";
12310 @c End: