Commit | Line | Data |
---|---|---|
568717fd LC |
1 | \input texinfo |
2 | @c -*-texinfo-*- | |
3 | ||
4 | @c %**start of header | |
5 | @setfilename guix.info | |
6 | @documentencoding UTF-8 | |
f8348b91 | 7 | @settitle GNU Guix Reference Manual |
568717fd LC |
8 | @c %**end of header |
9 | ||
10 | @include version.texi | |
7df7a74e NK |
11 | |
12 | @copying | |
db5a9444 | 13 | Copyright @copyright{} 2012, 2013, 2014, 2015, 2016 Ludovic Courtès@* |
af8a56b8 | 14 | Copyright @copyright{} 2013, 2014 Andreas Enge@* |
87eafdbd | 15 | Copyright @copyright{} 2013 Nikita Karetnikov@* |
8c01b9d0 ML |
16 | Copyright @copyright{} 2015 Mathieu Lirzin@* |
17 | Copyright @copyright{} 2014 Pierre-Antoine Rault@* | |
97d76250 LF |
18 | Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer@* |
19 | Copyright @copyright{} 2015, 2016 Leo Famulari | |
7df7a74e NK |
20 | |
21 | Permission is granted to copy, distribute and/or modify this document | |
22 | under the terms of the GNU Free Documentation License, Version 1.3 or | |
23 | any later version published by the Free Software Foundation; with no | |
24 | Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A | |
25 | copy of the license is included in the section entitled ``GNU Free | |
26 | Documentation License''. | |
27 | @end copying | |
568717fd | 28 | |
eeaf4427 | 29 | @dircategory Package management |
568717fd LC |
30 | @direntry |
31 | * guix: (guix). Guix, the functional package manager. | |
e49951eb | 32 | * guix package: (guix)Invoking guix package |
eeaf4427 | 33 | Managing packages with Guix. |
e49951eb | 34 | * guix build: (guix)Invoking guix build |
568717fd | 35 | Building packages with Guix. |
054e8576 LC |
36 | * guix system: (guix)Invoking guix system |
37 | Managing the operating system configuration. | |
568717fd | 38 | @end direntry |
568717fd | 39 | |
372c4bbc DT |
40 | @dircategory Software development |
41 | @direntry | |
42 | * guix environment: (guix)Invoking guix environment | |
43 | Building development environments with Guix. | |
44 | @end direntry | |
45 | ||
568717fd | 46 | @titlepage |
7730d112 LC |
47 | @title GNU Guix Reference Manual |
48 | @subtitle Using the GNU Guix Functional Package Manager | |
2cbed07e | 49 | @author The GNU Guix Developers |
568717fd LC |
50 | |
51 | @page | |
52 | @vskip 0pt plus 1filll | |
53 | Edition @value{EDITION} @* | |
54 | @value{UPDATED} @* | |
55 | ||
7df7a74e | 56 | @insertcopying |
568717fd LC |
57 | @end titlepage |
58 | ||
568717fd LC |
59 | @contents |
60 | ||
61 | @c ********************************************************************* | |
62 | @node Top | |
f8348b91 | 63 | @top GNU Guix |
568717fd | 64 | |
f8348b91 LC |
65 | This document describes GNU Guix version @value{VERSION}, a functional |
66 | package management tool written for the GNU system. | |
568717fd LC |
67 | |
68 | @menu | |
69 | * Introduction:: What is Guix about? | |
bd5e766b | 70 | * Installation:: Installing Guix. |
eeaf4427 | 71 | * Package Management:: Package installation, upgrade, etc. |
c554de89 | 72 | * Emacs Interface:: Using Guix from Emacs. |
568717fd LC |
73 | * Programming Interface:: Using Guix in Scheme. |
74 | * Utilities:: Package management commands. | |
a1ba8475 | 75 | * GNU Distribution:: Software for your friendly GNU system. |
9bf3c1a7 | 76 | * Contributing:: Your help needed! |
568717fd LC |
77 | |
78 | * Acknowledgments:: Thanks! | |
79 | * GNU Free Documentation License:: The license of this manual. | |
80 | * Concept Index:: Concepts. | |
a85b83d2 | 81 | * Programming Index:: Data types, functions, and variables. |
aaa3eaa9 LC |
82 | |
83 | @detailmenu | |
84 | --- The Detailed Node Listing --- | |
85 | ||
86 | Installation | |
87 | ||
1b2b8177 | 88 | * Binary Installation:: Getting Guix running in no time! |
aaa3eaa9 | 89 | * Requirements:: Software needed to build and run Guix. |
ec0339cd | 90 | * Running the Test Suite:: Testing Guix. |
aaa3eaa9 LC |
91 | * Setting Up the Daemon:: Preparing the build daemon's environment. |
92 | * Invoking guix-daemon:: Running the build daemon. | |
0e2d0213 | 93 | * Application Setup:: Application-specific setup. |
aaa3eaa9 LC |
94 | |
95 | Setting Up the Daemon | |
96 | ||
97 | * Build Environment Setup:: Preparing the isolated build environment. | |
98 | * Daemon Offload Setup:: Offloading builds to remote machines. | |
99 | ||
100 | Package Management | |
101 | ||
102 | * Features:: How Guix will make your life brighter. | |
103 | * Invoking guix package:: Package installation, removal, etc. | |
aaa3eaa9 LC |
104 | * Substitutes:: Downloading pre-built binaries. |
105 | * Packages with Multiple Outputs:: Single source package, multiple outputs. | |
106 | * Invoking guix gc:: Running the garbage collector. | |
107 | * Invoking guix pull:: Fetching the latest Guix and distribution. | |
108 | * Invoking guix archive:: Exporting and importing store files. | |
109 | ||
c554de89 AK |
110 | Emacs Interface |
111 | ||
112 | * Initial Setup: Emacs Initial Setup. Preparing @file{~/.emacs}. | |
113 | * Package Management: Emacs Package Management. Managing packages and generations. | |
687c9bc0 | 114 | * Licenses: Emacs Licenses. Interface for licenses of Guix packages. |
9b0afb0d | 115 | * Popup Interface: Emacs Popup Interface. Magit-like interface for guix commands. |
c554de89 | 116 | * Prettify Mode: Emacs Prettify. Abbreviating @file{/gnu/store/@dots{}} file names. |
34850cd5 | 117 | * Build Log Mode: Emacs Build Log. Highlighting Guix build logs. |
187f80c6 AK |
118 | * Completions: Emacs Completions. Completing @command{guix} shell command. |
119 | * Development: Emacs Development. Tools for Guix developers. | |
32950fc8 | 120 | * Hydra: Emacs Hydra. Interface for Guix build farm. |
c554de89 | 121 | |
aaa3eaa9 LC |
122 | Programming Interface |
123 | ||
124 | * Defining Packages:: Defining new packages. | |
125 | * Build Systems:: Specifying how packages are built. | |
126 | * The Store:: Manipulating the package store. | |
127 | * Derivations:: Low-level interface to package derivations. | |
128 | * The Store Monad:: Purely functional interface to the store. | |
129 | * G-Expressions:: Manipulating build expressions. | |
130 | ||
92492b23 LC |
131 | Defining Packages |
132 | ||
133 | * package Reference:: The package data type. | |
134 | * origin Reference:: The origin data type. | |
135 | ||
aaa3eaa9 LC |
136 | Utilities |
137 | ||
138 | * Invoking guix build:: Building packages from the command line. | |
fcc58db6 | 139 | * Invoking guix edit:: Editing package definitions. |
aaa3eaa9 LC |
140 | * Invoking guix download:: Downloading a file and printing its hash. |
141 | * Invoking guix hash:: Computing the cryptographic hash of a file. | |
142 | * Invoking guix import:: Importing package definitions. | |
143 | * Invoking guix refresh:: Updating package definitions. | |
144 | * Invoking guix lint:: Finding errors in package definitions. | |
fcc58db6 | 145 | * Invoking guix size:: Profiling disk usage. |
88856916 | 146 | * Invoking guix graph:: Visualizing the graph of packages. |
aaa3eaa9 | 147 | * Invoking guix environment:: Setting up development environments. |
aff8ce7c | 148 | * Invoking guix publish:: Sharing substitutes. |
d23c20f1 | 149 | * Invoking guix challenge:: Challenging substitute servers. |
32efa254 | 150 | * Invoking guix container:: Process isolation. |
aaa3eaa9 LC |
151 | |
152 | GNU Distribution | |
153 | ||
154 | * System Installation:: Installing the whole operating system. | |
35ed9306 | 155 | * System Configuration:: Configuring the operating system. |
aaa3eaa9 LC |
156 | * Installing Debugging Files:: Feeding the debugger. |
157 | * Security Updates:: Deploying security fixes quickly. | |
158 | * Package Modules:: Packages from the programmer's viewpoint. | |
159 | * Packaging Guidelines:: Growing the distribution. | |
160 | * Bootstrapping:: GNU/Linux built from scratch. | |
161 | * Porting:: Targeting another platform or kernel. | |
162 | ||
163 | System Configuration | |
164 | ||
165 | * Using the Configuration System:: Customizing your GNU system. | |
166 | * operating-system Reference:: Detail of operating-system declarations. | |
167 | * File Systems:: Configuring file system mounts. | |
168 | * Mapped Devices:: Block device extra processing. | |
169 | * User Accounts:: Specifying user accounts. | |
598e19dc | 170 | * Locales:: Language and cultural convention settings. |
aaa3eaa9 LC |
171 | * Services:: Specifying system services. |
172 | * Setuid Programs:: Programs running with root privileges. | |
1b2b8177 | 173 | * X.509 Certificates:: Authenticating HTTPS servers. |
996ed739 | 174 | * Name Service Switch:: Configuring libc's name service switch. |
aaa3eaa9 LC |
175 | * Initial RAM Disk:: Linux-Libre bootstrapping. |
176 | * GRUB Configuration:: Configuring the boot loader. | |
177 | * Invoking guix system:: Instantiating a system configuration. | |
97d76250 | 178 | * Running GuixSD in a VM:: How to run GuixSD in a virtual machine. |
aaa3eaa9 LC |
179 | * Defining Services:: Adding new service definitions. |
180 | ||
181 | Services | |
182 | ||
183 | * Base Services:: Essential system services. | |
184 | * Networking Services:: Network setup, SSH daemon, etc. | |
185 | * X Window:: Graphical display. | |
1b2b8177 LC |
186 | * Desktop Services:: D-Bus and desktop services. |
187 | * Database Services:: SQL databases. | |
d8c18af8 | 188 | * Mail Services:: IMAP, POP3, SMTP, and all that. |
cbd02397 | 189 | * Web Services:: Web servers. |
aa4ed923 | 190 | * Various Services:: Other services. |
aaa3eaa9 | 191 | |
0adfe95a LC |
192 | Defining Services |
193 | ||
194 | * Service Composition:: The model for composing services. | |
195 | * Service Types and Services:: Types and services. | |
196 | * Service Reference:: API reference. | |
dd17bc38 | 197 | * Shepherd Services:: A particular type of service. |
0adfe95a | 198 | |
aaa3eaa9 LC |
199 | Packaging Guidelines |
200 | ||
ec0339cd LC |
201 | * Software Freedom:: What may go into the distribution. |
202 | * Package Naming:: What's in a name? | |
203 | * Version Numbers:: When the name is not enough. | |
cbd02397 | 204 | * Synopses and Descriptions:: Helping users find the right package. |
ec0339cd LC |
205 | * Python Modules:: Taming the snake. |
206 | * Perl Modules:: Little pearls. | |
207 | * Fonts:: Fond of fonts. | |
aaa3eaa9 | 208 | |
8c01b9d0 ML |
209 | Contributing |
210 | ||
211 | * Building from Git:: The latest and greatest. | |
212 | * Running Guix Before It Is Installed:: Hacker tricks. | |
213 | * The Perfect Setup:: The right tools. | |
214 | * Coding Style:: Hygiene of the contributor. | |
215 | * Submitting Patches:: Share your work. | |
216 | ||
217 | Coding Style | |
218 | ||
219 | * Programming Paradigm:: How to compose your elements. | |
220 | * Modules:: Where to store your code? | |
221 | * Data Types and Pattern Matching:: Implementing data structures. | |
222 | * Formatting Code:: Writing conventions. | |
223 | ||
aaa3eaa9 | 224 | @end detailmenu |
568717fd LC |
225 | @end menu |
226 | ||
227 | @c ********************************************************************* | |
228 | @node Introduction | |
229 | @chapter Introduction | |
230 | ||
c80e7e55 LC |
231 | GNU Guix@footnote{``Guix'' is pronounced like ``geeks'', or ``ɡiːks'' |
232 | using the international phonetic alphabet (IPA).} is a functional | |
233 | package management tool for the GNU system. Package management consists | |
4bfc4ea3 NK |
234 | of all activities that relate to building packages from sources, |
235 | honoring their build-time and run-time dependencies, | |
c80e7e55 LC |
236 | installing packages in user environments, upgrading installed packages |
237 | to new versions or rolling back to a previous set, removing unused | |
238 | software packages, etc. | |
568717fd LC |
239 | |
240 | @cindex functional package management | |
241 | The term @dfn{functional} refers to a specific package management | |
136787cb LC |
242 | discipline pioneered by Nix (@pxref{Acknowledgments}). |
243 | In Guix, the package build and installation process is seen | |
4bfc4ea3 NK |
244 | as a function, in the mathematical sense. That function takes inputs, |
245 | such as build scripts, a compiler, and libraries, and | |
246 | returns an installed package. As a pure function, its result depends | |
568717fd LC |
247 | solely on its inputs---for instance, it cannot refer to software or |
248 | scripts that were not explicitly passed as inputs. A build function | |
4bfc4ea3 NK |
249 | always produces the same result when passed a given set of inputs. It |
250 | cannot alter the system's environment in | |
568717fd LC |
251 | any way; for instance, it cannot create, modify, or delete files outside |
252 | of its build and installation directories. This is achieved by running | |
e900c503 | 253 | build processes in isolated environments (or @dfn{containers}), where only their |
4bfc4ea3 | 254 | explicit inputs are visible. |
568717fd | 255 | |
e531ac2a | 256 | @cindex store |
568717fd | 257 | The result of package build functions is @dfn{cached} in the file |
e531ac2a LC |
258 | system, in a special directory called @dfn{the store} (@pxref{The |
259 | Store}). Each package is installed in a directory of its own, in the | |
834129e0 | 260 | store---by default under @file{/gnu/store}. The directory name contains |
568717fd LC |
261 | a hash of all the inputs used to build that package; thus, changing an |
262 | input yields a different directory name. | |
263 | ||
264 | This approach is the foundation of Guix's salient features: support for | |
4bfc4ea3 | 265 | transactional package upgrade and rollback, per-user installation, and |
eeaf4427 | 266 | garbage collection of packages (@pxref{Features}). |
568717fd | 267 | |
4bfc4ea3 | 268 | Guix has a command-line interface, which allows users to build, install, |
568717fd | 269 | upgrade, and remove packages, as well as a Scheme programming interface. |
568717fd | 270 | |
3ca2731c | 271 | @cindex Guix System Distribution |
4705641f | 272 | @cindex GuixSD |
a1ba8475 | 273 | Last but not least, Guix is used to build a distribution of the GNU |
3ca2731c | 274 | system, with many GNU and non-GNU free software packages. The Guix |
4705641f LC |
275 | System Distribution, or GNU@tie{}GuixSD, takes advantage of the core |
276 | properties of Guix at the system level. With GuixSD, users | |
3ca2731c LC |
277 | @emph{declare} all aspects of the operating system configuration, and |
278 | Guix takes care of instantiating that configuration in a reproducible, | |
279 | stateless fashion. @xref{GNU Distribution}. | |
a1ba8475 | 280 | |
bd5e766b LC |
281 | @c ********************************************************************* |
282 | @node Installation | |
283 | @chapter Installation | |
284 | ||
48febeb8 LC |
285 | GNU Guix is available for download from its website at |
286 | @url{http://www.gnu.org/software/guix/}. This section describes the | |
287 | software requirements of Guix, as well as how to install it and get | |
288 | ready to use it. | |
bd5e766b | 289 | |
5af6de3e LC |
290 | Note that this section is concerned with the installation of the package |
291 | manager, which can be done on top of a running GNU/Linux system. If, | |
292 | instead, you want to install the complete GNU operating system, | |
6621cdb6 | 293 | @pxref{System Installation}. |
5af6de3e | 294 | |
bd5e766b | 295 | @menu |
09722b11 | 296 | * Binary Installation:: Getting Guix running in no time! |
bd5e766b | 297 | * Requirements:: Software needed to build and run Guix. |
ec0339cd | 298 | * Running the Test Suite:: Testing Guix. |
bd5e766b LC |
299 | * Setting Up the Daemon:: Preparing the build daemon's environment. |
300 | * Invoking guix-daemon:: Running the build daemon. | |
0e2d0213 | 301 | * Application Setup:: Application-specific setup. |
bd5e766b LC |
302 | @end menu |
303 | ||
09722b11 LC |
304 | @node Binary Installation |
305 | @section Binary Installation | |
306 | ||
307 | This section describes how to install Guix on an arbitrary system from a | |
308 | self-contained tarball providing binaries for Guix and for all its | |
309 | dependencies. This is often quicker than installing from source, which | |
310 | is described in the next sections. The only requirement is to have | |
311 | GNU@tie{}tar and Xz. | |
312 | ||
313 | Installing goes along these lines: | |
314 | ||
315 | @enumerate | |
316 | @item | |
317 | Download the binary tarball from | |
daa8922a LC |
318 | @indicateurl{ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz}, |
319 | where @var{system} is @code{x86_64-linux} for an @code{x86_64} machine | |
320 | already running the kernel Linux, and so on. | |
321 | ||
322 | Make sure to download the associated @file{.sig} file and to verify the | |
323 | authenticity of the tarball against it, along these lines: | |
324 | ||
325 | @example | |
326 | $ wget ftp://alpha.gnu.org/gnu/guix/guix-binary-@value{VERSION}.@var{system}.tar.xz.sig | |
327 | $ gpg --verify guix-binary-@value{VERSION}.@var{system}.tar.xz.sig | |
328 | @end example | |
329 | ||
330 | If that command fails because you don't have the required public key, | |
331 | then run this command to import it: | |
332 | ||
333 | @example | |
334 | $ gpg --keyserver keys.gnupg.net --recv-keys 3D9AEBB5 | |
335 | @end example | |
336 | ||
337 | @noindent | |
338 | and rerun the @code{gpg --verify} command. | |
09722b11 LC |
339 | |
340 | @item | |
341 | As @code{root}, run: | |
342 | ||
343 | @example | |
5dc42964 | 344 | # cd /tmp |
254b1c2e LC |
345 | # tar --warning=no-timestamp -xf \ |
346 | guix-binary-@value{VERSION}.@var{system}.tar.xz | |
5dc42964 | 347 | # mv var/guix /var/ && mv gnu / |
09722b11 LC |
348 | @end example |
349 | ||
7acd3439 LC |
350 | This creates @file{/gnu/store} (@pxref{The Store}) and @file{/var/guix}. |
351 | The latter contains a ready-to-use profile for @code{root} (see next | |
352 | step.) | |
09722b11 | 353 | |
5dc3ce5f LC |
354 | Do @emph{not} unpack the tarball on a working Guix system since that |
355 | would overwrite its own essential files. | |
356 | ||
254b1c2e | 357 | The @code{--warning=no-timestamp} option makes sure GNU@tie{}tar does |
e9ba6357 LC |
358 | not emit warnings about ``implausibly old time stamps'' (such |
359 | warnings were triggered by GNU@tie{}tar 1.26 and older; recent | |
360 | versions are fine.) | |
361 | They stem from the fact that all the | |
254b1c2e LC |
362 | files in the archive have their modification time set to zero (which |
363 | means January 1st, 1970.) This is done on purpose to make sure the | |
364 | archive content is independent of its creation time, thus making it | |
365 | reproducible. | |
366 | ||
7acd3439 LC |
367 | @item |
368 | Make @code{root}'s profile available under @file{~/.guix-profile}: | |
369 | ||
370 | @example | |
371 | # ln -sf /var/guix/profiles/per-user/root/guix-profile \ | |
372 | ~root/.guix-profile | |
373 | @end example | |
374 | ||
43c33047 LC |
375 | @item |
376 | Create the group and user accounts for build users as explained below | |
377 | (@pxref{Build Environment Setup}). | |
378 | ||
09722b11 | 379 | @item |
175ced41 | 380 | Run the daemon: |
09722b11 LC |
381 | |
382 | @example | |
7acd3439 | 383 | # ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild |
09722b11 LC |
384 | @end example |
385 | ||
d2825c96 LC |
386 | On hosts using the systemd init system, drop |
387 | @file{~root/.guix-profile/lib/systemd/system/guix-daemon.service} in | |
388 | @file{/etc/systemd/system}. | |
389 | ||
ad227484 MDRS |
390 | Likewise, on hosts using the Upstart init system, drop |
391 | @file{~root/.guix-profile/lib/upstart/system/guix-daemon.conf} in | |
392 | @file{/etc/init}. | |
393 | ||
09722b11 LC |
394 | @item |
395 | Make the @command{guix} command available to other users on the machine, | |
396 | for instance with: | |
397 | ||
398 | @example | |
399 | # mkdir -p /usr/local/bin | |
400 | # cd /usr/local/bin | |
d72d05f9 | 401 | # ln -s /var/guix/profiles/per-user/root/guix-profile/bin/guix |
09722b11 | 402 | @end example |
39f8ed14 | 403 | |
aca738f3 LC |
404 | It is also a good idea to make the Info version of this manual available |
405 | there: | |
406 | ||
407 | @example | |
408 | # mkdir -p /usr/local/share/info | |
409 | # cd /usr/local/share/info | |
410 | # for i in /var/guix/profiles/per-user/root/guix-profile/share/info/* ; | |
411 | do ln -s $i ; done | |
412 | @end example | |
413 | ||
414 | That way, assuming @file{/usr/local/share/info} is in the search path, | |
415 | running @command{info guix} will open this manual (@pxref{Other Info | |
416 | Directories,,, texinfo, GNU Texinfo}, for more details on changing the | |
417 | Info search path.) | |
418 | ||
39f8ed14 LC |
419 | @item |
420 | To use substitutes from @code{hydra.gnu.org} (@pxref{Substitutes}), | |
421 | authorize them: | |
422 | ||
423 | @example | |
7acd3439 | 424 | # guix archive --authorize < ~root/.guix-profile/share/guix/hydra.gnu.org.pub |
39f8ed14 | 425 | @end example |
09722b11 LC |
426 | @end enumerate |
427 | ||
53de532f LC |
428 | And that's it! For additional tips and tricks, @pxref{Application |
429 | Setup}. | |
09722b11 | 430 | |
5dc3ce5f | 431 | The @code{guix} package must remain available in @code{root}'s |
09722b11 LC |
432 | profile, or it would become subject to garbage collection---in which |
433 | case you would find yourself badly handicapped by the lack of the | |
434 | @command{guix} command. | |
435 | ||
39f8ed14 LC |
436 | The tarball in question can be (re)produced and verified simply by |
437 | running the following command in the Guix source tree: | |
09722b11 LC |
438 | |
439 | @example | |
440 | make guix-binary.@var{system}.tar.xz | |
441 | @end example | |
442 | ||
443 | ||
bd5e766b LC |
444 | @node Requirements |
445 | @section Requirements | |
446 | ||
09722b11 LC |
447 | This section lists requirements when building Guix from source. The |
448 | build procedure for Guix is the same as for other GNU software, and is | |
449 | not covered here. Please see the files @file{README} and @file{INSTALL} | |
450 | in the Guix source tree for additional details. | |
451 | ||
bd5e766b LC |
452 | GNU Guix depends on the following packages: |
453 | ||
454 | @itemize | |
47c66da0 | 455 | @item @url{http://gnu.org/software/guile/, GNU Guile}, version 2.0.7 or later; |
288dca55 | 456 | @item @url{http://gnupg.org/, GNU libgcrypt}; |
f0b98b84 | 457 | @item @url{http://www.gnu.org/software/make/, GNU Make}. |
8a96bd4b ID |
458 | @end itemize |
459 | ||
460 | The following dependencies are optional: | |
461 | ||
462 | @itemize | |
288dca55 | 463 | @item |
8a96bd4b | 464 | Installing |
288dca55 | 465 | @url{http://savannah.nongnu.org/projects/guile-json/, Guile-JSON} will |
2f7d2d91 LC |
466 | allow you to use the @command{guix import pypi} command (@pxref{Invoking |
467 | guix import}). It is of | |
288dca55 | 468 | interest primarily for developers and not for casual users. |
8a96bd4b ID |
469 | @item |
470 | Installing @uref{http://gnutls.org/, GnuTLS-Guile} will | |
471 | allow you to access @code{https} URLs with the @command{guix download} | |
d45dc6da EB |
472 | command (@pxref{Invoking guix download}), the @command{guix import pypi} |
473 | command, and the @command{guix import cpan} command. This is primarily | |
474 | of interest to developers. @xref{Guile Preparations, how to install the | |
475 | GnuTLS bindings for Guile,, gnutls-guile, GnuTLS-Guile}. | |
bd5e766b LC |
476 | @end itemize |
477 | ||
478 | Unless @code{--disable-daemon} was passed to @command{configure}, the | |
479 | following packages are also needed: | |
480 | ||
481 | @itemize | |
368d08f7 LC |
482 | @item @url{http://sqlite.org, SQLite 3}; |
483 | @item @url{http://www.bzip.org, libbz2}; | |
484 | @item @url{http://gcc.gnu.org, GCC's g++}, with support for the | |
485 | C++11 standard. | |
bd5e766b LC |
486 | @end itemize |
487 | ||
4bfc4ea3 NK |
488 | When a working installation of @url{http://nixos.org/nix/, the Nix package |
489 | manager} is available, you | |
bd5e766b | 490 | can instead configure Guix with @code{--disable-daemon}. In that case, |
4bfc4ea3 | 491 | Nix replaces the three dependencies above. |
bd5e766b | 492 | |
b22a12fd LC |
493 | Guix is compatible with Nix, so it is possible to share the same store |
494 | between both. To do so, you must pass @command{configure} not only the | |
495 | same @code{--with-store-dir} value, but also the same | |
4bfc4ea3 NK |
496 | @code{--localstatedir} value. The latter is essential because it |
497 | specifies where the database that stores metadata about the store is | |
834129e0 | 498 | located, among other things. The default values for Nix are |
b22a12fd | 499 | @code{--with-store-dir=/nix/store} and @code{--localstatedir=/nix/var}. |
4bfc4ea3 NK |
500 | Note that @code{--disable-daemon} is not required if |
501 | your goal is to share the store with Nix. | |
b22a12fd | 502 | |
ec0339cd LC |
503 | @node Running the Test Suite |
504 | @section Running the Test Suite | |
505 | ||
506 | After a successful @command{configure} and @code{make} run, it is a good | |
507 | idea to run the test suite. It can help catch issues with the setup or | |
508 | environment, or bugs in Guix itself---and really, reporting test | |
509 | failures is a good way to help improve the software. To run the test | |
510 | suite, type: | |
511 | ||
512 | @example | |
513 | make check | |
514 | @end example | |
515 | ||
516 | Test cases can run in parallel: you can use the @code{-j} option of | |
517 | GNU@tie{}make to speed things up. The first run may take a few minutes | |
518 | on a recent machine; subsequent runs will be faster because the store | |
519 | that is created for test purposes will already have various things in | |
520 | cache. | |
521 | ||
a887fd8d LC |
522 | It is also possible to run a subset of the tests by defining the |
523 | @code{TESTS} makefile variable as in this example: | |
524 | ||
525 | @example | |
526 | make check TESTS="tests/store.scm tests/cpio.scm" | |
527 | @end example | |
528 | ||
ec0339cd LC |
529 | Upon failure, please email @email{bug-guix@@gnu.org} and attach the |
530 | @file{test-suite.log} file. When @file{tests/@var{something}.scm} | |
531 | fails, please also attach the @file{@var{something}.log} file available | |
532 | in the top-level build directory. Please specify the Guix version being | |
533 | used as well as version numbers of the dependencies | |
534 | (@pxref{Requirements}) in your message. | |
535 | ||
bd5e766b LC |
536 | @node Setting Up the Daemon |
537 | @section Setting Up the Daemon | |
538 | ||
539 | @cindex daemon | |
540 | Operations such as building a package or running the garbage collector | |
49e6291a | 541 | are all performed by a specialized process, the @dfn{build daemon}, on |
bd5e766b LC |
542 | behalf of clients. Only the daemon may access the store and its |
543 | associated database. Thus, any operation that manipulates the store | |
544 | goes through the daemon. For instance, command-line tools such as | |
e49951eb | 545 | @command{guix package} and @command{guix build} communicate with the |
bd5e766b LC |
546 | daemon (@i{via} remote procedure calls) to instruct it what to do. |
547 | ||
49e6291a | 548 | The following sections explain how to prepare the build daemon's |
225dafde LC |
549 | environment. Also @ref{Substitutes}, for information on how to allow |
550 | the daemon to download pre-built binaries. | |
49e6291a LC |
551 | |
552 | @menu | |
553 | * Build Environment Setup:: Preparing the isolated build environment. | |
554 | * Daemon Offload Setup:: Offloading builds to remote machines. | |
555 | @end menu | |
556 | ||
557 | @node Build Environment Setup | |
558 | @subsection Build Environment Setup | |
559 | ||
bd5e766b LC |
560 | In a standard multi-user setup, Guix and its daemon---the |
561 | @command{guix-daemon} program---are installed by the system | |
834129e0 | 562 | administrator; @file{/gnu/store} is owned by @code{root} and |
bd5e766b LC |
563 | @command{guix-daemon} runs as @code{root}. Unprivileged users may use |
564 | Guix tools to build packages or otherwise access the store, and the | |
565 | daemon will do it on their behalf, ensuring that the store is kept in a | |
566 | consistent state, and allowing built packages to be shared among users. | |
567 | ||
568 | @cindex build users | |
569 | When @command{guix-daemon} runs as @code{root}, you may not want package | |
570 | build processes themselves to run as @code{root} too, for obvious | |
571 | security reasons. To avoid that, a special pool of @dfn{build users} | |
572 | should be created for use by build processes started by the daemon. | |
573 | These build users need not have a shell and a home directory: they will | |
574 | just be used when the daemon drops @code{root} privileges in build | |
575 | processes. Having several such users allows the daemon to launch | |
576 | distinct build processes under separate UIDs, which guarantees that they | |
577 | do not interfere with each other---an essential feature since builds are | |
578 | regarded as pure functions (@pxref{Introduction}). | |
579 | ||
580 | On a GNU/Linux system, a build user pool may be created like this (using | |
581 | Bash syntax and the @code{shadow} commands): | |
582 | ||
091196b3 LC |
583 | @c See http://lists.gnu.org/archive/html/bug-guix/2013-01/msg00239.html |
584 | @c for why `-G' is needed. | |
bd5e766b | 585 | @example |
cfc149dc LC |
586 | # groupadd --system guixbuild |
587 | # for i in `seq -w 1 10`; | |
bd5e766b | 588 | do |
cfc149dc LC |
589 | useradd -g guixbuild -G guixbuild \ |
590 | -d /var/empty -s `which nologin` \ | |
591 | -c "Guix build user $i" --system \ | |
592 | guixbuilder$i; | |
bd5e766b LC |
593 | done |
594 | @end example | |
595 | ||
596 | @noindent | |
54eb03ab LC |
597 | The number of build users determines how many build jobs may run in |
598 | parallel, as specified by the @option{--max-jobs} option | |
d2825c96 LC |
599 | (@pxref{Invoking guix-daemon, @option{--max-jobs}}). The |
600 | @code{guix-daemon} program may then be run as @code{root} with the | |
601 | following command@footnote{If your machine uses the systemd init system, | |
602 | dropping the @file{@var{prefix}/lib/systemd/system/guix-daemon.service} | |
603 | file in @file{/etc/systemd/system} will ensure that | |
ad227484 MDRS |
604 | @command{guix-daemon} is automatically started. Similarly, if your |
605 | machine uses the Upstart init system, drop the | |
606 | @file{@var{prefix}/lib/upstart/system/guix-daemon.conf} | |
607 | file in @file{/etc/init}.}: | |
bd5e766b LC |
608 | |
609 | @example | |
cfc149dc | 610 | # guix-daemon --build-users-group=guixbuild |
bd5e766b LC |
611 | @end example |
612 | ||
e900c503 | 613 | @cindex chroot |
b095792f LC |
614 | @noindent |
615 | This way, the daemon starts build processes in a chroot, under one of | |
cfc149dc | 616 | the @code{guixbuilder} users. On GNU/Linux, by default, the chroot |
6dc99317 LC |
617 | environment contains nothing but: |
618 | ||
619 | @c Keep this list in sync with libstore/build.cc! ----------------------- | |
620 | @itemize | |
621 | @item | |
4743a4da LC |
622 | a minimal @code{/dev} directory, created mostly independently from the |
623 | host @code{/dev}@footnote{``Mostly'', because while the set of files | |
624 | that appear in the chroot's @code{/dev} is fixed, most of these files | |
625 | can only be created if the host has them.}; | |
626 | ||
627 | @item | |
628 | the @code{/proc} directory; it only shows the container's processes | |
629 | since a separate PID name space is used; | |
6dc99317 LC |
630 | |
631 | @item | |
632 | @file{/etc/passwd} with an entry for the current user and an entry for | |
633 | user @file{nobody}; | |
634 | ||
635 | @item | |
636 | @file{/etc/group} with an entry for the user's group; | |
637 | ||
638 | @item | |
639 | @file{/etc/hosts} with an entry that maps @code{localhost} to | |
640 | @code{127.0.0.1}; | |
641 | ||
642 | @item | |
643 | a writable @file{/tmp} directory. | |
644 | @end itemize | |
b095792f | 645 | |
cb960102 ED |
646 | You can influence the directory where the daemon stores build trees |
647 | @i{via} the @code{TMPDIR} environment variable. However, the build tree | |
7a57c96a | 648 | within the chroot is always @file{/tmp/guix-build-@var{name}.drv-0}, |
cb960102 ED |
649 | where @var{name} is the derivation name---e.g., @code{coreutils-8.24}. |
650 | This way, the value of @code{TMPDIR} does not leak inside build | |
651 | environments, which avoids discrepancies in cases where build processes | |
652 | capture the name of their build tree. | |
653 | ||
e0c941fe LC |
654 | @vindex http_proxy |
655 | The daemon also honors the @code{http_proxy} environment variable for | |
656 | HTTP downloads it performs, be it for fixed-output derivations | |
657 | (@pxref{Derivations}) or for substitutes (@pxref{Substitutes}). | |
658 | ||
1e2644bb LC |
659 | If you are installing Guix as an unprivileged user, it is still possible |
660 | to run @command{guix-daemon} provided you pass @code{--disable-chroot}. | |
661 | However, build processes will not be isolated from one another, and not | |
662 | from the rest of the system. Thus, build processes may interfere with | |
663 | each other, and may access programs, libraries, and other files | |
664 | available on the system---making it much harder to view them as | |
665 | @emph{pure} functions. | |
bd5e766b | 666 | |
49e6291a LC |
667 | |
668 | @node Daemon Offload Setup | |
669 | @subsection Using the Offload Facility | |
670 | ||
671 | @cindex offloading | |
4ec2e92d LC |
672 | @cindex build hook |
673 | When desired, the build daemon can @dfn{offload} | |
674 | derivation builds to other machines | |
49e6291a LC |
675 | running Guix, using the @code{offload} @dfn{build hook}. When that |
676 | feature is enabled, a list of user-specified build machines is read from | |
677 | @file{/etc/guix/machines.scm}; anytime a build is requested, for | |
678 | instance via @code{guix build}, the daemon attempts to offload it to one | |
679 | of the machines that satisfies the derivation's constraints, in | |
680 | particular its system type---e.g., @file{x86_64-linux}. Missing | |
681 | prerequisites for the build are copied over SSH to the target machine, | |
682 | which then proceeds with the build; upon success the output(s) of the | |
683 | build are copied back to the initial machine. | |
684 | ||
4ec2e92d | 685 | The @file{/etc/guix/machines.scm} file typically looks like this: |
49e6291a LC |
686 | |
687 | @example | |
688 | (list (build-machine | |
689 | (name "eightysix.example.org") | |
690 | (system "x86_64-linux") | |
691 | (user "bob") | |
692 | (speed 2.)) ; incredibly fast! | |
693 | ||
694 | (build-machine | |
695 | (name "meeps.example.org") | |
696 | (system "mips64el-linux") | |
697 | (user "alice") | |
698 | (private-key | |
699 | (string-append (getenv "HOME") | |
c4fdfd6f | 700 | "/.lsh/identity-for-guix")))) |
49e6291a LC |
701 | @end example |
702 | ||
703 | @noindent | |
704 | In the example above we specify a list of two build machines, one for | |
705 | the @code{x86_64} architecture and one for the @code{mips64el} | |
4ec2e92d LC |
706 | architecture. |
707 | ||
708 | In fact, this file is---not surprisingly!---a Scheme file that is | |
709 | evaluated when the @code{offload} hook is started. Its return value | |
710 | must be a list of @code{build-machine} objects. While this example | |
711 | shows a fixed list of build machines, one could imagine, say, using | |
712 | DNS-SD to return a list of potential build machines discovered in the | |
713 | local network (@pxref{Introduction, Guile-Avahi,, guile-avahi, Using | |
c678a4ee LC |
714 | Avahi in Guile Scheme Programs}). The @code{build-machine} data type is |
715 | detailed below. | |
4ec2e92d | 716 | |
c678a4ee LC |
717 | @deftp {Data Type} build-machine |
718 | This data type represents build machines the daemon may offload builds | |
719 | to. The important fields are: | |
49e6291a LC |
720 | |
721 | @table @code | |
722 | ||
723 | @item name | |
724 | The remote machine's host name. | |
725 | ||
726 | @item system | |
c678a4ee | 727 | The remote machine's system type---e.g., @code{"x86_64-linux"}. |
49e6291a LC |
728 | |
729 | @item user | |
730 | The user account to use when connecting to the remote machine over SSH. | |
731 | Note that the SSH key pair must @emph{not} be passphrase-protected, to | |
732 | allow non-interactive logins. | |
733 | ||
734 | @end table | |
735 | ||
4ec2e92d | 736 | A number of optional fields may be specified: |
49e6291a LC |
737 | |
738 | @table @code | |
739 | ||
cecd72d5 LC |
740 | @item port |
741 | Port number of the machine's SSH server (default: 22). | |
742 | ||
49e6291a LC |
743 | @item private-key |
744 | The SSH private key file to use when connecting to the machine. | |
745 | ||
c4fdfd6f LC |
746 | Currently offloading uses GNU@tie{}lsh as its SSH client |
747 | (@pxref{Invoking lsh,,, GNU lsh Manual}). Thus, the key file here must | |
748 | be an lsh key file. This may change in the future, though. | |
749 | ||
49e6291a LC |
750 | @item parallel-builds |
751 | The number of builds that may run in parallel on the machine (1 by | |
752 | default.) | |
753 | ||
754 | @item speed | |
755 | A ``relative speed factor''. The offload scheduler will tend to prefer | |
756 | machines with a higher speed factor. | |
757 | ||
758 | @item features | |
759 | A list of strings denoting specific features supported by the machine. | |
760 | An example is @code{"kvm"} for machines that have the KVM Linux modules | |
761 | and corresponding hardware support. Derivations can request features by | |
762 | name, and they will be scheduled on matching build machines. | |
763 | ||
764 | @end table | |
c678a4ee | 765 | @end deftp |
49e6291a LC |
766 | |
767 | The @code{guix} command must be in the search path on the build | |
768 | machines, since offloading works by invoking the @code{guix archive} and | |
c4fdfd6f LC |
769 | @code{guix build} commands. In addition, the Guix modules must be in |
770 | @code{$GUILE_LOAD_PATH} on the build machine---you can check whether | |
771 | this is the case by running: | |
772 | ||
773 | @example | |
74273b6f | 774 | lsh build-machine guile -c "'(use-modules (guix config))'" |
c4fdfd6f | 775 | @end example |
49e6291a LC |
776 | |
777 | There's one last thing to do once @file{machines.scm} is in place. As | |
778 | explained above, when offloading, files are transferred back and forth | |
c4fdfd6f LC |
779 | between the machine stores. For this to work, you first need to |
780 | generate a key pair on each machine to allow the daemon to export signed | |
781 | archives of files from the store (@pxref{Invoking guix archive}): | |
49e6291a LC |
782 | |
783 | @example | |
784 | # guix archive --generate-key | |
785 | @end example | |
786 | ||
787 | @noindent | |
c4fdfd6f LC |
788 | Each build machine must authorize the key of the master machine so that |
789 | it accepts store items it receives from the master: | |
790 | ||
791 | @example | |
792 | # guix archive --authorize < master-public-key.txt | |
793 | @end example | |
794 | ||
795 | @noindent | |
796 | Likewise, the master machine must authorize the key of each build machine. | |
797 | ||
798 | All the fuss with keys is here to express pairwise mutual trust | |
799 | relations between the master and the build machines. Concretely, when | |
800 | the master receives files from a build machine (and @i{vice versa}), its | |
801 | build daemon can make sure they are genuine, have not been tampered | |
802 | with, and that they are signed by an authorized key. | |
49e6291a LC |
803 | |
804 | ||
bd5e766b LC |
805 | @node Invoking guix-daemon |
806 | @section Invoking @command{guix-daemon} | |
807 | ||
808 | The @command{guix-daemon} program implements all the functionality to | |
809 | access the store. This includes launching build processes, running the | |
810 | garbage collector, querying the availability of a build result, etc. It | |
811 | is normally run as @code{root} like this: | |
812 | ||
813 | @example | |
cfc149dc | 814 | # guix-daemon --build-users-group=guixbuild |
bd5e766b LC |
815 | @end example |
816 | ||
817 | @noindent | |
081145cf | 818 | For details on how to set it up, @pxref{Setting Up the Daemon}. |
bd5e766b | 819 | |
e900c503 LC |
820 | @cindex chroot |
821 | @cindex container, build environment | |
822 | @cindex build environment | |
823 | @cindex reproducible builds | |
bd5e766b LC |
824 | By default, @command{guix-daemon} launches build processes under |
825 | different UIDs, taken from the build group specified with | |
826 | @code{--build-users-group}. In addition, each build process is run in a | |
827 | chroot environment that only contains the subset of the store that the | |
828 | build process depends on, as specified by its derivation | |
829 | (@pxref{Programming Interface, derivation}), plus a set of specific | |
830 | system directories. By default, the latter contains @file{/dev} and | |
e900c503 LC |
831 | @file{/dev/pts}. Furthermore, on GNU/Linux, the build environment is a |
832 | @dfn{container}: in addition to having its own file system tree, it has | |
833 | a separate mount name space, its own PID name space, network name space, | |
834 | etc. This helps achieve reproducible builds (@pxref{Features}). | |
bd5e766b | 835 | |
cbc538fe LC |
836 | When the daemon performs a build on behalf of the user, it creates a |
837 | build directory under @file{/tmp} or under the directory specified by | |
838 | its @code{TMPDIR} environment variable; this directory is shared with | |
839 | the container for the duration of the build. Be aware that using a | |
840 | directory other than @file{/tmp} can affect build results---for example, | |
841 | with a longer directory name, a build process that uses Unix-domain | |
842 | sockets might hit the name length limitation for @code{sun_path}, which | |
843 | it would otherwise not hit. | |
844 | ||
845 | The build directory is automatically deleted upon completion, unless the | |
846 | build failed and the client specified @option{--keep-failed} | |
847 | (@pxref{Invoking guix build, @option{--keep-failed}}). | |
848 | ||
bd5e766b LC |
849 | The following command-line options are supported: |
850 | ||
851 | @table @code | |
852 | @item --build-users-group=@var{group} | |
853 | Take users from @var{group} to run build processes (@pxref{Setting Up | |
854 | the Daemon, build users}). | |
855 | ||
6858f9d1 | 856 | @item --no-substitutes |
b5385b52 | 857 | @cindex substitutes |
6858f9d1 | 858 | Do not use substitutes for build products. That is, always build things |
c4202d60 LC |
859 | locally instead of allowing downloads of pre-built binaries |
860 | (@pxref{Substitutes}). | |
6858f9d1 | 861 | |
b5385b52 LC |
862 | By default substitutes are used, unless the client---such as the |
863 | @command{guix package} command---is explicitly invoked with | |
864 | @code{--no-substitutes}. | |
865 | ||
866 | When the daemon runs with @code{--no-substitutes}, clients can still | |
867 | explicitly enable substitution @i{via} the @code{set-build-options} | |
868 | remote procedure call (@pxref{The Store}). | |
869 | ||
9176607e | 870 | @item --substitute-urls=@var{urls} |
f8a8e0fe | 871 | @anchor{daemon-substitute-urls} |
9176607e | 872 | Consider @var{urls} the default whitespace-separated list of substitute |
ae806096 | 873 | source URLs. When this option is omitted, @indicateurl{http://hydra.gnu.org} |
9176607e LC |
874 | is used. |
875 | ||
876 | This means that substitutes may be downloaded from @var{urls}, as long | |
877 | as they are signed by a trusted signature (@pxref{Substitutes}). | |
878 | ||
4ec2e92d LC |
879 | @cindex build hook |
880 | @item --no-build-hook | |
881 | Do not use the @dfn{build hook}. | |
882 | ||
883 | The build hook is a helper program that the daemon can start and to | |
884 | which it submits build requests. This mechanism is used to offload | |
885 | builds to other machines (@pxref{Daemon Offload Setup}). | |
886 | ||
bd5e766b LC |
887 | @item --cache-failures |
888 | Cache build failures. By default, only successful builds are cached. | |
889 | ||
30d9aa54 LC |
890 | When this option is used, @command{guix gc --list-failures} can be used |
891 | to query the set of store items marked as failed; @command{guix gc | |
892 | --clear-failures} removes store items from the set of cached failures. | |
893 | @xref{Invoking guix gc}. | |
894 | ||
bd5e766b LC |
895 | @item --cores=@var{n} |
896 | @itemx -c @var{n} | |
897 | Use @var{n} CPU cores to build each derivation; @code{0} means as many | |
898 | as available. | |
899 | ||
6efc160e | 900 | The default value is @code{0}, but it may be overridden by clients, such |
e49951eb MW |
901 | as the @code{--cores} option of @command{guix build} (@pxref{Invoking |
902 | guix build}). | |
bd5e766b LC |
903 | |
904 | The effect is to define the @code{NIX_BUILD_CORES} environment variable | |
905 | in the build process, which can then use it to exploit internal | |
906 | parallelism---for instance, by running @code{make -j$NIX_BUILD_CORES}. | |
907 | ||
908 | @item --max-jobs=@var{n} | |
909 | @itemx -M @var{n} | |
910 | Allow at most @var{n} build jobs in parallel. The default value is | |
f6526eb3 LC |
911 | @code{1}. Setting it to @code{0} means that no builds will be performed |
912 | locally; instead, the daemon will offload builds (@pxref{Daemon Offload | |
913 | Setup}), or simply fail. | |
bd5e766b | 914 | |
ecf84b7c LC |
915 | @item --rounds=@var{N} |
916 | Build each derivation @var{n} times in a row, and raise an error if | |
917 | consecutive build results are not bit-for-bit identical. Note that this | |
918 | setting can be overridden by clients such as @command{guix build} | |
919 | (@pxref{Invoking guix build}). | |
920 | ||
bd5e766b LC |
921 | @item --debug |
922 | Produce debugging output. | |
923 | ||
924 | This is useful to debug daemon start-up issues, but then it may be | |
925 | overridden by clients, for example the @code{--verbosity} option of | |
e49951eb | 926 | @command{guix build} (@pxref{Invoking guix build}). |
bd5e766b LC |
927 | |
928 | @item --chroot-directory=@var{dir} | |
929 | Add @var{dir} to the build chroot. | |
930 | ||
931 | Doing this may change the result of build processes---for instance if | |
932 | they use optional dependencies found in @var{dir} when it is available, | |
933 | and not otherwise. For that reason, it is not recommended to do so. | |
934 | Instead, make sure that each derivation declares all the inputs that it | |
935 | needs. | |
936 | ||
937 | @item --disable-chroot | |
938 | Disable chroot builds. | |
939 | ||
940 | Using this option is not recommended since, again, it would allow build | |
1e2644bb LC |
941 | processes to gain access to undeclared dependencies. It is necessary, |
942 | though, when @command{guix-daemon} is running under an unprivileged user | |
943 | account. | |
bd5e766b LC |
944 | |
945 | @item --disable-log-compression | |
946 | Disable compression of the build logs. | |
947 | ||
1da983b9 LC |
948 | Unless @code{--lose-logs} is used, all the build logs are kept in the |
949 | @var{localstatedir}. To save space, the daemon automatically compresses | |
950 | them with bzip2 by default. This option disables that. | |
951 | ||
ab3893d7 LC |
952 | @item --disable-deduplication |
953 | @cindex deduplication | |
bd5e766b LC |
954 | Disable automatic file ``deduplication'' in the store. |
955 | ||
1da983b9 | 956 | By default, files added to the store are automatically ``deduplicated'': |
ab3893d7 LC |
957 | if a newly added file is identical to another one found in the store, |
958 | the daemon makes the new file a hard link to the other file. This can | |
4988dd40 | 959 | noticeably reduce disk usage, at the expense of slightly increased |
ab3893d7 LC |
960 | input/output load at the end of a build process. This option disables |
961 | this optimization. | |
1da983b9 | 962 | |
6e37066e LC |
963 | @item --gc-keep-outputs[=yes|no] |
964 | Tell whether the garbage collector (GC) must keep outputs of live | |
965 | derivations. | |
966 | ||
967 | When set to ``yes'', the GC will keep the outputs of any live derivation | |
968 | available in the store---the @code{.drv} files. The default is ``no'', | |
969 | meaning that derivation outputs are kept only if they are GC roots. | |
970 | ||
971 | @item --gc-keep-derivations[=yes|no] | |
972 | Tell whether the garbage collector (GC) must keep derivations | |
973 | corresponding to live outputs. | |
974 | ||
975 | When set to ``yes'', as is the case by default, the GC keeps | |
976 | derivations---i.e., @code{.drv} files---as long as at least one of their | |
977 | outputs is live. This allows users to keep track of the origins of | |
978 | items in their store. Setting it to ``no'' saves a bit of disk space. | |
979 | ||
980 | Note that when both @code{--gc-keep-derivations} and | |
981 | @code{--gc-keep-outputs} are used, the effect is to keep all the build | |
982 | prerequisites (the sources, compiler, libraries, and other build-time | |
983 | tools) of live objects in the store, regardless of whether these | |
984 | prerequisites are live. This is convenient for developers since it | |
985 | saves rebuilds or downloads. | |
986 | ||
bd5e766b LC |
987 | @item --impersonate-linux-2.6 |
988 | On Linux-based systems, impersonate Linux 2.6. This means that the | |
989 | kernel's @code{uname} system call will report 2.6 as the release number. | |
990 | ||
991 | This might be helpful to build programs that (usually wrongfully) depend | |
992 | on the kernel version number. | |
993 | ||
994 | @item --lose-logs | |
995 | Do not keep build logs. By default they are kept under | |
ce33631f | 996 | @code{@var{localstatedir}/guix/log}. |
bd5e766b LC |
997 | |
998 | @item --system=@var{system} | |
999 | Assume @var{system} as the current system type. By default it is the | |
1000 | architecture/kernel pair found at configure time, such as | |
1001 | @code{x86_64-linux}. | |
b8d2aa26 LC |
1002 | |
1003 | @item --listen=@var{socket} | |
1004 | Listen for connections on @var{socket}, the file name of a Unix-domain | |
1005 | socket. The default socket is | |
1006 | @file{@var{localstatedir}/daemon-socket/socket}. This option is only | |
1007 | useful in exceptional circumstances, such as if you need to run several | |
1008 | daemons on the same machine. | |
bd5e766b LC |
1009 | @end table |
1010 | ||
1011 | ||
0e2d0213 LC |
1012 | @node Application Setup |
1013 | @section Application Setup | |
1014 | ||
85e57214 LC |
1015 | When using Guix on top of GNU/Linux distribution other than GuixSD---a |
1016 | so-called @dfn{foreign distro}---a few additional steps are needed to | |
1017 | get everything in place. Here are some of them. | |
0e2d0213 LC |
1018 | |
1019 | @subsection Locales | |
1020 | ||
5c3c1427 | 1021 | @anchor{locales-and-locpath} |
0e2d0213 | 1022 | @cindex locales, when not on GuixSD |
5c3c1427 | 1023 | @vindex LOCPATH |
85e57214 | 1024 | @vindex GUIX_LOCPATH |
0e2d0213 LC |
1025 | Packages installed @i{via} Guix will not use the host system's locale |
1026 | data. Instead, you must first install one of the locale packages | |
85e57214 LC |
1027 | available with Guix and then define the @code{GUIX_LOCPATH} environment |
1028 | variable: | |
0e2d0213 LC |
1029 | |
1030 | @example | |
1031 | $ guix package -i glibc-locales | |
85e57214 | 1032 | $ export GUIX_LOCPATH=$HOME/.guix-profile/lib/locale |
0e2d0213 LC |
1033 | @end example |
1034 | ||
1035 | Note that the @code{glibc-locales} package contains data for all the | |
1036 | locales supported by the GNU@tie{}libc and weighs in at around | |
1037 | 110@tie{}MiB. Alternately, the @code{glibc-utf8-locales} is smaller but | |
1038 | limited to a few UTF-8 locales. | |
1039 | ||
85e57214 LC |
1040 | The @code{GUIX_LOCPATH} variable plays a role similar to @code{LOCPATH} |
1041 | (@pxref{Locale Names, @code{LOCPATH},, libc, The GNU C Library Reference | |
1042 | Manual}). There are two important differences though: | |
1043 | ||
1044 | @enumerate | |
1045 | @item | |
1046 | @code{GUIX_LOCPATH} is honored only by Guix's libc, and not by the libc | |
1047 | provided by foreign distros. Thus, using @code{GUIX_LOCPATH} allows you | |
f9b9a033 | 1048 | to make sure the foreign distro's programs will not end up loading |
85e57214 LC |
1049 | incompatible locale data. |
1050 | ||
1051 | @item | |
1052 | libc suffixes each entry of @code{GUIX_LOCPATH} with @code{/X.Y}, where | |
1053 | @code{X.Y} is the libc version---e.g., @code{2.22}. This means that, | |
1054 | should your Guix profile contain a mixture of programs linked against | |
1055 | different libc version, each libc version will only try to load locale | |
1056 | data in the right format. | |
1057 | @end enumerate | |
1058 | ||
1059 | This is important because the locale data format used by different libc | |
1060 | versions may be incompatible. | |
1061 | ||
0e2d0213 LC |
1062 | @subsection X11 Fonts |
1063 | ||
4988dd40 | 1064 | The majority of graphical applications use Fontconfig to locate and |
0e2d0213 LC |
1065 | load fonts and perform X11-client-side rendering. Guix's |
1066 | @code{fontconfig} package looks for fonts in @file{$HOME/.guix-profile} | |
1067 | by default. Thus, to allow graphical applications installed with Guix | |
1068 | to display fonts, you will have to install fonts with Guix as well. | |
1069 | Essential font packages include @code{gs-fonts}, @code{font-dejavu}, and | |
8fe5b1d1 | 1070 | @code{font-gnu-freefont-ttf}. |
0e2d0213 | 1071 | |
5c36edc8 LC |
1072 | To display text written in Chinese languages, Japanese, or Korean in |
1073 | graphical applications, consider installing | |
1074 | @code{font-adobe-source-han-sans} or @code{font-wqy-zenhei}. The former | |
1075 | has multiple outputs, one per language family (@pxref{Packages with | |
1076 | Multiple Outputs}). For instance, the following command installs fonts | |
1077 | for Chinese languages: | |
1078 | ||
1079 | @example | |
1080 | guix package -i font-adobe-source-han-sans:cn | |
1081 | @end example | |
1082 | ||
6d97319c AK |
1083 | @subsection Emacs Packages |
1084 | ||
1085 | When you install Emacs packages with Guix, the elisp files may be placed | |
1086 | either in @file{$HOME/.guix-profile/share/emacs/site-lisp/} or in | |
1087 | sub-directories of | |
1088 | @file{$HOME/.guix-profile/share/emacs/site-lisp/guix.d/}. The latter | |
1089 | directory exists because potentially there may exist thousands of Emacs | |
1090 | packages and storing all their files in a single directory may be not | |
1091 | reliable (because of name conflicts). So we think using a separate | |
1092 | directory for each package is a good idea. It is very similar to how | |
1093 | the Emacs package system organizes the file structure (@pxref{Package | |
1094 | Files,,, emacs, The GNU Emacs Manual}). | |
1095 | ||
1096 | By default, Emacs (installed with Guix) ``knows'' where these packages | |
1097 | are placed, so you don't need to perform any configuration. If, for | |
1098 | some reason, you want to avoid auto-loading Emacs packages installed | |
1099 | with Guix, you can do it by running Emacs with @code{--no-site-file} | |
1100 | option (@pxref{Init File,,, emacs, The GNU Emacs Manual}). | |
1101 | ||
0e2d0213 LC |
1102 | @c TODO What else? |
1103 | ||
eeaf4427 LC |
1104 | @c ********************************************************************* |
1105 | @node Package Management | |
1106 | @chapter Package Management | |
1107 | ||
f8348b91 | 1108 | The purpose of GNU Guix is to allow users to easily install, upgrade, and |
eeaf4427 LC |
1109 | remove software packages, without having to know about their build |
1110 | procedure or dependencies. Guix also goes beyond this obvious set of | |
1111 | features. | |
1112 | ||
1113 | This chapter describes the main features of Guix, as well as the package | |
c1941588 | 1114 | management tools it provides. Two user interfaces are provided for |
c554de89 AK |
1115 | routine package management tasks: A command-line interface described below |
1116 | (@pxref{Invoking guix package, @code{guix package}}), as well as a visual user | |
1117 | interface in Emacs described in a subsequent chapter (@pxref{Emacs Interface}). | |
eeaf4427 LC |
1118 | |
1119 | @menu | |
1120 | * Features:: How Guix will make your life brighter. | |
e49951eb | 1121 | * Invoking guix package:: Package installation, removal, etc. |
c4202d60 | 1122 | * Substitutes:: Downloading pre-built binaries. |
760c60d6 | 1123 | * Packages with Multiple Outputs:: Single source package, multiple outputs. |
e49951eb | 1124 | * Invoking guix gc:: Running the garbage collector. |
f651b477 | 1125 | * Invoking guix pull:: Fetching the latest Guix and distribution. |
760c60d6 | 1126 | * Invoking guix archive:: Exporting and importing store files. |
eeaf4427 LC |
1127 | @end menu |
1128 | ||
1129 | @node Features | |
1130 | @section Features | |
1131 | ||
1132 | When using Guix, each package ends up in the @dfn{package store}, in its | |
1133 | own directory---something that resembles | |
9a130e19 AK |
1134 | @file{/gnu/store/xxx-package-1.2}, where @code{xxx} is a base32 string |
1135 | (note that Guix comes with an Emacs extension to shorten those file | |
081145cf | 1136 | names, @pxref{Emacs Prettify}.) |
eeaf4427 LC |
1137 | |
1138 | Instead of referring to these directories, users have their own | |
1139 | @dfn{profile}, which points to the packages that they actually want to | |
821b0015 LC |
1140 | use. These profiles are stored within each user's home directory, at |
1141 | @code{$HOME/.guix-profile}. | |
eeaf4427 | 1142 | |
821b0015 | 1143 | For example, @code{alice} installs GCC 4.7.2. As a result, |
eeaf4427 | 1144 | @file{/home/alice/.guix-profile/bin/gcc} points to |
834129e0 | 1145 | @file{/gnu/store/@dots{}-gcc-4.7.2/bin/gcc}. Now, on the same machine, |
821b0015 LC |
1146 | @code{bob} had already installed GCC 4.8.0. The profile of @code{bob} |
1147 | simply continues to point to | |
834129e0 | 1148 | @file{/gnu/store/@dots{}-gcc-4.8.0/bin/gcc}---i.e., both versions of GCC |
821b0015 | 1149 | coexist on the same system without any interference. |
eeaf4427 | 1150 | |
e49951eb MW |
1151 | The @command{guix package} command is the central tool to manage |
1152 | packages (@pxref{Invoking guix package}). It operates on those per-user | |
821b0015 | 1153 | profiles, and can be used @emph{with normal user privileges}. |
eeaf4427 LC |
1154 | |
1155 | The command provides the obvious install, remove, and upgrade | |
1156 | operations. Each invocation is actually a @emph{transaction}: either | |
ba55b1cb | 1157 | the specified operation succeeds, or nothing happens. Thus, if the |
e49951eb | 1158 | @command{guix package} process is terminated during the transaction, |
eeaf4427 LC |
1159 | or if a power outage occurs during the transaction, then the user's |
1160 | profile remains in its previous state, and remains usable. | |
1161 | ||
1162 | In addition, any package transaction may be @emph{rolled back}. So, if, | |
1163 | for example, an upgrade installs a new version of a package that turns | |
1164 | out to have a serious bug, users may roll back to the previous instance | |
4af2447e LC |
1165 | of their profile, which was known to work well. Similarly, the global |
1166 | system configuration is subject to transactional upgrades and roll-back | |
1167 | (@pxref{Using the Configuration System}). | |
eeaf4427 LC |
1168 | |
1169 | All those packages in the package store may be @emph{garbage-collected}. | |
1170 | Guix can determine which packages are still referenced by the user | |
fe8ff028 | 1171 | profiles, and remove those that are provably no longer referenced |
e49951eb | 1172 | (@pxref{Invoking guix gc}). Users may also explicitly remove old |
fe8ff028 LC |
1173 | generations of their profile so that the packages they refer to can be |
1174 | collected. | |
eeaf4427 | 1175 | |
e900c503 LC |
1176 | @cindex reproducibility |
1177 | @cindex reproducible builds | |
eeaf4427 LC |
1178 | Finally, Guix takes a @dfn{purely functional} approach to package |
1179 | management, as described in the introduction (@pxref{Introduction}). | |
834129e0 | 1180 | Each @file{/gnu/store} package directory name contains a hash of all the |
eeaf4427 LC |
1181 | inputs that were used to build that package---compiler, libraries, build |
1182 | scripts, etc. This direct correspondence allows users to make sure a | |
1183 | given package installation matches the current state of their | |
e900c503 LC |
1184 | distribution. It also helps maximize @dfn{build reproducibility}: |
1185 | thanks to the isolated build environments that are used, a given build | |
1186 | is likely to yield bit-identical files when performed on different | |
1187 | machines (@pxref{Invoking guix-daemon, container}). | |
eeaf4427 | 1188 | |
c4202d60 | 1189 | @cindex substitutes |
eeaf4427 | 1190 | This foundation allows Guix to support @dfn{transparent binary/source |
c4202d60 | 1191 | deployment}. When a pre-built binary for a @file{/gnu/store} item is |
18f2887b | 1192 | available from an external source---a @dfn{substitute}, Guix just |
c4202d60 LC |
1193 | downloads it and unpacks it; |
1194 | otherwise, it builds the package from source, locally | |
1195 | (@pxref{Substitutes}). | |
eeaf4427 | 1196 | |
f5fd4fd2 LC |
1197 | Control over the build environment is a feature that is also useful for |
1198 | developers. The @command{guix environment} command allows developers of | |
1199 | a package to quickly set up the right development environment for their | |
1200 | package, without having to manually install the package's dependencies | |
1201 | in their profile (@pxref{Invoking guix environment}). | |
1202 | ||
e49951eb MW |
1203 | @node Invoking guix package |
1204 | @section Invoking @command{guix package} | |
eeaf4427 | 1205 | |
e49951eb | 1206 | The @command{guix package} command is the tool that allows users to |
eeaf4427 LC |
1207 | install, upgrade, and remove packages, as well as rolling back to |
1208 | previous configurations. It operates only on the user's own profile, | |
1209 | and works with normal user privileges (@pxref{Features}). Its syntax | |
1210 | is: | |
1211 | ||
1212 | @example | |
e49951eb | 1213 | guix package @var{options} |
eeaf4427 LC |
1214 | @end example |
1215 | ||
ba55b1cb | 1216 | Primarily, @var{options} specifies the operations to be performed during |
eeaf4427 | 1217 | the transaction. Upon completion, a new profile is created, but |
99bd74d5 | 1218 | previous @dfn{generations} of the profile remain available, should the user |
eeaf4427 LC |
1219 | want to roll back. |
1220 | ||
6447738c MW |
1221 | For example, to remove @code{lua} and install @code{guile} and |
1222 | @code{guile-cairo} in a single transaction: | |
1223 | ||
1224 | @example | |
1225 | guix package -r lua -i guile guile-cairo | |
1226 | @end example | |
1227 | ||
99bd74d5 LC |
1228 | @command{guix package} also supports a @dfn{declarative approach} |
1229 | whereby the user specifies the exact set of packages to be available and | |
1230 | passes it @i{via} the @option{--manifest} option | |
1231 | (@pxref{profile-manifest, @option{--manifest}}). | |
1232 | ||
b9e5c0a9 | 1233 | For each user, a symlink to the user's default profile is automatically |
0ec1af59 | 1234 | created in @file{$HOME/.guix-profile}. This symlink always points to the |
b9e5c0a9 LC |
1235 | current generation of the user's default profile. Thus, users can add |
1236 | @file{$HOME/.guix-profile/bin} to their @code{PATH} environment | |
1237 | variable, and so on. | |
d664f1b4 LC |
1238 | @cindex search paths |
1239 | If you are not using the Guix System Distribution, consider adding the | |
1240 | following lines to your @file{~/.bash_profile} (@pxref{Bash Startup | |
1241 | Files,,, bash, The GNU Bash Reference Manual}) so that newly-spawned | |
1242 | shells get all the right environment variable definitions: | |
1243 | ||
1244 | @example | |
1245 | GUIX_PROFILE="$HOME/.guix-profile" \ | |
1246 | source "$HOME/.guix-profile/etc/profile" | |
1247 | @end example | |
b9e5c0a9 | 1248 | |
4379c35b LC |
1249 | In a multi-user setup, user profiles are stored in a place registered as |
1250 | a @dfn{garbage-collector root}, which @file{$HOME/.guix-profile} points | |
1251 | to (@pxref{Invoking guix gc}). That directory is normally | |
0ec1af59 LC |
1252 | @code{@var{localstatedir}/profiles/per-user/@var{user}}, where |
1253 | @var{localstatedir} is the value passed to @code{configure} as | |
4379c35b LC |
1254 | @code{--localstatedir}, and @var{user} is the user name. The |
1255 | @file{per-user} directory is created when @command{guix-daemon} is | |
1256 | started, and the @var{user} sub-directory is created by @command{guix | |
1257 | package}. | |
0ec1af59 LC |
1258 | |
1259 | The @var{options} can be among the following: | |
1260 | ||
eeaf4427 LC |
1261 | @table @code |
1262 | ||
6447738c MW |
1263 | @item --install=@var{package} @dots{} |
1264 | @itemx -i @var{package} @dots{} | |
1265 | Install the specified @var{package}s. | |
eeaf4427 | 1266 | |
6447738c | 1267 | Each @var{package} may specify either a simple package name, such as |
eeaf4427 | 1268 | @code{guile}, or a package name followed by a hyphen and version number, |
724311a2 LC |
1269 | such as @code{guile-1.8.8} or simply @code{guile-1.8} (in the latter |
1270 | case, the newest version prefixed by @code{1.8} is selected.) | |
1271 | ||
1272 | If no version number is specified, the | |
dc5669cd MW |
1273 | newest available version will be selected. In addition, @var{package} |
1274 | may contain a colon, followed by the name of one of the outputs of the | |
6e721c4d | 1275 | package, as in @code{gcc:doc} or @code{binutils-2.22:lib} |
e7f34eb0 LC |
1276 | (@pxref{Packages with Multiple Outputs}). Packages with a corresponding |
1277 | name (and optionally version) are searched for among the GNU | |
1278 | distribution modules (@pxref{Package Modules}). | |
eeaf4427 | 1279 | |
461572cc LC |
1280 | @cindex propagated inputs |
1281 | Sometimes packages have @dfn{propagated inputs}: these are dependencies | |
21461f27 LC |
1282 | that automatically get installed along with the required package |
1283 | (@pxref{package-propagated-inputs, @code{propagated-inputs} in | |
1284 | @code{package} objects}, for information about propagated inputs in | |
1285 | package definitions). | |
461572cc | 1286 | |
21461f27 | 1287 | @anchor{package-cmd-propagated-inputs} |
461572cc LC |
1288 | An example is the GNU MPC library: its C header files refer to those of |
1289 | the GNU MPFR library, which in turn refer to those of the GMP library. | |
1290 | Thus, when installing MPC, the MPFR and GMP libraries also get installed | |
1291 | in the profile; removing MPC also removes MPFR and GMP---unless they had | |
1292 | also been explicitly installed independently. | |
1293 | ||
ba7ea5ce | 1294 | Besides, packages sometimes rely on the definition of environment |
5924080d | 1295 | variables for their search paths (see explanation of |
ba7ea5ce | 1296 | @code{--search-paths} below). Any missing or possibly incorrect |
5924080d LC |
1297 | environment variable definitions are reported here. |
1298 | ||
ef010c0f | 1299 | @c XXX: keep me up-to-date |
5924080d | 1300 | Finally, when installing a GNU package, the tool reports the |
ef010c0f LC |
1301 | availability of a newer upstream version. In the future, it may provide |
1302 | the option of installing directly from the upstream version, even if | |
1303 | that version is not yet in the distribution. | |
1304 | ||
5d4b411f LC |
1305 | @item --install-from-expression=@var{exp} |
1306 | @itemx -e @var{exp} | |
1307 | Install the package @var{exp} evaluates to. | |
1308 | ||
1309 | @var{exp} must be a Scheme expression that evaluates to a | |
1310 | @code{<package>} object. This option is notably useful to disambiguate | |
1311 | between same-named variants of a package, with expressions such as | |
1312 | @code{(@@ (gnu packages base) guile-final)}. | |
1313 | ||
1314 | Note that this option installs the first output of the specified | |
1315 | package, which may be insufficient when needing a specific output of a | |
1316 | multiple-output package. | |
1317 | ||
0d279400 DT |
1318 | @item --install-from-file=@var{file} |
1319 | @itemx -f @var{file} | |
1320 | Install the package that the code within @var{file} evaluates to. | |
1321 | ||
1322 | As an example, @var{file} might contain a definition like this | |
1323 | (@pxref{Defining Packages}): | |
1324 | ||
1325 | @example | |
1326 | @verbatiminclude package-hello.scm | |
1327 | @end example | |
1328 | ||
1329 | Developers may find it useful to include such a @file{package.scm} file | |
1330 | in the root of their project's source tree that can be used to test | |
1331 | development snapshots and create reproducible development environments | |
1332 | (@pxref{Invoking guix environment}). | |
1333 | ||
6447738c MW |
1334 | @item --remove=@var{package} @dots{} |
1335 | @itemx -r @var{package} @dots{} | |
1336 | Remove the specified @var{package}s. | |
eeaf4427 | 1337 | |
6447738c | 1338 | As for @code{--install}, each @var{package} may specify a version number |
13ed095c LC |
1339 | and/or output name in addition to the package name. For instance, |
1340 | @code{-r glibc:debug} would remove the @code{debug} output of | |
1341 | @code{glibc}. | |
1342 | ||
6447738c MW |
1343 | @item --upgrade[=@var{regexp} @dots{}] |
1344 | @itemx -u [@var{regexp} @dots{}] | |
1345 | Upgrade all the installed packages. If one or more @var{regexp}s are | |
1346 | specified, upgrade only installed packages whose name matches a | |
d5f01e48 | 1347 | @var{regexp}. Also see the @code{--do-not-upgrade} option below. |
eeaf4427 | 1348 | |
f651b477 LC |
1349 | Note that this upgrades package to the latest version of packages found |
1350 | in the distribution currently installed. To update your distribution, | |
1351 | you should regularly run @command{guix pull} (@pxref{Invoking guix | |
1352 | pull}). | |
1353 | ||
d5f01e48 MW |
1354 | @item --do-not-upgrade[=@var{regexp} @dots{}] |
1355 | When used together with the @code{--upgrade} option, do @emph{not} | |
1356 | upgrade any packages whose name matches a @var{regexp}. For example, to | |
1357 | upgrade all packages in the current profile except those containing the | |
1358 | substring ``emacs'': | |
1359 | ||
1360 | @example | |
1361 | $ guix package --upgrade . --do-not-upgrade emacs | |
1362 | @end example | |
1363 | ||
99bd74d5 | 1364 | @item @anchor{profile-manifest}--manifest=@var{file} |
1b676447 | 1365 | @itemx -m @var{file} |
99bd74d5 LC |
1366 | @cindex profile declaration |
1367 | @cindex profile manifest | |
1368 | Create a new generation of the profile from the manifest object | |
1b676447 DT |
1369 | returned by the Scheme code in @var{file}. |
1370 | ||
99bd74d5 LC |
1371 | This allows you to @emph{declare} the profile's contents rather than |
1372 | constructing it through a sequence of @code{--install} and similar | |
1373 | commands. The advantage is that @var{file} can be put under version | |
1374 | control, copied to different machines to reproduce the same profile, and | |
1375 | so on. | |
1376 | ||
1377 | @c FIXME: Add reference to (guix profile) documentation when available. | |
1378 | @var{file} must return a @dfn{manifest} object, which is roughly a list | |
1379 | of packages: | |
1b676447 | 1380 | |
99bd74d5 | 1381 | @findex packages->manifest |
1b676447 | 1382 | @example |
99bd74d5 | 1383 | (use-package-modules guile emacs) |
1b676447 DT |
1384 | |
1385 | (packages->manifest | |
99bd74d5 LC |
1386 | (list emacs |
1387 | guile-2.0 | |
1b676447 | 1388 | ;; Use a specific package output. |
99bd74d5 | 1389 | (list guile-2.0 "debug"))) |
1b676447 DT |
1390 | @end example |
1391 | ||
24e262f0 LC |
1392 | @item --roll-back |
1393 | Roll back to the previous @dfn{generation} of the profile---i.e., undo | |
1394 | the last transaction. | |
1395 | ||
1396 | When combined with options such as @code{--install}, roll back occurs | |
1397 | before any other actions. | |
1398 | ||
d9307267 | 1399 | When rolling back from the first generation that actually contains |
4b2bc804 NK |
1400 | installed packages, the profile is made to point to the @dfn{zeroth |
1401 | generation}, which contains no files apart from its own meta-data. | |
d9307267 | 1402 | |
82fe08ed LC |
1403 | Installing, removing, or upgrading packages from a generation that has |
1404 | been rolled back to overwrites previous future generations. Thus, the | |
1405 | history of a profile's generations is always linear. | |
1406 | ||
b3bb82f1 AK |
1407 | @item --switch-generation=@var{pattern} |
1408 | @itemx -S @var{pattern} | |
1409 | Switch to a particular generation defined by @var{pattern}. | |
1410 | ||
1411 | @var{pattern} may be either a generation number or a number prefixed | |
1412 | with ``+'' or ``-''. The latter means: move forward/backward by a | |
1413 | specified number of generations. For example, if you want to return to | |
1414 | the latest generation after @code{--roll-back}, use | |
1415 | @code{--switch-generation=+1}. | |
1416 | ||
1417 | The difference between @code{--roll-back} and | |
1418 | @code{--switch-generation=-1} is that @code{--switch-generation} will | |
1419 | not make a zeroth generation, so if a specified generation does not | |
1420 | exist, the current generation will not be changed. | |
1421 | ||
dbc31ab2 | 1422 | @item --search-paths[=@var{kind}] |
5924080d LC |
1423 | @cindex search paths |
1424 | Report environment variable definitions, in Bash syntax, that may be | |
1425 | needed in order to use the set of installed packages. These environment | |
1426 | variables are used to specify @dfn{search paths} for files used by some | |
1427 | of the installed packages. | |
1428 | ||
1429 | For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH} | |
1430 | environment variables to be defined so it can look for headers and | |
1431 | libraries in the user's profile (@pxref{Environment Variables,,, gcc, | |
1432 | Using the GNU Compiler Collection (GCC)}). If GCC and, say, the C | |
1433 | library are installed in the profile, then @code{--search-paths} will | |
1434 | suggest setting these variables to @code{@var{profile}/include} and | |
1435 | @code{@var{profile}/lib}, respectively. | |
1436 | ||
dbc31ab2 LC |
1437 | The typical use case is to define these environment variables in the |
1438 | shell: | |
1439 | ||
1440 | @example | |
1441 | $ eval `guix package --search-paths` | |
1442 | @end example | |
1443 | ||
1444 | @var{kind} may be one of @code{exact}, @code{prefix}, or @code{suffix}, | |
1445 | meaning that the returned environment variable definitions will either | |
1446 | be exact settings, or prefixes or suffixes of the current value of these | |
1447 | variables. When omitted, @var{kind} defaults to @code{exact}. | |
1448 | ||
fc2d2339 LC |
1449 | This option can also be used to compute the @emph{combined} search paths |
1450 | of several profiles. Consider this example: | |
1451 | ||
1452 | @example | |
1453 | $ guix package -p foo -i guile | |
1454 | $ guix package -p bar -i guile-json | |
1455 | $ guix package -p foo -p bar --search-paths | |
1456 | @end example | |
1457 | ||
1458 | The last command above reports about the @code{GUILE_LOAD_PATH} | |
1459 | variable, even though, taken individually, neither @file{foo} nor | |
1460 | @file{bar} would lead to that recommendation. | |
1461 | ||
1462 | ||
eeaf4427 LC |
1463 | @item --profile=@var{profile} |
1464 | @itemx -p @var{profile} | |
1465 | Use @var{profile} instead of the user's default profile. | |
1466 | ||
70915c1a LC |
1467 | @item --verbose |
1468 | Produce verbose output. In particular, emit the environment's build log | |
1469 | on the standard error port. | |
1470 | ||
eeaf4427 LC |
1471 | @item --bootstrap |
1472 | Use the bootstrap Guile to build the profile. This option is only | |
1473 | useful to distribution developers. | |
1474 | ||
1475 | @end table | |
1476 | ||
e49951eb | 1477 | In addition to these actions @command{guix package} supports the |
733b4130 LC |
1478 | following options to query the current state of a profile, or the |
1479 | availability of packages: | |
eeaf4427 | 1480 | |
733b4130 LC |
1481 | @table @option |
1482 | ||
acc08466 NK |
1483 | @item --search=@var{regexp} |
1484 | @itemx -s @var{regexp} | |
b110869d | 1485 | @cindex searching for packages |
5763ad92 | 1486 | List the available packages whose name, synopsis, or description matches |
299112d3 LC |
1487 | @var{regexp}. Print all the meta-data of matching packages in |
1488 | @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, | |
1489 | GNU recutils manual}). | |
acc08466 | 1490 | |
299112d3 LC |
1491 | This allows specific fields to be extracted using the @command{recsel} |
1492 | command, for instance: | |
1493 | ||
1494 | @example | |
e49951eb | 1495 | $ guix package -s malloc | recsel -p name,version |
299112d3 LC |
1496 | name: glibc |
1497 | version: 2.17 | |
1498 | ||
1499 | name: libgc | |
1500 | version: 7.2alpha6 | |
1501 | @end example | |
acc08466 | 1502 | |
a12d92f5 LC |
1503 | Similarly, to show the name of all the packages available under the |
1504 | terms of the GNU@tie{}LGPL version 3: | |
1505 | ||
1506 | @example | |
1507 | $ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"' | |
1508 | name: elfutils | |
1509 | ||
1510 | name: gmp | |
1511 | @dots{} | |
1512 | @end example | |
1513 | ||
db5a9444 LC |
1514 | It is also possible to refine search results using several @code{-s} |
1515 | flags. For example, the following command returns a list of board | |
1516 | games: | |
1517 | ||
1518 | @example | |
1519 | $ guix package -s '\<board\>' -s game | recsel -p name | |
1520 | name: gnubg | |
1521 | @dots{} | |
1522 | @end example | |
1523 | ||
1524 | If we were to omit @code{-s game}, we would also get software packages | |
1525 | that deal with printed circuit boards; removing the angle brackets | |
1526 | around @code{board} would further add packages that have to do with | |
1527 | keyboards. | |
1528 | ||
b110869d LC |
1529 | And now for a more elaborate example. The following command searches |
1530 | for cryptographic libraries, filters out Haskell, Perl, Python, and Ruby | |
1531 | libraries, and prints the name and synopsis of the matching packages: | |
1532 | ||
1533 | @example | |
1534 | $ guix package -s crypto -s library | \ | |
1535 | recsel -e '! (name ~ "^(ghc|perl|python|ruby)")' -p name,synopsis | |
1536 | @end example | |
1537 | ||
1538 | @noindent | |
1539 | @xref{Selection Expressions,,, recutils, GNU recutils manual}, for more | |
1540 | information on @dfn{selection expressions} for @code{recsel -e}. | |
1541 | ||
2aa6efb0 CR |
1542 | @item --show=@var{package} |
1543 | Show details about @var{package}, taken from the list of available packages, in | |
1544 | @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU | |
1545 | recutils manual}). | |
1546 | ||
1547 | @example | |
1548 | $ guix package --show=python | recsel -p name,version | |
1549 | name: python | |
1550 | version: 2.7.6 | |
1551 | ||
1552 | name: python | |
1553 | version: 3.3.5 | |
1554 | @end example | |
1555 | ||
1556 | You may also specify the full name of a package to only get details about a | |
1557 | specific version of it: | |
1558 | @example | |
1559 | $ guix package --show=python-3.3.5 | recsel -p name,version | |
1560 | name: python | |
1561 | version: 3.3.5 | |
1562 | @end example | |
1563 | ||
1564 | ||
1565 | ||
733b4130 LC |
1566 | @item --list-installed[=@var{regexp}] |
1567 | @itemx -I [@var{regexp}] | |
bd9bde1c LC |
1568 | List the currently installed packages in the specified profile, with the |
1569 | most recently installed packages shown last. When @var{regexp} is | |
1570 | specified, list only installed packages whose name matches @var{regexp}. | |
733b4130 LC |
1571 | |
1572 | For each installed package, print the following items, separated by | |
1573 | tabs: the package name, its version string, the part of the package that | |
1574 | is installed (for instance, @code{out} for the default output, | |
1575 | @code{include} for its headers, etc.), and the path of this package in | |
1576 | the store. | |
1577 | ||
64fc89b6 LC |
1578 | @item --list-available[=@var{regexp}] |
1579 | @itemx -A [@var{regexp}] | |
5763ad92 | 1580 | List packages currently available in the distribution for this system |
a1ba8475 LC |
1581 | (@pxref{GNU Distribution}). When @var{regexp} is specified, list only |
1582 | installed packages whose name matches @var{regexp}. | |
64fc89b6 LC |
1583 | |
1584 | For each package, print the following items separated by tabs: its name, | |
6e721c4d LC |
1585 | its version string, the parts of the package (@pxref{Packages with |
1586 | Multiple Outputs}), and the source location of its definition. | |
64fc89b6 | 1587 | |
f566d765 LC |
1588 | @item --list-generations[=@var{pattern}] |
1589 | @itemx -l [@var{pattern}] | |
1590 | Return a list of generations along with their creation dates; for each | |
1591 | generation, show the installed packages, with the most recently | |
4b2bc804 NK |
1592 | installed packages shown last. Note that the zeroth generation is never |
1593 | shown. | |
f566d765 LC |
1594 | |
1595 | For each installed package, print the following items, separated by | |
1596 | tabs: the name of a package, its version string, the part of the package | |
1597 | that is installed (@pxref{Packages with Multiple Outputs}), and the | |
1598 | location of this package in the store. | |
1599 | ||
1600 | When @var{pattern} is used, the command returns only matching | |
1601 | generations. Valid patterns include: | |
1602 | ||
1603 | @itemize | |
1604 | @item @emph{Integers and comma-separated integers}. Both patterns denote | |
1605 | generation numbers. For instance, @code{--list-generations=1} returns | |
1606 | the first one. | |
1607 | ||
1608 | And @code{--list-generations=1,8,2} outputs three generations in the | |
1609 | specified order. Neither spaces nor trailing commas are allowed. | |
1610 | ||
1611 | @item @emph{Ranges}. @code{--list-generations=2..9} prints the | |
1612 | specified generations and everything in between. Note that the start of | |
1613 | a range must be lesser than its end. | |
1614 | ||
1615 | It is also possible to omit the endpoint. For example, | |
1616 | @code{--list-generations=2..}, returns all generations starting from the | |
1617 | second one. | |
1618 | ||
1619 | @item @emph{Durations}. You can also get the last @emph{N}@tie{}days, weeks, | |
1620 | or months by passing an integer along with the first letter of the | |
d7ddb257 LC |
1621 | duration. For example, @code{--list-generations=20d} lists generations |
1622 | that are up to 20 days old. | |
f566d765 LC |
1623 | @end itemize |
1624 | ||
b7884ca3 NK |
1625 | @item --delete-generations[=@var{pattern}] |
1626 | @itemx -d [@var{pattern}] | |
d7ddb257 LC |
1627 | When @var{pattern} is omitted, delete all generations except the current |
1628 | one. | |
b7884ca3 NK |
1629 | |
1630 | This command accepts the same patterns as @option{--list-generations}. | |
d7ddb257 LC |
1631 | When @var{pattern} is specified, delete the matching generations. When |
1632 | @var{pattern} specifies a duration, generations @emph{older} than the | |
1633 | specified duration match. For instance, @code{--delete-generations=1m} | |
1634 | deletes generations that are more than one month old. | |
1635 | ||
391bdd8f LC |
1636 | If the current generation matches, it is @emph{not} deleted. Also, the |
1637 | zeroth generation is never deleted. | |
b7884ca3 | 1638 | |
1bb9900a LC |
1639 | Note that deleting generations prevents roll-back to them. |
1640 | Consequently, this command must be used with care. | |
1641 | ||
733b4130 | 1642 | @end table |
eeaf4427 | 1643 | |
70ee5642 LC |
1644 | Finally, since @command{guix package} may actually start build |
1645 | processes, it supports all the common build options that @command{guix | |
1646 | build} supports (@pxref{Invoking guix build, common build options}). | |
1647 | ||
c4202d60 LC |
1648 | @node Substitutes |
1649 | @section Substitutes | |
1650 | ||
1651 | @cindex substitutes | |
1652 | @cindex pre-built binaries | |
1653 | Guix supports transparent source/binary deployment, which means that it | |
1654 | can either build things locally, or download pre-built items from a | |
1655 | server. We call these pre-built items @dfn{substitutes}---they are | |
1656 | substitutes for local build results. In many cases, downloading a | |
1657 | substitute is much faster than building things locally. | |
1658 | ||
1659 | Substitutes can be anything resulting from a derivation build | |
1660 | (@pxref{Derivations}). Of course, in the common case, they are | |
1661 | pre-built package binaries, but source tarballs, for instance, which | |
1662 | also result from derivation builds, can be available as substitutes. | |
1663 | ||
1664 | The @code{hydra.gnu.org} server is a front-end to a build farm that | |
1665 | builds packages from the GNU distribution continuously for some | |
32950fc8 AK |
1666 | architectures, and makes them available as substitutes (@pxref{Emacs |
1667 | Hydra}, for information on how to query the continuous integration | |
1668 | server). This is the | |
f8a8e0fe LC |
1669 | default source of substitutes; it can be overridden by passing the |
1670 | @option{--substitute-urls} option either to @command{guix-daemon} | |
1671 | (@pxref{daemon-substitute-urls,, @code{guix-daemon --substitute-urls}}) | |
1672 | or to client tools such as @command{guix package} | |
1673 | (@pxref{client-substitute-urls,, client @option{--substitute-urls} | |
1674 | option}). | |
c4202d60 LC |
1675 | |
1676 | @cindex security | |
1677 | @cindex digital signatures | |
1678 | To allow Guix to download substitutes from @code{hydra.gnu.org}, you | |
1679 | must add its public key to the access control list (ACL) of archive | |
1680 | imports, using the @command{guix archive} command (@pxref{Invoking guix | |
1681 | archive}). Doing so implies that you trust @code{hydra.gnu.org} to not | |
1682 | be compromised and to serve genuine substitutes. | |
1683 | ||
1684 | This public key is installed along with Guix, in | |
1685 | @code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is | |
1686 | the installation prefix of Guix. If you installed Guix from source, | |
1687 | make sure you checked the GPG signature of | |
1688 | @file{guix-@value{VERSION}.tar.gz}, which contains this public key file. | |
1689 | Then, you can run something like this: | |
1690 | ||
1691 | @example | |
1692 | # guix archive --authorize < hydra.gnu.org.pub | |
1693 | @end example | |
1694 | ||
1695 | Once this is in place, the output of a command like @code{guix build} | |
1696 | should change from something like: | |
1697 | ||
1698 | @example | |
1699 | $ guix build emacs --dry-run | |
1700 | The following derivations would be built: | |
1701 | /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv | |
1702 | /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv | |
1703 | /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv | |
1704 | /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv | |
1705 | @dots{} | |
1706 | @end example | |
1707 | ||
1708 | @noindent | |
1709 | to something like: | |
1710 | ||
1711 | @example | |
1712 | $ guix build emacs --dry-run | |
1713 | The following files would be downloaded: | |
1714 | /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3 | |
1715 | /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d | |
1716 | /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16 | |
1717 | /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7 | |
1718 | @dots{} | |
1719 | @end example | |
1720 | ||
1721 | @noindent | |
1722 | This indicates that substitutes from @code{hydra.gnu.org} are usable and | |
1723 | will be downloaded, when possible, for future builds. | |
1724 | ||
1725 | Guix ignores substitutes that are not signed, or that are not signed by | |
ef27aa9c | 1726 | one of the keys listed in the ACL. It also detects and raises an error |
c4202d60 LC |
1727 | when attempting to use a substitute that has been tampered with. |
1728 | ||
e0c941fe LC |
1729 | @vindex http_proxy |
1730 | Substitutes are downloaded over HTTP. The @code{http_proxy} environment | |
1731 | variable can be set in the environment of @command{guix-daemon} and is | |
1732 | honored for downloads of substitutes. Note that the value of | |
1733 | @code{http_proxy} in the environment where @command{guix build}, | |
1734 | @command{guix package}, and other client commands are run has | |
1735 | @emph{absolutely no effect}. | |
1736 | ||
c4202d60 LC |
1737 | The substitute mechanism can be disabled globally by running |
1738 | @code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking | |
1739 | guix-daemon}). It can also be disabled temporarily by passing the | |
1740 | @code{--no-substitutes} option to @command{guix package}, @command{guix | |
1741 | build}, and other command-line tools. | |
1742 | ||
1743 | ||
1744 | Today, each individual's control over their own computing is at the | |
1745 | mercy of institutions, corporations, and groups with enough power and | |
1746 | determination to subvert the computing infrastructure and exploit its | |
1747 | weaknesses. While using @code{hydra.gnu.org} substitutes can be | |
1748 | convenient, we encourage users to also build on their own, or even run | |
1749 | their own build farm, such that @code{hydra.gnu.org} is less of an | |
8ce229fc LC |
1750 | interesting target. One way to help is by publishing the software you |
1751 | build using @command{guix publish} so that others have one more choice | |
1752 | of server to download substitutes from (@pxref{Invoking guix publish}). | |
c4202d60 LC |
1753 | |
1754 | Guix has the foundations to maximize build reproducibility | |
1755 | (@pxref{Features}). In most cases, independent builds of a given | |
1756 | package or derivation should yield bit-identical results. Thus, through | |
1757 | a diverse set of independent package builds, we can strengthen the | |
d23c20f1 LC |
1758 | integrity of our systems. The @command{guix challenge} command aims to |
1759 | help users assess substitute servers, and to assist developers in | |
1760 | finding out about non-deterministic package builds (@pxref{Invoking guix | |
a8d65643 LC |
1761 | challenge}). Similarly, the @option{--check} option of @command{guix |
1762 | build} allows users to check whether previously-installed substitutes | |
1763 | are genuine by rebuilding them locally (@pxref{build-check, | |
1764 | @command{guix build --check}}). | |
c4202d60 LC |
1765 | |
1766 | In the future, we want Guix to have support to publish and retrieve | |
1767 | binaries to/from other users, in a peer-to-peer fashion. If you would | |
1768 | like to discuss this project, join us on @email{guix-devel@@gnu.org}. | |
1769 | ||
1770 | ||
6e721c4d LC |
1771 | @node Packages with Multiple Outputs |
1772 | @section Packages with Multiple Outputs | |
1773 | ||
1774 | @cindex multiple-output packages | |
1775 | @cindex package outputs | |
1776 | ||
1777 | Often, packages defined in Guix have a single @dfn{output}---i.e., the | |
1778 | source package leads exactly one directory in the store. When running | |
1779 | @command{guix package -i glibc}, one installs the default output of the | |
1780 | GNU libc package; the default output is called @code{out}, but its name | |
1781 | can be omitted as shown in this command. In this particular case, the | |
1782 | default output of @code{glibc} contains all the C header files, shared | |
1783 | libraries, static libraries, Info documentation, and other supporting | |
1784 | files. | |
1785 | ||
1786 | Sometimes it is more appropriate to separate the various types of files | |
1787 | produced from a single source package into separate outputs. For | |
1788 | instance, the GLib C library (used by GTK+ and related packages) | |
1789 | installs more than 20 MiB of reference documentation as HTML pages. | |
1790 | To save space for users who do not need it, the documentation goes to a | |
1791 | separate output, called @code{doc}. To install the main GLib output, | |
1792 | which contains everything but the documentation, one would run: | |
1793 | ||
1794 | @example | |
1795 | guix package -i glib | |
1796 | @end example | |
1797 | ||
1798 | The command to install its documentation is: | |
1799 | ||
1800 | @example | |
1801 | guix package -i glib:doc | |
1802 | @end example | |
1803 | ||
1804 | Some packages install programs with different ``dependency footprints''. | |
1805 | For instance, the WordNet package install both command-line tools and | |
1806 | graphical user interfaces (GUIs). The former depend solely on the C | |
1807 | library, whereas the latter depend on Tcl/Tk and the underlying X | |
1808 | libraries. In this case, we leave the command-line tools in the default | |
1809 | output, whereas the GUIs are in a separate output. This allows users | |
fcc58db6 LC |
1810 | who do not need the GUIs to save space. The @command{guix size} command |
1811 | can help find out about such situations (@pxref{Invoking guix size}). | |
88856916 | 1812 | @command{guix graph} can also be helpful (@pxref{Invoking guix graph}). |
6e721c4d LC |
1813 | |
1814 | There are several such multiple-output packages in the GNU distribution. | |
91ef73d4 LC |
1815 | Other conventional output names include @code{lib} for libraries and |
1816 | possibly header files, @code{bin} for stand-alone programs, and | |
1817 | @code{debug} for debugging information (@pxref{Installing Debugging | |
1818 | Files}). The outputs of a packages are listed in the third column of | |
1819 | the output of @command{guix package --list-available} (@pxref{Invoking | |
1820 | guix package}). | |
6e721c4d | 1821 | |
eeaf4427 | 1822 | |
e49951eb MW |
1823 | @node Invoking guix gc |
1824 | @section Invoking @command{guix gc} | |
fe8ff028 LC |
1825 | |
1826 | @cindex garbage collector | |
1827 | Packages that are installed but not used may be @dfn{garbage-collected}. | |
e49951eb | 1828 | The @command{guix gc} command allows users to explicitly run the garbage |
c22eb992 LC |
1829 | collector to reclaim space from the @file{/gnu/store} directory. It is |
1830 | the @emph{only} way to remove files from @file{/gnu/store}---removing | |
1831 | files or directories manually may break it beyond repair! | |
fe8ff028 LC |
1832 | |
1833 | The garbage collector has a set of known @dfn{roots}: any file under | |
834129e0 | 1834 | @file{/gnu/store} reachable from a root is considered @dfn{live} and |
fe8ff028 LC |
1835 | cannot be deleted; any other file is considered @dfn{dead} and may be |
1836 | deleted. The set of garbage collector roots includes default user | |
e49951eb MW |
1837 | profiles, and may be augmented with @command{guix build --root}, for |
1838 | example (@pxref{Invoking guix build}). | |
fe8ff028 | 1839 | |
1bb9900a LC |
1840 | Prior to running @code{guix gc --collect-garbage} to make space, it is |
1841 | often useful to remove old generations from user profiles; that way, old | |
1842 | package builds referenced by those generations can be reclaimed. This | |
1843 | is achieved by running @code{guix package --delete-generations} | |
1844 | (@pxref{Invoking guix package}). | |
1845 | ||
e49951eb | 1846 | The @command{guix gc} command has three modes of operation: it can be |
fe8ff028 | 1847 | used to garbage-collect any dead files (the default), to delete specific |
7770aafc LC |
1848 | files (the @code{--delete} option), to print garbage-collector |
1849 | information, or for more advanced queries. The garbage collection | |
1850 | options are as follows: | |
fe8ff028 LC |
1851 | |
1852 | @table @code | |
1853 | @item --collect-garbage[=@var{min}] | |
1854 | @itemx -C [@var{min}] | |
834129e0 | 1855 | Collect garbage---i.e., unreachable @file{/gnu/store} files and |
fe8ff028 LC |
1856 | sub-directories. This is the default operation when no option is |
1857 | specified. | |
1858 | ||
1859 | When @var{min} is given, stop once @var{min} bytes have been collected. | |
1860 | @var{min} may be a number of bytes, or it may include a unit as a | |
4a44d7bb LC |
1861 | suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes |
1862 | (@pxref{Block size, size specifications,, coreutils, GNU Coreutils}). | |
fe8ff028 LC |
1863 | |
1864 | When @var{min} is omitted, collect all the garbage. | |
1865 | ||
1866 | @item --delete | |
1867 | @itemx -d | |
1868 | Attempt to delete all the store files and directories specified as | |
1869 | arguments. This fails if some of the files are not in the store, or if | |
1870 | they are still live. | |
1871 | ||
30d9aa54 LC |
1872 | @item --list-failures |
1873 | List store items corresponding to cached build failures. | |
1874 | ||
1875 | This prints nothing unless the daemon was started with | |
1876 | @option{--cache-failures} (@pxref{Invoking guix-daemon, | |
1877 | @option{--cache-failures}}). | |
1878 | ||
1879 | @item --clear-failures | |
1880 | Remove the specified store items from the failed-build cache. | |
1881 | ||
1882 | Again, this option only makes sense when the daemon is started with | |
1883 | @option{--cache-failures}. Otherwise, it does nothing. | |
1884 | ||
fe8ff028 LC |
1885 | @item --list-dead |
1886 | Show the list of dead files and directories still present in the | |
1887 | store---i.e., files and directories no longer reachable from any root. | |
1888 | ||
1889 | @item --list-live | |
1890 | Show the list of live store files and directories. | |
ba8b732d LC |
1891 | |
1892 | @end table | |
1893 | ||
1894 | In addition, the references among existing store files can be queried: | |
1895 | ||
1896 | @table @code | |
1897 | ||
1898 | @item --references | |
1899 | @itemx --referrers | |
1900 | List the references (respectively, the referrers) of store files given | |
1901 | as arguments. | |
1902 | ||
8e59fdd5 LC |
1903 | @item --requisites |
1904 | @itemx -R | |
fcc58db6 | 1905 | @cindex closure |
8e59fdd5 LC |
1906 | List the requisites of the store files passed as arguments. Requisites |
1907 | include the store files themselves, their references, and the references | |
1908 | of these, recursively. In other words, the returned list is the | |
1909 | @dfn{transitive closure} of the store files. | |
1910 | ||
fcc58db6 | 1911 | @xref{Invoking guix size}, for a tool to profile the size of an |
88856916 LC |
1912 | element's closure. @xref{Invoking guix graph}, for a tool to visualize |
1913 | the graph of references. | |
fcc58db6 | 1914 | |
fe8ff028 LC |
1915 | @end table |
1916 | ||
7770aafc LC |
1917 | Lastly, the following options allow you to check the integrity of the |
1918 | store and to control disk usage. | |
1919 | ||
1920 | @table @option | |
1921 | ||
1922 | @item --verify[=@var{options}] | |
1923 | @cindex integrity, of the store | |
1924 | @cindex integrity checking | |
1925 | Verify the integrity of the store. | |
1926 | ||
1927 | By default, make sure that all the store items marked as valid in the | |
1928 | daemon's database actually exist in @file{/gnu/store}. | |
1929 | ||
1930 | When provided, @var{options} must a comma-separated list containing one | |
1931 | or more of @code{contents} and @code{repair}. | |
1932 | ||
1933 | When passing @option{--verify=contents}, the daemon will compute the | |
1934 | content hash of each store item and compare it against its hash in the | |
1935 | database. Hash mismatches are reported as data corruptions. Because it | |
1936 | traverses @emph{all the files in the store}, this command can take a | |
1937 | long time, especially on systems with a slow disk drive. | |
1938 | ||
1939 | @cindex repairing the store | |
1940 | Using @option{--verify=repair} or @option{--verify=contents,repair} | |
1941 | causes the daemon to try to repair corrupt store items by fetching | |
1942 | substitutes for them (@pxref{Substitutes}). Because repairing is not | |
1943 | atomic, and thus potentially dangerous, it is available only to the | |
1944 | system administrator. | |
1945 | ||
1946 | @item --optimize | |
1947 | @cindex deduplication | |
1948 | Optimize the store by hard-linking identical files---this is | |
1949 | @dfn{deduplication}. | |
1950 | ||
1951 | The daemon performs deduplication after each successful build or archive | |
1952 | import, unless it was started with @code{--disable-deduplication} | |
1953 | (@pxref{Invoking guix-daemon, @code{--disable-deduplication}}). Thus, | |
1954 | this option is primarily useful when the daemon was running with | |
1955 | @code{--disable-deduplication}. | |
1956 | ||
1957 | @end table | |
eeaf4427 | 1958 | |
f651b477 LC |
1959 | @node Invoking guix pull |
1960 | @section Invoking @command{guix pull} | |
1961 | ||
1962 | Packages are installed or upgraded to the latest version available in | |
1963 | the distribution currently available on your local machine. To update | |
1964 | that distribution, along with the Guix tools, you must run @command{guix | |
1965 | pull}: the command downloads the latest Guix source code and package | |
1966 | descriptions, and deploys it. | |
1967 | ||
1968 | On completion, @command{guix package} will use packages and package | |
1969 | versions from this just-retrieved copy of Guix. Not only that, but all | |
1970 | the Guix commands and Scheme modules will also be taken from that latest | |
1971 | version. New @command{guix} sub-commands added by the update also | |
ef54b61d AV |
1972 | become available@footnote{Under the hood, @command{guix pull} updates |
1973 | the @file{~/.config/guix/latest} symbolic link to point to the latest | |
1974 | Guix, and the @command{guix} command loads code from there.}. | |
f651b477 LC |
1975 | |
1976 | The @command{guix pull} command is usually invoked with no arguments, | |
1977 | but it supports the following options: | |
1978 | ||
1979 | @table @code | |
1980 | @item --verbose | |
1981 | Produce verbose output, writing build logs to the standard error output. | |
1982 | ||
ab5d72ad LC |
1983 | @item --url=@var{url} |
1984 | Download the source tarball of Guix from @var{url}. | |
1985 | ||
1986 | By default, the tarball is taken from its canonical address at | |
1987 | @code{gnu.org}, for the stable branch of Guix. | |
1988 | ||
f651b477 LC |
1989 | @item --bootstrap |
1990 | Use the bootstrap Guile to build the latest Guix. This option is only | |
1991 | useful to Guix developers. | |
1992 | @end table | |
1993 | ||
760c60d6 LC |
1994 | |
1995 | @node Invoking guix archive | |
1996 | @section Invoking @command{guix archive} | |
1997 | ||
1998 | The @command{guix archive} command allows users to @dfn{export} files | |
1999 | from the store into a single archive, and to later @dfn{import} them. | |
2000 | In particular, it allows store files to be transferred from one machine | |
2001 | to another machine's store. For example, to transfer the @code{emacs} | |
2002 | package to a machine connected over SSH, one would run: | |
2003 | ||
2004 | @example | |
56607088 | 2005 | guix archive --export -r emacs | ssh the-machine guix archive --import |
760c60d6 LC |
2006 | @end example |
2007 | ||
87236aed | 2008 | @noindent |
56607088 LC |
2009 | Similarly, a complete user profile may be transferred from one machine |
2010 | to another like this: | |
2011 | ||
2012 | @example | |
2013 | guix archive --export -r $(readlink -f ~/.guix-profile) | \ | |
2014 | ssh the-machine guix-archive --import | |
2015 | @end example | |
2016 | ||
2017 | @noindent | |
2018 | However, note that, in both examples, all of @code{emacs} and the | |
2019 | profile as well as all of their dependencies are transferred (due to | |
2020 | @code{-r}), regardless of what is already available in the target | |
2021 | machine's store. The @code{--missing} option can help figure out which | |
2022 | items are missing from the target's store. | |
87236aed | 2023 | |
760c60d6 | 2024 | Archives are stored in the ``Nix archive'' or ``Nar'' format, which is |
0dbd88db LC |
2025 | comparable in spirit to `tar', but with a few noteworthy differences |
2026 | that make it more appropriate for our purposes. First, rather than | |
2027 | recording all Unix meta-data for each file, the Nar format only mentions | |
2028 | the file type (regular, directory, or symbolic link); Unix permissions | |
2029 | and owner/group are dismissed. Second, the order in which directory | |
2030 | entries are stored always follows the order of file names according to | |
2031 | the C locale collation order. This makes archive production fully | |
2032 | deterministic. | |
2033 | ||
2034 | When exporting, the daemon digitally signs the contents of the archive, | |
2035 | and that digital signature is appended. When importing, the daemon | |
2036 | verifies the signature and rejects the import in case of an invalid | |
2037 | signature or if the signing key is not authorized. | |
760c60d6 LC |
2038 | @c FIXME: Add xref to daemon doc about signatures. |
2039 | ||
2040 | The main options are: | |
2041 | ||
2042 | @table @code | |
2043 | @item --export | |
2044 | Export the specified store files or packages (see below.) Write the | |
2045 | resulting archive to the standard output. | |
2046 | ||
56607088 LC |
2047 | Dependencies are @emph{not} included in the output, unless |
2048 | @code{--recursive} is passed. | |
2049 | ||
2050 | @item -r | |
2051 | @itemx --recursive | |
2052 | When combined with @code{--export}, this instructs @command{guix | |
2053 | archive} to include dependencies of the given items in the archive. | |
2054 | Thus, the resulting archive is self-contained: it contains the closure | |
2055 | of the exported store items. | |
2056 | ||
760c60d6 LC |
2057 | @item --import |
2058 | Read an archive from the standard input, and import the files listed | |
2059 | therein into the store. Abort if the archive has an invalid digital | |
f82cc5fd LC |
2060 | signature, or if it is signed by a public key not among the authorized |
2061 | keys (see @code{--authorize} below.) | |
554f26ec | 2062 | |
87236aed LC |
2063 | @item --missing |
2064 | Read a list of store file names from the standard input, one per line, | |
2065 | and write on the standard output the subset of these files missing from | |
2066 | the store. | |
2067 | ||
554f26ec | 2068 | @item --generate-key[=@var{parameters}] |
f82cc5fd | 2069 | @cindex signing, archives |
554f26ec LC |
2070 | Generate a new key pair for the daemons. This is a prerequisite before |
2071 | archives can be exported with @code{--export}. Note that this operation | |
2072 | usually takes time, because it needs to gather enough entropy to | |
2073 | generate the key pair. | |
2074 | ||
2075 | The generated key pair is typically stored under @file{/etc/guix}, in | |
2076 | @file{signing-key.pub} (public key) and @file{signing-key.sec} (private | |
867d8473 LC |
2077 | key, which must be kept secret.) When @var{parameters} is omitted, |
2078 | an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt | |
2079 | versions before 1.6.0, it is a 4096-bit RSA key. | |
2080 | Alternately, @var{parameters} can specify | |
554f26ec LC |
2081 | @code{genkey} parameters suitable for Libgcrypt (@pxref{General |
2082 | public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The | |
2083 | Libgcrypt Reference Manual}). | |
f82cc5fd LC |
2084 | |
2085 | @item --authorize | |
2086 | @cindex authorizing, archives | |
2087 | Authorize imports signed by the public key passed on standard input. | |
2088 | The public key must be in ``s-expression advanced format''---i.e., the | |
2089 | same format as the @file{signing-key.pub} file. | |
2090 | ||
2091 | The list of authorized keys is kept in the human-editable file | |
2092 | @file{/etc/guix/acl}. The file contains | |
2093 | @url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format | |
2094 | s-expressions''} and is structured as an access-control list in the | |
2095 | @url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure | |
2096 | (SPKI)}. | |
c6f8e9dd LC |
2097 | |
2098 | @item --extract=@var{directory} | |
2099 | @itemx -x @var{directory} | |
2100 | Read a single-item archive as served by substitute servers | |
2101 | (@pxref{Substitutes}) and extract it to @var{directory}. This is a | |
2102 | low-level operation needed in only very narrow use cases; see below. | |
2103 | ||
2104 | For example, the following command extracts the substitute for Emacs | |
2105 | served by @code{hydra.gnu.org} to @file{/tmp/emacs}: | |
2106 | ||
2107 | @example | |
2108 | $ wget -O - \ | |
2109 | http://hydra.gnu.org/nar/@dots{}-emacs-24.5 \ | |
2110 | | bunzip2 | guix archive -x /tmp/emacs | |
2111 | @end example | |
2112 | ||
2113 | Single-item archives are different from multiple-item archives produced | |
2114 | by @command{guix archive --export}; they contain a single store item, | |
2115 | and they do @emph{not} embed a signature. Thus this operation does | |
2116 | @emph{no} signature verification and its output should be considered | |
2117 | unsafe. | |
2118 | ||
2119 | The primary purpose of this operation is to facilitate inspection of | |
2120 | archive contents coming from possibly untrusted substitute servers. | |
2121 | ||
760c60d6 LC |
2122 | @end table |
2123 | ||
2124 | To export store files as an archive to the standard output, run: | |
2125 | ||
2126 | @example | |
2127 | guix archive --export @var{options} @var{specifications}... | |
2128 | @end example | |
2129 | ||
2130 | @var{specifications} may be either store file names or package | |
2131 | specifications, as for @command{guix package} (@pxref{Invoking guix | |
2132 | package}). For instance, the following command creates an archive | |
2133 | containing the @code{gui} output of the @code{git} package and the main | |
2134 | output of @code{emacs}: | |
2135 | ||
2136 | @example | |
834129e0 | 2137 | guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar |
760c60d6 LC |
2138 | @end example |
2139 | ||
2140 | If the specified packages are not built yet, @command{guix archive} | |
2141 | automatically builds them. The build process may be controlled with the | |
2142 | same options that can be passed to the @command{guix build} command | |
70ee5642 | 2143 | (@pxref{Invoking guix build, common build options}). |
760c60d6 | 2144 | |
c554de89 AK |
2145 | @c ********************************************************************* |
2146 | @include emacs.texi | |
760c60d6 | 2147 | |
568717fd LC |
2148 | @c ********************************************************************* |
2149 | @node Programming Interface | |
2150 | @chapter Programming Interface | |
2151 | ||
3dc1970d LC |
2152 | GNU Guix provides several Scheme programming interfaces (APIs) to |
2153 | define, build, and query packages. The first interface allows users to | |
2154 | write high-level package definitions. These definitions refer to | |
2155 | familiar packaging concepts, such as the name and version of a package, | |
2156 | its build system, and its dependencies. These definitions can then be | |
2157 | turned into concrete build actions. | |
2158 | ||
ba55b1cb | 2159 | Build actions are performed by the Guix daemon, on behalf of users. In a |
3dc1970d | 2160 | standard setup, the daemon has write access to the store---the |
834129e0 | 2161 | @file{/gnu/store} directory---whereas users do not. The recommended |
3dc1970d LC |
2162 | setup also has the daemon perform builds in chroots, under a specific |
2163 | build users, to minimize interference with the rest of the system. | |
2164 | ||
2165 | @cindex derivation | |
2166 | Lower-level APIs are available to interact with the daemon and the | |
2167 | store. To instruct the daemon to perform a build action, users actually | |
2168 | provide it with a @dfn{derivation}. A derivation is a low-level | |
2169 | representation of the build actions to be taken, and the environment in | |
2170 | which they should occur---derivations are to package definitions what | |
49ad317a LC |
2171 | assembly is to C programs. The term ``derivation'' comes from the fact |
2172 | that build results @emph{derive} from them. | |
3dc1970d LC |
2173 | |
2174 | This chapter describes all these APIs in turn, starting from high-level | |
2175 | package definitions. | |
2176 | ||
568717fd | 2177 | @menu |
b860f382 | 2178 | * Defining Packages:: Defining new packages. |
7458bd0a | 2179 | * Build Systems:: Specifying how packages are built. |
b860f382 LC |
2180 | * The Store:: Manipulating the package store. |
2181 | * Derivations:: Low-level interface to package derivations. | |
2182 | * The Store Monad:: Purely functional interface to the store. | |
21b679f6 | 2183 | * G-Expressions:: Manipulating build expressions. |
568717fd LC |
2184 | @end menu |
2185 | ||
2186 | @node Defining Packages | |
2187 | @section Defining Packages | |
2188 | ||
3dc1970d LC |
2189 | The high-level interface to package definitions is implemented in the |
2190 | @code{(guix packages)} and @code{(guix build-system)} modules. As an | |
2191 | example, the package definition, or @dfn{recipe}, for the GNU Hello | |
2192 | package looks like this: | |
2193 | ||
2194 | @example | |
e7f34eb0 LC |
2195 | (define-module (gnu packages hello) |
2196 | #:use-module (guix packages) | |
2197 | #:use-module (guix download) | |
2198 | #:use-module (guix build-system gnu) | |
a6dcdcac SB |
2199 | #:use-module (guix licenses) |
2200 | #:use-module (gnu packages gawk)) | |
b22a12fd | 2201 | |
79f5dd59 | 2202 | (define-public hello |
3dc1970d LC |
2203 | (package |
2204 | (name "hello") | |
17d8e33f | 2205 | (version "2.10") |
3dc1970d | 2206 | (source (origin |
17d8e33f ML |
2207 | (method url-fetch) |
2208 | (uri (string-append "mirror://gnu/hello/hello-" version | |
2209 | ".tar.gz")) | |
2210 | (sha256 | |
2211 | (base32 | |
2212 | "0ssi1wpaf7plaswqqjwigppsg5fyh99vdlb9kzl7c9lng89ndq1i")))) | |
3dc1970d | 2213 | (build-system gnu-build-system) |
7458bd0a | 2214 | (arguments `(#:configure-flags '("--enable-silent-rules"))) |
3dc1970d | 2215 | (inputs `(("gawk" ,gawk))) |
7458bd0a LC |
2216 | (synopsis "Hello, GNU world: An example GNU package") |
2217 | (description "Guess what GNU Hello prints!") | |
3dc1970d | 2218 | (home-page "http://www.gnu.org/software/hello/") |
b22a12fd | 2219 | (license gpl3+))) |
3dc1970d LC |
2220 | @end example |
2221 | ||
2222 | @noindent | |
2223 | Without being a Scheme expert, the reader may have guessed the meaning | |
e7f34eb0 | 2224 | of the various fields here. This expression binds variable @code{hello} |
3dc1970d LC |
2225 | to a @code{<package>} object, which is essentially a record |
2226 | (@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}). | |
2227 | This package object can be inspected using procedures found in the | |
2228 | @code{(guix packages)} module; for instance, @code{(package-name hello)} | |
2229 | returns---surprise!---@code{"hello"}. | |
2230 | ||
2f7d2d91 LC |
2231 | With luck, you may be able to import part or all of the definition of |
2232 | the package you are interested in from another repository, using the | |
2233 | @code{guix import} command (@pxref{Invoking guix import}). | |
2234 | ||
e7f34eb0 LC |
2235 | In the example above, @var{hello} is defined into a module of its own, |
2236 | @code{(gnu packages hello)}. Technically, this is not strictly | |
2237 | necessary, but it is convenient to do so: all the packages defined in | |
2238 | modules under @code{(gnu packages @dots{})} are automatically known to | |
2239 | the command-line tools (@pxref{Package Modules}). | |
2240 | ||
3dc1970d LC |
2241 | There are a few points worth noting in the above package definition: |
2242 | ||
2243 | @itemize | |
2244 | @item | |
a2bf4907 LC |
2245 | The @code{source} field of the package is an @code{<origin>} object |
2246 | (@pxref{origin Reference}, for the complete reference). | |
3dc1970d LC |
2247 | Here, the @code{url-fetch} method from @code{(guix download)} is used, |
2248 | meaning that the source is a file to be downloaded over FTP or HTTP. | |
2249 | ||
2250 | The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of | |
2251 | the GNU mirrors defined in @code{(guix download)}. | |
2252 | ||
2253 | The @code{sha256} field specifies the expected SHA256 hash of the file | |
2254 | being downloaded. It is mandatory, and allows Guix to check the | |
2255 | integrity of the file. The @code{(base32 @dots{})} form introduces the | |
6c365eca | 2256 | base32 representation of the hash. You can obtain this information with |
210cc920 LC |
2257 | @code{guix download} (@pxref{Invoking guix download}) and @code{guix |
2258 | hash} (@pxref{Invoking guix hash}). | |
3dc1970d | 2259 | |
f9cc8971 LC |
2260 | @cindex patches |
2261 | When needed, the @code{origin} form can also have a @code{patches} field | |
2262 | listing patches to be applied, and a @code{snippet} field giving a | |
2263 | Scheme expression to modify the source code. | |
2264 | ||
3dc1970d LC |
2265 | @item |
2266 | @cindex GNU Build System | |
7458bd0a LC |
2267 | The @code{build-system} field specifies the procedure to build the |
2268 | package (@pxref{Build Systems}). Here, @var{gnu-build-system} | |
2269 | represents the familiar GNU Build System, where packages may be | |
2270 | configured, built, and installed with the usual @code{./configure && | |
2271 | make && make check && make install} command sequence. | |
2272 | ||
2273 | @item | |
2274 | The @code{arguments} field specifies options for the build system | |
2275 | (@pxref{Build Systems}). Here it is interpreted by | |
2276 | @var{gnu-build-system} as a request run @file{configure} with the | |
2277 | @code{--enable-silent-rules} flag. | |
3dc1970d LC |
2278 | |
2279 | @item | |
2280 | The @code{inputs} field specifies inputs to the build process---i.e., | |
2281 | build-time or run-time dependencies of the package. Here, we define an | |
2282 | input called @code{"gawk"} whose value is that of the @var{gawk} | |
2283 | variable; @var{gawk} is itself bound to a @code{<package>} object. | |
2284 | ||
2285 | Note that GCC, Coreutils, Bash, and other essential tools do not need to | |
2286 | be specified as inputs here. Instead, @var{gnu-build-system} takes care | |
7458bd0a | 2287 | of ensuring that they are present (@pxref{Build Systems}). |
3dc1970d LC |
2288 | |
2289 | However, any other dependencies need to be specified in the | |
2290 | @code{inputs} field. Any dependency not specified here will simply be | |
2291 | unavailable to the build process, possibly leading to a build failure. | |
2292 | @end itemize | |
2293 | ||
87eafdbd TUBK |
2294 | @xref{package Reference}, for a full description of possible fields. |
2295 | ||
2f7d2d91 | 2296 | Once a package definition is in place, the |
e49951eb | 2297 | package may actually be built using the @code{guix build} command-line |
39bee8a2 LC |
2298 | tool (@pxref{Invoking guix build}). You can easily jump back to the |
2299 | package definition using the @command{guix edit} command | |
2300 | (@pxref{Invoking guix edit}). | |
2301 | @xref{Packaging Guidelines}, for | |
b4f5e0e8 CR |
2302 | more information on how to test package definitions, and |
2303 | @ref{Invoking guix lint}, for information on how to check a definition | |
2304 | for style conformance. | |
2305 | ||
7458bd0a LC |
2306 | Eventually, updating the package definition to a new upstream version |
2307 | can be partly automated by the @command{guix refresh} command | |
2308 | (@pxref{Invoking guix refresh}). | |
3dc1970d LC |
2309 | |
2310 | Behind the scenes, a derivation corresponding to the @code{<package>} | |
2311 | object is first computed by the @code{package-derivation} procedure. | |
834129e0 | 2312 | That derivation is stored in a @code{.drv} file under @file{/gnu/store}. |
ba55b1cb | 2313 | The build actions it prescribes may then be realized by using the |
3dc1970d LC |
2314 | @code{build-derivations} procedure (@pxref{The Store}). |
2315 | ||
2316 | @deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}] | |
59688fc4 LC |
2317 | Return the @code{<derivation>} object of @var{package} for @var{system} |
2318 | (@pxref{Derivations}). | |
3dc1970d LC |
2319 | |
2320 | @var{package} must be a valid @code{<package>} object, and @var{system} | |
2321 | must be a string denoting the target system type---e.g., | |
2322 | @code{"x86_64-linux"} for an x86_64 Linux-based GNU system. @var{store} | |
2323 | must be a connection to the daemon, which operates on the store | |
2324 | (@pxref{The Store}). | |
2325 | @end deffn | |
568717fd | 2326 | |
9c1edabd LC |
2327 | @noindent |
2328 | @cindex cross-compilation | |
2329 | Similarly, it is possible to compute a derivation that cross-builds a | |
2330 | package for some other system: | |
2331 | ||
2332 | @deffn {Scheme Procedure} package-cross-derivation @var{store} @ | |
2333 | @var{package} @var{target} [@var{system}] | |
59688fc4 LC |
2334 | Return the @code{<derivation>} object of @var{package} cross-built from |
2335 | @var{system} to @var{target}. | |
9c1edabd LC |
2336 | |
2337 | @var{target} must be a valid GNU triplet denoting the target hardware | |
2338 | and operating system, such as @code{"mips64el-linux-gnu"} | |
2339 | (@pxref{Configuration Names, GNU configuration triplets,, configure, GNU | |
2340 | Configure and Build System}). | |
2341 | @end deffn | |
2342 | ||
87eafdbd TUBK |
2343 | @menu |
2344 | * package Reference :: The package data type. | |
2345 | * origin Reference:: The origin data type. | |
2346 | @end menu | |
2347 | ||
2348 | ||
2349 | @node package Reference | |
2350 | @subsection @code{package} Reference | |
2351 | ||
2352 | This section summarizes all the options available in @code{package} | |
2353 | declarations (@pxref{Defining Packages}). | |
2354 | ||
2355 | @deftp {Data Type} package | |
2356 | This is the data type representing a package recipe. | |
2357 | ||
2358 | @table @asis | |
2359 | @item @code{name} | |
2360 | The name of the package, as a string. | |
2361 | ||
2362 | @item @code{version} | |
2363 | The version of the package, as a string. | |
2364 | ||
2365 | @item @code{source} | |
2366 | An origin object telling how the source code for the package should be | |
2367 | acquired (@pxref{origin Reference}). | |
2368 | ||
2369 | @item @code{build-system} | |
2370 | The build system that should be used to build the package (@pxref{Build | |
2371 | Systems}). | |
2372 | ||
2373 | @item @code{arguments} (default: @code{'()}) | |
2374 | The arguments that should be passed to the build system. This is a | |
2375 | list, typically containing sequential keyword-value pairs. | |
2376 | ||
2377 | @item @code{inputs} (default: @code{'()}) | |
70650c68 LC |
2378 | @itemx @code{native-inputs} (default: @code{'()}) |
2379 | @itemx @code{propagated-inputs} (default: @code{'()}) | |
2380 | @cindex inputs, of packages | |
2381 | These fields list dependencies of the package. Each one is a list of | |
2382 | tuples, where each tuple has a label for the input (a string) as its | |
2383 | first element, a package, origin, or derivation as its second element, | |
2384 | and optionally the name of the output thereof that should be used, which | |
2385 | defaults to @code{"out"} (@pxref{Packages with Multiple Outputs}, for | |
2386 | more on package outputs). For example, the list below specifies 3 | |
2387 | inputs: | |
87eafdbd | 2388 | |
70650c68 LC |
2389 | @example |
2390 | `(("libffi" ,libffi) | |
2391 | ("libunistring" ,libunistring) | |
2392 | ("glib:bin" ,glib "bin")) ;the "bin" output of Glib | |
2393 | @end example | |
2394 | ||
2395 | @cindex cross compilation, package dependencies | |
2396 | The distinction between @code{native-inputs} and @code{inputs} is | |
2397 | necessary when considering cross-compilation. When cross-compiling, | |
2398 | dependencies listed in @code{inputs} are built for the @emph{target} | |
2399 | architecture; conversely, dependencies listed in @code{native-inputs} | |
2400 | are built for the architecture of the @emph{build} machine. | |
2401 | ||
2402 | @code{native-inputs} is typically where you would list tools needed at | |
2403 | build time but not at run time, such as Autoconf, Automake, pkg-config, | |
2404 | Gettext, or Bison. @command{guix lint} can report likely mistakes in | |
2405 | this area (@pxref{Invoking guix lint}). | |
2406 | ||
2407 | @anchor{package-propagated-inputs} | |
2408 | Lastly, @code{propagated-inputs} is similar to @code{inputs}, but the | |
2409 | specified packages will be force-installed alongside the package they | |
2410 | belong to (@pxref{package-cmd-propagated-inputs, @command{guix | |
2411 | package}}, for information on how @command{guix package} deals with | |
2412 | propagated inputs.) | |
21461f27 | 2413 | |
e0508b6b LC |
2414 | For example this is necessary when a C/C++ library needs headers of |
2415 | another library to compile, or when a pkg-config file refers to another | |
2416 | one @i{via} its @code{Requires} field. | |
2417 | ||
2418 | Another example where @code{propagated-inputs} is useful is for | |
2419 | languages that lack a facility to record the run-time search path akin | |
2420 | to ELF's @code{RUNPATH}; this includes Guile, Python, Perl, GHC, and | |
2421 | more. To ensure that libraries written in those languages can find | |
2422 | library code they depend on at run time, run-time dependencies must be | |
2423 | listed in @code{propagated-inputs} rather than @code{inputs}. | |
87eafdbd | 2424 | |
87eafdbd TUBK |
2425 | @item @code{self-native-input?} (default: @code{#f}) |
2426 | This is a Boolean field telling whether the package should use itself as | |
2427 | a native input when cross-compiling. | |
2428 | ||
2429 | @item @code{outputs} (default: @code{'("out")}) | |
2430 | The list of output names of the package. @xref{Packages with Multiple | |
2431 | Outputs}, for typical uses of additional outputs. | |
2432 | ||
2433 | @item @code{native-search-paths} (default: @code{'()}) | |
2434 | @itemx @code{search-paths} (default: @code{'()}) | |
2435 | A list of @code{search-path-specification} objects describing | |
2436 | search-path environment variables honored by the package. | |
2437 | ||
2438 | @item @code{replacement} (default: @code{#f}) | |
2439 | This must either @code{#f} or a package object that will be used as a | |
2440 | @dfn{replacement} for this package. @xref{Security Updates, grafts}, | |
2441 | for details. | |
2442 | ||
2443 | @item @code{synopsis} | |
2444 | A one-line description of the package. | |
2445 | ||
2446 | @item @code{description} | |
2447 | A more elaborate description of the package. | |
2448 | ||
2449 | @item @code{license} | |
2450 | The license of the package; a value from @code{(guix licenses)}. | |
2451 | ||
2452 | @item @code{home-page} | |
2453 | The URL to the home-page of the package, as a string. | |
2454 | ||
2455 | @item @code{supported-systems} (default: @var{%supported-systems}) | |
2456 | The list of systems supported by the package, as strings of the form | |
2457 | @code{architecture-kernel}, for example @code{"x86_64-linux"}. | |
2458 | ||
2459 | @item @code{maintainers} (default: @code{'()}) | |
2460 | The list of maintainers of the package, as @code{maintainer} objects. | |
2461 | ||
2462 | @item @code{location} (default: source location of the @code{package} form) | |
2463 | The source location of the package. It's useful to override this when | |
2464 | inheriting from another package, in which case this field is not | |
2465 | automatically corrected. | |
2466 | @end table | |
2467 | @end deftp | |
2468 | ||
2469 | ||
2470 | @node origin Reference | |
2471 | @subsection @code{origin} Reference | |
2472 | ||
2473 | This section summarizes all the options available in @code{origin} | |
2474 | declarations (@pxref{Defining Packages}). | |
2475 | ||
2476 | @deftp {Data Type} origin | |
2477 | This is the data type representing a source code origin. | |
2478 | ||
2479 | @table @asis | |
2480 | @item @code{uri} | |
2481 | An object containing the URI of the source. The object type depends on | |
2482 | the @code{method} (see below). For example, when using the | |
2483 | @var{url-fetch} method of @code{(guix download)}, the valid @code{uri} | |
2484 | values are: a URL represented as a string, or a list thereof. | |
2485 | ||
2486 | @item @code{method} | |
2487 | A procedure that will handle the URI. | |
2488 | ||
2489 | Examples include: | |
2490 | ||
2491 | @table @asis | |
2492 | @item @var{url-fetch} from @code{(guix download)} | |
2493 | download a file the HTTP, HTTPS, or FTP URL specified in the | |
2494 | @code{uri} field; | |
2495 | ||
2496 | @item @var{git-fetch} from @code{(guix git-download)} | |
2497 | clone the Git version control repository, and check out the revision | |
2498 | specified in the @code{uri} field as a @code{git-reference} object; a | |
2499 | @code{git-reference} looks like this: | |
2500 | ||
2501 | @example | |
2502 | (git-reference | |
2503 | (url "git://git.debian.org/git/pkg-shadow/shadow") | |
2504 | (commit "v4.1.5.1")) | |
2505 | @end example | |
2506 | @end table | |
2507 | ||
2508 | @item @code{sha256} | |
2509 | A bytevector containing the SHA-256 hash of the source. Typically the | |
2510 | @code{base32} form is used here to generate the bytevector from a | |
2511 | base-32 string. | |
2512 | ||
2513 | @item @code{file-name} (default: @code{#f}) | |
2514 | The file name under which the source code should be saved. When this is | |
2515 | @code{#f}, a sensible default value will be used in most cases. In case | |
2516 | the source is fetched from a URL, the file name from the URL will be | |
2517 | used. For version control checkouts, it's recommended to provide the | |
2518 | file name explicitly because the default is not very descriptive. | |
2519 | ||
2520 | @item @code{patches} (default: @code{'()}) | |
2521 | A list of file names containing patches to be applied to the source. | |
2522 | ||
2523 | @item @code{snippet} (default: @code{#f}) | |
2524 | A quoted piece of code that will be run in the source directory to make | |
2525 | any modifications, which is sometimes more convenient than a patch. | |
2526 | ||
2527 | @item @code{patch-flags} (default: @code{'("-p1")}) | |
2528 | A list of command-line flags that should be passed to the @code{patch} | |
2529 | command. | |
2530 | ||
2531 | @item @code{patch-inputs} (default: @code{#f}) | |
2532 | Input packages or derivations to the patching process. When this is | |
2533 | @code{#f}, the usual set of inputs necessary for patching are provided, | |
2534 | such as GNU@tie{}Patch. | |
2535 | ||
2536 | @item @code{modules} (default: @code{'()}) | |
2537 | A list of Guile modules that should be loaded during the patching | |
2538 | process and while running the code in the @code{snippet} field. | |
2539 | ||
2540 | @item @code{imported-modules} (default: @code{'()}) | |
2541 | The list of Guile modules to import in the patch derivation, for use by | |
2542 | the @code{snippet}. | |
2543 | ||
2544 | @item @code{patch-guile} (default: @code{#f}) | |
2545 | The Guile package that should be used in the patching process. When | |
2546 | this is @code{#f}, a sensible default is used. | |
2547 | @end table | |
2548 | @end deftp | |
2549 | ||
9c1edabd | 2550 | |
7458bd0a LC |
2551 | @node Build Systems |
2552 | @section Build Systems | |
2553 | ||
2554 | @cindex build system | |
2555 | Each package definition specifies a @dfn{build system} and arguments for | |
2556 | that build system (@pxref{Defining Packages}). This @code{build-system} | |
2557 | field represents the build procedure of the package, as well implicit | |
2558 | dependencies of that build procedure. | |
2559 | ||
2560 | Build systems are @code{<build-system>} objects. The interface to | |
2561 | create and manipulate them is provided by the @code{(guix build-system)} | |
2562 | module, and actual build systems are exported by specific modules. | |
2563 | ||
f5fd4fd2 | 2564 | @cindex bag (low-level package representation) |
0d5a559f LC |
2565 | Under the hood, build systems first compile package objects to |
2566 | @dfn{bags}. A @dfn{bag} is like a package, but with less | |
2567 | ornamentation---in other words, a bag is a lower-level representation of | |
2568 | a package, which includes all the inputs of that package, including some | |
2569 | that were implicitly added by the build system. This intermediate | |
2570 | representation is then compiled to a derivation (@pxref{Derivations}). | |
2571 | ||
7458bd0a LC |
2572 | Build systems accept an optional list of @dfn{arguments}. In package |
2573 | definitions, these are passed @i{via} the @code{arguments} field | |
2574 | (@pxref{Defining Packages}). They are typically keyword arguments | |
2575 | (@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU | |
2576 | Guile Reference Manual}). The value of these arguments is usually | |
2577 | evaluated in the @dfn{build stratum}---i.e., by a Guile process launched | |
2578 | by the daemon (@pxref{Derivations}). | |
2579 | ||
2580 | The main build system is @var{gnu-build-system}, which implements the | |
2581 | standard build procedure for GNU packages and many other packages. It | |
2582 | is provided by the @code{(guix build-system gnu)} module. | |
2583 | ||
2584 | @defvr {Scheme Variable} gnu-build-system | |
2585 | @var{gnu-build-system} represents the GNU Build System, and variants | |
2586 | thereof (@pxref{Configuration, configuration and makefile conventions,, | |
2587 | standards, GNU Coding Standards}). | |
2588 | ||
2589 | @cindex build phases | |
2590 | In a nutshell, packages using it configured, built, and installed with | |
2591 | the usual @code{./configure && make && make check && make install} | |
2592 | command sequence. In practice, a few additional steps are often needed. | |
2593 | All these steps are split up in separate @dfn{phases}, | |
2594 | notably@footnote{Please see the @code{(guix build gnu-build-system)} | |
2595 | modules for more details about the build phases.}: | |
2596 | ||
2597 | @table @code | |
2598 | @item unpack | |
2599 | Unpack the source tarball, and change the current directory to the | |
2600 | extracted source tree. If the source is actually a directory, copy it | |
2601 | to the build tree, and enter that directory. | |
2602 | ||
2603 | @item patch-source-shebangs | |
2604 | Patch shebangs encountered in source files so they refer to the right | |
2605 | store file names. For instance, this changes @code{#!/bin/sh} to | |
2606 | @code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}. | |
2607 | ||
2608 | @item configure | |
2609 | Run the @file{configure} script with a number of default options, such | |
2610 | as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified | |
2611 | by the @code{#:configure-flags} argument. | |
2612 | ||
2613 | @item build | |
2614 | Run @code{make} with the list of flags specified with | |
0917e80e | 2615 | @code{#:make-flags}. If the @code{#:parallel-build?} argument is true |
7458bd0a LC |
2616 | (the default), build with @code{make -j}. |
2617 | ||
2618 | @item check | |
2619 | Run @code{make check}, or some other target specified with | |
2620 | @code{#:test-target}, unless @code{#:tests? #f} is passed. If the | |
2621 | @code{#:parallel-tests?} argument is true (the default), run @code{make | |
2622 | check -j}. | |
2623 | ||
2624 | @item install | |
2625 | Run @code{make install} with the flags listed in @code{#:make-flags}. | |
2626 | ||
2627 | @item patch-shebangs | |
2628 | Patch shebangs on the installed executable files. | |
2629 | ||
2630 | @item strip | |
2631 | Strip debugging symbols from ELF files (unless @code{#:strip-binaries?} | |
2632 | is false), copying them to the @code{debug} output when available | |
2633 | (@pxref{Installing Debugging Files}). | |
2634 | @end table | |
2635 | ||
2636 | @vindex %standard-phases | |
2637 | The build-side module @code{(guix build gnu-build-system)} defines | |
2638 | @var{%standard-phases} as the default list of build phases. | |
2639 | @var{%standard-phases} is a list of symbol/procedure pairs, where the | |
2640 | procedure implements the actual phase. | |
2641 | ||
2642 | The list of phases used for a particular package can be changed with the | |
2643 | @code{#:phases} parameter. For instance, passing: | |
2644 | ||
2645 | @example | |
2646 | #:phases (alist-delete 'configure %standard-phases) | |
2647 | @end example | |
2648 | ||
9bf404e9 | 2649 | means that all the phases described above will be used, except the |
7458bd0a LC |
2650 | @code{configure} phase. |
2651 | ||
2652 | In addition, this build system ensures that the ``standard'' environment | |
2653 | for GNU packages is available. This includes tools such as GCC, libc, | |
2654 | Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix | |
2655 | build-system gnu)} module for a complete list.) We call these the | |
2656 | @dfn{implicit inputs} of a package, because package definitions don't | |
2657 | have to mention them. | |
2658 | @end defvr | |
2659 | ||
2660 | Other @code{<build-system>} objects are defined to support other | |
2661 | conventions and tools used by free software packages. They inherit most | |
2662 | of @var{gnu-build-system}, and differ mainly in the set of inputs | |
2663 | implicitly added to the build process, and in the list of phases | |
2664 | executed. Some of these build systems are listed below. | |
2665 | ||
2666 | @defvr {Scheme Variable} cmake-build-system | |
2667 | This variable is exported by @code{(guix build-system cmake)}. It | |
2668 | implements the build procedure for packages using the | |
2669 | @url{http://www.cmake.org, CMake build tool}. | |
2670 | ||
2671 | It automatically adds the @code{cmake} package to the set of inputs. | |
2672 | Which package is used can be specified with the @code{#:cmake} | |
2673 | parameter. | |
9849cfc1 LC |
2674 | |
2675 | The @code{#:configure-flags} parameter is taken as a list of flags | |
2676 | passed to the @command{cmake} command. The @code{#:build-type} | |
2677 | parameter specifies in abstract terms the flags passed to the compiler; | |
2678 | it defaults to @code{"RelWithDebInfo"} (short for ``release mode with | |
2679 | debugging information''), which roughly means that code is compiled with | |
2680 | @code{-O2 -g}, as is the case for Autoconf-based packages by default. | |
7458bd0a LC |
2681 | @end defvr |
2682 | ||
3afcf52b FB |
2683 | @defvr {Scheme Variable} glib-or-gtk-build-system |
2684 | This variable is exported by @code{(guix build-system glib-or-gtk)}. It | |
2685 | is intended for use with packages making use of GLib or GTK+. | |
2686 | ||
2687 | This build system adds the following two phases to the ones defined by | |
2688 | @var{gnu-build-system}: | |
2689 | ||
2690 | @table @code | |
2691 | @item glib-or-gtk-wrap | |
2692 | The phase @code{glib-or-gtk-wrap} ensures that programs found under | |
2693 | @file{bin/} are able to find GLib's ``schemas'' and | |
2694 | @uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+ | |
2695 | modules}. This is achieved by wrapping the programs in launch scripts | |
2696 | that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH} | |
2697 | environment variables. | |
2698 | ||
73aa8ddb LC |
2699 | It is possible to exclude specific package outputs from that wrapping |
2700 | process by listing their names in the | |
2701 | @code{#:glib-or-gtk-wrap-excluded-outputs} parameter. This is useful | |
2702 | when an output is known not to contain any GLib or GTK+ binaries, and | |
2703 | where wrapping would gratuitously add a dependency of that output on | |
2704 | GLib and GTK+. | |
2705 | ||
3afcf52b FB |
2706 | @item glib-or-gtk-compile-schemas |
2707 | The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's | |
2708 | @uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html, | |
2709 | GSettings schemas} are compiled. Compilation is performed by the | |
2710 | @command{glib-compile-schemas} program. It is provided by the package | |
2711 | @code{glib:bin} which is automatically imported by the build system. | |
2712 | The @code{glib} package providing @command{glib-compile-schemas} can be | |
2713 | specified with the @code{#:glib} parameter. | |
2714 | @end table | |
2715 | ||
2716 | Both phases are executed after the @code{install} phase. | |
2717 | @end defvr | |
2718 | ||
7458bd0a LC |
2719 | @defvr {Scheme Variable} python-build-system |
2720 | This variable is exported by @code{(guix build-system python)}. It | |
2721 | implements the more or less standard build procedure used by Python | |
2722 | packages, which consists in running @code{python setup.py build} and | |
2723 | then @code{python setup.py install --prefix=/gnu/store/@dots{}}. | |
2724 | ||
2725 | For packages that install stand-alone Python programs under @code{bin/}, | |
2726 | it takes care of wrapping these programs so their @code{PYTHONPATH} | |
2727 | environment variable points to all the Python libraries they depend on. | |
2728 | ||
2729 | Which Python package is used can be specified with the @code{#:python} | |
2730 | parameter. | |
2731 | @end defvr | |
2732 | ||
2733 | @defvr {Scheme Variable} perl-build-system | |
2734 | This variable is exported by @code{(guix build-system perl)}. It | |
2d2a53fc EB |
2735 | implements the standard build procedure for Perl packages, which either |
2736 | consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}}, | |
2737 | followed by @code{Build} and @code{Build install}; or in running | |
2738 | @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by | |
2739 | @code{make} and @code{make install}; depending on which of | |
2740 | @code{Build.PL} or @code{Makefile.PL} is present in the package | |
2741 | distribution. Preference is given to the former if both @code{Build.PL} | |
2742 | and @code{Makefile.PL} exist in the package distribution. This | |
2743 | preference can be reversed by specifying @code{#t} for the | |
2744 | @code{#:make-maker?} parameter. | |
2745 | ||
2746 | The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation | |
2747 | passes flags specified by the @code{#:make-maker-flags} or | |
2748 | @code{#:module-build-flags} parameter, respectively. | |
7458bd0a LC |
2749 | |
2750 | Which Perl package is used can be specified with @code{#:perl}. | |
2751 | @end defvr | |
2752 | ||
f8f3bef6 RW |
2753 | @defvr {Scheme Variable} r-build-system |
2754 | This variable is exported by @code{(guix build-system r)}. It | |
2755 | implements the build procedure used by @uref{http://r-project.org, R} | |
2756 | packages, which essentially is little more than running @code{R CMD | |
2757 | INSTALL --library=/gnu/store/@dots{}} in an environment where | |
2758 | @code{R_LIBS_SITE} contains the paths to all R package inputs. Tests | |
2759 | are run after installation using the R function | |
2760 | @code{tools::testInstalledPackage}. | |
2761 | @end defvr | |
2762 | ||
c08f9818 DT |
2763 | @defvr {Scheme Variable} ruby-build-system |
2764 | This variable is exported by @code{(guix build-system ruby)}. It | |
2765 | implements the RubyGems build procedure used by Ruby packages, which | |
2766 | involves running @code{gem build} followed by @code{gem install}. | |
2767 | ||
5dc87623 DT |
2768 | The @code{source} field of a package that uses this build system |
2769 | typically references a gem archive, since this is the format that Ruby | |
2770 | developers use when releasing their software. The build system unpacks | |
2771 | the gem archive, potentially patches the source, runs the test suite, | |
2772 | repackages the gem, and installs it. Additionally, directories and | |
2773 | tarballs may be referenced to allow building unreleased gems from Git or | |
2774 | a traditional source release tarball. | |
e83c6d00 | 2775 | |
c08f9818 | 2776 | Which Ruby package is used can be specified with the @code{#:ruby} |
6e9f2913 PP |
2777 | parameter. A list of additional flags to be passed to the @command{gem} |
2778 | command can be specified with the @code{#:gem-flags} parameter. | |
c08f9818 | 2779 | @end defvr |
7458bd0a | 2780 | |
a677c726 RW |
2781 | @defvr {Scheme Variable} waf-build-system |
2782 | This variable is exported by @code{(guix build-system waf)}. It | |
2783 | implements a build procedure around the @code{waf} script. The common | |
2784 | phases---@code{configure}, @code{build}, and @code{install}---are | |
2785 | implemented by passing their names as arguments to the @code{waf} | |
2786 | script. | |
2787 | ||
2788 | The @code{waf} script is executed by the Python interpreter. Which | |
2789 | Python package is used to run the script can be specified with the | |
2790 | @code{#:python} parameter. | |
2791 | @end defvr | |
2792 | ||
14dfdf2e FB |
2793 | @defvr {Scheme Variable} haskell-build-system |
2794 | This variable is exported by @code{(guix build-system haskell)}. It | |
2795 | implements the Cabal build procedure used by Haskell packages, which | |
2796 | involves running @code{runhaskell Setup.hs configure | |
2797 | --prefix=/gnu/store/@dots{}} and @code{runhaskell Setup.hs build}. | |
2798 | Instead of installing the package by running @code{runhaskell Setup.hs | |
2799 | install}, to avoid trying to register libraries in the read-only | |
2800 | compiler store directory, the build system uses @code{runhaskell | |
2801 | Setup.hs copy}, followed by @code{runhaskell Setup.hs register}. In | |
2802 | addition, the build system generates the package documentation by | |
2803 | running @code{runhaskell Setup.hs haddock}, unless @code{#:haddock? #f} | |
2804 | is passed. Optional Haddock parameters can be passed with the help of | |
2805 | the @code{#:haddock-flags} parameter. If the file @code{Setup.hs} is | |
2806 | not found, the build system looks for @code{Setup.lhs} instead. | |
2807 | ||
2808 | Which Haskell compiler is used can be specified with the @code{#:haskell} | |
a54bd6d7 | 2809 | parameter which defaults to @code{ghc}. |
14dfdf2e FB |
2810 | @end defvr |
2811 | ||
e9137a53 FB |
2812 | @defvr {Scheme Variable} emacs-build-system |
2813 | This variable is exported by @code{(guix build-system emacs)}. It | |
2814 | implements an installation procedure similar to the one of Emacs' own | |
2815 | packaging system (@pxref{Packages,,, emacs, The GNU Emacs Manual}). | |
2816 | ||
2817 | It first creates the @code{@var{package}-autoloads.el} file, then it | |
2818 | byte compiles all Emacs Lisp files. Differently from the Emacs | |
2819 | packaging system, the Info documentation files are moved to the standard | |
2820 | documentation directory and the @file{dir} file is deleted. Each | |
2821 | package is installed in its own directory under | |
2822 | @file{share/emacs/site-lisp/guix.d}. | |
2823 | @end defvr | |
2824 | ||
7458bd0a LC |
2825 | Lastly, for packages that do not need anything as sophisticated, a |
2826 | ``trivial'' build system is provided. It is trivial in the sense that | |
2827 | it provides basically no support: it does not pull any implicit inputs, | |
2828 | and does not have a notion of build phases. | |
2829 | ||
2830 | @defvr {Scheme Variable} trivial-build-system | |
2831 | This variable is exported by @code{(guix build-system trivial)}. | |
2832 | ||
2833 | This build system requires a @code{#:builder} argument. This argument | |
2834 | must be a Scheme expression that builds the package's output(s)---as | |
2835 | with @code{build-expression->derivation} (@pxref{Derivations, | |
2836 | @code{build-expression->derivation}}). | |
2837 | @end defvr | |
2838 | ||
568717fd LC |
2839 | @node The Store |
2840 | @section The Store | |
2841 | ||
e531ac2a LC |
2842 | @cindex store |
2843 | @cindex store paths | |
2844 | ||
2845 | Conceptually, the @dfn{store} is where derivations that have been | |
834129e0 | 2846 | successfully built are stored---by default, under @file{/gnu/store}. |
e531ac2a | 2847 | Sub-directories in the store are referred to as @dfn{store paths}. The |
4988dd40 | 2848 | store has an associated database that contains information such as the |
e531ac2a LC |
2849 | store paths referred to by each store path, and the list of @emph{valid} |
2850 | store paths---paths that result from a successful build. | |
2851 | ||
2852 | The store is always accessed by the daemon on behalf of its clients | |
2853 | (@pxref{Invoking guix-daemon}). To manipulate the store, clients | |
2854 | connect to the daemon over a Unix-domain socket, send it requests, and | |
2855 | read the result---these are remote procedure calls, or RPCs. | |
2856 | ||
2857 | The @code{(guix store)} module provides procedures to connect to the | |
2858 | daemon, and to perform RPCs. These are described below. | |
2859 | ||
2860 | @deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t] | |
2861 | Connect to the daemon over the Unix-domain socket at @var{file}. When | |
2862 | @var{reserve-space?} is true, instruct it to reserve a little bit of | |
2863 | extra space on the file system so that the garbage collector can still | |
2864 | operate, should the disk become full. Return a server object. | |
2865 | ||
2866 | @var{file} defaults to @var{%default-socket-path}, which is the normal | |
2867 | location given the options that were passed to @command{configure}. | |
2868 | @end deffn | |
2869 | ||
2870 | @deffn {Scheme Procedure} close-connection @var{server} | |
2871 | Close the connection to @var{server}. | |
2872 | @end deffn | |
2873 | ||
2874 | @defvr {Scheme Variable} current-build-output-port | |
2875 | This variable is bound to a SRFI-39 parameter, which refers to the port | |
2876 | where build and error logs sent by the daemon should be written. | |
2877 | @end defvr | |
2878 | ||
2879 | Procedures that make RPCs all take a server object as their first | |
2880 | argument. | |
2881 | ||
2882 | @deffn {Scheme Procedure} valid-path? @var{server} @var{path} | |
2883 | Return @code{#t} when @var{path} is a valid store path. | |
2884 | @end deffn | |
2885 | ||
cfbf9160 | 2886 | @deffn {Scheme Procedure} add-text-to-store @var{server} @var{name} @var{text} [@var{references}] |
e531ac2a LC |
2887 | Add @var{text} under file @var{name} in the store, and return its store |
2888 | path. @var{references} is the list of store paths referred to by the | |
2889 | resulting store path. | |
2890 | @end deffn | |
2891 | ||
874e6874 | 2892 | @deffn {Scheme Procedure} build-derivations @var{server} @var{derivations} |
59688fc4 LC |
2893 | Build @var{derivations} (a list of @code{<derivation>} objects or |
2894 | derivation paths), and return when the worker is done building them. | |
2895 | Return @code{#t} on success. | |
874e6874 LC |
2896 | @end deffn |
2897 | ||
b860f382 LC |
2898 | Note that the @code{(guix monads)} module provides a monad as well as |
2899 | monadic versions of the above procedures, with the goal of making it | |
2900 | more convenient to work with code that accesses the store (@pxref{The | |
2901 | Store Monad}). | |
2902 | ||
e531ac2a LC |
2903 | @c FIXME |
2904 | @i{This section is currently incomplete.} | |
568717fd LC |
2905 | |
2906 | @node Derivations | |
2907 | @section Derivations | |
2908 | ||
874e6874 LC |
2909 | @cindex derivations |
2910 | Low-level build actions and the environment in which they are performed | |
2911 | are represented by @dfn{derivations}. A derivation contain the | |
2912 | following pieces of information: | |
2913 | ||
2914 | @itemize | |
2915 | @item | |
2916 | The outputs of the derivation---derivations produce at least one file or | |
2917 | directory in the store, but may produce more. | |
2918 | ||
2919 | @item | |
2920 | The inputs of the derivations, which may be other derivations or plain | |
2921 | files in the store (patches, build scripts, etc.) | |
2922 | ||
2923 | @item | |
2924 | The system type targeted by the derivation---e.g., @code{x86_64-linux}. | |
2925 | ||
2926 | @item | |
2927 | The file name of a build script in the store, along with the arguments | |
2928 | to be passed. | |
2929 | ||
2930 | @item | |
2931 | A list of environment variables to be defined. | |
2932 | ||
2933 | @end itemize | |
2934 | ||
2935 | @cindex derivation path | |
2936 | Derivations allow clients of the daemon to communicate build actions to | |
2937 | the store. They exist in two forms: as an in-memory representation, | |
2938 | both on the client- and daemon-side, and as files in the store whose | |
2939 | name end in @code{.drv}---these files are referred to as @dfn{derivation | |
2940 | paths}. Derivations paths can be passed to the @code{build-derivations} | |
2941 | procedure to perform the build actions they prescribe (@pxref{The | |
2942 | Store}). | |
2943 | ||
2944 | The @code{(guix derivations)} module provides a representation of | |
2945 | derivations as Scheme objects, along with procedures to create and | |
2946 | otherwise manipulate derivations. The lowest-level primitive to create | |
2947 | a derivation is the @code{derivation} procedure: | |
2948 | ||
1909431c LC |
2949 | @deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @ |
2950 | @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @ | |
2096ef47 | 2951 | [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @ |
1909431c | 2952 | [#:system (%current-system)] [#:references-graphs #f] @ |
4a6aeb67 LC |
2953 | [#:allowed-references #f] [#:leaked-env-vars #f] [#:local-build? #f] @ |
2954 | [#:substitutable? #t] | |
59688fc4 LC |
2955 | Build a derivation with the given arguments, and return the resulting |
2956 | @code{<derivation>} object. | |
874e6874 | 2957 | |
2096ef47 | 2958 | When @var{hash} and @var{hash-algo} are given, a |
874e6874 | 2959 | @dfn{fixed-output derivation} is created---i.e., one whose result is |
36bbbbd1 LC |
2960 | known in advance, such as a file download. If, in addition, |
2961 | @var{recursive?} is true, then that fixed output may be an executable | |
2962 | file or a directory and @var{hash} must be the hash of an archive | |
2963 | containing this output. | |
5b0c9d16 | 2964 | |
858e9282 | 2965 | When @var{references-graphs} is true, it must be a list of file |
5b0c9d16 LC |
2966 | name/store path pairs. In that case, the reference graph of each store |
2967 | path is exported in the build environment in the corresponding file, in | |
2968 | a simple text format. | |
1909431c | 2969 | |
b53be755 LC |
2970 | When @var{allowed-references} is true, it must be a list of store items |
2971 | or outputs that the derivation's output may refer to. | |
2972 | ||
c0468155 LC |
2973 | When @var{leaked-env-vars} is true, it must be a list of strings |
2974 | denoting environment variables that are allowed to ``leak'' from the | |
2975 | daemon's environment to the build environment. This is only applicable | |
2976 | to fixed-output derivations---i.e., when @var{hash} is true. The main | |
2977 | use is to allow variables such as @code{http_proxy} to be passed to | |
2978 | derivations that download files. | |
2979 | ||
1909431c LC |
2980 | When @var{local-build?} is true, declare that the derivation is not a |
2981 | good candidate for offloading and should rather be built locally | |
2982 | (@pxref{Daemon Offload Setup}). This is the case for small derivations | |
2983 | where the costs of data transfers would outweigh the benefits. | |
4a6aeb67 LC |
2984 | |
2985 | When @var{substitutable?} is false, declare that substitutes of the | |
2986 | derivation's output should not be used (@pxref{Substitutes}). This is | |
2987 | useful, for instance, when building packages that capture details of the | |
2988 | host CPU instruction set. | |
874e6874 LC |
2989 | @end deffn |
2990 | ||
2991 | @noindent | |
2992 | Here's an example with a shell script as its builder, assuming | |
2993 | @var{store} is an open connection to the daemon, and @var{bash} points | |
2994 | to a Bash executable in the store: | |
2995 | ||
2996 | @lisp | |
2997 | (use-modules (guix utils) | |
2998 | (guix store) | |
2999 | (guix derivations)) | |
3000 | ||
59688fc4 LC |
3001 | (let ((builder ; add the Bash script to the store |
3002 | (add-text-to-store store "my-builder.sh" | |
3003 | "echo hello world > $out\n" '()))) | |
3004 | (derivation store "foo" | |
3005 | bash `("-e" ,builder) | |
21b679f6 | 3006 | #:inputs `((,bash) (,builder)) |
59688fc4 | 3007 | #:env-vars '(("HOME" . "/homeless")))) |
834129e0 | 3008 | @result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo> |
874e6874 LC |
3009 | @end lisp |
3010 | ||
21b679f6 LC |
3011 | As can be guessed, this primitive is cumbersome to use directly. A |
3012 | better approach is to write build scripts in Scheme, of course! The | |
3013 | best course of action for that is to write the build code as a | |
3014 | ``G-expression'', and to pass it to @code{gexp->derivation}. For more | |
6621cdb6 | 3015 | information, @pxref{G-Expressions}. |
21b679f6 LC |
3016 | |
3017 | Once upon a time, @code{gexp->derivation} did not exist and constructing | |
3018 | derivations with build code written in Scheme was achieved with | |
3019 | @code{build-expression->derivation}, documented below. This procedure | |
3020 | is now deprecated in favor of the much nicer @code{gexp->derivation}. | |
874e6874 | 3021 | |
dd1a5a15 LC |
3022 | @deffn {Scheme Procedure} build-expression->derivation @var{store} @ |
3023 | @var{name} @var{exp} @ | |
3024 | [#:system (%current-system)] [#:inputs '()] @ | |
3025 | [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @ | |
36bbbbd1 | 3026 | [#:recursive? #f] [#:env-vars '()] [#:modules '()] @ |
63a42824 | 3027 | [#:references-graphs #f] [#:allowed-references #f] @ |
4a6aeb67 | 3028 | [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f] |
874e6874 LC |
3029 | Return a derivation that executes Scheme expression @var{exp} as a |
3030 | builder for derivation @var{name}. @var{inputs} must be a list of | |
3031 | @code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted, | |
3032 | @code{"out"} is assumed. @var{modules} is a list of names of Guile | |
3033 | modules from the current search path to be copied in the store, | |
3034 | compiled, and made available in the load path during the execution of | |
3035 | @var{exp}---e.g., @code{((guix build utils) (guix build | |
3036 | gnu-build-system))}. | |
3037 | ||
3038 | @var{exp} is evaluated in an environment where @code{%outputs} is bound | |
3039 | to a list of output/path pairs, and where @code{%build-inputs} is bound | |
3040 | to a list of string/output-path pairs made from @var{inputs}. | |
3041 | Optionally, @var{env-vars} is a list of string pairs specifying the name | |
3042 | and value of environment variables visible to the builder. The builder | |
3043 | terminates by passing the result of @var{exp} to @code{exit}; thus, when | |
3044 | @var{exp} returns @code{#f}, the build is considered to have failed. | |
3045 | ||
3046 | @var{exp} is built using @var{guile-for-build} (a derivation). When | |
3047 | @var{guile-for-build} is omitted or is @code{#f}, the value of the | |
3048 | @code{%guile-for-build} fluid is used instead. | |
9c629a27 | 3049 | |
63a42824 | 3050 | See the @code{derivation} procedure for the meaning of |
4a6aeb67 LC |
3051 | @var{references-graphs}, @var{allowed-references}, @var{local-build?}, |
3052 | and @var{substitutable?}. | |
874e6874 LC |
3053 | @end deffn |
3054 | ||
3055 | @noindent | |
3056 | Here's an example of a single-output derivation that creates a directory | |
3057 | containing one file: | |
3058 | ||
3059 | @lisp | |
3060 | (let ((builder '(let ((out (assoc-ref %outputs "out"))) | |
834129e0 | 3061 | (mkdir out) ; create /gnu/store/@dots{}-goo |
874e6874 LC |
3062 | (call-with-output-file (string-append out "/test") |
3063 | (lambda (p) | |
3064 | (display '(hello guix) p)))))) | |
dd1a5a15 | 3065 | (build-expression->derivation store "goo" builder)) |
874e6874 | 3066 | |
834129e0 | 3067 | @result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}> |
874e6874 LC |
3068 | @end lisp |
3069 | ||
568717fd | 3070 | |
b860f382 LC |
3071 | @node The Store Monad |
3072 | @section The Store Monad | |
3073 | ||
3074 | @cindex monad | |
3075 | ||
3076 | The procedures that operate on the store described in the previous | |
3077 | sections all take an open connection to the build daemon as their first | |
3078 | argument. Although the underlying model is functional, they either have | |
3079 | side effects or depend on the current state of the store. | |
3080 | ||
3081 | The former is inconvenient: the connection to the build daemon has to be | |
3082 | carried around in all those functions, making it impossible to compose | |
3083 | functions that do not take that parameter with functions that do. The | |
3084 | latter can be problematic: since store operations have side effects | |
3085 | and/or depend on external state, they have to be properly sequenced. | |
3086 | ||
3087 | @cindex monadic values | |
3088 | @cindex monadic functions | |
3089 | This is where the @code{(guix monads)} module comes in. This module | |
3090 | provides a framework for working with @dfn{monads}, and a particularly | |
3091 | useful monad for our uses, the @dfn{store monad}. Monads are a | |
3092 | construct that allows two things: associating ``context'' with values | |
3093 | (in our case, the context is the store), and building sequences of | |
561fb6c3 | 3094 | computations (here computations include accesses to the store.) Values |
b860f382 LC |
3095 | in a monad---values that carry this additional context---are called |
3096 | @dfn{monadic values}; procedures that return such values are called | |
3097 | @dfn{monadic procedures}. | |
3098 | ||
3099 | Consider this ``normal'' procedure: | |
3100 | ||
3101 | @example | |
45adbd62 LC |
3102 | (define (sh-symlink store) |
3103 | ;; Return a derivation that symlinks the 'bash' executable. | |
3104 | (let* ((drv (package-derivation store bash)) | |
3105 | (out (derivation->output-path drv)) | |
3106 | (sh (string-append out "/bin/bash"))) | |
3107 | (build-expression->derivation store "sh" | |
3108 | `(symlink ,sh %output)))) | |
b860f382 LC |
3109 | @end example |
3110 | ||
c6f30b81 LC |
3111 | Using @code{(guix monads)} and @code{(guix gexp)}, it may be rewritten |
3112 | as a monadic function: | |
b860f382 LC |
3113 | |
3114 | @example | |
45adbd62 | 3115 | (define (sh-symlink) |
b860f382 | 3116 | ;; Same, but return a monadic value. |
c6f30b81 LC |
3117 | (mlet %store-monad ((drv (package->derivation bash))) |
3118 | (gexp->derivation "sh" | |
3119 | #~(symlink (string-append #$drv "/bin/bash") | |
3120 | #$output)))) | |
b860f382 LC |
3121 | @end example |
3122 | ||
c6f30b81 LC |
3123 | There several things to note in the second version: the @code{store} |
3124 | parameter is now implicit and is ``threaded'' in the calls to the | |
3125 | @code{package->derivation} and @code{gexp->derivation} monadic | |
3126 | procedures, and the monadic value returned by @code{package->derivation} | |
3127 | is @dfn{bound} using @code{mlet} instead of plain @code{let}. | |
3128 | ||
3129 | As it turns out, the call to @code{package->derivation} can even be | |
3130 | omitted since it will take place implicitly, as we will see later | |
3131 | (@pxref{G-Expressions}): | |
3132 | ||
3133 | @example | |
3134 | (define (sh-symlink) | |
3135 | (gexp->derivation "sh" | |
3136 | #~(symlink (string-append #$bash "/bin/bash") | |
3137 | #$output))) | |
3138 | @end example | |
b860f382 | 3139 | |
7ce21611 LC |
3140 | @c See |
3141 | @c <https://syntaxexclamation.wordpress.com/2014/06/26/escaping-continuations/> | |
3142 | @c for the funny quote. | |
3143 | Calling the monadic @code{sh-symlink} has no effect. As someone once | |
3144 | said, ``you exit a monad like you exit a building on fire: by running''. | |
3145 | So, to exit the monad and get the desired effect, one must use | |
3146 | @code{run-with-store}: | |
b860f382 LC |
3147 | |
3148 | @example | |
8e9aa37f CAW |
3149 | (run-with-store (open-connection) (sh-symlink)) |
3150 | @result{} /gnu/store/...-sh-symlink | |
b860f382 LC |
3151 | @end example |
3152 | ||
b9b86078 LC |
3153 | Note that the @code{(guix monad-repl)} module extends Guile's REPL with |
3154 | new ``meta-commands'' to make it easier to deal with monadic procedures: | |
3155 | @code{run-in-store}, and @code{enter-store-monad}. The former, is used | |
3156 | to ``run'' a single monadic value through the store: | |
3157 | ||
3158 | @example | |
3159 | scheme@@(guile-user)> ,run-in-store (package->derivation hello) | |
3160 | $1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}> | |
3161 | @end example | |
3162 | ||
3163 | The latter enters a recursive REPL, where all the return values are | |
3164 | automatically run through the store: | |
3165 | ||
3166 | @example | |
3167 | scheme@@(guile-user)> ,enter-store-monad | |
3168 | store-monad@@(guile-user) [1]> (package->derivation hello) | |
3169 | $2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}> | |
3170 | store-monad@@(guile-user) [1]> (text-file "foo" "Hello!") | |
3171 | $3 = "/gnu/store/@dots{}-foo" | |
3172 | store-monad@@(guile-user) [1]> ,q | |
3173 | scheme@@(guile-user)> | |
3174 | @end example | |
3175 | ||
3176 | @noindent | |
3177 | Note that non-monadic values cannot be returned in the | |
3178 | @code{store-monad} REPL. | |
3179 | ||
e87f0591 LC |
3180 | The main syntactic forms to deal with monads in general are provided by |
3181 | the @code{(guix monads)} module and are described below. | |
b860f382 LC |
3182 | |
3183 | @deffn {Scheme Syntax} with-monad @var{monad} @var{body} ... | |
3184 | Evaluate any @code{>>=} or @code{return} forms in @var{body} as being | |
3185 | in @var{monad}. | |
3186 | @end deffn | |
3187 | ||
3188 | @deffn {Scheme Syntax} return @var{val} | |
3189 | Return a monadic value that encapsulates @var{val}. | |
3190 | @end deffn | |
3191 | ||
751630c9 | 3192 | @deffn {Scheme Syntax} >>= @var{mval} @var{mproc} ... |
b860f382 | 3193 | @dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic |
751630c9 LC |
3194 | procedures @var{mproc}@dots{}@footnote{This operation is commonly |
3195 | referred to as ``bind'', but that name denotes an unrelated procedure in | |
3196 | Guile. Thus we use this somewhat cryptic symbol inherited from the | |
3197 | Haskell language.}. There can be one @var{mproc} or several of them, as | |
3198 | in this example: | |
3199 | ||
3200 | @example | |
3201 | (run-with-state | |
3202 | (with-monad %state-monad | |
3203 | (>>= (return 1) | |
3204 | (lambda (x) (return (+ 1 x))) | |
3205 | (lambda (x) (return (* 2 x))))) | |
3206 | 'some-state) | |
3207 | ||
3208 | @result{} 4 | |
3209 | @result{} some-state | |
3210 | @end example | |
b860f382 LC |
3211 | @end deffn |
3212 | ||
3213 | @deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @ | |
3214 | @var{body} ... | |
3215 | @deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @ | |
3216 | @var{body} ... | |
3217 | Bind the variables @var{var} to the monadic values @var{mval} in | |
3218 | @var{body}. The form (@var{var} -> @var{val}) binds @var{var} to the | |
3219 | ``normal'' value @var{val}, as per @code{let}. | |
3220 | ||
3221 | @code{mlet*} is to @code{mlet} what @code{let*} is to @code{let} | |
3222 | (@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}). | |
3223 | @end deffn | |
3224 | ||
405a9d4e LC |
3225 | @deffn {Scheme System} mbegin @var{monad} @var{mexp} ... |
3226 | Bind @var{mexp} and the following monadic expressions in sequence, | |
3227 | returning the result of the last expression. | |
3228 | ||
3229 | This is akin to @code{mlet}, except that the return values of the | |
3230 | monadic expressions are ignored. In that sense, it is analogous to | |
3231 | @code{begin}, but applied to monadic expressions. | |
3232 | @end deffn | |
3233 | ||
561fb6c3 LC |
3234 | @cindex state monad |
3235 | The @code{(guix monads)} module provides the @dfn{state monad}, which | |
3236 | allows an additional value---the state---to be @emph{threaded} through | |
3237 | monadic procedure calls. | |
3238 | ||
3239 | @defvr {Scheme Variable} %state-monad | |
3240 | The state monad. Procedures in the state monad can access and change | |
3241 | the state that is threaded. | |
3242 | ||
3243 | Consider the example below. The @code{square} procedure returns a value | |
3244 | in the state monad. It returns the square of its argument, but also | |
3245 | increments the current state value: | |
3246 | ||
3247 | @example | |
3248 | (define (square x) | |
3249 | (mlet %state-monad ((count (current-state))) | |
3250 | (mbegin %state-monad | |
3251 | (set-current-state (+ 1 count)) | |
3252 | (return (* x x))))) | |
3253 | ||
3254 | (run-with-state (sequence %state-monad (map square (iota 3))) 0) | |
3255 | @result{} (0 1 4) | |
3256 | @result{} 3 | |
3257 | @end example | |
3258 | ||
3259 | When ``run'' through @var{%state-monad}, we obtain that additional state | |
3260 | value, which is the number of @code{square} calls. | |
3261 | @end defvr | |
3262 | ||
3263 | @deffn {Monadic Procedure} current-state | |
3264 | Return the current state as a monadic value. | |
3265 | @end deffn | |
3266 | ||
3267 | @deffn {Monadic Procedure} set-current-state @var{value} | |
3268 | Set the current state to @var{value} and return the previous state as a | |
3269 | monadic value. | |
3270 | @end deffn | |
3271 | ||
3272 | @deffn {Monadic Procedure} state-push @var{value} | |
3273 | Push @var{value} to the current state, which is assumed to be a list, | |
3274 | and return the previous state as a monadic value. | |
3275 | @end deffn | |
3276 | ||
3277 | @deffn {Monadic Procedure} state-pop | |
3278 | Pop a value from the current state and return it as a monadic value. | |
3279 | The state is assumed to be a list. | |
3280 | @end deffn | |
3281 | ||
3282 | @deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}] | |
3283 | Run monadic value @var{mval} starting with @var{state} as the initial | |
3284 | state. Return two values: the resulting value, and the resulting state. | |
3285 | @end deffn | |
3286 | ||
e87f0591 LC |
3287 | The main interface to the store monad, provided by the @code{(guix |
3288 | store)} module, is as follows. | |
b860f382 LC |
3289 | |
3290 | @defvr {Scheme Variable} %store-monad | |
561fb6c3 LC |
3291 | The store monad---an alias for @var{%state-monad}. |
3292 | ||
3293 | Values in the store monad encapsulate accesses to the store. When its | |
3294 | effect is needed, a value of the store monad must be ``evaluated'' by | |
3295 | passing it to the @code{run-with-store} procedure (see below.) | |
b860f382 LC |
3296 | @end defvr |
3297 | ||
3298 | @deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)] | |
3299 | Run @var{mval}, a monadic value in the store monad, in @var{store}, an | |
3300 | open store connection. | |
3301 | @end deffn | |
3302 | ||
ad372953 | 3303 | @deffn {Monadic Procedure} text-file @var{name} @var{text} [@var{references}] |
b860f382 | 3304 | Return as a monadic value the absolute file name in the store of the file |
ad372953 LC |
3305 | containing @var{text}, a string. @var{references} is a list of store items that the |
3306 | resulting text file refers to; it defaults to the empty list. | |
45adbd62 LC |
3307 | @end deffn |
3308 | ||
0a90af15 LC |
3309 | @deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @ |
3310 | [#:recursive? #t] | |
3311 | Return the name of @var{file} once interned in the store. Use | |
3312 | @var{name} as its store name, or the basename of @var{file} if | |
3313 | @var{name} is omitted. | |
3314 | ||
3315 | When @var{recursive?} is true, the contents of @var{file} are added | |
3316 | recursively; if @var{file} designates a flat file and @var{recursive?} | |
3317 | is true, its contents are added, and its permission bits are kept. | |
3318 | ||
3319 | The example below adds a file to the store, under two different names: | |
3320 | ||
3321 | @example | |
3322 | (run-with-store (open-connection) | |
3323 | (mlet %store-monad ((a (interned-file "README")) | |
3324 | (b (interned-file "README" "LEGU-MIN"))) | |
3325 | (return (list a b)))) | |
3326 | ||
3327 | @result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN") | |
3328 | @end example | |
3329 | ||
3330 | @end deffn | |
3331 | ||
e87f0591 LC |
3332 | The @code{(guix packages)} module exports the following package-related |
3333 | monadic procedures: | |
3334 | ||
b860f382 | 3335 | @deffn {Monadic Procedure} package-file @var{package} [@var{file}] @ |
4231f05b LC |
3336 | [#:system (%current-system)] [#:target #f] @ |
3337 | [#:output "out"] Return as a monadic | |
b860f382 LC |
3338 | value in the absolute file name of @var{file} within the @var{output} |
3339 | directory of @var{package}. When @var{file} is omitted, return the name | |
4231f05b LC |
3340 | of the @var{output} directory of @var{package}. When @var{target} is |
3341 | true, use it as a cross-compilation target triplet. | |
b860f382 LC |
3342 | @end deffn |
3343 | ||
b860f382 | 3344 | @deffn {Monadic Procedure} package->derivation @var{package} [@var{system}] |
4231f05b LC |
3345 | @deffnx {Monadic Procedure} package->cross-derivation @var{package} @ |
3346 | @var{target} [@var{system}] | |
3347 | Monadic version of @code{package-derivation} and | |
3348 | @code{package-cross-derivation} (@pxref{Defining Packages}). | |
b860f382 LC |
3349 | @end deffn |
3350 | ||
3351 | ||
21b679f6 LC |
3352 | @node G-Expressions |
3353 | @section G-Expressions | |
3354 | ||
3355 | @cindex G-expression | |
3356 | @cindex build code quoting | |
3357 | So we have ``derivations'', which represent a sequence of build actions | |
3358 | to be performed to produce an item in the store (@pxref{Derivations}). | |
3359 | Those build actions are performed when asking the daemon to actually | |
3360 | build the derivations; they are run by the daemon in a container | |
3361 | (@pxref{Invoking guix-daemon}). | |
3362 | ||
3363 | @cindex strata of code | |
3364 | It should come as no surprise that we like to write those build actions | |
3365 | in Scheme. When we do that, we end up with two @dfn{strata} of Scheme | |
3366 | code@footnote{The term @dfn{stratum} in this context was coined by | |
ef4ab0a4 LC |
3367 | Manuel Serrano et al.@: in the context of their work on Hop. Oleg |
3368 | Kiselyov, who has written insightful | |
3369 | @url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code | |
3370 | on this topic}, refers to this kind of code generation as | |
3371 | @dfn{staging}.}: the ``host code''---code that defines packages, talks | |
3372 | to the daemon, etc.---and the ``build code''---code that actually | |
3373 | performs build actions, such as making directories, invoking | |
3374 | @command{make}, etc. | |
21b679f6 LC |
3375 | |
3376 | To describe a derivation and its build actions, one typically needs to | |
3377 | embed build code inside host code. It boils down to manipulating build | |
3378 | code as data, and Scheme's homoiconicity---code has a direct | |
3379 | representation as data---comes in handy for that. But we need more than | |
3380 | Scheme's normal @code{quasiquote} mechanism to construct build | |
3381 | expressions. | |
3382 | ||
3383 | The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of | |
3384 | S-expressions adapted to build expressions. G-expressions, or | |
3385 | @dfn{gexps}, consist essentially in three syntactic forms: @code{gexp}, | |
3386 | @code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~}, | |
3387 | @code{#$}, and @code{#$@@}), which are comparable respectively to | |
3388 | @code{quasiquote}, @code{unquote}, and @code{unquote-splicing} | |
3389 | (@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile | |
3390 | Reference Manual}). However, there are major differences: | |
3391 | ||
3392 | @itemize | |
3393 | @item | |
3394 | Gexps are meant to be written to a file and run or manipulated by other | |
3395 | processes. | |
3396 | ||
3397 | @item | |
b39fc6f7 LC |
3398 | When a high-level object such as a package or derivation is unquoted |
3399 | inside a gexp, the result is as if its output file name had been | |
3400 | introduced. | |
ff40e9b7 | 3401 | |
21b679f6 LC |
3402 | @item |
3403 | Gexps carry information about the packages or derivations they refer to, | |
3404 | and these dependencies are automatically added as inputs to the build | |
3405 | processes that use them. | |
3406 | @end itemize | |
3407 | ||
c2b84676 | 3408 | @cindex lowering, of high-level objects in gexps |
343eacbe LC |
3409 | This mechanism is not limited to package and derivation |
3410 | objects: @dfn{compilers} able to ``lower'' other high-level objects to | |
c2b84676 LC |
3411 | derivations or files in the store can be defined, |
3412 | such that these objects can also be inserted | |
343eacbe LC |
3413 | into gexps. For example, a useful type of high-level object that can be |
3414 | inserted in a gexp is ``file-like objects'', which make it easy to | |
3415 | add files to the store and refer to them in | |
558e8b11 LC |
3416 | derivations and such (see @code{local-file} and @code{plain-file} |
3417 | below.) | |
b39fc6f7 | 3418 | |
21b679f6 LC |
3419 | To illustrate the idea, here is an example of a gexp: |
3420 | ||
3421 | @example | |
3422 | (define build-exp | |
3423 | #~(begin | |
3424 | (mkdir #$output) | |
3425 | (chdir #$output) | |
aff8ce7c | 3426 | (symlink (string-append #$coreutils "/bin/ls") |
21b679f6 LC |
3427 | "list-files"))) |
3428 | @end example | |
3429 | ||
3430 | This gexp can be passed to @code{gexp->derivation}; we obtain a | |
3431 | derivation that builds a directory containing exactly one symlink to | |
3432 | @file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}: | |
3433 | ||
3434 | @example | |
3435 | (gexp->derivation "the-thing" build-exp) | |
3436 | @end example | |
3437 | ||
e20fd1bf | 3438 | As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is |
21b679f6 LC |
3439 | substituted to the reference to the @var{coreutils} package in the |
3440 | actual build code, and @var{coreutils} is automatically made an input to | |
3441 | the derivation. Likewise, @code{#$output} (equivalent to @code{(ungexp | |
3442 | output)}) is replaced by a string containing the derivation's output | |
667b2508 LC |
3443 | directory name. |
3444 | ||
3445 | @cindex cross compilation | |
3446 | In a cross-compilation context, it is useful to distinguish between | |
3447 | references to the @emph{native} build of a package---that can run on the | |
3448 | host---versus references to cross builds of a package. To that end, the | |
3449 | @code{#+} plays the same role as @code{#$}, but is a reference to a | |
3450 | native package build: | |
3451 | ||
3452 | @example | |
3453 | (gexp->derivation "vi" | |
3454 | #~(begin | |
3455 | (mkdir #$output) | |
3456 | (system* (string-append #+coreutils "/bin/ln") | |
3457 | "-s" | |
3458 | (string-append #$emacs "/bin/emacs") | |
3459 | (string-append #$output "/bin/vi"))) | |
3460 | #:target "mips64el-linux") | |
3461 | @end example | |
3462 | ||
3463 | @noindent | |
3464 | In the example above, the native build of @var{coreutils} is used, so | |
3465 | that @command{ln} can actually run on the host; but then the | |
3466 | cross-compiled build of @var{emacs} is referenced. | |
3467 | ||
3468 | The syntactic form to construct gexps is summarized below. | |
21b679f6 LC |
3469 | |
3470 | @deffn {Scheme Syntax} #~@var{exp} | |
3471 | @deffnx {Scheme Syntax} (gexp @var{exp}) | |
3472 | Return a G-expression containing @var{exp}. @var{exp} may contain one | |
3473 | or more of the following forms: | |
3474 | ||
3475 | @table @code | |
3476 | @item #$@var{obj} | |
3477 | @itemx (ungexp @var{obj}) | |
b39fc6f7 LC |
3478 | Introduce a reference to @var{obj}. @var{obj} may have one of the |
3479 | supported types, for example a package or a | |
21b679f6 LC |
3480 | derivation, in which case the @code{ungexp} form is replaced by its |
3481 | output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}. | |
3482 | ||
b39fc6f7 LC |
3483 | If @var{obj} is a list, it is traversed and references to supported |
3484 | objects are substituted similarly. | |
21b679f6 LC |
3485 | |
3486 | If @var{obj} is another gexp, its contents are inserted and its | |
3487 | dependencies are added to those of the containing gexp. | |
3488 | ||
3489 | If @var{obj} is another kind of object, it is inserted as is. | |
3490 | ||
b39fc6f7 LC |
3491 | @item #$@var{obj}:@var{output} |
3492 | @itemx (ungexp @var{obj} @var{output}) | |
21b679f6 | 3493 | This is like the form above, but referring explicitly to the |
b39fc6f7 LC |
3494 | @var{output} of @var{obj}---this is useful when @var{obj} produces |
3495 | multiple outputs (@pxref{Packages with Multiple Outputs}). | |
21b679f6 | 3496 | |
667b2508 LC |
3497 | @item #+@var{obj} |
3498 | @itemx #+@var{obj}:output | |
3499 | @itemx (ungexp-native @var{obj}) | |
3500 | @itemx (ungexp-native @var{obj} @var{output}) | |
3501 | Same as @code{ungexp}, but produces a reference to the @emph{native} | |
3502 | build of @var{obj} when used in a cross compilation context. | |
3503 | ||
21b679f6 LC |
3504 | @item #$output[:@var{output}] |
3505 | @itemx (ungexp output [@var{output}]) | |
3506 | Insert a reference to derivation output @var{output}, or to the main | |
3507 | output when @var{output} is omitted. | |
3508 | ||
3509 | This only makes sense for gexps passed to @code{gexp->derivation}. | |
3510 | ||
3511 | @item #$@@@var{lst} | |
3512 | @itemx (ungexp-splicing @var{lst}) | |
3513 | Like the above, but splices the contents of @var{lst} inside the | |
3514 | containing list. | |
3515 | ||
667b2508 LC |
3516 | @item #+@@@var{lst} |
3517 | @itemx (ungexp-native-splicing @var{lst}) | |
3518 | Like the above, but refers to native builds of the objects listed in | |
3519 | @var{lst}. | |
3520 | ||
21b679f6 LC |
3521 | @end table |
3522 | ||
3523 | G-expressions created by @code{gexp} or @code{#~} are run-time objects | |
3524 | of the @code{gexp?} type (see below.) | |
3525 | @end deffn | |
3526 | ||
3527 | @deffn {Scheme Procedure} gexp? @var{obj} | |
3528 | Return @code{#t} if @var{obj} is a G-expression. | |
3529 | @end deffn | |
3530 | ||
3531 | G-expressions are meant to be written to disk, either as code building | |
3532 | some derivation, or as plain files in the store. The monadic procedures | |
3533 | below allow you to do that (@pxref{The Store Monad}, for more | |
3534 | information about monads.) | |
3535 | ||
3536 | @deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @ | |
ce45eb4c | 3537 | [#:system (%current-system)] [#:target #f] [#:graft? #t] @ |
21b679f6 LC |
3538 | [#:hash #f] [#:hash-algo #f] @ |
3539 | [#:recursive? #f] [#:env-vars '()] [#:modules '()] @ | |
4684f301 | 3540 | [#:module-path @var{%load-path}] @ |
c8351d9a | 3541 | [#:references-graphs #f] [#:allowed-references #f] @ |
c0468155 | 3542 | [#:leaked-env-vars #f] @ |
0309e1b0 | 3543 | [#:script-name (string-append @var{name} "-builder")] @ |
4a6aeb67 | 3544 | [#:local-build? #f] [#:substitutable? #t] [#:guile-for-build #f] |
21b679f6 | 3545 | Return a derivation @var{name} that runs @var{exp} (a gexp) with |
0309e1b0 LC |
3546 | @var{guile-for-build} (a derivation) on @var{system}; @var{exp} is |
3547 | stored in a file called @var{script-name}. When @var{target} is true, | |
3548 | it is used as the cross-compilation target triplet for packages referred | |
3549 | to by @var{exp}. | |
21b679f6 | 3550 | |
ce45eb4c LC |
3551 | Make @var{modules} available in the evaluation context of @var{exp}; |
3552 | @var{modules} is a list of names of Guile modules searched in | |
3553 | @var{module-path} to be copied in the store, compiled, and made available in | |
21b679f6 LC |
3554 | the load path during the execution of @var{exp}---e.g., @code{((guix |
3555 | build utils) (guix build gnu-build-system))}. | |
3556 | ||
ce45eb4c LC |
3557 | @var{graft?} determines whether packages referred to by @var{exp} should be grafted when |
3558 | applicable. | |
3559 | ||
b53833b2 LC |
3560 | When @var{references-graphs} is true, it must be a list of tuples of one of the |
3561 | following forms: | |
3562 | ||
3563 | @example | |
3564 | (@var{file-name} @var{package}) | |
3565 | (@var{file-name} @var{package} @var{output}) | |
3566 | (@var{file-name} @var{derivation}) | |
3567 | (@var{file-name} @var{derivation} @var{output}) | |
3568 | (@var{file-name} @var{store-item}) | |
3569 | @end example | |
3570 | ||
3571 | The right-hand-side of each element of @var{references-graphs} is automatically made | |
3572 | an input of the build process of @var{exp}. In the build environment, each | |
3573 | @var{file-name} contains the reference graph of the corresponding item, in a simple | |
3574 | text format. | |
3575 | ||
c8351d9a LC |
3576 | @var{allowed-references} must be either @code{#f} or a list of output names and packages. |
3577 | In the latter case, the list denotes store items that the result is allowed to | |
3578 | refer to. Any reference to another store item will lead to a build error. | |
3579 | ||
e20fd1bf | 3580 | The other arguments are as for @code{derivation} (@pxref{Derivations}). |
21b679f6 LC |
3581 | @end deffn |
3582 | ||
343eacbe | 3583 | @cindex file-like objects |
e1c153e0 LC |
3584 | The @code{local-file}, @code{plain-file}, @code{computed-file}, |
3585 | @code{program-file}, and @code{scheme-file} procedures below return | |
3586 | @dfn{file-like objects}. That is, when unquoted in a G-expression, | |
3587 | these objects lead to a file in the store. Consider this G-expression: | |
343eacbe LC |
3588 | |
3589 | @example | |
3590 | #~(system* (string-append #$glibc "/sbin/nscd") "-f" | |
3591 | #$(local-file "/tmp/my-nscd.conf")) | |
3592 | @end example | |
3593 | ||
3594 | The effect here is to ``intern'' @file{/tmp/my-nscd.conf} by copying it | |
3595 | to the store. Once expanded, for instance @i{via} | |
3596 | @code{gexp->derivation}, the G-expression refers to that copy under | |
3597 | @file{/gnu/store}; thus, modifying or removing the file in @file{/tmp} | |
3598 | does not have any effect on what the G-expression does. | |
3599 | @code{plain-file} can be used similarly; it differs in that the file | |
3600 | content is directly passed as a string. | |
3601 | ||
d9ae938f LC |
3602 | @deffn {Scheme Procedure} local-file @var{file} [@var{name}] @ |
3603 | [#:recursive? #t] | |
3604 | Return an object representing local file @var{file} to add to the store; this | |
9d3994f7 LC |
3605 | object can be used in a gexp. If @var{file} is a relative file name, it is looked |
3606 | up relative to the source file where this form appears. @var{file} will be added to | |
3607 | the store under @var{name}--by default the base name of @var{file}. | |
d9ae938f LC |
3608 | |
3609 | When @var{recursive?} is true, the contents of @var{file} are added recursively; if @var{file} | |
3610 | designates a flat file and @var{recursive?} is true, its contents are added, and its | |
3611 | permission bits are kept. | |
3612 | ||
3613 | This is the declarative counterpart of the @code{interned-file} monadic | |
3614 | procedure (@pxref{The Store Monad, @code{interned-file}}). | |
3615 | @end deffn | |
3616 | ||
558e8b11 LC |
3617 | @deffn {Scheme Procedure} plain-file @var{name} @var{content} |
3618 | Return an object representing a text file called @var{name} with the given | |
3619 | @var{content} (a string) to be added to the store. | |
3620 | ||
3621 | This is the declarative counterpart of @code{text-file}. | |
3622 | @end deffn | |
3623 | ||
91937029 LC |
3624 | @deffn {Scheme Procedure} computed-file @var{name} @var{gexp} @ |
3625 | [#:modules '()] [#:options '(#:local-build? #t)] | |
3626 | Return an object representing the store item @var{name}, a file or | |
3627 | directory computed by @var{gexp}. @var{modules} specifies the set of | |
3628 | modules visible in the execution context of @var{gexp}. @var{options} | |
3629 | is a list of additional arguments to pass to @code{gexp->derivation}. | |
3630 | ||
3631 | This is the declarative counterpart of @code{gexp->derivation}. | |
3632 | @end deffn | |
3633 | ||
21b679f6 LC |
3634 | @deffn {Monadic Procedure} gexp->script @var{name} @var{exp} |
3635 | Return an executable script @var{name} that runs @var{exp} using | |
3636 | @var{guile} with @var{modules} in its search path. | |
3637 | ||
3638 | The example below builds a script that simply invokes the @command{ls} | |
3639 | command: | |
3640 | ||
3641 | @example | |
3642 | (use-modules (guix gexp) (gnu packages base)) | |
3643 | ||
3644 | (gexp->script "list-files" | |
3645 | #~(execl (string-append #$coreutils "/bin/ls") | |
3646 | "ls")) | |
3647 | @end example | |
3648 | ||
3649 | When ``running'' it through the store (@pxref{The Store Monad, | |
e20fd1bf | 3650 | @code{run-with-store}}), we obtain a derivation that produces an |
21b679f6 LC |
3651 | executable file @file{/gnu/store/@dots{}-list-files} along these lines: |
3652 | ||
3653 | @example | |
3654 | #!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds | |
3655 | !# | |
3656 | (execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls") | |
3657 | "ls") | |
3658 | @end example | |
3659 | @end deffn | |
3660 | ||
15a01c72 LC |
3661 | @deffn {Scheme Procedure} program-file @var{name} @var{exp} @ |
3662 | [#:modules '()] [#:guile #f] | |
3663 | Return an object representing the executable store item @var{name} that | |
3664 | runs @var{gexp}. @var{guile} is the Guile package used to execute that | |
3665 | script, and @var{modules} is the list of modules visible to that script. | |
3666 | ||
3667 | This is the declarative counterpart of @code{gexp->script}. | |
3668 | @end deffn | |
3669 | ||
21b679f6 LC |
3670 | @deffn {Monadic Procedure} gexp->file @var{name} @var{exp} |
3671 | Return a derivation that builds a file @var{name} containing @var{exp}. | |
3672 | ||
3673 | The resulting file holds references to all the dependencies of @var{exp} | |
3674 | or a subset thereof. | |
3675 | @end deffn | |
1ed19464 | 3676 | |
e1c153e0 LC |
3677 | @deffn {Scheme Procedure} scheme-file @var{name} @var{exp} |
3678 | Return an object representing the Scheme file @var{name} that contains | |
3679 | @var{exp}. | |
3680 | ||
3681 | This is the declarative counterpart of @code{gexp->file}. | |
3682 | @end deffn | |
3683 | ||
1ed19464 LC |
3684 | @deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{} |
3685 | Return as a monadic value a derivation that builds a text file | |
3686 | containing all of @var{text}. @var{text} may list, in addition to | |
d9ae938f LC |
3687 | strings, objects of any type that can be used in a gexp: packages, |
3688 | derivations, local file objects, etc. The resulting store file holds | |
3689 | references to all these. | |
1ed19464 LC |
3690 | |
3691 | This variant should be preferred over @code{text-file} anytime the file | |
3692 | to create will reference items from the store. This is typically the | |
3693 | case when building a configuration file that embeds store file names, | |
3694 | like this: | |
3695 | ||
3696 | @example | |
3697 | (define (profile.sh) | |
3698 | ;; Return the name of a shell script in the store that | |
3699 | ;; initializes the 'PATH' environment variable. | |
3700 | (text-file* "profile.sh" | |
3701 | "export PATH=" coreutils "/bin:" | |
3702 | grep "/bin:" sed "/bin\n")) | |
3703 | @end example | |
3704 | ||
3705 | In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file | |
3706 | will references @var{coreutils}, @var{grep}, and @var{sed}, thereby | |
3707 | preventing them from being garbage-collected during its lifetime. | |
3708 | @end deffn | |
21b679f6 | 3709 | |
b751cde3 LC |
3710 | @deffn {Scheme Procedure} mixed-text-file @var{name} @var{text} @dots{} |
3711 | Return an object representing store file @var{name} containing | |
3712 | @var{text}. @var{text} is a sequence of strings and file-like objects, | |
3713 | as in: | |
3714 | ||
3715 | @example | |
3716 | (mixed-text-file "profile" | |
3717 | "export PATH=" coreutils "/bin:" grep "/bin") | |
3718 | @end example | |
3719 | ||
3720 | This is the declarative counterpart of @code{text-file*}. | |
3721 | @end deffn | |
3722 | ||
21b679f6 LC |
3723 | Of course, in addition to gexps embedded in ``host'' code, there are |
3724 | also modules containing build tools. To make it clear that they are | |
3725 | meant to be used in the build stratum, these modules are kept in the | |
3726 | @code{(guix build @dots{})} name space. | |
3727 | ||
c2b84676 LC |
3728 | @cindex lowering, of high-level objects in gexps |
3729 | Internally, high-level objects are @dfn{lowered}, using their compiler, | |
3730 | to either derivations or store items. For instance, lowering a package | |
3731 | yields a derivation, and lowering a @code{plain-file} yields a store | |
3732 | item. This is achieved using the @code{lower-object} monadic procedure. | |
3733 | ||
3734 | @deffn {Monadic Procedure} lower-object @var{obj} [@var{system}] @ | |
3735 | [#:target #f] | |
3736 | Return as a value in @var{%store-monad} the derivation or store item | |
3737 | corresponding to @var{obj} for @var{system}, cross-compiling for | |
3738 | @var{target} if @var{target} is true. @var{obj} must be an object that | |
3739 | has an associated gexp compiler, such as a @code{<package>}. | |
3740 | @end deffn | |
3741 | ||
21b679f6 | 3742 | |
568717fd LC |
3743 | @c ********************************************************************* |
3744 | @node Utilities | |
3745 | @chapter Utilities | |
3746 | ||
210cc920 LC |
3747 | This section describes tools primarily targeted at developers and users |
3748 | who write new package definitions. They complement the Scheme | |
3749 | programming interface of Guix in a convenient way. | |
3750 | ||
568717fd | 3751 | @menu |
37166310 | 3752 | * Invoking guix build:: Building packages from the command line. |
39bee8a2 | 3753 | * Invoking guix edit:: Editing package definitions. |
210cc920 | 3754 | * Invoking guix download:: Downloading a file and printing its hash. |
37166310 | 3755 | * Invoking guix hash:: Computing the cryptographic hash of a file. |
2f7d2d91 | 3756 | * Invoking guix import:: Importing package definitions. |
37166310 | 3757 | * Invoking guix refresh:: Updating package definitions. |
b4f5e0e8 | 3758 | * Invoking guix lint:: Finding errors in package definitions. |
fcc58db6 | 3759 | * Invoking guix size:: Profiling disk usage. |
88856916 | 3760 | * Invoking guix graph:: Visualizing the graph of packages. |
372c4bbc | 3761 | * Invoking guix environment:: Setting up development environments. |
aff8ce7c | 3762 | * Invoking guix publish:: Sharing substitutes. |
d23c20f1 | 3763 | * Invoking guix challenge:: Challenging substitute servers. |
32efa254 | 3764 | * Invoking guix container:: Process isolation. |
568717fd LC |
3765 | @end menu |
3766 | ||
e49951eb MW |
3767 | @node Invoking guix build |
3768 | @section Invoking @command{guix build} | |
568717fd | 3769 | |
e49951eb | 3770 | The @command{guix build} command builds packages or derivations and |
6798a8e4 LC |
3771 | their dependencies, and prints the resulting store paths. Note that it |
3772 | does not modify the user's profile---this is the job of the | |
e49951eb | 3773 | @command{guix package} command (@pxref{Invoking guix package}). Thus, |
6798a8e4 LC |
3774 | it is mainly useful for distribution developers. |
3775 | ||
3776 | The general syntax is: | |
c78bd12b LC |
3777 | |
3778 | @example | |
e49951eb | 3779 | guix build @var{options} @var{package-or-derivation}@dots{} |
c78bd12b LC |
3780 | @end example |
3781 | ||
3782 | @var{package-or-derivation} may be either the name of a package found in | |
5401dd75 LC |
3783 | the software distribution such as @code{coreutils} or |
3784 | @code{coreutils-8.20}, or a derivation such as | |
834129e0 | 3785 | @file{/gnu/store/@dots{}-coreutils-8.19.drv}. In the former case, a |
e7f34eb0 LC |
3786 | package with the corresponding name (and optionally version) is searched |
3787 | for among the GNU distribution modules (@pxref{Package Modules}). | |
3788 | ||
3789 | Alternatively, the @code{--expression} option may be used to specify a | |
3790 | Scheme expression that evaluates to a package; this is useful when | |
3791 | disambiguation among several same-named packages or package variants is | |
3792 | needed. | |
c78bd12b LC |
3793 | |
3794 | The @var{options} may be zero or more of the following: | |
3795 | ||
3796 | @table @code | |
3797 | ||
34a1783f DT |
3798 | @item --file=@var{file} |
3799 | @itemx -f @var{file} | |
3800 | ||
3801 | Build the package or derivation that the code within @var{file} | |
3802 | evaluates to. | |
3803 | ||
3804 | As an example, @var{file} might contain a package definition like this | |
3805 | (@pxref{Defining Packages}): | |
3806 | ||
3807 | @example | |
3808 | @verbatiminclude package-hello.scm | |
3809 | @end example | |
3810 | ||
c78bd12b LC |
3811 | @item --expression=@var{expr} |
3812 | @itemx -e @var{expr} | |
ac5de156 | 3813 | Build the package or derivation @var{expr} evaluates to. |
c78bd12b | 3814 | |
5401dd75 | 3815 | For example, @var{expr} may be @code{(@@ (gnu packages guile) |
c78bd12b LC |
3816 | guile-1.8)}, which unambiguously designates this specific variant of |
3817 | version 1.8 of Guile. | |
3818 | ||
56b82106 LC |
3819 | Alternately, @var{expr} may be a G-expression, in which case it is used |
3820 | as a build program passed to @code{gexp->derivation} | |
3821 | (@pxref{G-Expressions}). | |
3822 | ||
3823 | Lastly, @var{expr} may refer to a zero-argument monadic procedure | |
ac5de156 LC |
3824 | (@pxref{The Store Monad}). The procedure must return a derivation as a |
3825 | monadic value, which is then passed through @code{run-with-store}. | |
3826 | ||
c78bd12b LC |
3827 | @item --source |
3828 | @itemx -S | |
3829 | Build the packages' source derivations, rather than the packages | |
3830 | themselves. | |
3831 | ||
e49951eb | 3832 | For instance, @code{guix build -S gcc} returns something like |
834129e0 | 3833 | @file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball. |
c78bd12b | 3834 | |
f9cc8971 LC |
3835 | The returned source tarball is the result of applying any patches and |
3836 | code snippets specified in the package's @code{origin} (@pxref{Defining | |
3837 | Packages}). | |
3838 | ||
2cdfe13d EB |
3839 | @item --sources |
3840 | Fetch and return the source of @var{package-or-derivation} and all their | |
3841 | dependencies, recursively. This is a handy way to obtain a local copy | |
3842 | of all the source code needed to build @var{packages}, allowing you to | |
3843 | eventually build them even without network access. It is an extension | |
3844 | of the @code{--source} option and can accept one of the following | |
3845 | optional argument values: | |
3846 | ||
3847 | @table @code | |
3848 | @item package | |
3849 | This value causes the @code{--sources} option to behave in the same way | |
3850 | as the @code{--source} option. | |
3851 | ||
3852 | @item all | |
3853 | Build all packages' source derivations, including any source that might | |
3854 | be listed as @code{inputs}. This is the default value. | |
3855 | ||
3856 | @example | |
3857 | $ guix build --sources tzdata | |
3858 | The following derivations will be built: | |
3859 | /gnu/store/@dots{}-tzdata2015b.tar.gz.drv | |
3860 | /gnu/store/@dots{}-tzcode2015b.tar.gz.drv | |
3861 | @end example | |
3862 | ||
3863 | @item transitive | |
3864 | Build all packages' source derivations, as well as all source | |
3865 | derivations for packages' transitive inputs. This can be used e.g. to | |
3866 | prefetch package source for later offline building. | |
3867 | ||
3868 | @example | |
3869 | $ guix build --sources=transitive tzdata | |
3870 | The following derivations will be built: | |
3871 | /gnu/store/@dots{}-tzcode2015b.tar.gz.drv | |
3872 | /gnu/store/@dots{}-findutils-4.4.2.tar.xz.drv | |
3873 | /gnu/store/@dots{}-grep-2.21.tar.xz.drv | |
3874 | /gnu/store/@dots{}-coreutils-8.23.tar.xz.drv | |
3875 | /gnu/store/@dots{}-make-4.1.tar.xz.drv | |
3876 | /gnu/store/@dots{}-bash-4.3.tar.xz.drv | |
3877 | @dots{} | |
3878 | @end example | |
3879 | ||
3880 | @end table | |
3881 | ||
c78bd12b LC |
3882 | @item --system=@var{system} |
3883 | @itemx -s @var{system} | |
3884 | Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of | |
3885 | the host's system type. | |
3886 | ||
3887 | An example use of this is on Linux-based systems, which can emulate | |
3888 | different personalities. For instance, passing | |
3889 | @code{--system=i686-linux} on an @code{x86_64-linux} system allows users | |
3890 | to build packages in a complete 32-bit environment. | |
3891 | ||
e55ec43d LC |
3892 | @item --target=@var{triplet} |
3893 | @cindex cross-compilation | |
3894 | Cross-build for @var{triplet}, which must be a valid GNU triplet, such | |
3895 | as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU | |
3896 | configuration triplets,, configure, GNU Configure and Build System}). | |
3897 | ||
7f3673f2 LC |
3898 | @item --with-source=@var{source} |
3899 | Use @var{source} as the source of the corresponding package. | |
3900 | @var{source} must be a file name or a URL, as for @command{guix | |
3901 | download} (@pxref{Invoking guix download}). | |
3902 | ||
3903 | The ``corresponding package'' is taken to be one specified on the | |
3904 | command line whose name matches the base of @var{source}---e.g., if | |
3905 | @var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding | |
3906 | package is @code{guile}. Likewise, the version string is inferred from | |
3907 | @var{source}; in the previous example, it's @code{2.0.10}. | |
3908 | ||
3909 | This option allows users to try out versions of packages other than the | |
3910 | one provided by the distribution. The example below downloads | |
3911 | @file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for | |
3912 | the @code{ed} package: | |
3913 | ||
3914 | @example | |
3915 | guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz | |
3916 | @end example | |
3917 | ||
3918 | As a developer, @code{--with-source} makes it easy to test release | |
3919 | candidates: | |
3920 | ||
3921 | @example | |
3922 | guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz | |
3923 | @end example | |
3924 | ||
a43b55f1 LC |
3925 | @dots{} or to build from a checkout in a pristine environment: |
3926 | ||
3927 | @example | |
3928 | $ git clone git://git.sv.gnu.org/guix.git | |
3929 | $ guix build guix --with-source=./guix | |
3930 | @end example | |
3931 | ||
a8d65643 LC |
3932 | @anchor{build-check} |
3933 | @item --check | |
3934 | @cindex determinism, checking | |
3935 | @cindex reproducibility, checking | |
3936 | Rebuild @var{package-or-derivation}, which are already available in the | |
3937 | store, and raise an error if the build results are not bit-for-bit | |
3938 | identical. | |
3939 | ||
3940 | This mechanism allows you to check whether previously-installed | |
3941 | substitutes are genuine (@pxref{Substitutes}), or whether a package's | |
3942 | build result is deterministic. @xref{Invoking guix challenge}, for more | |
3943 | background information and tools. | |
3944 | ||
05962f29 LC |
3945 | @item --no-grafts |
3946 | Do not ``graft'' packages. In practice, this means that package updates | |
3947 | available as grafts are not applied. @xref{Security Updates}, for more | |
3948 | information on grafts. | |
7f3673f2 | 3949 | |
c78bd12b LC |
3950 | @item --derivations |
3951 | @itemx -d | |
3952 | Return the derivation paths, not the output paths, of the given | |
3953 | packages. | |
3954 | ||
70ee5642 LC |
3955 | @item --root=@var{file} |
3956 | @itemx -r @var{file} | |
3957 | Make @var{file} a symlink to the result, and register it as a garbage | |
3958 | collector root. | |
3959 | ||
3960 | @item --log-file | |
3f208ad7 | 3961 | Return the build log file names or URLs for the given |
70ee5642 LC |
3962 | @var{package-or-derivation}s, or raise an error if build logs are |
3963 | missing. | |
3964 | ||
3965 | This works regardless of how packages or derivations are specified. For | |
3966 | instance, the following invocations are equivalent: | |
3967 | ||
3968 | @example | |
3969 | guix build --log-file `guix build -d guile` | |
3970 | guix build --log-file `guix build guile` | |
3971 | guix build --log-file guile | |
3972 | guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)' | |
3973 | @end example | |
3974 | ||
3f208ad7 LC |
3975 | If a log is unavailable locally, and unless @code{--no-substitutes} is |
3976 | passed, the command looks for a corresponding log on one of the | |
3977 | substitute servers (as specified with @code{--substitute-urls}.) | |
70ee5642 | 3978 | |
3f208ad7 LC |
3979 | So for instance, let's say you want to see the build log of GDB on MIPS |
3980 | but you're actually on an @code{x86_64} machine: | |
3981 | ||
3982 | @example | |
3983 | $ guix build --log-file gdb -s mips64el-linux | |
3984 | http://hydra.gnu.org/log/@dots{}-gdb-7.10 | |
3985 | @end example | |
3986 | ||
3987 | You can freely access a huge library of build logs! | |
70ee5642 LC |
3988 | @end table |
3989 | ||
3990 | @cindex common build options | |
3991 | In addition, a number of options that control the build process are | |
3992 | common to @command{guix build} and other commands that can spawn builds, | |
3993 | such as @command{guix package} or @command{guix archive}. These are the | |
3994 | following: | |
3995 | ||
3996 | @table @code | |
3997 | ||
300868ba LC |
3998 | @item --load-path=@var{directory} |
3999 | @itemx -L @var{directory} | |
4000 | Add @var{directory} to the front of the package module search path | |
4001 | (@pxref{Package Modules}). | |
4002 | ||
4003 | This allows users to define their own packages and make them visible to | |
4004 | the command-line tools. | |
4005 | ||
c78bd12b LC |
4006 | @item --keep-failed |
4007 | @itemx -K | |
4008 | Keep the build tree of failed builds. Thus, if a build fail, its build | |
4009 | tree is kept under @file{/tmp}, in a directory whose name is shown at | |
4010 | the end of the build log. This is useful when debugging build issues. | |
4011 | ||
f4953019 LC |
4012 | @item --keep-going |
4013 | @itemx -k | |
4014 | Keep going when some of the derivations fail to build; return only once | |
4015 | all the builds have either completed or failed. | |
4016 | ||
4017 | The default behavior is to stop as soon as one of the specified | |
4018 | derivations has failed. | |
4019 | ||
c78bd12b LC |
4020 | @item --dry-run |
4021 | @itemx -n | |
4022 | Do not build the derivations. | |
4023 | ||
56b1f4b7 LC |
4024 | @item --fallback |
4025 | When substituting a pre-built binary fails, fall back to building | |
4026 | packages locally. | |
4027 | ||
f8a8e0fe LC |
4028 | @item --substitute-urls=@var{urls} |
4029 | @anchor{client-substitute-urls} | |
4030 | Consider @var{urls} the whitespace-separated list of substitute source | |
4031 | URLs, overriding the default list of URLs of @command{guix-daemon} | |
4032 | (@pxref{daemon-substitute-urls,, @command{guix-daemon} URLs}). | |
4033 | ||
4034 | This means that substitutes may be downloaded from @var{urls}, provided | |
4035 | they are signed by a key authorized by the system administrator | |
4036 | (@pxref{Substitutes}). | |
4037 | ||
c78bd12b | 4038 | @item --no-substitutes |
b5385b52 | 4039 | Do not use substitutes for build products. That is, always build things |
c4202d60 LC |
4040 | locally instead of allowing downloads of pre-built binaries |
4041 | (@pxref{Substitutes}). | |
c78bd12b | 4042 | |
5b74fe06 LC |
4043 | @item --rounds=@var{n} |
4044 | Build each derivation @var{n} times in a row, and raise an error if | |
4045 | consecutive build results are not bit-for-bit identical. | |
4046 | ||
4047 | This is a useful way to detect non-deterministic builds processes. | |
4048 | Non-deterministic build processes are a problem because they make it | |
4049 | practically impossible for users to @emph{verify} whether third-party | |
4050 | binaries are genuine. @xref{Invoking guix challenge}, for more. | |
4051 | ||
4052 | Note that, currently, the differing build results are not kept around, | |
4053 | so you will have to manually investigate in case of an error---e.g., by | |
4054 | stashing one of the build results with @code{guix archive --export}, | |
4055 | then rebuilding, and finally comparing the two results. | |
4056 | ||
425b0bfc | 4057 | @item --no-build-hook |
4ec2e92d LC |
4058 | Do not attempt to offload builds @i{via} the daemon's ``build hook'' |
4059 | (@pxref{Daemon Offload Setup}). That is, always build things locally | |
4060 | instead of offloading builds to remote machines. | |
425b0bfc | 4061 | |
969e678e LC |
4062 | @item --max-silent-time=@var{seconds} |
4063 | When the build or substitution process remains silent for more than | |
4064 | @var{seconds}, terminate it and report a build failure. | |
4065 | ||
002622b6 LC |
4066 | @item --timeout=@var{seconds} |
4067 | Likewise, when the build or substitution process lasts for more than | |
4068 | @var{seconds}, terminate it and report a build failure. | |
4069 | ||
4070 | By default there is no timeout. This behavior can be restored with | |
4071 | @code{--timeout=0}. | |
4072 | ||
07ab4bf1 LC |
4073 | @item --verbosity=@var{level} |
4074 | Use the given verbosity level. @var{level} must be an integer between 0 | |
4075 | and 5; higher means more verbose output. Setting a level of 4 or more | |
4076 | may be helpful when debugging setup issues with the build daemon. | |
4077 | ||
70ee5642 LC |
4078 | @item --cores=@var{n} |
4079 | @itemx -c @var{n} | |
4080 | Allow the use of up to @var{n} CPU cores for the build. The special | |
4081 | value @code{0} means to use as many CPU cores as available. | |
bf421152 | 4082 | |
f6526eb3 LC |
4083 | @item --max-jobs=@var{n} |
4084 | @itemx -M @var{n} | |
4085 | Allow at most @var{n} build jobs in parallel. @xref{Invoking | |
4086 | guix-daemon, @code{--max-jobs}}, for details about this option and the | |
4087 | equivalent @command{guix-daemon} option. | |
4088 | ||
c78bd12b LC |
4089 | @end table |
4090 | ||
e49951eb | 4091 | Behind the scenes, @command{guix build} is essentially an interface to |
c78bd12b LC |
4092 | the @code{package-derivation} procedure of the @code{(guix packages)} |
4093 | module, and to the @code{build-derivations} procedure of the @code{(guix | |
01d8ac64 | 4094 | derivations)} module. |
c78bd12b | 4095 | |
16eb115e DP |
4096 | In addition to options explicitly passed on the command line, |
4097 | @command{guix build} and other @command{guix} commands that support | |
4098 | building honor the @code{GUIX_BUILD_OPTIONS} environment variable. | |
4099 | ||
4100 | @defvr {Environment Variable} GUIX_BUILD_OPTIONS | |
4101 | Users can define this variable to a list of command line options that | |
4102 | will automatically be used by @command{guix build} and other | |
4103 | @command{guix} commands that can perform builds, as in the example | |
4104 | below: | |
4105 | ||
4106 | @example | |
4107 | $ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar" | |
4108 | @end example | |
4109 | ||
847391fe DP |
4110 | These options are parsed independently, and the result is appended to |
4111 | the parsed command-line options. | |
16eb115e DP |
4112 | @end defvr |
4113 | ||
4114 | ||
39bee8a2 LC |
4115 | @node Invoking guix edit |
4116 | @section Invoking @command{guix edit} | |
4117 | ||
4118 | @cindex package definition, editing | |
4119 | So many packages, so many source files! The @command{guix edit} command | |
4120 | facilitates the life of packagers by pointing their editor at the source | |
4121 | file containing the definition of the specified packages. For instance: | |
4122 | ||
4123 | @example | |
4124 | guix edit gcc-4.8 vim | |
4125 | @end example | |
4126 | ||
4127 | @noindent | |
6237b9fa LC |
4128 | launches the program specified in the @code{VISUAL} or in the |
4129 | @code{EDITOR} environment variable to edit the recipe of GCC@tie{}4.8.4 | |
4130 | and that of Vim. | |
39bee8a2 LC |
4131 | |
4132 | If you are using Emacs, note that the Emacs user interface provides | |
6248e326 AK |
4133 | similar functionality in the ``package info'' and ``package list'' |
4134 | buffers created by @kbd{M-x guix-search-by-name} and similar commands | |
4135 | (@pxref{Emacs Commands}). | |
39bee8a2 LC |
4136 | |
4137 | ||
210cc920 LC |
4138 | @node Invoking guix download |
4139 | @section Invoking @command{guix download} | |
4140 | ||
4141 | When writing a package definition, developers typically need to download | |
4142 | the package's source tarball, compute its SHA256 hash, and write that | |
4143 | hash in the package definition (@pxref{Defining Packages}). The | |
4144 | @command{guix download} tool helps with this task: it downloads a file | |
4145 | from the given URI, adds it to the store, and prints both its file name | |
4146 | in the store and its SHA256 hash. | |
4147 | ||
4148 | The fact that the downloaded file is added to the store saves bandwidth: | |
4149 | when the developer eventually tries to build the newly defined package | |
4150 | with @command{guix build}, the source tarball will not have to be | |
4151 | downloaded again because it is already in the store. It is also a | |
4152 | convenient way to temporarily stash files, which may be deleted | |
4153 | eventually (@pxref{Invoking guix gc}). | |
4154 | ||
4155 | The @command{guix download} command supports the same URIs as used in | |
4156 | package definitions. In particular, it supports @code{mirror://} URIs. | |
4157 | @code{https} URIs (HTTP over TLS) are supported @emph{provided} the | |
4158 | Guile bindings for GnuTLS are available in the user's environment; when | |
537c8bb3 LC |
4159 | they are not available, an error is raised. @xref{Guile Preparations, |
4160 | how to install the GnuTLS bindings for Guile,, gnutls-guile, | |
4161 | GnuTLS-Guile}, for more information. | |
210cc920 LC |
4162 | |
4163 | The following option is available: | |
4164 | ||
4165 | @table @code | |
4166 | @item --format=@var{fmt} | |
4167 | @itemx -f @var{fmt} | |
4168 | Write the hash in the format specified by @var{fmt}. For more | |
081145cf | 4169 | information on the valid values for @var{fmt}, @pxref{Invoking guix hash}. |
210cc920 LC |
4170 | @end table |
4171 | ||
6c365eca NK |
4172 | @node Invoking guix hash |
4173 | @section Invoking @command{guix hash} | |
4174 | ||
210cc920 | 4175 | The @command{guix hash} command computes the SHA256 hash of a file. |
6c365eca NK |
4176 | It is primarily a convenience tool for anyone contributing to the |
4177 | distribution: it computes the cryptographic hash of a file, which can be | |
4178 | used in the definition of a package (@pxref{Defining Packages}). | |
4179 | ||
4180 | The general syntax is: | |
4181 | ||
4182 | @example | |
4183 | guix hash @var{option} @var{file} | |
4184 | @end example | |
4185 | ||
4186 | @command{guix hash} has the following option: | |
4187 | ||
4188 | @table @code | |
4189 | ||
4190 | @item --format=@var{fmt} | |
4191 | @itemx -f @var{fmt} | |
210cc920 | 4192 | Write the hash in the format specified by @var{fmt}. |
6c365eca NK |
4193 | |
4194 | Supported formats: @code{nix-base32}, @code{base32}, @code{base16} | |
4195 | (@code{hex} and @code{hexadecimal} can be used as well). | |
4196 | ||
4197 | If the @option{--format} option is not specified, @command{guix hash} | |
4198 | will output the hash in @code{nix-base32}. This representation is used | |
4199 | in the definitions of packages. | |
4200 | ||
3140f2df LC |
4201 | @item --recursive |
4202 | @itemx -r | |
4203 | Compute the hash on @var{file} recursively. | |
4204 | ||
4205 | In this case, the hash is computed on an archive containing @var{file}, | |
4206 | including its children if it is a directory. Some of @var{file}'s | |
4207 | meta-data is part of the archive; for instance, when @var{file} is a | |
4208 | regular file, the hash is different depending on whether @var{file} is | |
4209 | executable or not. Meta-data such as time stamps has no impact on the | |
4210 | hash (@pxref{Invoking guix archive}). | |
4211 | @c FIXME: Replace xref above with xref to an ``Archive'' section when | |
4212 | @c it exists. | |
4213 | ||
6c365eca NK |
4214 | @end table |
4215 | ||
2f7d2d91 LC |
4216 | @node Invoking guix import |
4217 | @section Invoking @command{guix import} | |
4218 | ||
4219 | @cindex importing packages | |
4220 | @cindex package import | |
4221 | @cindex package conversion | |
4222 | The @command{guix import} command is useful for people willing to add a | |
4223 | package to the distribution but who'd rather do as little work as | |
4224 | possible to get there---a legitimate demand. The command knows of a few | |
4225 | repositories from which it can ``import'' package meta-data. The result | |
4226 | is a package definition, or a template thereof, in the format we know | |
4227 | (@pxref{Defining Packages}). | |
4228 | ||
4229 | The general syntax is: | |
4230 | ||
4231 | @example | |
4232 | guix import @var{importer} @var{options}@dots{} | |
4233 | @end example | |
4234 | ||
4235 | @var{importer} specifies the source from which to import package | |
4236 | meta-data, and @var{options} specifies a package identifier and other | |
4237 | options specific to @var{importer}. Currently, the available | |
4238 | ``importers'' are: | |
4239 | ||
4240 | @table @code | |
4241 | @item gnu | |
4242 | Import meta-data for the given GNU package. This provides a template | |
4243 | for the latest version of that GNU package, including the hash of its | |
4244 | source tarball, and its canonical synopsis and description. | |
4245 | ||
4246 | Additional information such as the package's dependencies and its | |
4247 | license needs to be figured out manually. | |
4248 | ||
4249 | For example, the following command returns a package definition for | |
4250 | GNU@tie{}Hello: | |
4251 | ||
4252 | @example | |
4253 | guix import gnu hello | |
4254 | @end example | |
4255 | ||
4256 | Specific command-line options are: | |
4257 | ||
4258 | @table @code | |
4259 | @item --key-download=@var{policy} | |
4260 | As for @code{guix refresh}, specify the policy to handle missing OpenPGP | |
4261 | keys when verifying the package's signature. @xref{Invoking guix | |
4262 | refresh, @code{--key-download}}. | |
4263 | @end table | |
4264 | ||
4265 | @item pypi | |
4266 | @cindex pypi | |
4267 | Import meta-data from the @uref{https://pypi.python.org/, Python Package | |
4268 | Index}@footnote{This functionality requires Guile-JSON to be installed. | |
4269 | @xref{Requirements}.}. Information is taken from the JSON-formatted | |
4270 | description available at @code{pypi.python.org} and usually includes all | |
4271 | the relevant information, including package dependencies. | |
4272 | ||
4273 | The command below imports meta-data for the @code{itsdangerous} Python | |
4274 | package: | |
4275 | ||
4276 | @example | |
4277 | guix import pypi itsdangerous | |
4278 | @end example | |
4279 | ||
3aae8145 DT |
4280 | @item gem |
4281 | @cindex gem | |
4282 | Import meta-data from @uref{https://rubygems.org/, | |
4283 | RubyGems}@footnote{This functionality requires Guile-JSON to be | |
4284 | installed. @xref{Requirements}.}. Information is taken from the | |
4285 | JSON-formatted description available at @code{rubygems.org} and includes | |
4286 | most relevant information, including runtime dependencies. There are | |
4287 | some caveats, however. The meta-data doesn't distinguish between | |
4288 | synopses and descriptions, so the same string is used for both fields. | |
4289 | Additionally, the details of non-Ruby dependencies required to build | |
4290 | native extensions is unavailable and left as an exercise to the | |
4291 | packager. | |
4292 | ||
4293 | The command below imports meta-data for the @code{rails} Ruby package: | |
4294 | ||
4295 | @example | |
4296 | guix import gem rails | |
4297 | @end example | |
4298 | ||
d45dc6da EB |
4299 | @item cpan |
4300 | @cindex CPAN | |
4301 | Import meta-data from @uref{https://www.metacpan.org/, MetaCPAN}. | |
4302 | Information is taken from the JSON-formatted meta-data provided through | |
4303 | @uref{https://api.metacpan.org/, MetaCPAN's API} and includes most | |
66392e47 EB |
4304 | relevant information, such as module dependencies. License information |
4305 | should be checked closely. If Perl is available in the store, then the | |
4306 | @code{corelist} utility will be used to filter core modules out of the | |
4307 | list of dependencies. | |
d45dc6da EB |
4308 | |
4309 | The command command below imports meta-data for the @code{Acme::Boolean} | |
4310 | Perl module: | |
4311 | ||
4312 | @example | |
4313 | guix import cpan Acme::Boolean | |
4314 | @end example | |
4315 | ||
e1248602 RW |
4316 | @item cran |
4317 | @cindex CRAN | |
d0bd632f | 4318 | @cindex Bioconductor |
e1248602 RW |
4319 | Import meta-data from @uref{http://cran.r-project.org/, CRAN}, the |
4320 | central repository for the @uref{http://r-project.org, GNU@tie{}R | |
4321 | statistical and graphical environment}. | |
4322 | ||
d0bd632f | 4323 | Information is extracted from the package's @code{DESCRIPTION} file. |
e1248602 RW |
4324 | |
4325 | The command command below imports meta-data for the @code{Cairo} | |
4326 | R package: | |
4327 | ||
4328 | @example | |
4329 | guix import cran Cairo | |
4330 | @end example | |
4331 | ||
d0bd632f RW |
4332 | When @code{--archive=bioconductor} is added, meta-data is imported from |
4333 | @uref{http://www.bioconductor.org/, Bioconductor}, a repository of R | |
4334 | packages for for the analysis and comprehension of high-throughput | |
4335 | genomic data in bioinformatics. | |
4336 | ||
4337 | Information is extracted from a package's @code{DESCRIPTION} file | |
4338 | published on the web interface of the Bioconductor SVN repository. | |
4339 | ||
4340 | The command command below imports meta-data for the @code{GenomicRanges} | |
4341 | R package: | |
4342 | ||
4343 | @example | |
4344 | guix import cran --archive=bioconductor GenomicRanges | |
4345 | @end example | |
4346 | ||
2f7d2d91 LC |
4347 | @item nix |
4348 | Import meta-data from a local copy of the source of the | |
4349 | @uref{http://nixos.org/nixpkgs/, Nixpkgs distribution}@footnote{This | |
4350 | relies on the @command{nix-instantiate} command of | |
4351 | @uref{http://nixos.org/nix/, Nix}.}. Package definitions in Nixpkgs are | |
4352 | typically written in a mixture of Nix-language and Bash code. This | |
4353 | command only imports the high-level package structure that is written in | |
4354 | the Nix language. It normally includes all the basic fields of a | |
4355 | package definition. | |
4356 | ||
4357 | When importing a GNU package, the synopsis and descriptions are replaced | |
4358 | by their canonical upstream variant. | |
4359 | ||
961d0d2d LC |
4360 | Usually, you will first need to do: |
4361 | ||
4362 | @example | |
4363 | export NIX_REMOTE=daemon | |
4364 | @end example | |
4365 | ||
4366 | @noindent | |
4367 | so that @command{nix-instantiate} does not try to open the Nix database. | |
4368 | ||
2f7d2d91 LC |
4369 | As an example, the command below imports the package definition of |
4370 | LibreOffice (more precisely, it imports the definition of the package | |
4371 | bound to the @code{libreoffice} top-level attribute): | |
4372 | ||
4373 | @example | |
4374 | guix import nix ~/path/to/nixpkgs libreoffice | |
4375 | @end example | |
863af4e1 FB |
4376 | |
4377 | @item hackage | |
4378 | @cindex hackage | |
4379 | Import meta-data from Haskell community's central package archive | |
4380 | @uref{https://hackage.haskell.org/, Hackage}. Information is taken from | |
4381 | Cabal files and includes all the relevant information, including package | |
4382 | dependencies. | |
4383 | ||
4384 | Specific command-line options are: | |
4385 | ||
4386 | @table @code | |
a4154748 FB |
4387 | @item --stdin |
4388 | @itemx -s | |
4389 | Read a Cabal file from the standard input. | |
863af4e1 FB |
4390 | @item --no-test-dependencies |
4391 | @itemx -t | |
a4154748 FB |
4392 | Do not include dependencies required by the test suites only. |
4393 | @item --cabal-environment=@var{alist} | |
4394 | @itemx -e @var{alist} | |
4395 | @var{alist} is a Scheme alist defining the environment in which the | |
4396 | Cabal conditionals are evaluated. The accepted keys are: @code{os}, | |
4397 | @code{arch}, @code{impl} and a string representing the name of a flag. | |
4398 | The value associated with a flag has to be either the symbol | |
4399 | @code{true} or @code{false}. The value associated with other keys | |
4400 | has to conform to the Cabal file format definition. The default value | |
4401 | associated with the keys @code{os}, @code{arch} and @code{impl} is | |
4402 | @samp{linux}, @samp{x86_64} and @samp{ghc} respectively. | |
863af4e1 FB |
4403 | @end table |
4404 | ||
4405 | The command below imports meta-data for the latest version of the | |
a4154748 FB |
4406 | @code{HTTP} Haskell package without including test dependencies and |
4407 | specifying the value of the flag @samp{network-uri} as @code{false}: | |
863af4e1 FB |
4408 | |
4409 | @example | |
a4154748 | 4410 | guix import hackage -t -e "'((\"network-uri\" . false))" HTTP |
863af4e1 FB |
4411 | @end example |
4412 | ||
4413 | A specific package version may optionally be specified by following the | |
4414 | package name by a hyphen and a version number as in the following example: | |
4415 | ||
4416 | @example | |
4417 | guix import hackage mtl-2.1.3.1 | |
4418 | @end example | |
7f74a931 FB |
4419 | |
4420 | @item elpa | |
4421 | @cindex elpa | |
4422 | Import meta-data from an Emacs Lisp Package Archive (ELPA) package | |
4423 | repository (@pxref{Packages,,, emacs, The GNU Emacs Manual}). | |
4424 | ||
4425 | Specific command-line options are: | |
4426 | ||
4427 | @table @code | |
4428 | @item --archive=@var{repo} | |
4429 | @itemx -a @var{repo} | |
4430 | @var{repo} identifies the archive repository from which to retrieve the | |
4431 | information. Currently the supported repositories and their identifiers | |
4432 | are: | |
4433 | @itemize - | |
4434 | @item | |
840bd1d3 | 4435 | @uref{http://elpa.gnu.org/packages, GNU}, selected by the @code{gnu} |
7f74a931 FB |
4436 | identifier. This is the default. |
4437 | ||
4438 | @item | |
840bd1d3 | 4439 | @uref{http://stable.melpa.org/packages, MELPA-Stable}, selected by the |
7f74a931 FB |
4440 | @code{melpa-stable} identifier. |
4441 | ||
4442 | @item | |
840bd1d3 | 4443 | @uref{http://melpa.org/packages, MELPA}, selected by the @code{melpa} |
7f74a931 FB |
4444 | identifier. |
4445 | @end itemize | |
4446 | @end table | |
2f7d2d91 LC |
4447 | @end table |
4448 | ||
4449 | The structure of the @command{guix import} code is modular. It would be | |
4450 | useful to have more importers for other package formats, and your help | |
4451 | is welcome here (@pxref{Contributing}). | |
4452 | ||
37166310 LC |
4453 | @node Invoking guix refresh |
4454 | @section Invoking @command{guix refresh} | |
4455 | ||
4456 | The primary audience of the @command{guix refresh} command is developers | |
4457 | of the GNU software distribution. By default, it reports any packages | |
4458 | provided by the distribution that are outdated compared to the latest | |
4459 | upstream version, like this: | |
4460 | ||
4461 | @example | |
4462 | $ guix refresh | |
4463 | gnu/packages/gettext.scm:29:13: gettext would be upgraded from 0.18.1.1 to 0.18.2.1 | |
4464 | gnu/packages/glib.scm:77:12: glib would be upgraded from 2.34.3 to 2.37.0 | |
4465 | @end example | |
4466 | ||
4467 | It does so by browsing each package's FTP directory and determining the | |
bcb571cb LC |
4468 | highest version number of the source tarballs therein. The command |
4469 | knows how to update specific types of packages: GNU packages, ELPA | |
4470 | packages, etc.---see the documentation for @option{--type} below. The | |
4471 | are many packages, though, for which it lacks a method to determine | |
4472 | whether a new upstream release is available. However, the mechanism is | |
4473 | extensible, so feel free to get in touch with us to add a new method! | |
37166310 LC |
4474 | |
4475 | When passed @code{--update}, it modifies distribution source files to | |
4476 | update the version numbers and source tarball hashes of those packages' | |
4477 | recipes (@pxref{Defining Packages}). This is achieved by downloading | |
4478 | each package's latest source tarball and its associated OpenPGP | |
4479 | signature, authenticating the downloaded tarball against its signature | |
4480 | using @command{gpg}, and finally computing its hash. When the public | |
4481 | key used to sign the tarball is missing from the user's keyring, an | |
4482 | attempt is made to automatically retrieve it from a public key server; | |
4483 | when it's successful, the key is added to the user's keyring; otherwise, | |
4484 | @command{guix refresh} reports an error. | |
4485 | ||
4486 | The following options are supported: | |
4487 | ||
4488 | @table @code | |
4489 | ||
2d7fc7da LC |
4490 | @item --expression=@var{expr} |
4491 | @itemx -e @var{expr} | |
4492 | Consider the package @var{expr} evaluates to. | |
4493 | ||
4494 | This is useful to precisely refer to a package, as in this example: | |
4495 | ||
4496 | @example | |
4497 | guix refresh -l -e '(@@@@ (gnu packages commencement) glibc-final)' | |
4498 | @end example | |
4499 | ||
4500 | This command lists the dependents of the ``final'' libc (essentially all | |
4501 | the packages.) | |
4502 | ||
37166310 LC |
4503 | @item --update |
4504 | @itemx -u | |
38e16b49 LC |
4505 | Update distribution source files (package recipes) in place. This is |
4506 | usually run from a checkout of the Guix source tree (@pxref{Running | |
4507 | Guix Before It Is Installed}): | |
4508 | ||
4509 | @example | |
4510 | $ ./pre-inst-env guix refresh -s non-core | |
4511 | @end example | |
4512 | ||
081145cf | 4513 | @xref{Defining Packages}, for more information on package definitions. |
37166310 LC |
4514 | |
4515 | @item --select=[@var{subset}] | |
4516 | @itemx -s @var{subset} | |
4517 | Select all the packages in @var{subset}, one of @code{core} or | |
4518 | @code{non-core}. | |
4519 | ||
4520 | The @code{core} subset refers to all the packages at the core of the | |
4521 | distribution---i.e., packages that are used to build ``everything | |
4522 | else''. This includes GCC, libc, Binutils, Bash, etc. Usually, | |
4523 | changing one of these packages in the distribution entails a rebuild of | |
4524 | all the others. Thus, such updates are an inconvenience to users in | |
4525 | terms of build time or bandwidth used to achieve the upgrade. | |
4526 | ||
4527 | The @code{non-core} subset refers to the remaining packages. It is | |
4528 | typically useful in cases where an update of the core packages would be | |
4529 | inconvenient. | |
4530 | ||
bcb571cb LC |
4531 | @item --type=@var{updater} |
4532 | @itemx -t @var{updater} | |
7191adc5 AK |
4533 | Select only packages handled by @var{updater} (may be a comma-separated |
4534 | list of updaters). Currently, @var{updater} may be one of: | |
bcb571cb LC |
4535 | |
4536 | @table @code | |
4537 | @item gnu | |
4538 | the updater for GNU packages; | |
e80c0f85 LC |
4539 | @item gnome |
4540 | the updater for GNOME packages; | |
bcb571cb | 4541 | @item elpa |
d882c235 LC |
4542 | the updater for @uref{http://elpa.gnu.org/, ELPA} packages; |
4543 | @item cran | |
b9d044ef | 4544 | the updater for @uref{http://cran.r-project.org/, CRAN} packages; |
d0bd632f RW |
4545 | @item bioconductor |
4546 | the updater for @uref{http://www.bioconductor.org/, Bioconductor} R packages; | |
bab020d7 | 4547 | @item pypi |
b9d044ef | 4548 | the updater for @uref{https://pypi.python.org, PyPI} packages. |
bcb571cb LC |
4549 | @end table |
4550 | ||
4551 | For instance, the following commands only checks for updates of Emacs | |
d882c235 | 4552 | packages hosted at @code{elpa.gnu.org} and updates of CRAN packages: |
bcb571cb LC |
4553 | |
4554 | @example | |
7191adc5 | 4555 | $ guix refresh --type=elpa,cran |
d882c235 | 4556 | gnu/packages/statistics.scm:819:13: r-testthat would be upgraded from 0.10.0 to 0.11.0 |
bcb571cb LC |
4557 | gnu/packages/emacs.scm:856:13: emacs-auctex would be upgraded from 11.88.6 to 11.88.9 |
4558 | @end example | |
4559 | ||
37166310 LC |
4560 | @end table |
4561 | ||
4562 | In addition, @command{guix refresh} can be passed one or more package | |
4563 | names, as in this example: | |
4564 | ||
4565 | @example | |
38e16b49 | 4566 | $ ./pre-inst-env guix refresh -u emacs idutils gcc-4.8.4 |
37166310 LC |
4567 | @end example |
4568 | ||
4569 | @noindent | |
4570 | The command above specifically updates the @code{emacs} and | |
4571 | @code{idutils} packages. The @code{--select} option would have no | |
4572 | effect in this case. | |
4573 | ||
7d193ec3 EB |
4574 | When considering whether to upgrade a package, it is sometimes |
4575 | convenient to know which packages would be affected by the upgrade and | |
4576 | should be checked for compatibility. For this the following option may | |
4577 | be used when passing @command{guix refresh} one or more package names: | |
4578 | ||
4579 | @table @code | |
4580 | ||
6ffa706b AK |
4581 | @item --list-updaters |
4582 | @itemx -L | |
4583 | List available updaters and exit (see @option{--type} above.) | |
4584 | ||
7d193ec3 EB |
4585 | @item --list-dependent |
4586 | @itemx -l | |
4587 | List top-level dependent packages that would need to be rebuilt as a | |
4588 | result of upgrading one or more packages. | |
4589 | ||
4590 | @end table | |
4591 | ||
4592 | Be aware that the @code{--list-dependent} option only | |
4593 | @emph{approximates} the rebuilds that would be required as a result of | |
4594 | an upgrade. More rebuilds might be required under some circumstances. | |
4595 | ||
4596 | @example | |
7779ab61 LC |
4597 | $ guix refresh --list-dependent flex |
4598 | Building the following 120 packages would ensure 213 dependent packages are rebuilt: | |
4599 | hop-2.4.0 geiser-0.4 notmuch-0.18 mu-0.9.9.5 cflow-1.4 idutils-4.6 @dots{} | |
7d193ec3 EB |
4600 | @end example |
4601 | ||
4602 | The command above lists a set of packages that could be built to check | |
4603 | for compatibility with an upgraded @code{flex} package. | |
4604 | ||
f9230085 LC |
4605 | The following options can be used to customize GnuPG operation: |
4606 | ||
4607 | @table @code | |
4608 | ||
f9230085 LC |
4609 | @item --gpg=@var{command} |
4610 | Use @var{command} as the GnuPG 2.x command. @var{command} is searched | |
4611 | for in @code{$PATH}. | |
4612 | ||
2bc53ba9 LC |
4613 | @item --key-download=@var{policy} |
4614 | Handle missing OpenPGP keys according to @var{policy}, which may be one | |
4615 | of: | |
4616 | ||
4617 | @table @code | |
4618 | @item always | |
4619 | Always download missing OpenPGP keys from the key server, and add them | |
4620 | to the user's GnuPG keyring. | |
4621 | ||
4622 | @item never | |
4623 | Never try to download missing OpenPGP keys. Instead just bail out. | |
4624 | ||
4625 | @item interactive | |
4626 | When a package signed with an unknown OpenPGP key is encountered, ask | |
4627 | the user whether to download it or not. This is the default behavior. | |
4628 | @end table | |
4629 | ||
4630 | @item --key-server=@var{host} | |
4631 | Use @var{host} as the OpenPGP key server when importing a public key. | |
4632 | ||
f9230085 LC |
4633 | @end table |
4634 | ||
b4f5e0e8 CR |
4635 | @node Invoking guix lint |
4636 | @section Invoking @command{guix lint} | |
4637 | The @command{guix lint} is meant to help package developers avoid common | |
873c4085 LC |
4638 | errors and use a consistent style. It runs a number of checks on a |
4639 | given set of packages in order to find common mistakes in their | |
4640 | definitions. Available @dfn{checkers} include (see | |
4641 | @code{--list-checkers} for a complete list): | |
4642 | ||
4643 | @table @code | |
4644 | @item synopsis | |
4645 | @itemx description | |
4646 | Validate certain typographical and stylistic rules about package | |
4647 | descriptions and synopses. | |
4648 | ||
4649 | @item inputs-should-be-native | |
4650 | Identify inputs that should most likely be native inputs. | |
4651 | ||
4652 | @item source | |
4653 | @itemx home-page | |
50f5c46d | 4654 | @itemx source-file-name |
873c4085 | 4655 | Probe @code{home-page} and @code{source} URLs and report those that are |
50f5c46d EB |
4656 | invalid. Check that the source file name is meaningful, e.g. is not |
4657 | just a version number or ``git-checkout'', and should not have a | |
4658 | @code{file-name} declared (@pxref{origin Reference}). | |
40a7d4e5 | 4659 | |
5432734b LC |
4660 | @item cve |
4661 | Report known vulnerabilities found in the Common Vulnerabilities and | |
4662 | Exposures (CVE) database | |
4663 | @uref{https://nvd.nist.gov/download.cfm#CVE_FEED, published by the US | |
4664 | NIST}. | |
4665 | ||
40a7d4e5 LC |
4666 | @item formatting |
4667 | Warn about obvious source code formatting issues: trailing white space, | |
4668 | use of tabulations, etc. | |
873c4085 | 4669 | @end table |
b4f5e0e8 CR |
4670 | |
4671 | The general syntax is: | |
4672 | ||
4673 | @example | |
4674 | guix lint @var{options} @var{package}@dots{} | |
4675 | @end example | |
4676 | ||
4677 | If no package is given on the command line, then all packages are checked. | |
4678 | The @var{options} may be zero or more of the following: | |
4679 | ||
4680 | @table @code | |
4681 | ||
dd7c013d CR |
4682 | @item --checkers |
4683 | @itemx -c | |
4684 | Only enable the checkers specified in a comma-separated list using the | |
4685 | names returned by @code{--list-checkers}. | |
4686 | ||
b4f5e0e8 CR |
4687 | @item --list-checkers |
4688 | @itemx -l | |
4689 | List and describe all the available checkers that will be run on packages | |
4690 | and exit. | |
4691 | ||
4692 | @end table | |
37166310 | 4693 | |
fcc58db6 LC |
4694 | @node Invoking guix size |
4695 | @section Invoking @command{guix size} | |
4696 | ||
4697 | The @command{guix size} command helps package developers profile the | |
4698 | disk usage of packages. It is easy to overlook the impact of an | |
4699 | additional dependency added to a package, or the impact of using a | |
4700 | single output for a package that could easily be split (@pxref{Packages | |
4701 | with Multiple Outputs}). These are the typical issues that | |
4702 | @command{guix size} can highlight. | |
4703 | ||
4704 | The command can be passed a package specification such as @code{gcc-4.8} | |
4705 | or @code{guile:debug}, or a file name in the store. Consider this | |
4706 | example: | |
4707 | ||
4708 | @example | |
4709 | $ guix size coreutils | |
4710 | store item total self | |
4711 | /gnu/store/@dots{}-coreutils-8.23 70.0 13.9 19.8% | |
4712 | /gnu/store/@dots{}-gmp-6.0.0a 55.3 2.5 3.6% | |
4713 | /gnu/store/@dots{}-acl-2.2.52 53.7 0.5 0.7% | |
4714 | /gnu/store/@dots{}-attr-2.4.46 53.2 0.3 0.5% | |
4715 | /gnu/store/@dots{}-gcc-4.8.4-lib 52.9 15.7 22.4% | |
4716 | /gnu/store/@dots{}-glibc-2.21 37.2 37.2 53.1% | |
4717 | @end example | |
4718 | ||
4719 | @cindex closure | |
4720 | The store items listed here constitute the @dfn{transitive closure} of | |
4721 | Coreutils---i.e., Coreutils and all its dependencies, recursively---as | |
4722 | would be returned by: | |
4723 | ||
4724 | @example | |
4725 | $ guix gc -R /gnu/store/@dots{}-coreutils-8.23 | |
4726 | @end example | |
4727 | ||
4728 | Here the output shows 3 columns next to store items. The first column, | |
4729 | labeled ``total'', shows the size in mebibytes (MiB) of the closure of | |
4730 | the store item---that is, its own size plus the size of all its | |
4731 | dependencies. The next column, labeled ``self'', shows the size of the | |
4732 | item itself. The last column shows the ratio of the item's size to the | |
4733 | space occupied by all the items listed here. | |
4734 | ||
4735 | In this example, we see that the closure of Coreutils weighs in at | |
4736 | 70@tie{}MiB, half of which is taken by libc. (That libc represents a | |
4737 | large fraction of the closure is not a problem @i{per se} because it is | |
4738 | always available on the system anyway.) | |
4739 | ||
4740 | When the package passed to @command{guix size} is available in the | |
4741 | store, @command{guix size} queries the daemon to determine its | |
4742 | dependencies, and measures its size in the store, similar to @command{du | |
4743 | -ms --apparent-size} (@pxref{du invocation,,, coreutils, GNU | |
4744 | Coreutils}). | |
4745 | ||
4746 | When the given package is @emph{not} in the store, @command{guix size} | |
4747 | reports information based on information about the available substitutes | |
4748 | (@pxref{Substitutes}). This allows it to profile disk usage of store | |
4749 | items that are not even on disk, only available remotely. | |
4750 | ||
a8f996c6 | 4751 | The available options are: |
fcc58db6 LC |
4752 | |
4753 | @table @option | |
4754 | ||
d490d06e LC |
4755 | @item --substitute-urls=@var{urls} |
4756 | Use substitute information from @var{urls}. | |
4757 | @xref{client-substitute-urls, the same option for @code{guix build}}. | |
4758 | ||
a8f996c6 LC |
4759 | @item --map-file=@var{file} |
4760 | Write to @var{file} a graphical map of disk usage as a PNG file. | |
4761 | ||
4762 | For the example above, the map looks like this: | |
4763 | ||
4764 | @image{images/coreutils-size-map,5in,, map of Coreutils disk usage | |
4765 | produced by @command{guix size}} | |
4766 | ||
4767 | This option requires that | |
4768 | @uref{http://wingolog.org/software/guile-charting/, Guile-Charting} be | |
4769 | installed and visible in Guile's module search path. When that is not | |
4770 | the case, @command{guix size} fails as it tries to load it. | |
4771 | ||
fcc58db6 LC |
4772 | @item --system=@var{system} |
4773 | @itemx -s @var{system} | |
4774 | Consider packages for @var{system}---e.g., @code{x86_64-linux}. | |
4775 | ||
4776 | @end table | |
4777 | ||
88856916 LC |
4778 | @node Invoking guix graph |
4779 | @section Invoking @command{guix graph} | |
4780 | ||
4781 | @cindex DAG | |
4782 | Packages and their dependencies form a @dfn{graph}, specifically a | |
4783 | directed acyclic graph (DAG). It can quickly become difficult to have a | |
4784 | mental model of the package DAG, so the @command{guix graph} command is | |
4785 | here to provide a visual representation of the DAG. @command{guix | |
4786 | graph} emits a DAG representation in the input format of | |
4787 | @uref{http://www.graphviz.org/, Graphviz}, so its output can be passed | |
4788 | directly to Graphviz's @command{dot} command, for instance. The general | |
4789 | syntax is: | |
4790 | ||
4791 | @example | |
4792 | guix graph @var{options} @var{package}@dots{} | |
4793 | @end example | |
4794 | ||
4795 | For example, the following command generates a PDF file representing the | |
4796 | package DAG for the GNU@tie{}Core Utilities, showing its build-time | |
4797 | dependencies: | |
4798 | ||
4799 | @example | |
4800 | guix graph coreutils | dot -Tpdf > dag.pdf | |
4801 | @end example | |
4802 | ||
4803 | The output looks like this: | |
4804 | ||
4805 | @image{images/coreutils-graph,2in,,Dependency graph of the GNU Coreutils} | |
4806 | ||
4807 | Nice little graph, no? | |
4808 | ||
4809 | But there's more than one graph! The one above is concise: it's the | |
4810 | graph of package objects, omitting implicit inputs such as GCC, libc, | |
4811 | grep, etc. It's often useful to have such a concise graph, but | |
4812 | sometimes you want to see more details. @command{guix graph} supports | |
4813 | several types of graphs, allowing you to choose the level of details: | |
4814 | ||
4815 | @table @code | |
4816 | @item package | |
4817 | This is the default type, the one we used above. It shows the DAG of | |
4818 | package objects, excluding implicit dependencies. It is concise, but | |
4819 | filters out many details. | |
4820 | ||
4821 | @item bag-emerged | |
4822 | This is the package DAG, @emph{including} implicit inputs. | |
4823 | ||
4824 | For instance, the following command: | |
4825 | ||
4826 | @example | |
4827 | guix graph --type=bag-emerged coreutils | dot -Tpdf > dag.pdf | |
4828 | @end example | |
4829 | ||
4830 | ... yields this bigger graph: | |
4831 | ||
4832 | @image{images/coreutils-bag-graph,,5in,Detailed dependency graph of the GNU Coreutils} | |
4833 | ||
4834 | At the bottom of the graph, we see all the implicit inputs of | |
4835 | @var{gnu-build-system} (@pxref{Build Systems, @code{gnu-build-system}}). | |
4836 | ||
4837 | Now, note that the dependencies of those implicit inputs---that is, the | |
4838 | @dfn{bootstrap dependencies} (@pxref{Bootstrapping})---are not shown | |
4839 | here, for conciseness. | |
4840 | ||
4841 | @item bag | |
4842 | Similar to @code{bag-emerged}, but this time including all the bootstrap | |
4843 | dependencies. | |
4844 | ||
38b92daa LC |
4845 | @item bag-with-origins |
4846 | Similar to @code{bag}, but also showing origins and their dependencies. | |
4847 | ||
88856916 LC |
4848 | @item derivations |
4849 | This is the most detailed representation: It shows the DAG of | |
4850 | derivations (@pxref{Derivations}) and plain store items. Compared to | |
4851 | the above representation, many additional nodes are visible, including | |
4852 | builds scripts, patches, Guile modules, etc. | |
4853 | ||
4854 | @end table | |
4855 | ||
4856 | All the above types correspond to @emph{build-time dependencies}. The | |
4857 | following graph type represents the @emph{run-time dependencies}: | |
4858 | ||
4859 | @table @code | |
4860 | @item references | |
4861 | This is the graph of @dfn{references} of a package output, as returned | |
4862 | by @command{guix gc --references} (@pxref{Invoking guix gc}). | |
4863 | ||
4864 | If the given package output is not available in the store, @command{guix | |
4865 | graph} attempts to obtain dependency information from substitutes. | |
4866 | @end table | |
4867 | ||
4868 | The available options are the following: | |
4869 | ||
4870 | @table @option | |
4871 | @item --type=@var{type} | |
4872 | @itemx -t @var{type} | |
4873 | Produce a graph output of @var{type}, where @var{type} must be one of | |
4874 | the values listed above. | |
4875 | ||
4876 | @item --list-types | |
4877 | List the supported graph types. | |
4c8f997a LC |
4878 | |
4879 | @item --expression=@var{expr} | |
4880 | @itemx -e @var{expr} | |
4881 | Consider the package @var{expr} evaluates to. | |
4882 | ||
4883 | This is useful to precisely refer to a package, as in this example: | |
4884 | ||
4885 | @example | |
4886 | guix graph -e '(@@@@ (gnu packages commencement) gnu-make-final)' | |
4887 | @end example | |
88856916 LC |
4888 | @end table |
4889 | ||
4890 | ||
372c4bbc DT |
4891 | @node Invoking guix environment |
4892 | @section Invoking @command{guix environment} | |
4893 | ||
f5fd4fd2 | 4894 | @cindex reproducible build environments |
fe36d84e | 4895 | @cindex development environments |
372c4bbc DT |
4896 | The purpose of @command{guix environment} is to assist hackers in |
4897 | creating reproducible development environments without polluting their | |
4898 | package profile. The @command{guix environment} tool takes one or more | |
4899 | packages, builds all of the necessary inputs, and creates a shell | |
4900 | environment to use them. | |
4901 | ||
4902 | The general syntax is: | |
4903 | ||
4904 | @example | |
4905 | guix environment @var{options} @var{package}@dots{} | |
4906 | @end example | |
4907 | ||
fe36d84e LC |
4908 | The following example spawns a new shell set up for the development of |
4909 | GNU@tie{}Guile: | |
372c4bbc DT |
4910 | |
4911 | @example | |
4912 | guix environment guile | |
4913 | @end example | |
4914 | ||
4915 | If the specified packages are not built yet, @command{guix environment} | |
4916 | automatically builds them. The new shell's environment is an augmented | |
4917 | version of the environment that @command{guix environment} was run in. | |
4918 | It contains the necessary search paths for building the given package | |
4919 | added to the existing environment variables. To create a ``pure'' | |
4920 | environment in which the original environment variables have been unset, | |
50500f7c LC |
4921 | use the @code{--pure} option@footnote{Users sometimes wrongfully augment |
4922 | environment variables such as @code{PATH} in their @file{~/.bashrc} | |
4923 | file. As a consequence, when @code{guix environment} launches it, Bash | |
4924 | may read @file{~/.bashrc}, thereby introducing ``impurities'' in these | |
4925 | environment variables. It is an error to define such environment | |
4926 | variables in @file{.bashrc}; instead, they should be defined in | |
4927 | @file{.bash_profile}, which is sourced only by log-in shells. | |
4928 | @xref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}, for | |
4929 | details on Bash start-up files.}. | |
372c4bbc | 4930 | |
28de8d25 LC |
4931 | @vindex GUIX_ENVIRONMENT |
4932 | @command{guix environment} defines the @code{GUIX_ENVIRONMENT} | |
4933 | variable in the shell it spaws. This allows users to, say, define a | |
4934 | specific prompt for development environments in their @file{.bashrc} | |
4935 | (@pxref{Bash Startup Files,,, bash, The GNU Bash Reference Manual}): | |
4936 | ||
4937 | @example | |
4938 | if [ -n "$GUIX_ENVIRONMENT" ] | |
4939 | then | |
4940 | export PS1="\u@@\h \w [dev]\$ " | |
4941 | fi | |
4942 | @end example | |
4943 | ||
372c4bbc DT |
4944 | Additionally, more than one package may be specified, in which case the |
4945 | union of the inputs for the given packages are used. For example, the | |
4946 | command below spawns a shell where all of the dependencies of both Guile | |
4947 | and Emacs are available: | |
4948 | ||
4949 | @example | |
4950 | guix environment guile emacs | |
4951 | @end example | |
4952 | ||
1de2fe95 DT |
4953 | Sometimes an interactive shell session is not desired. An arbitrary |
4954 | command may be invoked by placing the @code{--} token to separate the | |
4955 | command from the rest of the arguments: | |
372c4bbc DT |
4956 | |
4957 | @example | |
1de2fe95 | 4958 | guix environment guile -- make -j4 |
372c4bbc DT |
4959 | @end example |
4960 | ||
fe36d84e LC |
4961 | In other situations, it is more convenient to specify the list of |
4962 | packages needed in the environment. For example, the following command | |
4963 | runs @command{python} from an environment containing Python@tie{}2.7 and | |
4964 | NumPy: | |
4965 | ||
4966 | @example | |
1de2fe95 | 4967 | guix environment --ad-hoc python2-numpy python-2.7 -- python |
fe36d84e LC |
4968 | @end example |
4969 | ||
cc90fbbf DT |
4970 | Furthermore, one might want the dependencies of a package and also some |
4971 | additional packages that are not build-time or runtime dependencies, but | |
4972 | are useful when developing nonetheless. Because of this, the | |
4973 | @code{--ad-hoc} flag is positional. Packages appearing before | |
4974 | @code{--ad-hoc} are interpreted as packages whose dependencies will be | |
4975 | added to the environment. Packages appearing after are interpreted as | |
4976 | packages that will be added to the environment directly. For example, | |
4977 | the following command creates a Guix development environment that | |
4978 | additionally includes Git and strace: | |
4979 | ||
4980 | @example | |
4981 | guix environment guix --ad-hoc git strace | |
4982 | @end example | |
4983 | ||
f535dcbe DT |
4984 | Sometimes it is desirable to isolate the environment as much as |
4985 | possible, for maximal purity and reproducibility. In particular, when | |
4986 | using Guix on a host distro that is not GuixSD, it is desirable to | |
4987 | prevent access to @file{/usr/bin} and other system-wide resources from | |
4988 | the development environment. For example, the following command spawns | |
4989 | a Guile REPL in a ``container'' where only the store and the current | |
4990 | working directory are mounted: | |
4991 | ||
4992 | @example | |
4993 | guix environment --ad-hoc --container guile -- guile | |
4994 | @end example | |
4995 | ||
0f252e26 | 4996 | @quotation Note |
cfd35b4e | 4997 | The @code{--container} option requires Linux-libre 3.19 or newer. |
0f252e26 DT |
4998 | @end quotation |
4999 | ||
fe36d84e | 5000 | The available options are summarized below. |
372c4bbc DT |
5001 | |
5002 | @table @code | |
5003 | @item --expression=@var{expr} | |
5004 | @itemx -e @var{expr} | |
c9c282ce DT |
5005 | Create an environment for the package or list of packages that |
5006 | @var{expr} evaluates to. | |
372c4bbc | 5007 | |
fe36d84e LC |
5008 | For example, running: |
5009 | ||
5010 | @example | |
5011 | guix environment -e '(@@ (gnu packages maths) petsc-openmpi)' | |
5012 | @end example | |
5013 | ||
5014 | starts a shell with the environment for this specific variant of the | |
5015 | PETSc package. | |
5016 | ||
c9c282ce DT |
5017 | Running: |
5018 | ||
5019 | @example | |
5c2b2f00 | 5020 | guix environment --ad-hoc -e '(@@ (gnu) %base-packages)' |
c9c282ce DT |
5021 | @end example |
5022 | ||
5023 | starts a shell with all the GuixSD base packages available. | |
5024 | ||
372c4bbc DT |
5025 | @item --load=@var{file} |
5026 | @itemx -l @var{file} | |
c9c282ce DT |
5027 | Create an environment for the package or list of packages that the code |
5028 | within @var{file} evaluates to. | |
372c4bbc | 5029 | |
fe36d84e LC |
5030 | As an example, @var{file} might contain a definition like this |
5031 | (@pxref{Defining Packages}): | |
5032 | ||
5033 | @example | |
5034 | @verbatiminclude environment-gdb.scm | |
5035 | @end example | |
5036 | ||
a54bd6d7 DT |
5037 | @item --ad-hoc |
5038 | Include all specified packages in the resulting environment, as if an | |
5039 | @i{ad hoc} package were defined with them as inputs. This option is | |
5040 | useful for quickly creating an environment without having to write a | |
5041 | package expression to contain the desired inputs. | |
5042 | ||
5043 | For instance, the command: | |
5044 | ||
5045 | @example | |
1de2fe95 | 5046 | guix environment --ad-hoc guile guile-sdl -- guile |
a54bd6d7 DT |
5047 | @end example |
5048 | ||
5049 | runs @command{guile} in an environment where Guile and Guile-SDL are | |
5050 | available. | |
5051 | ||
417c39f1 LC |
5052 | Note that this example implicitly asks for the default output of |
5053 | @code{guile} and @code{guile-sdl} but it is possible to ask for a | |
5054 | specific output---e.g., @code{glib:bin} asks for the @code{bin} output | |
5055 | of @code{glib} (@pxref{Packages with Multiple Outputs}). | |
5056 | ||
cc90fbbf DT |
5057 | This option may be composed with the default behavior of @command{guix |
5058 | environment}. Packages appearing before @code{--ad-hoc} are interpreted | |
5059 | as packages whose dependencies will be added to the environment, the | |
5060 | default behavior. Packages appearing after are interpreted as packages | |
5061 | that will be added to the environment directly. | |
5062 | ||
372c4bbc DT |
5063 | @item --pure |
5064 | Unset existing environment variables when building the new environment. | |
5065 | This has the effect of creating an environment in which search paths | |
5066 | only contain package inputs. | |
5067 | ||
5068 | @item --search-paths | |
5069 | Display the environment variable definitions that make up the | |
5070 | environment. | |
ce367ef3 LC |
5071 | |
5072 | @item --system=@var{system} | |
5073 | @itemx -s @var{system} | |
5074 | Attempt to build for @var{system}---e.g., @code{i686-linux}. | |
f535dcbe DT |
5075 | |
5076 | @item --container | |
5077 | @itemx -C | |
5078 | @cindex container | |
5079 | Run @var{command} within an isolated container. The current working | |
56b6befb | 5080 | directory outside the container is mapped inside the |
f535dcbe DT |
5081 | container. Additionally, the spawned process runs as the current user |
5082 | outside the container, but has root privileges in the context of the | |
5083 | container. | |
5084 | ||
5085 | @item --network | |
5086 | @itemx -N | |
5087 | For containers, share the network namespace with the host system. | |
5088 | Containers created without this flag only have access to the loopback | |
5089 | device. | |
5090 | ||
5091 | @item --expose=@var{source}[=@var{target}] | |
5092 | For containers, expose the file system @var{source} from the host system | |
5093 | as the read-only file system @var{target} within the container. If | |
5094 | @var{target} is not specified, @var{source} is used as the target mount | |
5095 | point in the container. | |
5096 | ||
5097 | The example below spawns a Guile REPL in a container in which the user's | |
5098 | home directory is accessible read-only via the @file{/exchange} | |
5099 | directory: | |
5100 | ||
5101 | @example | |
5102 | guix environment --container --expose=$HOME=/exchange guile -- guile | |
5103 | @end example | |
5104 | ||
5c2b2f00 | 5105 | @item --share=@var{source}[=@var{target}] |
f535dcbe DT |
5106 | For containers, share the file system @var{source} from the host system |
5107 | as the writable file system @var{target} within the container. If | |
5108 | @var{target} is not specified, @var{source} is used as the target mount | |
5109 | point in the container. | |
5110 | ||
5111 | The example below spawns a Guile REPL in a container in which the user's | |
5112 | home directory is accessible for both reading and writing via the | |
5113 | @file{/exchange} directory: | |
5114 | ||
5115 | @example | |
5116 | guix environment --container --share=$HOME=/exchange guile -- guile | |
5117 | @end example | |
372c4bbc DT |
5118 | @end table |
5119 | ||
5120 | It also supports all of the common build options that @command{guix | |
5121 | build} supports (@pxref{Invoking guix build, common build options}). | |
5122 | ||
aff8ce7c DT |
5123 | @node Invoking guix publish |
5124 | @section Invoking @command{guix publish} | |
5125 | ||
5126 | The purpose of @command{guix publish} is to enable users to easily share | |
8ce229fc LC |
5127 | their store with others, which can then use it as a substitute server |
5128 | (@pxref{Substitutes}). | |
5129 | ||
5130 | When @command{guix publish} runs, it spawns an HTTP server which allows | |
5131 | anyone with network access to obtain substitutes from it. This means | |
5132 | that any machine running Guix can also act as if it were a build farm, | |
5133 | since the HTTP interface is compatible with Hydra, the software behind | |
5134 | the @code{hydra.gnu.org} build farm. | |
aff8ce7c DT |
5135 | |
5136 | For security, each substitute is signed, allowing recipients to check | |
5137 | their authenticity and integrity (@pxref{Substitutes}). Because | |
5138 | @command{guix publish} uses the system's signing key, which is only | |
5463fe51 LC |
5139 | readable by the system administrator, it must be started as root; the |
5140 | @code{--user} option makes it drop root privileges early on. | |
aff8ce7c | 5141 | |
b18812b6 LC |
5142 | The signing key pair must be generated before @command{guix publish} is |
5143 | launched, using @command{guix archive --generate-key} (@pxref{Invoking | |
5144 | guix archive}). | |
5145 | ||
aff8ce7c DT |
5146 | The general syntax is: |
5147 | ||
5148 | @example | |
5149 | guix publish @var{options}@dots{} | |
5150 | @end example | |
5151 | ||
5152 | Running @command{guix publish} without any additional arguments will | |
5153 | spawn an HTTP server on port 8080: | |
5154 | ||
5155 | @example | |
5156 | guix publish | |
5157 | @end example | |
5158 | ||
5159 | Once a publishing server has been authorized (@pxref{Invoking guix | |
5160 | archive}), the daemon may download substitutes from it: | |
5161 | ||
5162 | @example | |
5163 | guix-daemon --substitute-urls=http://example.org:8080 | |
5164 | @end example | |
5165 | ||
5166 | The following options are available: | |
5167 | ||
5168 | @table @code | |
5169 | @item --port=@var{port} | |
5170 | @itemx -p @var{port} | |
5171 | Listen for HTTP requests on @var{port}. | |
5172 | ||
9e2292ef LC |
5173 | @item --listen=@var{host} |
5174 | Listen on the network interface for @var{host}. The default is to | |
5175 | accept connections from any interface. | |
5176 | ||
5463fe51 LC |
5177 | @item --user=@var{user} |
5178 | @itemx -u @var{user} | |
5179 | Change privileges to @var{user} as soon as possible---i.e., once the | |
5180 | server socket is open and the signing key has been read. | |
5181 | ||
aff8ce7c DT |
5182 | @item --repl[=@var{port}] |
5183 | @itemx -r [@var{port}] | |
5184 | Spawn a Guile REPL server (@pxref{REPL Servers,,, guile, GNU Guile | |
8ce229fc LC |
5185 | Reference Manual}) on @var{port} (37146 by default). This is used |
5186 | primarily for debugging a running @command{guix publish} server. | |
aff8ce7c DT |
5187 | @end table |
5188 | ||
1c52181f LC |
5189 | Enabling @command{guix publish} on a GuixSD system is a one-liner: just |
5190 | add a call to @code{guix-publish-service} in the @code{services} field | |
5191 | of the @code{operating-system} declaration (@pxref{guix-publish-service, | |
5192 | @code{guix-publish-service}}). | |
5193 | ||
d23c20f1 LC |
5194 | |
5195 | @node Invoking guix challenge | |
5196 | @section Invoking @command{guix challenge} | |
5197 | ||
5198 | @cindex reproducible builds | |
5199 | @cindex verifiable builds | |
5200 | ||
5201 | Do the binaries provided by this server really correspond to the source | |
5202 | code it claims to build? Is this package's build process deterministic? | |
5203 | These are the questions the @command{guix challenge} command attempts to | |
5204 | answer. | |
5205 | ||
5206 | The former is obviously an important question: Before using a substitute | |
5207 | server (@pxref{Substitutes}), you'd rather @emph{verify} that it | |
5208 | provides the right binaries, and thus @emph{challenge} it. The latter | |
5209 | is what enables the former: If package builds are deterministic, then | |
5210 | independent builds of the package should yield the exact same result, | |
5211 | bit for bit; if a server provides a binary different from the one | |
5212 | obtained locally, it may be either corrupt or malicious. | |
5213 | ||
5214 | We know that the hash that shows up in @file{/gnu/store} file names is | |
5215 | the hash of all the inputs of the process that built the file or | |
5216 | directory---compilers, libraries, build scripts, | |
5217 | etc. (@pxref{Introduction}). Assuming deterministic build processes, | |
5218 | one store file name should map to exactly one build output. | |
5219 | @command{guix challenge} checks whether there is, indeed, a single | |
5220 | mapping by comparing the build outputs of several independent builds of | |
5221 | any given store item. | |
5222 | ||
5223 | The command's output looks like this: | |
5224 | ||
5225 | @smallexample | |
5226 | $ guix challenge --substitute-urls="http://hydra.gnu.org http://guix.example.org" | |
5227 | updating list of substitutes from 'http://hydra.gnu.org'... 100.0% | |
5228 | updating list of substitutes from 'http://guix.example.org'... 100.0% | |
5229 | /gnu/store/@dots{}-openssl-1.0.2d contents differ: | |
5230 | local hash: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q | |
5231 | http://hydra.gnu.org/nar/@dots{}-openssl-1.0.2d: 0725l22r5jnzazaacncwsvp9kgf42266ayyp814v7djxs7nk963q | |
5232 | http://guix.example.org/nar/@dots{}-openssl-1.0.2d: 1zy4fmaaqcnjrzzajkdn3f5gmjk754b43qkq47llbyak9z0qjyim | |
5233 | /gnu/store/@dots{}-git-2.5.0 contents differ: | |
5234 | local hash: 00p3bmryhjxrhpn2gxs2fy0a15lnip05l97205pgbk5ra395hyha | |
5235 | http://hydra.gnu.org/nar/@dots{}-git-2.5.0: 069nb85bv4d4a6slrwjdy8v1cn4cwspm3kdbmyb81d6zckj3nq9f | |
5236 | http://guix.example.org/nar/@dots{}-git-2.5.0: 0mdqa9w1p6cmli6976v4wi0sw9r4p5prkj7lzfd1877wk11c9c73 | |
5237 | /gnu/store/@dots{}-pius-2.1.1 contents differ: | |
5238 | local hash: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax | |
5239 | http://hydra.gnu.org/nar/@dots{}-pius-2.1.1: 0k4v3m9z1zp8xzzizb7d8kjj72f9172xv078sq4wl73vnq9ig3ax | |
5240 | http://guix.example.org/nar/@dots{}-pius-2.1.1: 1cy25x1a4fzq5rk0pmvc8xhwyffnqz95h2bpvqsz2mpvlbccy0gs | |
5241 | @end smallexample | |
5242 | ||
5243 | @noindent | |
5244 | In this example, @command{guix challenge} first scans the store to | |
5245 | determine the set of locally-built derivations---as opposed to store | |
5246 | items that were downloaded from a substitute server---and then queries | |
5247 | all the substitute servers. It then reports those store items for which | |
5248 | the servers obtained a result different from the local build. | |
5249 | ||
5250 | @cindex non-determinism, in package builds | |
5251 | As an example, @code{guix.example.org} always gets a different answer. | |
5252 | Conversely, @code{hydra.gnu.org} agrees with local builds, except in the | |
5253 | case of Git. This might indicate that the build process of Git is | |
5254 | non-deterministic, meaning that its output varies as a function of | |
5255 | various things that Guix does not fully control, in spite of building | |
5256 | packages in isolated environments (@pxref{Features}). Most common | |
5257 | sources of non-determinism include the addition of timestamps in build | |
5258 | results, the inclusion of random numbers, and directory listings sorted | |
5259 | by inode number. See @uref{http://reproducible.debian.net/howto/}, for | |
5260 | more information. | |
5261 | ||
5262 | To find out what's wrong with this Git binary, we can do something along | |
5263 | these lines (@pxref{Invoking guix archive}): | |
5264 | ||
5265 | @example | |
5266 | $ wget -q -O - http://hydra.gnu.org/nar/@dots{}-git-2.5.0 \ | |
5267 | | guix archive -x /tmp/git | |
043f4698 | 5268 | $ diff -ur --no-dereference /gnu/store/@dots{}-git.2.5.0 /tmp/git |
d23c20f1 LC |
5269 | @end example |
5270 | ||
5271 | This command shows the difference between the files resulting from the | |
5272 | local build, and the files resulting from the build on | |
5273 | @code{hydra.gnu.org} (@pxref{Overview, Comparing and Merging Files,, | |
5274 | diffutils, Comparing and Merging Files}). The @command{diff} command | |
5275 | works great for text files. When binary files differ, a better option | |
5276 | is @uref{http://diffoscope.org/, Diffoscope}, a tool that helps | |
5277 | visualize differences for all kinds of files. | |
5278 | ||
5279 | Once you've done that work, you can tell whether the differences are due | |
5280 | to a non-deterministic build process or to a malicious server. We try | |
5281 | hard to remove sources of non-determinism in packages to make it easier | |
5282 | to verify substitutes, but of course, this is a process, one that | |
5283 | involves not just Guix but a large part of the free software community. | |
5284 | In the meantime, @command{guix challenge} is one tool to help address | |
5285 | the problem. | |
5286 | ||
5287 | If you are writing packages for Guix, you are encouraged to check | |
5288 | whether @code{hydra.gnu.org} and other substitute servers obtain the | |
5289 | same build result as you did with: | |
5290 | ||
5291 | @example | |
5292 | $ guix challenge @var{package} | |
5293 | @end example | |
5294 | ||
5295 | @noindent | |
5296 | ... where @var{package} is a package specification such as | |
5297 | @code{guile-2.0} or @code{glibc:debug}. | |
5298 | ||
5299 | The general syntax is: | |
5300 | ||
5301 | @example | |
5302 | guix challenge @var{options} [@var{packages}@dots{}] | |
5303 | @end example | |
5304 | ||
5305 | The one option that matters is: | |
5306 | ||
5307 | @table @code | |
5308 | ||
5309 | @item --substitute-urls=@var{urls} | |
5310 | Consider @var{urls} the whitespace-separated list of substitute source | |
5311 | URLs to compare to. | |
5312 | ||
5313 | @end table | |
5314 | ||
5315 | ||
32efa254 DT |
5316 | @node Invoking guix container |
5317 | @section Invoking @command{guix container} | |
5318 | @cindex container | |
5319 | ||
5320 | @quotation Note | |
5321 | As of version @value{VERSION}, this tool is experimental. The interface | |
5322 | is subject to radical change in the future. | |
5323 | @end quotation | |
5324 | ||
5325 | The purpose of @command{guix container} is to manipulate processes | |
5326 | running within an isolated environment, commonly known as a | |
46c36586 | 5327 | ``container'', typically created by the @command{guix environment} |
32efa254 DT |
5328 | (@pxref{Invoking guix environment}) and @command{guix system container} |
5329 | (@pxref{Invoking guix system}) commands. | |
5330 | ||
5331 | The general syntax is: | |
5332 | ||
5333 | @example | |
5334 | guix container @var{action} @var{options}@dots{} | |
5335 | @end example | |
5336 | ||
5337 | @var{action} specifies the operation to perform with a container, and | |
5338 | @var{options} specifies the context-specific arguments for the action. | |
5339 | ||
5340 | The following actions are available: | |
5341 | ||
5342 | @table @code | |
5343 | @item exec | |
5344 | Execute a command within the context of a running container. | |
5345 | ||
5346 | The syntax is: | |
5347 | ||
5348 | @example | |
5349 | guix container exec @var{pid} @var{program} @var{arguments}@dots{} | |
5350 | @end example | |
5351 | ||
5352 | @var{pid} specifies the process ID of the running container. | |
5353 | @var{program} specifies an executable file name within the container's | |
5354 | root file system. @var{arguments} are the additional options that will | |
5355 | be passed to @var{program}. | |
5356 | ||
5357 | The following command launches an interactive login shell inside a | |
5358 | GuixSD container, started by @command{guix system container}, and whose | |
5359 | process ID is 9001: | |
5360 | ||
5361 | @example | |
5362 | guix container exec 9001 /run/current-system/profile/bin/bash --login | |
5363 | @end example | |
5364 | ||
5365 | Note that the @var{pid} cannot be the parent process of a container. It | |
5366 | must be the container's PID 1 or one of its child processes. | |
5367 | ||
5368 | @end table | |
5369 | ||
a1ba8475 LC |
5370 | @c ********************************************************************* |
5371 | @node GNU Distribution | |
5372 | @chapter GNU Distribution | |
5373 | ||
3ca2731c | 5374 | @cindex Guix System Distribution |
4705641f | 5375 | @cindex GuixSD |
3ca2731c LC |
5376 | Guix comes with a distribution of the GNU system consisting entirely of |
5377 | free software@footnote{The term ``free'' here refers to the | |
a1ba8475 | 5378 | @url{http://www.gnu.org/philosophy/free-sw.html,freedom provided to |
3ca2731c | 5379 | users of that software}.}. The |
35ed9306 LC |
5380 | distribution can be installed on its own (@pxref{System Installation}), |
5381 | but it is also possible to install Guix as a package manager on top of | |
5382 | an installed GNU/Linux system (@pxref{Installation}). To distinguish | |
3ca2731c | 5383 | between the two, we refer to the standalone distribution as the Guix |
4705641f | 5384 | System Distribution, or GuixSD. |
35ed9306 LC |
5385 | |
5386 | The distribution provides core GNU packages such as GNU libc, GCC, and | |
5387 | Binutils, as well as many GNU and non-GNU applications. The complete | |
5388 | list of available packages can be browsed | |
093ae1be | 5389 | @url{http://www.gnu.org/software/guix/packages,on-line} or by |
d03bb653 | 5390 | running @command{guix package} (@pxref{Invoking guix package}): |
a1ba8475 LC |
5391 | |
5392 | @example | |
e49951eb | 5393 | guix package --list-available |
a1ba8475 LC |
5394 | @end example |
5395 | ||
35ed9306 | 5396 | Our goal has been to provide a practical 100% free software distribution of |
401c53c4 LC |
5397 | Linux-based and other variants of GNU, with a focus on the promotion and |
5398 | tight integration of GNU components, and an emphasis on programs and | |
5399 | tools that help users exert that freedom. | |
5400 | ||
3ca2731c | 5401 | Packages are currently available on the following platforms: |
c320011d LC |
5402 | |
5403 | @table @code | |
5404 | ||
5405 | @item x86_64-linux | |
5406 | Intel/AMD @code{x86_64} architecture, Linux-Libre kernel; | |
5407 | ||
5408 | @item i686-linux | |
5409 | Intel 32-bit architecture (IA32), Linux-Libre kernel; | |
5410 | ||
aa1e1947 | 5411 | @item armhf-linux |
aa725117 | 5412 | ARMv7-A architecture with hard float, Thumb-2 and NEON, |
aa1e1947 MW |
5413 | using the EABI hard-float ABI, and Linux-Libre kernel. |
5414 | ||
c320011d LC |
5415 | @item mips64el-linux |
5416 | little-endian 64-bit MIPS processors, specifically the Loongson series, | |
5417 | n32 application binary interface (ABI), and Linux-Libre kernel. | |
5418 | ||
5419 | @end table | |
5420 | ||
4705641f | 5421 | GuixSD itself is currently only available on @code{i686} and @code{x86_64}. |
3ca2731c | 5422 | |
c320011d LC |
5423 | @noindent |
5424 | For information on porting to other architectures or kernels, | |
5425 | @xref{Porting}. | |
5426 | ||
401c53c4 | 5427 | @menu |
5af6de3e | 5428 | * System Installation:: Installing the whole operating system. |
35ed9306 | 5429 | * System Configuration:: Configuring the operating system. |
91ef73d4 | 5430 | * Installing Debugging Files:: Feeding the debugger. |
05962f29 | 5431 | * Security Updates:: Deploying security fixes quickly. |
401c53c4 | 5432 | * Package Modules:: Packages from the programmer's viewpoint. |
da7cabd4 | 5433 | * Packaging Guidelines:: Growing the distribution. |
401c53c4 | 5434 | * Bootstrapping:: GNU/Linux built from scratch. |
8b315a6d | 5435 | * Porting:: Targeting another platform or kernel. |
401c53c4 LC |
5436 | @end menu |
5437 | ||
5438 | Building this distribution is a cooperative effort, and you are invited | |
081145cf | 5439 | to join! @xref{Contributing}, for information about how you can help. |
401c53c4 | 5440 | |
5af6de3e LC |
5441 | @node System Installation |
5442 | @section System Installation | |
5443 | ||
3ca2731c LC |
5444 | @cindex Guix System Distribution |
5445 | This section explains how to install the Guix System Distribution | |
5446 | on a machine. The Guix package manager can | |
35ed9306 LC |
5447 | also be installed on top of a running GNU/Linux system, |
5448 | @pxref{Installation}. | |
5af6de3e LC |
5449 | |
5450 | @ifinfo | |
5451 | @c This paragraph is for people reading this from tty2 of the | |
5452 | @c installation image. | |
5453 | You're reading this documentation with an Info reader. For details on | |
5454 | how to use it, hit the @key{RET} key (``return'' or ``enter'') on the | |
6621cdb6 | 5455 | link that follows: @pxref{Help,,, info, Info: An Introduction}. Hit |
5af6de3e LC |
5456 | @kbd{l} afterwards to come back here. |
5457 | @end ifinfo | |
5458 | ||
8aaaae38 LC |
5459 | @subsection Limitations |
5460 | ||
4705641f | 5461 | As of version @value{VERSION}, the Guix System Distribution (GuixSD) is |
3ca2731c | 5462 | not production-ready. It may contain bugs and lack important |
8aaaae38 LC |
5463 | features. Thus, if you are looking for a stable production system that |
5464 | respects your freedom as a computer user, a good solution at this point | |
5465 | is to consider @url{http://www.gnu.org/distros/free-distros.html, one of | |
5466 | more established GNU/Linux distributions}. We hope you can soon switch | |
4705641f | 5467 | to the GuixSD without fear, of course. In the meantime, you can |
8aaaae38 LC |
5468 | also keep using your distribution and try out the package manager on top |
5469 | of it (@pxref{Installation}). | |
5470 | ||
5471 | Before you proceed with the installation, be aware of the following | |
5472 | noteworthy limitations applicable to version @value{VERSION}: | |
5473 | ||
5474 | @itemize | |
5475 | @item | |
5476 | The installation process does not include a graphical user interface and | |
5477 | requires familiarity with GNU/Linux (see the following subsections to | |
5478 | get a feel of what that means.) | |
5479 | ||
5480 | @item | |
093ae1be LC |
5481 | The system does not yet provide full GNOME and KDE desktops. Xfce and |
5482 | Enlightenment are available though, if graphical desktop environments | |
5483 | are your thing, as well as a number of X11 window managers. | |
8aaaae38 LC |
5484 | |
5485 | @item | |
dbcb0ab1 | 5486 | Support for the Logical Volume Manager (LVM) is missing. |
8aaaae38 LC |
5487 | |
5488 | @item | |
5489 | Few system services are currently supported out-of-the-box | |
5490 | (@pxref{Services}). | |
5491 | ||
5492 | @item | |
093ae1be | 5493 | More than 2,000 packages are available, but you may |
8aaaae38 LC |
5494 | occasionally find that a useful package is missing. |
5495 | @end itemize | |
5496 | ||
5497 | You've been warned. But more than a disclaimer, this is an invitation | |
5498 | to report issues (and success stories!), and join us in improving it. | |
5499 | @xref{Contributing}, for more info. | |
5af6de3e LC |
5500 | |
5501 | @subsection USB Stick Installation | |
5502 | ||
5503 | An installation image for USB sticks can be downloaded from | |
4705641f | 5504 | @indicateurl{ftp://alpha.gnu.org/gnu/guix/guixsd-usb-install-@value{VERSION}.@var{system}.xz}, |
5af6de3e LC |
5505 | where @var{system} is one of: |
5506 | ||
5507 | @table @code | |
5508 | @item x86_64-linux | |
5509 | for a GNU/Linux system on Intel/AMD-compatible 64-bit CPUs; | |
5510 | ||
5511 | @item i686-linux | |
5512 | for a 32-bit GNU/Linux system on Intel-compatible CPUs. | |
5513 | @end table | |
5514 | ||
5515 | This image contains a single partition with the tools necessary for an | |
5516 | installation. It is meant to be copied @emph{as is} to a large-enough | |
5517 | USB stick. | |
5518 | ||
5519 | To copy the image to a USB stick, follow these steps: | |
5520 | ||
5521 | @enumerate | |
5522 | @item | |
5523 | Decompress the image using the @command{xz} command: | |
5524 | ||
5525 | @example | |
4705641f | 5526 | xz -d guixsd-usb-install-@value{VERSION}.@var{system}.xz |
5af6de3e LC |
5527 | @end example |
5528 | ||
5529 | @item | |
5530 | Insert a USB stick of 1@tie{}GiB or more in your machine, and determine | |
5531 | its device name. Assuming that USB stick is known as @file{/dev/sdX}, | |
5532 | copy the image with: | |
5533 | ||
5534 | @example | |
4705641f | 5535 | dd if=guixsd-usb-install-@value{VERSION}.x86_64 of=/dev/sdX |
5af6de3e LC |
5536 | @end example |
5537 | ||
5538 | Access to @file{/dev/sdX} usually requires root privileges. | |
5539 | @end enumerate | |
5540 | ||
5541 | Once this is done, you should be able to reboot the system and boot from | |
5542 | the USB stick. The latter usually requires you to get in the BIOS' boot | |
5543 | menu, where you can choose to boot from the USB stick. | |
5544 | ||
5545 | @subsection Preparing for Installation | |
5546 | ||
5547 | Once you have successfully booted the image on the USB stick, you should | |
5548 | end up with a root prompt. Several console TTYs are configured and can | |
5549 | be used to run commands as root. TTY2 shows this documentation, | |
5550 | browsable using the Info reader commands (@pxref{Help,,, info, Info: An | |
ae7ffa9e LC |
5551 | Introduction}). The installation system runs the GPM mouse daemon, |
5552 | which allows you to select text with the left mouse button and to paste | |
5553 | it with the middle button. | |
5af6de3e LC |
5554 | |
5555 | To install the system, you would: | |
5556 | ||
5557 | @enumerate | |
5558 | ||
5559 | @item | |
235cba85 LC |
5560 | Configure the network, by running: |
5561 | ||
5562 | @example | |
5563 | ifconfig eno1 up && dhclient eno1 | |
5564 | @end example | |
5565 | ||
5566 | to get an automatically assigned IP address from the wired | |
152dd61c | 5567 | network interface controller@footnote{ |
95c559c1 LC |
5568 | @c http://cgit.freedesktop.org/systemd/systemd/tree/src/udev/udev-builtin-net_id.c#n20 |
5569 | The name @code{eno1} is for the first on-board Ethernet controller. The | |
5570 | interface name for an Ethernet controller that is in the first slot of | |
5571 | the first PCI bus, for instance, would be @code{enp1s0}. Use | |
235cba85 | 5572 | @command{ifconfig -a} to list all the available network interfaces.}, |
95c559c1 | 5573 | or using the @command{ifconfig} command. |
5af6de3e LC |
5574 | |
5575 | The system automatically loads drivers for your network interface | |
5576 | controllers. | |
5577 | ||
5578 | Setting up network access is almost always a requirement because the | |
5579 | image does not contain all the software and tools that may be needed. | |
5580 | ||
5581 | @item | |
316d65be LC |
5582 | Unless this has already been done, you must partition, and then format |
5583 | the target partition. | |
5af6de3e | 5584 | |
7ab44369 LC |
5585 | Preferably, assign partitions a label so that you can easily and |
5586 | reliably refer to them in @code{file-system} declarations (@pxref{File | |
5587 | Systems}). This is typically done using the @code{-L} option of | |
5588 | @command{mkfs.ext4} and related commands. | |
5589 | ||
dd816355 LF |
5590 | Be sure that your partition labels match the value of their respective |
5591 | @code{device} fields in your @code{file-system} configuration, if your | |
5592 | @code{file-system} configuration sets the value of @code{title} to | |
5593 | @code{'label}, as do the example configurations found on the USB | |
5594 | installation image under @file{/etc/configuration} (@pxref{Using the | |
5595 | Configuration System}). | |
5596 | ||
316d65be LC |
5597 | @c FIXME: Uncomment this once GRUB fully supports encrypted roots. |
5598 | @c A typical command sequence may be: | |
5599 | @c | |
5600 | @c @example | |
5601 | @c # fdisk /dev/sdX | |
5602 | @c @dots{} Create partitions etc.@dots{} | |
5603 | @c # cryptsetup luksFormat /dev/sdX1 | |
5604 | @c # cryptsetup open --type luks /dev/sdX1 my-partition | |
5605 | @c # mkfs.ext4 -L my-root /dev/mapper/my-partition | |
5606 | @c @end example | |
6d6e6281 | 5607 | |
5af6de3e | 5608 | The installation image includes Parted (@pxref{Overview,,, parted, GNU |
b419c7f5 LC |
5609 | Parted User Manual}), @command{fdisk}, Cryptsetup/LUKS for disk |
5610 | encryption, and e2fsprogs, the suite of tools to manipulate | |
5611 | ext2/ext3/ext4 file systems. | |
5af6de3e | 5612 | |
83a17b62 LC |
5613 | @item |
5614 | Once that is done, mount the target root partition under @file{/mnt}. | |
5615 | ||
5616 | @item | |
dd17bc38 | 5617 | Lastly, run @code{herd start cow-store /mnt}. |
83a17b62 LC |
5618 | |
5619 | This will make @file{/gnu/store} copy-on-write, such that packages added | |
5620 | to it during the installation phase will be written to the target disk | |
5621 | rather than kept in memory. | |
5622 | ||
5af6de3e LC |
5623 | @end enumerate |
5624 | ||
5af6de3e LC |
5625 | |
5626 | @subsection Proceeding with the Installation | |
5627 | ||
5628 | With the target partitions ready, you now have to edit a file and | |
5629 | provide the declaration of the operating system to be installed. To | |
5630 | that end, the installation system comes with two text editors: GNU nano | |
5631 | (@pxref{Top,,, nano, GNU nano Manual}), and GNU Zile, an Emacs clone. | |
5632 | It is better to store that file on the target root file system, say, as | |
5633 | @file{/mnt/etc/config.scm}. | |
5634 | ||
dd51caac LC |
5635 | @xref{Using the Configuration System}, for examples of operating system |
5636 | configurations. These examples are available under | |
5637 | @file{/etc/configuration} in the installation image, so you can copy | |
5638 | them and use them as a starting point for your own configuration. | |
5af6de3e | 5639 | |
dd51caac LC |
5640 | Once you are done preparing the configuration file, the new system must |
5641 | be initialized (remember that the target root file system is mounted | |
5642 | under @file{/mnt}): | |
5af6de3e LC |
5643 | |
5644 | @example | |
5645 | guix system init /mnt/etc/config.scm /mnt | |
5646 | @end example | |
5647 | ||
5648 | @noindent | |
5649 | This will copy all the necessary files, and install GRUB on | |
5650 | @file{/dev/sdX}, unless you pass the @option{--no-grub} option. For | |
6621cdb6 | 5651 | more information, @pxref{Invoking guix system}. This command may trigger |
5af6de3e LC |
5652 | downloads or builds of missing packages, which can take some time. |
5653 | ||
1bd4e6db LC |
5654 | Once that command has completed---and hopefully succeeded!---you can run |
5655 | @command{reboot} and boot into the new system. The @code{root} password | |
5656 | in the new system is initially empty; other users' passwords need to be | |
5657 | initialized by running the @command{passwd} command as @code{root}, | |
5658 | unless your configuration specifies otherwise | |
5659 | (@pxref{user-account-password, user account passwords}). | |
5660 | ||
5661 | Join us on @code{#guix} on the Freenode IRC network or on | |
5af6de3e LC |
5662 | @file{guix-devel@@gnu.org} to share your experience---good or not so |
5663 | good. | |
5664 | ||
5665 | @subsection Building the Installation Image | |
5666 | ||
5667 | The installation image described above was built using the @command{guix | |
5668 | system} command, specifically: | |
5669 | ||
5670 | @example | |
8a225c66 | 5671 | guix system disk-image --image-size=850MiB gnu/system/install.scm |
5af6de3e LC |
5672 | @end example |
5673 | ||
5674 | @xref{Invoking guix system}, for more information. See | |
5675 | @file{gnu/system/install.scm} in the source tree for more information | |
5676 | about the installation image. | |
5677 | ||
cf4a9129 LC |
5678 | @node System Configuration |
5679 | @section System Configuration | |
b208a005 | 5680 | |
cf4a9129 | 5681 | @cindex system configuration |
3ca2731c | 5682 | The Guix System Distribution supports a consistent whole-system configuration |
cf4a9129 LC |
5683 | mechanism. By that we mean that all aspects of the global system |
5684 | configuration---such as the available system services, timezone and | |
5685 | locale settings, user accounts---are declared in a single place. Such | |
5686 | a @dfn{system configuration} can be @dfn{instantiated}---i.e., effected. | |
91ef73d4 | 5687 | |
cf4a9129 LC |
5688 | One of the advantages of putting all the system configuration under the |
5689 | control of Guix is that it supports transactional system upgrades, and | |
5690 | makes it possible to roll-back to a previous system instantiation, | |
5691 | should something go wrong with the new one (@pxref{Features}). Another | |
5692 | one is that it makes it easy to replicate the exact same configuration | |
5693 | across different machines, or at different points in time, without | |
5694 | having to resort to additional administration tools layered on top of | |
5695 | the system's own tools. | |
5696 | @c Yes, we're talking of Puppet, Chef, & co. here. ↑ | |
91ef73d4 | 5697 | |
cf4a9129 LC |
5698 | This section describes this mechanism. First we focus on the system |
5699 | administrator's viewpoint---explaining how the system is configured and | |
5700 | instantiated. Then we show how this mechanism can be extended, for | |
5701 | instance to support new system services. | |
91ef73d4 | 5702 | |
cf4a9129 LC |
5703 | @menu |
5704 | * Using the Configuration System:: Customizing your GNU system. | |
7313a52e | 5705 | * operating-system Reference:: Detail of operating-system declarations. |
cf4a9129 | 5706 | * File Systems:: Configuring file system mounts. |
510f9d86 | 5707 | * Mapped Devices:: Block device extra processing. |
cf4a9129 | 5708 | * User Accounts:: Specifying user accounts. |
598e19dc | 5709 | * Locales:: Language and cultural convention settings. |
cf4a9129 | 5710 | * Services:: Specifying system services. |
0ae8c15a | 5711 | * Setuid Programs:: Programs running with root privileges. |
efb5e833 | 5712 | * X.509 Certificates:: Authenticating HTTPS servers. |
996ed739 | 5713 | * Name Service Switch:: Configuring libc's name service switch. |
fd1b1fa2 | 5714 | * Initial RAM Disk:: Linux-Libre bootstrapping. |
88faf933 | 5715 | * GRUB Configuration:: Configuring the boot loader. |
cf4a9129 | 5716 | * Invoking guix system:: Instantiating a system configuration. |
97d76250 | 5717 | * Running GuixSD in a VM:: How to run GuixSD in a virtual machine. |
cf4a9129 LC |
5718 | * Defining Services:: Adding new service definitions. |
5719 | @end menu | |
91ef73d4 | 5720 | |
cf4a9129 LC |
5721 | @node Using the Configuration System |
5722 | @subsection Using the Configuration System | |
64d76fa6 | 5723 | |
cf4a9129 LC |
5724 | The operating system is configured by providing an |
5725 | @code{operating-system} declaration in a file that can then be passed to | |
5726 | the @command{guix system} command (@pxref{Invoking guix system}). A | |
5727 | simple setup, with the default system services, the default Linux-Libre | |
5728 | kernel, initial RAM disk, and boot loader looks like this: | |
91ef73d4 | 5729 | |
cf4a9129 LC |
5730 | @findex operating-system |
5731 | @lisp | |
dd51caac | 5732 | @include os-config-bare-bones.texi |
cf4a9129 | 5733 | @end lisp |
401c53c4 | 5734 | |
cf4a9129 LC |
5735 | This example should be self-describing. Some of the fields defined |
5736 | above, such as @code{host-name} and @code{bootloader}, are mandatory. | |
5737 | Others, such as @code{packages} and @code{services}, can be omitted, in | |
5738 | which case they get a default value. | |
e7f34eb0 | 5739 | |
5d94ac51 LC |
5740 | Below we discuss the effect of some of the most important fields |
5741 | (@pxref{operating-system Reference}, for details about all the available | |
5742 | fields), and how to @dfn{instantiate} the operating system using | |
5743 | @command{guix system}. | |
5744 | ||
5745 | @unnumberedsubsubsec Globally-Visible Packages | |
5746 | ||
cf4a9129 | 5747 | @vindex %base-packages |
5d94ac51 LC |
5748 | The @code{packages} field lists packages that will be globally visible |
5749 | on the system, for all user accounts---i.e., in every user's @code{PATH} | |
5750 | environment variable---in addition to the per-user profiles | |
5751 | (@pxref{Invoking guix package}). The @var{%base-packages} variable | |
5752 | provides all the tools one would expect for basic user and administrator | |
5753 | tasks---including the GNU Core Utilities, the GNU Networking Utilities, | |
5754 | the GNU Zile lightweight text editor, @command{find}, @command{grep}, | |
5755 | etc. The example above adds tcpdump to those, taken from the @code{(gnu | |
5756 | packages admin)} module (@pxref{Package Modules}). | |
e7f34eb0 | 5757 | |
f6c9fb1b LC |
5758 | @findex specification->package |
5759 | Referring to packages by variable name, like @var{tcpdump} above, has | |
5760 | the advantage of being unambiguous; it also allows typos and such to be | |
5761 | diagnosed right away as ``unbound variables''. The downside is that one | |
5762 | needs to know which module defines which package, and to augment the | |
5763 | @code{use-package-modules} line accordingly. To avoid that, one can use | |
5764 | the @code{specification->package} procedure of the @code{(gnu packages)} | |
5765 | module, which returns the best package for a given name or name and | |
5766 | version: | |
5767 | ||
5768 | @lisp | |
5769 | (use-modules (gnu packages)) | |
5770 | ||
5771 | (operating-system | |
5772 | ;; ... | |
5773 | (packages (append (map specification->package | |
5774 | '("tcpdump" "htop" "gnupg-2.0")) | |
5775 | %base-packages))) | |
5776 | @end lisp | |
5777 | ||
5d94ac51 LC |
5778 | @unnumberedsubsubsec System Services |
5779 | ||
cf4a9129 LC |
5780 | @vindex %base-services |
5781 | The @code{services} field lists @dfn{system services} to be made | |
5782 | available when the system starts (@pxref{Services}). | |
5783 | The @code{operating-system} declaration above specifies that, in | |
5784 | addition to the basic services, we want the @command{lshd} secure shell | |
cd6f6c22 LC |
5785 | daemon listening on port 2222 (@pxref{Networking Services, |
5786 | @code{lsh-service}}). Under the hood, | |
cf4a9129 LC |
5787 | @code{lsh-service} arranges so that @code{lshd} is started with the |
5788 | right command-line options, possibly with supporting configuration files | |
cd6f6c22 LC |
5789 | generated as needed (@pxref{Defining Services}). |
5790 | ||
5791 | @cindex customization, of services | |
5792 | @findex modify-services | |
5793 | Occasionally, instead of using the base services as is, you will want to | |
5794 | customize them. For instance, to change the configuration of | |
5795 | @code{guix-daemon} and Mingetty (the console log-in), you may write the | |
5796 | following instead of @var{%base-services}: | |
5797 | ||
5798 | @lisp | |
5799 | (modify-services %base-services | |
5800 | (guix-service-type config => | |
5801 | (guix-configuration | |
5802 | (inherit config) | |
5803 | (use-substitutes? #f) | |
5804 | (extra-options '("--gc-keep-outputs")))) | |
5805 | (mingetty-service-type config => | |
5806 | (mingetty-configuration | |
5807 | (inherit config) | |
5808 | (motd (plain-file "motd" "Hi there!"))))) | |
5809 | @end lisp | |
5810 | ||
5811 | @noindent | |
5812 | The effect here is to change the options passed to @command{guix-daemon} | |
5813 | when it is started, as well as the ``message of the day'' that appears | |
5814 | when logging in at the console. @xref{Service Reference, | |
5815 | @code{modify-services}}, for more on that. | |
a1ba8475 | 5816 | |
dd51caac | 5817 | The configuration for a typical ``desktop'' usage, with the X11 display |
cd6f6c22 | 5818 | server, a desktop environment, network management, power management, and |
dd51caac LC |
5819 | more, would look like this: |
5820 | ||
5821 | @lisp | |
5822 | @include os-config-desktop.texi | |
5823 | @end lisp | |
5824 | ||
5825 | @xref{Desktop Services}, for the exact list of services provided by | |
efb5e833 LC |
5826 | @var{%desktop-services}. @xref{X.509 Certificates}, for background |
5827 | information about the @code{nss-certs} package that is used here. | |
dd51caac | 5828 | |
5d94ac51 LC |
5829 | Again, @var{%desktop-services} is just a list of service objects. If |
5830 | you want to remove services from there, you can do so using the | |
5831 | procedures for list filtering (@pxref{SRFI-1 Filtering and | |
5832 | Partitioning,,, guile, GNU Guile Reference Manual}). For instance, the | |
5833 | following expression returns a list that contains all the services in | |
5834 | @var{%desktop-services} minus the Avahi service: | |
5835 | ||
5836 | @example | |
5837 | (remove (lambda (service) | |
5838 | (eq? (service-kind service) avahi-service-type)) | |
5839 | %desktop-services) | |
5840 | @end example | |
5841 | ||
5842 | @unnumberedsubsubsec Instantiating the System | |
5843 | ||
5844 | Assuming the @code{operating-system} declaration | |
5845 | is stored in the @file{my-system-config.scm} | |
cf4a9129 LC |
5846 | file, the @command{guix system reconfigure my-system-config.scm} command |
5847 | instantiates that configuration, and makes it the default GRUB boot | |
65797bff LC |
5848 | entry (@pxref{Invoking guix system}). |
5849 | ||
5850 | The normal way to change the system's configuration is by updating this | |
5851 | file and re-running @command{guix system reconfigure}. One should never | |
5852 | have to touch files in @command{/etc} or to run commands that modify the | |
5853 | system state such as @command{useradd} or @command{grub-install}. In | |
5854 | fact, you must avoid that since that would not only void your warranty | |
5855 | but also prevent you from rolling back to previous versions of your | |
5856 | system, should you ever need to. | |
5857 | ||
5858 | @cindex roll-back, of the operating system | |
5859 | Speaking of roll-back, each time you run @command{guix system | |
5860 | reconfigure}, a new @dfn{generation} of the system is created---without | |
5861 | modifying or deleting previous generations. Old system generations get | |
5862 | an entry in the GRUB boot menu, allowing you to boot them in case | |
5863 | something went wrong with the latest generation. Reassuring, no? The | |
5864 | @command{guix system list-generations} command lists the system | |
5865 | generations available on disk. | |
b81e1947 | 5866 | |
5d94ac51 LC |
5867 | @unnumberedsubsubsec The Programming Interface |
5868 | ||
cf4a9129 LC |
5869 | At the Scheme level, the bulk of an @code{operating-system} declaration |
5870 | is instantiated with the following monadic procedure (@pxref{The Store | |
5871 | Monad}): | |
b81e1947 | 5872 | |
cf4a9129 LC |
5873 | @deffn {Monadic Procedure} operating-system-derivation os |
5874 | Return a derivation that builds @var{os}, an @code{operating-system} | |
5875 | object (@pxref{Derivations}). | |
b81e1947 | 5876 | |
cf4a9129 LC |
5877 | The output of the derivation is a single directory that refers to all |
5878 | the packages, configuration files, and other supporting files needed to | |
5879 | instantiate @var{os}. | |
5880 | @end deffn | |
b81e1947 | 5881 | |
5d94ac51 LC |
5882 | This procedure is provided by the @code{(gnu system)} module. Along |
5883 | with @code{(gnu services)} (@pxref{Services}), this module contains the | |
5884 | guts of GuixSD. Make sure to visit it! | |
5885 | ||
5886 | ||
7313a52e LC |
5887 | @node operating-system Reference |
5888 | @subsection @code{operating-system} Reference | |
5889 | ||
5890 | This section summarizes all the options available in | |
5891 | @code{operating-system} declarations (@pxref{Using the Configuration | |
5892 | System}). | |
5893 | ||
5894 | @deftp {Data Type} operating-system | |
5895 | This is the data type representing an operating system configuration. | |
5896 | By that, we mean all the global system configuration, not per-user | |
5897 | configuration (@pxref{Using the Configuration System}). | |
5898 | ||
5899 | @table @asis | |
5900 | @item @code{kernel} (default: @var{linux-libre}) | |
fbb25e56 | 5901 | The package object of the operating system kernel to use@footnote{Currently |
7313a52e LC |
5902 | only the Linux-libre kernel is supported. In the future, it will be |
5903 | possible to use the GNU@tie{}Hurd.}. | |
5904 | ||
ee2a6304 LC |
5905 | @item @code{kernel-arguments} (default: @code{'()}) |
5906 | List of strings or gexps representing additional arguments to pass on | |
5907 | the kernel's command-line---e.g., @code{("console=ttyS0")}. | |
5908 | ||
7313a52e | 5909 | @item @code{bootloader} |
88faf933 | 5910 | The system bootloader configuration object. @xref{GRUB Configuration}. |
7313a52e LC |
5911 | |
5912 | @item @code{initrd} (default: @code{base-initrd}) | |
5913 | A two-argument monadic procedure that returns an initial RAM disk for | |
5914 | the Linux kernel. @xref{Initial RAM Disk}. | |
5915 | ||
f34c56be LC |
5916 | @item @code{firmware} (default: @var{%base-firmware}) |
5917 | @cindex firmware | |
5918 | List of firmware packages loadable by the operating system kernel. | |
5919 | ||
5920 | The default includes firmware needed for Atheros-based WiFi devices | |
5921 | (Linux-libre module @code{ath9k}.) | |
5922 | ||
7313a52e LC |
5923 | @item @code{host-name} |
5924 | The host name. | |
5925 | ||
5926 | @item @code{hosts-file} | |
5927 | @cindex hosts file | |
24e02c28 | 5928 | A file-like object (@pxref{G-Expressions, file-like objects}) for use as |
7313a52e | 5929 | @file{/etc/hosts} (@pxref{Host Names,,, libc, The GNU C Library |
24e02c28 | 5930 | Reference Manual}). The default is a file with entries for |
7313a52e LC |
5931 | @code{localhost} and @var{host-name}. |
5932 | ||
5933 | @item @code{mapped-devices} (default: @code{'()}) | |
5934 | A list of mapped devices. @xref{Mapped Devices}. | |
5935 | ||
5936 | @item @code{file-systems} | |
5937 | A list of file systems. @xref{File Systems}. | |
5938 | ||
5939 | @item @code{swap-devices} (default: @code{'()}) | |
5940 | @cindex swap devices | |
5941 | A list of strings identifying devices to be used for ``swap space'' | |
5942 | (@pxref{Memory Concepts,,, libc, The GNU C Library Reference Manual}). | |
5943 | For example, @code{'("/dev/sda3")}. | |
5944 | ||
bf87f38a | 5945 | @item @code{users} (default: @code{%base-user-accounts}) |
7313a52e LC |
5946 | @itemx @code{groups} (default: @var{%base-groups}) |
5947 | List of user accounts and groups. @xref{User Accounts}. | |
5948 | ||
5949 | @item @code{skeletons} (default: @code{(default-skeletons)}) | |
5950 | A monadic list of pairs of target file name and files. These are the | |
5951 | files that will be used as skeletons as new accounts are created. | |
5952 | ||
5953 | For instance, a valid value may look like this: | |
5954 | ||
5955 | @example | |
5956 | (mlet %store-monad ((bashrc (text-file "bashrc" "\ | |
5957 | export PATH=$HOME/.guix-profile/bin"))) | |
5958 | (return `((".bashrc" ,bashrc)))) | |
5959 | @end example | |
5960 | ||
5961 | @item @code{issue} (default: @var{%default-issue}) | |
5962 | A string denoting the contents of the @file{/etc/issue} file, which is | |
5963 | what displayed when users log in on a text console. | |
5964 | ||
5965 | @item @code{packages} (default: @var{%base-packages}) | |
5966 | The set of packages installed in the global profile, which is accessible | |
5967 | at @file{/run/current-system/profile}. | |
5968 | ||
5969 | The default set includes core utilities, but it is good practice to | |
5970 | install non-core utilities in user profiles (@pxref{Invoking guix | |
5971 | package}). | |
5972 | ||
5973 | @item @code{timezone} | |
5974 | A timezone identifying string---e.g., @code{"Europe/Paris"}. | |
5975 | ||
598e19dc LC |
5976 | @item @code{locale} (default: @code{"en_US.utf8"}) |
5977 | The name of the default locale (@pxref{Locale Names,,, libc, The GNU C | |
5978 | Library Reference Manual}). @xref{Locales}, for more information. | |
5979 | ||
5980 | @item @code{locale-definitions} (default: @var{%default-locale-definitions}) | |
5981 | The list of locale definitions to be compiled and that may be used at | |
5982 | run time. @xref{Locales}. | |
7313a52e | 5983 | |
34760ae7 LC |
5984 | @item @code{locale-libcs} (default: @code{(list @var{glibc})}) |
5985 | The list of GNU@tie{}libc packages whose locale data and tools are used | |
5986 | to build the locale definitions. @xref{Locales}, for compatibility | |
5987 | considerations that justify this option. | |
5988 | ||
996ed739 LC |
5989 | @item @code{name-service-switch} (default: @var{%default-nss}) |
5990 | Configuration of libc's name service switch (NSS)---a | |
5991 | @code{<name-service-switch>} object. @xref{Name Service Switch}, for | |
5992 | details. | |
5993 | ||
7313a52e | 5994 | @item @code{services} (default: @var{%base-services}) |
28d939af | 5995 | A list of service objects denoting system services. @xref{Services}. |
7313a52e LC |
5996 | |
5997 | @item @code{pam-services} (default: @code{(base-pam-services)}) | |
5998 | @cindex PAM | |
5999 | @cindex pluggable authentication modules | |
6000 | Linux @dfn{pluggable authentication module} (PAM) services. | |
6001 | @c FIXME: Add xref to PAM services section. | |
6002 | ||
6003 | @item @code{setuid-programs} (default: @var{%setuid-programs}) | |
6004 | List of string-valued G-expressions denoting setuid programs. | |
6005 | @xref{Setuid Programs}. | |
6006 | ||
f5a9ffa0 AK |
6007 | @item @code{sudoers-file} (default: @var{%sudoers-specification}) |
6008 | @cindex sudoers file | |
84765839 LC |
6009 | The contents of the @file{/etc/sudoers} file as a file-like object |
6010 | (@pxref{G-Expressions, @code{local-file} and @code{plain-file}}). | |
7313a52e LC |
6011 | |
6012 | This file specifies which users can use the @command{sudo} command, what | |
6013 | they are allowed to do, and what privileges they may gain. The default | |
6014 | is that only @code{root} and members of the @code{wheel} group may use | |
6015 | @code{sudo}. | |
6016 | ||
6017 | @end table | |
6018 | @end deftp | |
6019 | ||
cf4a9129 LC |
6020 | @node File Systems |
6021 | @subsection File Systems | |
b81e1947 | 6022 | |
cf4a9129 LC |
6023 | The list of file systems to be mounted is specified in the |
6024 | @code{file-systems} field of the operating system's declaration | |
6025 | (@pxref{Using the Configuration System}). Each file system is declared | |
6026 | using the @code{file-system} form, like this: | |
b81e1947 LC |
6027 | |
6028 | @example | |
cf4a9129 LC |
6029 | (file-system |
6030 | (mount-point "/home") | |
6031 | (device "/dev/sda3") | |
6032 | (type "ext4")) | |
b81e1947 LC |
6033 | @end example |
6034 | ||
cf4a9129 LC |
6035 | As usual, some of the fields are mandatory---those shown in the example |
6036 | above---while others can be omitted. These are described below. | |
b81e1947 | 6037 | |
cf4a9129 LC |
6038 | @deftp {Data Type} file-system |
6039 | Objects of this type represent file systems to be mounted. They | |
6040 | contain the following members: | |
5ff3c4b8 | 6041 | |
cf4a9129 LC |
6042 | @table @asis |
6043 | @item @code{type} | |
6044 | This is a string specifying the type of the file system---e.g., | |
6045 | @code{"ext4"}. | |
5ff3c4b8 | 6046 | |
cf4a9129 LC |
6047 | @item @code{mount-point} |
6048 | This designates the place where the file system is to be mounted. | |
b81e1947 | 6049 | |
cf4a9129 LC |
6050 | @item @code{device} |
6051 | This names the ``source'' of the file system. By default it is the name | |
6052 | of a node under @file{/dev}, but its meaning depends on the @code{title} | |
6053 | field described below. | |
401c53c4 | 6054 | |
cf4a9129 LC |
6055 | @item @code{title} (default: @code{'device}) |
6056 | This is a symbol that specifies how the @code{device} field is to be | |
6057 | interpreted. | |
401c53c4 | 6058 | |
cf4a9129 LC |
6059 | When it is the symbol @code{device}, then the @code{device} field is |
6060 | interpreted as a file name; when it is @code{label}, then @code{device} | |
6061 | is interpreted as a partition label name; when it is @code{uuid}, | |
6062 | @code{device} is interpreted as a partition unique identifier (UUID). | |
da7cabd4 | 6063 | |
661a1d79 LC |
6064 | UUIDs may be converted from their string representation (as shown by the |
6065 | @command{tune2fs -l} command) using the @code{uuid} form, like this: | |
6066 | ||
6067 | @example | |
6068 | (file-system | |
6069 | (mount-point "/home") | |
6070 | (type "ext4") | |
6071 | (title 'uuid) | |
6072 | (device (uuid "4dab5feb-d176-45de-b287-9b0a6e4c01cb"))) | |
6073 | @end example | |
6074 | ||
cf4a9129 | 6075 | The @code{label} and @code{uuid} options offer a way to refer to disk |
661a1d79 LC |
6076 | partitions without having to hard-code their actual device |
6077 | name@footnote{Note that, while it is tempting to use | |
6078 | @file{/dev/disk/by-uuid} and similar device names to achieve the same | |
6079 | result, this is not recommended: These special device nodes are created | |
6080 | by the udev daemon and may be unavailable at the time the device is | |
6081 | mounted.}. | |
da7cabd4 | 6082 | |
5f86a66e LC |
6083 | However, when a file system's source is a mapped device (@pxref{Mapped |
6084 | Devices}), its @code{device} field @emph{must} refer to the mapped | |
6085 | device name---e.g., @file{/dev/mapper/root-partition}---and consequently | |
6086 | @code{title} must be set to @code{'device}. This is required so that | |
6087 | the system knows that mounting the file system depends on having the | |
6088 | corresponding device mapping established. | |
6089 | ||
cf4a9129 LC |
6090 | @item @code{flags} (default: @code{'()}) |
6091 | This is a list of symbols denoting mount flags. Recognized flags | |
2c071ce9 LC |
6092 | include @code{read-only}, @code{bind-mount}, @code{no-dev} (disallow |
6093 | access to special files), @code{no-suid} (ignore setuid and setgid | |
6094 | bits), and @code{no-exec} (disallow program execution.) | |
da7cabd4 | 6095 | |
cf4a9129 LC |
6096 | @item @code{options} (default: @code{#f}) |
6097 | This is either @code{#f}, or a string denoting mount options. | |
da7cabd4 | 6098 | |
be21979d LC |
6099 | @item @code{mount?} (default: @code{#t}) |
6100 | This value indicates whether to automatically mount the file system when | |
6101 | the system is brought up. When set to @code{#f}, the file system gets | |
6102 | an entry in @file{/etc/fstab} (read by the @command{mount} command) but | |
6103 | is not automatically mounted. | |
6104 | ||
cf4a9129 LC |
6105 | @item @code{needed-for-boot?} (default: @code{#f}) |
6106 | This Boolean value indicates whether the file system is needed when | |
6107 | booting. If that is true, then the file system is mounted when the | |
6108 | initial RAM disk (initrd) is loaded. This is always the case, for | |
6109 | instance, for the root file system. | |
da7cabd4 | 6110 | |
cf4a9129 LC |
6111 | @item @code{check?} (default: @code{#t}) |
6112 | This Boolean indicates whether the file system needs to be checked for | |
6113 | errors before being mounted. | |
f9cc8971 | 6114 | |
4e469051 LC |
6115 | @item @code{create-mount-point?} (default: @code{#f}) |
6116 | When true, the mount point is created if it does not exist yet. | |
6117 | ||
e51710d1 LC |
6118 | @item @code{dependencies} (default: @code{'()}) |
6119 | This is a list of @code{<file-system>} objects representing file systems | |
6120 | that must be mounted before (and unmounted after) this one. | |
6121 | ||
6122 | As an example, consider a hierarchy of mounts: @file{/sys/fs/cgroup} is | |
6123 | a dependency of @file{/sys/fs/cgroup/cpu} and | |
6124 | @file{/sys/fs/cgroup/memory}. | |
6125 | ||
cf4a9129 LC |
6126 | @end table |
6127 | @end deftp | |
da7cabd4 | 6128 | |
a69576ea LC |
6129 | The @code{(gnu system file-systems)} exports the following useful |
6130 | variables. | |
6131 | ||
6132 | @defvr {Scheme Variable} %base-file-systems | |
6133 | These are essential file systems that are required on normal systems, | |
cc0e575a | 6134 | such as @var{%pseudo-terminal-file-system} and @var{%immutable-store} (see |
3392ce5d LC |
6135 | below.) Operating system declarations should always contain at least |
6136 | these. | |
a69576ea LC |
6137 | @end defvr |
6138 | ||
7f239fd3 LC |
6139 | @defvr {Scheme Variable} %pseudo-terminal-file-system |
6140 | This is the file system to be mounted as @file{/dev/pts}. It supports | |
6141 | @dfn{pseudo-terminals} created @i{via} @code{openpty} and similar | |
6142 | functions (@pxref{Pseudo-Terminals,,, libc, The GNU C Library Reference | |
6143 | Manual}). Pseudo-terminals are used by terminal emulators such as | |
6144 | @command{xterm}. | |
6145 | @end defvr | |
6146 | ||
db17ae5c LC |
6147 | @defvr {Scheme Variable} %shared-memory-file-system |
6148 | This file system is mounted as @file{/dev/shm} and is used to support | |
6149 | memory sharing across processes (@pxref{Memory-mapped I/O, | |
6150 | @code{shm_open},, libc, The GNU C Library Reference Manual}). | |
6151 | @end defvr | |
6152 | ||
3392ce5d LC |
6153 | @defvr {Scheme Variable} %immutable-store |
6154 | This file system performs a read-only ``bind mount'' of | |
6155 | @file{/gnu/store}, making it read-only for all the users including | |
6156 | @code{root}. This prevents against accidental modification by software | |
6157 | running as @code{root} or by system administrators. | |
6158 | ||
6159 | The daemon itself is still able to write to the store: it remounts it | |
6160 | read-write in its own ``name space.'' | |
6161 | @end defvr | |
6162 | ||
a69576ea LC |
6163 | @defvr {Scheme Variable} %binary-format-file-system |
6164 | The @code{binfmt_misc} file system, which allows handling of arbitrary | |
6165 | executable file types to be delegated to user space. This requires the | |
6166 | @code{binfmt.ko} kernel module to be loaded. | |
6167 | @end defvr | |
6168 | ||
6169 | @defvr {Scheme Variable} %fuse-control-file-system | |
6170 | The @code{fusectl} file system, which allows unprivileged users to mount | |
6171 | and unmount user-space FUSE file systems. This requires the | |
6172 | @code{fuse.ko} kernel module to be loaded. | |
6173 | @end defvr | |
6174 | ||
510f9d86 LC |
6175 | @node Mapped Devices |
6176 | @subsection Mapped Devices | |
6177 | ||
6178 | @cindex device mapping | |
6179 | @cindex mapped devices | |
6180 | The Linux kernel has a notion of @dfn{device mapping}: a block device, | |
6181 | such as a hard disk partition, can be @dfn{mapped} into another device, | |
6182 | with additional processing over the data that flows through | |
6183 | it@footnote{Note that the GNU@tie{}Hurd makes no difference between the | |
6184 | concept of a ``mapped device'' and that of a file system: both boil down | |
6185 | to @emph{translating} input/output operations made on a file to | |
6186 | operations on its backing store. Thus, the Hurd implements mapped | |
6187 | devices, like file systems, using the generic @dfn{translator} mechanism | |
6188 | (@pxref{Translators,,, hurd, The GNU Hurd Reference Manual}).}. A | |
6189 | typical example is encryption device mapping: all writes to the mapped | |
6190 | device are encrypted, and all reads are deciphered, transparently. | |
6191 | ||
6192 | Mapped devices are declared using the @code{mapped-device} form: | |
6193 | ||
6194 | @example | |
6195 | (mapped-device | |
6196 | (source "/dev/sda3") | |
6197 | (target "home") | |
6198 | (type luks-device-mapping)) | |
6199 | @end example | |
6200 | ||
6201 | @noindent | |
6202 | @cindex disk encryption | |
6203 | @cindex LUKS | |
6204 | This example specifies a mapping from @file{/dev/sda3} to | |
6205 | @file{/dev/mapper/home} using LUKS---the | |
6206 | @url{http://code.google.com/p/cryptsetup,Linux Unified Key Setup}, a | |
6207 | standard mechanism for disk encryption. The @file{/dev/mapper/home} | |
6208 | device can then be used as the @code{device} of a @code{file-system} | |
6209 | declaration (@pxref{File Systems}). The @code{mapped-device} form is | |
6210 | detailed below. | |
6211 | ||
6212 | @deftp {Data Type} mapped-device | |
6213 | Objects of this type represent device mappings that will be made when | |
6214 | the system boots up. | |
6215 | ||
9cb426b8 LC |
6216 | @table @code |
6217 | @item source | |
510f9d86 LC |
6218 | This string specifies the name of the block device to be mapped, such as |
6219 | @code{"/dev/sda3"}. | |
6220 | ||
9cb426b8 | 6221 | @item target |
510f9d86 LC |
6222 | This string specifies the name of the mapping to be established. For |
6223 | example, specifying @code{"my-partition"} will lead to the creation of | |
6224 | the @code{"/dev/mapper/my-partition"} device. | |
6225 | ||
9cb426b8 | 6226 | @item type |
510f9d86 LC |
6227 | This must be a @code{mapped-device-kind} object, which specifies how |
6228 | @var{source} is mapped to @var{target}. | |
6229 | @end table | |
6230 | @end deftp | |
6231 | ||
6232 | @defvr {Scheme Variable} luks-device-mapping | |
6233 | This defines LUKS block device encryption using the @command{cryptsetup} | |
6234 | command, from the same-named package. This relies on the | |
6235 | @code{dm-crypt} Linux kernel module. | |
6236 | @end defvr | |
6237 | ||
cf4a9129 LC |
6238 | @node User Accounts |
6239 | @subsection User Accounts | |
ee85f3db | 6240 | |
9bea87a5 LC |
6241 | User accounts and groups are entirely managed through the |
6242 | @code{operating-system} declaration. They are specified with the | |
6243 | @code{user-account} and @code{user-group} forms: | |
ee85f3db | 6244 | |
cf4a9129 LC |
6245 | @example |
6246 | (user-account | |
6247 | (name "alice") | |
6248 | (group "users") | |
24e752c0 LC |
6249 | (supplementary-groups '("wheel" ;allow use of sudo, etc. |
6250 | "audio" ;sound card | |
6251 | "video" ;video devices such as webcams | |
6252 | "cdrom")) ;the good ol' CD-ROM | |
cf4a9129 LC |
6253 | (comment "Bob's sister") |
6254 | (home-directory "/home/alice")) | |
6255 | @end example | |
25083588 | 6256 | |
9bea87a5 LC |
6257 | When booting or upon completion of @command{guix system reconfigure}, |
6258 | the system ensures that only the user accounts and groups specified in | |
6259 | the @code{operating-system} declaration exist, and with the specified | |
6260 | properties. Thus, account or group creations or modifications made by | |
6261 | directly invoking commands such as @command{useradd} are lost upon | |
6262 | reconfiguration or reboot. This ensures that the system remains exactly | |
6263 | as declared. | |
6264 | ||
cf4a9129 LC |
6265 | @deftp {Data Type} user-account |
6266 | Objects of this type represent user accounts. The following members may | |
6267 | be specified: | |
ee85f3db | 6268 | |
cf4a9129 LC |
6269 | @table @asis |
6270 | @item @code{name} | |
6271 | The name of the user account. | |
ee85f3db | 6272 | |
cf4a9129 LC |
6273 | @item @code{group} |
6274 | This is the name (a string) or identifier (a number) of the user group | |
6275 | this account belongs to. | |
ee85f3db | 6276 | |
cf4a9129 LC |
6277 | @item @code{supplementary-groups} (default: @code{'()}) |
6278 | Optionally, this can be defined as a list of group names that this | |
6279 | account belongs to. | |
ee85f3db | 6280 | |
cf4a9129 LC |
6281 | @item @code{uid} (default: @code{#f}) |
6282 | This is the user ID for this account (a number), or @code{#f}. In the | |
6283 | latter case, a number is automatically chosen by the system when the | |
6284 | account is created. | |
ee85f3db | 6285 | |
cf4a9129 LC |
6286 | @item @code{comment} (default: @code{""}) |
6287 | A comment about the account, such as the account's owner full name. | |
c8c871d1 | 6288 | |
cf4a9129 LC |
6289 | @item @code{home-directory} |
6290 | This is the name of the home directory for the account. | |
ee85f3db | 6291 | |
cf4a9129 LC |
6292 | @item @code{shell} (default: Bash) |
6293 | This is a G-expression denoting the file name of a program to be used as | |
6294 | the shell (@pxref{G-Expressions}). | |
ee85f3db | 6295 | |
cf4a9129 LC |
6296 | @item @code{system?} (default: @code{#f}) |
6297 | This Boolean value indicates whether the account is a ``system'' | |
6298 | account. System accounts are sometimes treated specially; for instance, | |
6299 | graphical login managers do not list them. | |
ee85f3db | 6300 | |
1bd4e6db | 6301 | @anchor{user-account-password} |
cf4a9129 | 6302 | @item @code{password} (default: @code{#f}) |
eb59595c LC |
6303 | You would normally leave this field to @code{#f}, initialize user |
6304 | passwords as @code{root} with the @command{passwd} command, and then let | |
9bea87a5 LC |
6305 | users change it with @command{passwd}. Passwords set with |
6306 | @command{passwd} are of course preserved across reboot and | |
6307 | reconfiguration. | |
eb59595c LC |
6308 | |
6309 | If you @emph{do} want to have a preset password for an account, then | |
6310 | this field must contain the encrypted password, as a string. | |
5d1f1177 LC |
6311 | @xref{crypt,,, libc, The GNU C Library Reference Manual}, for more information |
6312 | on password encryption, and @ref{Encryption,,, guile, GNU Guile Reference | |
eb59595c | 6313 | Manual}, for information on Guile's @code{crypt} procedure. |
c8c871d1 | 6314 | |
cf4a9129 LC |
6315 | @end table |
6316 | @end deftp | |
ee85f3db | 6317 | |
cf4a9129 | 6318 | User group declarations are even simpler: |
ee85f3db | 6319 | |
cf4a9129 LC |
6320 | @example |
6321 | (user-group (name "students")) | |
6322 | @end example | |
ee85f3db | 6323 | |
cf4a9129 LC |
6324 | @deftp {Data Type} user-group |
6325 | This type is for, well, user groups. There are just a few fields: | |
af8a56b8 | 6326 | |
cf4a9129 LC |
6327 | @table @asis |
6328 | @item @code{name} | |
6329 | The group's name. | |
ee85f3db | 6330 | |
cf4a9129 LC |
6331 | @item @code{id} (default: @code{#f}) |
6332 | The group identifier (a number). If @code{#f}, a new number is | |
6333 | automatically allocated when the group is created. | |
ee85f3db | 6334 | |
c8fa3426 LC |
6335 | @item @code{system?} (default: @code{#f}) |
6336 | This Boolean value indicates whether the group is a ``system'' group. | |
6337 | System groups have low numerical IDs. | |
6338 | ||
cf4a9129 LC |
6339 | @item @code{password} (default: @code{#f}) |
6340 | What, user groups can have a password? Well, apparently yes. Unless | |
6341 | @code{#f}, this field specifies the group's password. | |
ee85f3db | 6342 | |
cf4a9129 LC |
6343 | @end table |
6344 | @end deftp | |
401c53c4 | 6345 | |
cf4a9129 LC |
6346 | For convenience, a variable lists all the basic user groups one may |
6347 | expect: | |
401c53c4 | 6348 | |
cf4a9129 LC |
6349 | @defvr {Scheme Variable} %base-groups |
6350 | This is the list of basic user groups that users and/or packages expect | |
6351 | to be present on the system. This includes groups such as ``root'', | |
6352 | ``wheel'', and ``users'', as well as groups used to control access to | |
6353 | specific devices such as ``audio'', ``disk'', and ``cdrom''. | |
6354 | @end defvr | |
401c53c4 | 6355 | |
bf87f38a LC |
6356 | @defvr {Scheme Variable} %base-user-accounts |
6357 | This is the list of basic system accounts that programs may expect to | |
6358 | find on a GNU/Linux system, such as the ``nobody'' account. | |
6359 | ||
6360 | Note that the ``root'' account is not included here. It is a | |
6361 | special-case and is automatically added whether or not it is specified. | |
6362 | @end defvr | |
6363 | ||
598e19dc LC |
6364 | @node Locales |
6365 | @subsection Locales | |
6366 | ||
6367 | @cindex locale | |
6368 | A @dfn{locale} defines cultural conventions for a particular language | |
6369 | and region of the world (@pxref{Locales,,, libc, The GNU C Library | |
6370 | Reference Manual}). Each locale has a name that typically has the form | |
b2636518 | 6371 | @code{@var{language}_@var{territory}.@var{codeset}}---e.g., |
598e19dc LC |
6372 | @code{fr_LU.utf8} designates the locale for the French language, with |
6373 | cultural conventions from Luxembourg, and using the UTF-8 encoding. | |
6374 | ||
6375 | @cindex locale definition | |
6376 | Usually, you will want to specify the default locale for the machine | |
6377 | using the @code{locale} field of the @code{operating-system} declaration | |
6378 | (@pxref{operating-system Reference, @code{locale}}). | |
6379 | ||
6380 | That locale must be among the @dfn{locale definitions} that are known to | |
6381 | the system---and these are specified in the @code{locale-definitions} | |
6382 | slot of @code{operating-system}. The default value includes locale | |
c4847f49 | 6383 | definitions for some widely used locales, but not for all the available |
598e19dc LC |
6384 | locales, in order to save space. |
6385 | ||
6386 | If the locale specified in the @code{locale} field is not among the | |
6387 | definitions listed in @code{locale-definitions}, @command{guix system} | |
6388 | raises an error. In that case, you should add the locale definition to | |
6389 | the @code{locale-definitions} field. For instance, to add the North | |
6390 | Frisian locale for Germany, the value of that field may be: | |
6391 | ||
6392 | @example | |
6393 | (cons (locale-definition | |
6394 | (name "fy_DE.utf8") (source "fy_DE")) | |
6395 | %default-locale-definitions) | |
6396 | @end example | |
6397 | ||
6398 | Likewise, to save space, one might want @code{locale-definitions} to | |
6399 | list only the locales that are actually used, as in: | |
6400 | ||
6401 | @example | |
6402 | (list (locale-definition | |
6403 | (name "ja_JP.eucjp") (source "ja_JP") | |
6404 | (charset "EUC-JP"))) | |
6405 | @end example | |
6406 | ||
5c3c1427 LC |
6407 | @vindex LOCPATH |
6408 | The compiled locale definitions are available at | |
46bd6edd LC |
6409 | @file{/run/current-system/locale/X.Y}, where @code{X.Y} is the libc |
6410 | version, which is the default location where the GNU@tie{}libc provided | |
6411 | by Guix looks for locale data. This can be overridden using the | |
6412 | @code{LOCPATH} environment variable (@pxref{locales-and-locpath, | |
5c3c1427 LC |
6413 | @code{LOCPATH} and locale packages}). |
6414 | ||
598e19dc LC |
6415 | The @code{locale-definition} form is provided by the @code{(gnu system |
6416 | locale)} module. Details are given below. | |
6417 | ||
6418 | @deftp {Data Type} locale-definition | |
6419 | This is the data type of a locale definition. | |
6420 | ||
6421 | @table @asis | |
6422 | ||
6423 | @item @code{name} | |
6424 | The name of the locale. @xref{Locale Names,,, libc, The GNU C Library | |
6425 | Reference Manual}, for more information on locale names. | |
6426 | ||
6427 | @item @code{source} | |
6428 | The name of the source for that locale. This is typically the | |
6429 | @code{@var{language}_@var{territory}} part of the locale name. | |
6430 | ||
6431 | @item @code{charset} (default: @code{"UTF-8"}) | |
6432 | The ``character set'' or ``code set'' for that locale, | |
6433 | @uref{http://www.iana.org/assignments/character-sets, as defined by | |
6434 | IANA}. | |
6435 | ||
6436 | @end table | |
6437 | @end deftp | |
6438 | ||
6439 | @defvr {Scheme Variable} %default-locale-definitions | |
b2636518 LC |
6440 | An arbitrary list of commonly used UTF-8 locales, used as the default |
6441 | value of the @code{locale-definitions} field of @code{operating-system} | |
598e19dc | 6442 | declarations. |
b2636518 LC |
6443 | |
6444 | @cindex locale name | |
6445 | @cindex normalized codeset in locale names | |
6446 | These locale definitions use the @dfn{normalized codeset} for the part | |
6447 | that follows the dot in the name (@pxref{Using gettextized software, | |
6448 | normalized codeset,, libc, The GNU C Library Reference Manual}). So for | |
6449 | instance it has @code{uk_UA.utf8} but @emph{not}, say, | |
6450 | @code{uk_UA.UTF-8}. | |
598e19dc | 6451 | @end defvr |
401c53c4 | 6452 | |
34760ae7 LC |
6453 | @subsubsection Locale Data Compatibility Considerations |
6454 | ||
6455 | @cindex incompatibility, of locale data | |
6456 | @code{operating-system} declarations provide a @code{locale-libcs} field | |
6457 | to specify the GNU@tie{}libc packages that are used to compile locale | |
6458 | declarations (@pxref{operating-system Reference}). ``Why would I | |
6459 | care?'', you may ask. Well, it turns out that the binary format of | |
6460 | locale data is occasionally incompatible from one libc version to | |
6461 | another. | |
6462 | ||
6463 | @c See <https://sourceware.org/ml/libc-alpha/2015-09/msg00575.html> | |
6464 | @c and <https://lists.gnu.org/archive/html/guix-devel/2015-08/msg00737.html>. | |
6465 | For instance, a program linked against libc version 2.21 is unable to | |
6466 | read locale data produced with libc 2.22; worse, that program | |
6467 | @emph{aborts} instead of simply ignoring the incompatible locale | |
6468 | data@footnote{Versions 2.23 and later of GNU@tie{}libc will simply skip | |
6469 | the incompatible locale data, which is already an improvement.}. | |
6470 | Similarly, a program linked against libc 2.22 can read most, but not | |
6471 | all, the locale data from libc 2.21 (specifically, @code{LC_COLLATE} | |
6472 | data is incompatible); thus calls to @code{setlocale} may fail, but | |
6473 | programs will not abort. | |
6474 | ||
6475 | The ``problem'' in GuixSD is that users have a lot of freedom: They can | |
6476 | choose whether and when to upgrade software in their profiles, and might | |
6477 | be using a libc version different from the one the system administrator | |
6478 | used to build the system-wide locale data. | |
6479 | ||
6480 | Fortunately, unprivileged users can also install their own locale data | |
6481 | and define @var{GUIX_LOCPATH} accordingly (@pxref{locales-and-locpath, | |
6482 | @code{GUIX_LOCPATH} and locale packages}). | |
6483 | ||
6484 | Still, it is best if the system-wide locale data at | |
6485 | @file{/run/current-system/locale} is built for all the libc versions | |
6486 | actually in use on the system, so that all the programs can access | |
6487 | it---this is especially crucial on a multi-user system. To do that, the | |
6488 | administrator can specify several libc packages in the | |
6489 | @code{locale-libcs} field of @code{operating-system}: | |
6490 | ||
6491 | @example | |
6492 | (use-package-modules base) | |
6493 | ||
6494 | (operating-system | |
6495 | ;; @dots{} | |
6496 | (locale-libcs (list glibc-2.21 (canonical-package glibc)))) | |
6497 | @end example | |
6498 | ||
6499 | This example would lead to a system containing locale definitions for | |
6500 | both libc 2.21 and the current version of libc in | |
6501 | @file{/run/current-system/locale}. | |
6502 | ||
6503 | ||
cf4a9129 LC |
6504 | @node Services |
6505 | @subsection Services | |
401c53c4 | 6506 | |
cf4a9129 LC |
6507 | @cindex system services |
6508 | An important part of preparing an @code{operating-system} declaration is | |
6509 | listing @dfn{system services} and their configuration (@pxref{Using the | |
6510 | Configuration System}). System services are typically daemons launched | |
6511 | when the system boots, or other actions needed at that time---e.g., | |
d8b94dbd LC |
6512 | configuring network access. |
6513 | ||
dd17bc38 AK |
6514 | Services are managed by the GNU@tie{}Shepherd (@pxref{Introduction,,, |
6515 | shepherd, The GNU Shepherd Manual}). On a running system, the | |
6516 | @command{herd} command allows you to list the available services, show | |
6517 | their status, start and stop them, or do other specific operations | |
6518 | (@pxref{Jump Start,,, shepherd, The GNU Shepherd Manual}). For example: | |
d8b94dbd LC |
6519 | |
6520 | @example | |
dd17bc38 | 6521 | # herd status |
d8b94dbd LC |
6522 | @end example |
6523 | ||
6524 | The above command, run as @code{root}, lists the currently defined | |
dd17bc38 | 6525 | services. The @command{herd doc} command shows a synopsis of the given |
d8b94dbd LC |
6526 | service: |
6527 | ||
6528 | @example | |
dd17bc38 | 6529 | # herd doc nscd |
d8b94dbd LC |
6530 | Run libc's name service cache daemon (nscd). |
6531 | @end example | |
6532 | ||
6533 | The @command{start}, @command{stop}, and @command{restart} sub-commands | |
6534 | have the effect you would expect. For instance, the commands below stop | |
6535 | the nscd service and restart the Xorg display server: | |
6536 | ||
6537 | @example | |
dd17bc38 | 6538 | # herd stop nscd |
d8b94dbd | 6539 | Service nscd has been stopped. |
dd17bc38 | 6540 | # herd restart xorg-server |
d8b94dbd LC |
6541 | Service xorg-server has been stopped. |
6542 | Service xorg-server has been started. | |
6543 | @end example | |
401c53c4 | 6544 | |
cf4a9129 | 6545 | The following sections document the available services, starting with |
d8b94dbd LC |
6546 | the core services, that may be used in an @code{operating-system} |
6547 | declaration. | |
401c53c4 | 6548 | |
cf4a9129 LC |
6549 | @menu |
6550 | * Base Services:: Essential system services. | |
6551 | * Networking Services:: Network setup, SSH daemon, etc. | |
6552 | * X Window:: Graphical display. | |
fe1a39d3 | 6553 | * Desktop Services:: D-Bus and desktop services. |
105369a4 | 6554 | * Database Services:: SQL databases. |
d8c18af8 | 6555 | * Mail Services:: IMAP, POP3, SMTP, and all that. |
58724c48 | 6556 | * Web Services:: Web servers. |
aa4ed923 | 6557 | * Various Services:: Other services. |
cf4a9129 | 6558 | @end menu |
401c53c4 | 6559 | |
cf4a9129 LC |
6560 | @node Base Services |
6561 | @subsubsection Base Services | |
a1ba8475 | 6562 | |
cf4a9129 LC |
6563 | The @code{(gnu services base)} module provides definitions for the basic |
6564 | services that one expects from the system. The services exported by | |
6565 | this module are listed below. | |
401c53c4 | 6566 | |
cf4a9129 | 6567 | @defvr {Scheme Variable} %base-services |
31771497 LC |
6568 | This variable contains a list of basic services (@pxref{Service Types |
6569 | and Services}, for more information on service objects) one would | |
cf4a9129 LC |
6570 | expect from the system: a login service (mingetty) on each tty, syslogd, |
6571 | libc's name service cache daemon (nscd), the udev device manager, and | |
6572 | more. | |
401c53c4 | 6573 | |
cf4a9129 LC |
6574 | This is the default value of the @code{services} field of |
6575 | @code{operating-system} declarations. Usually, when customizing a | |
6576 | system, you will want to append services to @var{%base-services}, like | |
6577 | this: | |
401c53c4 | 6578 | |
cf4a9129 | 6579 | @example |
fa1e31b8 | 6580 | (cons* (avahi-service) (lsh-service) %base-services) |
cf4a9129 LC |
6581 | @end example |
6582 | @end defvr | |
401c53c4 | 6583 | |
be1c2c54 | 6584 | @deffn {Scheme Procedure} host-name-service @var{name} |
cf4a9129 LC |
6585 | Return a service that sets the host name to @var{name}. |
6586 | @end deffn | |
401c53c4 | 6587 | |
66e4f01c LC |
6588 | @deffn {Scheme Procedure} mingetty-service @var{config} |
6589 | Return a service to run mingetty according to @var{config}, a | |
6590 | @code{<mingetty-configuration>} object, which specifies the tty to run, among | |
6591 | other things. | |
cf4a9129 | 6592 | @end deffn |
401c53c4 | 6593 | |
66e4f01c LC |
6594 | @deftp {Data Type} mingetty-configuration |
6595 | This is the data type representing the configuration of Mingetty, which | |
6596 | implements console log-in. | |
6597 | ||
6598 | @table @asis | |
6599 | ||
6600 | @item @code{tty} | |
6601 | The name of the console this Mingetty runs on---e.g., @code{"tty1"}. | |
6602 | ||
6603 | @item @code{motd} | |
6604 | A file-like object containing the ``message of the day''. | |
6605 | ||
6606 | @item @code{auto-login} (default: @code{#f}) | |
6607 | When true, this field must be a string denoting the user name under | |
f9b9a033 | 6608 | which the system automatically logs in. When it is @code{#f}, a |
66e4f01c LC |
6609 | user name and password must be entered to log in. |
6610 | ||
6611 | @item @code{login-program} (default: @code{#f}) | |
6612 | This must be either @code{#f}, in which case the default log-in program | |
6613 | is used (@command{login} from the Shadow tool suite), or a gexp denoting | |
6614 | the name of the log-in program. | |
6615 | ||
6616 | @item @code{login-pause?} (default: @code{#f}) | |
6617 | When set to @code{#t} in conjunction with @var{auto-login}, the user | |
6618 | will have to press a key before the log-in shell is launched. | |
6619 | ||
6620 | @item @code{mingetty} (default: @var{mingetty}) | |
6621 | The Mingetty package to use. | |
6622 | ||
6623 | @end table | |
6624 | @end deftp | |
6625 | ||
6454b333 LC |
6626 | @cindex name service cache daemon |
6627 | @cindex nscd | |
be1c2c54 | 6628 | @deffn {Scheme Procedure} nscd-service [@var{config}] [#:glibc glibc] @ |
4aee6e60 | 6629 | [#:name-services '()] |
b893f1ae LC |
6630 | Return a service that runs libc's name service cache daemon (nscd) with the |
6631 | given @var{config}---an @code{<nscd-configuration>} object. @xref{Name | |
6632 | Service Switch}, for an example. | |
cf4a9129 | 6633 | @end deffn |
401c53c4 | 6634 | |
6454b333 LC |
6635 | @defvr {Scheme Variable} %nscd-default-configuration |
6636 | This is the default @code{<nscd-configuration>} value (see below) used | |
6637 | by @code{nscd-service}. This uses the caches defined by | |
6638 | @var{%nscd-default-caches}; see below. | |
6639 | @end defvr | |
6640 | ||
6641 | @deftp {Data Type} nscd-configuration | |
6642 | This is the type representing the name service cache daemon (nscd) | |
6643 | configuration. | |
6644 | ||
6645 | @table @asis | |
6646 | ||
b893f1ae LC |
6647 | @item @code{name-services} (default: @code{'()}) |
6648 | List of packages denoting @dfn{name services} that must be visible to | |
6649 | the nscd---e.g., @code{(list @var{nss-mdns})}. | |
6650 | ||
6651 | @item @code{glibc} (default: @var{glibc}) | |
6652 | Package object denoting the GNU C Library providing the @command{nscd} | |
6653 | command. | |
6654 | ||
6454b333 LC |
6655 | @item @code{log-file} (default: @code{"/var/log/nscd.log"}) |
6656 | Name of nscd's log file. This is where debugging output goes when | |
6657 | @code{debug-level} is strictly positive. | |
6658 | ||
6659 | @item @code{debug-level} (default: @code{0}) | |
6660 | Integer denoting the debugging levels. Higher numbers mean more | |
6661 | debugging output is logged. | |
6662 | ||
6663 | @item @code{caches} (default: @var{%nscd-default-caches}) | |
6664 | List of @code{<nscd-cache>} objects denoting things to be cached; see | |
6665 | below. | |
6666 | ||
6667 | @end table | |
6668 | @end deftp | |
6669 | ||
6670 | @deftp {Data Type} nscd-cache | |
6671 | Data type representing a cache database of nscd and its parameters. | |
6672 | ||
6673 | @table @asis | |
6674 | ||
6675 | @item @code{database} | |
6676 | This is a symbol representing the name of the database to be cached. | |
6677 | Valid values are @code{passwd}, @code{group}, @code{hosts}, and | |
6678 | @code{services}, which designate the corresponding NSS database | |
6679 | (@pxref{NSS Basics,,, libc, The GNU C Library Reference Manual}). | |
6680 | ||
6681 | @item @code{positive-time-to-live} | |
6682 | @itemx @code{negative-time-to-live} (default: @code{20}) | |
6683 | A number representing the number of seconds during which a positive or | |
6684 | negative lookup result remains in cache. | |
6685 | ||
6686 | @item @code{check-files?} (default: @code{#t}) | |
6687 | Whether to check for updates of the files corresponding to | |
6688 | @var{database}. | |
6689 | ||
6690 | For instance, when @var{database} is @code{hosts}, setting this flag | |
6691 | instructs nscd to check for updates in @file{/etc/hosts} and to take | |
6692 | them into account. | |
6693 | ||
6694 | @item @code{persistent?} (default: @code{#t}) | |
6695 | Whether the cache should be stored persistently on disk. | |
6696 | ||
6697 | @item @code{shared?} (default: @code{#t}) | |
6698 | Whether the cache should be shared among users. | |
6699 | ||
6700 | @item @code{max-database-size} (default: 32@tie{}MiB) | |
6701 | Maximum size in bytes of the database cache. | |
6702 | ||
6703 | @c XXX: 'suggested-size' and 'auto-propagate?' seem to be expert | |
6704 | @c settings, so leave them out. | |
6705 | ||
6706 | @end table | |
6707 | @end deftp | |
6708 | ||
6709 | @defvr {Scheme Variable} %nscd-default-caches | |
6710 | List of @code{<nscd-cache>} objects used by default by | |
6711 | @code{nscd-configuration} (see above.) | |
6712 | ||
6713 | It enables persistent and aggressive caching of service and host name | |
6714 | lookups. The latter provides better host name lookup performance, | |
6715 | resilience in the face of unreliable name servers, and also better | |
6716 | privacy---often the result of host name lookups is in local cache, so | |
6717 | external name servers do not even need to be queried. | |
6718 | @end defvr | |
6719 | ||
6720 | ||
be1c2c54 | 6721 | @deffn {Scheme Procedure} syslog-service [#:config-file #f] |
1bb76f75 AK |
6722 | Return a service that runs @code{syslogd}. If configuration file name |
6723 | @var{config-file} is not specified, use some reasonable default | |
cf4a9129 LC |
6724 | settings. |
6725 | @end deffn | |
401c53c4 | 6726 | |
0adfe95a LC |
6727 | @anchor{guix-configuration-type} |
6728 | @deftp {Data Type} guix-configuration | |
6729 | This data type represents the configuration of the Guix build daemon. | |
6730 | @xref{Invoking guix-daemon}, for more information. | |
6731 | ||
6732 | @table @asis | |
6733 | @item @code{guix} (default: @var{guix}) | |
6734 | The Guix package to use. | |
401c53c4 | 6735 | |
0adfe95a LC |
6736 | @item @code{build-group} (default: @code{"guixbuild"}) |
6737 | Name of the group for build user accounts. | |
401c53c4 | 6738 | |
0adfe95a LC |
6739 | @item @code{build-accounts} (default: @code{10}) |
6740 | Number of build user accounts to create. | |
401c53c4 | 6741 | |
0adfe95a LC |
6742 | @item @code{authorize-key?} (default: @code{#t}) |
6743 | Whether to authorize the substitute key for @code{hydra.gnu.org} | |
6744 | (@pxref{Substitutes}). | |
6745 | ||
6746 | @item @code{use-substitutes?} (default: @code{#t}) | |
6747 | Whether to use substitutes. | |
6748 | ||
b0b9f6e0 LC |
6749 | @item @code{substitute-urls} (default: @var{%default-substitute-urls}) |
6750 | The list of URLs where to look for substitutes by default. | |
6751 | ||
0adfe95a LC |
6752 | @item @code{extra-options} (default: @code{'()}) |
6753 | List of extra command-line options for @command{guix-daemon}. | |
6754 | ||
6755 | @item @code{lsof} (default: @var{lsof}) | |
6756 | @itemx @code{lsh} (default: @var{lsh}) | |
6757 | The lsof and lsh packages to use. | |
6758 | ||
6759 | @end table | |
6760 | @end deftp | |
6761 | ||
6762 | @deffn {Scheme Procedure} guix-service @var{config} | |
6763 | Return a service that runs the Guix build daemon according to | |
6764 | @var{config}. | |
cf4a9129 | 6765 | @end deffn |
a1ba8475 | 6766 | |
be1c2c54 | 6767 | @deffn {Scheme Procedure} udev-service [#:udev udev] |
cf4a9129 LC |
6768 | Run @var{udev}, which populates the @file{/dev} directory dynamically. |
6769 | @end deffn | |
401c53c4 | 6770 | |
be1c2c54 | 6771 | @deffn {Scheme Procedure} console-keymap-service @var{file} |
5eca9459 AK |
6772 | Return a service to load console keymap from @var{file} using |
6773 | @command{loadkeys} command. | |
6774 | @end deffn | |
6775 | ||
8664cc88 LC |
6776 | @deffn {Scheme Procedure} gpm-service-type [#:gpm @var{gpm}] @ |
6777 | [#:options] | |
6778 | Run @var{gpm}, the general-purpose mouse daemon, with the given | |
6779 | command-line @var{options}. GPM allows users to use the mouse in the console, | |
6780 | notably to select, copy, and paste text. The default value of @var{options} | |
6781 | uses the @code{ps2} protocol, which works for both USB and PS/2 mice. | |
6782 | ||
6783 | This service is not part of @var{%base-services}. | |
6784 | @end deffn | |
6785 | ||
1c52181f LC |
6786 | @anchor{guix-publish-service} |
6787 | @deffn {Scheme Procedure} guix-publish-service [#:guix @var{guix}] @ | |
6788 | [#:port 80] [#:host "localhost"] | |
6789 | Return a service that runs @command{guix publish} listening on @var{host} | |
6790 | and @var{port} (@pxref{Invoking guix publish}). | |
6791 | ||
6792 | This assumes that @file{/etc/guix} already contains a signing key pair as | |
6793 | created by @command{guix archive --generate-key} (@pxref{Invoking guix | |
6794 | archive}). If that is not the case, the service will fail to start. | |
6795 | @end deffn | |
6796 | ||
a69576ea | 6797 | |
cf4a9129 LC |
6798 | @node Networking Services |
6799 | @subsubsection Networking Services | |
401c53c4 | 6800 | |
fa1e31b8 | 6801 | The @code{(gnu services networking)} module provides services to configure |
cf4a9129 | 6802 | the network interface. |
a1ba8475 | 6803 | |
a023cca8 | 6804 | @cindex DHCP, networking service |
be1c2c54 | 6805 | @deffn {Scheme Procedure} dhcp-client-service [#:dhcp @var{isc-dhcp}] |
a023cca8 LC |
6806 | Return a service that runs @var{dhcp}, a Dynamic Host Configuration |
6807 | Protocol (DHCP) client, on all the non-loopback network interfaces. | |
6808 | @end deffn | |
6809 | ||
be1c2c54 | 6810 | @deffn {Scheme Procedure} static-networking-service @var{interface} @var{ip} @ |
cf4a9129 LC |
6811 | [#:gateway #f] [#:name-services @code{'()}] |
6812 | Return a service that starts @var{interface} with address @var{ip}. If | |
6813 | @var{gateway} is true, it must be a string specifying the default network | |
6814 | gateway. | |
6815 | @end deffn | |
8b315a6d | 6816 | |
b7d0c494 | 6817 | @cindex wicd |
87f40011 | 6818 | @cindex network management |
be1c2c54 | 6819 | @deffn {Scheme Procedure} wicd-service [#:wicd @var{wicd}] |
87f40011 LC |
6820 | Return a service that runs @url{https://launchpad.net/wicd,Wicd}, a network |
6821 | management daemon that aims to simplify wired and wireless networking. | |
6822 | ||
6823 | This service adds the @var{wicd} package to the global profile, providing | |
6824 | several commands to interact with the daemon and configure networking: | |
6825 | @command{wicd-client}, a graphical user interface, and the @command{wicd-cli} | |
6826 | and @command{wicd-curses} user interfaces. | |
b7d0c494 MW |
6827 | @end deffn |
6828 | ||
c0a9589d SB |
6829 | @cindex NetworkManager |
6830 | @deffn {Scheme Procedure} network-manager-service @ | |
6831 | [#:network-manager @var{network-manager}] | |
6832 | Return a service that runs NetworkManager, a network connection manager | |
6833 | that attempting to keep active network connectivity when available. | |
6834 | @end deffn | |
6835 | ||
be1c2c54 | 6836 | @deffn {Scheme Procedure} ntp-service [#:ntp @var{ntp}] @ |
63854bcb LC |
6837 | [#:name-service @var{%ntp-servers}] |
6838 | Return a service that runs the daemon from @var{ntp}, the | |
6839 | @uref{http://www.ntp.org, Network Time Protocol package}. The daemon will | |
6840 | keep the system clock synchronized with that of @var{servers}. | |
6841 | @end deffn | |
6842 | ||
6843 | @defvr {Scheme Variable} %ntp-servers | |
6844 | List of host names used as the default NTP servers. | |
6845 | @end defvr | |
6846 | ||
375c6108 LC |
6847 | @deffn {Scheme Procedure} tor-service [@var{config-file}] [#:tor @var{tor}] |
6848 | Return a service to run the @uref{https://torproject.org, Tor} anonymous | |
6849 | networking daemon. | |
8b315a6d | 6850 | |
375c6108 | 6851 | The daemon runs as the @code{tor} unprivileged user. It is passed |
6331bde7 LC |
6852 | @var{config-file}, a file-like object, with an additional @code{User tor} line |
6853 | and lines for hidden services added via @code{tor-hidden-service}. Run | |
6854 | @command{man tor} for information about the configuration file. | |
6855 | @end deffn | |
6856 | ||
24a8ef3b | 6857 | @cindex hidden service |
6331bde7 LC |
6858 | @deffn {Scheme Procedure} tor-hidden-service @var{name} @var{mapping} |
6859 | Define a new Tor @dfn{hidden service} called @var{name} and implementing | |
6860 | @var{mapping}. @var{mapping} is a list of port/host tuples, such as: | |
6861 | ||
6862 | @example | |
24a8ef3b LC |
6863 | '((22 "127.0.0.1:22") |
6864 | (80 "127.0.0.1:8080")) | |
6331bde7 LC |
6865 | @end example |
6866 | ||
6867 | In this example, port 22 of the hidden service is mapped to local port 22, and | |
6868 | port 80 is mapped to local port 8080. | |
6869 | ||
6629099a LC |
6870 | This creates a @file{/var/lib/tor/hidden-services/@var{name}} directory, where |
6871 | the @file{hostname} file contains the @code{.onion} host name for the hidden | |
6331bde7 LC |
6872 | service. |
6873 | ||
6874 | See @uref{https://www.torproject.org/docs/tor-hidden-service.html.en, the Tor | |
6875 | project's documentation} for more information. | |
cf4a9129 | 6876 | @end deffn |
8b315a6d | 6877 | |
be1c2c54 | 6878 | @deffn {Scheme Procedure} bitlbee-service [#:bitlbee bitlbee] @ |
4627a464 LC |
6879 | [#:interface "127.0.0.1"] [#:port 6667] @ |
6880 | [#:extra-settings ""] | |
6881 | Return a service that runs @url{http://bitlbee.org,BitlBee}, a daemon that | |
6882 | acts as a gateway between IRC and chat networks. | |
6883 | ||
6884 | The daemon will listen to the interface corresponding to the IP address | |
6885 | specified in @var{interface}, on @var{port}. @code{127.0.0.1} means that only | |
6886 | local clients can connect, whereas @code{0.0.0.0} means that connections can | |
6887 | come from any networking interface. | |
6888 | ||
6889 | In addition, @var{extra-settings} specifies a string to append to the | |
6890 | configuration file. | |
6891 | @end deffn | |
6892 | ||
f4391bec | 6893 | Furthermore, @code{(gnu services ssh)} provides the following service. |
8b315a6d | 6894 | |
be1c2c54 | 6895 | @deffn {Scheme Procedure} lsh-service [#:host-key "/etc/lsh/host-key"] @ |
5833bf33 | 6896 | [#:daemonic? #t] [#:interfaces '()] [#:port-number 22] @ |
cf4a9129 LC |
6897 | [#:allow-empty-passwords? #f] [#:root-login? #f] @ |
6898 | [#:syslog-output? #t] [#:x11-forwarding? #t] @ | |
6899 | [#:tcp/ip-forwarding? #t] [#:password-authentication? #t] @ | |
21cc905a | 6900 | [#:public-key-authentication? #t] [#:initialize? #t] |
cf4a9129 LC |
6901 | Run the @command{lshd} program from @var{lsh} to listen on port @var{port-number}. |
6902 | @var{host-key} must designate a file containing the host key, and readable | |
6903 | only by root. | |
72e25e35 | 6904 | |
5833bf33 DP |
6905 | When @var{daemonic?} is true, @command{lshd} will detach from the |
6906 | controlling terminal and log its output to syslogd, unless one sets | |
6907 | @var{syslog-output?} to false. Obviously, it also makes lsh-service | |
6908 | depend on existence of syslogd service. When @var{pid-file?} is true, | |
6909 | @command{lshd} writes its PID to the file called @var{pid-file}. | |
6910 | ||
cf4a9129 LC |
6911 | When @var{initialize?} is true, automatically create the seed and host key |
6912 | upon service activation if they do not exist yet. This may take long and | |
6913 | require interaction. | |
8b315a6d | 6914 | |
20dd519c LC |
6915 | When @var{initialize?} is false, it is up to the user to initialize the |
6916 | randomness generator (@pxref{lsh-make-seed,,, lsh, LSH Manual}), and to create | |
6917 | a key pair with the private key stored in file @var{host-key} (@pxref{lshd | |
6918 | basics,,, lsh, LSH Manual}). | |
6919 | ||
cf4a9129 LC |
6920 | When @var{interfaces} is empty, lshd listens for connections on all the |
6921 | network interfaces; otherwise, @var{interfaces} must be a list of host names | |
6922 | or addresses. | |
9bf3c1a7 | 6923 | |
20dd519c LC |
6924 | @var{allow-empty-passwords?} specifies whether to accept log-ins with empty |
6925 | passwords, and @var{root-login?} specifies whether to accept log-ins as | |
cf4a9129 | 6926 | root. |
4af2447e | 6927 | |
cf4a9129 LC |
6928 | The other options should be self-descriptive. |
6929 | @end deffn | |
4af2447e | 6930 | |
fa0c1d61 LC |
6931 | @defvr {Scheme Variable} %facebook-host-aliases |
6932 | This variable contains a string for use in @file{/etc/hosts} | |
6933 | (@pxref{Host Names,,, libc, The GNU C Library Reference Manual}). Each | |
6934 | line contains a entry that maps a known server name of the Facebook | |
6935 | on-line service---e.g., @code{www.facebook.com}---to the local | |
6936 | host---@code{127.0.0.1} or its IPv6 equivalent, @code{::1}. | |
6937 | ||
6938 | This variable is typically used in the @code{hosts-file} field of an | |
7313a52e LC |
6939 | @code{operating-system} declaration (@pxref{operating-system Reference, |
6940 | @file{/etc/hosts}}): | |
fa0c1d61 LC |
6941 | |
6942 | @example | |
6943 | (use-modules (gnu) (guix)) | |
6944 | ||
6945 | (operating-system | |
6946 | (host-name "mymachine") | |
6947 | ;; ... | |
6948 | (hosts-file | |
6949 | ;; Create a /etc/hosts file with aliases for "localhost" | |
6950 | ;; and "mymachine", as well as for Facebook servers. | |
24e02c28 LC |
6951 | (plain-file "hosts" |
6952 | (string-append (local-host-aliases host-name) | |
6953 | %facebook-host-aliases)))) | |
fa0c1d61 LC |
6954 | @end example |
6955 | ||
6956 | This mechanism can prevent programs running locally, such as Web | |
6957 | browsers, from accessing Facebook. | |
6958 | @end defvr | |
6959 | ||
965a7332 LC |
6960 | The @code{(gnu services avahi)} provides the following definition. |
6961 | ||
be1c2c54 | 6962 | @deffn {Scheme Procedure} avahi-service [#:avahi @var{avahi}] @ |
965a7332 LC |
6963 | [#:host-name #f] [#:publish? #t] [#:ipv4? #t] @ |
6964 | [#:ipv6? #t] [#:wide-area? #f] @ | |
6965 | [#:domains-to-browse '()] | |
6966 | Return a service that runs @command{avahi-daemon}, a system-wide | |
6967 | mDNS/DNS-SD responder that allows for service discovery and | |
cc9c1f39 LC |
6968 | "zero-configuration" host name lookups (see @uref{http://avahi.org/}), and |
6969 | extends the name service cache daemon (nscd) so that it can resolve | |
6970 | @code{.local} host names using | |
1065bed9 LC |
6971 | @uref{http://0pointer.de/lennart/projects/nss-mdns/, nss-mdns}. Additionally, |
6972 | add the @var{avahi} package to the system profile so that commands such as | |
6973 | @command{avahi-browse} are directly usable. | |
965a7332 LC |
6974 | |
6975 | If @var{host-name} is different from @code{#f}, use that as the host name to | |
6976 | publish for this machine; otherwise, use the machine's actual host name. | |
6977 | ||
6978 | When @var{publish?} is true, publishing of host names and services is allowed; | |
6979 | in particular, avahi-daemon will publish the machine's host name and IP | |
6980 | address via mDNS on the local network. | |
6981 | ||
6982 | When @var{wide-area?} is true, DNS-SD over unicast DNS is enabled. | |
6983 | ||
6984 | Boolean values @var{ipv4?} and @var{ipv6?} determine whether to use IPv4/IPv6 | |
6985 | sockets. | |
6986 | @end deffn | |
6987 | ||
6988 | ||
cf4a9129 LC |
6989 | @node X Window |
6990 | @subsubsection X Window | |
68ad877c | 6991 | |
cf4a9129 LC |
6992 | Support for the X Window graphical display system---specifically |
6993 | Xorg---is provided by the @code{(gnu services xorg)} module. Note that | |
6994 | there is no @code{xorg-service} procedure. Instead, the X server is | |
6995 | started by the @dfn{login manager}, currently SLiM. | |
4af2447e | 6996 | |
be1c2c54 | 6997 | @deffn {Scheme Procedure} slim-service [#:allow-empty-passwords? #f] @ |
0ecc3bf3 LC |
6998 | [#:auto-login? #f] [#:default-user ""] [#:startx] @ |
6999 | [#:theme @var{%default-slim-theme}] @ | |
4bd43bbe | 7000 | [#:theme-name @var{%default-slim-theme-name}] |
cf4a9129 LC |
7001 | Return a service that spawns the SLiM graphical login manager, which in |
7002 | turn starts the X display server with @var{startx}, a command as returned by | |
7003 | @code{xorg-start-command}. | |
4af2447e | 7004 | |
04e4e6ab LC |
7005 | @cindex X session |
7006 | ||
7007 | SLiM automatically looks for session types described by the @file{.desktop} | |
7008 | files in @file{/run/current-system/profile/share/xsessions} and allows users | |
7009 | to choose a session from the log-in screen using @kbd{F1}. Packages such as | |
7010 | @var{xfce}, @var{sawfish}, and @var{ratpoison} provide @file{.desktop} files; | |
7011 | adding them to the system-wide set of packages automatically makes them | |
7012 | available at the log-in screen. | |
7013 | ||
7014 | In addition, @file{~/.xsession} files are honored. When available, | |
7015 | @file{~/.xsession} must be an executable that starts a window manager | |
7016 | and/or other X clients. | |
7017 | ||
cf4a9129 LC |
7018 | When @var{allow-empty-passwords?} is true, allow logins with an empty |
7019 | password. When @var{auto-login?} is true, log in automatically as | |
7020 | @var{default-user}. | |
0ecc3bf3 LC |
7021 | |
7022 | If @var{theme} is @code{#f}, the use the default log-in theme; otherwise | |
7023 | @var{theme} must be a gexp denoting the name of a directory containing the | |
7024 | theme to use. In that case, @var{theme-name} specifies the name of the | |
7025 | theme. | |
cf4a9129 | 7026 | @end deffn |
4af2447e | 7027 | |
0ecc3bf3 LC |
7028 | @defvr {Scheme Variable} %default-theme |
7029 | @defvrx {Scheme Variable} %default-theme-name | |
7030 | The G-Expression denoting the default SLiM theme and its name. | |
7031 | @end defvr | |
7032 | ||
be1c2c54 | 7033 | @deffn {Scheme Procedure} xorg-start-command [#:guile] @ |
d1cdd7ba | 7034 | [#:configuration-file #f] [#:xorg-server @var{xorg-server}] |
f703413e | 7035 | Return a derivation that builds a @var{guile} script to start the X server |
d1cdd7ba LC |
7036 | from @var{xorg-server}. @var{configuration-file} is the server configuration |
7037 | file or a derivation that builds it; when omitted, the result of | |
7038 | @code{xorg-configuration-file} is used. | |
7039 | ||
7040 | Usually the X server is started by a login manager. | |
7041 | @end deffn | |
7042 | ||
be1c2c54 | 7043 | @deffn {Scheme Procedure} xorg-configuration-file @ |
12422c9d | 7044 | [#:drivers '()] [#:resolutions '()] [#:extra-config '()] |
d1cdd7ba LC |
7045 | Return a configuration file for the Xorg server containing search paths for |
7046 | all the common drivers. | |
f703413e LC |
7047 | |
7048 | @var{drivers} must be either the empty list, in which case Xorg chooses a | |
7049 | graphics driver automatically, or a list of driver names that will be tried in | |
d1cdd7ba | 7050 | this order---e.g., @code{(\"modesetting\" \"vesa\")}. |
d2e59637 LC |
7051 | |
7052 | Likewise, when @var{resolutions} is the empty list, Xorg chooses an | |
7053 | appropriate screen resolution; otherwise, it must be a list of | |
7054 | resolutions---e.g., @code{((1024 768) (640 480))}. | |
12422c9d LC |
7055 | |
7056 | Last, @var{extra-config} is a list of strings or objects appended to the | |
7057 | @code{text-file*} argument list. It is used to pass extra text to be added | |
7058 | verbatim to the configuration file. | |
f703413e | 7059 | @end deffn |
4af2447e | 7060 | |
6726282b LC |
7061 | @deffn {Scheme Procedure} screen-locker-service @var{package} [@var{name}] |
7062 | Add @var{package}, a package for a screen-locker or screen-saver whose | |
7063 | command is @var{program}, to the set of setuid programs and add a PAM entry | |
7064 | for it. For example: | |
7065 | ||
7066 | @lisp | |
7067 | (screen-locker-service xlockmore "xlock") | |
7068 | @end lisp | |
7069 | ||
7070 | makes the good ol' XlockMore usable. | |
7071 | @end deffn | |
7072 | ||
7073 | ||
fe1a39d3 LC |
7074 | @node Desktop Services |
7075 | @subsubsection Desktop Services | |
aa4ed923 | 7076 | |
fe1a39d3 LC |
7077 | The @code{(gnu services desktop)} module provides services that are |
7078 | usually useful in the context of a ``desktop'' setup---that is, on a | |
7079 | machine running a graphical display server, possibly with graphical user | |
7080 | interfaces, etc. | |
aa4ed923 | 7081 | |
4467be21 LC |
7082 | To simplify things, the module defines a variable containing the set of |
7083 | services that users typically expect on a machine with a graphical | |
7084 | environment and networking: | |
7085 | ||
7086 | @defvr {Scheme Variable} %desktop-services | |
7087 | This is a list of services that builds upon @var{%base-services} and | |
7088 | adds or adjust services for a typical ``desktop'' setup. | |
7089 | ||
7090 | In particular, it adds a graphical login manager (@pxref{X Window, | |
6726282b LC |
7091 | @code{slim-service}}), screen lockers, |
7092 | a network management tool (@pxref{Networking | |
4467be21 | 7093 | Services, @code{wicd-service}}), energy and color management services, |
4650a77e | 7094 | the @code{elogind} login and seat manager, the Polkit privilege service, |
cee32ee4 AW |
7095 | the GeoClue location service, an NTP client (@pxref{Networking |
7096 | Services}), the Avahi daemon, and has the name service switch service | |
7097 | configured to be able to use @code{nss-mdns} (@pxref{Name Service | |
7098 | Switch, mDNS}). | |
4467be21 LC |
7099 | @end defvr |
7100 | ||
7101 | The @var{%desktop-services} variable can be used as the @code{services} | |
7102 | field of an @code{operating-system} declaration (@pxref{operating-system | |
7103 | Reference, @code{services}}). | |
7104 | ||
0adfe95a LC |
7105 | The actual service definitions provided by @code{(gnu services dbus)} |
7106 | and @code{(gnu services desktop)} are described below. | |
4467be21 | 7107 | |
0adfe95a | 7108 | @deffn {Scheme Procedure} dbus-service [#:dbus @var{dbus}] [#:services '()] |
fe1a39d3 LC |
7109 | Return a service that runs the ``system bus'', using @var{dbus}, with |
7110 | support for @var{services}. | |
aa4ed923 | 7111 | |
fe1a39d3 LC |
7112 | @uref{http://dbus.freedesktop.org/, D-Bus} is an inter-process communication |
7113 | facility. Its system bus is used to allow system services to communicate | |
7114 | and be notified of system-wide events. | |
aa4ed923 | 7115 | |
fe1a39d3 LC |
7116 | @var{services} must be a list of packages that provide an |
7117 | @file{etc/dbus-1/system.d} directory containing additional D-Bus configuration | |
7118 | and policy files. For example, to allow avahi-daemon to use the system bus, | |
7119 | @var{services} must be equal to @code{(list avahi)}. | |
aa4ed923 AK |
7120 | @end deffn |
7121 | ||
0adfe95a | 7122 | @deffn {Scheme Procedure} elogind-service [#:config @var{config}] |
4650a77e AW |
7123 | Return a service that runs the @code{elogind} login and |
7124 | seat management daemon. @uref{https://github.com/andywingo/elogind, | |
7125 | Elogind} exposes a D-Bus interface that can be used to know which users | |
7126 | are logged in, know what kind of sessions they have open, suspend the | |
7127 | system, inhibit system suspend, reboot the system, and other tasks. | |
7128 | ||
7129 | Elogind handles most system-level power events for a computer, for | |
7130 | example suspending the system when a lid is closed, or shutting it down | |
7131 | when the power button is pressed. | |
7132 | ||
7133 | The @var{config} keyword argument specifies the configuration for | |
7134 | elogind, and should be the result of a @code{(elogind-configuration | |
7135 | (@var{parameter} @var{value})...)} invocation. Available parameters and | |
7136 | their default values are: | |
7137 | ||
7138 | @table @code | |
7139 | @item kill-user-processes? | |
7140 | @code{#f} | |
7141 | @item kill-only-users | |
7142 | @code{()} | |
7143 | @item kill-exclude-users | |
7144 | @code{("root")} | |
7145 | @item inhibit-delay-max-seconds | |
7146 | @code{5} | |
7147 | @item handle-power-key | |
7148 | @code{poweroff} | |
7149 | @item handle-suspend-key | |
7150 | @code{suspend} | |
7151 | @item handle-hibernate-key | |
7152 | @code{hibernate} | |
7153 | @item handle-lid-switch | |
7154 | @code{suspend} | |
7155 | @item handle-lid-switch-docked | |
7156 | @code{ignore} | |
7157 | @item power-key-ignore-inhibited? | |
7158 | @code{#f} | |
7159 | @item suspend-key-ignore-inhibited? | |
7160 | @code{#f} | |
7161 | @item hibernate-key-ignore-inhibited? | |
7162 | @code{#f} | |
7163 | @item lid-switch-ignore-inhibited? | |
7164 | @code{#t} | |
7165 | @item holdoff-timeout-seconds | |
7166 | @code{30} | |
7167 | @item idle-action | |
7168 | @code{ignore} | |
7169 | @item idle-action-seconds | |
7170 | @code{(* 30 60)} | |
7171 | @item runtime-directory-size-percent | |
7172 | @code{10} | |
7173 | @item runtime-directory-size | |
7174 | @code{#f} | |
7175 | @item remove-ipc? | |
7176 | @code{#t} | |
7177 | @item suspend-state | |
7178 | @code{("mem" "standby" "freeze")} | |
7179 | @item suspend-mode | |
7180 | @code{()} | |
7181 | @item hibernate-state | |
7182 | @code{("disk")} | |
7183 | @item hibernate-mode | |
7184 | @code{("platform" "shutdown")} | |
7185 | @item hybrid-sleep-state | |
7186 | @code{("disk")} | |
7187 | @item hybrid-sleep-mode | |
7188 | @code{("suspend" "platform" "shutdown")} | |
7189 | @end table | |
7190 | @end deffn | |
7191 | ||
be1c2c54 | 7192 | @deffn {Scheme Procedure} polkit-service @ |
4650a77e | 7193 | [#:polkit @var{polkit}] |
222e3319 LC |
7194 | Return a service that runs the |
7195 | @uref{http://www.freedesktop.org/wiki/Software/polkit/, Polkit privilege | |
7196 | management service}, which allows system administrators to grant access to | |
7197 | privileged operations in a structured way. By querying the Polkit service, a | |
7198 | privileged system component can know when it should grant additional | |
7199 | capabilities to ordinary users. For example, an ordinary user can be granted | |
7200 | the capability to suspend the system if the user is logged in locally. | |
4650a77e AW |
7201 | @end deffn |
7202 | ||
be1c2c54 | 7203 | @deffn {Scheme Procedure} upower-service [#:upower @var{upower}] @ |
be234128 AW |
7204 | [#:watts-up-pro? #f] @ |
7205 | [#:poll-batteries? #t] @ | |
7206 | [#:ignore-lid? #f] @ | |
7207 | [#:use-percentage-for-policy? #f] @ | |
7208 | [#:percentage-low 10] @ | |
7209 | [#:percentage-critical 3] @ | |
7210 | [#:percentage-action 2] @ | |
7211 | [#:time-low 1200] @ | |
7212 | [#:time-critical 300] @ | |
7213 | [#:time-action 120] @ | |
7214 | [#:critical-power-action 'hybrid-sleep] | |
7215 | Return a service that runs @uref{http://upower.freedesktop.org/, | |
7216 | @command{upowerd}}, a system-wide monitor for power consumption and battery | |
7217 | levels, with the given configuration settings. It implements the | |
7218 | @code{org.freedesktop.UPower} D-Bus interface, and is notably used by | |
7219 | GNOME. | |
7220 | @end deffn | |
7221 | ||
2b9e0a94 LC |
7222 | @deffn {Scheme Procedure} udisks-service [#:udisks @var{udisks}] |
7223 | Return a service for @uref{http://udisks.freedesktop.org/docs/latest/, | |
7224 | UDisks}, a @dfn{disk management} daemon that provides user interfaces with | |
7225 | notifications and ways to mount/unmount disks. Programs that talk to UDisks | |
7226 | include the @command{udisksctl} command, part of UDisks, and GNOME Disks. | |
7227 | @end deffn | |
7228 | ||
be1c2c54 | 7229 | @deffn {Scheme Procedure} colord-service [#:colord @var{colord}] |
7ce597ff AW |
7230 | Return a service that runs @command{colord}, a system service with a D-Bus |
7231 | interface to manage the color profiles of input and output devices such as | |
7232 | screens and scanners. It is notably used by the GNOME Color Manager graphical | |
7233 | tool. See @uref{http://www.freedesktop.org/software/colord/, the colord web | |
7234 | site} for more information. | |
7235 | @end deffn | |
7236 | ||
cee32ee4 AW |
7237 | @deffn {Scheme Procedure} geoclue-application name [#:allowed? #t] [#:system? #f] [#:users '()] |
7238 | Return an configuration allowing an application to access GeoClue | |
7239 | location data. @var{name} is the Desktop ID of the application, without | |
7240 | the @code{.desktop} part. If @var{allowed?} is true, the application | |
7241 | will have access to location information by default. The boolean | |
7242 | @var{system?} value indicates that an application is a system component | |
7243 | or not. Finally @var{users} is a list of UIDs of all users for which | |
7244 | this application is allowed location info access. An empty users list | |
7245 | means that all users are allowed. | |
7246 | @end deffn | |
7247 | ||
7248 | @defvr {Scheme Variable} %standard-geoclue-applications | |
7249 | The standard list of well-known GeoClue application configurations, | |
7250 | granting authority to GNOME's date-and-time utility to ask for the | |
7251 | current location in order to set the time zone, and allowing the Firefox | |
7252 | (IceCat) and Epiphany web browsers to request location information. | |
7253 | Firefox and Epiphany both query the user before allowing a web page to | |
7254 | know the user's location. | |
7255 | @end defvr | |
7256 | ||
be1c2c54 | 7257 | @deffn {Scheme Procedure} geoclue-service [#:colord @var{colord}] @ |
cee32ee4 AW |
7258 | [#:whitelist '()] @ |
7259 | [#:wifi-geolocation-url "https://location.services.mozilla.com/v1/geolocate?key=geoclue"] @ | |
7260 | [#:submit-data? #f] | |
7261 | [#:wifi-submission-url "https://location.services.mozilla.com/v1/submit?key=geoclue"] @ | |
7262 | [#:submission-nick "geoclue"] @ | |
7263 | [#:applications %standard-geoclue-applications] | |
7264 | Return a service that runs the GeoClue location service. This service | |
7265 | provides a D-Bus interface to allow applications to request access to a | |
7266 | user's physical location, and optionally to add information to online | |
7267 | location databases. See | |
7268 | @uref{https://wiki.freedesktop.org/www/Software/GeoClue/, the GeoClue | |
7269 | web site} for more information. | |
7270 | @end deffn | |
7271 | ||
105369a4 DT |
7272 | @node Database Services |
7273 | @subsubsection Database Services | |
7274 | ||
7275 | The @code{(gnu services databases)} module provides the following service. | |
7276 | ||
be1c2c54 | 7277 | @deffn {Scheme Procedure} postgresql-service [#:postgresql postgresql] @ |
105369a4 DT |
7278 | [#:config-file] [#:data-directory ``/var/lib/postgresql/data''] |
7279 | Return a service that runs @var{postgresql}, the PostgreSQL database | |
7280 | server. | |
7281 | ||
7282 | The PostgreSQL daemon loads its runtime configuration from | |
7283 | @var{config-file} and stores the database cluster in | |
7284 | @var{data-directory}. | |
7285 | @end deffn | |
fe1a39d3 | 7286 | |
d8c18af8 AW |
7287 | @node Mail Services |
7288 | @subsubsection Mail Services | |
7289 | ||
7290 | The @code{(gnu services mail)} module provides Guix service definitions | |
7291 | for mail services. Currently the only implemented service is Dovecot, | |
7292 | an IMAP, POP3, and LMTP server. | |
7293 | ||
7294 | Guix does not yet have a mail transfer agent (MTA), although for some | |
7295 | lightweight purposes the @code{esmtp} relay-only MTA may suffice. Help | |
7296 | is needed to properly integrate a full MTA, such as Postfix. Patches | |
7297 | welcome! | |
7298 | ||
7299 | To add an IMAP/POP3 server to a GuixSD system, add a | |
7300 | @code{dovecot-service} to the operating system definition: | |
7301 | ||
7302 | @deffn {Scheme Procedure} dovecot-service [#:config (dovecot-configuration)] | |
7303 | Return a service that runs the Dovecot IMAP/POP3/LMTP mail server. | |
7304 | @end deffn | |
7305 | ||
7306 | By default, Dovecot doesn't need much configuration; the default | |
7307 | configuration object created by @code{(dovecot-configuration)} will | |
7308 | suffice if your mail is delivered to @code{~/Maildir}. A self-signed | |
7309 | certificate will be generated for TLS-protected connections, though | |
7310 | Dovecot will also listen on cleartext ports by default. There are a | |
7311 | number of options though which mail administrators might need to change, | |
7312 | and as is the case with other services, Guix allows the system | |
7313 | administrator to specify these parameters via a uniform Scheme interface. | |
7314 | ||
7315 | For example, to specify that mail is located at @code{maildir~/.mail}, | |
7316 | one would instantiate the Dovecot service like this: | |
7317 | ||
7318 | @example | |
7319 | (dovecot-service #:config | |
7320 | (dovecot-configuration | |
7321 | (mail-location "maildir:~/.mail"))) | |
7322 | @end example | |
7323 | ||
7324 | The available configuration parameters follow. Each parameter | |
7325 | definition is preceded by its type; for example, @samp{string-list foo} | |
7326 | indicates that the @code{foo} parameter should be specified as a list of | |
7327 | strings. There is also a way to specify the configuration as a string, | |
7328 | if you have an old @code{dovecot.conf} file that you want to port over | |
7329 | from some other system; see the end for more details. | |
7330 | ||
7331 | @c The following documentation was initially generated by | |
7332 | @c (generate-documentation) in (gnu services mail). Manually maintained | |
7333 | @c documentation is better, so we shouldn't hesitate to edit below as | |
7334 | @c needed. However if the change you want to make to this documentation | |
7335 | @c can be done in an automated way, it's probably easier to change | |
7336 | @c (generate-documentation) than to make it below and have to deal with | |
7337 | @c the churn as dovecot updates. | |
7338 | ||
7339 | Available @code{dovecot-configuration} fields are: | |
7340 | ||
7341 | @deftypevr {@code{dovecot-configuration} parameter} package dovecot | |
7342 | The dovecot package. | |
7343 | @end deftypevr | |
7344 | ||
7345 | @deftypevr {@code{dovecot-configuration} parameter} comma-separated-string-list listen | |
7346 | A list of IPs or hosts where to listen in for connections. @samp{*} | |
7347 | listens in all IPv4 interfaces, @samp{::} listens in all IPv6 | |
7348 | interfaces. If you want to specify non-default ports or anything more | |
7349 | complex, customize the address and port fields of the | |
7350 | @samp{inet-listener} of the specific services you are interested in. | |
7351 | @end deftypevr | |
7352 | ||
7353 | @deftypevr {@code{dovecot-configuration} parameter} protocol-configuration-list protocols | |
7354 | List of protocols we want to serve. Available protocols include | |
7355 | @samp{imap}, @samp{pop3}, and @samp{lmtp}. | |
7356 | ||
7357 | Available @code{protocol-configuration} fields are: | |
7358 | ||
7359 | @deftypevr {@code{protocol-configuration} parameter} string name | |
7360 | The name of the protocol. | |
7361 | @end deftypevr | |
7362 | ||
7363 | @deftypevr {@code{protocol-configuration} parameter} string auth-socket-path | |
7364 | UNIX socket path to master authentication server to find users. | |
7365 | This is used by imap (for shared users) and lda. | |
7366 | Defaults to @samp{"/var/run/dovecot/auth-userdb"}. | |
7367 | @end deftypevr | |
7368 | ||
7369 | @deftypevr {@code{protocol-configuration} parameter} space-separated-string-list mail-plugins | |
7370 | Space separated list of plugins to load. | |
7371 | @end deftypevr | |
7372 | ||
7373 | @deftypevr {@code{protocol-configuration} parameter} non-negative-integer mail-max-userip-connections | |
7374 | Maximum number of IMAP connections allowed for a user from each IP | |
7375 | address. NOTE: The username is compared case-sensitively. | |
7376 | Defaults to @samp{10}. | |
7377 | @end deftypevr | |
7378 | ||
7379 | @end deftypevr | |
7380 | ||
7381 | @deftypevr {@code{dovecot-configuration} parameter} service-configuration-list services | |
7382 | List of services to enable. Available services include @samp{imap}, | |
7383 | @samp{imap-login}, @samp{pop3}, @samp{pop3-login}, @samp{auth}, and | |
7384 | @samp{lmtp}. | |
7385 | ||
7386 | Available @code{service-configuration} fields are: | |
7387 | ||
7388 | @deftypevr {@code{service-configuration} parameter} string kind | |
7389 | The service kind. Valid values include @code{director}, | |
7390 | @code{imap-login}, @code{pop3-login}, @code{lmtp}, @code{imap}, | |
7391 | @code{pop3}, @code{auth}, @code{auth-worker}, @code{dict}, | |
7392 | @code{tcpwrap}, @code{quota-warning}, or anything else. | |
7393 | @end deftypevr | |
7394 | ||
7395 | @deftypevr {@code{service-configuration} parameter} listener-configuration-list listeners | |
7396 | Listeners for the service. A listener is either an | |
7397 | @code{unix-listener-configuration}, a @code{fifo-listener-configuration}, or | |
7398 | an @code{inet-listener-configuration}. | |
7399 | Defaults to @samp{()}. | |
7400 | ||
7401 | Available @code{unix-listener-configuration} fields are: | |
7402 | ||
7403 | @deftypevr {@code{unix-listener-configuration} parameter} file-name path | |
7404 | The file name on which to listen. | |
7405 | @end deftypevr | |
7406 | ||
7407 | @deftypevr {@code{unix-listener-configuration} parameter} string mode | |
7408 | The access mode for the socket. | |
7409 | Defaults to @samp{"0600"}. | |
7410 | @end deftypevr | |
7411 | ||
7412 | @deftypevr {@code{unix-listener-configuration} parameter} string user | |
f9b9a033 | 7413 | The user to own the socket. |
d8c18af8 AW |
7414 | Defaults to @samp{""}. |
7415 | @end deftypevr | |
7416 | ||
7417 | @deftypevr {@code{unix-listener-configuration} parameter} string group | |
7418 | The group to own the socket. | |
7419 | Defaults to @samp{""}. | |
7420 | @end deftypevr | |
7421 | ||
7422 | ||
7423 | Available @code{fifo-listener-configuration} fields are: | |
7424 | ||
7425 | @deftypevr {@code{fifo-listener-configuration} parameter} file-name path | |
7426 | The file name on which to listen. | |
7427 | @end deftypevr | |
7428 | ||
7429 | @deftypevr {@code{fifo-listener-configuration} parameter} string mode | |
7430 | The access mode for the socket. | |
7431 | Defaults to @samp{"0600"}. | |
7432 | @end deftypevr | |
7433 | ||
7434 | @deftypevr {@code{fifo-listener-configuration} parameter} string user | |
f9b9a033 | 7435 | The user to own the socket. |
d8c18af8 AW |
7436 | Defaults to @samp{""}. |
7437 | @end deftypevr | |
7438 | ||
7439 | @deftypevr {@code{fifo-listener-configuration} parameter} string group | |
7440 | The group to own the socket. | |
7441 | Defaults to @samp{""}. | |
7442 | @end deftypevr | |
7443 | ||
7444 | ||
7445 | Available @code{inet-listener-configuration} fields are: | |
7446 | ||
7447 | @deftypevr {@code{inet-listener-configuration} parameter} string protocol | |
7448 | The protocol to listen for. | |
7449 | @end deftypevr | |
7450 | ||
7451 | @deftypevr {@code{inet-listener-configuration} parameter} string address | |
7452 | The address on which to listen, or empty for all addresses. | |
7453 | Defaults to @samp{""}. | |
7454 | @end deftypevr | |
7455 | ||
7456 | @deftypevr {@code{inet-listener-configuration} parameter} non-negative-integer port | |
7457 | The port on which to listen. | |
7458 | @end deftypevr | |
7459 | ||
7460 | @deftypevr {@code{inet-listener-configuration} parameter} boolean ssl? | |
7461 | Whether to use SSL for this service; @samp{yes}, @samp{no}, or | |
7462 | @samp{required}. | |
7463 | Defaults to @samp{#t}. | |
7464 | @end deftypevr | |
7465 | ||
7466 | @end deftypevr | |
7467 | ||
7468 | @deftypevr {@code{service-configuration} parameter} non-negative-integer service-count | |
7469 | Number of connections to handle before starting a new process. | |
7470 | Typically the only useful values are 0 (unlimited) or 1. 1 is more | |
7471 | secure, but 0 is faster. <doc/wiki/LoginProcess.txt>. | |
7472 | Defaults to @samp{1}. | |
7473 | @end deftypevr | |
7474 | ||
7475 | @deftypevr {@code{service-configuration} parameter} non-negative-integer process-min-avail | |
7476 | Number of processes to always keep waiting for more connections. | |
7477 | Defaults to @samp{0}. | |
7478 | @end deftypevr | |
7479 | ||
7480 | @deftypevr {@code{service-configuration} parameter} non-negative-integer vsz-limit | |
7481 | If you set @samp{service-count 0}, you probably need to grow | |
7482 | this. | |
7483 | Defaults to @samp{256000000}. | |
7484 | @end deftypevr | |
7485 | ||
7486 | @end deftypevr | |
7487 | ||
7488 | @deftypevr {@code{dovecot-configuration} parameter} dict-configuration dict | |
7489 | Dict configuration, as created by the @code{dict-configuration} | |
7490 | constructor. | |
7491 | ||
7492 | Available @code{dict-configuration} fields are: | |
7493 | ||
7494 | @deftypevr {@code{dict-configuration} parameter} free-form-fields entries | |
7495 | A list of key-value pairs that this dict should hold. | |
7496 | Defaults to @samp{()}. | |
7497 | @end deftypevr | |
7498 | ||
7499 | @end deftypevr | |
7500 | ||
7501 | @deftypevr {@code{dovecot-configuration} parameter} passdb-configuration-list passdbs | |
7502 | List of passdb configurations, each one created by the | |
7503 | @code{passdb-configuration} constructor. | |
7504 | ||
7505 | Available @code{passdb-configuration} fields are: | |
7506 | ||
7507 | @deftypevr {@code{passdb-configuration} parameter} string driver | |
7508 | The driver that the passdb should use. Valid values include | |
7509 | @samp{pam}, @samp{passwd}, @samp{shadow}, @samp{bsdauth}, and | |
7510 | @samp{static}. | |
7511 | Defaults to @samp{"pam"}. | |
7512 | @end deftypevr | |
7513 | ||
7514 | @deftypevr {@code{passdb-configuration} parameter} free-form-args args | |
7515 | A list of key-value args to the passdb driver. | |
7516 | Defaults to @samp{()}. | |
7517 | @end deftypevr | |
7518 | ||
7519 | @end deftypevr | |
7520 | ||
7521 | @deftypevr {@code{dovecot-configuration} parameter} userdb-configuration-list userdbs | |
7522 | List of userdb configurations, each one created by the | |
7523 | @code{userdb-configuration} constructor. | |
7524 | ||
7525 | Available @code{userdb-configuration} fields are: | |
7526 | ||
7527 | @deftypevr {@code{userdb-configuration} parameter} string driver | |
7528 | The driver that the userdb should use. Valid values include | |
7529 | @samp{passwd} and @samp{static}. | |
7530 | Defaults to @samp{"passwd"}. | |
7531 | @end deftypevr | |
7532 | ||
7533 | @deftypevr {@code{userdb-configuration} parameter} free-form-args args | |
7534 | A list of key-value args to the userdb driver. | |
7535 | Defaults to @samp{()}. | |
7536 | @end deftypevr | |
7537 | ||
7538 | @deftypevr {@code{userdb-configuration} parameter} free-form-args override-fields | |
7539 | Override fields from passwd. | |
7540 | Defaults to @samp{()}. | |
7541 | @end deftypevr | |
7542 | ||
7543 | @end deftypevr | |
7544 | ||
7545 | @deftypevr {@code{dovecot-configuration} parameter} plugin-configuration plugin-configuration | |
7546 | Plug-in configuration, created by the @code{plugin-configuration} | |
7547 | constructor. | |
7548 | @end deftypevr | |
7549 | ||
7550 | @deftypevr {@code{dovecot-configuration} parameter} list-of-namespace-configuration namespaces | |
7551 | List of namespaces. Each item in the list is created by the | |
7552 | @code{namespace-configuration} constructor. | |
7553 | ||
7554 | Available @code{namespace-configuration} fields are: | |
7555 | ||
7556 | @deftypevr {@code{namespace-configuration} parameter} string name | |
7557 | Name for this namespace. | |
7558 | @end deftypevr | |
7559 | ||
7560 | @deftypevr {@code{namespace-configuration} parameter} string type | |
7561 | Namespace type: @samp{private}, @samp{shared} or @samp{public}. | |
7562 | Defaults to @samp{"private"}. | |
7563 | @end deftypevr | |
7564 | ||
7565 | @deftypevr {@code{namespace-configuration} parameter} string separator | |
7566 | Hierarchy separator to use. You should use the same separator for | |
7567 | all namespaces or some clients get confused. @samp{/} is usually a good | |
7568 | one. The default however depends on the underlying mail storage | |
7569 | format. | |
7570 | Defaults to @samp{""}. | |
7571 | @end deftypevr | |
7572 | ||
7573 | @deftypevr {@code{namespace-configuration} parameter} string prefix | |
7574 | Prefix required to access this namespace. This needs to be | |
7575 | different for all namespaces. For example @samp{Public/}. | |
7576 | Defaults to @samp{""}. | |
7577 | @end deftypevr | |
7578 | ||
7579 | @deftypevr {@code{namespace-configuration} parameter} string location | |
7580 | Physical location of the mailbox. This is in same format as | |
7581 | mail_location, which is also the default for it. | |
7582 | Defaults to @samp{""}. | |
7583 | @end deftypevr | |
7584 | ||
7585 | @deftypevr {@code{namespace-configuration} parameter} boolean inbox? | |
7586 | There can be only one INBOX, and this setting defines which | |
7587 | namespace has it. | |
7588 | Defaults to @samp{#f}. | |
7589 | @end deftypevr | |
7590 | ||
7591 | @deftypevr {@code{namespace-configuration} parameter} boolean hidden? | |
7592 | If namespace is hidden, it's not advertised to clients via NAMESPACE | |
7593 | extension. You'll most likely also want to set @samp{list? #f}. This is mostly | |
7594 | useful when converting from another server with different namespaces | |
7595 | which you want to deprecate but still keep working. For example you can | |
7596 | create hidden namespaces with prefixes @samp{~/mail/}, @samp{~%u/mail/} | |
7597 | and @samp{mail/}. | |
7598 | Defaults to @samp{#f}. | |
7599 | @end deftypevr | |
7600 | ||
7601 | @deftypevr {@code{namespace-configuration} parameter} boolean list? | |
7602 | Show the mailboxes under this namespace with LIST command. This | |
7603 | makes the namespace visible for clients that don't support NAMESPACE | |
7604 | extension. The special @code{children} value lists child mailboxes, but | |
7605 | hides the namespace prefix. | |
7606 | Defaults to @samp{#t}. | |
7607 | @end deftypevr | |
7608 | ||
7609 | @deftypevr {@code{namespace-configuration} parameter} boolean subscriptions? | |
7610 | Namespace handles its own subscriptions. If set to @code{#f}, the | |
7611 | parent namespace handles them. The empty prefix should always have this | |
7612 | as @code{#t}.) | |
7613 | Defaults to @samp{#t}. | |
7614 | @end deftypevr | |
7615 | ||
7616 | @deftypevr {@code{namespace-configuration} parameter} mailbox-configuration-list mailboxes | |
7617 | List of predefined mailboxes in this namespace. | |
7618 | Defaults to @samp{()}. | |
7619 | ||
7620 | Available @code{mailbox-configuration} fields are: | |
7621 | ||
7622 | @deftypevr {@code{mailbox-configuration} parameter} string name | |
7623 | Name for this mailbox. | |
7624 | @end deftypevr | |
7625 | ||
7626 | @deftypevr {@code{mailbox-configuration} parameter} string auto | |
7627 | @samp{create} will automatically create this mailbox. | |
7628 | @samp{subscribe} will both create and subscribe to the mailbox. | |
7629 | Defaults to @samp{"no"}. | |
7630 | @end deftypevr | |
7631 | ||
7632 | @deftypevr {@code{mailbox-configuration} parameter} space-separated-string-list special-use | |
7633 | List of IMAP @code{SPECIAL-USE} attributes as specified by RFC 6154. | |
7634 | Valid values are @code{\All}, @code{\Archive}, @code{\Drafts}, | |
7635 | @code{\Flagged}, @code{\Junk}, @code{\Sent}, and @code{\Trash}. | |
7636 | Defaults to @samp{()}. | |
7637 | @end deftypevr | |
7638 | ||
7639 | @end deftypevr | |
7640 | ||
7641 | @end deftypevr | |
7642 | ||
7643 | @deftypevr {@code{dovecot-configuration} parameter} file-name base-dir | |
7644 | Base directory where to store runtime data. | |
7645 | Defaults to @samp{"/var/run/dovecot/"}. | |
7646 | @end deftypevr | |
7647 | ||
7648 | @deftypevr {@code{dovecot-configuration} parameter} string login-greeting | |
7649 | Greeting message for clients. | |
7650 | Defaults to @samp{"Dovecot ready."}. | |
7651 | @end deftypevr | |
7652 | ||
7653 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-trusted-networks | |
7654 | List of trusted network ranges. Connections from these IPs are | |
7655 | allowed to override their IP addresses and ports (for logging and for | |
7656 | authentication checks). @samp{disable-plaintext-auth} is also ignored | |
7657 | for these networks. Typically you'd specify your IMAP proxy servers | |
7658 | here. | |
7659 | Defaults to @samp{()}. | |
7660 | @end deftypevr | |
7661 | ||
7662 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-access-sockets | |
7663 | List of login access check sockets (e.g. tcpwrap). | |
7664 | Defaults to @samp{()}. | |
7665 | @end deftypevr | |
7666 | ||
7667 | @deftypevr {@code{dovecot-configuration} parameter} boolean verbose-proctitle? | |
7668 | Show more verbose process titles (in ps). Currently shows user name | |
7669 | and IP address. Useful for seeing who are actually using the IMAP | |
7670 | processes (e.g. shared mailboxes or if same uid is used for multiple | |
7671 | accounts). | |
7672 | Defaults to @samp{#f}. | |
7673 | @end deftypevr | |
7674 | ||
7675 | @deftypevr {@code{dovecot-configuration} parameter} boolean shutdown-clients? | |
7676 | Should all processes be killed when Dovecot master process shuts down. | |
7677 | Setting this to @code{#f} means that Dovecot can be upgraded without | |
7678 | forcing existing client connections to close (although that could also | |
7679 | be a problem if the upgrade is e.g. because of a security fix). | |
7680 | Defaults to @samp{#t}. | |
7681 | @end deftypevr | |
7682 | ||
7683 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer doveadm-worker-count | |
7684 | If non-zero, run mail commands via this many connections to doveadm | |
7685 | server, instead of running them directly in the same process. | |
7686 | Defaults to @samp{0}. | |
7687 | @end deftypevr | |
7688 | ||
7689 | @deftypevr {@code{dovecot-configuration} parameter} string doveadm-socket-path | |
7690 | UNIX socket or host:port used for connecting to doveadm server. | |
7691 | Defaults to @samp{"doveadm-server"}. | |
7692 | @end deftypevr | |
7693 | ||
7694 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list import-environment | |
7695 | List of environment variables that are preserved on Dovecot startup | |
7696 | and passed down to all of its child processes. You can also give | |
7697 | key=value pairs to always set specific settings. | |
7698 | @end deftypevr | |
7699 | ||
7700 | @deftypevr {@code{dovecot-configuration} parameter} boolean disable-plaintext-auth? | |
7701 | Disable LOGIN command and all other plaintext authentications unless | |
7702 | SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP | |
7703 | matches the local IP (i.e. you're connecting from the same computer), | |
7704 | the connection is considered secure and plaintext authentication is | |
7705 | allowed. See also ssl=required setting. | |
7706 | Defaults to @samp{#t}. | |
7707 | @end deftypevr | |
7708 | ||
7709 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer auth-cache-size | |
7710 | Authentication cache size (e.g. @samp{#e10e6}). 0 means it's disabled. | |
7711 | Note that bsdauth, PAM and vpopmail require @samp{cache-key} to be set | |
7712 | for caching to be used. | |
7713 | Defaults to @samp{0}. | |
7714 | @end deftypevr | |
7715 | ||
7716 | @deftypevr {@code{dovecot-configuration} parameter} string auth-cache-ttl | |
7717 | Time to live for cached data. After TTL expires the cached record | |
7718 | is no longer used, *except* if the main database lookup returns internal | |
7719 | failure. We also try to handle password changes automatically: If | |
7720 | user's previous authentication was successful, but this one wasn't, the | |
7721 | cache isn't used. For now this works only with plaintext | |
7722 | authentication. | |
7723 | Defaults to @samp{"1 hour"}. | |
7724 | @end deftypevr | |
7725 | ||
7726 | @deftypevr {@code{dovecot-configuration} parameter} string auth-cache-negative-ttl | |
7727 | TTL for negative hits (user not found, password mismatch). | |
7728 | 0 disables caching them completely. | |
7729 | Defaults to @samp{"1 hour"}. | |
7730 | @end deftypevr | |
7731 | ||
7732 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list auth-realms | |
7733 | List of realms for SASL authentication mechanisms that need them. | |
7734 | You can leave it empty if you don't want to support multiple realms. | |
7735 | Many clients simply use the first one listed here, so keep the default | |
7736 | realm first. | |
7737 | Defaults to @samp{()}. | |
7738 | @end deftypevr | |
7739 | ||
7740 | @deftypevr {@code{dovecot-configuration} parameter} string auth-default-realm | |
7741 | Default realm/domain to use if none was specified. This is used for | |
7742 | both SASL realms and appending @@domain to username in plaintext | |
7743 | logins. | |
7744 | Defaults to @samp{""}. | |
7745 | @end deftypevr | |
7746 | ||
7747 | @deftypevr {@code{dovecot-configuration} parameter} string auth-username-chars | |
7748 | List of allowed characters in username. If the user-given username | |
7749 | contains a character not listed in here, the login automatically fails. | |
7750 | This is just an extra check to make sure user can't exploit any | |
7751 | potential quote escaping vulnerabilities with SQL/LDAP databases. If | |
7752 | you want to allow all characters, set this value to empty. | |
7753 | Defaults to @samp{"abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@@"}. | |
7754 | @end deftypevr | |
7755 | ||
7756 | @deftypevr {@code{dovecot-configuration} parameter} string auth-username-translation | |
7757 | Username character translations before it's looked up from | |
7758 | databases. The value contains series of from -> to characters. For | |
7759 | example @samp{#@@/@@} means that @samp{#} and @samp{/} characters are | |
7760 | translated to @samp{@@}. | |
7761 | Defaults to @samp{""}. | |
7762 | @end deftypevr | |
7763 | ||
7764 | @deftypevr {@code{dovecot-configuration} parameter} string auth-username-format | |
7765 | Username formatting before it's looked up from databases. You can | |
7766 | use the standard variables here, e.g. %Lu would lowercase the username, | |
7767 | %n would drop away the domain if it was given, or @samp{%n-AT-%d} would | |
7768 | change the @samp{@@} into @samp{-AT-}. This translation is done after | |
7769 | @samp{auth-username-translation} changes. | |
7770 | Defaults to @samp{"%Lu"}. | |
7771 | @end deftypevr | |
7772 | ||
7773 | @deftypevr {@code{dovecot-configuration} parameter} string auth-master-user-separator | |
7774 | If you want to allow master users to log in by specifying the master | |
7775 | username within the normal username string (i.e. not using SASL | |
7776 | mechanism's support for it), you can specify the separator character | |
7777 | here. The format is then <username><separator><master username>. | |
7778 | UW-IMAP uses @samp{*} as the separator, so that could be a good | |
7779 | choice. | |
7780 | Defaults to @samp{""}. | |
7781 | @end deftypevr | |
7782 | ||
7783 | @deftypevr {@code{dovecot-configuration} parameter} string auth-anonymous-username | |
7784 | Username to use for users logging in with ANONYMOUS SASL | |
7785 | mechanism. | |
7786 | Defaults to @samp{"anonymous"}. | |
7787 | @end deftypevr | |
7788 | ||
7789 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer auth-worker-max-count | |
7790 | Maximum number of dovecot-auth worker processes. They're used to | |
7791 | execute blocking passdb and userdb queries (e.g. MySQL and PAM). | |
7792 | They're automatically created and destroyed as needed. | |
7793 | Defaults to @samp{30}. | |
7794 | @end deftypevr | |
7795 | ||
7796 | @deftypevr {@code{dovecot-configuration} parameter} string auth-gssapi-hostname | |
7797 | Host name to use in GSSAPI principal names. The default is to use | |
7798 | the name returned by gethostname(). Use @samp{$ALL} (with quotes) to | |
7799 | allow all keytab entries. | |
7800 | Defaults to @samp{""}. | |
7801 | @end deftypevr | |
7802 | ||
7803 | @deftypevr {@code{dovecot-configuration} parameter} string auth-krb5-keytab | |
7804 | Kerberos keytab to use for the GSSAPI mechanism. Will use the | |
7805 | system default (usually /etc/krb5.keytab) if not specified. You may | |
7806 | need to change the auth service to run as root to be able to read this | |
7807 | file. | |
7808 | Defaults to @samp{""}. | |
7809 | @end deftypevr | |
7810 | ||
7811 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-use-winbind? | |
7812 | Do NTLM and GSS-SPNEGO authentication using Samba's winbind daemon | |
7813 | and @samp{ntlm-auth} helper. | |
7814 | <doc/wiki/Authentication/Mechanisms/Winbind.txt>. | |
7815 | Defaults to @samp{#f}. | |
7816 | @end deftypevr | |
7817 | ||
7818 | @deftypevr {@code{dovecot-configuration} parameter} file-name auth-winbind-helper-path | |
7819 | Path for Samba's @samp{ntlm-auth} helper binary. | |
7820 | Defaults to @samp{"/usr/bin/ntlm_auth"}. | |
7821 | @end deftypevr | |
7822 | ||
7823 | @deftypevr {@code{dovecot-configuration} parameter} string auth-failure-delay | |
7824 | Time to delay before replying to failed authentications. | |
7825 | Defaults to @samp{"2 secs"}. | |
7826 | @end deftypevr | |
7827 | ||
7828 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-ssl-require-client-cert? | |
7829 | Require a valid SSL client certificate or the authentication | |
7830 | fails. | |
7831 | Defaults to @samp{#f}. | |
7832 | @end deftypevr | |
7833 | ||
7834 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-ssl-username-from-cert? | |
7835 | Take the username from client's SSL certificate, using | |
7836 | @code{X509_NAME_get_text_by_NID()} which returns the subject's DN's | |
7837 | CommonName. | |
7838 | Defaults to @samp{#f}. | |
7839 | @end deftypevr | |
7840 | ||
7841 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list auth-mechanisms | |
7842 | List of wanted authentication mechanisms. Supported mechanisms are: | |
7843 | @samp{plain}, @samp{login}, @samp{digest-md5}, @samp{cram-md5}, | |
7844 | @samp{ntlm}, @samp{rpa}, @samp{apop}, @samp{anonymous}, @samp{gssapi}, | |
7845 | @samp{otp}, @samp{skey}, and @samp{gss-spnego}. NOTE: See also | |
7846 | @samp{disable-plaintext-auth} setting. | |
7847 | @end deftypevr | |
7848 | ||
7849 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list director-servers | |
7850 | List of IPs or hostnames to all director servers, including ourself. | |
7851 | Ports can be specified as ip:port. The default port is the same as what | |
7852 | director service's @samp{inet-listener} is using. | |
7853 | Defaults to @samp{()}. | |
7854 | @end deftypevr | |
7855 | ||
7856 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list director-mail-servers | |
7857 | List of IPs or hostnames to all backend mail servers. Ranges are | |
7858 | allowed too, like 10.0.0.10-10.0.0.30. | |
7859 | Defaults to @samp{()}. | |
7860 | @end deftypevr | |
7861 | ||
7862 | @deftypevr {@code{dovecot-configuration} parameter} string director-user-expire | |
7863 | How long to redirect users to a specific server after it no longer | |
7864 | has any connections. | |
7865 | Defaults to @samp{"15 min"}. | |
7866 | @end deftypevr | |
7867 | ||
7868 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer director-doveadm-port | |
7869 | TCP/IP port that accepts doveadm connections (instead of director | |
7870 | connections) If you enable this, you'll also need to add | |
7871 | @samp{inet-listener} for the port. | |
7872 | Defaults to @samp{0}. | |
7873 | @end deftypevr | |
7874 | ||
7875 | @deftypevr {@code{dovecot-configuration} parameter} string director-username-hash | |
7876 | How the username is translated before being hashed. Useful values | |
7877 | include %Ln if user can log in with or without @@domain, %Ld if mailboxes | |
7878 | are shared within domain. | |
7879 | Defaults to @samp{"%Lu"}. | |
7880 | @end deftypevr | |
7881 | ||
7882 | @deftypevr {@code{dovecot-configuration} parameter} string log-path | |
7883 | Log file to use for error messages. @samp{syslog} logs to syslog, | |
7884 | @samp{/dev/stderr} logs to stderr. | |
7885 | Defaults to @samp{"syslog"}. | |
7886 | @end deftypevr | |
7887 | ||
7888 | @deftypevr {@code{dovecot-configuration} parameter} string info-log-path | |
7889 | Log file to use for informational messages. Defaults to | |
7890 | @samp{log-path}. | |
7891 | Defaults to @samp{""}. | |
7892 | @end deftypevr | |
7893 | ||
7894 | @deftypevr {@code{dovecot-configuration} parameter} string debug-log-path | |
7895 | Log file to use for debug messages. Defaults to | |
7896 | @samp{info-log-path}. | |
7897 | Defaults to @samp{""}. | |
7898 | @end deftypevr | |
7899 | ||
7900 | @deftypevr {@code{dovecot-configuration} parameter} string syslog-facility | |
7901 | Syslog facility to use if you're logging to syslog. Usually if you | |
7902 | don't want to use @samp{mail}, you'll use local0..local7. Also other | |
7903 | standard facilities are supported. | |
7904 | Defaults to @samp{"mail"}. | |
7905 | @end deftypevr | |
7906 | ||
7907 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-verbose? | |
7908 | Log unsuccessful authentication attempts and the reasons why they | |
7909 | failed. | |
7910 | Defaults to @samp{#f}. | |
7911 | @end deftypevr | |
7912 | ||
7913 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-verbose-passwords? | |
7914 | In case of password mismatches, log the attempted password. Valid | |
7915 | values are no, plain and sha1. sha1 can be useful for detecting brute | |
7916 | force password attempts vs. user simply trying the same password over | |
7917 | and over again. You can also truncate the value to n chars by appending | |
7918 | ":n" (e.g. sha1:6). | |
7919 | Defaults to @samp{#f}. | |
7920 | @end deftypevr | |
7921 | ||
7922 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-debug? | |
7923 | Even more verbose logging for debugging purposes. Shows for example | |
7924 | SQL queries. | |
7925 | Defaults to @samp{#f}. | |
7926 | @end deftypevr | |
7927 | ||
7928 | @deftypevr {@code{dovecot-configuration} parameter} boolean auth-debug-passwords? | |
7929 | In case of password mismatches, log the passwords and used scheme so | |
7930 | the problem can be debugged. Enabling this also enables | |
7931 | @samp{auth-debug}. | |
7932 | Defaults to @samp{#f}. | |
7933 | @end deftypevr | |
7934 | ||
7935 | @deftypevr {@code{dovecot-configuration} parameter} boolean mail-debug? | |
7936 | Enable mail process debugging. This can help you figure out why | |
7937 | Dovecot isn't finding your mails. | |
7938 | Defaults to @samp{#f}. | |
7939 | @end deftypevr | |
7940 | ||
7941 | @deftypevr {@code{dovecot-configuration} parameter} boolean verbose-ssl? | |
7942 | Show protocol level SSL errors. | |
7943 | Defaults to @samp{#f}. | |
7944 | @end deftypevr | |
7945 | ||
7946 | @deftypevr {@code{dovecot-configuration} parameter} string log-timestamp | |
7947 | Prefix for each line written to log file. % codes are in | |
7948 | strftime(3) format. | |
7949 | Defaults to @samp{"\"%b %d %H:%M:%S \""}. | |
7950 | @end deftypevr | |
7951 | ||
7952 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list login-log-format-elements | |
7953 | List of elements we want to log. The elements which have a | |
7954 | non-empty variable value are joined together to form a comma-separated | |
7955 | string. | |
7956 | @end deftypevr | |
7957 | ||
7958 | @deftypevr {@code{dovecot-configuration} parameter} string login-log-format | |
7959 | Login log format. %s contains @samp{login-log-format-elements} | |
7960 | string, %$ contains the data we want to log. | |
7961 | Defaults to @samp{"%$: %s"}. | |
7962 | @end deftypevr | |
7963 | ||
7964 | @deftypevr {@code{dovecot-configuration} parameter} string mail-log-prefix | |
7965 | Log prefix for mail processes. See doc/wiki/Variables.txt for list | |
7966 | of possible variables you can use. | |
7967 | Defaults to @samp{"\"%s(%u): \""}. | |
7968 | @end deftypevr | |
7969 | ||
7970 | @deftypevr {@code{dovecot-configuration} parameter} string deliver-log-format | |
7971 | Format to use for logging mail deliveries. You can use variables: | |
7972 | @table @code | |
7973 | @item %$ | |
7974 | Delivery status message (e.g. @samp{saved to INBOX}) | |
7975 | @item %m | |
7976 | Message-ID | |
7977 | @item %s | |
7978 | Subject | |
7979 | @item %f | |
7980 | From address | |
7981 | @item %p | |
7982 | Physical size | |
7983 | @item %w | |
7984 | Virtual size. | |
7985 | @end table | |
7986 | Defaults to @samp{"msgid=%m: %$"}. | |
7987 | @end deftypevr | |
7988 | ||
7989 | @deftypevr {@code{dovecot-configuration} parameter} string mail-location | |
7990 | Location for users' mailboxes. The default is empty, which means | |
7991 | that Dovecot tries to find the mailboxes automatically. This won't work | |
7992 | if the user doesn't yet have any mail, so you should explicitly tell | |
7993 | Dovecot the full location. | |
7994 | ||
7995 | If you're using mbox, giving a path to the INBOX | |
7996 | file (e.g. /var/mail/%u) isn't enough. You'll also need to tell Dovecot | |
7997 | where the other mailboxes are kept. This is called the "root mail | |
7998 | directory", and it must be the first path given in the | |
7999 | @samp{mail-location} setting. | |
8000 | ||
8001 | There are a few special variables you can use, eg.: | |
8002 | ||
8003 | @table @samp | |
8004 | @item %u | |
8005 | username | |
8006 | @item %n | |
8007 | user part in user@@domain, same as %u if there's no domain | |
8008 | @item %d | |
8009 | domain part in user@@domain, empty if there's no domain | |
8010 | @item %h | |
8011 | home director | |
8012 | @end table | |
8013 | ||
8014 | See doc/wiki/Variables.txt for full list. Some examples: | |
8015 | @table @samp | |
8016 | @item maildir:~/Maildir | |
8017 | @item mbox:~/mail:INBOX=/var/mail/%u | |
8018 | @item mbox:/var/mail/%d/%1n/%n:INDEX=/var/indexes/%d/%1n/% | |
8019 | @end table | |
8020 | Defaults to @samp{""}. | |
8021 | @end deftypevr | |
8022 | ||
8023 | @deftypevr {@code{dovecot-configuration} parameter} string mail-uid | |
8024 | System user and group used to access mails. If you use multiple, | |
8025 | userdb can override these by returning uid or gid fields. You can use | |
8026 | either numbers or names. <doc/wiki/UserIds.txt>. | |
8027 | Defaults to @samp{""}. | |
8028 | @end deftypevr | |
8029 | ||
8030 | @deftypevr {@code{dovecot-configuration} parameter} string mail-gid | |
8031 | ||
8032 | Defaults to @samp{""}. | |
8033 | @end deftypevr | |
8034 | ||
8035 | @deftypevr {@code{dovecot-configuration} parameter} string mail-privileged-group | |
8036 | Group to enable temporarily for privileged operations. Currently | |
8037 | this is used only with INBOX when either its initial creation or | |
8038 | dotlocking fails. Typically this is set to "mail" to give access to | |
8039 | /var/mail. | |
8040 | Defaults to @samp{""}. | |
8041 | @end deftypevr | |
8042 | ||
8043 | @deftypevr {@code{dovecot-configuration} parameter} string mail-access-groups | |
8044 | Grant access to these supplementary groups for mail processes. | |
8045 | Typically these are used to set up access to shared mailboxes. Note | |
8046 | that it may be dangerous to set these if users can create | |
8047 | symlinks (e.g. if "mail" group is set here, ln -s /var/mail ~/mail/var | |
8048 | could allow a user to delete others' mailboxes, or ln -s | |
8049 | /secret/shared/box ~/mail/mybox would allow reading it). | |
8050 | Defaults to @samp{""}. | |
8051 | @end deftypevr | |
8052 | ||
8053 | @deftypevr {@code{dovecot-configuration} parameter} boolean mail-full-filesystem-access? | |
8054 | Allow full filesystem access to clients. There's no access checks | |
8055 | other than what the operating system does for the active UID/GID. It | |
8056 | works with both maildir and mboxes, allowing you to prefix mailboxes | |
8057 | names with e.g. /path/ or ~user/. | |
8058 | Defaults to @samp{#f}. | |
8059 | @end deftypevr | |
8060 | ||
8061 | @deftypevr {@code{dovecot-configuration} parameter} boolean mmap-disable? | |
8062 | Don't use mmap() at all. This is required if you store indexes to | |
8063 | shared filesystems (NFS or clustered filesystem). | |
8064 | Defaults to @samp{#f}. | |
8065 | @end deftypevr | |
8066 | ||
8067 | @deftypevr {@code{dovecot-configuration} parameter} boolean dotlock-use-excl? | |
8068 | Rely on @samp{O_EXCL} to work when creating dotlock files. NFS | |
8069 | supports @samp{O_EXCL} since version 3, so this should be safe to use | |
8070 | nowadays by default. | |
8071 | Defaults to @samp{#t}. | |
8072 | @end deftypevr | |
8073 | ||
8074 | @deftypevr {@code{dovecot-configuration} parameter} string mail-fsync | |
8075 | When to use fsync() or fdatasync() calls: | |
8076 | @table @code | |
8077 | @item optimized | |
8078 | Whenever necessary to avoid losing important data | |
8079 | @item always | |
8080 | Useful with e.g. NFS when write()s are delayed | |
8081 | @item never | |
8082 | Never use it (best performance, but crashes can lose data). | |
8083 | @end table | |
8084 | Defaults to @samp{"optimized"}. | |
8085 | @end deftypevr | |
8086 | ||
8087 | @deftypevr {@code{dovecot-configuration} parameter} boolean mail-nfs-storage? | |
8088 | Mail storage exists in NFS. Set this to yes to make Dovecot flush | |
8089 | NFS caches whenever needed. If you're using only a single mail server | |
8090 | this isn't needed. | |
8091 | Defaults to @samp{#f}. | |
8092 | @end deftypevr | |
8093 | ||
8094 | @deftypevr {@code{dovecot-configuration} parameter} boolean mail-nfs-index? | |
8095 | Mail index files also exist in NFS. Setting this to yes requires | |
8096 | @samp{mmap-disable? #t} and @samp{fsync-disable? #f}. | |
8097 | Defaults to @samp{#f}. | |
8098 | @end deftypevr | |
8099 | ||
8100 | @deftypevr {@code{dovecot-configuration} parameter} string lock-method | |
8101 | Locking method for index files. Alternatives are fcntl, flock and | |
8102 | dotlock. Dotlocking uses some tricks which may create more disk I/O | |
8103 | than other locking methods. NFS users: flock doesn't work, remember to | |
8104 | change @samp{mmap-disable}. | |
8105 | Defaults to @samp{"fcntl"}. | |
8106 | @end deftypevr | |
8107 | ||
8108 | @deftypevr {@code{dovecot-configuration} parameter} file-name mail-temp-dir | |
8109 | Directory in which LDA/LMTP temporarily stores incoming mails >128 | |
8110 | kB. | |
8111 | Defaults to @samp{"/tmp"}. | |
8112 | @end deftypevr | |
8113 | ||
8114 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer first-valid-uid | |
8115 | Valid UID range for users. This is mostly to make sure that users can't | |
8116 | log in as daemons or other system users. Note that denying root logins is | |
8117 | hardcoded to dovecot binary and can't be done even if @samp{first-valid-uid} | |
8118 | is set to 0. | |
8119 | Defaults to @samp{500}. | |
8120 | @end deftypevr | |
8121 | ||
8122 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer last-valid-uid | |
8123 | ||
8124 | Defaults to @samp{0}. | |
8125 | @end deftypevr | |
8126 | ||
8127 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer first-valid-gid | |
8128 | Valid GID range for users. Users having non-valid GID as primary group ID | |
8129 | aren't allowed to log in. If user belongs to supplementary groups with | |
8130 | non-valid GIDs, those groups are not set. | |
8131 | Defaults to @samp{1}. | |
8132 | @end deftypevr | |
8133 | ||
8134 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer last-valid-gid | |
8135 | ||
8136 | Defaults to @samp{0}. | |
8137 | @end deftypevr | |
8138 | ||
8139 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-max-keyword-length | |
8140 | Maximum allowed length for mail keyword name. It's only forced when | |
8141 | trying to create new keywords. | |
8142 | Defaults to @samp{50}. | |
8143 | @end deftypevr | |
8144 | ||
8145 | @deftypevr {@code{dovecot-configuration} parameter} colon-separated-file-name-list valid-chroot-dirs | |
8146 | List of directories under which chrooting is allowed for mail | |
8147 | processes (i.e. /var/mail will allow chrooting to /var/mail/foo/bar | |
8148 | too). This setting doesn't affect @samp{login-chroot} | |
8149 | @samp{mail-chroot} or auth chroot settings. If this setting is empty, | |
8150 | "/./" in home dirs are ignored. WARNING: Never add directories here | |
8151 | which local users can modify, that may lead to root exploit. Usually | |
8152 | this should be done only if you don't allow shell access for users. | |
8153 | <doc/wiki/Chrooting.txt>. | |
8154 | Defaults to @samp{()}. | |
8155 | @end deftypevr | |
8156 | ||
8157 | @deftypevr {@code{dovecot-configuration} parameter} string mail-chroot | |
8158 | Default chroot directory for mail processes. This can be overridden | |
8159 | for specific users in user database by giving /./ in user's home | |
8160 | directory (e.g. /home/./user chroots into /home). Note that usually | |
8161 | there is no real need to do chrooting, Dovecot doesn't allow users to | |
8162 | access files outside their mail directory anyway. If your home | |
8163 | directories are prefixed with the chroot directory, append "/." to | |
8164 | @samp{mail-chroot}. <doc/wiki/Chrooting.txt>. | |
8165 | Defaults to @samp{""}. | |
8166 | @end deftypevr | |
8167 | ||
8168 | @deftypevr {@code{dovecot-configuration} parameter} file-name auth-socket-path | |
8169 | UNIX socket path to master authentication server to find users. | |
8170 | This is used by imap (for shared users) and lda. | |
8171 | Defaults to @samp{"/var/run/dovecot/auth-userdb"}. | |
8172 | @end deftypevr | |
8173 | ||
8174 | @deftypevr {@code{dovecot-configuration} parameter} file-name mail-plugin-dir | |
8175 | Directory where to look up mail plugins. | |
8176 | Defaults to @samp{"/usr/lib/dovecot"}. | |
8177 | @end deftypevr | |
8178 | ||
8179 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mail-plugins | |
8180 | List of plugins to load for all services. Plugins specific to IMAP, | |
8181 | LDA, etc. are added to this list in their own .conf files. | |
8182 | Defaults to @samp{()}. | |
8183 | @end deftypevr | |
8184 | ||
8185 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-cache-min-mail-count | |
8186 | The minimum number of mails in a mailbox before updates are done to | |
8187 | cache file. This allows optimizing Dovecot's behavior to do less disk | |
8188 | writes at the cost of more disk reads. | |
8189 | Defaults to @samp{0}. | |
8190 | @end deftypevr | |
8191 | ||
8192 | @deftypevr {@code{dovecot-configuration} parameter} string mailbox-idle-check-interval | |
8193 | When IDLE command is running, mailbox is checked once in a while to | |
8194 | see if there are any new mails or other changes. This setting defines | |
8195 | the minimum time to wait between those checks. Dovecot can also use | |
8196 | dnotify, inotify and kqueue to find out immediately when changes | |
8197 | occur. | |
8198 | Defaults to @samp{"30 secs"}. | |
8199 | @end deftypevr | |
8200 | ||
8201 | @deftypevr {@code{dovecot-configuration} parameter} boolean mail-save-crlf? | |
8202 | Save mails with CR+LF instead of plain LF. This makes sending those | |
8203 | mails take less CPU, especially with sendfile() syscall with Linux and | |
8204 | FreeBSD. But it also creates a bit more disk I/O which may just make it | |
8205 | slower. Also note that if other software reads the mboxes/maildirs, | |
8206 | they may handle the extra CRs wrong and cause problems. | |
8207 | Defaults to @samp{#f}. | |
8208 | @end deftypevr | |
8209 | ||
8210 | @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-stat-dirs? | |
8211 | By default LIST command returns all entries in maildir beginning | |
8212 | with a dot. Enabling this option makes Dovecot return only entries | |
8213 | which are directories. This is done by stat()ing each entry, so it | |
8214 | causes more disk I/O. | |
8215 | (For systems setting struct @samp{dirent->d_type} this check is free | |
8216 | and it's done always regardless of this setting). | |
8217 | Defaults to @samp{#f}. | |
8218 | @end deftypevr | |
8219 | ||
8220 | @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-copy-with-hardlinks? | |
8221 | When copying a message, do it with hard links whenever possible. | |
8222 | This makes the performance much better, and it's unlikely to have any | |
8223 | side effects. | |
8224 | Defaults to @samp{#t}. | |
8225 | @end deftypevr | |
8226 | ||
8227 | @deftypevr {@code{dovecot-configuration} parameter} boolean maildir-very-dirty-syncs? | |
8228 | Assume Dovecot is the only MUA accessing Maildir: Scan cur/ | |
8229 | directory only when its mtime changes unexpectedly or when we can't find | |
8230 | the mail otherwise. | |
8231 | Defaults to @samp{#f}. | |
8232 | @end deftypevr | |
8233 | ||
8234 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mbox-read-locks | |
8235 | Which locking methods to use for locking mbox. There are four | |
8236 | available: | |
8237 | ||
8238 | @table @code | |
8239 | @item dotlock | |
8240 | Create <mailbox>.lock file. This is the oldest and most NFS-safe | |
8241 | solution. If you want to use /var/mail/ like directory, the users will | |
8242 | need write access to that directory. | |
8243 | @item dotlock-try | |
8244 | Same as dotlock, but if it fails because of permissions or because there | |
8245 | isn't enough disk space, just skip it. | |
8246 | @item fcntl | |
8247 | Use this if possible. Works with NFS too if lockd is used. | |
8248 | @item flock | |
8249 | May not exist in all systems. Doesn't work with NFS. | |
8250 | @item lockf | |
8251 | May not exist in all systems. Doesn't work with NFS. | |
8252 | @end table | |
8253 | ||
8254 | You can use multiple locking methods; if you do the order they're declared | |
8255 | in is important to avoid deadlocks if other MTAs/MUAs are using multiple | |
8256 | locking methods as well. Some operating systems don't allow using some of | |
8257 | them simultaneously. | |
8258 | @end deftypevr | |
8259 | ||
8260 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list mbox-write-locks | |
8261 | ||
8262 | @end deftypevr | |
8263 | ||
8264 | @deftypevr {@code{dovecot-configuration} parameter} string mbox-lock-timeout | |
8265 | Maximum time to wait for lock (all of them) before aborting. | |
8266 | Defaults to @samp{"5 mins"}. | |
8267 | @end deftypevr | |
8268 | ||
8269 | @deftypevr {@code{dovecot-configuration} parameter} string mbox-dotlock-change-timeout | |
8270 | If dotlock exists but the mailbox isn't modified in any way, | |
8271 | override the lock file after this much time. | |
8272 | Defaults to @samp{"2 mins"}. | |
8273 | @end deftypevr | |
8274 | ||
8275 | @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-dirty-syncs? | |
8276 | When mbox changes unexpectedly we have to fully read it to find out | |
8277 | what changed. If the mbox is large this can take a long time. Since | |
8278 | the change is usually just a newly appended mail, it'd be faster to | |
8279 | simply read the new mails. If this setting is enabled, Dovecot does | |
8280 | this but still safely fallbacks to re-reading the whole mbox file | |
8281 | whenever something in mbox isn't how it's expected to be. The only real | |
8282 | downside to this setting is that if some other MUA changes message | |
8283 | flags, Dovecot doesn't notice it immediately. Note that a full sync is | |
8284 | done with SELECT, EXAMINE, EXPUNGE and CHECK commands. | |
8285 | Defaults to @samp{#t}. | |
8286 | @end deftypevr | |
8287 | ||
8288 | @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-very-dirty-syncs? | |
8289 | Like @samp{mbox-dirty-syncs}, but don't do full syncs even with SELECT, | |
8290 | EXAMINE, EXPUNGE or CHECK commands. If this is set, | |
8291 | @samp{mbox-dirty-syncs} is ignored. | |
8292 | Defaults to @samp{#f}. | |
8293 | @end deftypevr | |
8294 | ||
8295 | @deftypevr {@code{dovecot-configuration} parameter} boolean mbox-lazy-writes? | |
8296 | Delay writing mbox headers until doing a full write sync (EXPUNGE | |
8297 | and CHECK commands and when closing the mailbox). This is especially | |
8298 | useful for POP3 where clients often delete all mails. The downside is | |
8299 | that our changes aren't immediately visible to other MUAs. | |
8300 | Defaults to @samp{#t}. | |
8301 | @end deftypevr | |
8302 | ||
8303 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mbox-min-index-size | |
8304 | If mbox size is smaller than this (e.g. 100k), don't write index | |
8305 | files. If an index file already exists it's still read, just not | |
8306 | updated. | |
8307 | Defaults to @samp{0}. | |
8308 | @end deftypevr | |
8309 | ||
8310 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mdbox-rotate-size | |
8311 | Maximum dbox file size until it's rotated. | |
8312 | Defaults to @samp{2000000}. | |
8313 | @end deftypevr | |
8314 | ||
8315 | @deftypevr {@code{dovecot-configuration} parameter} string mdbox-rotate-interval | |
8316 | Maximum dbox file age until it's rotated. Typically in days. Day | |
8317 | begins from midnight, so 1d = today, 2d = yesterday, etc. 0 = check | |
8318 | disabled. | |
8319 | Defaults to @samp{"1d"}. | |
8320 | @end deftypevr | |
8321 | ||
8322 | @deftypevr {@code{dovecot-configuration} parameter} boolean mdbox-preallocate-space? | |
8323 | When creating new mdbox files, immediately preallocate their size to | |
8324 | @samp{mdbox-rotate-size}. This setting currently works only in Linux | |
8325 | with some filesystems (ext4, xfs). | |
8326 | Defaults to @samp{#f}. | |
8327 | @end deftypevr | |
8328 | ||
8329 | @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-dir | |
8330 | sdbox and mdbox support saving mail attachments to external files, | |
8331 | which also allows single instance storage for them. Other backends | |
8332 | don't support this for now. | |
8333 | ||
8334 | WARNING: This feature hasn't been tested much yet. Use at your own risk. | |
8335 | ||
8336 | Directory root where to store mail attachments. Disabled, if empty. | |
8337 | Defaults to @samp{""}. | |
8338 | @end deftypevr | |
8339 | ||
8340 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer mail-attachment-min-size | |
8341 | Attachments smaller than this aren't saved externally. It's also | |
8342 | possible to write a plugin to disable saving specific attachments | |
8343 | externally. | |
8344 | Defaults to @samp{128000}. | |
8345 | @end deftypevr | |
8346 | ||
8347 | @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-fs | |
8348 | Filesystem backend to use for saving attachments: | |
8349 | @table @code | |
8350 | @item posix | |
8351 | No SiS done by Dovecot (but this might help FS's own deduplication) | |
8352 | @item sis posix | |
8353 | SiS with immediate byte-by-byte comparison during saving | |
8354 | @item sis-queue posix | |
8355 | SiS with delayed comparison and deduplication. | |
8356 | @end table | |
8357 | Defaults to @samp{"sis posix"}. | |
8358 | @end deftypevr | |
8359 | ||
8360 | @deftypevr {@code{dovecot-configuration} parameter} string mail-attachment-hash | |
8361 | Hash format to use in attachment filenames. You can add any text and | |
8362 | variables: @code{%@{md4@}}, @code{%@{md5@}}, @code{%@{sha1@}}, | |
8363 | @code{%@{sha256@}}, @code{%@{sha512@}}, @code{%@{size@}}. Variables can be | |
8364 | truncated, e.g. @code{%@{sha256:80@}} returns only first 80 bits. | |
8365 | Defaults to @samp{"%@{sha1@}"}. | |
8366 | @end deftypevr | |
8367 | ||
8368 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-process-limit | |
8369 | ||
8370 | Defaults to @samp{100}. | |
8371 | @end deftypevr | |
8372 | ||
8373 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-client-limit | |
8374 | ||
8375 | Defaults to @samp{1000}. | |
8376 | @end deftypevr | |
8377 | ||
8378 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer default-vsz-limit | |
8379 | Default VSZ (virtual memory size) limit for service processes. | |
8380 | This is mainly intended to catch and kill processes that leak memory | |
8381 | before they eat up everything. | |
8382 | Defaults to @samp{256000000}. | |
8383 | @end deftypevr | |
8384 | ||
8385 | @deftypevr {@code{dovecot-configuration} parameter} string default-login-user | |
8386 | Login user is internally used by login processes. This is the most | |
8387 | untrusted user in Dovecot system. It shouldn't have access to anything | |
8388 | at all. | |
8389 | Defaults to @samp{"dovenull"}. | |
8390 | @end deftypevr | |
8391 | ||
8392 | @deftypevr {@code{dovecot-configuration} parameter} string default-internal-user | |
8393 | Internal user is used by unprivileged processes. It should be | |
8394 | separate from login user, so that login processes can't disturb other | |
8395 | processes. | |
8396 | Defaults to @samp{"dovecot"}. | |
8397 | @end deftypevr | |
8398 | ||
8399 | @deftypevr {@code{dovecot-configuration} parameter} string ssl? | |
8400 | SSL/TLS support: yes, no, required. <doc/wiki/SSL.txt>. | |
8401 | Defaults to @samp{"required"}. | |
8402 | @end deftypevr | |
8403 | ||
8404 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-cert | |
8405 | PEM encoded X.509 SSL/TLS certificate (public key). | |
8406 | Defaults to @samp{"</etc/dovecot/default.pem"}. | |
8407 | @end deftypevr | |
8408 | ||
8409 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-key | |
8410 | PEM encoded SSL/TLS private key. The key is opened before | |
8411 | dropping root privileges, so keep the key file unreadable by anyone but | |
8412 | root. | |
8413 | Defaults to @samp{"</etc/dovecot/private/default.pem"}. | |
8414 | @end deftypevr | |
8415 | ||
8416 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-key-password | |
8417 | If key file is password protected, give the password here. | |
8418 | Alternatively give it when starting dovecot with -p parameter. Since | |
8419 | this file is often world-readable, you may want to place this setting | |
8420 | instead to a different. | |
8421 | Defaults to @samp{""}. | |
8422 | @end deftypevr | |
8423 | ||
8424 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-ca | |
8425 | PEM encoded trusted certificate authority. Set this only if you | |
8426 | intend to use @samp{ssl-verify-client-cert? #t}. The file should | |
8427 | contain the CA certificate(s) followed by the matching | |
8428 | CRL(s). (e.g. @samp{ssl-ca </etc/ssl/certs/ca.pem}). | |
8429 | Defaults to @samp{""}. | |
8430 | @end deftypevr | |
8431 | ||
8432 | @deftypevr {@code{dovecot-configuration} parameter} boolean ssl-require-crl? | |
8433 | Require that CRL check succeeds for client certificates. | |
8434 | Defaults to @samp{#t}. | |
8435 | @end deftypevr | |
8436 | ||
8437 | @deftypevr {@code{dovecot-configuration} parameter} boolean ssl-verify-client-cert? | |
8438 | Request client to send a certificate. If you also want to require | |
8439 | it, set @samp{auth-ssl-require-client-cert? #t} in auth section. | |
8440 | Defaults to @samp{#f}. | |
8441 | @end deftypevr | |
8442 | ||
8443 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-cert-username-field | |
8444 | Which field from certificate to use for username. commonName and | |
8445 | x500UniqueIdentifier are the usual choices. You'll also need to set | |
8446 | @samp{auth-ssl-username-from-cert? #t}. | |
8447 | Defaults to @samp{"commonName"}. | |
8448 | @end deftypevr | |
8449 | ||
8450 | @deftypevr {@code{dovecot-configuration} parameter} hours ssl-parameters-regenerate | |
8451 | How often to regenerate the SSL parameters file. Generation is | |
8452 | quite CPU intensive operation. The value is in hours, 0 disables | |
8453 | regeneration entirely. | |
8454 | Defaults to @samp{168}. | |
8455 | @end deftypevr | |
8456 | ||
8457 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-protocols | |
8458 | SSL protocols to use. | |
8459 | Defaults to @samp{"!SSLv2"}. | |
8460 | @end deftypevr | |
8461 | ||
8462 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-cipher-list | |
8463 | SSL ciphers to use. | |
8464 | Defaults to @samp{"ALL:!LOW:!SSLv2:!EXP:!aNULL"}. | |
8465 | @end deftypevr | |
8466 | ||
8467 | @deftypevr {@code{dovecot-configuration} parameter} string ssl-crypto-device | |
8468 | SSL crypto device to use, for valid values run "openssl engine". | |
8469 | Defaults to @samp{""}. | |
8470 | @end deftypevr | |
8471 | ||
8472 | @deftypevr {@code{dovecot-configuration} parameter} string postmaster-address | |
8473 | Address to use when sending rejection mails. | |
8474 | Default is postmaster@@<your domain>. %d expands to recipient domain. | |
8475 | Defaults to @samp{""}. | |
8476 | @end deftypevr | |
8477 | ||
8478 | @deftypevr {@code{dovecot-configuration} parameter} string hostname | |
8479 | Hostname to use in various parts of sent mails (e.g. in Message-Id) | |
8480 | and in LMTP replies. Default is the system's real hostname@@domain. | |
8481 | Defaults to @samp{""}. | |
8482 | @end deftypevr | |
8483 | ||
8484 | @deftypevr {@code{dovecot-configuration} parameter} boolean quota-full-tempfail? | |
8485 | If user is over quota, return with temporary failure instead of | |
8486 | bouncing the mail. | |
8487 | Defaults to @samp{#f}. | |
8488 | @end deftypevr | |
8489 | ||
8490 | @deftypevr {@code{dovecot-configuration} parameter} file-name sendmail-path | |
8491 | Binary to use for sending mails. | |
8492 | Defaults to @samp{"/usr/sbin/sendmail"}. | |
8493 | @end deftypevr | |
8494 | ||
8495 | @deftypevr {@code{dovecot-configuration} parameter} string submission-host | |
8496 | If non-empty, send mails via this SMTP host[:port] instead of | |
8497 | sendmail. | |
8498 | Defaults to @samp{""}. | |
8499 | @end deftypevr | |
8500 | ||
8501 | @deftypevr {@code{dovecot-configuration} parameter} string rejection-subject | |
8502 | Subject: header to use for rejection mails. You can use the same | |
8503 | variables as for @samp{rejection-reason} below. | |
8504 | Defaults to @samp{"Rejected: %s"}. | |
8505 | @end deftypevr | |
8506 | ||
8507 | @deftypevr {@code{dovecot-configuration} parameter} string rejection-reason | |
8508 | Human readable error message for rejection mails. You can use | |
8509 | variables: | |
8510 | ||
8511 | @table @code | |
8512 | @item %n | |
8513 | CRLF | |
8514 | @item %r | |
8515 | reason | |
8516 | @item %s | |
8517 | original subject | |
8518 | @item %t | |
8519 | recipient | |
8520 | @end table | |
8521 | Defaults to @samp{"Your message to <%t> was automatically rejected:%n%r"}. | |
8522 | @end deftypevr | |
8523 | ||
8524 | @deftypevr {@code{dovecot-configuration} parameter} string recipient-delimiter | |
8525 | Delimiter character between local-part and detail in email | |
8526 | address. | |
8527 | Defaults to @samp{"+"}. | |
8528 | @end deftypevr | |
8529 | ||
8530 | @deftypevr {@code{dovecot-configuration} parameter} string lda-original-recipient-header | |
8531 | Header where the original recipient address (SMTP's RCPT TO: | |
8532 | address) is taken from if not available elsewhere. With dovecot-lda -a | |
8533 | parameter overrides this. A commonly used header for this is | |
8534 | X-Original-To. | |
8535 | Defaults to @samp{""}. | |
8536 | @end deftypevr | |
8537 | ||
8538 | @deftypevr {@code{dovecot-configuration} parameter} boolean lda-mailbox-autocreate? | |
8539 | Should saving a mail to a nonexistent mailbox automatically create | |
8540 | it?. | |
8541 | Defaults to @samp{#f}. | |
8542 | @end deftypevr | |
8543 | ||
8544 | @deftypevr {@code{dovecot-configuration} parameter} boolean lda-mailbox-autosubscribe? | |
8545 | Should automatically created mailboxes be also automatically | |
8546 | subscribed?. | |
8547 | Defaults to @samp{#f}. | |
8548 | @end deftypevr | |
8549 | ||
8550 | @deftypevr {@code{dovecot-configuration} parameter} non-negative-integer imap-max-line-length | |
8551 | Maximum IMAP command line length. Some clients generate very long | |
8552 | command lines with huge mailboxes, so you may need to raise this if you | |
8553 | get "Too long argument" or "IMAP command line too large" errors | |
8554 | often. | |
8555 | Defaults to @samp{64000}. | |
8556 | @end deftypevr | |
8557 | ||
8558 | @deftypevr {@code{dovecot-configuration} parameter} string imap-logout-format | |
8559 | IMAP logout format string: | |
8560 | @table @code | |
8561 | @item %i | |
8562 | total number of bytes read from client | |
8563 | @item %o | |
8564 | total number of bytes sent to client. | |
8565 | @end table | |
8566 | Defaults to @samp{"in=%i out=%o"}. | |
8567 | @end deftypevr | |
8568 | ||
8569 | @deftypevr {@code{dovecot-configuration} parameter} string imap-capability | |
8570 | Override the IMAP CAPABILITY response. If the value begins with '+', | |
8571 | add the given capabilities on top of the defaults (e.g. +XFOO XBAR). | |
8572 | Defaults to @samp{""}. | |
8573 | @end deftypevr | |
8574 | ||
8575 | @deftypevr {@code{dovecot-configuration} parameter} string imap-idle-notify-interval | |
8576 | How long to wait between "OK Still here" notifications when client | |
8577 | is IDLEing. | |
8578 | Defaults to @samp{"2 mins"}. | |
8579 | @end deftypevr | |
8580 | ||
8581 | @deftypevr {@code{dovecot-configuration} parameter} string imap-id-send | |
8582 | ID field names and values to send to clients. Using * as the value | |
8583 | makes Dovecot use the default value. The following fields have default | |
8584 | values currently: name, version, os, os-version, support-url, | |
8585 | support-email. | |
8586 | Defaults to @samp{""}. | |
8587 | @end deftypevr | |
8588 | ||
8589 | @deftypevr {@code{dovecot-configuration} parameter} string imap-id-log | |
8590 | ID fields sent by client to log. * means everything. | |
8591 | Defaults to @samp{""}. | |
8592 | @end deftypevr | |
8593 | ||
8594 | @deftypevr {@code{dovecot-configuration} parameter} space-separated-string-list imap-client-workarounds | |
8595 | Workarounds for various client bugs: | |
8596 | ||
8597 | @table @code | |
8598 | @item delay-newmail | |
8599 | Send EXISTS/RECENT new mail notifications only when replying to NOOP and | |
8600 | CHECK commands. Some clients ignore them otherwise, for example OSX | |
8601 | Mail (<v2.1). Outlook Express breaks more badly though, without this it | |
8602 | may show user "Message no longer in server" errors. Note that OE6 | |
8603 | still breaks even with this workaround if synchronization is set to | |
8604 | "Headers Only". | |
8605 | ||
8606 | @item tb-extra-mailbox-sep | |
8607 | Thunderbird gets somehow confused with LAYOUT=fs (mbox and dbox) and | |
8608 | adds extra @samp{/} suffixes to mailbox names. This option causes Dovecot to | |
8609 | ignore the extra @samp{/} instead of treating it as invalid mailbox name. | |
8610 | ||
8611 | @item tb-lsub-flags | |
8612 | Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox). | |
8613 | This makes Thunderbird realize they aren't selectable and show them | |
8614 | greyed out, instead of only later giving "not selectable" popup error. | |
8615 | @end table | |
8616 | Defaults to @samp{()}. | |
8617 | @end deftypevr | |
8618 | ||
8619 | @deftypevr {@code{dovecot-configuration} parameter} string imap-urlauth-host | |
8620 | Host allowed in URLAUTH URLs sent by client. "*" allows all. | |
8621 | Defaults to @samp{""}. | |
8622 | @end deftypevr | |
8623 | ||
8624 | ||
8625 | Whew! Lots of configuration options. The nice thing about it though is | |
8626 | that GuixSD has a complete interface to Dovecot's configuration | |
8627 | language. This allows not only a nice way to declare configurations, | |
8628 | but also offers reflective capabilities as well: users can write code to | |
8629 | inspect and transform configurations from within Scheme. | |
8630 | ||
8631 | However, it could be that you just want to get a @code{dovecot.conf} up | |
8632 | and running. In that case, you can pass an | |
8633 | @code{opaque-dovecot-configuration} as the @code{#:config} paramter to | |
8634 | @code{dovecot-service}. As its name indicates, an opaque configuration | |
8635 | does not have easy reflective capabilities. | |
8636 | ||
8637 | Available @code{opaque-dovecot-configuration} fields are: | |
8638 | ||
8639 | @deftypevr {@code{opaque-dovecot-configuration} parameter} package dovecot | |
8640 | The dovecot package. | |
8641 | @end deftypevr | |
8642 | ||
8643 | @deftypevr {@code{opaque-dovecot-configuration} parameter} string string | |
8644 | The contents of the @code{dovecot.conf}, as a string. | |
8645 | @end deftypevr | |
8646 | ||
8647 | For example, if your @code{dovecot.conf} is just the empty string, you | |
8648 | could instantiate a dovecot service like this: | |
8649 | ||
8650 | @example | |
8651 | (dovecot-service #:config | |
8652 | (opaque-dovecot-configuration | |
8653 | (string ""))) | |
8654 | @end example | |
8655 | ||
58724c48 DT |
8656 | @node Web Services |
8657 | @subsubsection Web Services | |
8658 | ||
8659 | The @code{(gnu services web)} module provides the following service: | |
8660 | ||
be1c2c54 | 8661 | @deffn {Scheme Procedure} nginx-service [#:nginx nginx] @ |
58724c48 DT |
8662 | [#:log-directory ``/var/log/nginx''] @ |
8663 | [#:run-directory ``/var/run/nginx''] @ | |
8664 | [#:config-file] | |
8665 | ||
8666 | Return a service that runs @var{nginx}, the nginx web server. | |
8667 | ||
8668 | The nginx daemon loads its runtime configuration from @var{config-file}. | |
8669 | Log files are written to @var{log-directory} and temporary runtime data | |
8670 | files are written to @var{run-directory}. For proper operation, these | |
8671 | arguments should match what is in @var{config-file} to ensure that the | |
8672 | directories are created when the service is activated. | |
8673 | ||
8674 | @end deffn | |
8675 | ||
fe1a39d3 LC |
8676 | @node Various Services |
8677 | @subsubsection Various Services | |
8678 | ||
8679 | The @code{(gnu services lirc)} module provides the following service. | |
8680 | ||
be1c2c54 | 8681 | @deffn {Scheme Procedure} lirc-service [#:lirc lirc] @ |
fe1a39d3 LC |
8682 | [#:device #f] [#:driver #f] [#:config-file #f] @ |
8683 | [#:extra-options '()] | |
8684 | Return a service that runs @url{http://www.lirc.org,LIRC}, a daemon that | |
8685 | decodes infrared signals from remote controls. | |
8686 | ||
8687 | Optionally, @var{device}, @var{driver} and @var{config-file} | |
8688 | (configuration file name) may be specified. See @command{lircd} manual | |
8689 | for details. | |
8690 | ||
8691 | Finally, @var{extra-options} is a list of additional command-line options | |
8692 | passed to @command{lircd}. | |
8693 | @end deffn | |
8694 | ||
8695 | ||
0ae8c15a LC |
8696 | @node Setuid Programs |
8697 | @subsection Setuid Programs | |
8698 | ||
8699 | @cindex setuid programs | |
8700 | Some programs need to run with ``root'' privileges, even when they are | |
8701 | launched by unprivileged users. A notorious example is the | |
4d40227c LC |
8702 | @command{passwd} program, which users can run to change their |
8703 | password, and which needs to access the @file{/etc/passwd} and | |
0ae8c15a LC |
8704 | @file{/etc/shadow} files---something normally restricted to root, for |
8705 | obvious security reasons. To address that, these executables are | |
8706 | @dfn{setuid-root}, meaning that they always run with root privileges | |
8707 | (@pxref{How Change Persona,,, libc, The GNU C Library Reference Manual}, | |
f7e4ae7f | 8708 | for more info about the setuid mechanism.) |
0ae8c15a LC |
8709 | |
8710 | The store itself @emph{cannot} contain setuid programs: that would be a | |
8711 | security issue since any user on the system can write derivations that | |
8712 | populate the store (@pxref{The Store}). Thus, a different mechanism is | |
8713 | used: instead of changing the setuid bit directly on files that are in | |
8714 | the store, we let the system administrator @emph{declare} which programs | |
8715 | should be setuid root. | |
8716 | ||
8717 | The @code{setuid-programs} field of an @code{operating-system} | |
8718 | declaration contains a list of G-expressions denoting the names of | |
8719 | programs to be setuid-root (@pxref{Using the Configuration System}). | |
8720 | For instance, the @command{passwd} program, which is part of the Shadow | |
8721 | package, can be designated by this G-expression (@pxref{G-Expressions}): | |
8722 | ||
8723 | @example | |
8724 | #~(string-append #$shadow "/bin/passwd") | |
8725 | @end example | |
8726 | ||
8727 | A default set of setuid programs is defined by the | |
8728 | @code{%setuid-programs} variable of the @code{(gnu system)} module. | |
8729 | ||
8730 | @defvr {Scheme Variable} %setuid-programs | |
8731 | A list of G-expressions denoting common programs that are setuid-root. | |
8732 | ||
8733 | The list includes commands such as @command{passwd}, @command{ping}, | |
8734 | @command{su}, and @command{sudo}. | |
8735 | @end defvr | |
8736 | ||
8737 | Under the hood, the actual setuid programs are created in the | |
8738 | @file{/run/setuid-programs} directory at system activation time. The | |
8739 | files in this directory refer to the ``real'' binaries, which are in the | |
8740 | store. | |
8741 | ||
efb5e833 LC |
8742 | @node X.509 Certificates |
8743 | @subsection X.509 Certificates | |
8744 | ||
8745 | @cindex HTTPS, certificates | |
8746 | @cindex X.509 certificates | |
8747 | @cindex TLS | |
8748 | Web servers available over HTTPS (that is, HTTP over the transport-layer | |
8749 | security mechanism, TLS) send client programs an @dfn{X.509 certificate} | |
8750 | that the client can then use to @emph{authenticate} the server. To do | |
8751 | that, clients verify that the server's certificate is signed by a | |
8752 | so-called @dfn{certificate authority} (CA). But to verify the CA's | |
8753 | signature, clients must have first acquired the CA's certificate. | |
8754 | ||
8755 | Web browsers such as GNU@tie{}IceCat include their own set of CA | |
8756 | certificates, such that they are able to verify CA signatures | |
8757 | out-of-the-box. | |
8758 | ||
8759 | However, most other programs that can talk HTTPS---@command{wget}, | |
8760 | @command{git}, @command{w3m}, etc.---need to be told where CA | |
8761 | certificates can be found. | |
8762 | ||
8763 | @cindex @code{nss-certs} | |
8764 | In GuixSD, this is done by adding a package that provides certificates | |
8765 | to the @code{packages} field of the @code{operating-system} declaration | |
8766 | (@pxref{operating-system Reference}). GuixSD includes one such package, | |
8767 | @code{nss-certs}, which is a set of CA certificates provided as part of | |
8768 | Mozilla's Network Security Services. | |
8769 | ||
8770 | Note that it is @emph{not} part of @var{%base-packages}, so you need to | |
8771 | explicitly add it. The @file{/etc/ssl/certs} directory, which is where | |
8772 | most applications and libraries look for certificates by default, points | |
8773 | to the certificates installed globally. | |
8774 | ||
8775 | Unprivileged users can also install their own certificate package in | |
8776 | their profile. A number of environment variables need to be defined so | |
8777 | that applications and libraries know where to find them. Namely, the | |
8778 | OpenSSL library honors the @code{SSL_CERT_DIR} and @code{SSL_CERT_FILE} | |
8779 | variables. Some applications add their own environment variables; for | |
8780 | instance, the Git version control system honors the certificate bundle | |
8781 | pointed to by the @code{GIT_SSL_CAINFO} environment variable. | |
8782 | ||
8783 | ||
996ed739 LC |
8784 | @node Name Service Switch |
8785 | @subsection Name Service Switch | |
8786 | ||
8787 | @cindex name service switch | |
8788 | @cindex NSS | |
8789 | The @code{(gnu system nss)} module provides bindings to the | |
8790 | configuration file of libc's @dfn{name service switch} or @dfn{NSS} | |
8791 | (@pxref{NSS Configuration File,,, libc, The GNU C Library Reference | |
8792 | Manual}). In a nutshell, the NSS is a mechanism that allows libc to be | |
8793 | extended with new ``name'' lookup methods for system databases, which | |
8794 | includes host names, service names, user accounts, and more (@pxref{Name | |
8795 | Service Switch, System Databases and Name Service Switch,, libc, The GNU | |
8796 | C Library Reference Manual}). | |
8797 | ||
8798 | The NSS configuration specifies, for each system database, which lookup | |
8799 | method is to be used, and how the various methods are chained | |
8800 | together---for instance, under which circumstances NSS should try the | |
8801 | next method in the list. The NSS configuration is given in the | |
8802 | @code{name-service-switch} field of @code{operating-system} declarations | |
8803 | (@pxref{operating-system Reference, @code{name-service-switch}}). | |
8804 | ||
4c9050c6 LC |
8805 | @cindex nss-mdns |
8806 | @cindex .local, host name lookup | |
996ed739 | 8807 | As an example, the declaration below configures the NSS to use the |
4c9050c6 LC |
8808 | @uref{http://0pointer.de/lennart/projects/nss-mdns/, @code{nss-mdns} |
8809 | back-end}, which supports host name lookups over multicast DNS (mDNS) | |
8810 | for host names ending in @code{.local}: | |
996ed739 LC |
8811 | |
8812 | @example | |
8813 | (name-service-switch | |
8814 | (hosts (list %files ;first, check /etc/hosts | |
8815 | ||
8816 | ;; If the above did not succeed, try | |
8817 | ;; with 'mdns_minimal'. | |
8818 | (name-service | |
8819 | (name "mdns_minimal") | |
8820 | ||
8821 | ;; 'mdns_minimal' is authoritative for | |
8822 | ;; '.local'. When it returns "not found", | |
8823 | ;; no need to try the next methods. | |
8824 | (reaction (lookup-specification | |
8825 | (not-found => return)))) | |
8826 | ||
8827 | ;; Then fall back to DNS. | |
8828 | (name-service | |
8829 | (name "dns")) | |
8830 | ||
8831 | ;; Finally, try with the "full" 'mdns'. | |
8832 | (name-service | |
8833 | (name "mdns"))))) | |
8834 | @end example | |
8835 | ||
15137a29 LC |
8836 | Don't worry: the @code{%mdns-host-lookup-nss} variable (see below) |
8837 | contains this configuration, so you won't have to type it if all you | |
8838 | want is to have @code{.local} host lookup working. | |
8839 | ||
4c9050c6 LC |
8840 | Note that, in this case, in addition to setting the |
8841 | @code{name-service-switch} of the @code{operating-system} declaration, | |
cc9c1f39 LC |
8842 | you also need to use @code{avahi-service} (@pxref{Networking Services, |
8843 | @code{avahi-service}}), or @var{%desktop-services}, which includes it | |
8844 | (@pxref{Desktop Services}). Doing this makes @code{nss-mdns} accessible | |
8845 | to the name service cache daemon (@pxref{Base Services, | |
8846 | @code{nscd-service}}). | |
15137a29 LC |
8847 | |
8848 | For convenience, the following variables provide typical NSS | |
8849 | configurations. | |
8850 | ||
8851 | @defvr {Scheme Variable} %default-nss | |
8852 | This is the default name service switch configuration, a | |
8853 | @code{name-service-switch} object. | |
8854 | @end defvr | |
8855 | ||
8856 | @defvr {Scheme Variable} %mdns-host-lookup-nss | |
8857 | This is the name service switch configuration with support for host name | |
8858 | lookup over multicast DNS (mDNS) for host names ending in @code{.local}. | |
8859 | @end defvr | |
4c9050c6 | 8860 | |
996ed739 LC |
8861 | The reference for name service switch configuration is given below. It |
8862 | is a direct mapping of the C library's configuration file format, so | |
8863 | please refer to the C library manual for more information (@pxref{NSS | |
8864 | Configuration File,,, libc, The GNU C Library Reference Manual}). | |
8865 | Compared to libc's NSS configuration file format, it has the advantage | |
8866 | not only of adding this warm parenthetic feel that we like, but also | |
8867 | static checks: you'll know about syntax errors and typos as soon as you | |
8868 | run @command{guix system}. | |
8869 | ||
996ed739 LC |
8870 | @deftp {Data Type} name-service-switch |
8871 | ||
8872 | This is the data type representation the configuration of libc's name | |
8873 | service switch (NSS). Each field below represents one of the supported | |
8874 | system databases. | |
8875 | ||
8876 | @table @code | |
8877 | @item aliases | |
8878 | @itemx ethers | |
8879 | @itemx group | |
8880 | @itemx gshadow | |
8881 | @itemx hosts | |
8882 | @itemx initgroups | |
8883 | @itemx netgroup | |
8884 | @itemx networks | |
8885 | @itemx password | |
8886 | @itemx public-key | |
8887 | @itemx rpc | |
8888 | @itemx services | |
8889 | @itemx shadow | |
8890 | The system databases handled by the NSS. Each of these fields must be a | |
8891 | list of @code{<name-service>} objects (see below.) | |
8892 | @end table | |
8893 | @end deftp | |
8894 | ||
8895 | @deftp {Data Type} name-service | |
8896 | ||
8897 | This is the data type representing an actual name service and the | |
8898 | associated lookup action. | |
8899 | ||
8900 | @table @code | |
8901 | @item name | |
8902 | A string denoting the name service (@pxref{Services in the NSS | |
8903 | configuration,,, libc, The GNU C Library Reference Manual}). | |
8904 | ||
4aee6e60 LC |
8905 | Note that name services listed here must be visible to nscd. This is |
8906 | achieved by passing the @code{#:name-services} argument to | |
8907 | @code{nscd-service} the list of packages providing the needed name | |
8908 | services (@pxref{Base Services, @code{nscd-service}}). | |
8909 | ||
996ed739 LC |
8910 | @item reaction |
8911 | An action specified using the @code{lookup-specification} macro | |
8912 | (@pxref{Actions in the NSS configuration,,, libc, The GNU C Library | |
8913 | Reference Manual}). For example: | |
8914 | ||
8915 | @example | |
8916 | (lookup-specification (unavailable => continue) | |
8917 | (success => return)) | |
8918 | @end example | |
8919 | @end table | |
8920 | @end deftp | |
0ae8c15a | 8921 | |
fd1b1fa2 LC |
8922 | @node Initial RAM Disk |
8923 | @subsection Initial RAM Disk | |
8924 | ||
8925 | @cindex initial RAM disk (initrd) | |
8926 | @cindex initrd (initial RAM disk) | |
8927 | For bootstrapping purposes, the Linux-Libre kernel is passed an | |
8928 | @dfn{initial RAM disk}, or @dfn{initrd}. An initrd contains a temporary | |
8929 | root file system, as well as an initialization script. The latter is | |
8930 | responsible for mounting the real root file system, and for loading any | |
8931 | kernel modules that may be needed to achieve that. | |
8932 | ||
8933 | The @code{initrd} field of an @code{operating-system} declaration allows | |
8934 | you to specify which initrd you would like to use. The @code{(gnu | |
8935 | system linux-initrd)} module provides two ways to build an initrd: the | |
8936 | high-level @code{base-initrd} procedure, and the low-level | |
8937 | @code{expression->initrd} procedure. | |
8938 | ||
8939 | The @code{base-initrd} procedure is intended to cover most common uses. | |
8940 | For example, if you want to add a bunch of kernel modules to be loaded | |
8941 | at boot time, you can define the @code{initrd} field of the operating | |
8942 | system declaration like this: | |
8943 | ||
8944 | @example | |
52ac153e | 8945 | (initrd (lambda (file-systems . rest) |
027981d6 LC |
8946 | ;; Create a standard initrd that has modules "foo.ko" |
8947 | ;; and "bar.ko", as well as their dependencies, in | |
8948 | ;; addition to the modules available by default. | |
52ac153e | 8949 | (apply base-initrd file-systems |
027981d6 | 8950 | #:extra-modules '("foo" "bar") |
52ac153e | 8951 | rest))) |
fd1b1fa2 LC |
8952 | @end example |
8953 | ||
52ac153e LC |
8954 | The @code{base-initrd} procedure also handles common use cases that |
8955 | involves using the system as a QEMU guest, or as a ``live'' system whose | |
8956 | root file system is volatile. | |
fd1b1fa2 | 8957 | |
e90cf6c1 LC |
8958 | The initial RAM disk produced by @code{base-initrd} honors several |
8959 | options passed on the Linux kernel command line (that is, arguments | |
8960 | passed @i{via} GRUB's @code{linux} command, or with QEMU's | |
8961 | @code{-append} option), notably: | |
8962 | ||
8963 | @table @code | |
8964 | @item --load=@var{boot} | |
8965 | Tell the initial RAM disk to load @var{boot}, a file containing a Scheme | |
8966 | program, once it has mounted the root file system. | |
8967 | ||
8968 | GuixSD uses this option to yield control to a boot program that runs the | |
dd17bc38 | 8969 | service activation programs and then spawns the GNU@tie{}Shepherd, the |
e90cf6c1 LC |
8970 | initialization system. |
8971 | ||
8972 | @item --root=@var{root} | |
8973 | Mount @var{root} as the root file system. @var{root} can be a device | |
8974 | device name like @code{/dev/sda1}, a partition label, or a partition | |
8975 | UUID. | |
8976 | ||
8977 | @item --system=@var{system} | |
8978 | Have @file{/run/booted-system} and @file{/run/current-system} point to | |
8979 | @var{system}. | |
8980 | ||
8981 | @item modprobe.blacklist=@var{modules}@dots{} | |
8982 | @cindex module, black-listing | |
8983 | @cindex black list, of kernel modules | |
8984 | Instruct the initial RAM disk as well as the @command{modprobe} command | |
8985 | (from the kmod package) to refuse to load @var{modules}. @var{modules} | |
8986 | must be a comma-separated list of module names---e.g., | |
8987 | @code{usbkbd,9pnet}. | |
8988 | ||
8989 | @item --repl | |
8990 | Start a read-eval-print loop (REPL) from the initial RAM disk before it | |
8991 | tries to load kernel modules and to mount the root file system. Our | |
8992 | marketing team calls it @dfn{boot-to-Guile}. The Schemer in you will | |
8993 | love it. @xref{Using Guile Interactively,,, guile, GNU Guile Reference | |
8994 | Manual}, for more information on Guile's REPL. | |
8995 | ||
8996 | @end table | |
8997 | ||
8998 | Now that you know all the features that initial RAM disks produced by | |
8999 | @code{base-initrd} provide, here is how to use it and customize it | |
9000 | further. | |
9001 | ||
fd1b1fa2 | 9002 | @deffn {Monadic Procedure} base-initrd @var{file-systems} @ |
9059b97d | 9003 | [#:qemu-networking? #f] [#:virtio? #t] [#:volatile-root? #f] @ |
52ac153e | 9004 | [#:extra-modules '()] [#:mapped-devices '()] |
fd1b1fa2 LC |
9005 | Return a monadic derivation that builds a generic initrd. @var{file-systems} is |
9006 | a list of file-systems to be mounted by the initrd, possibly in addition to | |
9007 | the root file system specified on the kernel command line via @code{--root}. | |
52ac153e LC |
9008 | @var{mapped-devices} is a list of device mappings to realize before |
9009 | @var{file-systems} are mounted (@pxref{Mapped Devices}). | |
fd1b1fa2 LC |
9010 | |
9011 | When @var{qemu-networking?} is true, set up networking with the standard QEMU | |
9012 | parameters. When @var{virtio?} is true, load additional modules so the initrd can | |
9013 | be used as a QEMU guest with para-virtualized I/O drivers. | |
9014 | ||
9015 | When @var{volatile-root?} is true, the root file system is writable but any changes | |
9016 | to it are lost. | |
9017 | ||
9018 | The initrd is automatically populated with all the kernel modules necessary | |
9019 | for @var{file-systems} and for the given options. However, additional kernel | |
9020 | modules can be listed in @var{extra-modules}. They will be added to the initrd, and | |
9021 | loaded at boot time in the order in which they appear. | |
9022 | @end deffn | |
9023 | ||
9024 | Needless to say, the initrds we produce and use embed a | |
9025 | statically-linked Guile, and the initialization program is a Guile | |
9026 | program. That gives a lot of flexibility. The | |
9027 | @code{expression->initrd} procedure builds such an initrd, given the | |
9028 | program to run in that initrd. | |
9029 | ||
9030 | @deffn {Monadic Procedure} expression->initrd @var{exp} @ | |
9031 | [#:guile %guile-static-stripped] [#:name "guile-initrd"] @ | |
42d10464 | 9032 | [#:modules '()] |
fd1b1fa2 LC |
9033 | Return a derivation that builds a Linux initrd (a gzipped cpio archive) |
9034 | containing @var{guile} and that evaluates @var{exp}, a G-expression, | |
df650fa8 LC |
9035 | upon booting. All the derivations referenced by @var{exp} are |
9036 | automatically copied to the initrd. | |
fd1b1fa2 | 9037 | |
42d10464 LC |
9038 | @var{modules} is a list of Guile module names to be embedded in the |
9039 | initrd. | |
fd1b1fa2 LC |
9040 | @end deffn |
9041 | ||
88faf933 LC |
9042 | @node GRUB Configuration |
9043 | @subsection GRUB Configuration | |
9044 | ||
9045 | @cindex GRUB | |
9046 | @cindex boot loader | |
9047 | ||
9048 | The operating system uses GNU@tie{}GRUB as its boot loader | |
9049 | (@pxref{Overview, overview of GRUB,, grub, GNU GRUB Manual}). It is | |
9050 | configured using @code{grub-configuration} declarations. This data type | |
9051 | is exported by the @code{(gnu system grub)} module, and described below. | |
9052 | ||
9053 | @deftp {Data Type} grub-configuration | |
9054 | The type of a GRUB configuration declaration. | |
9055 | ||
9056 | @table @asis | |
9057 | ||
9058 | @item @code{device} | |
9059 | This is a string denoting the boot device. It must be a device name | |
9060 | understood by the @command{grub-install} command, such as | |
9061 | @code{/dev/sda} or @code{(hd0)} (@pxref{Invoking grub-install,,, grub, | |
9062 | GNU GRUB Manual}). | |
9063 | ||
9064 | @item @code{menu-entries} (default: @code{()}) | |
9065 | A possibly empty list of @code{menu-entry} objects (see below), denoting | |
9066 | entries to appear in the GRUB boot menu, in addition to the current | |
9067 | system entry and the entry pointing to previous system generations. | |
9068 | ||
9069 | @item @code{default-entry} (default: @code{0}) | |
9070 | The index of the default boot menu entry. Index 0 is for the current | |
9071 | system's entry. | |
9072 | ||
9073 | @item @code{timeout} (default: @code{5}) | |
9074 | The number of seconds to wait for keyboard input before booting. Set to | |
9075 | 0 to boot immediately, and to -1 to wait indefinitely. | |
9076 | ||
9077 | @item @code{theme} (default: @var{%default-theme}) | |
9078 | The @code{grub-theme} object describing the theme to use. | |
9079 | @end table | |
9080 | ||
9081 | @end deftp | |
9082 | ||
9083 | Should you want to list additional boot menu entries @i{via} the | |
9084 | @code{menu-entries} field above, you will need to create them with the | |
9085 | @code{menu-entry} form: | |
9086 | ||
9087 | @deftp {Data Type} menu-entry | |
9088 | The type of an entry in the GRUB boot menu. | |
9089 | ||
9090 | @table @asis | |
9091 | ||
9092 | @item @code{label} | |
35ed9306 | 9093 | The label to show in the menu---e.g., @code{"GNU"}. |
88faf933 LC |
9094 | |
9095 | @item @code{linux} | |
9096 | The Linux kernel to boot. | |
9097 | ||
9098 | @item @code{linux-arguments} (default: @code{()}) | |
9099 | The list of extra Linux kernel command-line arguments---e.g., | |
9100 | @code{("console=ttyS0")}. | |
9101 | ||
9102 | @item @code{initrd} | |
9103 | A G-Expression or string denoting the file name of the initial RAM disk | |
9104 | to use (@pxref{G-Expressions}). | |
9105 | ||
9106 | @end table | |
9107 | @end deftp | |
9108 | ||
9109 | @c FIXME: Write documentation once it's stable. | |
9110 | Themes are created using the @code{grub-theme} form, which is not | |
9111 | documented yet. | |
9112 | ||
9113 | @defvr {Scheme Variable} %default-theme | |
9114 | This is the default GRUB theme used by the operating system, with a | |
9115 | fancy background image displaying the GNU and Guix logos. | |
9116 | @end defvr | |
9117 | ||
9118 | ||
cf4a9129 LC |
9119 | @node Invoking guix system |
9120 | @subsection Invoking @code{guix system} | |
0918e64a | 9121 | |
cf4a9129 LC |
9122 | Once you have written an operating system declaration, as seen in the |
9123 | previous section, it can be @dfn{instantiated} using the @command{guix | |
9124 | system} command. The synopsis is: | |
4af2447e | 9125 | |
cf4a9129 LC |
9126 | @example |
9127 | guix system @var{options}@dots{} @var{action} @var{file} | |
9128 | @end example | |
4af2447e | 9129 | |
cf4a9129 LC |
9130 | @var{file} must be the name of a file containing an |
9131 | @code{operating-system} declaration. @var{action} specifies how the | |
9132 | operating system is instantiate. Currently the following values are | |
9133 | supported: | |
4af2447e | 9134 | |
cf4a9129 LC |
9135 | @table @code |
9136 | @item reconfigure | |
9137 | Build the operating system described in @var{file}, activate it, and | |
9138 | switch to it@footnote{This action is usable only on systems already | |
65797bff | 9139 | running GuixSD.}. |
4af2447e | 9140 | |
cf4a9129 LC |
9141 | This effects all the configuration specified in @var{file}: user |
9142 | accounts, system services, global package list, setuid programs, etc. | |
4af2447e | 9143 | |
cf4a9129 LC |
9144 | It also adds a GRUB menu entry for the new OS configuration, and moves |
9145 | entries for older configurations to a submenu---unless | |
9146 | @option{--no-grub} is passed. | |
4af2447e | 9147 | |
bf2479c7 LC |
9148 | @c The paragraph below refers to the problem discussed at |
9149 | @c <http://lists.gnu.org/archive/html/guix-devel/2014-08/msg00057.html>. | |
9150 | It is highly recommended to run @command{guix pull} once before you run | |
9151 | @command{guix system reconfigure} for the first time (@pxref{Invoking | |
9152 | guix pull}). Failing to do that you would see an older version of Guix | |
9153 | once @command{reconfigure} has completed. | |
9154 | ||
cf4a9129 LC |
9155 | @item build |
9156 | Build the operating system's derivation, which includes all the | |
9157 | configuration files and programs needed to boot and run the system. | |
9158 | This action does not actually install anything. | |
113daf62 | 9159 | |
cf4a9129 LC |
9160 | @item init |
9161 | Populate the given directory with all the files necessary to run the | |
9162 | operating system specified in @var{file}. This is useful for first-time | |
4705641f | 9163 | installations of GuixSD. For instance: |
113daf62 LC |
9164 | |
9165 | @example | |
cf4a9129 | 9166 | guix system init my-os-config.scm /mnt |
113daf62 LC |
9167 | @end example |
9168 | ||
cf4a9129 LC |
9169 | copies to @file{/mnt} all the store items required by the configuration |
9170 | specified in @file{my-os-config.scm}. This includes configuration | |
9171 | files, packages, and so on. It also creates other essential files | |
9172 | needed for the system to operate correctly---e.g., the @file{/etc}, | |
9173 | @file{/var}, and @file{/run} directories, and the @file{/bin/sh} file. | |
113daf62 | 9174 | |
cf4a9129 LC |
9175 | This command also installs GRUB on the device specified in |
9176 | @file{my-os-config}, unless the @option{--no-grub} option was passed. | |
113daf62 | 9177 | |
cf4a9129 LC |
9178 | @item vm |
9179 | @cindex virtual machine | |
0276f697 | 9180 | @cindex VM |
f535dcbe | 9181 | @anchor{guix system vm} |
cf4a9129 LC |
9182 | Build a virtual machine that contain the operating system declared in |
9183 | @var{file}, and return a script to run that virtual machine (VM). | |
810568b3 | 9184 | Arguments given to the script are passed as is to QEMU. |
113daf62 | 9185 | |
cf4a9129 | 9186 | The VM shares its store with the host system. |
113daf62 | 9187 | |
0276f697 LC |
9188 | Additional file systems can be shared between the host and the VM using |
9189 | the @code{--share} and @code{--expose} command-line options: the former | |
9190 | specifies a directory to be shared with write access, while the latter | |
9191 | provides read-only access to the shared directory. | |
9192 | ||
9193 | The example below creates a VM in which the user's home directory is | |
9194 | accessible read-only, and where the @file{/exchange} directory is a | |
9195 | read-write mapping of the host's @file{$HOME/tmp}: | |
9196 | ||
9197 | @example | |
9198 | guix system vm my-config.scm \ | |
9199 | --expose=$HOME --share=$HOME/tmp=/exchange | |
9200 | @end example | |
9201 | ||
6aa260af LC |
9202 | On GNU/Linux, the default is to boot directly to the kernel; this has |
9203 | the advantage of requiring only a very tiny root disk image since the | |
9204 | host's store can then be mounted. | |
9205 | ||
9206 | The @code{--full-boot} option forces a complete boot sequence, starting | |
9207 | with the bootloader. This requires more disk space since a root image | |
9208 | containing at least the kernel, initrd, and bootloader data files must | |
9209 | be created. The @code{--image-size} option can be used to specify the | |
9210 | image's size. | |
ab11f0be | 9211 | |
cf4a9129 LC |
9212 | @item vm-image |
9213 | @itemx disk-image | |
9214 | Return a virtual machine or disk image of the operating system declared | |
9215 | in @var{file} that stands alone. Use the @option{--image-size} option | |
9216 | to specify the size of the image. | |
113daf62 | 9217 | |
cf4a9129 | 9218 | When using @code{vm-image}, the returned image is in qcow2 format, which |
97d76250 LF |
9219 | the QEMU emulator can efficiently use. @xref{Running GuixSD in a VM}, |
9220 | for more information on how to run the image in a virtual machine. | |
113daf62 | 9221 | |
cf4a9129 LC |
9222 | When using @code{disk-image}, a raw disk image is produced; it can be |
9223 | copied as is to a USB stick, for instance. Assuming @code{/dev/sdc} is | |
9224 | the device corresponding to a USB stick, one can copy the image on it | |
9225 | using the following command: | |
113daf62 | 9226 | |
cf4a9129 LC |
9227 | @example |
9228 | # dd if=$(guix system disk-image my-os.scm) of=/dev/sdc | |
9229 | @end example | |
113daf62 | 9230 | |
1c8a81b1 DT |
9231 | @item container |
9232 | Return a script to run the operating system declared in @var{file} | |
9233 | within a container. Containers are a set of lightweight isolation | |
9234 | mechanisms provided by the kernel Linux-libre. Containers are | |
9235 | substantially less resource-demanding than full virtual machines since | |
9236 | the kernel, shared objects, and other resources can be shared with the | |
9237 | host system; this also means they provide thinner isolation. | |
9238 | ||
9239 | Currently, the script must be run as root in order to support more than | |
9240 | a single user and group. The container shares its store with the host | |
9241 | system. | |
9242 | ||
9243 | As with the @code{vm} action (@pxref{guix system vm}), additional file | |
9244 | systems to be shared between the host and container can be specified | |
9245 | using the @option{--share} and @option{--expose} options: | |
9246 | ||
9247 | @example | |
9248 | guix system container my-config.scm \ | |
9249 | --expose=$HOME --share=$HOME/tmp=/exchange | |
9250 | @end example | |
9251 | ||
0f252e26 | 9252 | @quotation Note |
cfd35b4e | 9253 | This option requires Linux-libre 3.19 or newer. |
0f252e26 DT |
9254 | @end quotation |
9255 | ||
cf4a9129 | 9256 | @end table |
113daf62 | 9257 | |
cf4a9129 LC |
9258 | @var{options} can contain any of the common build options provided by |
9259 | @command{guix build} (@pxref{Invoking guix build}). In addition, | |
9260 | @var{options} can contain one of the following: | |
113daf62 | 9261 | |
cf4a9129 LC |
9262 | @table @option |
9263 | @item --system=@var{system} | |
9264 | @itemx -s @var{system} | |
9265 | Attempt to build for @var{system} instead of the host's system type. | |
9266 | This works as per @command{guix build} (@pxref{Invoking guix build}). | |
113daf62 | 9267 | |
f3f427c2 LC |
9268 | @item --derivation |
9269 | @itemx -d | |
9270 | Return the derivation file name of the given operating system without | |
9271 | building anything. | |
9272 | ||
cf4a9129 LC |
9273 | @item --image-size=@var{size} |
9274 | For the @code{vm-image} and @code{disk-image} actions, create an image | |
9275 | of the given @var{size}. @var{size} may be a number of bytes, or it may | |
4a44d7bb LC |
9276 | include a unit as a suffix (@pxref{Block size, size specifications,, |
9277 | coreutils, GNU Coreutils}). | |
db030303 LC |
9278 | |
9279 | @item --on-error=@var{strategy} | |
9280 | Apply @var{strategy} when an error occurs when reading @var{file}. | |
9281 | @var{strategy} may be one of the following: | |
9282 | ||
9283 | @table @code | |
9284 | @item nothing-special | |
9285 | Report the error concisely and exit. This is the default strategy. | |
9286 | ||
9287 | @item backtrace | |
9288 | Likewise, but also display a backtrace. | |
9289 | ||
9290 | @item debug | |
9291 | Report the error and enter Guile's debugger. From there, you can run | |
9292 | commands such as @code{,bt} to get a backtrace, @code{,locals} to | |
9293 | display local variable values, and more generally inspect the program's | |
9294 | state. @xref{Debug Commands,,, guile, GNU Guile Reference Manual}, for | |
9295 | a list of available debugging commands. | |
9296 | @end table | |
113daf62 | 9297 | @end table |
113daf62 | 9298 | |
cf4a9129 LC |
9299 | Note that all the actions above, except @code{build} and @code{init}, |
9300 | rely on KVM support in the Linux-Libre kernel. Specifically, the | |
9301 | machine should have hardware virtualization support, the corresponding | |
9302 | KVM kernel module should be loaded, and the @file{/dev/kvm} device node | |
9303 | must exist and be readable and writable by the user and by the daemon's | |
9304 | build users. | |
8451a568 | 9305 | |
65797bff LC |
9306 | Once you have built, configured, re-configured, and re-re-configured |
9307 | your GuixSD installation, you may find it useful to list the operating | |
9308 | system generations available on disk---and that you can choose from the | |
9309 | GRUB boot menu: | |
9310 | ||
9311 | @table @code | |
9312 | ||
9313 | @item list-generations | |
9314 | List a summary of each generation of the operating system available on | |
9315 | disk, in a human-readable way. This is similar to the | |
9316 | @option{--list-generations} option of @command{guix package} | |
9317 | (@pxref{Invoking guix package}). | |
9318 | ||
9319 | Optionally, one can specify a pattern, with the same syntax that is used | |
9320 | in @command{guix package --list-generations}, to restrict the list of | |
9321 | generations displayed. For instance, the following command displays | |
9322 | generations up to 10-day old: | |
9323 | ||
9324 | @example | |
9325 | $ guix system list-generations 10d | |
9326 | @end example | |
9327 | ||
9328 | @end table | |
9329 | ||
d6c3267a LC |
9330 | The @command{guix system} command has even more to offer! The following |
9331 | sub-commands allow you to visualize how your system services relate to | |
9332 | each other: | |
9333 | ||
9334 | @anchor{system-extension-graph} | |
9335 | @table @code | |
9336 | ||
9337 | @item extension-graph | |
9338 | Emit in Dot/Graphviz format to standard output the @dfn{service | |
9339 | extension graph} of the operating system defined in @var{file} | |
9340 | (@pxref{Service Composition}, for more information on service | |
9341 | extensions.) | |
9342 | ||
9343 | The command: | |
9344 | ||
9345 | @example | |
9346 | $ guix system extension-graph @var{file} | dot -Tpdf > services.pdf | |
9347 | @end example | |
9348 | ||
9349 | produces a PDF file showing the extension relations among services. | |
9350 | ||
6f305ea5 LC |
9351 | @anchor{system-dmd-graph} |
9352 | @item dmd-graph | |
9353 | Emit in Dot/Graphviz format to standard output the @dfn{dependency | |
dd17bc38 AK |
9354 | graph} of shepherd services of the operating system defined in |
9355 | @var{file}. @xref{Shepherd Services}, for more information and for an | |
9356 | example graph. | |
6f305ea5 | 9357 | |
d6c3267a LC |
9358 | @end table |
9359 | ||
97d76250 LF |
9360 | @node Running GuixSD in a VM |
9361 | @subsection Running GuixSD in a virtual machine | |
9362 | ||
9363 | One way to run GuixSD in a virtual machine (VM) is to build a GuixSD | |
9364 | virtual machine image using @command{guix system vm-image} | |
9365 | (@pxref{Invoking guix system}). The returned image is in qcow2 format, | |
9366 | which the @uref{http://qemu.org/, QEMU emulator} can efficiently use. | |
9367 | ||
9368 | To run the image in QEMU, copy it out of the store (@pxref{The Store}) | |
9369 | and give yourself permission to write to the copy. When invoking QEMU, | |
9370 | you must choose a system emulator that is suitable for your hardware | |
9371 | platform. Here is a minimal QEMU invocation that will boot the result | |
9372 | of @command{guix system vm-image} on x86_64 hardware: | |
9373 | ||
9374 | @example | |
9375 | $ qemu-system-x86_64 \ | |
9376 | -net user -net nic,model=virtio \ | |
9377 | -enable-kvm -m 256 /tmp/qemu-image | |
9378 | @end example | |
9379 | ||
9380 | Here is what each of these options means: | |
9381 | ||
9382 | @table @code | |
9383 | @item qemu-system-x86_64 | |
9384 | This specifies the hardware platform to emulate. This should match the | |
9385 | host. | |
9386 | ||
9387 | @item -net user | |
9388 | Enable the unprivileged user-mode network stack. The guest OS can | |
9389 | access the host but not vice versa. This is the simplest way to get the | |
9390 | guest OS online. If you don't choose a network stack, the boot will | |
9391 | fail. | |
9392 | ||
9393 | @item -net nic,model=virtio | |
9394 | You must create a network interface of a given model. If you don't | |
9395 | create a NIC, the boot will fail. Assuming your hardware platform is | |
9396 | x86_64, you can get a list of available NIC models by running | |
9397 | @command{qemu-system-x86_64 -net nic,model=help}. | |
9398 | ||
9399 | @item -enable-kvm | |
9400 | If your system has hardware virtualization extensions, enabling the | |
9401 | Linux kernel's virtual machine support (KVM) will make things run | |
9402 | faster. | |
9403 | ||
9404 | @item -m 256 | |
9405 | RAM available to the guest OS, in mebibytes. Defaults to 128@tie{}MiB, | |
9406 | which may be insufficent for some operations. | |
9407 | ||
9408 | @item /tmp/qemu-image | |
9409 | The file name of the qcow2 image. | |
9410 | @end table | |
d6c3267a | 9411 | |
cf4a9129 LC |
9412 | @node Defining Services |
9413 | @subsection Defining Services | |
8451a568 | 9414 | |
eb524192 | 9415 | The previous sections show the available services and how one can combine |
0adfe95a LC |
9416 | them in an @code{operating-system} declaration. But how do we define |
9417 | them in the first place? And what is a service anyway? | |
8451a568 | 9418 | |
0adfe95a LC |
9419 | @menu |
9420 | * Service Composition:: The model for composing services. | |
9421 | * Service Types and Services:: Types and services. | |
9422 | * Service Reference:: API reference. | |
dd17bc38 | 9423 | * Shepherd Services:: A particular type of service. |
0adfe95a LC |
9424 | @end menu |
9425 | ||
9426 | @node Service Composition | |
9427 | @subsubsection Service Composition | |
9428 | ||
9429 | @cindex services | |
9430 | @cindex daemons | |
9431 | Here we define a @dfn{service} as, broadly, something that extends the | |
9432 | operating system's functionality. Often a service is a process---a | |
9433 | @dfn{daemon}---started when the system boots: a secure shell server, a | |
9434 | Web server, the Guix build daemon, etc. Sometimes a service is a daemon | |
9435 | whose execution can be triggered by another daemon---e.g., an FTP server | |
9436 | started by @command{inetd} or a D-Bus service activated by | |
9437 | @command{dbus-daemon}. Occasionally, a service does not map to a | |
9438 | daemon. For instance, the ``account'' service collects user accounts | |
9439 | and makes sure they exist when the system runs; the ``udev'' service | |
9440 | collects device management rules and makes them available to the eudev | |
9441 | daemon; the @file{/etc} service populates the system's @file{/etc} | |
9442 | directory. | |
9443 | ||
d6c3267a | 9444 | @cindex service extensions |
0adfe95a | 9445 | GuixSD services are connected by @dfn{extensions}. For instance, the |
dd17bc38 AK |
9446 | secure shell service @emph{extends} the Shepherd---GuixSD's |
9447 | initialization system, running as PID@tie{}1---by giving it the command | |
9448 | lines to start and stop the secure shell daemon (@pxref{Networking | |
9449 | Services, @code{lsh-service}}); the UPower service extends the D-Bus | |
9450 | service by passing it its @file{.service} specification, and extends the | |
9451 | udev service by passing it device management rules (@pxref{Desktop | |
9452 | Services, @code{upower-service}}); the Guix daemon service extends the | |
9453 | Shepherd by passing it the command lines to start and stop the daemon, | |
9454 | and extends the account service by passing it a list of required build | |
9455 | user accounts (@pxref{Base Services}). | |
0adfe95a LC |
9456 | |
9457 | All in all, services and their ``extends'' relations form a directed | |
9458 | acyclic graph (DAG). If we represent services as boxes and extensions | |
9459 | as arrows, a typical system might provide something like this: | |
9460 | ||
9461 | @image{images/service-graph,,5in,Typical service extension graph.} | |
9462 | ||
d62e201c LC |
9463 | @cindex system service |
9464 | At the bottom, we see the @dfn{system service}, which produces the | |
9465 | directory containing everything to run and boot the system, as returned | |
9466 | by the @command{guix system build} command. @xref{Service Reference}, | |
9467 | to learn about the other service types shown here. | |
d6c3267a LC |
9468 | @xref{system-extension-graph, the @command{guix system extension-graph} |
9469 | command}, for information on how to generate this representation for a | |
9470 | particular operating system definition. | |
0adfe95a LC |
9471 | |
9472 | @cindex service types | |
9473 | Technically, developers can define @dfn{service types} to express these | |
9474 | relations. There can be any number of services of a given type on the | |
9475 | system---for instance, a system running two instances of the GNU secure | |
9476 | shell server (lsh) has two instances of @var{lsh-service-type}, with | |
9477 | different parameters. | |
9478 | ||
9479 | The following section describes the programming interface for service | |
9480 | types and services. | |
9481 | ||
9482 | @node Service Types and Services | |
9483 | @subsubsection Service Types and Services | |
9484 | ||
9485 | A @dfn{service type} is a node in the DAG described above. Let us start | |
9486 | with a simple example, the service type for the Guix build daemon | |
9487 | (@pxref{Invoking guix-daemon}): | |
9488 | ||
9489 | @example | |
9490 | (define guix-service-type | |
9491 | (service-type | |
9492 | (name 'guix) | |
9493 | (extensions | |
9494 | (list (service-extension dmd-root-service-type guix-dmd-service) | |
9495 | (service-extension account-service-type guix-accounts) | |
9496 | (service-extension activation-service-type guix-activation))))) | |
9497 | @end example | |
8451a568 | 9498 | |
cf4a9129 | 9499 | @noindent |
0adfe95a LC |
9500 | It defines a two things: |
9501 | ||
9502 | @enumerate | |
9503 | @item | |
9504 | A name, whose sole purpose is to make inspection and debugging easier. | |
9505 | ||
9506 | @item | |
9507 | A list of @dfn{service extensions}, where each extension designates the | |
9508 | target service type and a procedure that, given the service's | |
9509 | parameters, returns a list of object to extend the service of that type. | |
9510 | ||
9511 | Every service type has at least one service extension. The only | |
9512 | exception is the @dfn{boot service type}, which is the ultimate service. | |
9513 | @end enumerate | |
9514 | ||
9515 | In this example, @var{guix-service-type} extends three services: | |
9516 | ||
9517 | @table @var | |
9518 | @item dmd-root-service-type | |
dd17bc38 | 9519 | The @var{guix-dmd-service} procedure defines how the Shepherd service is |
0adfe95a | 9520 | extended. Namely, it returns a @code{<dmd-service>} object that defines |
dd17bc38 AK |
9521 | how @command{guix-daemon} is started and stopped (@pxref{Shepherd |
9522 | Services}). | |
0adfe95a LC |
9523 | |
9524 | @item account-service-type | |
9525 | This extension for this service is computed by @var{guix-accounts}, | |
9526 | which returns a list of @code{user-group} and @code{user-account} | |
9527 | objects representing the build user accounts (@pxref{Invoking | |
9528 | guix-daemon}). | |
9529 | ||
9530 | @item activation-service-type | |
9531 | Here @var{guix-activation} is a procedure that returns a gexp, which is | |
9532 | a code snippet to run at ``activation time''---e.g., when the service is | |
9533 | booted. | |
9534 | @end table | |
9535 | ||
9536 | A service of this type is instantiated like this: | |
9537 | ||
9538 | @example | |
9539 | (service guix-service-type | |
9540 | (guix-configuration | |
9541 | (build-accounts 5) | |
9542 | (use-substitutes? #f))) | |
9543 | @end example | |
9544 | ||
9545 | The second argument to the @code{service} form is a value representing | |
9546 | the parameters of this specific service instance. | |
9547 | @xref{guix-configuration-type, @code{guix-configuration}}, for | |
9548 | information about the @code{guix-configuration} data type. | |
9549 | ||
9550 | @var{guix-service-type} is quite simple because it extends other | |
9551 | services but is not extensible itself. | |
9552 | ||
9553 | @c @subsubsubsection Extensible Service Types | |
9554 | ||
9555 | The service type for an @emph{extensible} service looks like this: | |
9556 | ||
9557 | @example | |
9558 | (define udev-service-type | |
9559 | (service-type (name 'udev) | |
9560 | (extensions | |
9561 | (list (service-extension dmd-root-service-type | |
9562 | udev-dmd-service))) | |
9563 | ||
9564 | (compose concatenate) ;concatenate the list of rules | |
9565 | (extend (lambda (config rules) | |
9566 | (match config | |
9567 | (($ <udev-configuration> udev initial-rules) | |
9568 | (udev-configuration | |
9569 | (udev udev) ;the udev package to use | |
9570 | (rules (append initial-rules rules))))))))) | |
9571 | @end example | |
9572 | ||
9573 | This is the service type for the | |
9574 | @uref{https://wiki.gentoo.org/wiki/Project:Eudev, eudev device | |
9575 | management daemon}. Compared to the previous example, in addition to an | |
9576 | extension of @var{dmd-root-service-type}, we see two new fields: | |
9577 | ||
9578 | @table @code | |
9579 | @item compose | |
9580 | This is the procedure to @dfn{compose} the list of extensions to | |
9581 | services of this type. | |
9582 | ||
9583 | Services can extend the udev service by passing it lists of rules; we | |
9584 | compose those extensions simply by concatenating them. | |
9585 | ||
9586 | @item extend | |
9587 | This procedure defines how the service's value is @dfn{extended} with | |
9588 | the composition of the extensions. | |
9589 | ||
9590 | Udev extensions are composed into a list of rules, but the udev service | |
9591 | value is itself a @code{<udev-configuration>} record. So here, we | |
9592 | extend that record by appending the list of rules is contains to the | |
9593 | list of contributed rules. | |
9594 | @end table | |
9595 | ||
9596 | There can be only one instance of an extensible service type such as | |
9597 | @var{udev-service-type}. If there were more, the | |
9598 | @code{service-extension} specifications would be ambiguous. | |
9599 | ||
9600 | Still here? The next section provides a reference of the programming | |
9601 | interface for services. | |
9602 | ||
9603 | @node Service Reference | |
9604 | @subsubsection Service Reference | |
9605 | ||
9606 | We have seen an overview of service types (@pxref{Service Types and | |
9607 | Services}). This section provides a reference on how to manipulate | |
9608 | services and service types. This interface is provided by the | |
9609 | @code{(gnu services)} module. | |
9610 | ||
9611 | @deffn {Scheme Procedure} service @var{type} @var{value} | |
9612 | Return a new service of @var{type}, a @code{<service-type>} object (see | |
9613 | below.) @var{value} can be any object; it represents the parameters of | |
9614 | this particular service instance. | |
9615 | @end deffn | |
9616 | ||
9617 | @deffn {Scheme Procedure} service? @var{obj} | |
9618 | Return true if @var{obj} is a service. | |
9619 | @end deffn | |
8451a568 | 9620 | |
0adfe95a LC |
9621 | @deffn {Scheme Procedure} service-kind @var{service} |
9622 | Return the type of @var{service}---i.e., a @code{<service-type>} object. | |
9623 | @end deffn | |
9624 | ||
9625 | @deffn {Scheme Procedure} service-parameters @var{service} | |
9626 | Return the value associated with @var{service}. It represents its | |
9627 | parameters. | |
9628 | @end deffn | |
9629 | ||
9630 | Here is an example of how a service is created and manipulated: | |
9631 | ||
9632 | @example | |
9633 | (define s | |
9634 | (service nginx-service-type | |
9635 | (nginx-configuration | |
9636 | (nginx nginx) | |
9637 | (log-directory log-directory) | |
9638 | (run-directory run-directory) | |
9639 | (file config-file)))) | |
9640 | ||
9641 | (service? s) | |
9642 | @result{} #t | |
9643 | ||
9644 | (eq? (service-kind s) nginx-service-type) | |
9645 | @result{} #t | |
9646 | @end example | |
9647 | ||
cd6f6c22 LC |
9648 | The @code{modify-services} form provides a handy way to change the |
9649 | parameters of some of the services of a list such as | |
9650 | @var{%base-services} (@pxref{Base Services, @code{%base-services}}). Of | |
9651 | course, you could always use standard list combinators such as | |
9652 | @code{map} and @code{fold} to do that (@pxref{SRFI-1, List Library,, | |
9653 | guile, GNU Guile Reference Manual}); @code{modify-services} simply | |
9654 | provides a more concise form for this common pattern. | |
9655 | ||
9656 | @deffn {Scheme Syntax} modify-services @var{services} @ | |
9657 | (@var{type} @var{variable} => @var{body}) @dots{} | |
9658 | ||
9659 | Modify the services listed in @var{services} according to the given | |
9660 | clauses. Each clause has the form: | |
9661 | ||
9662 | @example | |
9663 | (@var{type} @var{variable} => @var{body}) | |
9664 | @end example | |
9665 | ||
9666 | where @var{type} is a service type, such as @var{guix-service-type}, and | |
9667 | @var{variable} is an identifier that is bound within @var{body} to the | |
9668 | value of the service of that @var{type}. @xref{Using the Configuration | |
9669 | System}, for an example. | |
9670 | ||
9671 | This is a shorthand for: | |
9672 | ||
9673 | @example | |
9674 | (map (lambda (service) @dots{}) @var{services}) | |
9675 | @end example | |
9676 | @end deffn | |
9677 | ||
9678 | Next comes the programming interface for service types. This is | |
9679 | something you want to know when writing new service definitions, but not | |
9680 | necessarily when simply looking for ways to customize your | |
9681 | @code{operating-system} declaration. | |
9682 | ||
0adfe95a LC |
9683 | @deftp {Data Type} service-type |
9684 | @cindex service type | |
9685 | This is the representation of a @dfn{service type} (@pxref{Service Types | |
9686 | and Services}). | |
9687 | ||
9688 | @table @asis | |
9689 | @item @code{name} | |
9690 | This is a symbol, used only to simplify inspection and debugging. | |
9691 | ||
9692 | @item @code{extensions} | |
9693 | A non-empty list of @code{<service-extension>} objects (see below.) | |
9694 | ||
9695 | @item @code{compose} (default: @code{#f}) | |
9696 | If this is @code{#f}, then the service type denotes services that cannot | |
9697 | be extended---i.e., services that do not receive ``values'' from other | |
9698 | services. | |
9699 | ||
9700 | Otherwise, it must be a one-argument procedure. The procedure is called | |
9701 | by @code{fold-services} and is passed a list of values collected from | |
9702 | extensions. It must return a value that is a valid parameter value for | |
9703 | the service instance. | |
9704 | ||
9705 | @item @code{extend} (default: @code{#f}) | |
9706 | If this is @code{#f}, services of this type cannot be extended. | |
9707 | ||
9708 | Otherwise, it must be a two-argument procedure: @code{fold-services} | |
9709 | calls it, passing it the service's initial value as the first argument | |
9710 | and the result of applying @code{compose} to the extension values as the | |
9711 | second argument. | |
9712 | @end table | |
9713 | ||
9714 | @xref{Service Types and Services}, for examples. | |
9715 | @end deftp | |
9716 | ||
9717 | @deffn {Scheme Procedure} service-extension @var{target-type} @ | |
9718 | @var{compute} | |
9719 | Return a new extension for services of type @var{target-type}. | |
9720 | @var{compute} must be a one-argument procedure: @code{fold-services} | |
9721 | calls it, passing it the value associated with the service that provides | |
9722 | the extension; it must return a valid value for the target service. | |
9723 | @end deffn | |
9724 | ||
9725 | @deffn {Scheme Procedure} service-extension? @var{obj} | |
9726 | Return true if @var{obj} is a service extension. | |
9727 | @end deffn | |
9728 | ||
9729 | At the core of the service abstraction lies the @code{fold-services} | |
9730 | procedure, which is responsible for ``compiling'' a list of services | |
d62e201c LC |
9731 | down to a single directory that contains everything needed to boot and |
9732 | run the system---the directory shown by the @command{guix system build} | |
9733 | command (@pxref{Invoking guix system}). In essence, it propagates | |
9734 | service extensions down the service graph, updating each node parameters | |
9735 | on the way, until it reaches the root node. | |
0adfe95a LC |
9736 | |
9737 | @deffn {Scheme Procedure} fold-services @var{services} @ | |
d62e201c | 9738 | [#:target-type @var{system-service-type}] |
0adfe95a LC |
9739 | Fold @var{services} by propagating their extensions down to the root of |
9740 | type @var{target-type}; return the root service adjusted accordingly. | |
9741 | @end deffn | |
9742 | ||
9743 | Lastly, the @code{(gnu services)} module also defines several essential | |
9744 | service types, some of which are listed below. | |
9745 | ||
d62e201c LC |
9746 | @defvr {Scheme Variable} system-service-type |
9747 | This is the root of the service graph. It produces the system directory | |
9748 | as returned by the @command{guix system build} command. | |
9749 | @end defvr | |
9750 | ||
0adfe95a | 9751 | @defvr {Scheme Variable} boot-service-type |
d62e201c LC |
9752 | The type of the ``boot service'', which produces the @dfn{boot script}. |
9753 | The boot script is what the initial RAM disk runs when booting. | |
0adfe95a LC |
9754 | @end defvr |
9755 | ||
9756 | @defvr {Scheme Variable} etc-service-type | |
9757 | The type of the @file{/etc} service. This service can be extended by | |
9758 | passing it name/file tuples such as: | |
9759 | ||
9760 | @example | |
9761 | (list `("issue" ,(plain-file "issue" "Welcome!\n"))) | |
9762 | @end example | |
9763 | ||
9764 | In this example, the effect would be to add an @file{/etc/issue} file | |
9765 | pointing to the given file. | |
9766 | @end defvr | |
9767 | ||
9768 | @defvr {Scheme Variable} setuid-program-service-type | |
9769 | Type for the ``setuid-program service''. This service collects lists of | |
9770 | executable file names, passed as gexps, and adds them to the set of | |
9771 | setuid-root programs on the system (@pxref{Setuid Programs}). | |
9772 | @end defvr | |
9773 | ||
af4c3fd5 LC |
9774 | @defvr {Scheme Variable} profile-service-type |
9775 | Type of the service that populates the @dfn{system profile}---i.e., the | |
9776 | programs under @file{/run/current-system/profile}. Other services can | |
9777 | extend it by passing it lists of packages to add to the system profile. | |
9778 | @end defvr | |
9779 | ||
0adfe95a | 9780 | |
dd17bc38 AK |
9781 | @node Shepherd Services |
9782 | @subsubsection Shepherd Services | |
0adfe95a LC |
9783 | |
9784 | @cindex PID 1 | |
9785 | @cindex init system | |
0190c1c0 AK |
9786 | The @code{(gnu services shepherd)} provides a way to define services |
9787 | managed by the GNU@tie{}Shepherd, which is GuixSD initialization | |
9788 | system---the first process that is started when the system boots, | |
9789 | aka. PID@tie{}1 (@pxref{Introduction,,, shepherd, The GNU Shepherd | |
9790 | Manual}). | |
6f305ea5 | 9791 | |
dd17bc38 AK |
9792 | Services in the Shepherd can depend on each other. For instance, the |
9793 | SSH daemon may need to be started after the syslog daemon has been | |
9794 | started, which in turn can only happen once all the file systems have | |
9795 | been mounted. The simple operating system defined earlier (@pxref{Using | |
9796 | the Configuration System}) results in a service graph like this: | |
6f305ea5 LC |
9797 | |
9798 | @image{images/dmd-graph,,5in,Typical dmd service graph.} | |
9799 | ||
9800 | You can actually generate such a graph for any operating system | |
9801 | definition using the @command{guix system dmd-graph} command | |
9802 | (@pxref{system-dmd-graph, @command{guix system dmd-graph}}). | |
9803 | ||
9804 | The @var{%dmd-root-service} is a service object representing PID@tie{}1, | |
9805 | of type @var{dmd-root-service-type}; it can be extended by passing it | |
9806 | lists of @code{<dmd-service>} objects. | |
0adfe95a LC |
9807 | |
9808 | @deftp {Data Type} dmd-service | |
dd17bc38 | 9809 | The data type representing a service managed by the Shepherd. |
0adfe95a LC |
9810 | |
9811 | @table @asis | |
9812 | @item @code{provision} | |
9813 | This is a list of symbols denoting what the service provides. | |
9814 | ||
dd17bc38 AK |
9815 | These are the names that may be passed to @command{herd start}, |
9816 | @command{herd status}, and similar commands (@pxref{Invoking herd,,, | |
9817 | shepherd, The GNU Shepherd Manual}). @xref{Slots of services, the | |
9818 | @code{provides} slot,, shepherd, The GNU Shepherd Manual}, for details. | |
0adfe95a LC |
9819 | |
9820 | @item @code{requirements} (default: @code{'()}) | |
dd17bc38 | 9821 | List of symbols denoting the Shepherd services this one depends on. |
0adfe95a LC |
9822 | |
9823 | @item @code{respawn?} (default: @code{#t}) | |
9824 | Whether to restart the service when it stops, for instance when the | |
9825 | underlying process dies. | |
9826 | ||
9827 | @item @code{start} | |
9828 | @itemx @code{stop} (default: @code{#~(const #f)}) | |
dd17bc38 AK |
9829 | The @code{start} and @code{stop} fields refer to the Shepherd's |
9830 | facilities to start and stop processes (@pxref{Service De- and | |
9831 | Constructors,,, shepherd, The GNU Shepherd Manual}). They are given as | |
9832 | G-expressions that get expanded in the Shepherd configuration file | |
9833 | (@pxref{G-Expressions}). | |
0adfe95a LC |
9834 | |
9835 | @item @code{documentation} | |
9836 | A documentation string, as shown when running: | |
9837 | ||
9838 | @example | |
dd17bc38 | 9839 | herd doc @var{service-name} |
0adfe95a LC |
9840 | @end example |
9841 | ||
9842 | where @var{service-name} is one of the symbols in @var{provision} | |
dd17bc38 | 9843 | (@pxref{Invoking herd,,, shepherd, The GNU Shepherd Manual}). |
fae685b9 LC |
9844 | |
9845 | @item @code{modules} (default: @var{%default-modules}) | |
9846 | This is the list of modules that must be in scope when @code{start} and | |
9847 | @code{stop} are evaluated. | |
9848 | ||
9849 | @item @code{imported-modules} (default: @var{%default-imported-modules}) | |
9850 | This is the list of modules to import in the execution environment of | |
dd17bc38 | 9851 | the Shepherd. |
fae685b9 | 9852 | |
0adfe95a LC |
9853 | @end table |
9854 | @end deftp | |
9855 | ||
9856 | @defvr {Scheme Variable} dmd-root-service-type | |
dd17bc38 | 9857 | The service type for the Shepherd ``root service''---i.e., PID@tie{}1. |
0adfe95a LC |
9858 | |
9859 | This is the service type that extensions target when they want to create | |
dd17bc38 AK |
9860 | shepherd services (@pxref{Service Types and Services}, for an example). |
9861 | Each extension must pass a list of @code{<dmd-service>}. | |
0adfe95a LC |
9862 | @end defvr |
9863 | ||
9864 | @defvr {Scheme Variable} %dmd-root-service | |
9865 | This service represents PID@tie{}1. | |
9866 | @end defvr | |
8451a568 | 9867 | |
8451a568 | 9868 | |
cf4a9129 LC |
9869 | @node Installing Debugging Files |
9870 | @section Installing Debugging Files | |
8451a568 | 9871 | |
cf4a9129 LC |
9872 | @cindex debugging files |
9873 | Program binaries, as produced by the GCC compilers for instance, are | |
9874 | typically written in the ELF format, with a section containing | |
9875 | @dfn{debugging information}. Debugging information is what allows the | |
9876 | debugger, GDB, to map binary code to source code; it is required to | |
9877 | debug a compiled program in good conditions. | |
8451a568 | 9878 | |
cf4a9129 LC |
9879 | The problem with debugging information is that is takes up a fair amount |
9880 | of disk space. For example, debugging information for the GNU C Library | |
9881 | weighs in at more than 60 MiB. Thus, as a user, keeping all the | |
9882 | debugging info of all the installed programs is usually not an option. | |
9883 | Yet, space savings should not come at the cost of an impediment to | |
9884 | debugging---especially in the GNU system, which should make it easier | |
9885 | for users to exert their computing freedom (@pxref{GNU Distribution}). | |
8451a568 | 9886 | |
cf4a9129 LC |
9887 | Thankfully, the GNU Binary Utilities (Binutils) and GDB provide a |
9888 | mechanism that allows users to get the best of both worlds: debugging | |
9889 | information can be stripped from the binaries and stored in separate | |
9890 | files. GDB is then able to load debugging information from those files, | |
9891 | when they are available (@pxref{Separate Debug Files,,, gdb, Debugging | |
9892 | with GDB}). | |
8451a568 | 9893 | |
cf4a9129 LC |
9894 | The GNU distribution takes advantage of this by storing debugging |
9895 | information in the @code{lib/debug} sub-directory of a separate package | |
9896 | output unimaginatively called @code{debug} (@pxref{Packages with | |
9897 | Multiple Outputs}). Users can choose to install the @code{debug} output | |
9898 | of a package when they need it. For instance, the following command | |
9899 | installs the debugging information for the GNU C Library and for GNU | |
9900 | Guile: | |
8451a568 LC |
9901 | |
9902 | @example | |
cf4a9129 | 9903 | guix package -i glibc:debug guile:debug |
8451a568 LC |
9904 | @end example |
9905 | ||
cf4a9129 LC |
9906 | GDB must then be told to look for debug files in the user's profile, by |
9907 | setting the @code{debug-file-directory} variable (consider setting it | |
9908 | from the @file{~/.gdbinit} file, @pxref{Startup,,, gdb, Debugging with | |
9909 | GDB}): | |
8451a568 | 9910 | |
cf4a9129 LC |
9911 | @example |
9912 | (gdb) set debug-file-directory ~/.guix-profile/lib/debug | |
9913 | @end example | |
8451a568 | 9914 | |
cf4a9129 LC |
9915 | From there on, GDB will pick up debugging information from the |
9916 | @code{.debug} files under @file{~/.guix-profile/lib/debug}. | |
8451a568 | 9917 | |
cf4a9129 LC |
9918 | In addition, you will most likely want GDB to be able to show the source |
9919 | code being debugged. To do that, you will have to unpack the source | |
9920 | code of the package of interest (obtained with @code{guix build | |
9921 | --source}, @pxref{Invoking guix build}), and to point GDB to that source | |
9922 | directory using the @code{directory} command (@pxref{Source Path, | |
9923 | @code{directory},, gdb, Debugging with GDB}). | |
8451a568 | 9924 | |
cf4a9129 LC |
9925 | @c XXX: keep me up-to-date |
9926 | The @code{debug} output mechanism in Guix is implemented by the | |
9927 | @code{gnu-build-system} (@pxref{Build Systems}). Currently, it is | |
9928 | opt-in---debugging information is available only for those packages | |
9929 | whose definition explicitly declares a @code{debug} output. This may be | |
9930 | changed to opt-out in the future, if our build farm servers can handle | |
9931 | the load. To check whether a package has a @code{debug} output, use | |
9932 | @command{guix package --list-available} (@pxref{Invoking guix package}). | |
8451a568 | 9933 | |
8451a568 | 9934 | |
05962f29 LC |
9935 | @node Security Updates |
9936 | @section Security Updates | |
9937 | ||
843858b8 LC |
9938 | @quotation Note |
9939 | As of version @value{VERSION}, the feature described in this section is | |
9940 | experimental. | |
9941 | @end quotation | |
05962f29 LC |
9942 | |
9943 | @cindex security updates | |
9944 | Occasionally, important security vulnerabilities are discovered in core | |
9945 | software packages and must be patched. Guix follows a functional | |
9946 | package management discipline (@pxref{Introduction}), which implies | |
9947 | that, when a package is changed, @emph{every package that depends on it} | |
9948 | must be rebuilt. This can significantly slow down the deployment of | |
9949 | fixes in core packages such as libc or Bash, since basically the whole | |
9950 | distribution would need to be rebuilt. Using pre-built binaries helps | |
9951 | (@pxref{Substitutes}), but deployment may still take more time than | |
9952 | desired. | |
9953 | ||
9954 | @cindex grafts | |
9955 | To address that, Guix implements @dfn{grafts}, a mechanism that allows | |
9956 | for fast deployment of critical updates without the costs associated | |
9957 | with a whole-distribution rebuild. The idea is to rebuild only the | |
9958 | package that needs to be patched, and then to ``graft'' it onto packages | |
9959 | explicitly installed by the user and that were previously referring to | |
9960 | the original package. The cost of grafting is typically very low, and | |
9961 | order of magnitudes lower than a full rebuild of the dependency chain. | |
9962 | ||
9963 | @cindex replacements of packages, for grafts | |
9964 | For instance, suppose a security update needs to be applied to Bash. | |
9965 | Guix developers will provide a package definition for the ``fixed'' | |
9966 | Bash, say @var{bash-fixed}, in the usual way (@pxref{Defining | |
9967 | Packages}). Then, the original package definition is augmented with a | |
9968 | @code{replacement} field pointing to the package containing the bug fix: | |
9969 | ||
9970 | @example | |
9971 | (define bash | |
9972 | (package | |
9973 | (name "bash") | |
9974 | ;; @dots{} | |
9975 | (replacement bash-fixed))) | |
9976 | @end example | |
9977 | ||
9978 | From there on, any package depending directly or indirectly on Bash that | |
9979 | is installed will automatically be ``rewritten'' to refer to | |
9980 | @var{bash-fixed} instead of @var{bash}. This grafting process takes | |
9981 | time proportional to the size of the package, but expect less than a | |
9982 | minute for an ``average'' package on a recent machine. | |
9983 | ||
9984 | Currently, the graft and the package it replaces (@var{bash-fixed} and | |
9985 | @var{bash} in the example above) must have the exact same @code{name} | |
9986 | and @code{version} fields. This restriction mostly comes from the fact | |
9987 | that grafting works by patching files, including binary files, directly. | |
9988 | Other restrictions may apply: for instance, when adding a graft to a | |
9989 | package providing a shared library, the original shared library and its | |
9990 | replacement must have the same @code{SONAME} and be binary-compatible. | |
9991 | ||
9992 | ||
cf4a9129 LC |
9993 | @node Package Modules |
9994 | @section Package Modules | |
8451a568 | 9995 | |
cf4a9129 LC |
9996 | From a programming viewpoint, the package definitions of the |
9997 | GNU distribution are provided by Guile modules in the @code{(gnu packages | |
9998 | @dots{})} name space@footnote{Note that packages under the @code{(gnu | |
9999 | packages @dots{})} module name space are not necessarily ``GNU | |
10000 | packages''. This module naming scheme follows the usual Guile module | |
10001 | naming convention: @code{gnu} means that these modules are distributed | |
10002 | as part of the GNU system, and @code{packages} identifies modules that | |
10003 | define packages.} (@pxref{Modules, Guile modules,, guile, GNU Guile | |
10004 | Reference Manual}). For instance, the @code{(gnu packages emacs)} | |
10005 | module exports a variable named @code{emacs}, which is bound to a | |
10006 | @code{<package>} object (@pxref{Defining Packages}). | |
113daf62 | 10007 | |
300868ba | 10008 | The @code{(gnu packages @dots{})} module name space is |
cf4a9129 LC |
10009 | automatically scanned for packages by the command-line tools. For |
10010 | instance, when running @code{guix package -i emacs}, all the @code{(gnu | |
10011 | packages @dots{})} modules are scanned until one that exports a package | |
10012 | object whose name is @code{emacs} is found. This package search | |
10013 | facility is implemented in the @code{(gnu packages)} module. | |
113daf62 | 10014 | |
300868ba | 10015 | @cindex customization, of packages |
8689901f | 10016 | @cindex package module search path |
cf4a9129 | 10017 | Users can store package definitions in modules with different |
60142854 | 10018 | names---e.g., @code{(my-packages emacs)}@footnote{Note that the file |
c95ded7e LC |
10019 | name and module name must match. For instance, the @code{(my-packages |
10020 | emacs)} module must be stored in a @file{my-packages/emacs.scm} file | |
10021 | relative to the load path specified with @option{--load-path} or | |
10022 | @code{GUIX_PACKAGE_PATH}. @xref{Modules and the File System,,, | |
10023 | guile, GNU Guile Reference Manual}, for details.}. These package definitions | |
300868ba LC |
10024 | will not be visible by default. Thus, users can invoke commands such as |
10025 | @command{guix package} and @command{guix build} have to be used with the | |
c95ded7e LC |
10026 | @code{-e} option so that they know where to find the package. Better |
10027 | yet, they can use the | |
300868ba | 10028 | @code{-L} option of these commands to make those modules visible |
8689901f LC |
10029 | (@pxref{Invoking guix build, @code{--load-path}}), or define the |
10030 | @code{GUIX_PACKAGE_PATH} environment variable. This environment | |
10031 | variable makes it easy to extend or customize the distribution and is | |
10032 | honored by all the user interfaces. | |
10033 | ||
10034 | @defvr {Environment Variable} GUIX_PACKAGE_PATH | |
10035 | This is a colon-separated list of directories to search for package | |
10036 | modules. Directories listed in this variable take precedence over the | |
10037 | distribution's own modules. | |
10038 | @end defvr | |
ef5dd60a | 10039 | |
cf4a9129 LC |
10040 | The distribution is fully @dfn{bootstrapped} and @dfn{self-contained}: |
10041 | each package is built based solely on other packages in the | |
10042 | distribution. The root of this dependency graph is a small set of | |
10043 | @dfn{bootstrap binaries}, provided by the @code{(gnu packages | |
10044 | bootstrap)} module. For more information on bootstrapping, | |
081145cf | 10045 | @pxref{Bootstrapping}. |
ef5dd60a | 10046 | |
cf4a9129 LC |
10047 | @node Packaging Guidelines |
10048 | @section Packaging Guidelines | |
ef5dd60a | 10049 | |
cf4a9129 LC |
10050 | The GNU distribution is nascent and may well lack some of your favorite |
10051 | packages. This section describes how you can help make the distribution | |
10052 | grow. @xref{Contributing}, for additional information on how you can | |
10053 | help. | |
ef5dd60a | 10054 | |
cf4a9129 LC |
10055 | Free software packages are usually distributed in the form of |
10056 | @dfn{source code tarballs}---typically @file{tar.gz} files that contain | |
10057 | all the source files. Adding a package to the distribution means | |
10058 | essentially two things: adding a @dfn{recipe} that describes how to | |
10059 | build the package, including a list of other packages required to build | |
10060 | it, and adding @dfn{package meta-data} along with that recipe, such as a | |
10061 | description and licensing information. | |
ef5dd60a | 10062 | |
cf4a9129 LC |
10063 | In Guix all this information is embodied in @dfn{package definitions}. |
10064 | Package definitions provide a high-level view of the package. They are | |
10065 | written using the syntax of the Scheme programming language; in fact, | |
10066 | for each package we define a variable bound to the package definition, | |
10067 | and export that variable from a module (@pxref{Package Modules}). | |
10068 | However, in-depth Scheme knowledge is @emph{not} a prerequisite for | |
10069 | creating packages. For more information on package definitions, | |
081145cf | 10070 | @pxref{Defining Packages}. |
ef5dd60a | 10071 | |
cf4a9129 LC |
10072 | Once a package definition is in place, stored in a file in the Guix |
10073 | source tree, it can be tested using the @command{guix build} command | |
10074 | (@pxref{Invoking guix build}). For example, assuming the new package is | |
c71979f4 LC |
10075 | called @code{gnew}, you may run this command from the Guix build tree |
10076 | (@pxref{Running Guix Before It Is Installed}): | |
ef5dd60a LC |
10077 | |
10078 | @example | |
cf4a9129 | 10079 | ./pre-inst-env guix build gnew --keep-failed |
ef5dd60a | 10080 | @end example |
ef5dd60a | 10081 | |
cf4a9129 LC |
10082 | Using @code{--keep-failed} makes it easier to debug build failures since |
10083 | it provides access to the failed build tree. Another useful | |
10084 | command-line option when debugging is @code{--log-file}, to access the | |
10085 | build log. | |
ef5dd60a | 10086 | |
cf4a9129 LC |
10087 | If the package is unknown to the @command{guix} command, it may be that |
10088 | the source file contains a syntax error, or lacks a @code{define-public} | |
10089 | clause to export the package variable. To figure it out, you may load | |
10090 | the module from Guile to get more information about the actual error: | |
ef5dd60a | 10091 | |
cf4a9129 LC |
10092 | @example |
10093 | ./pre-inst-env guile -c '(use-modules (gnu packages gnew))' | |
10094 | @end example | |
ef5dd60a | 10095 | |
cf4a9129 LC |
10096 | Once your package builds correctly, please send us a patch |
10097 | (@pxref{Contributing}). Well, if you need help, we will be happy to | |
10098 | help you too. Once the patch is committed in the Guix repository, the | |
10099 | new package automatically gets built on the supported platforms by | |
2b1cee21 | 10100 | @url{http://hydra.gnu.org/jobset/gnu/master, our continuous integration |
cf4a9129 | 10101 | system}. |
ef5dd60a | 10102 | |
cf4a9129 LC |
10103 | @cindex substituter |
10104 | Users can obtain the new package definition simply by running | |
10105 | @command{guix pull} (@pxref{Invoking guix pull}). When | |
10106 | @code{hydra.gnu.org} is done building the package, installing the | |
10107 | package automatically downloads binaries from there | |
10108 | (@pxref{Substitutes}). The only place where human intervention is | |
10109 | needed is to review and apply the patch. | |
ef5dd60a | 10110 | |
ef5dd60a | 10111 | |
cf4a9129 | 10112 | @menu |
ec0339cd LC |
10113 | * Software Freedom:: What may go into the distribution. |
10114 | * Package Naming:: What's in a name? | |
10115 | * Version Numbers:: When the name is not enough. | |
cbd02397 | 10116 | * Synopses and Descriptions:: Helping users find the right package. |
ec0339cd LC |
10117 | * Python Modules:: Taming the snake. |
10118 | * Perl Modules:: Little pearls. | |
10119 | * Fonts:: Fond of fonts. | |
cf4a9129 | 10120 | @end menu |
ef5dd60a | 10121 | |
cf4a9129 LC |
10122 | @node Software Freedom |
10123 | @subsection Software Freedom | |
ef5dd60a | 10124 | |
cf4a9129 | 10125 | @c Adapted from http://www.gnu.org/philosophy/philosophy.html. |
c11a6eb1 | 10126 | |
cf4a9129 LC |
10127 | The GNU operating system has been developed so that users can have |
10128 | freedom in their computing. GNU is @dfn{free software}, meaning that | |
10129 | users have the @url{http://www.gnu.org/philosophy/free-sw.html,four | |
10130 | essential freedoms}: to run the program, to study and change the program | |
10131 | in source code form, to redistribute exact copies, and to distribute | |
10132 | modified versions. Packages found in the GNU distribution provide only | |
10133 | software that conveys these four freedoms. | |
c11a6eb1 | 10134 | |
cf4a9129 LC |
10135 | In addition, the GNU distribution follow the |
10136 | @url{http://www.gnu.org/distros/free-system-distribution-guidelines.html,free | |
10137 | software distribution guidelines}. Among other things, these guidelines | |
10138 | reject non-free firmware, recommendations of non-free software, and | |
10139 | discuss ways to deal with trademarks and patents. | |
ef5dd60a | 10140 | |
cf4a9129 LC |
10141 | Some packages contain a small and optional subset that violates the |
10142 | above guidelines, for instance because this subset is itself non-free | |
10143 | code. When that happens, the offending items are removed with | |
10144 | appropriate patches or code snippets in the package definition's | |
10145 | @code{origin} form (@pxref{Defining Packages}). That way, @code{guix | |
10146 | build --source} returns the ``freed'' source rather than the unmodified | |
10147 | upstream source. | |
ef5dd60a | 10148 | |
ef5dd60a | 10149 | |
cf4a9129 LC |
10150 | @node Package Naming |
10151 | @subsection Package Naming | |
ef5dd60a | 10152 | |
cf4a9129 LC |
10153 | A package has actually two names associated with it: |
10154 | First, there is the name of the @emph{Scheme variable}, the one following | |
10155 | @code{define-public}. By this name, the package can be made known in the | |
10156 | Scheme code, for instance as input to another package. Second, there is | |
10157 | the string in the @code{name} field of a package definition. This name | |
10158 | is used by package management commands such as | |
10159 | @command{guix package} and @command{guix build}. | |
ef5dd60a | 10160 | |
cf4a9129 LC |
10161 | Both are usually the same and correspond to the lowercase conversion of |
10162 | the project name chosen upstream, with underscores replaced with | |
10163 | hyphens. For instance, GNUnet is available as @code{gnunet}, and | |
10164 | SDL_net as @code{sdl-net}. | |
927097ef | 10165 | |
cf4a9129 | 10166 | We do not add @code{lib} prefixes for library packages, unless these are |
081145cf | 10167 | already part of the official project name. But @pxref{Python |
cf4a9129 LC |
10168 | Modules} and @ref{Perl Modules} for special rules concerning modules for |
10169 | the Python and Perl languages. | |
927097ef | 10170 | |
1b366ee4 | 10171 | Font package names are handled differently, @pxref{Fonts}. |
7fec52b7 | 10172 | |
ef5dd60a | 10173 | |
cf4a9129 LC |
10174 | @node Version Numbers |
10175 | @subsection Version Numbers | |
ef5dd60a | 10176 | |
cf4a9129 LC |
10177 | We usually package only the latest version of a given free software |
10178 | project. But sometimes, for instance for incompatible library versions, | |
10179 | two (or more) versions of the same package are needed. These require | |
10180 | different Scheme variable names. We use the name as defined | |
10181 | in @ref{Package Naming} | |
10182 | for the most recent version; previous versions use the same name, suffixed | |
10183 | by @code{-} and the smallest prefix of the version number that may | |
10184 | distinguish the two versions. | |
ef5dd60a | 10185 | |
cf4a9129 LC |
10186 | The name inside the package definition is the same for all versions of a |
10187 | package and does not contain any version number. | |
ef5dd60a | 10188 | |
cf4a9129 | 10189 | For instance, the versions 2.24.20 and 3.9.12 of GTK+ may be packaged as follows: |
ef5dd60a | 10190 | |
cf4a9129 LC |
10191 | @example |
10192 | (define-public gtk+ | |
10193 | (package | |
17d8e33f ML |
10194 | (name "gtk+") |
10195 | (version "3.9.12") | |
10196 | ...)) | |
cf4a9129 LC |
10197 | (define-public gtk+-2 |
10198 | (package | |
17d8e33f ML |
10199 | (name "gtk+") |
10200 | (version "2.24.20") | |
10201 | ...)) | |
cf4a9129 LC |
10202 | @end example |
10203 | If we also wanted GTK+ 3.8.2, this would be packaged as | |
10204 | @example | |
10205 | (define-public gtk+-3.8 | |
10206 | (package | |
17d8e33f ML |
10207 | (name "gtk+") |
10208 | (version "3.8.2") | |
10209 | ...)) | |
cf4a9129 | 10210 | @end example |
ef5dd60a | 10211 | |
880d647d LC |
10212 | @c See <https://lists.gnu.org/archive/html/guix-devel/2016-01/msg00425.html>, |
10213 | @c for a discussion of what follows. | |
10214 | @cindex version number, for VCS snapshots | |
10215 | Occasionally, we package snapshots of upstream's version control system | |
10216 | (VCS) instead of formal releases. This should remain exceptional, | |
10217 | because it is up to upstream developers to clarify what the stable | |
10218 | release is. Yet, it is sometimes necessary. So, what should we put in | |
10219 | the @code{version} field? | |
10220 | ||
10221 | Clearly, we need to make the commit identifier of the VCS snapshot | |
10222 | visible in the version string, but we also need to make sure that the | |
10223 | version string is monotonically increasing so that @command{guix package | |
10224 | --upgrade} can determine which version is newer. Since commit | |
10225 | identifiers, notably with Git, are not monotonically increasing, we add | |
10226 | a revision number that we increase each time we upgrade to a newer | |
10227 | snapshot. The resulting version string looks like this: | |
10228 | ||
10229 | @example | |
10230 | 2.0.11-3.cabba9e | |
10231 | ^ ^ ^ | |
10232 | | | `-- upstream commit ID | |
10233 | | | | |
10234 | | `--- Guix package revision | |
10235 | | | |
10236 | latest upstream version | |
10237 | @end example | |
10238 | ||
10239 | It is a good idea to strip commit identifiers in the @code{version} | |
10240 | field to, say, 7 digits. It avoids an aesthetic annoyance (assuming | |
10241 | aesthetics have a role to play here) as well as problems related to OS | |
10242 | limits such as the maximum shebang length (127 bytes for the Linux | |
10243 | kernel.) It is best to use the full commit identifiers in | |
10244 | @code{origin}s, though, to avoid ambiguities. | |
10245 | ||
cbd02397 LC |
10246 | @node Synopses and Descriptions |
10247 | @subsection Synopses and Descriptions | |
10248 | ||
10249 | As we have seen before, each package in GNU@tie{}Guix includes a | |
10250 | synopsis and a description (@pxref{Defining Packages}). Synopses and | |
10251 | descriptions are important: They are what @command{guix package | |
10252 | --search} searches, and a crucial piece of information to help users | |
10253 | determine whether a given package suits their needs. Consequently, | |
10254 | packagers should pay attention to what goes into them. | |
10255 | ||
10256 | Synopses must start with a capital letter and must not end with a | |
10257 | period. They must not start with ``a'' or ``the'', which usually does | |
10258 | not bring anything; for instance, prefer ``File-frobbing tool'' over ``A | |
10259 | tool that frobs files''. The synopsis should say what the package | |
10260 | is---e.g., ``Core GNU utilities (file, text, shell)''---or what it is | |
10261 | used for---e.g., the synopsis for GNU@tie{}grep is ``Print lines | |
10262 | matching a pattern''. | |
10263 | ||
10264 | Keep in mind that the synopsis must be meaningful for a very wide | |
10265 | audience. For example, ``Manipulate alignments in the SAM format'' | |
10266 | might make sense for a seasoned bioinformatics researcher, but might be | |
10267 | fairly unhelpful or even misleading to a non-specialized audience. It | |
10268 | is a good idea to come up with a synopsis that gives an idea of the | |
10269 | application domain of the package. In this example, this might give | |
10270 | something like ``Manipulate nucleotide sequence alignments'', which | |
10271 | hopefully gives the user a better idea of whether this is what they are | |
10272 | looking for. | |
10273 | ||
10274 | @cindex Texinfo markup, in package descriptions | |
10275 | Descriptions should take between five and ten lines. Use full | |
10276 | sentences, and avoid using acronyms without first introducing them. | |
10277 | Descriptions can include Texinfo markup, which is useful to introduce | |
10278 | ornaments such as @code{@@code} or @code{@@dfn}, bullet lists, or | |
ba7d6c76 ML |
10279 | hyperlinks (@pxref{Overview,,, texinfo, GNU Texinfo}). However you |
10280 | should be careful when using some characters for example @samp{@@} and | |
10281 | curly braces which are the basic special characters in Texinfo | |
10282 | (@pxref{Special Characters,,, texinfo, GNU Texinfo}). User interfaces | |
10283 | such as @command{guix package --show} take care of rendering it | |
10284 | appropriately. | |
cbd02397 LC |
10285 | |
10286 | Synopses and descriptions are translated by volunteers | |
10287 | @uref{http://translationproject.org/domain/guix-packages.html, at the | |
10288 | Translation Project} so that as many users as possible can read them in | |
10289 | their native language. User interfaces search them and display them in | |
10290 | the language specified by the current locale. | |
10291 | ||
10292 | Translation is a lot of work so, as a packager, please pay even more | |
10293 | attention to your synopses and descriptions as every change may entail | |
ba7d6c76 | 10294 | additional work for translators. In order to help them, it is possible |
36743e71 | 10295 | to make recommendations or instructions visible to them by inserting |
ba7d6c76 ML |
10296 | special comments like this (@pxref{xgettext Invocation,,, gettext, GNU |
10297 | Gettext}): | |
10298 | ||
10299 | @example | |
10300 | ;; TRANSLATORS: "X11 resize-and-rotate" should not be translated. | |
10301 | (description "ARandR is designed to provide a simple visual front end | |
10302 | for the X11 resize-and-rotate (RandR) extension. @dots{}") | |
10303 | @end example | |
cbd02397 | 10304 | |
ef5dd60a | 10305 | |
cf4a9129 LC |
10306 | @node Python Modules |
10307 | @subsection Python Modules | |
ef5dd60a | 10308 | |
cf4a9129 LC |
10309 | We currently package Python 2 and Python 3, under the Scheme variable names |
10310 | @code{python-2} and @code{python} as explained in @ref{Version Numbers}. | |
10311 | To avoid confusion and naming clashes with other programming languages, it | |
10312 | seems desirable that the name of a package for a Python module contains | |
10313 | the word @code{python}. | |
ef5dd60a | 10314 | |
cf4a9129 LC |
10315 | Some modules are compatible with only one version of Python, others with both. |
10316 | If the package Foo compiles only with Python 3, we name it | |
10317 | @code{python-foo}; if it compiles only with Python 2, we name it | |
10318 | @code{python2-foo}. If it is compatible with both versions, we create two | |
10319 | packages with the corresponding names. | |
ef5dd60a | 10320 | |
cf4a9129 LC |
10321 | If a project already contains the word @code{python}, we drop this; |
10322 | for instance, the module python-dateutil is packaged under the names | |
10323 | @code{python-dateutil} and @code{python2-dateutil}. | |
113daf62 | 10324 | |
523e4896 | 10325 | |
cf4a9129 LC |
10326 | @node Perl Modules |
10327 | @subsection Perl Modules | |
523e4896 | 10328 | |
cf4a9129 LC |
10329 | Perl programs standing for themselves are named as any other package, |
10330 | using the lowercase upstream name. | |
10331 | For Perl packages containing a single class, we use the lowercase class name, | |
10332 | replace all occurrences of @code{::} by dashes and prepend the prefix | |
10333 | @code{perl-}. | |
10334 | So the class @code{XML::Parser} becomes @code{perl-xml-parser}. | |
10335 | Modules containing several classes keep their lowercase upstream name and | |
10336 | are also prepended by @code{perl-}. Such modules tend to have the word | |
10337 | @code{perl} somewhere in their name, which gets dropped in favor of the | |
10338 | prefix. For instance, @code{libwww-perl} becomes @code{perl-libwww}. | |
523e4896 | 10339 | |
523e4896 | 10340 | |
7fec52b7 AE |
10341 | @node Fonts |
10342 | @subsection Fonts | |
10343 | ||
10344 | For fonts that are in general not installed by a user for typesetting | |
10345 | purposes, or that are distributed as part of a larger software package, | |
10346 | we rely on the general packaging rules for software; for instance, this | |
10347 | applies to the fonts delivered as part of the X.Org system or fonts that | |
10348 | are part of TeX Live. | |
10349 | ||
10350 | To make it easier for a user to search for fonts, names for other packages | |
10351 | containing only fonts are constructed as follows, independently of the | |
10352 | upstream package name. | |
10353 | ||
10354 | The name of a package containing only one font family starts with | |
10355 | @code{font-}; it is followed by the foundry name and a dash @code{-} | |
10356 | if the foundry is known, and the font family name, in which spaces are | |
10357 | replaced by dashes (and as usual, all upper case letters are transformed | |
10358 | to lower case). | |
10359 | For example, the Gentium font family by SIL is packaged under the name | |
10360 | @code{font-sil-gentium}. | |
10361 | ||
10362 | For a package containing several font families, the name of the collection | |
10363 | is used in the place of the font family name. | |
10364 | For instance, the Liberation fonts consist of three families, | |
10365 | Liberation Sans, Liberation Serif and Liberation Mono. | |
10366 | These could be packaged separately under the names | |
10367 | @code{font-liberation-sans} and so on; but as they are distributed together | |
10368 | under a common name, we prefer to package them together as | |
10369 | @code{font-liberation}. | |
10370 | ||
10371 | In the case where several formats of the same font family or font collection | |
10372 | are packaged separately, a short form of the format, prepended by a dash, | |
10373 | is added to the package name. We use @code{-ttf} for TrueType fonts, | |
1b366ee4 | 10374 | @code{-otf} for OpenType fonts and @code{-type1} for PostScript Type 1 |
7fec52b7 AE |
10375 | fonts. |
10376 | ||
10377 | ||
b25937e3 | 10378 | |
cf4a9129 LC |
10379 | @node Bootstrapping |
10380 | @section Bootstrapping | |
b25937e3 | 10381 | |
cf4a9129 | 10382 | @c Adapted from the ELS 2013 paper. |
b25937e3 | 10383 | |
cf4a9129 | 10384 | @cindex bootstrapping |
7889394e | 10385 | |
cf4a9129 LC |
10386 | Bootstrapping in our context refers to how the distribution gets built |
10387 | ``from nothing''. Remember that the build environment of a derivation | |
10388 | contains nothing but its declared inputs (@pxref{Introduction}). So | |
10389 | there's an obvious chicken-and-egg problem: how does the first package | |
10390 | get built? How does the first compiler get compiled? Note that this is | |
10391 | a question of interest only to the curious hacker, not to the regular | |
10392 | user, so you can shamelessly skip this section if you consider yourself | |
10393 | a ``regular user''. | |
72b9d60d | 10394 | |
cf4a9129 LC |
10395 | @cindex bootstrap binaries |
10396 | The GNU system is primarily made of C code, with libc at its core. The | |
10397 | GNU build system itself assumes the availability of a Bourne shell and | |
10398 | command-line tools provided by GNU Coreutils, Awk, Findutils, `sed', and | |
10399 | `grep'. Furthermore, build programs---programs that run | |
10400 | @code{./configure}, @code{make}, etc.---are written in Guile Scheme | |
10401 | (@pxref{Derivations}). Consequently, to be able to build anything at | |
10402 | all, from scratch, Guix relies on pre-built binaries of Guile, GCC, | |
10403 | Binutils, libc, and the other packages mentioned above---the | |
10404 | @dfn{bootstrap binaries}. | |
72b9d60d | 10405 | |
cf4a9129 LC |
10406 | These bootstrap binaries are ``taken for granted'', though we can also |
10407 | re-create them if needed (more on that later). | |
72b9d60d | 10408 | |
cf4a9129 | 10409 | @unnumberedsubsec Preparing to Use the Bootstrap Binaries |
c79d54fe | 10410 | |
cf4a9129 LC |
10411 | @c As of Emacs 24.3, Info-mode displays the image, but since it's a |
10412 | @c large image, it's hard to scroll. Oh well. | |
10413 | @image{images/bootstrap-graph,6in,,Dependency graph of the early bootstrap derivations} | |
523e4896 | 10414 | |
cf4a9129 LC |
10415 | The figure above shows the very beginning of the dependency graph of the |
10416 | distribution, corresponding to the package definitions of the @code{(gnu | |
d33fa0c7 LC |
10417 | packages bootstrap)} module. A similar figure can be generated with |
10418 | @command{guix graph} (@pxref{Invoking guix graph}), along the lines of: | |
10419 | ||
10420 | @example | |
10421 | guix graph -t derivation \ | |
10422 | -e '(@@@@ (gnu packages bootstrap) %bootstrap-gcc)' \ | |
10423 | | dot -Tps > t.ps | |
10424 | @end example | |
10425 | ||
10426 | At this level of detail, things are | |
cf4a9129 LC |
10427 | slightly complex. First, Guile itself consists of an ELF executable, |
10428 | along with many source and compiled Scheme files that are dynamically | |
10429 | loaded when it runs. This gets stored in the @file{guile-2.0.7.tar.xz} | |
10430 | tarball shown in this graph. This tarball is part of Guix's ``source'' | |
10431 | distribution, and gets inserted into the store with @code{add-to-store} | |
10432 | (@pxref{The Store}). | |
2e7b5cea | 10433 | |
cf4a9129 LC |
10434 | But how do we write a derivation that unpacks this tarball and adds it |
10435 | to the store? To solve this problem, the @code{guile-bootstrap-2.0.drv} | |
10436 | derivation---the first one that gets built---uses @code{bash} as its | |
10437 | builder, which runs @code{build-bootstrap-guile.sh}, which in turn calls | |
10438 | @code{tar} to unpack the tarball. Thus, @file{bash}, @file{tar}, | |
10439 | @file{xz}, and @file{mkdir} are statically-linked binaries, also part of | |
10440 | the Guix source distribution, whose sole purpose is to allow the Guile | |
10441 | tarball to be unpacked. | |
fb729425 | 10442 | |
cf4a9129 LC |
10443 | Once @code{guile-bootstrap-2.0.drv} is built, we have a functioning |
10444 | Guile that can be used to run subsequent build programs. Its first task | |
10445 | is to download tarballs containing the other pre-built binaries---this | |
10446 | is what the @code{.tar.xz.drv} derivations do. Guix modules such as | |
10447 | @code{ftp-client.scm} are used for this purpose. The | |
10448 | @code{module-import.drv} derivations import those modules in a directory | |
10449 | in the store, using the original layout. The | |
10450 | @code{module-import-compiled.drv} derivations compile those modules, and | |
10451 | write them in an output directory with the right layout. This | |
10452 | corresponds to the @code{#:modules} argument of | |
10453 | @code{build-expression->derivation} (@pxref{Derivations}). | |
fb729425 | 10454 | |
cf4a9129 LC |
10455 | Finally, the various tarballs are unpacked by the |
10456 | derivations @code{gcc-bootstrap-0.drv}, @code{glibc-bootstrap-0.drv}, | |
10457 | etc., at which point we have a working C tool chain. | |
fb729425 | 10458 | |
fb729425 | 10459 | |
cf4a9129 | 10460 | @unnumberedsubsec Building the Build Tools |
523e4896 | 10461 | |
cf4a9129 LC |
10462 | Bootstrapping is complete when we have a full tool chain that does not |
10463 | depend on the pre-built bootstrap tools discussed above. This | |
10464 | no-dependency requirement is verified by checking whether the files of | |
10465 | the final tool chain contain references to the @file{/gnu/store} | |
10466 | directories of the bootstrap inputs. The process that leads to this | |
10467 | ``final'' tool chain is described by the package definitions found in | |
1f6f57df | 10468 | the @code{(gnu packages commencement)} module. |
df2ce343 | 10469 | |
d33fa0c7 LC |
10470 | The @command{guix graph} command allows us to ``zoom out'' compared to |
10471 | the graph above, by looking at the level of package objects instead of | |
10472 | individual derivations---remember that a package may translate to | |
10473 | several derivations, typically one derivation to download its source, | |
10474 | one to build the Guile modules it needs, and one to actually build the | |
10475 | package from source. The command: | |
10476 | ||
10477 | @example | |
10478 | guix graph -t bag \ | |
10479 | -e '(@@@@ (gnu packages commencement) | |
10480 | glibc-final-with-bootstrap-bash)' | dot -Tps > t.ps | |
10481 | @end example | |
10482 | ||
10483 | @noindent | |
10484 | produces the dependency graph leading to the ``final'' C | |
10485 | library@footnote{You may notice the @code{glibc-intermediate} label, | |
10486 | suggesting that it is not @emph{quite} final, but as a good | |
10487 | approximation, we will consider it final.}, depicted below. | |
10488 | ||
10489 | @image{images/bootstrap-packages,6in,,Dependency graph of the early packages} | |
10490 | ||
cf4a9129 LC |
10491 | @c See <http://lists.gnu.org/archive/html/gnu-system-discuss/2012-10/msg00000.html>. |
10492 | The first tool that gets built with the bootstrap binaries is | |
d33fa0c7 LC |
10493 | GNU@tie{}Make---noted @code{make-boot0} above---which is a prerequisite |
10494 | for all the following packages. From there Findutils and Diffutils get | |
10495 | built. | |
523e4896 | 10496 | |
cf4a9129 LC |
10497 | Then come the first-stage Binutils and GCC, built as pseudo cross |
10498 | tools---i.e., with @code{--target} equal to @code{--host}. They are | |
10499 | used to build libc. Thanks to this cross-build trick, this libc is | |
10500 | guaranteed not to hold any reference to the initial tool chain. | |
4af2447e | 10501 | |
d33fa0c7 LC |
10502 | From there the final Binutils and GCC (not shown above) are built. |
10503 | GCC uses @code{ld} | |
cf4a9129 LC |
10504 | from the final Binutils, and links programs against the just-built libc. |
10505 | This tool chain is used to build the other packages used by Guix and by | |
10506 | the GNU Build System: Guile, Bash, Coreutils, etc. | |
4af2447e | 10507 | |
cf4a9129 LC |
10508 | And voilà! At this point we have the complete set of build tools that |
10509 | the GNU Build System expects. These are in the @code{%final-inputs} | |
dd164244 MW |
10510 | variable of the @code{(gnu packages commencement)} module, and are |
10511 | implicitly used by any package that uses @code{gnu-build-system} | |
1f6f57df | 10512 | (@pxref{Build Systems, @code{gnu-build-system}}). |
4af2447e | 10513 | |
4af2447e | 10514 | |
cf4a9129 | 10515 | @unnumberedsubsec Building the Bootstrap Binaries |
4af2447e | 10516 | |
cf4a9129 LC |
10517 | Because the final tool chain does not depend on the bootstrap binaries, |
10518 | those rarely need to be updated. Nevertheless, it is useful to have an | |
10519 | automated way to produce them, should an update occur, and this is what | |
10520 | the @code{(gnu packages make-bootstrap)} module provides. | |
4af2447e | 10521 | |
cf4a9129 LC |
10522 | The following command builds the tarballs containing the bootstrap |
10523 | binaries (Guile, Binutils, GCC, libc, and a tarball containing a mixture | |
10524 | of Coreutils and other basic command-line tools): | |
4b2615e1 | 10525 | |
cf4a9129 LC |
10526 | @example |
10527 | guix build bootstrap-tarballs | |
10528 | @end example | |
10529 | ||
10530 | The generated tarballs are those that should be referred to in the | |
10531 | @code{(gnu packages bootstrap)} module mentioned at the beginning of | |
10532 | this section. | |
10533 | ||
10534 | Still here? Then perhaps by now you've started to wonder: when do we | |
10535 | reach a fixed point? That is an interesting question! The answer is | |
10536 | unknown, but if you would like to investigate further (and have | |
10537 | significant computational and storage resources to do so), then let us | |
10538 | know. | |
10539 | ||
10540 | @node Porting | |
10541 | @section Porting to a New Platform | |
10542 | ||
10543 | As discussed above, the GNU distribution is self-contained, and | |
10544 | self-containment is achieved by relying on pre-built ``bootstrap | |
10545 | binaries'' (@pxref{Bootstrapping}). These binaries are specific to an | |
10546 | operating system kernel, CPU architecture, and application binary | |
10547 | interface (ABI). Thus, to port the distribution to a platform that is | |
10548 | not yet supported, one must build those bootstrap binaries, and update | |
10549 | the @code{(gnu packages bootstrap)} module to use them on that platform. | |
10550 | ||
10551 | Fortunately, Guix can @emph{cross compile} those bootstrap binaries. | |
10552 | When everything goes well, and assuming the GNU tool chain supports the | |
10553 | target platform, this can be as simple as running a command like this | |
10554 | one: | |
10555 | ||
10556 | @example | |
10557 | guix build --target=armv5tel-linux-gnueabi bootstrap-tarballs | |
10558 | @end example | |
10559 | ||
1c0c417d LC |
10560 | For this to work, the @code{glibc-dynamic-linker} procedure in |
10561 | @code{(gnu packages bootstrap)} must be augmented to return the right | |
10562 | file name for libc's dynamic linker on that platform; likewise, | |
10563 | @code{system->linux-architecture} in @code{(gnu packages linux)} must be | |
10564 | taught about the new platform. | |
10565 | ||
cf4a9129 | 10566 | Once these are built, the @code{(gnu packages bootstrap)} module needs |
1c0c417d LC |
10567 | to be updated to refer to these binaries on the target platform. That |
10568 | is, the hashes and URLs of the bootstrap tarballs for the new platform | |
10569 | must be added alongside those of the currently supported platforms. The | |
10570 | bootstrap Guile tarball is treated specially: it is expected to be | |
10571 | available locally, and @file{gnu-system.am} has rules do download it for | |
10572 | the supported architectures; a rule for the new platform must be added | |
10573 | as well. | |
cf4a9129 LC |
10574 | |
10575 | In practice, there may be some complications. First, it may be that the | |
10576 | extended GNU triplet that specifies an ABI (like the @code{eabi} suffix | |
10577 | above) is not recognized by all the GNU tools. Typically, glibc | |
10578 | recognizes some of these, whereas GCC uses an extra @code{--with-abi} | |
10579 | configure flag (see @code{gcc.scm} for examples of how to handle this). | |
10580 | Second, some of the required packages could fail to build for that | |
10581 | platform. Lastly, the generated binaries could be broken for some | |
10582 | reason. | |
4af2447e | 10583 | |
9bf3c1a7 | 10584 | @c ********************************************************************* |
8c01b9d0 | 10585 | @include contributing.texi |
c78bd12b | 10586 | |
568717fd LC |
10587 | @c ********************************************************************* |
10588 | @node Acknowledgments | |
10589 | @chapter Acknowledgments | |
10590 | ||
136787cb LC |
10591 | Guix is based on the @uref{http://nixos.org/nix/, Nix package manager}, |
10592 | which was designed and | |
4c7ac9aa LC |
10593 | implemented by Eelco Dolstra, with contributions from other people (see |
10594 | the @file{nix/AUTHORS} file in Guix.) Nix pioneered functional package | |
568717fd LC |
10595 | management, and promoted unprecedented features, such as transactional |
10596 | package upgrades and rollbacks, per-user profiles, and referentially | |
10597 | transparent build processes. Without this work, Guix would not exist. | |
10598 | ||
10599 | The Nix-based software distributions, Nixpkgs and NixOS, have also been | |
10600 | an inspiration for Guix. | |
10601 | ||
4c7ac9aa LC |
10602 | GNU@tie{}Guix itself is a collective work with contributions from a |
10603 | number of people. See the @file{AUTHORS} file in Guix for more | |
10604 | information on these fine people. The @file{THANKS} file lists people | |
10605 | who have helped by reporting bugs, taking care of the infrastructure, | |
10606 | providing artwork and themes, making suggestions, and more---thank you! | |
10607 | ||
10608 | ||
568717fd LC |
10609 | @c ********************************************************************* |
10610 | @node GNU Free Documentation License | |
10611 | @appendix GNU Free Documentation License | |
10612 | ||
10613 | @include fdl-1.3.texi | |
10614 | ||
10615 | @c ********************************************************************* | |
10616 | @node Concept Index | |
10617 | @unnumbered Concept Index | |
10618 | @printindex cp | |
10619 | ||
a85b83d2 LC |
10620 | @node Programming Index |
10621 | @unnumbered Programming Index | |
10622 | @syncodeindex tp fn | |
10623 | @syncodeindex vr fn | |
568717fd LC |
10624 | @printindex fn |
10625 | ||
10626 | @bye | |
10627 | ||
10628 | @c Local Variables: | |
10629 | @c ispell-local-dictionary: "american"; | |
10630 | @c End: |