Add "invocation" index entry.
[bpt/guile.git] / doc / ref / api-modules.texi
CommitLineData
07d83abe
MV
1@c -*-texinfo-*-
2@c This is part of the GNU Guile Reference Manual.
3@c Copyright (C) 1996, 1997, 2000, 2001, 2002, 2003, 2004
4@c Free Software Foundation, Inc.
5@c See the file guile.texi for copying conditions.
6
7@page
8@node Modules
9@section Modules
10@cindex modules
11
12When programs become large, naming conflicts can occur when a function
13or global variable defined in one file has the same name as a function
14or global variable in another file. Even just a @emph{similarity}
15between function names can cause hard-to-find bugs, since a programmer
16might type the wrong function name.
17
18The approach used to tackle this problem is called @emph{information
19encapsulation}, which consists of packaging functional units into a
20given name space that is clearly separated from other name spaces.
21@cindex encapsulation
22@cindex information encapsulation
23@cindex name space
24
25The language features that allow this are usually called @emph{the
26module system} because programs are broken up into modules that are
27compiled separately (or loaded separately in an interpreter).
28
29Older languages, like C, have limited support for name space
30manipulation and protection. In C a variable or function is public by
31default, and can be made local to a module with the @code{static}
32keyword. But you cannot reference public variables and functions from
33another module with different names.
34
35More advanced module systems have become a common feature in recently
36designed languages: ML, Python, Perl, and Modula 3 all allow the
37@emph{renaming} of objects from a foreign module, so they will not
38clutter the global name space.
39@cindex name space - private
40
41In addition, Guile offers variables as first-class objects. They can
42be used for interacting with the module system.
43
44@menu
45* provide and require:: The SLIB feature mechanism.
46* Environments:: R5RS top-level environments.
47* The Guile module system:: How Guile does it.
48* Dynamic Libraries:: Loading libraries of compiled code at run time.
49* Variables:: First-class variables.
50@end menu
51
52@node provide and require
53@subsection provide and require
54
55Aubrey Jaffer, mostly to support his portable Scheme library SLIB,
56implemented a provide/require mechanism for many Scheme implementations.
57Library files in SLIB @emph{provide} a feature, and when user programs
58@emph{require} that feature, the library file is loaded in.
59
60For example, the file @file{random.scm} in the SLIB package contains the
61line
62
63@smalllisp
64(provide 'random)
65@end smalllisp
66
67so to use its procedures, a user would type
68
69@smalllisp
70(require 'random)
71@end smalllisp
72
73and they would magically become available, @emph{but still have the same
74names!} So this method is nice, but not as good as a full-featured
75module system.
76
77When SLIB is used with Guile, provide and require can be used to access
78its facilities.
79
80@node Environments
81@subsection Environments
82@cindex environment
83
84Scheme, as defined in R5RS, does @emph{not} have a full module system.
85However it does define the concept of a top-level @dfn{environment}.
86Such an environment maps identifiers (symbols) to Scheme objects such
87as procedures and lists: @ref{About Closure}. In other words, it
88implements a set of @dfn{bindings}.
89
90Environments in R5RS can be passed as the second argument to
91@code{eval} (@pxref{Fly Evaluation}). Three procedures are defined to
92return environments: @code{scheme-report-environment},
93@code{null-environment} and @code{interaction-environment} (@pxref{Fly
94Evaluation}).
95
96In addition, in Guile any module can be used as an R5RS environment,
97i.e., passed as the second argument to @code{eval}.
98
99Note: the following two procedures are available only when the
100@code{(ice-9 r5rs)} module is loaded:
101
102@smalllisp
103(use-modules (ice-9 r5rs))
104@end smalllisp
105
106@deffn {Scheme Procedure} scheme-report-environment version
107@deffnx {Scheme Procedure} null-environment version
108@var{version} must be the exact integer `5', corresponding to revision
1095 of the Scheme report (the Revised^5 Report on Scheme).
110@code{scheme-report-environment} returns a specifier for an
111environment that is empty except for all bindings defined in the
112report that are either required or both optional and supported by the
113implementation. @code{null-environment} returns a specifier for an
114environment that is empty except for the (syntactic) bindings for all
115syntactic keywords defined in the report that are either required or
116both optional and supported by the implementation.
117
118Currently Guile does not support values of @var{version} for other
119revisions of the report.
120
121The effect of assigning (through the use of @code{eval}) a variable
122bound in a @code{scheme-report-environment} (for example @code{car})
123is unspecified. Currently the environments specified by
124@code{scheme-report-environment} are not immutable in Guile.
125@end deffn
126
127@node The Guile module system
128@subsection The Guile module system
129
130The Guile module system extends the concept of environments, discussed
131in the previous section, with mechanisms to define, use and customise
132sets of bindings.
133
134In 1996 Tom Lord implemented a full-featured module system for Guile which
135allows loading Scheme source files into a private name space. This system has
136been in available since at least Guile version 1.1.
137
138For Guile version 1.5.0 and later, the system has been improved to have better
139integration from C code, more fine-grained user control over interfaces, and
140documentation.
141
142Although it is anticipated that the module system implementation will
143change in the future, the Scheme programming interface described in this
144manual should be considered stable. The C programming interface is
145considered relatively stable, although at the time of this writing,
146there is still some flux.
147
148@menu
149* General Information about Modules:: Guile module basics.
150* Using Guile Modules:: How to use existing modules.
151* Creating Guile Modules:: How to package your code into modules.
cdf1ad3b 152* Module System Reflection:: Accessing module objects at run-time.
07d83abe
MV
153* Module System Quirks:: Strange things to be aware of.
154* Included Guile Modules:: Which modules come with Guile?
155* Accessing Modules from C:: How to work with modules with C code.
156@end menu
157
158@node General Information about Modules
159@subsubsection General Information about Modules
160
161A Guile module can be thought of as a collection of named procedures,
162variables and macros. More precisely, it is a set of @dfn{bindings}
163of symbols (names) to Scheme objects.
164
165An environment is a mapping from identifiers (or symbols) to locations,
166i.e., a set of bindings.
167There are top-level environments and lexical environments.
168The environment in which a lambda is executed is remembered as part of its
169definition.
170
171Within a module, all bindings are visible. Certain bindings
172can be declared @dfn{public}, in which case they are added to the
173module's so-called @dfn{export list}; this set of public bindings is
174called the module's @dfn{public interface} (@pxref{Creating Guile
175Modules}).
176
177A client module @dfn{uses} a providing module's bindings by either
178accessing the providing module's public interface, or by building a
179custom interface (and then accessing that). In a custom interface, the
180client module can @dfn{select} which bindings to access and can also
181algorithmically @dfn{rename} bindings. In contrast, when using the
182providing module's public interface, the entire export list is available
183without renaming (@pxref{Using Guile Modules}).
184
185To use a module, it must be found and loaded. All Guile modules have a
186unique @dfn{module name}, which is a list of one or more symbols.
187Examples are @code{(ice-9 popen)} or @code{(srfi srfi-11)}. When Guile
188searches for the code of a module, it constructs the name of the file to
189load by concatenating the name elements with slashes between the
190elements and appending a number of file name extensions from the list
191@code{%load-extensions} (@pxref{Loading}). The resulting file name is
192then searched in all directories in the variable @code{%load-path}
193(@pxref{Build Config}). For example, the @code{(ice-9 popen)} module
194would result in the filename @code{ice-9/popen.scm} and searched in the
195installation directories of Guile and in all other directories in the
196load path.
197
198@c FIXME::martin: Not sure about this, maybe someone knows better?
199Every module has a so-called syntax transformer associated with it.
200This is a procedure which performs all syntax transformation for the
201time the module is read in and evaluated. When working with modules,
202you can manipulate the current syntax transformer using the
203@code{use-syntax} syntactic form or the @code{#:use-syntax} module
204definition option (@pxref{Creating Guile Modules}).
205
206Please note that there are some problems with the current module system
207you should keep in mind (@pxref{Module System Quirks}). We hope to
208address these eventually.
209
210
211@node Using Guile Modules
212@subsubsection Using Guile Modules
213
214To use a Guile module is to access either its public interface or a
215custom interface (@pxref{General Information about Modules}). Both
216types of access are handled by the syntactic form @code{use-modules},
217which accepts one or more interface specifications and, upon evaluation,
218arranges for those interfaces to be available to the current module.
219This process may include locating and loading code for a given module if
220that code has not yet been loaded, following %load-path (@pxref{Build
221Config}).
222
223An @dfn{interface specification} has one of two forms. The first
224variation is simply to name the module, in which case its public
225interface is the one accessed. For example:
226
227@smalllisp
228(use-modules (ice-9 popen))
229@end smalllisp
230
231Here, the interface specification is @code{(ice-9 popen)}, and the
232result is that the current module now has access to @code{open-pipe},
233@code{close-pipe}, @code{open-input-pipe}, and so on (@pxref{Included
234Guile Modules}).
235
236Note in the previous example that if the current module had already
237defined @code{open-pipe}, that definition would be overwritten by the
238definition in @code{(ice-9 popen)}. For this reason (and others), there
239is a second variation of interface specification that not only names a
240module to be accessed, but also selects bindings from it and renames
241them to suit the current module's needs. For example:
242
243@smalllisp
244(use-modules ((ice-9 popen)
245 :select ((open-pipe . pipe-open) close-pipe)
246 :renamer (symbol-prefix-proc 'unixy:)))
247@end smalllisp
248
249Here, the interface specification is more complex than before, and the
250result is that a custom interface with only two bindings is created and
251subsequently accessed by the current module. The mapping of old to new
252names is as follows:
253
254@c Use `smallexample' since `table' is ugly. --ttn
255@smallexample
256(ice-9 popen) sees: current module sees:
257open-pipe unixy:pipe-open
258close-pipe unixy:close-pipe
259@end smallexample
260
261This example also shows how to use the convenience procedure
262@code{symbol-prefix-proc}.
263
264You can also directly refer to bindings in a module by using the
265@code{@@} syntax. For example, instead of using the
266@code{use-modules} statement from above and writing
267@code{unixy:pipe-open} to refer to the @code{pipe-open} from the
268@code{(ice-9 popen)}, you could also write @code{(@@ (ice-9 popen)
269open-pipe)}. Thus an alternative to the complete @code{use-modules}
270statement would be
271
272@smalllisp
273(define unixy:pipe-open (@@ (ice-9 popen) open-pipe))
274(define unixy:close-pipe (@@ (ice-9 popen) close-pipe))
275@end smalllisp
276
277There is also @code{@@@@}, which can be used like @code{@@}, but does
278not check whether the variable that is being accessed is actually
279exported. Thus, @code{@@@@} can be thought of as the impolite version
280of @code{@@} and should only be used as a last resort or for
281debugging, for example.
282
283Note that just as with a @code{use-modules} statement, any module that
284has not yet been loaded yet will be loaded when referenced by a
285@code{@@} or @code{@@@@} form.
286
287You can also use the @code{@@} and @code{@@@@} syntaxes as the target
288of a @code{set!} when the binding refers to a variable.
289
290@c begin (scm-doc-string "boot-9.scm" "symbol-prefix-proc")
291@deffn {Scheme Procedure} symbol-prefix-proc prefix-sym
292Return a procedure that prefixes its arg (a symbol) with
293@var{prefix-sym}.
294@c Insert gratuitous C++ slam here. --ttn
295@end deffn
296
297@c begin (scm-doc-string "boot-9.scm" "use-modules")
298@deffn syntax use-modules spec @dots{}
299Resolve each interface specification @var{spec} into an interface and
300arrange for these to be accessible by the current module. The return
301value is unspecified.
302
303@var{spec} can be a list of symbols, in which case it names a module
304whose public interface is found and used.
305
306@var{spec} can also be of the form:
307
308@smalllisp
309 (MODULE-NAME [:select SELECTION] [:renamer RENAMER])
310@end smalllisp
311
312in which case a custom interface is newly created and used.
313@var{module-name} is a list of symbols, as above; @var{selection} is a
314list of selection-specs; and @var{renamer} is a procedure that takes a
315symbol and returns its new name. A selection-spec is either a symbol or
316a pair of symbols @code{(ORIG . SEEN)}, where @var{orig} is the name in
317the used module and @var{seen} is the name in the using module. Note
318that @var{seen} is also passed through @var{renamer}.
319
320The @code{:select} and @code{:renamer} clauses are optional. If both are
321omitted, the returned interface has no bindings. If the @code{:select}
322clause is omitted, @var{renamer} operates on the used module's public
323interface.
324
325Signal error if module name is not resolvable.
326@end deffn
327
328
329@c FIXME::martin: Is this correct, and is there more to say?
330@c FIXME::martin: Define term and concept `system transformer' somewhere.
331
332@deffn syntax use-syntax module-name
333Load the module @code{module-name} and use its system
334transformer as the system transformer for the currently defined module,
335as well as installing it as the current system transformer.
336@end deffn
337
338@deffn syntax @@ module-name binding-name
339Refer to the binding named @var{binding-name} in module
340@var{module-name}. The binding must have been exported by the module.
341@end deffn
342
343@deffn syntax @@@@ module-name binding-name
344Refer to the binding named @var{binding-name} in module
345@var{module-name}. The binding must not have been exported by the
346module. This syntax is only intended for debugging purposes or as a
347last resort.
348@end deffn
349
350@node Creating Guile Modules
351@subsubsection Creating Guile Modules
352
353When you want to create your own modules, you have to take the following
354steps:
355
356@itemize @bullet
357@item
358Create a Scheme source file and add all variables and procedures you wish
359to export, or which are required by the exported procedures.
360
361@item
362Add a @code{define-module} form at the beginning.
363
364@item
365Export all bindings which should be in the public interface, either
366by using @code{define-public} or @code{export} (both documented below).
367@end itemize
368
369@c begin (scm-doc-string "boot-9.scm" "define-module")
370@deffn syntax define-module module-name [options @dots{}]
371@var{module-name} is of the form @code{(hierarchy file)}. One
372example of this is
373
374@smalllisp
375(define-module (ice-9 popen))
376@end smalllisp
377
378@code{define-module} makes this module available to Guile programs under
379the given @var{module-name}.
380
381The @var{options} are keyword/value pairs which specify more about the
382defined module. The recognized options and their meaning is shown in
383the following table.
384
385@c fixme: Should we use "#:" or ":"?
386
387@table @code
388@item #:use-module @var{interface-specification}
389Equivalent to a @code{(use-modules @var{interface-specification})}
390(@pxref{Using Guile Modules}).
391
392@item #:use-syntax @var{module}
393Use @var{module} when loading the currently defined module, and install
394it as the syntax transformer.
395
396@item #:autoload @var{module} @var{symbol}
397Load @var{module} whenever @var{symbol} is accessed.
398
399@item #:export @var{list}
400Export all identifiers in @var{list}, which must be a list of symbols.
401This is equivalent to @code{(export @var{list})} in the module body.
402
403@item #:no-backtrace
404Tell Guile not to record information for procedure backtraces when
405executing the procedures in this module.
406
407@item #:pure
408Create a @dfn{pure} module, that is a module which does not contain any
409of the standard procedure bindings except for the syntax forms. This is
410useful if you want to create @dfn{safe} modules, that is modules which
411do not know anything about dangerous procedures.
412@end table
413
414@end deffn
415@c end
416
417@deffn syntax export variable @dots{}
418Add all @var{variable}s (which must be symbols) to the list of exported
419bindings of the current module.
420@end deffn
421
422@c begin (scm-doc-string "boot-9.scm" "define-public")
423@deffn syntax define-public @dots{}
424Equivalent to @code{(begin (define foo ...) (export foo))}.
425@end deffn
426@c end
427
cdf1ad3b
MV
428@node Module System Reflection
429@subsubsection Module System Reflection
430
431The previous sections have described a declarative view of the module
432system. You can also work with it programmatically by accessing and
433modifying various parts of the Scheme objects that Guile uses to
434implement the module system.
435
436At any time, there is a @dfn{current module}. This module is the one
437where a top-level @code{define} and similar syntax will add new
438bindings. You can find other module objects with @code{resolve-module},
439for example.
440
441These module objects can be used as the second argument to @code{eval}.
442
443@deffn {Scheme Procedure} current-module
444Return the current module object.
445@end deffn
446
447@deffn {Scheme Procedure} set-current-module module
448Set the current module to @var{module} and return
449the previous current module.
450@end deffn
451
452@deffn {Scheme Procedure} resolve-module name
453Find the module named @var{name} and return it. When it has not already
454been defined, try to auto-load it. When it can't be found that way
455either, create an empty module. The name is a list of symbols.
456@end deffn
457
458@deffn {Scheme Procedure} resolve-interface name
459Find the module named @var{name} as with @code{resolve-module} and
460return its interface. The interface of a module is also a module
461object, but it contains only the exported bindings.
462@end deffn
463
464@deffn {Scheme Procedure} module-use! module interface
465Add @var{interface} to the front of the use-list of @var{module}. Both
466arguments should be module objects, and @var{interface} should very
467likely be a module returned by @code{resolve-interface}.
468@end deffn
07d83abe
MV
469
470@node Module System Quirks
471@subsubsection Module System Quirks
472
473Although the programming interfaces are relatively stable, the Guile
474module system itself is still evolving. Here are some situations where
475usage surpasses design.
476
477@itemize @bullet
478
479@item
480When using a module which exports a macro definition, the other module
481must export all bindings the macro expansion uses, too, because the
482expanded code would otherwise not be able to see these definitions and
483issue a ``variable unbound'' error, or worse, would use another binding
484which might be present in the scope of the expansion.
485
486@item
487When two or more used modules export bindings with the same names, the
488last accessed module wins, and the exported binding of that last module
489will silently be used. This might lead to hard-to-find errors because
490wrong procedures or variables are used. To avoid this kind of
491@dfn{name-clash} situation, use a custom interface specification
492(@pxref{Using Guile Modules}). (We include this entry for the possible
493benefit of users of Guile versions previous to 1.5.0, when custom
494interfaces were added to the module system.)
495
496@item
497[Add other quirks here.]
498
499@end itemize
500
501
502@node Included Guile Modules
503@subsubsection Included Guile Modules
504
505@c FIXME::martin: Review me!
506
507Some modules are included in the Guile distribution; here are references
508to the entries in this manual which describe them in more detail:
509
510@table @strong
511@item boot-9
512boot-9 is Guile's initialization module, and it is always loaded when
513Guile starts up.
514
515@item (ice-9 debug)
516Mikael Djurfeldt's source-level debugging support for Guile
517(@pxref{Debugging Features}).
518
519@item (ice-9 threads)
520Guile's support for multi threaded execution (@pxref{Scheduling}).
521
522@item (ice-9 rdelim)
523Line- and character-delimited input (@pxref{Line/Delimited}).
524
525@item (ice-9 rw)
526Block string input/output (@pxref{Block Reading and Writing}).
527
528@item (ice-9 documentation)
529Online documentation (REFFIXME).
530
531@item (srfi srfi-1)
532A library providing a lot of useful list and pair processing
533procedures (@pxref{SRFI-1}).
534
535@item (srfi srfi-2)
536Support for @code{and-let*} (@pxref{SRFI-2}).
537
538@item (srfi srfi-4)
539Support for homogeneous numeric vectors (@pxref{SRFI-4}).
540
541@item (srfi srfi-6)
542Support for some additional string port procedures (@pxref{SRFI-6}).
543
544@item (srfi srfi-8)
545Multiple-value handling with @code{receive} (@pxref{SRFI-8}).
546
547@item (srfi srfi-9)
548Record definition with @code{define-record-type} (@pxref{SRFI-9}).
549
550@item (srfi srfi-10)
551Read hash extension @code{#,()} (@pxref{SRFI-10}).
552
553@item (srfi srfi-11)
554Multiple-value handling with @code{let-values} and @code{let-values*}
555(@pxref{SRFI-11}).
556
557@item (srfi srfi-13)
558String library (@pxref{SRFI-13}).
559
560@item (srfi srfi-14)
561Character-set library (@pxref{SRFI-14}).
562
563@item (srfi srfi-17)
564Getter-with-setter support (@pxref{SRFI-17}).
565
566@item (srfi srfi-26)
567Convenient syntax for partial application (@pxref{SRFI-26})
568
569@item (ice-9 slib)
570This module contains hooks for using Aubrey Jaffer's portable Scheme
571library SLIB from Guile (@pxref{SLIB}).
572
573@c FIXME::martin: This module is not in the distribution. Remove it
574@c from here?
575@item (ice-9 jacal)
576This module contains hooks for using Aubrey Jaffer's symbolic math
577package Jacal from Guile (@pxref{JACAL}).
578@end table
579
580
581@node Accessing Modules from C
582@subsubsection Accessing Modules from C
583
584The last sections have described how modules are used in Scheme code,
585which is the recommended way of creating and accessing modules. You
586can also work with modules from C, but it is more cumbersome.
587
588The following procedures are available.
589
590@deftypefn {C Procedure} SCM scm_current_module ()
591Return the module that is the @emph{current module}.
592@end deftypefn
593
594@deftypefn {C Procedure} SCM scm_set_current_module (SCM @var{module})
595Set the current module to @var{module} and return the previous current
596module.
597@end deftypefn
598
599@deftypefn {C Procedure} SCM scm_c_call_with_current_module (SCM @var{module}, SCM (*@var{func})(void *), void *@var{data})
600Call @var{func} and make @var{module} the current module during the
601call. The argument @var{data} is passed to @var{func}. The return
602value of @code{scm_c_call_with_current_module} is the return value of
603@var{func}.
604@end deftypefn
605
606@deftypefn {C Procedure} SCM scm_c_lookup (const char *@var{name})
607Return the variable bound to the symbol indicated by @var{name} in the
608current module. If there is no such binding or the symbol is not
609bound to a variable, signal an error.
610@end deftypefn
611
612@deftypefn {C Procedure} SCM scm_lookup (SCM @var{name})
613Like @code{scm_c_lookup}, but the symbol is specified directly.
614@end deftypefn
615
616@deftypefn {C Procedure} SCM scm_c_module_lookup (SCM @var{module}, const char *@var{name})
617@deftypefnx {C Procedure} SCM scm_module_lookup (SCM @var{module}, SCM @var{name})
618Like @code{scm_c_lookup} and @code{scm_lookup}, but the specified
619module is used instead of the current one.
620@end deftypefn
621
622@deftypefn {C Procedure} SCM scm_c_define (const char *@var{name}, SCM @var{val})
623Bind the symbol indicated by @var{name} to a variable in the current
624module and set that variable to @var{val}. When @var{name} is already
625bound to a variable, use that. Else create a new variable.
626@end deftypefn
627
628@deftypefn {C Procedure} SCM scm_define (SCM @var{name}, SCM @var{val})
629Like @code{scm_c_define}, but the symbol is specified directly.
630@end deftypefn
631
632@deftypefn {C Procedure} SCM scm_c_module_define (SCM @var{module}, const char *@var{name}, SCM @var{val})
633@deftypefnx {C Procedure} SCM scm_module_define (SCM @var{module}, SCM @var{name}, SCM @var{val})
634Like @code{scm_c_define} and @code{scm_define}, but the specified
635module is used instead of the current one.
636@end deftypefn
637
638@deftypefn {C Procedure} SCM scm_module_reverse_lookup (SCM @var{module}, SCM @var{variable})
639Find the symbol that is bound to @var{variable} in @var{module}. When no such binding is found, return @var{#f}.
640@end deftypefn
641
642@deftypefn {C Procedure} SCM scm_c_define_module (const char *@var{name}, void (*@var{init})(void *), void *@var{data})
643Define a new module named @var{name} and make it current while
644@var{init} is called, passing it @var{data}. Return the module.
645
646The parameter @var{name} is a string with the symbols that make up
647the module name, separated by spaces. For example, @samp{"foo bar"} names
648the module @samp{(foo bar)}.
649
650When there already exists a module named @var{name}, it is used
651unchanged, otherwise, an empty module is created.
652@end deftypefn
653
654@deftypefn {C Procedure} SCM scm_c_resolve_module (const char *@var{name})
655Find the module name @var{name} and return it. When it has not
656already been defined, try to auto-load it. When it can't be found
657that way either, create an empty module. The name is interpreted as
658for @code{scm_c_define_module}.
659@end deftypefn
660
661@deftypefn {C Procedure} SCM scm_resolve_module (SCM @var{name})
662Like @code{scm_c_resolve_module}, but the name is given as a real list
663of symbols.
664@end deftypefn
665
666@deftypefn {C Procedure} SCM scm_c_use_module (const char *@var{name})
667Add the module named @var{name} to the uses list of the current
668module, as with @code{(use-modules @var{name})}. The name is
669interpreted as for @code{scm_c_define_module}.
670@end deftypefn
671
672@deftypefn {C Procedure} SCM scm_c_export (const char *@var{name}, ...)
673Add the bindings designated by @var{name}, ... to the public interface
674of the current module. The list of names is terminated by
675@code{NULL}.
676@end deftypefn
677
678@node Dynamic Libraries
679@subsection Dynamic Libraries
680
681Most modern Unices have something called @dfn{shared libraries}. This
682ordinarily means that they have the capability to share the executable
683image of a library between several running programs to save memory and
684disk space. But generally, shared libraries give a lot of additional
685flexibility compared to the traditional static libraries. In fact,
686calling them `dynamic' libraries is as correct as calling them `shared'.
687
688Shared libraries really give you a lot of flexibility in addition to the
689memory and disk space savings. When you link a program against a shared
690library, that library is not closely incorporated into the final
691executable. Instead, the executable of your program only contains
692enough information to find the needed shared libraries when the program
693is actually run. Only then, when the program is starting, is the final
694step of the linking process performed. This means that you need not
695recompile all programs when you install a new, only slightly modified
696version of a shared library. The programs will pick up the changes
697automatically the next time they are run.
698
699Now, when all the necessary machinery is there to perform part of the
700linking at run-time, why not take the next step and allow the programmer
701to explicitly take advantage of it from within his program? Of course,
702many operating systems that support shared libraries do just that, and
703chances are that Guile will allow you to access this feature from within
704your Scheme programs. As you might have guessed already, this feature
705is called @dfn{dynamic linking}.@footnote{Some people also refer to the
706final linking stage at program startup as `dynamic linking', so if you
707want to make yourself perfectly clear, it is probably best to use the
708more technical term @dfn{dlopening}, as suggested by Gordon Matzigkeit
709in his libtool documentation.}
710
711As with many aspects of Guile, there is a low-level way to access the
712dynamic linking apparatus, and a more high-level interface that
713integrates dynamically linked libraries into the module system.
714
715@menu
716* Low level dynamic linking::
717* Compiled Code Modules::
718* Dynamic Linking and Compiled Code Modules::
719@end menu
720
721@node Low level dynamic linking
722@subsubsection Low level dynamic linking
723
724When using the low level procedures to do your dynamic linking, you have
725complete control over which library is loaded when and what gets done
726with it.
727
728@deffn {Scheme Procedure} dynamic-link library
729@deffnx {C Function} scm_dynamic_link (library)
730Find the shared library denoted by @var{library} (a string) and link it
731into the running Guile application. When everything works out, return a
732Scheme object suitable for representing the linked object file.
733Otherwise an error is thrown. How object files are searched is system
734dependent.
735
736Normally, @var{library} is just the name of some shared library file
737that will be searched for in the places where shared libraries usually
738reside, such as in @file{/usr/lib} and @file{/usr/local/lib}.
739@end deffn
740
741@deffn {Scheme Procedure} dynamic-object? obj
742@deffnx {C Function} scm_dynamic_object_p (obj)
743Return @code{#t} if @var{obj} is a dynamic library handle, or @code{#f}
744otherwise.
745@end deffn
746
747@deffn {Scheme Procedure} dynamic-unlink dobj
748@deffnx {C Function} scm_dynamic_unlink (dobj)
749Unlink the indicated object file from the application. The
750argument @var{dobj} must have been obtained by a call to
751@code{dynamic-link}. After @code{dynamic-unlink} has been
752called on @var{dobj}, its content is no longer accessible.
753@end deffn
754
755@deffn {Scheme Procedure} dynamic-func name dobj
756@deffnx {C Function} scm_dynamic_func (name, dobj)
757Search the dynamic object @var{dobj} for the C function
758indicated by the string @var{name} and return some Scheme
759handle that can later be used with @code{dynamic-call} to
760actually call the function.
761
762Regardless whether your C compiler prepends an underscore @samp{_} to
763the global names in a program, you should @strong{not} include this
764underscore in @var{function}. Guile knows whether the underscore is
765needed or not and will add it when necessary.
766@end deffn
767
768@deffn {Scheme Procedure} dynamic-call func dobj
769@deffnx {C Function} scm_dynamic_call (func, dobj)
770Call the C function indicated by @var{func} and @var{dobj}.
771The function is passed no arguments and its return value is
772ignored. When @var{function} is something returned by
773@code{dynamic-func}, call that function and ignore @var{dobj}.
774When @var{func} is a string , look it up in @var{dynobj}; this
775is equivalent to
776@smallexample
777(dynamic-call (dynamic-func @var{func} @var{dobj}) #f)
778@end smallexample
779
780Interrupts are deferred while the C function is executing (with
781@code{SCM_DEFER_INTS}/@code{SCM_ALLOW_INTS}).
782@end deffn
783
784@deffn {Scheme Procedure} dynamic-args-call func dobj args
785@deffnx {C Function} scm_dynamic_args_call (func, dobj, args)
786Call the C function indicated by @var{func} and @var{dobj},
787just like @code{dynamic-call}, but pass it some arguments and
788return its return value. The C function is expected to take
789two arguments and return an @code{int}, just like @code{main}:
790@smallexample
791int c_func (int argc, char **argv);
792@end smallexample
793
794The parameter @var{args} must be a list of strings and is
795converted into an array of @code{char *}. The array is passed
796in @var{argv} and its size in @var{argc}. The return value is
797converted to a Scheme number and returned from the call to
798@code{dynamic-args-call}.
799@end deffn
800
801When dynamic linking is disabled or not supported on your system,
802the above functions throw errors, but they are still available.
803
804Here is a small example that works on GNU/Linux:
805
806@smallexample
807(define libc-obj (dynamic-link "libc.so"))
808libc-obj
809@result{} #<dynamic-object "libc.so">
810(dynamic-args-call 'rand libc-obj '())
811@result{} 269167349
812(dynamic-unlink libc-obj)
813libc-obj
814@result{} #<dynamic-object "libc.so" (unlinked)>
815@end smallexample
816
817As you can see, after calling @code{dynamic-unlink} on a dynamically
818linked library, it is marked as @samp{(unlinked)} and you are no longer
819able to use it with @code{dynamic-call}, etc. Whether the library is
820really removed from you program is system-dependent and will generally
821not happen when some other parts of your program still use it. In the
822example above, @code{libc} is almost certainly not removed from your
823program because it is badly needed by almost everything.
824
825The functions to call a function from a dynamically linked library,
826@code{dynamic-call} and @code{dynamic-args-call}, are not very powerful.
827They are mostly intended to be used for calling specially written
828initialization functions that will then add new primitives to Guile.
829For example, we do not expect that you will dynamically link
830@file{libX11} with @code{dynamic-link} and then construct a beautiful
831graphical user interface just by using @code{dynamic-call} and
832@code{dynamic-args-call}. Instead, the usual way would be to write a
833special Guile<->X11 glue library that has intimate knowledge about both
834Guile and X11 and does whatever is necessary to make them inter-operate
835smoothly. This glue library could then be dynamically linked into a
836vanilla Guile interpreter and activated by calling its initialization
837function. That function would add all the new types and primitives to
838the Guile interpreter that it has to offer.
839
840From this setup the next logical step is to integrate these glue
841libraries into the module system of Guile so that you can load new
842primitives into a running system just as you can load new Scheme code.
843
844There is, however, another possibility to get a more thorough access to
845the functions contained in a dynamically linked library. Anthony Green
846has written @file{libffi}, a library that implements a @dfn{foreign
847function interface} for a number of different platforms. With it, you
848can extend the Spartan functionality of @code{dynamic-call} and
849@code{dynamic-args-call} considerably. There is glue code available in
850the Guile contrib archive to make @file{libffi} accessible from Guile.
851
852@node Compiled Code Modules
853@subsubsection Putting Compiled Code into Modules
854
855The new primitives that you add to Guile with
856@code{scm_c_define_gsubr} (@pxref{Primitive Procedures}) or with any
857of the other mechanisms are placed into the @code{(guile-user)} module
858by default. However, it is also possible to put new primitives into
859other modules.
860
861The mechanism for doing so is not very well thought out and is likely to
862change when the module system of Guile itself is revised, but it is
863simple and useful enough to document it as it stands.
864
865What @code{scm_c_define_gsubr} and the functions used by the snarfer
866really do is to add the new primitives to whatever module is the
867@emph{current module} when they are called. This is analogous to the
868way Scheme code is put into modules: the @code{define-module} expression
869at the top of a Scheme source file creates a new module and makes it the
870current module while the rest of the file is evaluated. The
871@code{define} expressions in that file then add their new definitions to
872this current module.
873
874Therefore, all we need to do is to make sure that the right module is
875current when calling @code{scm_c_define_gsubr} for our new primitives.
876
877@node Dynamic Linking and Compiled Code Modules
878@subsubsection Dynamic Linking and Compiled Code Modules
879
880The most interesting application of dynamically linked libraries is
881probably to use them for providing @emph{compiled code modules} to
882Scheme programs. As much fun as programming in Scheme is, every now and
883then comes the need to write some low-level C stuff to make Scheme even
884more fun.
885
886Not only can you put these new primitives into their own module (see the
887previous section), you can even put them into a shared library that is
888only then linked to your running Guile image when it is actually
889needed.
890
891An example will hopefully make everything clear. Suppose we want to
892make the Bessel functions of the C library available to Scheme in the
893module @samp{(math bessel)}. First we need to write the appropriate
894glue code to convert the arguments and return values of the functions
895from Scheme to C and back. Additionally, we need a function that will
896add them to the set of Guile primitives. Because this is just an
897example, we will only implement this for the @code{j0} function.
898
899@c FIXME::martin: Change all gh_ references to their scm_ equivalents.
900
901@smallexample
902#include <math.h>
903#include <libguile.h>
904
905SCM
906j0_wrapper (SCM x)
907@{
908 return scm_double2num (j0 (scm_num2dbl (x, "j0")));
909@}
910
911void
912init_math_bessel ()
913@{
914 scm_c_define_gsubr ("j0", 1, 0, 0, j0_wrapper);
915@}
916@end smallexample
917
918We can already try to bring this into action by manually calling the low
919level functions for performing dynamic linking. The C source file needs
920to be compiled into a shared library. Here is how to do it on
921GNU/Linux, please refer to the @code{libtool} documentation for how to
922create dynamically linkable libraries portably.
923
924@smallexample
925gcc -shared -o libbessel.so -fPIC bessel.c
926@end smallexample
927
928Now fire up Guile:
929
930@smalllisp
931(define bessel-lib (dynamic-link "./libbessel.so"))
932(dynamic-call "init_math_bessel" bessel-lib)
933(j0 2)
934@result{} 0.223890779141236
935@end smalllisp
936
937The filename @file{./libbessel.so} should be pointing to the shared
938library produced with the @code{gcc} command above, of course. The
939second line of the Guile interaction will call the
940@code{init_math_bessel} function which in turn will register the C
941function @code{j0_wrapper} with the Guile interpreter under the name
942@code{j0}. This function becomes immediately available and we can call
943it from Scheme.
944
945Fun, isn't it? But we are only half way there. This is what
946@code{apropos} has to say about @code{j0}:
947
948@smallexample
949(apropos "j0")
950@print{} (guile-user): j0 #<primitive-procedure j0>
951@end smallexample
952
953As you can see, @code{j0} is contained in the root module, where all
954the other Guile primitives like @code{display}, etc live. In general,
955a primitive is put into whatever module is the @dfn{current module} at
956the time @code{scm_c_define_gsubr} is called.
957
958A compiled module should have a specially named @dfn{module init
959function}. Guile knows about this special name and will call that
960function automatically after having linked in the shared library. For
961our example, we replace @code{init_math_bessel} with the following code in
962@file{bessel.c}:
963
964@smallexample
965void
966init_math_bessel (void *unused)
967@{
968 scm_c_define_gsubr ("j0", 1, 0, 0, j0_wrapper);
969 scm_c_export ("j0", NULL);
970@}
971
972void
973scm_init_math_bessel_module ()
974@{
975 scm_c_define_module ("math bessel", init_math_bessel, NULL);
976@}
977@end smallexample
978
979The general pattern for the name of a module init function is:
980@samp{scm_init_}, followed by the name of the module where the
981individual hierarchical components are concatenated with underscores,
982followed by @samp{_module}.
983
984After @file{libbessel.so} has been rebuilt, we need to place the shared
985library into the right place.
986
987Once the module has been correctly installed, it should be possible to
988use it like this:
989
990@smallexample
991guile> (load-extension "./libbessel.so" "scm_init_math_bessel_module")
992guile> (use-modules (math bessel))
993guile> (j0 2)
9940.223890779141236
995guile> (apropos "j0")
996@print{} (math bessel): j0 #<primitive-procedure j0>
997@end smallexample
998
999That's it!
1000
cdf1ad3b
MV
1001@deffn {Scheme Procedure} load-extension lib init
1002@deffnx {C Function} scm_load_extension (lib, init)
1003Load and initialize the extension designated by LIB and INIT.
1004When there is no pre-registered function for LIB/INIT, this is
1005equivalent to
1006
1007@lisp
1008(dynamic-call INIT (dynamic-link LIB))
1009@end lisp
1010
1011When there is a pre-registered function, that function is called
1012instead.
1013
1014Normally, there is no pre-registered function. This option exists
1015only for situations where dynamic linking is unavailable or unwanted.
1016In that case, you would statically link your program with the desired
1017library, and register its init function right after Guile has been
1018initialized.
1019
1020LIB should be a string denoting a shared library without any file type
1021suffix such as ".so". The suffix is provided automatically. It
1022should also not contain any directory components. Libraries that
1023implement Guile Extensions should be put into the normal locations for
1024shared libraries. We recommend to use the naming convention
1025libguile-bla-blum for a extension related to a module `(bla blum)'.
1026
1027The normal way for a extension to be used is to write a small Scheme
1028file that defines a module, and to load the extension into this
1029module. When the module is auto-loaded, the extension is loaded as
1030well. For example,
1031
1032@lisp
1033(define-module (bla blum))
1034
1035(load-extension "libguile-bla-blum" "bla_init_blum")
1036@end lisp
1037@end deffn
1038
07d83abe
MV
1039@node Variables
1040@subsection Variables
1041@tpindex Variables
1042
1043Each module has its own hash table, sometimes known as an @dfn{obarray},
1044that maps the names defined in that module to their corresponding
1045variable objects.
1046
1047A variable is a box-like object that can hold any Scheme value. It is
1048said to be @dfn{undefined} if its box holds a special Scheme value that
1049denotes undefined-ness (which is different from all other Scheme values,
1050including for example @code{#f}); otherwise the variable is
1051@dfn{defined}.
1052
1053On its own, a variable object is anonymous. A variable is said to be
1054@dfn{bound} when it is associated with a name in some way, usually a
1055symbol in a module obarray. When this happens, the relationship is
1056mutual: the variable is bound to the name (in that module), and the name
1057(in that module) is bound to the variable.
1058
1059(That's the theory, anyway. In practice, defined-ness and bound-ness
1060sometimes get confused, because Lisp and Scheme implementations have
1061often conflated --- or deliberately drawn no distinction between --- a
1062name that is unbound and a name that is bound to a variable whose value
1063is undefined. We will try to be clear about the difference and explain
1064any confusion where it is unavoidable.)
1065
1066Variables do not have a read syntax. Most commonly they are created and
1067bound implicitly by @code{define} expressions: a top-level @code{define}
1068expression of the form
1069
1070@lisp
1071(define @var{name} @var{value})
1072@end lisp
1073
1074@noindent
1075creates a variable with initial value @var{value} and binds it to the
1076name @var{name} in the current module. But they can also be created
1077dynamically by calling one of the constructor procedures
1078@code{make-variable} and @code{make-undefined-variable}.
1079
1080First-class variables are especially useful for interacting with the
1081current module system (@pxref{The Guile module system}).
1082
1083@deffn {Scheme Procedure} make-undefined-variable
1084@deffnx {C Function} scm_make_undefined_variable ()
1085Return a variable that is initially unbound.
1086@end deffn
1087
1088@deffn {Scheme Procedure} make-variable init
1089@deffnx {C Function} scm_make_variable (init)
1090Return a variable initialized to value @var{init}.
1091@end deffn
1092
1093@deffn {Scheme Procedure} variable-bound? var
1094@deffnx {C Function} scm_variable_bound_p (var)
1095Return @code{#t} iff @var{var} is bound to a value.
1096Throws an error if @var{var} is not a variable object.
1097@end deffn
1098
1099@deffn {Scheme Procedure} variable-ref var
1100@deffnx {C Function} scm_variable_ref (var)
1101Dereference @var{var} and return its value.
1102@var{var} must be a variable object; see @code{make-variable}
1103and @code{make-undefined-variable}.
1104@end deffn
1105
1106@deffn {Scheme Procedure} variable-set! var val
1107@deffnx {C Function} scm_variable_set_x (var, val)
1108Set the value of the variable @var{var} to @var{val}.
1109@var{var} must be a variable object, @var{val} can be any
1110value. Return an unspecified value.
1111@end deffn
1112
1113@deffn {Scheme Procedure} variable? obj
1114@deffnx {C Function} scm_variable_p (obj)
1115Return @code{#t} iff @var{obj} is a variable object, else
1116return @code{#f}.
1117@end deffn
1118
1119
1120@c Local Variables:
1121@c TeX-master: "guile.texi"
1122@c End: