Some doc updates for default process sentinels and filters not being nil
[bpt/emacs.git] / doc / lispref / internals.texi
CommitLineData
b8d4c8d0
GM
1@c -*-texinfo-*-
2@c This is part of the GNU Emacs Lisp Reference Manual.
ba318903 3@c Copyright (C) 1990-1993, 1998-1999, 2001-2014 Free Software
ab422c4d 4@c Foundation, Inc.
b8d4c8d0 5@c See the file elisp.texi for copying conditions.
ecc6530d 6@node GNU Emacs Internals
b8d4c8d0
GM
7@appendix GNU Emacs Internals
8
9This chapter describes how the runnable Emacs executable is dumped with
10the preloaded Lisp libraries in it, how storage is allocated, and some
11internal aspects of GNU Emacs that may be of interest to C programmers.
12
13@menu
14* Building Emacs:: How the dumped Emacs is made.
333f9019 15* Pure Storage:: Kludge to make preloaded Lisp functions shareable.
b8d4c8d0
GM
16* Garbage Collection:: Reclaiming space for Lisp objects no longer used.
17* Memory Usage:: Info about total size of Lisp objects made so far.
18* Writing Emacs Primitives:: Writing C code for Emacs.
19* Object Internals:: Data formats of buffers, windows, processes.
d92d9c95 20* C Integer Types:: How C integer types are used inside Emacs.
b8d4c8d0
GM
21@end menu
22
23@node Building Emacs
520f2425 24@section Building Emacs
b8d4c8d0
GM
25@cindex building Emacs
26@pindex temacs
27
28 This section explains the steps involved in building the Emacs
29executable. You don't have to know this material to build and install
30Emacs, since the makefiles do all these things automatically. This
d15aac68 31information is pertinent to Emacs developers.
b8d4c8d0
GM
32
33 Compilation of the C source files in the @file{src} directory
34produces an executable file called @file{temacs}, also called a
d15aac68
CY
35@dfn{bare impure Emacs}. It contains the Emacs Lisp interpreter and
36I/O routines, but not the editing commands.
b8d4c8d0
GM
37
38@cindex @file{loadup.el}
d15aac68
CY
39 The command @w{@command{temacs -l loadup}} would run @file{temacs}
40and direct it to load @file{loadup.el}. The @code{loadup} library
41loads additional Lisp libraries, which set up the normal Emacs editing
42environment. After this step, the Emacs executable is no longer
43@dfn{bare}.
b8d4c8d0
GM
44
45@cindex dumping Emacs
d15aac68
CY
46 Because it takes some time to load the standard Lisp files, the
47@file{temacs} executable usually isn't run directly by users.
48Instead, as one of the last steps of building Emacs, the command
49@samp{temacs -batch -l loadup dump} is run. The special @samp{dump}
50argument causes @command{temacs} to dump out an executable program,
51called @file{emacs}, which has all the standard Lisp files preloaded.
52(The @samp{-batch} argument prevents @file{temacs} from trying to
53initialize any of its data on the terminal, so that the tables of
54terminal information are empty in the dumped Emacs.)
55
56@cindex preloaded Lisp files
b578c9cc 57@vindex preloaded-file-list
d15aac68
CY
58 The dumped @file{emacs} executable (also called a @dfn{pure} Emacs)
59is the one which is installed. The variable
60@code{preloaded-file-list} stores a list of the Lisp files preloaded
61into the dumped Emacs. If you port Emacs to a new operating system,
62and are not able to implement dumping, then Emacs must load
63@file{loadup.el} each time it starts.
b8d4c8d0
GM
64
65@cindex @file{site-load.el}
b8d4c8d0 66 You can specify additional files to preload by writing a library named
520f2425
GM
67@file{site-load.el} that loads them. You may need to rebuild Emacs
68with an added definition
b8d4c8d0
GM
69
70@example
71#define SITELOAD_PURESIZE_EXTRA @var{n}
72@end example
73
74@noindent
520f2425
GM
75to make @var{n} added bytes of pure space to hold the additional files;
76see @file{src/puresize.h}.
b8d4c8d0
GM
77(Try adding increments of 20000 until it is big enough.) However, the
78advantage of preloading additional files decreases as machines get
79faster. On modern machines, it is usually not advisable.
80
81 After @file{loadup.el} reads @file{site-load.el}, it finds the
82documentation strings for primitive and preloaded functions (and
83variables) in the file @file{etc/DOC} where they are stored, by
84calling @code{Snarf-documentation} (@pxref{Definition of
85Snarf-documentation,, Accessing Documentation}).
86
87@cindex @file{site-init.el}
88@cindex preloading additional functions and variables
89 You can specify other Lisp expressions to execute just before dumping
90by putting them in a library named @file{site-init.el}. This file is
91executed after the documentation strings are found.
92
93 If you want to preload function or variable definitions, there are
94three ways you can do this and make their documentation strings
95accessible when you subsequently run Emacs:
96
97@itemize @bullet
98@item
99Arrange to scan these files when producing the @file{etc/DOC} file,
100and load them with @file{site-load.el}.
101
102@item
103Load the files with @file{site-init.el}, then copy the files into the
104installation directory for Lisp files when you install Emacs.
105
106@item
5906db45
GM
107Specify a @code{nil} value for @code{byte-compile-dynamic-docstrings}
108as a local variable in each of these files, and load them with either
109@file{site-load.el} or @file{site-init.el}. (This method has the
110drawback that the documentation strings take up space in Emacs all the
111time.)
b8d4c8d0
GM
112@end itemize
113
114 It is not advisable to put anything in @file{site-load.el} or
115@file{site-init.el} that would alter any of the features that users
116expect in an ordinary unmodified Emacs. If you feel you must override
117normal features for your site, do it with @file{default.el}, so that
118users can override your changes if they wish. @xref{Startup Summary}.
06a4f110
GM
119Note that if either @file{site-load.el} or @file{site-init.el} changes
120@code{load-path}, the changes will be lost after dumping.
121@xref{Library Search}. To make a permanent change to
122@code{load-path}, use the @option{--enable-locallisppath} option
123of @command{configure}.
b8d4c8d0 124
520f2425
GM
125 In a package that can be preloaded, it is sometimes necessary (or
126useful) to delay certain evaluations until Emacs subsequently starts
127up. The vast majority of such cases relate to the values of
128customizable variables. For example, @code{tutorial-directory} is a
129variable defined in @file{startup.el}, which is preloaded. The default
130value is set based on @code{data-directory}. The variable needs to
131access the value of @code{data-directory} when Emacs starts, not when
132it is dumped, because the Emacs executable has probably been installed
133in a different location since it was dumped.
134
135@defun custom-initialize-delay symbol value
136This function delays the initialization of @var{symbol} to the next
137Emacs start. You normally use this function by specifying it as the
138@code{:initialize} property of a customizable variable. (The argument
f003f294 139@var{value} is unused, and is provided only for compatibility with the
520f2425
GM
140form Custom expects.)
141@end defun
b8d4c8d0 142
520f2425
GM
143In the unlikely event that you need a more general functionality than
144@code{custom-initialize-delay} provides, you can use
145@code{before-init-hook} (@pxref{Startup Summary}).
b8d4c8d0
GM
146
147@defun dump-emacs to-file from-file
148@cindex unexec
149This function dumps the current state of Emacs into an executable file
150@var{to-file}. It takes symbols from @var{from-file} (this is normally
151the executable file @file{temacs}).
152
153If you want to use this function in an Emacs that was already dumped,
154you must run Emacs with @samp{-batch}.
155@end defun
156
157@node Pure Storage
520f2425 158@section Pure Storage
b8d4c8d0
GM
159@cindex pure storage
160
161 Emacs Lisp uses two kinds of storage for user-created Lisp objects:
162@dfn{normal storage} and @dfn{pure storage}. Normal storage is where
999dd333
GM
163all the new data created during an Emacs session are kept
164(@pxref{Garbage Collection}). Pure storage is used for certain data
165in the preloaded standard Lisp files---data that should never change
166during actual use of Emacs.
b8d4c8d0 167
d15aac68 168 Pure storage is allocated only while @command{temacs} is loading the
b8d4c8d0
GM
169standard preloaded Lisp libraries. In the file @file{emacs}, it is
170marked as read-only (on operating systems that permit this), so that
171the memory space can be shared by all the Emacs jobs running on the
172machine at once. Pure storage is not expandable; a fixed amount is
173allocated when Emacs is compiled, and if that is not sufficient for
174the preloaded libraries, @file{temacs} allocates dynamic memory for
999dd333
GM
175the part that didn't fit. The resulting image will work, but garbage
176collection (@pxref{Garbage Collection}) is disabled in this situation,
177causing a memory leak. Such an overflow normally won't happen unless
178you try to preload additional libraries or add features to the
179standard ones. Emacs will display a warning about the overflow when
180it starts. If this happens, you should increase the compilation
181parameter @code{SYSTEM_PURESIZE_EXTRA} in the file
182@file{src/puresize.h} and rebuild Emacs.
b8d4c8d0
GM
183
184@defun purecopy object
185This function makes a copy in pure storage of @var{object}, and returns
186it. It copies a string by simply making a new string with the same
187characters, but without text properties, in pure storage. It
188recursively copies the contents of vectors and cons cells. It does
189not make copies of other objects such as symbols, but just returns
190them unchanged. It signals an error if asked to copy markers.
191
192This function is a no-op except while Emacs is being built and dumped;
999dd333 193it is usually called only in preloaded Lisp files.
b8d4c8d0
GM
194@end defun
195
196@defvar pure-bytes-used
197The value of this variable is the number of bytes of pure storage
198allocated so far. Typically, in a dumped Emacs, this number is very
199close to the total amount of pure storage available---if it were not,
200we would preallocate less.
201@end defvar
202
203@defvar purify-flag
204This variable determines whether @code{defun} should make a copy of the
205function definition in pure storage. If it is non-@code{nil}, then the
206function definition is copied into pure storage.
207
208This flag is @code{t} while loading all of the basic functions for
333f9019 209building Emacs initially (allowing those functions to be shareable and
b8d4c8d0
GM
210non-collectible). Dumping Emacs as an executable always writes
211@code{nil} in this variable, regardless of the value it actually has
212before and after dumping.
213
214You should not change this flag in a running Emacs.
215@end defvar
216
217@node Garbage Collection
520f2425 218@section Garbage Collection
b8d4c8d0
GM
219
220@cindex memory allocation
d15aac68
CY
221 When a program creates a list or the user defines a new function
222(such as by loading a library), that data is placed in normal storage.
223If normal storage runs low, then Emacs asks the operating system to
224allocate more memory. Different types of Lisp objects, such as
f3372c87
DA
225symbols, cons cells, small vectors, markers, etc., are segregated in
226distinct blocks in memory. (Large vectors, long strings, buffers and
227certain other editing types, which are fairly large, are allocated in
228individual blocks, one per object; small strings are packed into blocks
229of 8k bytes, and small vectors are packed into blocks of 4k bytes).
230
231@cindex vector-like objects, storage
232@cindex storage of vector-like Lisp objects
233 Beyond the basic vector, a lot of objects like window, buffer, and
234frame are managed as if they were vectors. The corresponding C data
235structures include the @code{struct vectorlike_header} field whose
74934dcc
DA
236@code{size} member contains the subtype enumerated by @code{enum pvec_type}
237and an information about how many @code{Lisp_Object} fields this structure
238contains and what the size of the rest data is. This information is
239needed to calculate the memory footprint of an object, and used
240by the vector allocation code while iterating over the vector blocks.
b8d4c8d0 241
d15aac68
CY
242@cindex garbage collection
243 It is quite common to use some storage for a while, then release it
244by (for example) killing a buffer or deleting the last pointer to an
245object. Emacs provides a @dfn{garbage collector} to reclaim this
246abandoned storage. The garbage collector operates by finding and
247marking all Lisp objects that are still accessible to Lisp programs.
248To begin with, it assumes all the symbols, their values and associated
249function definitions, and any data presently on the stack, are
250accessible. Any objects that can be reached indirectly through other
251accessible objects are also accessible.
b8d4c8d0
GM
252
253 When marking is finished, all objects still unmarked are garbage. No
254matter what the Lisp program or the user does, it is impossible to refer
255to them, since there is no longer a way to reach them. Their space
256might as well be reused, since no one will miss them. The second
257(``sweep'') phase of the garbage collector arranges to reuse them.
258
259@c ??? Maybe add something describing weak hash tables here?
260
261@cindex free list
262 The sweep phase puts unused cons cells onto a @dfn{free list}
263for future allocation; likewise for symbols and markers. It compacts
264the accessible strings so they occupy fewer 8k blocks; then it frees the
f3372c87
DA
265other 8k blocks. Unreachable vectors from vector blocks are coalesced
266to create largest possible free areas; if a free area spans a complete
2674k block, that block is freed. Otherwise, the free area is recorded
268in a free list array, where each entry corresponds to a free list
269of areas of the same size. Large vectors, buffers, and other large
270objects are allocated and freed individually.
b8d4c8d0
GM
271
272@cindex CL note---allocate more storage
273@quotation
274@b{Common Lisp note:} Unlike other Lisps, GNU Emacs Lisp does not
275call the garbage collector when the free list is empty. Instead, it
276simply requests the operating system to allocate more storage, and
277processing continues until @code{gc-cons-threshold} bytes have been
278used.
279
280This means that you can make sure that the garbage collector will not
281run during a certain portion of a Lisp program by calling the garbage
282collector explicitly just before it (provided that portion of the
283program does not use so much space as to force a second garbage
284collection).
285@end quotation
286
287@deffn Command garbage-collect
288This command runs a garbage collection, and returns information on
289the amount of space in use. (Garbage collection can also occur
290spontaneously if you use more than @code{gc-cons-threshold} bytes of
291Lisp data since the previous garbage collection.)
292
74934dcc
DA
293@code{garbage-collect} returns a list with information on amount of space in
294use, where each entry has the form @samp{(@var{name} @var{size} @var{used})}
295or @samp{(@var{name} @var{size} @var{used} @var{free})}. In the entry,
296@var{name} is a symbol describing the kind of objects this entry represents,
297@var{size} is the number of bytes used by each one, @var{used} is the number
298of those objects that were found live in the heap, and optional @var{free} is
299the number of those objects that are not live but that Emacs keeps around for
300future allocations. So an overall result is:
b8d4c8d0
GM
301
302@example
f24f2e22 303((@code{conses} @var{cons-size} @var{used-conses} @var{free-conses})
74934dcc
DA
304 (@code{symbols} @var{symbol-size} @var{used-symbols} @var{free-symbols})
305 (@code{miscs} @var{misc-size} @var{used-miscs} @var{free-miscs})
306 (@code{strings} @var{string-size} @var{used-strings} @var{free-strings})
307 (@code{string-bytes} @var{byte-size} @var{used-bytes})
308 (@code{vectors} @var{vector-size} @var{used-vectors})
309 (@code{vector-slots} @var{slot-size} @var{used-slots} @var{free-slots})
310 (@code{floats} @var{float-size} @var{used-floats} @var{free-floats})
311 (@code{intervals} @var{interval-size} @var{used-intervals} @var{free-intervals})
312 (@code{buffers} @var{buffer-size} @var{used-buffers})
313 (@code{heap} @var{unit-size} @var{total-size} @var{free-size}))
b8d4c8d0
GM
314@end example
315
316Here is an example:
317
318@example
b8d4c8d0 319(garbage-collect)
74934dcc
DA
320 @result{} ((conses 16 49126 8058) (symbols 48 14607 0)
321 (miscs 40 34 56) (strings 32 2942 2607)
322 (string-bytes 1 78607) (vectors 16 7247)
323 (vector-slots 8 341609 29474) (floats 8 71 102)
324 (intervals 56 27 26) (buffers 944 8)
325 (heap 1024 11715 2678))
b8d4c8d0
GM
326@end example
327
74934dcc
DA
328Below is a table explaining each element. Note that last @code{heap} entry
329is optional and present only if an underlying @code{malloc} implementation
330provides @code{mallinfo} function.
b8d4c8d0
GM
331
332@table @var
74934dcc 333@item cons-size
39670ef4 334Internal size of a cons cell, i.e., @code{sizeof (struct Lisp_Cons)}.
74934dcc 335
b8d4c8d0
GM
336@item used-conses
337The number of cons cells in use.
338
339@item free-conses
74934dcc
DA
340The number of cons cells for which space has been obtained from
341the operating system, but that are not currently being used.
b8d4c8d0 342
74934dcc 343@item symbol-size
39670ef4 344Internal size of a symbol, i.e., @code{sizeof (struct Lisp_Symbol)}.
74934dcc
DA
345
346@item used-symbols
b8d4c8d0
GM
347The number of symbols in use.
348
74934dcc
DA
349@item free-symbols
350The number of symbols for which space has been obtained from
351the operating system, but that are not currently being used.
352
353@item misc-size
39670ef4 354Internal size of a miscellaneous entity, i.e.,
74934dcc
DA
355@code{sizeof (union Lisp_Misc)}, which is a size of the
356largest type enumerated in @code{enum Lisp_Misc_Type}.
b8d4c8d0
GM
357
358@item used-miscs
74934dcc
DA
359The number of miscellaneous objects in use. These include markers
360and overlays, plus certain objects not visible to users.
b8d4c8d0
GM
361
362@item free-miscs
363The number of miscellaneous objects for which space has been obtained
364from the operating system, but that are not currently being used.
365
74934dcc 366@item string-size
39670ef4 367Internal size of a string header, i.e., @code{sizeof (struct Lisp_String)}.
74934dcc
DA
368
369@item used-strings
370The number of string headers in use.
371
372@item free-strings
373The number of string headers for which space has been obtained
374from the operating system, but that are not currently being used.
375
376@item byte-size
377This is used for convenience and equals to @code{sizeof (char)}.
378
379@item used-bytes
380The total size of all string data in bytes.
381
382@item vector-size
39670ef4 383Internal size of a vector header, i.e., @code{sizeof (struct Lisp_Vector)}.
74934dcc
DA
384
385@item used-vectors
386The number of vector headers allocated from the vector blocks.
387
388@item slot-size
389Internal size of a vector slot, always equal to @code{sizeof (Lisp_Object)}.
390
391@item used-slots
392The number of slots in all used vectors.
393
394@item free-slots
395The number of free slots in all vector blocks.
b8d4c8d0 396
74934dcc 397@item float-size
39670ef4 398Internal size of a float object, i.e., @code{sizeof (struct Lisp_Float)}.
74934dcc 399(Do not confuse it with the native platform @code{float} or @code{double}.)
b8d4c8d0
GM
400
401@item used-floats
b8d4c8d0
GM
402The number of floats in use.
403
404@item free-floats
74934dcc
DA
405The number of floats for which space has been obtained from
406the operating system, but that are not currently being used.
407
408@item interval-size
39670ef4 409Internal size of an interval object, i.e., @code{sizeof (struct interval)}.
b8d4c8d0
GM
410
411@item used-intervals
74934dcc 412The number of intervals in use.
b8d4c8d0
GM
413
414@item free-intervals
74934dcc
DA
415The number of intervals for which space has been obtained from
416the operating system, but that are not currently being used.
b8d4c8d0 417
74934dcc 418@item buffer-size
39670ef4 419Internal size of a buffer, i.e., @code{sizeof (struct buffer)}.
74934dcc 420(Do not confuse with the value returned by @code{buffer-size} function.)
b8d4c8d0 421
74934dcc
DA
422@item used-buffers
423The number of buffer objects in use. This includes killed buffers
39670ef4 424invisible to users, i.e., all buffers in @code{all_buffers} list.
74934dcc
DA
425
426@item unit-size
427The unit of heap space measurement, always equal to 1024 bytes.
428
429@item total-size
430Total heap size, in @var{unit-size} units.
431
432@item free-size
433Heap space which is not currently used, in @var{unit-size} units.
b8d4c8d0
GM
434@end table
435
999dd333 436If there was overflow in pure space (@pxref{Pure Storage}),
b8d4c8d0 437@code{garbage-collect} returns @code{nil}, because a real garbage
9658dc2a 438collection cannot be done.
b8d4c8d0
GM
439@end deffn
440
441@defopt garbage-collection-messages
442If this variable is non-@code{nil}, Emacs displays a message at the
443beginning and end of garbage collection. The default value is
999dd333 444@code{nil}.
b8d4c8d0
GM
445@end defopt
446
447@defvar post-gc-hook
448This is a normal hook that is run at the end of garbage collection.
449Garbage collection is inhibited while the hook functions run, so be
450careful writing them.
451@end defvar
452
453@defopt gc-cons-threshold
454The value of this variable is the number of bytes of storage that must
455be allocated for Lisp objects after one garbage collection in order to
74934dcc
DA
456trigger another garbage collection. You can use the result returned by
457@code{garbage-collect} to get an information about size of the particular
458object type; space allocated to the contents of buffers does not count.
459Note that the subsequent garbage collection does not happen immediately
460when the threshold is exhausted, but only the next time the Lisp interpreter
461is called.
462
463The initial threshold value is @code{GC_DEFAULT_THRESHOLD}, defined in
464@file{alloc.c}. Since it's defined in @code{word_size} units, the value
465is 400,000 for the default 32-bit configuration and 800,000 for the 64-bit
466one. If you specify a larger value, garbage collection will happen less
467often. This reduces the amount of time spent garbage collecting, but
468increases total memory use. You may want to do this when running a program
469that creates lots of Lisp data.
470
471You can make collections more frequent by specifying a smaller value, down
472to 1/10th of @code{GC_DEFAULT_THRESHOLD}. A value less than this minimum
473will remain in effect only until the subsequent garbage collection, at which
474time @code{garbage-collect} will set the threshold back to the minimum.
b8d4c8d0
GM
475@end defopt
476
477@defopt gc-cons-percentage
478The value of this variable specifies the amount of consing before a
479garbage collection occurs, as a fraction of the current heap size.
480This criterion and @code{gc-cons-threshold} apply in parallel, and
481garbage collection occurs only when both criteria are satisfied.
482
483As the heap size increases, the time to perform a garbage collection
484increases. Thus, it can be desirable to do them less frequently in
485proportion.
486@end defopt
487
488 The value returned by @code{garbage-collect} describes the amount of
489memory used by Lisp data, broken down by data type. By contrast, the
490function @code{memory-limit} provides information on the total amount of
491memory Emacs is currently using.
492
b8d4c8d0
GM
493@defun memory-limit
494This function returns the address of the last byte Emacs has allocated,
495divided by 1024. We divide the value by 1024 to make sure it fits in a
496Lisp integer.
497
498You can use this to get a general idea of how your actions affect the
499memory usage.
500@end defun
501
502@defvar memory-full
d15aac68 503This variable is @code{t} if Emacs is nearly out of memory for Lisp
b8d4c8d0
GM
504objects, and @code{nil} otherwise.
505@end defvar
506
507@defun memory-use-counts
508This returns a list of numbers that count the number of objects
509created in this Emacs session. Each of these counters increments for
510a certain kind of object. See the documentation string for details.
511@end defun
512
513@defvar gcs-done
514This variable contains the total number of garbage collections
515done so far in this Emacs session.
516@end defvar
517
518@defvar gc-elapsed
519This variable contains the total number of seconds of elapsed time
520during garbage collection so far in this Emacs session, as a floating
521point number.
522@end defvar
523
524@node Memory Usage
525@section Memory Usage
526@cindex memory usage
527
528 These functions and variables give information about the total amount
529of memory allocation that Emacs has done, broken down by data type.
530Note the difference between these and the values returned by
01a6dcc8 531@code{garbage-collect}; those count objects that currently exist, but
b8d4c8d0
GM
532these count the number or size of all allocations, including those for
533objects that have since been freed.
534
535@defvar cons-cells-consed
536The total number of cons cells that have been allocated so far
537in this Emacs session.
538@end defvar
539
540@defvar floats-consed
541The total number of floats that have been allocated so far
542in this Emacs session.
543@end defvar
544
545@defvar vector-cells-consed
546The total number of vector cells that have been allocated so far
547in this Emacs session.
548@end defvar
549
550@defvar symbols-consed
551The total number of symbols that have been allocated so far
552in this Emacs session.
553@end defvar
554
555@defvar string-chars-consed
556The total number of string characters that have been allocated so far
9658dc2a 557in this session.
b8d4c8d0
GM
558@end defvar
559
560@defvar misc-objects-consed
561The total number of miscellaneous objects that have been allocated so
9658dc2a 562far in this session. These include markers and overlays, plus
b8d4c8d0
GM
563certain objects not visible to users.
564@end defvar
565
566@defvar intervals-consed
567The total number of intervals that have been allocated so far
568in this Emacs session.
569@end defvar
570
571@defvar strings-consed
572The total number of strings that have been allocated so far in this
573Emacs session.
574@end defvar
575
576@node Writing Emacs Primitives
520f2425 577@section Writing Emacs Primitives
b8d4c8d0
GM
578@cindex primitive function internals
579@cindex writing Emacs primitives
580
1df7defd 581 Lisp primitives are Lisp functions implemented in C@. The details of
b8d4c8d0
GM
582interfacing the C function so that Lisp can call it are handled by a few
583C macros. The only way to really understand how to write new C code is
584to read the source, but we can explain some things here.
585
586 An example of a special form is the definition of @code{or}, from
587@file{eval.c}. (An ordinary function would have the same general
588appearance.)
589
590@cindex garbage collection protection
591@smallexample
592@group
593DEFUN ("or", For, Sor, 0, UNEVALLED, 0,
d15aac68
CY
594 doc: /* Eval args until one of them yields non-nil, then return
595that value.
596The remaining args are not evalled at all.
b8d4c8d0
GM
597If all args return nil, return nil.
598@end group
599@group
600usage: (or CONDITIONS ...) */)
b88746ba 601 (Lisp_Object args)
b8d4c8d0
GM
602@{
603 register Lisp_Object val = Qnil;
604 struct gcpro gcpro1;
605@end group
606
607@group
608 GCPRO1 (args);
609@end group
610
611@group
612 while (CONSP (args))
613 @{
7d2d7cc0 614 val = eval_sub (XCAR (args));
b8d4c8d0
GM
615 if (!NILP (val))
616 break;
617 args = XCDR (args);
618 @}
619@end group
620
621@group
622 UNGCPRO;
623 return val;
624@}
625@end group
626@end smallexample
627
628@cindex @code{DEFUN}, C macro to define Lisp primitives
629 Let's start with a precise explanation of the arguments to the
630@code{DEFUN} macro. Here is a template for them:
631
632@example
633DEFUN (@var{lname}, @var{fname}, @var{sname}, @var{min}, @var{max}, @var{interactive}, @var{doc})
634@end example
635
636@table @var
637@item lname
638This is the name of the Lisp symbol to define as the function name; in
639the example above, it is @code{or}.
640
641@item fname
d15aac68
CY
642This is the C function name for this function. This is the name that
643is used in C code for calling the function. The name is, by
644convention, @samp{F} prepended to the Lisp name, with all dashes
645(@samp{-}) in the Lisp name changed to underscores. Thus, to call
646this function from C code, call @code{For}.
b8d4c8d0
GM
647
648@item sname
649This is a C variable name to use for a structure that holds the data for
650the subr object that represents the function in Lisp. This structure
651conveys the Lisp symbol name to the initialization routine that will
652create the symbol and store the subr object as its definition. By
653convention, this name is always @var{fname} with @samp{F} replaced with
654@samp{S}.
655
656@item min
657This is the minimum number of arguments that the function requires. The
658function @code{or} allows a minimum of zero arguments.
659
660@item max
661This is the maximum number of arguments that the function accepts, if
662there is a fixed maximum. Alternatively, it can be @code{UNEVALLED},
663indicating a special form that receives unevaluated arguments, or
664@code{MANY}, indicating an unlimited number of evaluated arguments (the
665equivalent of @code{&rest}). Both @code{UNEVALLED} and @code{MANY} are
9658dc2a
GM
666macros. If @var{max} is a number, it must be more than @var{min} but
667less than 8.
b8d4c8d0 668
84ebefe9 669@cindex interactive specification in primitives
b8d4c8d0 670@item interactive
84ebefe9
XF
671This is an interactive specification, a string such as might be used
672as the argument of @code{interactive} in a Lisp function. In the case
673of @code{or}, it is 0 (a null pointer), indicating that @code{or}
b02b5481
GM
674cannot be called interactively. A value of @code{""} indicates a
675function that should receive no arguments when called interactively.
84ebefe9
XF
676If the value begins with a @samp{"(}, the string is evaluated as a
677Lisp form. For example:
678
b02b5481 679@example
84ebefe9 680@group
b02b5481
GM
681DEFUN ("foo", Ffoo, Sfoo, 0, UNEVALLED,
682 "(list (read-char-by-name \"Insert character: \")\
84ebefe9
XF
683 (prefix-numeric-value current-prefix-arg)\
684 t))",
685 doc: /* @dots{} /*)
686@end group
b02b5481 687@end example
b8d4c8d0
GM
688
689@item doc
690This is the documentation string. It uses C comment syntax rather
691than C string syntax because comment syntax requires nothing special
692to include multiple lines. The @samp{doc:} identifies the comment
693that follows as the documentation string. The @samp{/*} and @samp{*/}
694delimiters that begin and end the comment are not part of the
695documentation string.
696
697If the last line of the documentation string begins with the keyword
698@samp{usage:}, the rest of the line is treated as the argument list
699for documentation purposes. This way, you can use different argument
700names in the documentation string from the ones used in the C code.
701@samp{usage:} is required if the function has an unlimited number of
702arguments.
703
704All the usual rules for documentation strings in Lisp code
705(@pxref{Documentation Tips}) apply to C code documentation strings
706too.
707@end table
708
b88746ba 709 After the call to the @code{DEFUN} macro, you must write the
d15aac68
CY
710argument list for the C function, including the types for the
711arguments. If the primitive accepts a fixed maximum number of Lisp
712arguments, there must be one C argument for each Lisp argument, and
713each argument must be of type @code{Lisp_Object}. (Various macros and
714functions for creating values of type @code{Lisp_Object} are declared
715in the file @file{lisp.h}.) If the primitive has no upper limit on
716the number of Lisp arguments, it must have exactly two C arguments:
717the first is the number of Lisp arguments, and the second is the
718address of a block containing their values. These have types
39670ef4 719@code{int} and @w{@code{Lisp_Object *}} respectively. Since
74934dcc
DA
720@code{Lisp_Object} can hold any Lisp object of any data type, you
721can determine the actual data type only at run time; so if you want
722a primitive to accept only a certain type of argument, you must check
723the type explicitly using a suitable predicate (@pxref{Type Predicates}).
724@cindex type checking internals
b8d4c8d0
GM
725
726@cindex @code{GCPRO} and @code{UNGCPRO}
727@cindex protect C variables from garbage collection
728 Within the function @code{For} itself, note the use of the macros
d15aac68
CY
729@code{GCPRO1} and @code{UNGCPRO}. These macros are defined for the
730sake of the few platforms which do not use Emacs' default
731stack-marking garbage collector. The @code{GCPRO1} macro ``protects''
732a variable from garbage collection, explicitly informing the garbage
733collector that that variable and all its contents must be as
734accessible. GC protection is necessary in any function which can
735perform Lisp evaluation by calling @code{eval_sub} or @code{Feval} as
736a subroutine, either directly or indirectly.
b8d4c8d0
GM
737
738 It suffices to ensure that at least one pointer to each object is
d15aac68 739GC-protected. Thus, a particular local variable can do without
b8d4c8d0 740protection if it is certain that the object it points to will be
7d2d7cc0 741preserved by some other pointer (such as another local variable that
d15aac68
CY
742has a @code{GCPRO}). Otherwise, the local variable needs a
743@code{GCPRO}.
b8d4c8d0
GM
744
745 The macro @code{GCPRO1} protects just one local variable. If you
746want to protect two variables, use @code{GCPRO2} instead; repeating
747@code{GCPRO1} will not work. Macros @code{GCPRO3}, @code{GCPRO4},
748@code{GCPRO5}, and @code{GCPRO6} also exist. All these macros
749implicitly use local variables such as @code{gcpro1}; you must declare
750these explicitly, with type @code{struct gcpro}. Thus, if you use
751@code{GCPRO2}, you must declare @code{gcpro1} and @code{gcpro2}.
b8d4c8d0
GM
752
753 @code{UNGCPRO} cancels the protection of the variables that are
754protected in the current function. It is necessary to do this
755explicitly.
756
b8d4c8d0
GM
757 You must not use C initializers for static or global variables unless
758the variables are never written once Emacs is dumped. These variables
759with initializers are allocated in an area of memory that becomes
760read-only (on certain operating systems) as a result of dumping Emacs.
761@xref{Pure Storage}.
762
b8d4c8d0
GM
763@cindex @code{defsubr}, Lisp symbol for a primitive
764 Defining the C function is not enough to make a Lisp primitive
765available; you must also create the Lisp symbol for the primitive and
766store a suitable subr object in its function cell. The code looks like
767this:
768
769@example
7d2d7cc0 770defsubr (&@var{sname});
b8d4c8d0
GM
771@end example
772
773@noindent
7d2d7cc0 774Here @var{sname} is the name you used as the third argument to @code{DEFUN}.
b8d4c8d0
GM
775
776 If you add a new primitive to a file that already has Lisp primitives
777defined in it, find the function (near the end of the file) named
778@code{syms_of_@var{something}}, and add the call to @code{defsubr}
779there. If the file doesn't have this function, or if you create a new
780file, add to it a @code{syms_of_@var{filename}} (e.g.,
781@code{syms_of_myfile}). Then find the spot in @file{emacs.c} where all
782of these functions are called, and add a call to
783@code{syms_of_@var{filename}} there.
784
785@anchor{Defining Lisp variables in C}
786@vindex byte-boolean-vars
787@cindex defining Lisp variables in C
788@cindex @code{DEFVAR_INT}, @code{DEFVAR_LISP}, @code{DEFVAR_BOOL}
789 The function @code{syms_of_@var{filename}} is also the place to define
790any C variables that are to be visible as Lisp variables.
791@code{DEFVAR_LISP} makes a C variable of type @code{Lisp_Object} visible
792in Lisp. @code{DEFVAR_INT} makes a C variable of type @code{int}
793visible in Lisp with a value that is always an integer.
794@code{DEFVAR_BOOL} makes a C variable of type @code{int} visible in Lisp
795with a value that is either @code{t} or @code{nil}. Note that variables
796defined with @code{DEFVAR_BOOL} are automatically added to the list
797@code{byte-boolean-vars} used by the byte compiler.
798
7d2d7cc0
GM
799@cindex defining customization variables in C
800 If you want to make a Lisp variables that is defined in C behave
801like one declared with @code{defcustom}, add an appropriate entry to
802@file{cus-start.el}.
803
b8d4c8d0
GM
804@cindex @code{staticpro}, protection from GC
805 If you define a file-scope C variable of type @code{Lisp_Object},
806you must protect it from garbage-collection by calling @code{staticpro}
807in @code{syms_of_@var{filename}}, like this:
808
809@example
810staticpro (&@var{variable});
811@end example
812
813 Here is another example function, with more complicated arguments.
814This comes from the code in @file{window.c}, and it demonstrates the use
815of macros and functions to manipulate Lisp objects.
816
817@smallexample
818@group
819DEFUN ("coordinates-in-window-p", Fcoordinates_in_window_p,
7d2d7cc0
GM
820 Scoordinates_in_window_p, 2, 2, 0,
821 doc: /* Return non-nil if COORDINATES are in WINDOW.
822 ...
b8d4c8d0
GM
823@end group
824@group
7d2d7cc0
GM
825 or `right-margin' is returned. */)
826 (register Lisp_Object coordinates, Lisp_Object window)
b8d4c8d0 827@{
7d2d7cc0
GM
828 struct window *w;
829 struct frame *f;
b8d4c8d0 830 int x, y;
7d2d7cc0 831 Lisp_Object lx, ly;
b8d4c8d0
GM
832@end group
833
834@group
7d2d7cc0
GM
835 CHECK_LIVE_WINDOW (window);
836 w = XWINDOW (window);
837 f = XFRAME (w->frame);
838 CHECK_CONS (coordinates);
839 lx = Fcar (coordinates);
840 ly = Fcdr (coordinates);
841 CHECK_NUMBER_OR_FLOAT (lx);
842 CHECK_NUMBER_OR_FLOAT (ly);
843 x = FRAME_PIXEL_X_FROM_CANON_X (f, lx) + FRAME_INTERNAL_BORDER_WIDTH(f);
844 y = FRAME_PIXEL_Y_FROM_CANON_Y (f, ly) + FRAME_INTERNAL_BORDER_WIDTH(f);
b8d4c8d0
GM
845@end group
846
847@group
7d2d7cc0 848 switch (coordinates_in_window (w, x, y))
b8d4c8d0 849 @{
7d2d7cc0 850 case ON_NOTHING: /* NOT in window at all. */
b8d4c8d0
GM
851 return Qnil;
852@end group
853
7d2d7cc0 854 ...
b8d4c8d0
GM
855
856@group
7d2d7cc0 857 case ON_MODE_LINE: /* In mode line of window. */
b8d4c8d0
GM
858 return Qmode_line;
859@end group
860
7d2d7cc0
GM
861 ...
862
b8d4c8d0 863@group
7d2d7cc0
GM
864 case ON_SCROLL_BAR: /* On scroll-bar of window. */
865 /* Historically we are supposed to return nil in this case. */
866 return Qnil;
b8d4c8d0
GM
867@end group
868
869@group
870 default:
871 abort ();
872 @}
873@}
874@end group
875@end smallexample
876
877 Note that C code cannot call functions by name unless they are defined
1df7defd 878in C@. The way to call a function written in Lisp is to use
b8d4c8d0
GM
879@code{Ffuncall}, which embodies the Lisp function @code{funcall}. Since
880the Lisp function @code{funcall} accepts an unlimited number of
881arguments, in C it takes two: the number of Lisp-level arguments, and a
882one-dimensional array containing their values. The first Lisp-level
883argument is the Lisp function to call, and the rest are the arguments to
884pass to it. Since @code{Ffuncall} can call the evaluator, you must
885protect pointers from garbage collection around the call to
886@code{Ffuncall}.
887
888 The C functions @code{call0}, @code{call1}, @code{call2}, and so on,
889provide handy ways to call a Lisp function conveniently with a fixed
890number of arguments. They work by calling @code{Ffuncall}.
891
892 @file{eval.c} is a very good file to look through for examples;
893@file{lisp.h} contains the definitions for some important macros and
894functions.
895
896 If you define a function which is side-effect free, update the code
7d2d7cc0 897in @file{byte-opt.el} that binds @code{side-effect-free-fns} and
b8d4c8d0
GM
898@code{side-effect-and-error-free-fns} so that the compiler optimizer
899knows about it.
900
901@node Object Internals
520f2425 902@section Object Internals
b8d4c8d0
GM
903@cindex object internals
904
74934dcc 905 Emacs Lisp provides a rich set of the data types. Some of them, like cons
f24f2e22 906cells, integers and strings, are common to nearly all Lisp dialects. Some
74934dcc
DA
907others, like markers and buffers, are quite special and needed to provide
908the basic support to write editor commands in Lisp. To implement such
909a variety of object types and provide an efficient way to pass objects between
910the subsystems of an interpreter, there is a set of C data structures and
911a special type to represent the pointers to all of them, which is known as
912@dfn{tagged pointer}.
913
914 In C, the tagged pointer is an object of type @code{Lisp_Object}. Any
915initialized variable of such a type always holds the value of one of the
916following basic data types: integer, symbol, string, cons cell, float,
917vectorlike or miscellaneous object. Each of these data types has the
918corresponding tag value. All tags are enumerated by @code{enum Lisp_Type}
919and placed into a 3-bit bitfield of the @code{Lisp_Object}. The rest of the
39670ef4 920bits is the value itself. Integer values are immediate, i.e., directly
74934dcc
DA
921represented by those @dfn{value bits}, and all other objects are represented
922by the C pointers to a corresponding object allocated from the heap. Width
923of the @code{Lisp_Object} is platform- and configuration-dependent: usually
39670ef4 924it's equal to the width of an underlying platform pointer (i.e., 32-bit on
74934dcc
DA
925a 32-bit machine and 64-bit on a 64-bit one), but also there is a special
926configuration where @code{Lisp_Object} is 64-bit but all pointers are 32-bit.
927The latter trick was designed to overcome the limited range of values for
928Lisp integers on a 32-bit system by using 64-bit @code{long long} type for
929@code{Lisp_Object}.
930
931 The following C data structures are defined in @file{lisp.h} to represent
932the basic data types beyond integers:
933
934@table @code
935@item struct Lisp_Cons
936Cons cell, an object used to construct lists.
937
938@item struct Lisp_String
939String, the basic object to represent a sequence of characters.
940
941@item struct Lisp_Vector
942Array, a fixed-size set of Lisp objects which may be accessed by an index.
943
944@item struct Lisp_Symbol
945Symbol, the unique-named entity commonly used as an identifier.
946
947@item struct Lisp_Float
948Floating point value.
949
950@item union Lisp_Misc
951Miscellaneous kinds of objects which don't fit into any of the above.
952@end table
953
954 These types are the first-class citizens of an internal type system.
955Since the tag space is limited, all other types are the subtypes of either
956@code{Lisp_Vectorlike} or @code{Lisp_Misc}. Vector subtypes are enumerated
957by @code{enum pvec_type}, and nearly all complex objects like windows, buffers,
958frames, and processes fall into this category. The rest of special types,
959including markers and overlays, are enumerated by @code{enum Lisp_Misc_Type}
960and form the set of subtypes of @code{Lisp_Misc}.
961
962 Below there is a description of a few subtypes of @code{Lisp_Vectorlike}.
963Buffer object represents the text to display and edit. Window is the part
964of display structure which shows the buffer or used as a container to
965recursively place other windows on the same frame. (Do not confuse Emacs Lisp
966window object with the window as an entity managed by the user interface
967system like X; in Emacs terminology, the latter is called frame.) Finally,
968process object is used to manage the subprocesses.
b8d4c8d0
GM
969
970@menu
971* Buffer Internals:: Components of a buffer structure.
972* Window Internals:: Components of a window structure.
973* Process Internals:: Components of a process structure.
974@end menu
975
976@node Buffer Internals
520f2425 977@subsection Buffer Internals
b8d4c8d0
GM
978@cindex internals, of buffer
979@cindex buffer internals
980
7d2d7cc0 981 Two structures (see @file{buffer.h}) are used to represent buffers
1df7defd 982in C@. The @code{buffer_text} structure contains fields describing the
7d2d7cc0
GM
983text of a buffer; the @code{buffer} structure holds other fields. In
984the case of indirect buffers, two or more @code{buffer} structures
985reference the same @code{buffer_text} structure.
b8d4c8d0 986
c773345a 987Here are some of the fields in @code{struct buffer_text}:
b8d4c8d0
GM
988
989@table @code
990@item beg
c773345a 991The address of the buffer contents.
b8d4c8d0
GM
992
993@item gpt
c773345a
CY
994@itemx gpt_byte
995The character and byte positions of the buffer gap. @xref{Buffer
996Gap}.
b8d4c8d0
GM
997
998@item z
c773345a
CY
999@itemx z_byte
1000The character and byte positions of the end of the buffer text.
b8d4c8d0
GM
1001
1002@item gap_size
c773345a 1003The size of buffer's gap. @xref{Buffer Gap}.
b8d4c8d0
GM
1004
1005@item modiff
c773345a
CY
1006@itemx save_modiff
1007@itemx chars_modiff
1008@itemx overlay_modiff
1009These fields count the number of buffer-modification events performed
1010in this buffer. @code{modiff} is incremented after each
1011buffer-modification event, and is never otherwise changed;
1012@code{save_modiff} contains the value of @code{modiff} the last time
1013the buffer was visited or saved; @code{chars_modiff} counts only
1014modifications to the characters in the buffer, ignoring all other
1015kinds of changes; and @code{overlay_modiff} counts only modifications
1016to the overlays.
b8d4c8d0
GM
1017
1018@item beg_unchanged
c773345a
CY
1019@itemx end_unchanged
1020The number of characters at the start and end of the text that are
1021known to be unchanged since the last complete redisplay.
b8d4c8d0
GM
1022
1023@item unchanged_modified
c773345a
CY
1024@itemx overlay_unchanged_modified
1025The values of @code{modiff} and @code{overlay_modiff}, respectively,
da6062e6 1026after the last complete redisplay. If their current values match
c773345a 1027@code{modiff} or @code{overlay_modiff}, that means
b8d4c8d0
GM
1028@code{beg_unchanged} and @code{end_unchanged} contain no useful
1029information.
1030
1031@item markers
1032The markers that refer to this buffer. This is actually a single
1033marker, and successive elements in its marker @code{chain} are the other
1034markers referring to this buffer text.
1035
1036@item intervals
c773345a 1037The interval tree which records the text properties of this buffer.
b8d4c8d0
GM
1038@end table
1039
c773345a 1040Some of the fields of @code{struct buffer} are:
b8d4c8d0
GM
1041
1042@table @code
7d2d7cc0 1043@item header
74934dcc
DA
1044A header of type @code{struct vectorlike_header} is common to all
1045vectorlike objects.
b8d4c8d0
GM
1046
1047@item own_text
c773345a
CY
1048A @code{struct buffer_text} structure that ordinarily holds the buffer
1049contents. In indirect buffers, this field is not used.
b8d4c8d0
GM
1050
1051@item text
c773345a
CY
1052A pointer to the @code{buffer_text} structure for this buffer. In an
1053ordinary buffer, this is the @code{own_text} field above. In an
1054indirect buffer, this is the @code{own_text} field of the base buffer.
b8d4c8d0 1055
74934dcc
DA
1056@item next
1057A pointer to the next buffer, in the chain of all buffers, including
1058killed buffers. This chain is used only for allocation and garbage
1059collection, in order to collect killed buffers properly.
1060
b8d4c8d0 1061@item pt
c773345a
CY
1062@itemx pt_byte
1063The character and byte positions of point in a buffer.
b8d4c8d0
GM
1064
1065@item begv
c773345a
CY
1066@itemx begv_byte
1067The character and byte positions of the beginning of the accessible
1068range of text in the buffer.
b8d4c8d0
GM
1069
1070@item zv
c773345a
CY
1071@itemx zv_byte
1072The character and byte positions of the end of the accessible range of
1073text in the buffer.
b8d4c8d0
GM
1074
1075@item base_buffer
1076In an indirect buffer, this points to the base buffer. In an ordinary
1077buffer, it is null.
1078
c773345a
CY
1079@item local_flags
1080This field contains flags indicating that certain variables are local
1081in this buffer. Such variables are declared in the C code using
1082@code{DEFVAR_PER_BUFFER}, and their buffer-local bindings are stored
1083in fields in the buffer structure itself. (Some of these fields are
b8d4c8d0
GM
1084described in this table.)
1085
1086@item modtime
c773345a
CY
1087The modification time of the visited file. It is set when the file is
1088written or read. Before writing the buffer into a file, this field is
1089compared to the modification time of the file to see if the file has
1090changed on disk. @xref{Buffer Modification}.
b8d4c8d0
GM
1091
1092@item auto_save_modified
c773345a 1093The time when the buffer was last auto-saved.
b8d4c8d0
GM
1094
1095@item last_window_start
c773345a
CY
1096The @code{window-start} position in the buffer as of the last time the
1097buffer was displayed in a window.
b8d4c8d0
GM
1098
1099@item clip_changed
c773345a
CY
1100This flag indicates that narrowing has changed in the buffer.
1101@xref{Narrowing}.
b8d4c8d0
GM
1102
1103@item prevent_redisplay_optimizations_p
c773345a
CY
1104This flag indicates that redisplay optimizations should not be used to
1105display this buffer.
b8d4c8d0 1106
c773345a
CY
1107@item overlay_center
1108This field holds the current overlay center position. @xref{Managing
1109Overlays}.
1110
1111@item overlays_before
1112@itemx overlays_after
1113These fields hold, respectively, a list of overlays that end at or
1114before the current overlay center, and a list of overlays that end
1115after the current overlay center. @xref{Managing Overlays}.
1116@code{overlays_before} is sorted in order of decreasing end position,
1117and @code{overlays_after} is sorted in order of increasing beginning
1118position.
b8d4c8d0 1119
7d2d7cc0
GM
1120@c FIXME? the following are now all Lisp_Object BUFFER_INTERNAL_FIELD (foo).
1121
b8d4c8d0 1122@item name
c773345a
CY
1123A Lisp string that names the buffer. It is guaranteed to be unique.
1124@xref{Buffer Names}.
b8d4c8d0 1125
c773345a
CY
1126@item save_length
1127The length of the file this buffer is visiting, when last read or
1128saved. This and other fields concerned with saving are not kept in
1129the @code{buffer_text} structure because indirect buffers are never
1130saved.
b8d4c8d0
GM
1131
1132@item directory
c773345a
CY
1133The directory for expanding relative file names. This is the value of
1134the buffer-local variable @code{default-directory} (@pxref{File Name Expansion}).
b8d4c8d0 1135
c773345a
CY
1136@item filename
1137The name of the file visited in this buffer, or @code{nil}. This is
1138the value of the buffer-local variable @code{buffer-file-name}
1139(@pxref{Buffer File Name}).
b8d4c8d0 1140
c773345a
CY
1141@item undo_list
1142@itemx backed_up
1143@itemx auto_save_file_name
7d2d7cc0 1144@itemx auto_save_file_format
c773345a
CY
1145@itemx read_only
1146@itemx file_format
1147@itemx file_truename
1148@itemx invisibility_spec
1149@itemx display_count
1150@itemx display_time
1151These fields store the values of Lisp variables that are automatically
1152buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1153variable names have the additional prefix @code{buffer-} and have
1154underscores replaced with dashes. For instance, @code{undo_list}
29157371 1155stores the value of @code{buffer-undo-list}.
b8d4c8d0
GM
1156
1157@item mark
c773345a
CY
1158The mark for the buffer. The mark is a marker, hence it is also
1159included on the list @code{markers}. @xref{The Mark}.
b8d4c8d0
GM
1160
1161@item local_var_alist
c773345a
CY
1162The association list describing the buffer-local variable bindings of
1163this buffer, not including the built-in buffer-local bindings that
1164have special slots in the buffer object. (Those slots are omitted
1165from this table.) @xref{Buffer-Local Variables}.
b8d4c8d0
GM
1166
1167@item major_mode
1168Symbol naming the major mode of this buffer, e.g., @code{lisp-mode}.
1169
1170@item mode_name
c773345a 1171Pretty name of the major mode, e.g., @code{"Lisp"}.
b8d4c8d0
GM
1172
1173@item keymap
c773345a
CY
1174@itemx abbrev_table
1175@itemx syntax_table
1176@itemx category_table
1177@itemx display_table
1178These fields store the buffer's local keymap (@pxref{Keymaps}), abbrev
1179table (@pxref{Abbrev Tables}), syntax table (@pxref{Syntax Tables}),
1180category table (@pxref{Categories}), and display table (@pxref{Display
1181Tables}).
b8d4c8d0
GM
1182
1183@item downcase_table
c773345a
CY
1184@itemx upcase_table
1185@itemx case_canon_table
1186These fields store the conversion tables for converting text to lower
1187case, upper case, and for canonicalizing text for case-fold search.
b8d4c8d0
GM
1188@xref{Case Tables}.
1189
b8d4c8d0
GM
1190@item minor_modes
1191An alist of the minor modes of this buffer.
1192
b8d4c8d0 1193@item pt_marker
c773345a
CY
1194@itemx begv_marker
1195@itemx zv_marker
1196These fields are only used in an indirect buffer, or in a buffer that
1197is the base of an indirect buffer. Each holds a marker that records
1198@code{pt}, @code{begv}, and @code{zv} respectively, for this buffer
b8d4c8d0
GM
1199when the buffer is not current.
1200
c773345a
CY
1201@item mode_line_format
1202@itemx header_line_format
1203@itemx case_fold_search
1204@itemx tab_width
1205@itemx fill_column
1206@itemx left_margin
1207@itemx auto_fill_function
c773345a
CY
1208@itemx truncate_lines
1209@itemx word_wrap
1210@itemx ctl_arrow
7d2d7cc0
GM
1211@itemx bidi_display_reordering
1212@itemx bidi_paragraph_direction
c773345a
CY
1213@itemx selective_display
1214@itemx selective_display_ellipses
1215@itemx overwrite_mode
1216@itemx abbrev_mode
c773345a
CY
1217@itemx mark_active
1218@itemx enable_multibyte_characters
1219@itemx buffer_file_coding_system
c773345a
CY
1220@itemx cache_long_line_scans
1221@itemx point_before_scroll
1222@itemx left_fringe_width
1223@itemx right_fringe_width
1224@itemx fringes_outside_margins
1225@itemx scroll_bar_width
1226@itemx indicate_empty_lines
1227@itemx indicate_buffer_boundaries
1228@itemx fringe_indicator_alist
1229@itemx fringe_cursor_alist
1230@itemx scroll_up_aggressively
1231@itemx scroll_down_aggressively
1232@itemx cursor_type
1233@itemx cursor_in_non_selected_windows
1234These fields store the values of Lisp variables that are automatically
1235buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1236variable names have underscores replaced with dashes. For instance,
1237@code{mode_line_format} stores the value of @code{mode-line-format}.
b8d4c8d0
GM
1238
1239@item last_selected_window
1240This is the last window that was selected with this buffer in it, or @code{nil}
1241if that window no longer displays this buffer.
b8d4c8d0
GM
1242@end table
1243
1244@node Window Internals
520f2425 1245@subsection Window Internals
b8d4c8d0
GM
1246@cindex internals, of window
1247@cindex window internals
1248
7d2d7cc0
GM
1249 The fields of a window (for a complete list, see the definition of
1250@code{struct window} in @file{window.h}) include:
b8d4c8d0
GM
1251
1252@table @code
1253@item frame
1254The frame that this window is on.
1255
1256@item mini_p
1257Non-@code{nil} if this window is a minibuffer window.
1258
1259@item parent
1260Internally, Emacs arranges windows in a tree; each group of siblings has
1261a parent window whose area includes all the siblings. This field points
1262to a window's parent.
1263
1264Parent windows do not display buffers, and play little role in display
1265except to shape their child windows. Emacs Lisp programs usually have
1266no access to the parent windows; they operate on the windows at the
1267leaves of the tree, which actually display buffers.
1268
b8d4c8d0 1269@item hchild
ee2d5b5e
CY
1270@itemx vchild
1271These fields contain the window's leftmost child and its topmost child
1272respectively. @code{hchild} is used if the window is subdivided
1273horizontally by child windows, and @code{vchild} if it is subdivided
7d2d7cc0 1274vertically. In a live window, only one of @code{hchild}, @code{vchild},
1df7defd 1275and @code{buffer} (q.v.@:) is non-@code{nil}.
b8d4c8d0
GM
1276
1277@item next
ee2d5b5e
CY
1278@itemx prev
1279The next sibling and previous sibling of this window. @code{next} is
520f2425
GM
1280@code{nil} if the window is the right-most or bottom-most in its group;
1281@code{prev} is @code{nil} if it is the left-most or top-most in its
ee2d5b5e
CY
1282group.
1283
1284@item left_col
1285The left-hand edge of the window, measured in columns, relative to the
1286leftmost column in the frame (column 0).
1287
1288@item top_line
1289The top edge of the window, measured in lines, relative to the topmost
1290line in the frame (line 0).
1291
1292@item total_cols
1293@itemx total_lines
1294The width and height of the window, measured in columns and lines
1295respectively. The width includes the scroll bar and fringes, and/or
1296the separator line on the right of the window (if any).
b8d4c8d0
GM
1297
1298@item buffer
ee2d5b5e 1299The buffer that the window is displaying.
b8d4c8d0
GM
1300
1301@item start
ee2d5b5e
CY
1302A marker pointing to the position in the buffer that is the first
1303character displayed in the window.
b8d4c8d0
GM
1304
1305@item pointm
1306@cindex window point internals
1307This is the value of point in the current buffer when this window is
1308selected; when it is not selected, it retains its previous value.
1309
1310@item force_start
1311If this flag is non-@code{nil}, it says that the window has been
1312scrolled explicitly by the Lisp program. This affects what the next
1313redisplay does if point is off the screen: instead of scrolling the
1314window to show the text around point, it moves point to a location that
1315is on the screen.
1316
1317@item frozen_window_start_p
1318This field is set temporarily to 1 to indicate to redisplay that
1319@code{start} of this window should not be changed, even if point
1320gets invisible.
1321
1322@item start_at_line_beg
1323Non-@code{nil} means current value of @code{start} was the beginning of a line
1324when it was chosen.
1325
b8d4c8d0
GM
1326@item use_time
1327This is the last time that the window was selected. The function
1328@code{get-lru-window} uses this field.
1329
1330@item sequence_number
1331A unique number assigned to this window when it was created.
1332
1333@item last_modified
1334The @code{modiff} field of the window's buffer, as of the last time
1335a redisplay completed in this window.
1336
1337@item last_overlay_modified
1338The @code{overlay_modiff} field of the window's buffer, as of the last
1339time a redisplay completed in this window.
1340
1341@item last_point
1342The buffer's value of point, as of the last time a redisplay completed
1343in this window.
1344
1345@item last_had_star
1346A non-@code{nil} value means the window's buffer was ``modified'' when the
1347window was last updated.
1348
1349@item vertical_scroll_bar
1350This window's vertical scroll bar.
1351
7d2d7cc0
GM
1352@item left_margin_cols
1353@itemx right_margin_cols
ee2d5b5e 1354The widths of the left and right margins in this window. A value of
7d2d7cc0
GM
1355@code{nil} means no margin.
1356
1357@item left_fringe_width
1358@itemx right_fringe_width
1359The widths of the left and right fringes in this window. A value of
1360@code{nil} or @code{t} means use the values of the frame.
1361
1362@item fringes_outside_margins
1363A non-@code{nil} value means the fringes outside the display margins;
1364othersize they are between the margin and the text.
b8d4c8d0
GM
1365
1366@item window_end_pos
1367This is computed as @code{z} minus the buffer position of the last glyph
1368in the current matrix of the window. The value is only valid if
1369@code{window_end_valid} is not @code{nil}.
1370
1371@item window_end_bytepos
1372The byte position corresponding to @code{window_end_pos}.
1373
1374@item window_end_vpos
1375The window-relative vertical position of the line containing
1376@code{window_end_pos}.
1377
1378@item window_end_valid
1379This field is set to a non-@code{nil} value if @code{window_end_pos} is truly
7d2d7cc0 1380valid. This is @code{nil} if nontrivial redisplay is pre-empted, since in that
b8d4c8d0
GM
1381case the display that @code{window_end_pos} was computed for did not get
1382onto the screen.
1383
b8d4c8d0
GM
1384@item cursor
1385A structure describing where the cursor is in this window.
1386
1387@item last_cursor
1388The value of @code{cursor} as of the last redisplay that finished.
1389
1390@item phys_cursor
1391A structure describing where the cursor of this window physically is.
1392
1393@item phys_cursor_type
7d2d7cc0
GM
1394@c FIXME What is this?
1395@c itemx phys_cursor_ascent
1396@itemx phys_cursor_height
1397@itemx phys_cursor_width
1398The type, height, and width of the cursor that was last displayed on
1399this window.
b8d4c8d0
GM
1400
1401@item phys_cursor_on_p
1402This field is non-zero if the cursor is physically on.
1403
1404@item cursor_off_p
7d2d7cc0
GM
1405Non-zero means the cursor in this window is logically off. This is
1406used for blinking the cursor.
b8d4c8d0
GM
1407
1408@item last_cursor_off_p
1409This field contains the value of @code{cursor_off_p} as of the time of
1410the last redisplay.
1411
1412@item must_be_updated_p
1413This is set to 1 during redisplay when this window must be updated.
1414
1415@item hscroll
1416This is the number of columns that the display in the window is scrolled
1417horizontally to the left. Normally, this is 0.
1418
1419@item vscroll
1420Vertical scroll amount, in pixels. Normally, this is 0.
1421
1422@item dedicated
1423Non-@code{nil} if this window is dedicated to its buffer.
1424
1425@item display_table
1426The window's display table, or @code{nil} if none is specified for it.
1427
1428@item update_mode_line
1429Non-@code{nil} means this window's mode line needs to be updated.
1430
1431@item base_line_number
1432The line number of a certain position in the buffer, or @code{nil}.
1433This is used for displaying the line number of point in the mode line.
1434
1435@item base_line_pos
1436The position in the buffer for which the line number is known, or
7d2d7cc0
GM
1437@code{nil} meaning none is known. If it is a buffer, don't display
1438the line number as long as the window shows that buffer.
b8d4c8d0
GM
1439
1440@item region_showing
1441If the region (or part of it) is highlighted in this window, this field
1442holds the mark position that made one end of that region. Otherwise,
1443this field is @code{nil}.
1444
1445@item column_number_displayed
1446The column number currently displayed in this window's mode line, or @code{nil}
1447if column numbers are not being displayed.
1448
1449@item current_matrix
7d2d7cc0
GM
1450@itemx desired_matrix
1451Glyph matrices describing the current and desired display of this window.
b8d4c8d0
GM
1452@end table
1453
1454@node Process Internals
520f2425 1455@subsection Process Internals
b8d4c8d0
GM
1456@cindex internals, of process
1457@cindex process internals
1458
7d2d7cc0
GM
1459 The fields of a process (for a complete list, see the definition of
1460@code{struct Lisp_Process} in @file{process.h}) include:
b8d4c8d0
GM
1461
1462@table @code
1463@item name
1464A string, the name of the process.
1465
1466@item command
1467A list containing the command arguments that were used to start this
c73e02fa
GM
1468process. For a network or serial process, it is @code{nil} if the
1469process is running or @code{t} if the process is stopped.
b8d4c8d0
GM
1470
1471@item filter
458e643b 1472A function used to accept output from the process.
b8d4c8d0
GM
1473
1474@item sentinel
458e643b 1475A function called whenever the state of the process changes.
b8d4c8d0
GM
1476
1477@item buffer
1478The associated buffer of the process.
1479
1480@item pid
1481An integer, the operating system's process @acronym{ID}.
7d2d7cc0 1482Pseudo-processes such as network or serial connections use a value of 0.
b8d4c8d0
GM
1483
1484@item childp
7d2d7cc0
GM
1485A flag, @code{t} if this is really a child process. For a network or
1486serial connection, it is a plist based on the arguments to
1487@code{make-network-process} or @code{make-serial-process}.
b8d4c8d0
GM
1488
1489@item mark
1490A marker indicating the position of the end of the last output from this
1491process inserted into the buffer. This is often but not always the end
1492of the buffer.
1493
1494@item kill_without_query
ee2d5b5e
CY
1495If this is non-zero, killing Emacs while this process is still running
1496does not ask for confirmation about killing the process.
b8d4c8d0 1497
7d2d7cc0
GM
1498@item raw_status
1499The raw process status, as returned by the @code{wait} system call.
b8d4c8d0
GM
1500
1501@item status
1502The process status, as @code{process-status} should return it.
1503
1504@item tick
1505@itemx update_tick
1506If these two fields are not equal, a change in the status of the process
1507needs to be reported, either by running the sentinel or by inserting a
1508message in the process buffer.
1509
1510@item pty_flag
a2eb421b 1511Non-@code{nil} if communication with the subprocess uses a pty;
b8d4c8d0
GM
1512@code{nil} if it uses a pipe.
1513
1514@item infd
1515The file descriptor for input from the process.
1516
1517@item outfd
1518The file descriptor for output to the process.
1519
b8d4c8d0
GM
1520@item tty_name
1521The name of the terminal that the subprocess is using,
1522or @code{nil} if it is using pipes.
1523
1524@item decode_coding_system
1525Coding-system for decoding the input from this process.
1526
1527@item decoding_buf
1528A working buffer for decoding.
1529
1530@item decoding_carryover
1531Size of carryover in decoding.
1532
1533@item encode_coding_system
1534Coding-system for encoding the output to this process.
1535
1536@item encoding_buf
1537A working buffer for encoding.
1538
b8d4c8d0
GM
1539@item inherit_coding_system_flag
1540Flag to set @code{coding-system} of the process buffer from the
1541coding system used to decode process output.
c73e02fa
GM
1542
1543@item type
1544Symbol indicating the type of process: @code{real}, @code{network},
7d2d7cc0 1545@code{serial}.
c73e02fa 1546
b8d4c8d0 1547@end table
7d2d7cc0 1548
d92d9c95
PE
1549@node C Integer Types
1550@section C Integer Types
1551@cindex integer types (C programming language)
1552
1553Here are some guidelines for use of integer types in the Emacs C
1554source code. These guidelines sometimes give competing advice; common
1555sense is advised.
1556
1557@itemize @bullet
1558@item
1559Avoid arbitrary limits. For example, avoid @code{int len = strlen
1560(s);} unless the length of @code{s} is required for other reasons to
1561fit in @code{int} range.
1562
1563@item
1564Do not assume that signed integer arithmetic wraps around on overflow.
1565This is no longer true of Emacs porting targets: signed integer
1566overflow has undefined behavior in practice, and can dump core or
1567even cause earlier or later code to behave ``illogically''. Unsigned
1568overflow does wrap around reliably, modulo a power of two.
1569
1570@item
1571Prefer signed types to unsigned, as code gets confusing when signed
1572and unsigned types are combined. Many other guidelines assume that
1573types are signed; in the rarer cases where unsigned types are needed,
1574similar advice may apply to the unsigned counterparts (e.g.,
1575@code{size_t} instead of @code{ptrdiff_t}, or @code{uintptr_t} instead
1576of @code{intptr_t}).
1577
1578@item
1579Prefer @code{int} for Emacs character codes, in the range 0 ..@: 0x3FFFFF.
1580
1581@item
1582Prefer @code{ptrdiff_t} for sizes, i.e., for integers bounded by the
1583maximum size of any individual C object or by the maximum number of
1584elements in any C array. This is part of Emacs's general preference
1585for signed types. Using @code{ptrdiff_t} limits objects to
1586@code{PTRDIFF_MAX} bytes, but larger objects would cause trouble
1587anyway since they would break pointer subtraction, so this does not
1588impose an arbitrary limit.
1589
1590@item
1591Prefer @code{intptr_t} for internal representations of pointers, or
1592for integers bounded only by the number of objects that can exist at
1593any given time or by the total number of bytes that can be allocated.
1594Currently Emacs sometimes uses other types when @code{intptr_t} would
1595be better; fixing this is lower priority, as the code works as-is on
1596Emacs's current porting targets.
1597
1598@item
1599Prefer the Emacs-defined type @code{EMACS_INT} for representing values
1600converted to or from Emacs Lisp fixnums, as fixnum arithmetic is based
1601on @code{EMACS_INT}.
1602
1603@item
1604When representing a system value (such as a file size or a count of
1605seconds since the Epoch), prefer the corresponding system type (e.g.,
1606@code{off_t}, @code{time_t}). Do not assume that a system type is
1607signed, unless this assumption is known to be safe. For example,
1608although @code{off_t} is always signed, @code{time_t} need not be.
1609
1610@item
1611Prefer the Emacs-defined type @code{printmax_t} for representing
1612values that might be any signed integer value that can be printed,
1613using a @code{printf}-family function.
1614
1615@item
1616Prefer @code{intmax_t} for representing values that might be any
1617signed integer value.
1618
1619@item
1620In bitfields, prefer @code{unsigned int} or @code{signed int} to
1621@code{int}, as @code{int} is less portable: it might be signed, and
1622might not be. Single-bit bit fields are invariably @code{unsigned
1623int} so that their values are 0 and 1.
1624
1625@item
1626In C, Emacs commonly uses @code{bool}, 1, and 0 for boolean values.
1627Using @code{bool} for booleans can make programs easier to read and a
1628bit faster than using @code{int}. Although it is also OK to use
1629@code{int}, this older style is gradually being phased out. When
1630using @code{bool}, respect the limitations of the replacement
1631implementation of @code{bool}, as documented in the source file
1632@file{lib/stdbool.in.h}, so that Emacs remains portable to pre-C99
1633platforms.
1634@end itemize
1635
7d2d7cc0 1636@c FIXME Mention src/globals.h somewhere in this file?