* internals.texi (C Dialect): New section.
[bpt/emacs.git] / doc / lispref / internals.texi
CommitLineData
b8d4c8d0
GM
1@c -*-texinfo-*-
2@c This is part of the GNU Emacs Lisp Reference Manual.
ba318903 3@c Copyright (C) 1990-1993, 1998-1999, 2001-2014 Free Software
ab422c4d 4@c Foundation, Inc.
b8d4c8d0 5@c See the file elisp.texi for copying conditions.
ecc6530d 6@node GNU Emacs Internals
b8d4c8d0
GM
7@appendix GNU Emacs Internals
8
9This chapter describes how the runnable Emacs executable is dumped with
10the preloaded Lisp libraries in it, how storage is allocated, and some
11internal aspects of GNU Emacs that may be of interest to C programmers.
12
13@menu
14* Building Emacs:: How the dumped Emacs is made.
333f9019 15* Pure Storage:: Kludge to make preloaded Lisp functions shareable.
b8d4c8d0
GM
16* Garbage Collection:: Reclaiming space for Lisp objects no longer used.
17* Memory Usage:: Info about total size of Lisp objects made so far.
76377e46 18* C Dialect:: What C variant Emacs is written in.
b8d4c8d0
GM
19* Writing Emacs Primitives:: Writing C code for Emacs.
20* Object Internals:: Data formats of buffers, windows, processes.
d92d9c95 21* C Integer Types:: How C integer types are used inside Emacs.
b8d4c8d0
GM
22@end menu
23
24@node Building Emacs
520f2425 25@section Building Emacs
b8d4c8d0
GM
26@cindex building Emacs
27@pindex temacs
28
29 This section explains the steps involved in building the Emacs
30executable. You don't have to know this material to build and install
31Emacs, since the makefiles do all these things automatically. This
d15aac68 32information is pertinent to Emacs developers.
b8d4c8d0
GM
33
34 Compilation of the C source files in the @file{src} directory
35produces an executable file called @file{temacs}, also called a
d15aac68
CY
36@dfn{bare impure Emacs}. It contains the Emacs Lisp interpreter and
37I/O routines, but not the editing commands.
b8d4c8d0
GM
38
39@cindex @file{loadup.el}
d15aac68
CY
40 The command @w{@command{temacs -l loadup}} would run @file{temacs}
41and direct it to load @file{loadup.el}. The @code{loadup} library
42loads additional Lisp libraries, which set up the normal Emacs editing
43environment. After this step, the Emacs executable is no longer
44@dfn{bare}.
b8d4c8d0
GM
45
46@cindex dumping Emacs
d15aac68
CY
47 Because it takes some time to load the standard Lisp files, the
48@file{temacs} executable usually isn't run directly by users.
49Instead, as one of the last steps of building Emacs, the command
50@samp{temacs -batch -l loadup dump} is run. The special @samp{dump}
51argument causes @command{temacs} to dump out an executable program,
52called @file{emacs}, which has all the standard Lisp files preloaded.
53(The @samp{-batch} argument prevents @file{temacs} from trying to
54initialize any of its data on the terminal, so that the tables of
55terminal information are empty in the dumped Emacs.)
56
57@cindex preloaded Lisp files
b578c9cc 58@vindex preloaded-file-list
d15aac68
CY
59 The dumped @file{emacs} executable (also called a @dfn{pure} Emacs)
60is the one which is installed. The variable
61@code{preloaded-file-list} stores a list of the Lisp files preloaded
62into the dumped Emacs. If you port Emacs to a new operating system,
63and are not able to implement dumping, then Emacs must load
64@file{loadup.el} each time it starts.
b8d4c8d0
GM
65
66@cindex @file{site-load.el}
b8d4c8d0 67 You can specify additional files to preload by writing a library named
520f2425
GM
68@file{site-load.el} that loads them. You may need to rebuild Emacs
69with an added definition
b8d4c8d0
GM
70
71@example
72#define SITELOAD_PURESIZE_EXTRA @var{n}
73@end example
74
75@noindent
520f2425
GM
76to make @var{n} added bytes of pure space to hold the additional files;
77see @file{src/puresize.h}.
b8d4c8d0
GM
78(Try adding increments of 20000 until it is big enough.) However, the
79advantage of preloading additional files decreases as machines get
80faster. On modern machines, it is usually not advisable.
81
82 After @file{loadup.el} reads @file{site-load.el}, it finds the
83documentation strings for primitive and preloaded functions (and
84variables) in the file @file{etc/DOC} where they are stored, by
85calling @code{Snarf-documentation} (@pxref{Definition of
86Snarf-documentation,, Accessing Documentation}).
87
88@cindex @file{site-init.el}
89@cindex preloading additional functions and variables
90 You can specify other Lisp expressions to execute just before dumping
91by putting them in a library named @file{site-init.el}. This file is
92executed after the documentation strings are found.
93
94 If you want to preload function or variable definitions, there are
95three ways you can do this and make their documentation strings
96accessible when you subsequently run Emacs:
97
98@itemize @bullet
99@item
100Arrange to scan these files when producing the @file{etc/DOC} file,
101and load them with @file{site-load.el}.
102
103@item
104Load the files with @file{site-init.el}, then copy the files into the
105installation directory for Lisp files when you install Emacs.
106
107@item
5906db45
GM
108Specify a @code{nil} value for @code{byte-compile-dynamic-docstrings}
109as a local variable in each of these files, and load them with either
110@file{site-load.el} or @file{site-init.el}. (This method has the
111drawback that the documentation strings take up space in Emacs all the
112time.)
b8d4c8d0
GM
113@end itemize
114
f982b371
EZ
115@cindex change @code{load-path} at configure time
116@cindex @option{--enable-locallisppath} option to @command{configure}
b8d4c8d0
GM
117 It is not advisable to put anything in @file{site-load.el} or
118@file{site-init.el} that would alter any of the features that users
119expect in an ordinary unmodified Emacs. If you feel you must override
120normal features for your site, do it with @file{default.el}, so that
121users can override your changes if they wish. @xref{Startup Summary}.
06a4f110
GM
122Note that if either @file{site-load.el} or @file{site-init.el} changes
123@code{load-path}, the changes will be lost after dumping.
124@xref{Library Search}. To make a permanent change to
125@code{load-path}, use the @option{--enable-locallisppath} option
126of @command{configure}.
b8d4c8d0 127
520f2425
GM
128 In a package that can be preloaded, it is sometimes necessary (or
129useful) to delay certain evaluations until Emacs subsequently starts
130up. The vast majority of such cases relate to the values of
131customizable variables. For example, @code{tutorial-directory} is a
132variable defined in @file{startup.el}, which is preloaded. The default
133value is set based on @code{data-directory}. The variable needs to
134access the value of @code{data-directory} when Emacs starts, not when
135it is dumped, because the Emacs executable has probably been installed
136in a different location since it was dumped.
137
138@defun custom-initialize-delay symbol value
139This function delays the initialization of @var{symbol} to the next
140Emacs start. You normally use this function by specifying it as the
141@code{:initialize} property of a customizable variable. (The argument
f003f294 142@var{value} is unused, and is provided only for compatibility with the
520f2425
GM
143form Custom expects.)
144@end defun
b8d4c8d0 145
520f2425
GM
146In the unlikely event that you need a more general functionality than
147@code{custom-initialize-delay} provides, you can use
148@code{before-init-hook} (@pxref{Startup Summary}).
b8d4c8d0
GM
149
150@defun dump-emacs to-file from-file
151@cindex unexec
152This function dumps the current state of Emacs into an executable file
153@var{to-file}. It takes symbols from @var{from-file} (this is normally
154the executable file @file{temacs}).
155
156If you want to use this function in an Emacs that was already dumped,
157you must run Emacs with @samp{-batch}.
158@end defun
159
160@node Pure Storage
520f2425 161@section Pure Storage
b8d4c8d0
GM
162@cindex pure storage
163
164 Emacs Lisp uses two kinds of storage for user-created Lisp objects:
165@dfn{normal storage} and @dfn{pure storage}. Normal storage is where
999dd333
GM
166all the new data created during an Emacs session are kept
167(@pxref{Garbage Collection}). Pure storage is used for certain data
168in the preloaded standard Lisp files---data that should never change
169during actual use of Emacs.
b8d4c8d0 170
d15aac68 171 Pure storage is allocated only while @command{temacs} is loading the
b8d4c8d0
GM
172standard preloaded Lisp libraries. In the file @file{emacs}, it is
173marked as read-only (on operating systems that permit this), so that
174the memory space can be shared by all the Emacs jobs running on the
175machine at once. Pure storage is not expandable; a fixed amount is
176allocated when Emacs is compiled, and if that is not sufficient for
177the preloaded libraries, @file{temacs} allocates dynamic memory for
999dd333
GM
178the part that didn't fit. The resulting image will work, but garbage
179collection (@pxref{Garbage Collection}) is disabled in this situation,
180causing a memory leak. Such an overflow normally won't happen unless
181you try to preload additional libraries or add features to the
182standard ones. Emacs will display a warning about the overflow when
183it starts. If this happens, you should increase the compilation
184parameter @code{SYSTEM_PURESIZE_EXTRA} in the file
185@file{src/puresize.h} and rebuild Emacs.
b8d4c8d0
GM
186
187@defun purecopy object
188This function makes a copy in pure storage of @var{object}, and returns
189it. It copies a string by simply making a new string with the same
190characters, but without text properties, in pure storage. It
191recursively copies the contents of vectors and cons cells. It does
192not make copies of other objects such as symbols, but just returns
193them unchanged. It signals an error if asked to copy markers.
194
195This function is a no-op except while Emacs is being built and dumped;
999dd333 196it is usually called only in preloaded Lisp files.
b8d4c8d0
GM
197@end defun
198
199@defvar pure-bytes-used
200The value of this variable is the number of bytes of pure storage
201allocated so far. Typically, in a dumped Emacs, this number is very
202close to the total amount of pure storage available---if it were not,
203we would preallocate less.
204@end defvar
205
206@defvar purify-flag
207This variable determines whether @code{defun} should make a copy of the
208function definition in pure storage. If it is non-@code{nil}, then the
209function definition is copied into pure storage.
210
211This flag is @code{t} while loading all of the basic functions for
333f9019 212building Emacs initially (allowing those functions to be shareable and
b8d4c8d0
GM
213non-collectible). Dumping Emacs as an executable always writes
214@code{nil} in this variable, regardless of the value it actually has
215before and after dumping.
216
217You should not change this flag in a running Emacs.
218@end defvar
219
220@node Garbage Collection
520f2425 221@section Garbage Collection
b8d4c8d0
GM
222
223@cindex memory allocation
d15aac68
CY
224 When a program creates a list or the user defines a new function
225(such as by loading a library), that data is placed in normal storage.
226If normal storage runs low, then Emacs asks the operating system to
227allocate more memory. Different types of Lisp objects, such as
f3372c87
DA
228symbols, cons cells, small vectors, markers, etc., are segregated in
229distinct blocks in memory. (Large vectors, long strings, buffers and
230certain other editing types, which are fairly large, are allocated in
231individual blocks, one per object; small strings are packed into blocks
232of 8k bytes, and small vectors are packed into blocks of 4k bytes).
233
234@cindex vector-like objects, storage
235@cindex storage of vector-like Lisp objects
236 Beyond the basic vector, a lot of objects like window, buffer, and
237frame are managed as if they were vectors. The corresponding C data
238structures include the @code{struct vectorlike_header} field whose
74934dcc
DA
239@code{size} member contains the subtype enumerated by @code{enum pvec_type}
240and an information about how many @code{Lisp_Object} fields this structure
241contains and what the size of the rest data is. This information is
242needed to calculate the memory footprint of an object, and used
243by the vector allocation code while iterating over the vector blocks.
b8d4c8d0 244
d15aac68
CY
245@cindex garbage collection
246 It is quite common to use some storage for a while, then release it
247by (for example) killing a buffer or deleting the last pointer to an
248object. Emacs provides a @dfn{garbage collector} to reclaim this
249abandoned storage. The garbage collector operates by finding and
250marking all Lisp objects that are still accessible to Lisp programs.
251To begin with, it assumes all the symbols, their values and associated
252function definitions, and any data presently on the stack, are
253accessible. Any objects that can be reached indirectly through other
254accessible objects are also accessible.
b8d4c8d0
GM
255
256 When marking is finished, all objects still unmarked are garbage. No
257matter what the Lisp program or the user does, it is impossible to refer
258to them, since there is no longer a way to reach them. Their space
259might as well be reused, since no one will miss them. The second
260(``sweep'') phase of the garbage collector arranges to reuse them.
261
262@c ??? Maybe add something describing weak hash tables here?
263
264@cindex free list
265 The sweep phase puts unused cons cells onto a @dfn{free list}
266for future allocation; likewise for symbols and markers. It compacts
267the accessible strings so they occupy fewer 8k blocks; then it frees the
f3372c87
DA
268other 8k blocks. Unreachable vectors from vector blocks are coalesced
269to create largest possible free areas; if a free area spans a complete
2704k block, that block is freed. Otherwise, the free area is recorded
271in a free list array, where each entry corresponds to a free list
272of areas of the same size. Large vectors, buffers, and other large
273objects are allocated and freed individually.
b8d4c8d0
GM
274
275@cindex CL note---allocate more storage
276@quotation
277@b{Common Lisp note:} Unlike other Lisps, GNU Emacs Lisp does not
278call the garbage collector when the free list is empty. Instead, it
279simply requests the operating system to allocate more storage, and
280processing continues until @code{gc-cons-threshold} bytes have been
281used.
282
283This means that you can make sure that the garbage collector will not
284run during a certain portion of a Lisp program by calling the garbage
285collector explicitly just before it (provided that portion of the
286program does not use so much space as to force a second garbage
287collection).
288@end quotation
289
290@deffn Command garbage-collect
291This command runs a garbage collection, and returns information on
292the amount of space in use. (Garbage collection can also occur
293spontaneously if you use more than @code{gc-cons-threshold} bytes of
294Lisp data since the previous garbage collection.)
295
74934dcc
DA
296@code{garbage-collect} returns a list with information on amount of space in
297use, where each entry has the form @samp{(@var{name} @var{size} @var{used})}
298or @samp{(@var{name} @var{size} @var{used} @var{free})}. In the entry,
299@var{name} is a symbol describing the kind of objects this entry represents,
300@var{size} is the number of bytes used by each one, @var{used} is the number
301of those objects that were found live in the heap, and optional @var{free} is
302the number of those objects that are not live but that Emacs keeps around for
303future allocations. So an overall result is:
b8d4c8d0
GM
304
305@example
f24f2e22 306((@code{conses} @var{cons-size} @var{used-conses} @var{free-conses})
74934dcc
DA
307 (@code{symbols} @var{symbol-size} @var{used-symbols} @var{free-symbols})
308 (@code{miscs} @var{misc-size} @var{used-miscs} @var{free-miscs})
309 (@code{strings} @var{string-size} @var{used-strings} @var{free-strings})
310 (@code{string-bytes} @var{byte-size} @var{used-bytes})
311 (@code{vectors} @var{vector-size} @var{used-vectors})
312 (@code{vector-slots} @var{slot-size} @var{used-slots} @var{free-slots})
313 (@code{floats} @var{float-size} @var{used-floats} @var{free-floats})
314 (@code{intervals} @var{interval-size} @var{used-intervals} @var{free-intervals})
315 (@code{buffers} @var{buffer-size} @var{used-buffers})
316 (@code{heap} @var{unit-size} @var{total-size} @var{free-size}))
b8d4c8d0
GM
317@end example
318
319Here is an example:
320
321@example
b8d4c8d0 322(garbage-collect)
74934dcc
DA
323 @result{} ((conses 16 49126 8058) (symbols 48 14607 0)
324 (miscs 40 34 56) (strings 32 2942 2607)
325 (string-bytes 1 78607) (vectors 16 7247)
326 (vector-slots 8 341609 29474) (floats 8 71 102)
327 (intervals 56 27 26) (buffers 944 8)
328 (heap 1024 11715 2678))
b8d4c8d0
GM
329@end example
330
74934dcc
DA
331Below is a table explaining each element. Note that last @code{heap} entry
332is optional and present only if an underlying @code{malloc} implementation
333provides @code{mallinfo} function.
b8d4c8d0
GM
334
335@table @var
74934dcc 336@item cons-size
39670ef4 337Internal size of a cons cell, i.e., @code{sizeof (struct Lisp_Cons)}.
74934dcc 338
b8d4c8d0
GM
339@item used-conses
340The number of cons cells in use.
341
342@item free-conses
74934dcc
DA
343The number of cons cells for which space has been obtained from
344the operating system, but that are not currently being used.
b8d4c8d0 345
74934dcc 346@item symbol-size
39670ef4 347Internal size of a symbol, i.e., @code{sizeof (struct Lisp_Symbol)}.
74934dcc
DA
348
349@item used-symbols
b8d4c8d0
GM
350The number of symbols in use.
351
74934dcc
DA
352@item free-symbols
353The number of symbols for which space has been obtained from
354the operating system, but that are not currently being used.
355
356@item misc-size
39670ef4 357Internal size of a miscellaneous entity, i.e.,
74934dcc
DA
358@code{sizeof (union Lisp_Misc)}, which is a size of the
359largest type enumerated in @code{enum Lisp_Misc_Type}.
b8d4c8d0
GM
360
361@item used-miscs
74934dcc
DA
362The number of miscellaneous objects in use. These include markers
363and overlays, plus certain objects not visible to users.
b8d4c8d0
GM
364
365@item free-miscs
366The number of miscellaneous objects for which space has been obtained
367from the operating system, but that are not currently being used.
368
74934dcc 369@item string-size
39670ef4 370Internal size of a string header, i.e., @code{sizeof (struct Lisp_String)}.
74934dcc
DA
371
372@item used-strings
373The number of string headers in use.
374
375@item free-strings
376The number of string headers for which space has been obtained
377from the operating system, but that are not currently being used.
378
379@item byte-size
380This is used for convenience and equals to @code{sizeof (char)}.
381
382@item used-bytes
383The total size of all string data in bytes.
384
385@item vector-size
39670ef4 386Internal size of a vector header, i.e., @code{sizeof (struct Lisp_Vector)}.
74934dcc
DA
387
388@item used-vectors
389The number of vector headers allocated from the vector blocks.
390
391@item slot-size
392Internal size of a vector slot, always equal to @code{sizeof (Lisp_Object)}.
393
394@item used-slots
395The number of slots in all used vectors.
396
397@item free-slots
398The number of free slots in all vector blocks.
b8d4c8d0 399
74934dcc 400@item float-size
39670ef4 401Internal size of a float object, i.e., @code{sizeof (struct Lisp_Float)}.
74934dcc 402(Do not confuse it with the native platform @code{float} or @code{double}.)
b8d4c8d0
GM
403
404@item used-floats
b8d4c8d0
GM
405The number of floats in use.
406
407@item free-floats
74934dcc
DA
408The number of floats for which space has been obtained from
409the operating system, but that are not currently being used.
410
411@item interval-size
39670ef4 412Internal size of an interval object, i.e., @code{sizeof (struct interval)}.
b8d4c8d0
GM
413
414@item used-intervals
74934dcc 415The number of intervals in use.
b8d4c8d0
GM
416
417@item free-intervals
74934dcc
DA
418The number of intervals for which space has been obtained from
419the operating system, but that are not currently being used.
b8d4c8d0 420
74934dcc 421@item buffer-size
39670ef4 422Internal size of a buffer, i.e., @code{sizeof (struct buffer)}.
74934dcc 423(Do not confuse with the value returned by @code{buffer-size} function.)
b8d4c8d0 424
74934dcc
DA
425@item used-buffers
426The number of buffer objects in use. This includes killed buffers
39670ef4 427invisible to users, i.e., all buffers in @code{all_buffers} list.
74934dcc
DA
428
429@item unit-size
430The unit of heap space measurement, always equal to 1024 bytes.
431
432@item total-size
433Total heap size, in @var{unit-size} units.
434
435@item free-size
436Heap space which is not currently used, in @var{unit-size} units.
b8d4c8d0
GM
437@end table
438
999dd333 439If there was overflow in pure space (@pxref{Pure Storage}),
b8d4c8d0 440@code{garbage-collect} returns @code{nil}, because a real garbage
9658dc2a 441collection cannot be done.
b8d4c8d0
GM
442@end deffn
443
444@defopt garbage-collection-messages
445If this variable is non-@code{nil}, Emacs displays a message at the
446beginning and end of garbage collection. The default value is
999dd333 447@code{nil}.
b8d4c8d0
GM
448@end defopt
449
450@defvar post-gc-hook
451This is a normal hook that is run at the end of garbage collection.
452Garbage collection is inhibited while the hook functions run, so be
453careful writing them.
454@end defvar
455
456@defopt gc-cons-threshold
457The value of this variable is the number of bytes of storage that must
458be allocated for Lisp objects after one garbage collection in order to
74934dcc
DA
459trigger another garbage collection. You can use the result returned by
460@code{garbage-collect} to get an information about size of the particular
461object type; space allocated to the contents of buffers does not count.
462Note that the subsequent garbage collection does not happen immediately
463when the threshold is exhausted, but only the next time the Lisp interpreter
464is called.
465
466The initial threshold value is @code{GC_DEFAULT_THRESHOLD}, defined in
467@file{alloc.c}. Since it's defined in @code{word_size} units, the value
468is 400,000 for the default 32-bit configuration and 800,000 for the 64-bit
469one. If you specify a larger value, garbage collection will happen less
470often. This reduces the amount of time spent garbage collecting, but
471increases total memory use. You may want to do this when running a program
472that creates lots of Lisp data.
473
474You can make collections more frequent by specifying a smaller value, down
475to 1/10th of @code{GC_DEFAULT_THRESHOLD}. A value less than this minimum
476will remain in effect only until the subsequent garbage collection, at which
477time @code{garbage-collect} will set the threshold back to the minimum.
b8d4c8d0
GM
478@end defopt
479
480@defopt gc-cons-percentage
481The value of this variable specifies the amount of consing before a
482garbage collection occurs, as a fraction of the current heap size.
483This criterion and @code{gc-cons-threshold} apply in parallel, and
484garbage collection occurs only when both criteria are satisfied.
485
486As the heap size increases, the time to perform a garbage collection
487increases. Thus, it can be desirable to do them less frequently in
488proportion.
489@end defopt
490
491 The value returned by @code{garbage-collect} describes the amount of
492memory used by Lisp data, broken down by data type. By contrast, the
493function @code{memory-limit} provides information on the total amount of
494memory Emacs is currently using.
495
b8d4c8d0
GM
496@defun memory-limit
497This function returns the address of the last byte Emacs has allocated,
498divided by 1024. We divide the value by 1024 to make sure it fits in a
499Lisp integer.
500
501You can use this to get a general idea of how your actions affect the
502memory usage.
503@end defun
504
505@defvar memory-full
d15aac68 506This variable is @code{t} if Emacs is nearly out of memory for Lisp
b8d4c8d0
GM
507objects, and @code{nil} otherwise.
508@end defvar
509
510@defun memory-use-counts
511This returns a list of numbers that count the number of objects
512created in this Emacs session. Each of these counters increments for
513a certain kind of object. See the documentation string for details.
514@end defun
515
516@defvar gcs-done
517This variable contains the total number of garbage collections
518done so far in this Emacs session.
519@end defvar
520
521@defvar gc-elapsed
522This variable contains the total number of seconds of elapsed time
09b73f08
PE
523during garbage collection so far in this Emacs session, as a
524floating-point number.
b8d4c8d0
GM
525@end defvar
526
527@node Memory Usage
528@section Memory Usage
529@cindex memory usage
530
531 These functions and variables give information about the total amount
532of memory allocation that Emacs has done, broken down by data type.
533Note the difference between these and the values returned by
01a6dcc8 534@code{garbage-collect}; those count objects that currently exist, but
b8d4c8d0
GM
535these count the number or size of all allocations, including those for
536objects that have since been freed.
537
538@defvar cons-cells-consed
539The total number of cons cells that have been allocated so far
540in this Emacs session.
541@end defvar
542
543@defvar floats-consed
544The total number of floats that have been allocated so far
545in this Emacs session.
546@end defvar
547
548@defvar vector-cells-consed
549The total number of vector cells that have been allocated so far
550in this Emacs session.
551@end defvar
552
553@defvar symbols-consed
554The total number of symbols that have been allocated so far
555in this Emacs session.
556@end defvar
557
558@defvar string-chars-consed
559The total number of string characters that have been allocated so far
9658dc2a 560in this session.
b8d4c8d0
GM
561@end defvar
562
563@defvar misc-objects-consed
564The total number of miscellaneous objects that have been allocated so
9658dc2a 565far in this session. These include markers and overlays, plus
b8d4c8d0
GM
566certain objects not visible to users.
567@end defvar
568
569@defvar intervals-consed
570The total number of intervals that have been allocated so far
571in this Emacs session.
572@end defvar
573
574@defvar strings-consed
575The total number of strings that have been allocated so far in this
576Emacs session.
577@end defvar
578
76377e46
PE
579@node C Dialect
580@section C Dialect
581@cindex C programming language
582
583The C part of Emacs is portable to C89: C99-specific features such as
584@samp{<stdbool.h>} and @samp{inline} are not used without a check,
585typically at configuration time, and the Emacs build procedure
586provides a substitute implementation if necessary. Some C99 features,
587such as declarations after statements, are too difficult to provide
588substitutes for, so they are avoided entirely.
589
590At some point in the not-too-distant future the base C dialect will
591change from C89 to C99, and eventually it will no doubt change to C11.
592
b8d4c8d0 593@node Writing Emacs Primitives
520f2425 594@section Writing Emacs Primitives
b8d4c8d0
GM
595@cindex primitive function internals
596@cindex writing Emacs primitives
597
1df7defd 598 Lisp primitives are Lisp functions implemented in C@. The details of
b8d4c8d0
GM
599interfacing the C function so that Lisp can call it are handled by a few
600C macros. The only way to really understand how to write new C code is
601to read the source, but we can explain some things here.
602
603 An example of a special form is the definition of @code{or}, from
604@file{eval.c}. (An ordinary function would have the same general
605appearance.)
606
607@cindex garbage collection protection
608@smallexample
609@group
610DEFUN ("or", For, Sor, 0, UNEVALLED, 0,
d15aac68
CY
611 doc: /* Eval args until one of them yields non-nil, then return
612that value.
613The remaining args are not evalled at all.
b8d4c8d0
GM
614If all args return nil, return nil.
615@end group
616@group
617usage: (or CONDITIONS ...) */)
b88746ba 618 (Lisp_Object args)
b8d4c8d0
GM
619@{
620 register Lisp_Object val = Qnil;
621 struct gcpro gcpro1;
622@end group
623
624@group
625 GCPRO1 (args);
626@end group
627
628@group
629 while (CONSP (args))
630 @{
7d2d7cc0 631 val = eval_sub (XCAR (args));
b8d4c8d0
GM
632 if (!NILP (val))
633 break;
634 args = XCDR (args);
635 @}
636@end group
637
638@group
639 UNGCPRO;
640 return val;
641@}
642@end group
643@end smallexample
644
645@cindex @code{DEFUN}, C macro to define Lisp primitives
646 Let's start with a precise explanation of the arguments to the
647@code{DEFUN} macro. Here is a template for them:
648
649@example
650DEFUN (@var{lname}, @var{fname}, @var{sname}, @var{min}, @var{max}, @var{interactive}, @var{doc})
651@end example
652
653@table @var
654@item lname
655This is the name of the Lisp symbol to define as the function name; in
656the example above, it is @code{or}.
657
658@item fname
d15aac68
CY
659This is the C function name for this function. This is the name that
660is used in C code for calling the function. The name is, by
661convention, @samp{F} prepended to the Lisp name, with all dashes
662(@samp{-}) in the Lisp name changed to underscores. Thus, to call
663this function from C code, call @code{For}.
b8d4c8d0
GM
664
665@item sname
666This is a C variable name to use for a structure that holds the data for
667the subr object that represents the function in Lisp. This structure
668conveys the Lisp symbol name to the initialization routine that will
669create the symbol and store the subr object as its definition. By
670convention, this name is always @var{fname} with @samp{F} replaced with
671@samp{S}.
672
673@item min
674This is the minimum number of arguments that the function requires. The
675function @code{or} allows a minimum of zero arguments.
676
677@item max
678This is the maximum number of arguments that the function accepts, if
679there is a fixed maximum. Alternatively, it can be @code{UNEVALLED},
680indicating a special form that receives unevaluated arguments, or
681@code{MANY}, indicating an unlimited number of evaluated arguments (the
682equivalent of @code{&rest}). Both @code{UNEVALLED} and @code{MANY} are
9658dc2a
GM
683macros. If @var{max} is a number, it must be more than @var{min} but
684less than 8.
b8d4c8d0 685
84ebefe9 686@cindex interactive specification in primitives
b8d4c8d0 687@item interactive
84ebefe9
XF
688This is an interactive specification, a string such as might be used
689as the argument of @code{interactive} in a Lisp function. In the case
690of @code{or}, it is 0 (a null pointer), indicating that @code{or}
b02b5481
GM
691cannot be called interactively. A value of @code{""} indicates a
692function that should receive no arguments when called interactively.
84ebefe9
XF
693If the value begins with a @samp{"(}, the string is evaluated as a
694Lisp form. For example:
695
b02b5481 696@example
84ebefe9 697@group
b02b5481
GM
698DEFUN ("foo", Ffoo, Sfoo, 0, UNEVALLED,
699 "(list (read-char-by-name \"Insert character: \")\
84ebefe9
XF
700 (prefix-numeric-value current-prefix-arg)\
701 t))",
702 doc: /* @dots{} /*)
703@end group
b02b5481 704@end example
b8d4c8d0
GM
705
706@item doc
707This is the documentation string. It uses C comment syntax rather
708than C string syntax because comment syntax requires nothing special
709to include multiple lines. The @samp{doc:} identifies the comment
710that follows as the documentation string. The @samp{/*} and @samp{*/}
711delimiters that begin and end the comment are not part of the
712documentation string.
713
714If the last line of the documentation string begins with the keyword
715@samp{usage:}, the rest of the line is treated as the argument list
716for documentation purposes. This way, you can use different argument
717names in the documentation string from the ones used in the C code.
718@samp{usage:} is required if the function has an unlimited number of
719arguments.
720
721All the usual rules for documentation strings in Lisp code
722(@pxref{Documentation Tips}) apply to C code documentation strings
723too.
724@end table
725
b88746ba 726 After the call to the @code{DEFUN} macro, you must write the
d15aac68
CY
727argument list for the C function, including the types for the
728arguments. If the primitive accepts a fixed maximum number of Lisp
729arguments, there must be one C argument for each Lisp argument, and
730each argument must be of type @code{Lisp_Object}. (Various macros and
731functions for creating values of type @code{Lisp_Object} are declared
732in the file @file{lisp.h}.) If the primitive has no upper limit on
733the number of Lisp arguments, it must have exactly two C arguments:
734the first is the number of Lisp arguments, and the second is the
735address of a block containing their values. These have types
39670ef4 736@code{int} and @w{@code{Lisp_Object *}} respectively. Since
74934dcc
DA
737@code{Lisp_Object} can hold any Lisp object of any data type, you
738can determine the actual data type only at run time; so if you want
739a primitive to accept only a certain type of argument, you must check
740the type explicitly using a suitable predicate (@pxref{Type Predicates}).
741@cindex type checking internals
b8d4c8d0
GM
742
743@cindex @code{GCPRO} and @code{UNGCPRO}
744@cindex protect C variables from garbage collection
745 Within the function @code{For} itself, note the use of the macros
d15aac68
CY
746@code{GCPRO1} and @code{UNGCPRO}. These macros are defined for the
747sake of the few platforms which do not use Emacs' default
748stack-marking garbage collector. The @code{GCPRO1} macro ``protects''
749a variable from garbage collection, explicitly informing the garbage
750collector that that variable and all its contents must be as
751accessible. GC protection is necessary in any function which can
752perform Lisp evaluation by calling @code{eval_sub} or @code{Feval} as
753a subroutine, either directly or indirectly.
b8d4c8d0
GM
754
755 It suffices to ensure that at least one pointer to each object is
d15aac68 756GC-protected. Thus, a particular local variable can do without
b8d4c8d0 757protection if it is certain that the object it points to will be
7d2d7cc0 758preserved by some other pointer (such as another local variable that
d15aac68
CY
759has a @code{GCPRO}). Otherwise, the local variable needs a
760@code{GCPRO}.
b8d4c8d0
GM
761
762 The macro @code{GCPRO1} protects just one local variable. If you
763want to protect two variables, use @code{GCPRO2} instead; repeating
764@code{GCPRO1} will not work. Macros @code{GCPRO3}, @code{GCPRO4},
765@code{GCPRO5}, and @code{GCPRO6} also exist. All these macros
766implicitly use local variables such as @code{gcpro1}; you must declare
767these explicitly, with type @code{struct gcpro}. Thus, if you use
768@code{GCPRO2}, you must declare @code{gcpro1} and @code{gcpro2}.
b8d4c8d0
GM
769
770 @code{UNGCPRO} cancels the protection of the variables that are
771protected in the current function. It is necessary to do this
772explicitly.
773
b8d4c8d0
GM
774 You must not use C initializers for static or global variables unless
775the variables are never written once Emacs is dumped. These variables
776with initializers are allocated in an area of memory that becomes
777read-only (on certain operating systems) as a result of dumping Emacs.
778@xref{Pure Storage}.
779
b8d4c8d0
GM
780@cindex @code{defsubr}, Lisp symbol for a primitive
781 Defining the C function is not enough to make a Lisp primitive
782available; you must also create the Lisp symbol for the primitive and
783store a suitable subr object in its function cell. The code looks like
784this:
785
786@example
7d2d7cc0 787defsubr (&@var{sname});
b8d4c8d0
GM
788@end example
789
790@noindent
7d2d7cc0 791Here @var{sname} is the name you used as the third argument to @code{DEFUN}.
b8d4c8d0
GM
792
793 If you add a new primitive to a file that already has Lisp primitives
794defined in it, find the function (near the end of the file) named
795@code{syms_of_@var{something}}, and add the call to @code{defsubr}
796there. If the file doesn't have this function, or if you create a new
797file, add to it a @code{syms_of_@var{filename}} (e.g.,
798@code{syms_of_myfile}). Then find the spot in @file{emacs.c} where all
799of these functions are called, and add a call to
800@code{syms_of_@var{filename}} there.
801
802@anchor{Defining Lisp variables in C}
803@vindex byte-boolean-vars
804@cindex defining Lisp variables in C
805@cindex @code{DEFVAR_INT}, @code{DEFVAR_LISP}, @code{DEFVAR_BOOL}
806 The function @code{syms_of_@var{filename}} is also the place to define
807any C variables that are to be visible as Lisp variables.
808@code{DEFVAR_LISP} makes a C variable of type @code{Lisp_Object} visible
809in Lisp. @code{DEFVAR_INT} makes a C variable of type @code{int}
810visible in Lisp with a value that is always an integer.
811@code{DEFVAR_BOOL} makes a C variable of type @code{int} visible in Lisp
812with a value that is either @code{t} or @code{nil}. Note that variables
813defined with @code{DEFVAR_BOOL} are automatically added to the list
814@code{byte-boolean-vars} used by the byte compiler.
815
7d2d7cc0
GM
816@cindex defining customization variables in C
817 If you want to make a Lisp variables that is defined in C behave
818like one declared with @code{defcustom}, add an appropriate entry to
819@file{cus-start.el}.
820
b8d4c8d0
GM
821@cindex @code{staticpro}, protection from GC
822 If you define a file-scope C variable of type @code{Lisp_Object},
823you must protect it from garbage-collection by calling @code{staticpro}
824in @code{syms_of_@var{filename}}, like this:
825
826@example
827staticpro (&@var{variable});
828@end example
829
830 Here is another example function, with more complicated arguments.
831This comes from the code in @file{window.c}, and it demonstrates the use
832of macros and functions to manipulate Lisp objects.
833
834@smallexample
835@group
836DEFUN ("coordinates-in-window-p", Fcoordinates_in_window_p,
7d2d7cc0
GM
837 Scoordinates_in_window_p, 2, 2, 0,
838 doc: /* Return non-nil if COORDINATES are in WINDOW.
839 ...
b8d4c8d0
GM
840@end group
841@group
7d2d7cc0
GM
842 or `right-margin' is returned. */)
843 (register Lisp_Object coordinates, Lisp_Object window)
b8d4c8d0 844@{
7d2d7cc0
GM
845 struct window *w;
846 struct frame *f;
b8d4c8d0 847 int x, y;
7d2d7cc0 848 Lisp_Object lx, ly;
b8d4c8d0
GM
849@end group
850
851@group
7d2d7cc0
GM
852 CHECK_LIVE_WINDOW (window);
853 w = XWINDOW (window);
854 f = XFRAME (w->frame);
855 CHECK_CONS (coordinates);
856 lx = Fcar (coordinates);
857 ly = Fcdr (coordinates);
858 CHECK_NUMBER_OR_FLOAT (lx);
859 CHECK_NUMBER_OR_FLOAT (ly);
860 x = FRAME_PIXEL_X_FROM_CANON_X (f, lx) + FRAME_INTERNAL_BORDER_WIDTH(f);
861 y = FRAME_PIXEL_Y_FROM_CANON_Y (f, ly) + FRAME_INTERNAL_BORDER_WIDTH(f);
b8d4c8d0
GM
862@end group
863
864@group
7d2d7cc0 865 switch (coordinates_in_window (w, x, y))
b8d4c8d0 866 @{
7d2d7cc0 867 case ON_NOTHING: /* NOT in window at all. */
b8d4c8d0
GM
868 return Qnil;
869@end group
870
7d2d7cc0 871 ...
b8d4c8d0
GM
872
873@group
7d2d7cc0 874 case ON_MODE_LINE: /* In mode line of window. */
b8d4c8d0
GM
875 return Qmode_line;
876@end group
877
7d2d7cc0
GM
878 ...
879
b8d4c8d0 880@group
7d2d7cc0
GM
881 case ON_SCROLL_BAR: /* On scroll-bar of window. */
882 /* Historically we are supposed to return nil in this case. */
883 return Qnil;
b8d4c8d0
GM
884@end group
885
886@group
887 default:
888 abort ();
889 @}
890@}
891@end group
892@end smallexample
893
894 Note that C code cannot call functions by name unless they are defined
1df7defd 895in C@. The way to call a function written in Lisp is to use
b8d4c8d0
GM
896@code{Ffuncall}, which embodies the Lisp function @code{funcall}. Since
897the Lisp function @code{funcall} accepts an unlimited number of
898arguments, in C it takes two: the number of Lisp-level arguments, and a
899one-dimensional array containing their values. The first Lisp-level
900argument is the Lisp function to call, and the rest are the arguments to
901pass to it. Since @code{Ffuncall} can call the evaluator, you must
902protect pointers from garbage collection around the call to
903@code{Ffuncall}.
904
905 The C functions @code{call0}, @code{call1}, @code{call2}, and so on,
906provide handy ways to call a Lisp function conveniently with a fixed
907number of arguments. They work by calling @code{Ffuncall}.
908
909 @file{eval.c} is a very good file to look through for examples;
910@file{lisp.h} contains the definitions for some important macros and
911functions.
912
913 If you define a function which is side-effect free, update the code
7d2d7cc0 914in @file{byte-opt.el} that binds @code{side-effect-free-fns} and
b8d4c8d0
GM
915@code{side-effect-and-error-free-fns} so that the compiler optimizer
916knows about it.
917
918@node Object Internals
520f2425 919@section Object Internals
b8d4c8d0
GM
920@cindex object internals
921
74934dcc 922 Emacs Lisp provides a rich set of the data types. Some of them, like cons
f24f2e22 923cells, integers and strings, are common to nearly all Lisp dialects. Some
74934dcc
DA
924others, like markers and buffers, are quite special and needed to provide
925the basic support to write editor commands in Lisp. To implement such
926a variety of object types and provide an efficient way to pass objects between
927the subsystems of an interpreter, there is a set of C data structures and
928a special type to represent the pointers to all of them, which is known as
929@dfn{tagged pointer}.
930
931 In C, the tagged pointer is an object of type @code{Lisp_Object}. Any
932initialized variable of such a type always holds the value of one of the
933following basic data types: integer, symbol, string, cons cell, float,
934vectorlike or miscellaneous object. Each of these data types has the
935corresponding tag value. All tags are enumerated by @code{enum Lisp_Type}
936and placed into a 3-bit bitfield of the @code{Lisp_Object}. The rest of the
09b73f08 937bits is the value itself. Integers are immediate, i.e., directly
74934dcc
DA
938represented by those @dfn{value bits}, and all other objects are represented
939by the C pointers to a corresponding object allocated from the heap. Width
940of the @code{Lisp_Object} is platform- and configuration-dependent: usually
39670ef4 941it's equal to the width of an underlying platform pointer (i.e., 32-bit on
74934dcc
DA
942a 32-bit machine and 64-bit on a 64-bit one), but also there is a special
943configuration where @code{Lisp_Object} is 64-bit but all pointers are 32-bit.
944The latter trick was designed to overcome the limited range of values for
945Lisp integers on a 32-bit system by using 64-bit @code{long long} type for
946@code{Lisp_Object}.
947
948 The following C data structures are defined in @file{lisp.h} to represent
949the basic data types beyond integers:
950
951@table @code
952@item struct Lisp_Cons
953Cons cell, an object used to construct lists.
954
955@item struct Lisp_String
956String, the basic object to represent a sequence of characters.
957
958@item struct Lisp_Vector
959Array, a fixed-size set of Lisp objects which may be accessed by an index.
960
961@item struct Lisp_Symbol
962Symbol, the unique-named entity commonly used as an identifier.
963
964@item struct Lisp_Float
09b73f08 965Floating-point value.
74934dcc
DA
966
967@item union Lisp_Misc
968Miscellaneous kinds of objects which don't fit into any of the above.
969@end table
970
971 These types are the first-class citizens of an internal type system.
972Since the tag space is limited, all other types are the subtypes of either
973@code{Lisp_Vectorlike} or @code{Lisp_Misc}. Vector subtypes are enumerated
974by @code{enum pvec_type}, and nearly all complex objects like windows, buffers,
975frames, and processes fall into this category. The rest of special types,
976including markers and overlays, are enumerated by @code{enum Lisp_Misc_Type}
977and form the set of subtypes of @code{Lisp_Misc}.
978
979 Below there is a description of a few subtypes of @code{Lisp_Vectorlike}.
980Buffer object represents the text to display and edit. Window is the part
981of display structure which shows the buffer or used as a container to
982recursively place other windows on the same frame. (Do not confuse Emacs Lisp
983window object with the window as an entity managed by the user interface
984system like X; in Emacs terminology, the latter is called frame.) Finally,
985process object is used to manage the subprocesses.
b8d4c8d0
GM
986
987@menu
988* Buffer Internals:: Components of a buffer structure.
989* Window Internals:: Components of a window structure.
990* Process Internals:: Components of a process structure.
991@end menu
992
993@node Buffer Internals
520f2425 994@subsection Buffer Internals
b8d4c8d0
GM
995@cindex internals, of buffer
996@cindex buffer internals
997
7d2d7cc0 998 Two structures (see @file{buffer.h}) are used to represent buffers
1df7defd 999in C@. The @code{buffer_text} structure contains fields describing the
7d2d7cc0
GM
1000text of a buffer; the @code{buffer} structure holds other fields. In
1001the case of indirect buffers, two or more @code{buffer} structures
1002reference the same @code{buffer_text} structure.
b8d4c8d0 1003
c773345a 1004Here are some of the fields in @code{struct buffer_text}:
b8d4c8d0
GM
1005
1006@table @code
1007@item beg
c773345a 1008The address of the buffer contents.
b8d4c8d0
GM
1009
1010@item gpt
c773345a
CY
1011@itemx gpt_byte
1012The character and byte positions of the buffer gap. @xref{Buffer
1013Gap}.
b8d4c8d0
GM
1014
1015@item z
c773345a
CY
1016@itemx z_byte
1017The character and byte positions of the end of the buffer text.
b8d4c8d0
GM
1018
1019@item gap_size
c773345a 1020The size of buffer's gap. @xref{Buffer Gap}.
b8d4c8d0
GM
1021
1022@item modiff
c773345a
CY
1023@itemx save_modiff
1024@itemx chars_modiff
1025@itemx overlay_modiff
1026These fields count the number of buffer-modification events performed
1027in this buffer. @code{modiff} is incremented after each
1028buffer-modification event, and is never otherwise changed;
1029@code{save_modiff} contains the value of @code{modiff} the last time
1030the buffer was visited or saved; @code{chars_modiff} counts only
1031modifications to the characters in the buffer, ignoring all other
1032kinds of changes; and @code{overlay_modiff} counts only modifications
1033to the overlays.
b8d4c8d0
GM
1034
1035@item beg_unchanged
c773345a
CY
1036@itemx end_unchanged
1037The number of characters at the start and end of the text that are
1038known to be unchanged since the last complete redisplay.
b8d4c8d0
GM
1039
1040@item unchanged_modified
c773345a
CY
1041@itemx overlay_unchanged_modified
1042The values of @code{modiff} and @code{overlay_modiff}, respectively,
da6062e6 1043after the last complete redisplay. If their current values match
c773345a 1044@code{modiff} or @code{overlay_modiff}, that means
b8d4c8d0
GM
1045@code{beg_unchanged} and @code{end_unchanged} contain no useful
1046information.
1047
1048@item markers
1049The markers that refer to this buffer. This is actually a single
1050marker, and successive elements in its marker @code{chain} are the other
1051markers referring to this buffer text.
1052
1053@item intervals
c773345a 1054The interval tree which records the text properties of this buffer.
b8d4c8d0
GM
1055@end table
1056
c773345a 1057Some of the fields of @code{struct buffer} are:
b8d4c8d0
GM
1058
1059@table @code
7d2d7cc0 1060@item header
74934dcc
DA
1061A header of type @code{struct vectorlike_header} is common to all
1062vectorlike objects.
b8d4c8d0
GM
1063
1064@item own_text
c773345a
CY
1065A @code{struct buffer_text} structure that ordinarily holds the buffer
1066contents. In indirect buffers, this field is not used.
b8d4c8d0
GM
1067
1068@item text
c773345a
CY
1069A pointer to the @code{buffer_text} structure for this buffer. In an
1070ordinary buffer, this is the @code{own_text} field above. In an
1071indirect buffer, this is the @code{own_text} field of the base buffer.
b8d4c8d0 1072
74934dcc
DA
1073@item next
1074A pointer to the next buffer, in the chain of all buffers, including
1075killed buffers. This chain is used only for allocation and garbage
1076collection, in order to collect killed buffers properly.
1077
b8d4c8d0 1078@item pt
c773345a
CY
1079@itemx pt_byte
1080The character and byte positions of point in a buffer.
b8d4c8d0
GM
1081
1082@item begv
c773345a
CY
1083@itemx begv_byte
1084The character and byte positions of the beginning of the accessible
1085range of text in the buffer.
b8d4c8d0
GM
1086
1087@item zv
c773345a
CY
1088@itemx zv_byte
1089The character and byte positions of the end of the accessible range of
1090text in the buffer.
b8d4c8d0
GM
1091
1092@item base_buffer
1093In an indirect buffer, this points to the base buffer. In an ordinary
1094buffer, it is null.
1095
c773345a
CY
1096@item local_flags
1097This field contains flags indicating that certain variables are local
1098in this buffer. Such variables are declared in the C code using
1099@code{DEFVAR_PER_BUFFER}, and their buffer-local bindings are stored
1100in fields in the buffer structure itself. (Some of these fields are
b8d4c8d0
GM
1101described in this table.)
1102
1103@item modtime
c773345a
CY
1104The modification time of the visited file. It is set when the file is
1105written or read. Before writing the buffer into a file, this field is
1106compared to the modification time of the file to see if the file has
1107changed on disk. @xref{Buffer Modification}.
b8d4c8d0
GM
1108
1109@item auto_save_modified
c773345a 1110The time when the buffer was last auto-saved.
b8d4c8d0
GM
1111
1112@item last_window_start
c773345a
CY
1113The @code{window-start} position in the buffer as of the last time the
1114buffer was displayed in a window.
b8d4c8d0
GM
1115
1116@item clip_changed
c773345a
CY
1117This flag indicates that narrowing has changed in the buffer.
1118@xref{Narrowing}.
b8d4c8d0
GM
1119
1120@item prevent_redisplay_optimizations_p
c773345a
CY
1121This flag indicates that redisplay optimizations should not be used to
1122display this buffer.
b8d4c8d0 1123
c773345a
CY
1124@item overlay_center
1125This field holds the current overlay center position. @xref{Managing
1126Overlays}.
1127
1128@item overlays_before
1129@itemx overlays_after
1130These fields hold, respectively, a list of overlays that end at or
1131before the current overlay center, and a list of overlays that end
1132after the current overlay center. @xref{Managing Overlays}.
1133@code{overlays_before} is sorted in order of decreasing end position,
1134and @code{overlays_after} is sorted in order of increasing beginning
1135position.
b8d4c8d0 1136
7d2d7cc0
GM
1137@c FIXME? the following are now all Lisp_Object BUFFER_INTERNAL_FIELD (foo).
1138
b8d4c8d0 1139@item name
c773345a
CY
1140A Lisp string that names the buffer. It is guaranteed to be unique.
1141@xref{Buffer Names}.
b8d4c8d0 1142
c773345a
CY
1143@item save_length
1144The length of the file this buffer is visiting, when last read or
1145saved. This and other fields concerned with saving are not kept in
1146the @code{buffer_text} structure because indirect buffers are never
1147saved.
b8d4c8d0
GM
1148
1149@item directory
c773345a
CY
1150The directory for expanding relative file names. This is the value of
1151the buffer-local variable @code{default-directory} (@pxref{File Name Expansion}).
b8d4c8d0 1152
c773345a
CY
1153@item filename
1154The name of the file visited in this buffer, or @code{nil}. This is
1155the value of the buffer-local variable @code{buffer-file-name}
1156(@pxref{Buffer File Name}).
b8d4c8d0 1157
c773345a
CY
1158@item undo_list
1159@itemx backed_up
1160@itemx auto_save_file_name
7d2d7cc0 1161@itemx auto_save_file_format
c773345a
CY
1162@itemx read_only
1163@itemx file_format
1164@itemx file_truename
1165@itemx invisibility_spec
1166@itemx display_count
1167@itemx display_time
1168These fields store the values of Lisp variables that are automatically
1169buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1170variable names have the additional prefix @code{buffer-} and have
1171underscores replaced with dashes. For instance, @code{undo_list}
29157371 1172stores the value of @code{buffer-undo-list}.
b8d4c8d0
GM
1173
1174@item mark
c773345a
CY
1175The mark for the buffer. The mark is a marker, hence it is also
1176included on the list @code{markers}. @xref{The Mark}.
b8d4c8d0
GM
1177
1178@item local_var_alist
c773345a
CY
1179The association list describing the buffer-local variable bindings of
1180this buffer, not including the built-in buffer-local bindings that
1181have special slots in the buffer object. (Those slots are omitted
1182from this table.) @xref{Buffer-Local Variables}.
b8d4c8d0
GM
1183
1184@item major_mode
1185Symbol naming the major mode of this buffer, e.g., @code{lisp-mode}.
1186
1187@item mode_name
c773345a 1188Pretty name of the major mode, e.g., @code{"Lisp"}.
b8d4c8d0
GM
1189
1190@item keymap
c773345a
CY
1191@itemx abbrev_table
1192@itemx syntax_table
1193@itemx category_table
1194@itemx display_table
1195These fields store the buffer's local keymap (@pxref{Keymaps}), abbrev
1196table (@pxref{Abbrev Tables}), syntax table (@pxref{Syntax Tables}),
1197category table (@pxref{Categories}), and display table (@pxref{Display
1198Tables}).
b8d4c8d0
GM
1199
1200@item downcase_table
c773345a
CY
1201@itemx upcase_table
1202@itemx case_canon_table
1203These fields store the conversion tables for converting text to lower
1204case, upper case, and for canonicalizing text for case-fold search.
b8d4c8d0
GM
1205@xref{Case Tables}.
1206
b8d4c8d0
GM
1207@item minor_modes
1208An alist of the minor modes of this buffer.
1209
b8d4c8d0 1210@item pt_marker
c773345a
CY
1211@itemx begv_marker
1212@itemx zv_marker
1213These fields are only used in an indirect buffer, or in a buffer that
1214is the base of an indirect buffer. Each holds a marker that records
1215@code{pt}, @code{begv}, and @code{zv} respectively, for this buffer
b8d4c8d0
GM
1216when the buffer is not current.
1217
c773345a
CY
1218@item mode_line_format
1219@itemx header_line_format
1220@itemx case_fold_search
1221@itemx tab_width
1222@itemx fill_column
1223@itemx left_margin
1224@itemx auto_fill_function
c773345a
CY
1225@itemx truncate_lines
1226@itemx word_wrap
1227@itemx ctl_arrow
7d2d7cc0
GM
1228@itemx bidi_display_reordering
1229@itemx bidi_paragraph_direction
c773345a
CY
1230@itemx selective_display
1231@itemx selective_display_ellipses
1232@itemx overwrite_mode
1233@itemx abbrev_mode
c773345a
CY
1234@itemx mark_active
1235@itemx enable_multibyte_characters
1236@itemx buffer_file_coding_system
c773345a
CY
1237@itemx cache_long_line_scans
1238@itemx point_before_scroll
1239@itemx left_fringe_width
1240@itemx right_fringe_width
1241@itemx fringes_outside_margins
1242@itemx scroll_bar_width
1243@itemx indicate_empty_lines
1244@itemx indicate_buffer_boundaries
1245@itemx fringe_indicator_alist
1246@itemx fringe_cursor_alist
1247@itemx scroll_up_aggressively
1248@itemx scroll_down_aggressively
1249@itemx cursor_type
1250@itemx cursor_in_non_selected_windows
1251These fields store the values of Lisp variables that are automatically
1252buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1253variable names have underscores replaced with dashes. For instance,
1254@code{mode_line_format} stores the value of @code{mode-line-format}.
b8d4c8d0
GM
1255
1256@item last_selected_window
1257This is the last window that was selected with this buffer in it, or @code{nil}
1258if that window no longer displays this buffer.
b8d4c8d0
GM
1259@end table
1260
1261@node Window Internals
520f2425 1262@subsection Window Internals
b8d4c8d0
GM
1263@cindex internals, of window
1264@cindex window internals
1265
7d2d7cc0
GM
1266 The fields of a window (for a complete list, see the definition of
1267@code{struct window} in @file{window.h}) include:
b8d4c8d0
GM
1268
1269@table @code
1270@item frame
1271The frame that this window is on.
1272
1273@item mini_p
1274Non-@code{nil} if this window is a minibuffer window.
1275
1276@item parent
1277Internally, Emacs arranges windows in a tree; each group of siblings has
1278a parent window whose area includes all the siblings. This field points
1279to a window's parent.
1280
1281Parent windows do not display buffers, and play little role in display
1282except to shape their child windows. Emacs Lisp programs usually have
1283no access to the parent windows; they operate on the windows at the
1284leaves of the tree, which actually display buffers.
1285
37b2bf43
XF
1286@c FIXME: These two slots and the `buffer' slot below were replaced
1287@c with a single slot `contents' on 2013-03-28. --xfq
b8d4c8d0 1288@item hchild
ee2d5b5e
CY
1289@itemx vchild
1290These fields contain the window's leftmost child and its topmost child
1291respectively. @code{hchild} is used if the window is subdivided
1292horizontally by child windows, and @code{vchild} if it is subdivided
7d2d7cc0 1293vertically. In a live window, only one of @code{hchild}, @code{vchild},
1df7defd 1294and @code{buffer} (q.v.@:) is non-@code{nil}.
b8d4c8d0
GM
1295
1296@item next
ee2d5b5e
CY
1297@itemx prev
1298The next sibling and previous sibling of this window. @code{next} is
520f2425
GM
1299@code{nil} if the window is the right-most or bottom-most in its group;
1300@code{prev} is @code{nil} if it is the left-most or top-most in its
ee2d5b5e
CY
1301group.
1302
1303@item left_col
1304The left-hand edge of the window, measured in columns, relative to the
1305leftmost column in the frame (column 0).
1306
1307@item top_line
1308The top edge of the window, measured in lines, relative to the topmost
1309line in the frame (line 0).
1310
1311@item total_cols
1312@itemx total_lines
1313The width and height of the window, measured in columns and lines
1314respectively. The width includes the scroll bar and fringes, and/or
1315the separator line on the right of the window (if any).
b8d4c8d0
GM
1316
1317@item buffer
ee2d5b5e 1318The buffer that the window is displaying.
b8d4c8d0
GM
1319
1320@item start
ee2d5b5e
CY
1321A marker pointing to the position in the buffer that is the first
1322character displayed in the window.
b8d4c8d0
GM
1323
1324@item pointm
1325@cindex window point internals
1326This is the value of point in the current buffer when this window is
1327selected; when it is not selected, it retains its previous value.
1328
1329@item force_start
1330If this flag is non-@code{nil}, it says that the window has been
1331scrolled explicitly by the Lisp program. This affects what the next
1332redisplay does if point is off the screen: instead of scrolling the
1333window to show the text around point, it moves point to a location that
1334is on the screen.
1335
1336@item frozen_window_start_p
1337This field is set temporarily to 1 to indicate to redisplay that
1338@code{start} of this window should not be changed, even if point
1339gets invisible.
1340
1341@item start_at_line_beg
1342Non-@code{nil} means current value of @code{start} was the beginning of a line
1343when it was chosen.
1344
b8d4c8d0
GM
1345@item use_time
1346This is the last time that the window was selected. The function
1347@code{get-lru-window} uses this field.
1348
1349@item sequence_number
1350A unique number assigned to this window when it was created.
1351
1352@item last_modified
1353The @code{modiff} field of the window's buffer, as of the last time
1354a redisplay completed in this window.
1355
1356@item last_overlay_modified
1357The @code{overlay_modiff} field of the window's buffer, as of the last
1358time a redisplay completed in this window.
1359
1360@item last_point
1361The buffer's value of point, as of the last time a redisplay completed
1362in this window.
1363
1364@item last_had_star
1365A non-@code{nil} value means the window's buffer was ``modified'' when the
1366window was last updated.
1367
1368@item vertical_scroll_bar
1369This window's vertical scroll bar.
1370
7d2d7cc0
GM
1371@item left_margin_cols
1372@itemx right_margin_cols
ee2d5b5e 1373The widths of the left and right margins in this window. A value of
7d2d7cc0
GM
1374@code{nil} means no margin.
1375
1376@item left_fringe_width
1377@itemx right_fringe_width
1378The widths of the left and right fringes in this window. A value of
1379@code{nil} or @code{t} means use the values of the frame.
1380
1381@item fringes_outside_margins
1382A non-@code{nil} value means the fringes outside the display margins;
1383othersize they are between the margin and the text.
b8d4c8d0
GM
1384
1385@item window_end_pos
1386This is computed as @code{z} minus the buffer position of the last glyph
1387in the current matrix of the window. The value is only valid if
1388@code{window_end_valid} is not @code{nil}.
1389
1390@item window_end_bytepos
1391The byte position corresponding to @code{window_end_pos}.
1392
1393@item window_end_vpos
1394The window-relative vertical position of the line containing
1395@code{window_end_pos}.
1396
1397@item window_end_valid
1398This field is set to a non-@code{nil} value if @code{window_end_pos} is truly
7d2d7cc0 1399valid. This is @code{nil} if nontrivial redisplay is pre-empted, since in that
b8d4c8d0
GM
1400case the display that @code{window_end_pos} was computed for did not get
1401onto the screen.
1402
b8d4c8d0
GM
1403@item cursor
1404A structure describing where the cursor is in this window.
1405
1406@item last_cursor
1407The value of @code{cursor} as of the last redisplay that finished.
1408
1409@item phys_cursor
1410A structure describing where the cursor of this window physically is.
1411
1412@item phys_cursor_type
7d2d7cc0
GM
1413@c FIXME What is this?
1414@c itemx phys_cursor_ascent
1415@itemx phys_cursor_height
1416@itemx phys_cursor_width
1417The type, height, and width of the cursor that was last displayed on
1418this window.
b8d4c8d0
GM
1419
1420@item phys_cursor_on_p
1421This field is non-zero if the cursor is physically on.
1422
1423@item cursor_off_p
7d2d7cc0
GM
1424Non-zero means the cursor in this window is logically off. This is
1425used for blinking the cursor.
b8d4c8d0
GM
1426
1427@item last_cursor_off_p
1428This field contains the value of @code{cursor_off_p} as of the time of
1429the last redisplay.
1430
1431@item must_be_updated_p
1432This is set to 1 during redisplay when this window must be updated.
1433
1434@item hscroll
1435This is the number of columns that the display in the window is scrolled
1436horizontally to the left. Normally, this is 0.
1437
1438@item vscroll
1439Vertical scroll amount, in pixels. Normally, this is 0.
1440
1441@item dedicated
1442Non-@code{nil} if this window is dedicated to its buffer.
1443
1444@item display_table
1445The window's display table, or @code{nil} if none is specified for it.
1446
1447@item update_mode_line
1448Non-@code{nil} means this window's mode line needs to be updated.
1449
1450@item base_line_number
1451The line number of a certain position in the buffer, or @code{nil}.
1452This is used for displaying the line number of point in the mode line.
1453
1454@item base_line_pos
1455The position in the buffer for which the line number is known, or
7d2d7cc0
GM
1456@code{nil} meaning none is known. If it is a buffer, don't display
1457the line number as long as the window shows that buffer.
b8d4c8d0 1458
b8d4c8d0
GM
1459@item column_number_displayed
1460The column number currently displayed in this window's mode line, or @code{nil}
1461if column numbers are not being displayed.
1462
1463@item current_matrix
7d2d7cc0
GM
1464@itemx desired_matrix
1465Glyph matrices describing the current and desired display of this window.
b8d4c8d0
GM
1466@end table
1467
1468@node Process Internals
520f2425 1469@subsection Process Internals
b8d4c8d0
GM
1470@cindex internals, of process
1471@cindex process internals
1472
7d2d7cc0
GM
1473 The fields of a process (for a complete list, see the definition of
1474@code{struct Lisp_Process} in @file{process.h}) include:
b8d4c8d0
GM
1475
1476@table @code
1477@item name
1478A string, the name of the process.
1479
1480@item command
1481A list containing the command arguments that were used to start this
c73e02fa
GM
1482process. For a network or serial process, it is @code{nil} if the
1483process is running or @code{t} if the process is stopped.
b8d4c8d0
GM
1484
1485@item filter
458e643b 1486A function used to accept output from the process.
b8d4c8d0
GM
1487
1488@item sentinel
458e643b 1489A function called whenever the state of the process changes.
b8d4c8d0
GM
1490
1491@item buffer
1492The associated buffer of the process.
1493
1494@item pid
1495An integer, the operating system's process @acronym{ID}.
7d2d7cc0 1496Pseudo-processes such as network or serial connections use a value of 0.
b8d4c8d0
GM
1497
1498@item childp
7d2d7cc0
GM
1499A flag, @code{t} if this is really a child process. For a network or
1500serial connection, it is a plist based on the arguments to
1501@code{make-network-process} or @code{make-serial-process}.
b8d4c8d0
GM
1502
1503@item mark
1504A marker indicating the position of the end of the last output from this
1505process inserted into the buffer. This is often but not always the end
1506of the buffer.
1507
1508@item kill_without_query
ee2d5b5e
CY
1509If this is non-zero, killing Emacs while this process is still running
1510does not ask for confirmation about killing the process.
b8d4c8d0 1511
7d2d7cc0
GM
1512@item raw_status
1513The raw process status, as returned by the @code{wait} system call.
b8d4c8d0
GM
1514
1515@item status
1516The process status, as @code{process-status} should return it.
1517
1518@item tick
1519@itemx update_tick
1520If these two fields are not equal, a change in the status of the process
1521needs to be reported, either by running the sentinel or by inserting a
1522message in the process buffer.
1523
1524@item pty_flag
a2eb421b 1525Non-@code{nil} if communication with the subprocess uses a pty;
b8d4c8d0
GM
1526@code{nil} if it uses a pipe.
1527
1528@item infd
1529The file descriptor for input from the process.
1530
1531@item outfd
1532The file descriptor for output to the process.
1533
b8d4c8d0
GM
1534@item tty_name
1535The name of the terminal that the subprocess is using,
1536or @code{nil} if it is using pipes.
1537
1538@item decode_coding_system
1539Coding-system for decoding the input from this process.
1540
1541@item decoding_buf
1542A working buffer for decoding.
1543
1544@item decoding_carryover
1545Size of carryover in decoding.
1546
1547@item encode_coding_system
1548Coding-system for encoding the output to this process.
1549
1550@item encoding_buf
1551A working buffer for encoding.
1552
b8d4c8d0
GM
1553@item inherit_coding_system_flag
1554Flag to set @code{coding-system} of the process buffer from the
1555coding system used to decode process output.
c73e02fa
GM
1556
1557@item type
1558Symbol indicating the type of process: @code{real}, @code{network},
7d2d7cc0 1559@code{serial}.
c73e02fa 1560
b8d4c8d0 1561@end table
7d2d7cc0 1562
d92d9c95
PE
1563@node C Integer Types
1564@section C Integer Types
1565@cindex integer types (C programming language)
1566
1567Here are some guidelines for use of integer types in the Emacs C
1568source code. These guidelines sometimes give competing advice; common
1569sense is advised.
1570
1571@itemize @bullet
1572@item
1573Avoid arbitrary limits. For example, avoid @code{int len = strlen
1574(s);} unless the length of @code{s} is required for other reasons to
1575fit in @code{int} range.
1576
1577@item
1578Do not assume that signed integer arithmetic wraps around on overflow.
1579This is no longer true of Emacs porting targets: signed integer
1580overflow has undefined behavior in practice, and can dump core or
1581even cause earlier or later code to behave ``illogically''. Unsigned
1582overflow does wrap around reliably, modulo a power of two.
1583
1584@item
1585Prefer signed types to unsigned, as code gets confusing when signed
1586and unsigned types are combined. Many other guidelines assume that
1587types are signed; in the rarer cases where unsigned types are needed,
1588similar advice may apply to the unsigned counterparts (e.g.,
1589@code{size_t} instead of @code{ptrdiff_t}, or @code{uintptr_t} instead
1590of @code{intptr_t}).
1591
1592@item
1593Prefer @code{int} for Emacs character codes, in the range 0 ..@: 0x3FFFFF.
1594
1595@item
1596Prefer @code{ptrdiff_t} for sizes, i.e., for integers bounded by the
1597maximum size of any individual C object or by the maximum number of
1598elements in any C array. This is part of Emacs's general preference
1599for signed types. Using @code{ptrdiff_t} limits objects to
1600@code{PTRDIFF_MAX} bytes, but larger objects would cause trouble
1601anyway since they would break pointer subtraction, so this does not
1602impose an arbitrary limit.
1603
1604@item
1605Prefer @code{intptr_t} for internal representations of pointers, or
1606for integers bounded only by the number of objects that can exist at
1607any given time or by the total number of bytes that can be allocated.
1608Currently Emacs sometimes uses other types when @code{intptr_t} would
1609be better; fixing this is lower priority, as the code works as-is on
1610Emacs's current porting targets.
1611
1612@item
1613Prefer the Emacs-defined type @code{EMACS_INT} for representing values
1614converted to or from Emacs Lisp fixnums, as fixnum arithmetic is based
1615on @code{EMACS_INT}.
1616
1617@item
1618When representing a system value (such as a file size or a count of
1619seconds since the Epoch), prefer the corresponding system type (e.g.,
1620@code{off_t}, @code{time_t}). Do not assume that a system type is
1621signed, unless this assumption is known to be safe. For example,
1622although @code{off_t} is always signed, @code{time_t} need not be.
1623
1624@item
1625Prefer the Emacs-defined type @code{printmax_t} for representing
09b73f08 1626values that might be any signed integer that can be printed,
d92d9c95
PE
1627using a @code{printf}-family function.
1628
1629@item
1630Prefer @code{intmax_t} for representing values that might be any
1631signed integer value.
1632
d92d9c95 1633@item
a2326811
PE
1634Prefer @code{bool}, @code{false} and @code{true} for booleans.
1635Using @code{bool} can make programs easier to read and a bit faster than
1636using @code{int}. Although it is also OK to use @code{int}, @code{0}
1637and @code{1}, this older style is gradually being phased out. When
d92d9c95
PE
1638using @code{bool}, respect the limitations of the replacement
1639implementation of @code{bool}, as documented in the source file
1640@file{lib/stdbool.in.h}, so that Emacs remains portable to pre-C99
76377e46
PE
1641platforms. In particular, boolean bitfields should be of type
1642@code{bool_bf}, not @code{bool}, so that they work correctly even when
1643compiling Objective C with standard GCC.
1644
1645@item
1646In bitfields, prefer @code{unsigned int} or @code{signed int} to
1647@code{int}, as @code{int} is less portable: it might be signed, and
1648might not be. Single-bit bit fields should be @code{unsigned int} or
1649@code{bool_bf} so that their values are 0 or 1.
d92d9c95
PE
1650@end itemize
1651
7d2d7cc0 1652@c FIXME Mention src/globals.h somewhere in this file?