Minor fixes to the docs.
[bpt/emacs.git] / doc / lispref / internals.texi
CommitLineData
b8d4c8d0
GM
1@c -*-texinfo-*-
2@c This is part of the GNU Emacs Lisp Reference Manual.
ba318903 3@c Copyright (C) 1990-1993, 1998-1999, 2001-2014 Free Software
ab422c4d 4@c Foundation, Inc.
b8d4c8d0 5@c See the file elisp.texi for copying conditions.
ecc6530d 6@node GNU Emacs Internals
b8d4c8d0
GM
7@appendix GNU Emacs Internals
8
9This chapter describes how the runnable Emacs executable is dumped with
10the preloaded Lisp libraries in it, how storage is allocated, and some
11internal aspects of GNU Emacs that may be of interest to C programmers.
12
13@menu
14* Building Emacs:: How the dumped Emacs is made.
333f9019 15* Pure Storage:: Kludge to make preloaded Lisp functions shareable.
b8d4c8d0
GM
16* Garbage Collection:: Reclaiming space for Lisp objects no longer used.
17* Memory Usage:: Info about total size of Lisp objects made so far.
18* Writing Emacs Primitives:: Writing C code for Emacs.
19* Object Internals:: Data formats of buffers, windows, processes.
d92d9c95 20* C Integer Types:: How C integer types are used inside Emacs.
b8d4c8d0
GM
21@end menu
22
23@node Building Emacs
520f2425 24@section Building Emacs
b8d4c8d0
GM
25@cindex building Emacs
26@pindex temacs
27
28 This section explains the steps involved in building the Emacs
29executable. You don't have to know this material to build and install
30Emacs, since the makefiles do all these things automatically. This
d15aac68 31information is pertinent to Emacs developers.
b8d4c8d0
GM
32
33 Compilation of the C source files in the @file{src} directory
34produces an executable file called @file{temacs}, also called a
d15aac68
CY
35@dfn{bare impure Emacs}. It contains the Emacs Lisp interpreter and
36I/O routines, but not the editing commands.
b8d4c8d0
GM
37
38@cindex @file{loadup.el}
d15aac68
CY
39 The command @w{@command{temacs -l loadup}} would run @file{temacs}
40and direct it to load @file{loadup.el}. The @code{loadup} library
41loads additional Lisp libraries, which set up the normal Emacs editing
42environment. After this step, the Emacs executable is no longer
43@dfn{bare}.
b8d4c8d0
GM
44
45@cindex dumping Emacs
d15aac68
CY
46 Because it takes some time to load the standard Lisp files, the
47@file{temacs} executable usually isn't run directly by users.
48Instead, as one of the last steps of building Emacs, the command
49@samp{temacs -batch -l loadup dump} is run. The special @samp{dump}
50argument causes @command{temacs} to dump out an executable program,
51called @file{emacs}, which has all the standard Lisp files preloaded.
52(The @samp{-batch} argument prevents @file{temacs} from trying to
53initialize any of its data on the terminal, so that the tables of
54terminal information are empty in the dumped Emacs.)
55
56@cindex preloaded Lisp files
b578c9cc 57@vindex preloaded-file-list
d15aac68
CY
58 The dumped @file{emacs} executable (also called a @dfn{pure} Emacs)
59is the one which is installed. The variable
60@code{preloaded-file-list} stores a list of the Lisp files preloaded
61into the dumped Emacs. If you port Emacs to a new operating system,
62and are not able to implement dumping, then Emacs must load
63@file{loadup.el} each time it starts.
b8d4c8d0
GM
64
65@cindex @file{site-load.el}
b8d4c8d0 66 You can specify additional files to preload by writing a library named
520f2425
GM
67@file{site-load.el} that loads them. You may need to rebuild Emacs
68with an added definition
b8d4c8d0
GM
69
70@example
71#define SITELOAD_PURESIZE_EXTRA @var{n}
72@end example
73
74@noindent
520f2425
GM
75to make @var{n} added bytes of pure space to hold the additional files;
76see @file{src/puresize.h}.
b8d4c8d0
GM
77(Try adding increments of 20000 until it is big enough.) However, the
78advantage of preloading additional files decreases as machines get
79faster. On modern machines, it is usually not advisable.
80
81 After @file{loadup.el} reads @file{site-load.el}, it finds the
82documentation strings for primitive and preloaded functions (and
83variables) in the file @file{etc/DOC} where they are stored, by
84calling @code{Snarf-documentation} (@pxref{Definition of
85Snarf-documentation,, Accessing Documentation}).
86
87@cindex @file{site-init.el}
88@cindex preloading additional functions and variables
89 You can specify other Lisp expressions to execute just before dumping
90by putting them in a library named @file{site-init.el}. This file is
91executed after the documentation strings are found.
92
93 If you want to preload function or variable definitions, there are
94three ways you can do this and make their documentation strings
95accessible when you subsequently run Emacs:
96
97@itemize @bullet
98@item
99Arrange to scan these files when producing the @file{etc/DOC} file,
100and load them with @file{site-load.el}.
101
102@item
103Load the files with @file{site-init.el}, then copy the files into the
104installation directory for Lisp files when you install Emacs.
105
106@item
5906db45
GM
107Specify a @code{nil} value for @code{byte-compile-dynamic-docstrings}
108as a local variable in each of these files, and load them with either
109@file{site-load.el} or @file{site-init.el}. (This method has the
110drawback that the documentation strings take up space in Emacs all the
111time.)
b8d4c8d0
GM
112@end itemize
113
f982b371
EZ
114@cindex change @code{load-path} at configure time
115@cindex @option{--enable-locallisppath} option to @command{configure}
b8d4c8d0
GM
116 It is not advisable to put anything in @file{site-load.el} or
117@file{site-init.el} that would alter any of the features that users
118expect in an ordinary unmodified Emacs. If you feel you must override
119normal features for your site, do it with @file{default.el}, so that
120users can override your changes if they wish. @xref{Startup Summary}.
06a4f110
GM
121Note that if either @file{site-load.el} or @file{site-init.el} changes
122@code{load-path}, the changes will be lost after dumping.
123@xref{Library Search}. To make a permanent change to
124@code{load-path}, use the @option{--enable-locallisppath} option
125of @command{configure}.
b8d4c8d0 126
520f2425
GM
127 In a package that can be preloaded, it is sometimes necessary (or
128useful) to delay certain evaluations until Emacs subsequently starts
129up. The vast majority of such cases relate to the values of
130customizable variables. For example, @code{tutorial-directory} is a
131variable defined in @file{startup.el}, which is preloaded. The default
132value is set based on @code{data-directory}. The variable needs to
133access the value of @code{data-directory} when Emacs starts, not when
134it is dumped, because the Emacs executable has probably been installed
135in a different location since it was dumped.
136
137@defun custom-initialize-delay symbol value
138This function delays the initialization of @var{symbol} to the next
139Emacs start. You normally use this function by specifying it as the
140@code{:initialize} property of a customizable variable. (The argument
f003f294 141@var{value} is unused, and is provided only for compatibility with the
520f2425
GM
142form Custom expects.)
143@end defun
b8d4c8d0 144
520f2425
GM
145In the unlikely event that you need a more general functionality than
146@code{custom-initialize-delay} provides, you can use
147@code{before-init-hook} (@pxref{Startup Summary}).
b8d4c8d0
GM
148
149@defun dump-emacs to-file from-file
150@cindex unexec
151This function dumps the current state of Emacs into an executable file
152@var{to-file}. It takes symbols from @var{from-file} (this is normally
153the executable file @file{temacs}).
154
155If you want to use this function in an Emacs that was already dumped,
156you must run Emacs with @samp{-batch}.
157@end defun
158
159@node Pure Storage
520f2425 160@section Pure Storage
b8d4c8d0
GM
161@cindex pure storage
162
163 Emacs Lisp uses two kinds of storage for user-created Lisp objects:
164@dfn{normal storage} and @dfn{pure storage}. Normal storage is where
999dd333
GM
165all the new data created during an Emacs session are kept
166(@pxref{Garbage Collection}). Pure storage is used for certain data
167in the preloaded standard Lisp files---data that should never change
168during actual use of Emacs.
b8d4c8d0 169
d15aac68 170 Pure storage is allocated only while @command{temacs} is loading the
b8d4c8d0
GM
171standard preloaded Lisp libraries. In the file @file{emacs}, it is
172marked as read-only (on operating systems that permit this), so that
173the memory space can be shared by all the Emacs jobs running on the
174machine at once. Pure storage is not expandable; a fixed amount is
175allocated when Emacs is compiled, and if that is not sufficient for
176the preloaded libraries, @file{temacs} allocates dynamic memory for
999dd333
GM
177the part that didn't fit. The resulting image will work, but garbage
178collection (@pxref{Garbage Collection}) is disabled in this situation,
179causing a memory leak. Such an overflow normally won't happen unless
180you try to preload additional libraries or add features to the
181standard ones. Emacs will display a warning about the overflow when
182it starts. If this happens, you should increase the compilation
183parameter @code{SYSTEM_PURESIZE_EXTRA} in the file
184@file{src/puresize.h} and rebuild Emacs.
b8d4c8d0
GM
185
186@defun purecopy object
187This function makes a copy in pure storage of @var{object}, and returns
188it. It copies a string by simply making a new string with the same
189characters, but without text properties, in pure storage. It
190recursively copies the contents of vectors and cons cells. It does
191not make copies of other objects such as symbols, but just returns
192them unchanged. It signals an error if asked to copy markers.
193
194This function is a no-op except while Emacs is being built and dumped;
999dd333 195it is usually called only in preloaded Lisp files.
b8d4c8d0
GM
196@end defun
197
198@defvar pure-bytes-used
199The value of this variable is the number of bytes of pure storage
200allocated so far. Typically, in a dumped Emacs, this number is very
201close to the total amount of pure storage available---if it were not,
202we would preallocate less.
203@end defvar
204
205@defvar purify-flag
206This variable determines whether @code{defun} should make a copy of the
207function definition in pure storage. If it is non-@code{nil}, then the
208function definition is copied into pure storage.
209
210This flag is @code{t} while loading all of the basic functions for
333f9019 211building Emacs initially (allowing those functions to be shareable and
b8d4c8d0
GM
212non-collectible). Dumping Emacs as an executable always writes
213@code{nil} in this variable, regardless of the value it actually has
214before and after dumping.
215
216You should not change this flag in a running Emacs.
217@end defvar
218
219@node Garbage Collection
520f2425 220@section Garbage Collection
b8d4c8d0
GM
221
222@cindex memory allocation
d15aac68
CY
223 When a program creates a list or the user defines a new function
224(such as by loading a library), that data is placed in normal storage.
225If normal storage runs low, then Emacs asks the operating system to
226allocate more memory. Different types of Lisp objects, such as
f3372c87
DA
227symbols, cons cells, small vectors, markers, etc., are segregated in
228distinct blocks in memory. (Large vectors, long strings, buffers and
229certain other editing types, which are fairly large, are allocated in
230individual blocks, one per object; small strings are packed into blocks
231of 8k bytes, and small vectors are packed into blocks of 4k bytes).
232
233@cindex vector-like objects, storage
234@cindex storage of vector-like Lisp objects
235 Beyond the basic vector, a lot of objects like window, buffer, and
236frame are managed as if they were vectors. The corresponding C data
237structures include the @code{struct vectorlike_header} field whose
74934dcc
DA
238@code{size} member contains the subtype enumerated by @code{enum pvec_type}
239and an information about how many @code{Lisp_Object} fields this structure
240contains and what the size of the rest data is. This information is
241needed to calculate the memory footprint of an object, and used
242by the vector allocation code while iterating over the vector blocks.
b8d4c8d0 243
d15aac68
CY
244@cindex garbage collection
245 It is quite common to use some storage for a while, then release it
246by (for example) killing a buffer or deleting the last pointer to an
247object. Emacs provides a @dfn{garbage collector} to reclaim this
248abandoned storage. The garbage collector operates by finding and
249marking all Lisp objects that are still accessible to Lisp programs.
250To begin with, it assumes all the symbols, their values and associated
251function definitions, and any data presently on the stack, are
252accessible. Any objects that can be reached indirectly through other
253accessible objects are also accessible.
b8d4c8d0
GM
254
255 When marking is finished, all objects still unmarked are garbage. No
256matter what the Lisp program or the user does, it is impossible to refer
257to them, since there is no longer a way to reach them. Their space
258might as well be reused, since no one will miss them. The second
259(``sweep'') phase of the garbage collector arranges to reuse them.
260
261@c ??? Maybe add something describing weak hash tables here?
262
263@cindex free list
264 The sweep phase puts unused cons cells onto a @dfn{free list}
265for future allocation; likewise for symbols and markers. It compacts
266the accessible strings so they occupy fewer 8k blocks; then it frees the
f3372c87
DA
267other 8k blocks. Unreachable vectors from vector blocks are coalesced
268to create largest possible free areas; if a free area spans a complete
2694k block, that block is freed. Otherwise, the free area is recorded
270in a free list array, where each entry corresponds to a free list
271of areas of the same size. Large vectors, buffers, and other large
272objects are allocated and freed individually.
b8d4c8d0
GM
273
274@cindex CL note---allocate more storage
275@quotation
276@b{Common Lisp note:} Unlike other Lisps, GNU Emacs Lisp does not
277call the garbage collector when the free list is empty. Instead, it
278simply requests the operating system to allocate more storage, and
279processing continues until @code{gc-cons-threshold} bytes have been
280used.
281
282This means that you can make sure that the garbage collector will not
283run during a certain portion of a Lisp program by calling the garbage
284collector explicitly just before it (provided that portion of the
285program does not use so much space as to force a second garbage
286collection).
287@end quotation
288
289@deffn Command garbage-collect
290This command runs a garbage collection, and returns information on
291the amount of space in use. (Garbage collection can also occur
292spontaneously if you use more than @code{gc-cons-threshold} bytes of
293Lisp data since the previous garbage collection.)
294
74934dcc
DA
295@code{garbage-collect} returns a list with information on amount of space in
296use, where each entry has the form @samp{(@var{name} @var{size} @var{used})}
297or @samp{(@var{name} @var{size} @var{used} @var{free})}. In the entry,
298@var{name} is a symbol describing the kind of objects this entry represents,
299@var{size} is the number of bytes used by each one, @var{used} is the number
300of those objects that were found live in the heap, and optional @var{free} is
301the number of those objects that are not live but that Emacs keeps around for
302future allocations. So an overall result is:
b8d4c8d0
GM
303
304@example
f24f2e22 305((@code{conses} @var{cons-size} @var{used-conses} @var{free-conses})
74934dcc
DA
306 (@code{symbols} @var{symbol-size} @var{used-symbols} @var{free-symbols})
307 (@code{miscs} @var{misc-size} @var{used-miscs} @var{free-miscs})
308 (@code{strings} @var{string-size} @var{used-strings} @var{free-strings})
309 (@code{string-bytes} @var{byte-size} @var{used-bytes})
310 (@code{vectors} @var{vector-size} @var{used-vectors})
311 (@code{vector-slots} @var{slot-size} @var{used-slots} @var{free-slots})
312 (@code{floats} @var{float-size} @var{used-floats} @var{free-floats})
313 (@code{intervals} @var{interval-size} @var{used-intervals} @var{free-intervals})
314 (@code{buffers} @var{buffer-size} @var{used-buffers})
315 (@code{heap} @var{unit-size} @var{total-size} @var{free-size}))
b8d4c8d0
GM
316@end example
317
318Here is an example:
319
320@example
b8d4c8d0 321(garbage-collect)
74934dcc
DA
322 @result{} ((conses 16 49126 8058) (symbols 48 14607 0)
323 (miscs 40 34 56) (strings 32 2942 2607)
324 (string-bytes 1 78607) (vectors 16 7247)
325 (vector-slots 8 341609 29474) (floats 8 71 102)
326 (intervals 56 27 26) (buffers 944 8)
327 (heap 1024 11715 2678))
b8d4c8d0
GM
328@end example
329
74934dcc
DA
330Below is a table explaining each element. Note that last @code{heap} entry
331is optional and present only if an underlying @code{malloc} implementation
332provides @code{mallinfo} function.
b8d4c8d0
GM
333
334@table @var
74934dcc 335@item cons-size
39670ef4 336Internal size of a cons cell, i.e., @code{sizeof (struct Lisp_Cons)}.
74934dcc 337
b8d4c8d0
GM
338@item used-conses
339The number of cons cells in use.
340
341@item free-conses
74934dcc
DA
342The number of cons cells for which space has been obtained from
343the operating system, but that are not currently being used.
b8d4c8d0 344
74934dcc 345@item symbol-size
39670ef4 346Internal size of a symbol, i.e., @code{sizeof (struct Lisp_Symbol)}.
74934dcc
DA
347
348@item used-symbols
b8d4c8d0
GM
349The number of symbols in use.
350
74934dcc
DA
351@item free-symbols
352The number of symbols for which space has been obtained from
353the operating system, but that are not currently being used.
354
355@item misc-size
39670ef4 356Internal size of a miscellaneous entity, i.e.,
74934dcc
DA
357@code{sizeof (union Lisp_Misc)}, which is a size of the
358largest type enumerated in @code{enum Lisp_Misc_Type}.
b8d4c8d0
GM
359
360@item used-miscs
74934dcc
DA
361The number of miscellaneous objects in use. These include markers
362and overlays, plus certain objects not visible to users.
b8d4c8d0
GM
363
364@item free-miscs
365The number of miscellaneous objects for which space has been obtained
366from the operating system, but that are not currently being used.
367
74934dcc 368@item string-size
39670ef4 369Internal size of a string header, i.e., @code{sizeof (struct Lisp_String)}.
74934dcc
DA
370
371@item used-strings
372The number of string headers in use.
373
374@item free-strings
375The number of string headers for which space has been obtained
376from the operating system, but that are not currently being used.
377
378@item byte-size
379This is used for convenience and equals to @code{sizeof (char)}.
380
381@item used-bytes
382The total size of all string data in bytes.
383
384@item vector-size
39670ef4 385Internal size of a vector header, i.e., @code{sizeof (struct Lisp_Vector)}.
74934dcc
DA
386
387@item used-vectors
388The number of vector headers allocated from the vector blocks.
389
390@item slot-size
391Internal size of a vector slot, always equal to @code{sizeof (Lisp_Object)}.
392
393@item used-slots
394The number of slots in all used vectors.
395
396@item free-slots
397The number of free slots in all vector blocks.
b8d4c8d0 398
74934dcc 399@item float-size
39670ef4 400Internal size of a float object, i.e., @code{sizeof (struct Lisp_Float)}.
74934dcc 401(Do not confuse it with the native platform @code{float} or @code{double}.)
b8d4c8d0
GM
402
403@item used-floats
b8d4c8d0
GM
404The number of floats in use.
405
406@item free-floats
74934dcc
DA
407The number of floats for which space has been obtained from
408the operating system, but that are not currently being used.
409
410@item interval-size
39670ef4 411Internal size of an interval object, i.e., @code{sizeof (struct interval)}.
b8d4c8d0
GM
412
413@item used-intervals
74934dcc 414The number of intervals in use.
b8d4c8d0
GM
415
416@item free-intervals
74934dcc
DA
417The number of intervals for which space has been obtained from
418the operating system, but that are not currently being used.
b8d4c8d0 419
74934dcc 420@item buffer-size
39670ef4 421Internal size of a buffer, i.e., @code{sizeof (struct buffer)}.
74934dcc 422(Do not confuse with the value returned by @code{buffer-size} function.)
b8d4c8d0 423
74934dcc
DA
424@item used-buffers
425The number of buffer objects in use. This includes killed buffers
39670ef4 426invisible to users, i.e., all buffers in @code{all_buffers} list.
74934dcc
DA
427
428@item unit-size
429The unit of heap space measurement, always equal to 1024 bytes.
430
431@item total-size
432Total heap size, in @var{unit-size} units.
433
434@item free-size
435Heap space which is not currently used, in @var{unit-size} units.
b8d4c8d0
GM
436@end table
437
999dd333 438If there was overflow in pure space (@pxref{Pure Storage}),
b8d4c8d0 439@code{garbage-collect} returns @code{nil}, because a real garbage
9658dc2a 440collection cannot be done.
b8d4c8d0
GM
441@end deffn
442
443@defopt garbage-collection-messages
444If this variable is non-@code{nil}, Emacs displays a message at the
445beginning and end of garbage collection. The default value is
999dd333 446@code{nil}.
b8d4c8d0
GM
447@end defopt
448
449@defvar post-gc-hook
450This is a normal hook that is run at the end of garbage collection.
451Garbage collection is inhibited while the hook functions run, so be
452careful writing them.
453@end defvar
454
455@defopt gc-cons-threshold
456The value of this variable is the number of bytes of storage that must
457be allocated for Lisp objects after one garbage collection in order to
74934dcc
DA
458trigger another garbage collection. You can use the result returned by
459@code{garbage-collect} to get an information about size of the particular
460object type; space allocated to the contents of buffers does not count.
461Note that the subsequent garbage collection does not happen immediately
462when the threshold is exhausted, but only the next time the Lisp interpreter
463is called.
464
465The initial threshold value is @code{GC_DEFAULT_THRESHOLD}, defined in
466@file{alloc.c}. Since it's defined in @code{word_size} units, the value
467is 400,000 for the default 32-bit configuration and 800,000 for the 64-bit
468one. If you specify a larger value, garbage collection will happen less
469often. This reduces the amount of time spent garbage collecting, but
470increases total memory use. You may want to do this when running a program
471that creates lots of Lisp data.
472
473You can make collections more frequent by specifying a smaller value, down
474to 1/10th of @code{GC_DEFAULT_THRESHOLD}. A value less than this minimum
475will remain in effect only until the subsequent garbage collection, at which
476time @code{garbage-collect} will set the threshold back to the minimum.
b8d4c8d0
GM
477@end defopt
478
479@defopt gc-cons-percentage
480The value of this variable specifies the amount of consing before a
481garbage collection occurs, as a fraction of the current heap size.
482This criterion and @code{gc-cons-threshold} apply in parallel, and
483garbage collection occurs only when both criteria are satisfied.
484
485As the heap size increases, the time to perform a garbage collection
486increases. Thus, it can be desirable to do them less frequently in
487proportion.
488@end defopt
489
490 The value returned by @code{garbage-collect} describes the amount of
491memory used by Lisp data, broken down by data type. By contrast, the
492function @code{memory-limit} provides information on the total amount of
493memory Emacs is currently using.
494
b8d4c8d0
GM
495@defun memory-limit
496This function returns the address of the last byte Emacs has allocated,
497divided by 1024. We divide the value by 1024 to make sure it fits in a
498Lisp integer.
499
500You can use this to get a general idea of how your actions affect the
501memory usage.
502@end defun
503
504@defvar memory-full
d15aac68 505This variable is @code{t} if Emacs is nearly out of memory for Lisp
b8d4c8d0
GM
506objects, and @code{nil} otherwise.
507@end defvar
508
509@defun memory-use-counts
510This returns a list of numbers that count the number of objects
511created in this Emacs session. Each of these counters increments for
512a certain kind of object. See the documentation string for details.
513@end defun
514
515@defvar gcs-done
516This variable contains the total number of garbage collections
517done so far in this Emacs session.
518@end defvar
519
520@defvar gc-elapsed
521This variable contains the total number of seconds of elapsed time
09b73f08
PE
522during garbage collection so far in this Emacs session, as a
523floating-point number.
b8d4c8d0
GM
524@end defvar
525
526@node Memory Usage
527@section Memory Usage
528@cindex memory usage
529
530 These functions and variables give information about the total amount
531of memory allocation that Emacs has done, broken down by data type.
532Note the difference between these and the values returned by
01a6dcc8 533@code{garbage-collect}; those count objects that currently exist, but
b8d4c8d0
GM
534these count the number or size of all allocations, including those for
535objects that have since been freed.
536
537@defvar cons-cells-consed
538The total number of cons cells that have been allocated so far
539in this Emacs session.
540@end defvar
541
542@defvar floats-consed
543The total number of floats that have been allocated so far
544in this Emacs session.
545@end defvar
546
547@defvar vector-cells-consed
548The total number of vector cells that have been allocated so far
549in this Emacs session.
550@end defvar
551
552@defvar symbols-consed
553The total number of symbols that have been allocated so far
554in this Emacs session.
555@end defvar
556
557@defvar string-chars-consed
558The total number of string characters that have been allocated so far
9658dc2a 559in this session.
b8d4c8d0
GM
560@end defvar
561
562@defvar misc-objects-consed
563The total number of miscellaneous objects that have been allocated so
9658dc2a 564far in this session. These include markers and overlays, plus
b8d4c8d0
GM
565certain objects not visible to users.
566@end defvar
567
568@defvar intervals-consed
569The total number of intervals that have been allocated so far
570in this Emacs session.
571@end defvar
572
573@defvar strings-consed
574The total number of strings that have been allocated so far in this
575Emacs session.
576@end defvar
577
578@node Writing Emacs Primitives
520f2425 579@section Writing Emacs Primitives
b8d4c8d0
GM
580@cindex primitive function internals
581@cindex writing Emacs primitives
582
1df7defd 583 Lisp primitives are Lisp functions implemented in C@. The details of
b8d4c8d0
GM
584interfacing the C function so that Lisp can call it are handled by a few
585C macros. The only way to really understand how to write new C code is
586to read the source, but we can explain some things here.
587
588 An example of a special form is the definition of @code{or}, from
589@file{eval.c}. (An ordinary function would have the same general
590appearance.)
591
592@cindex garbage collection protection
593@smallexample
594@group
595DEFUN ("or", For, Sor, 0, UNEVALLED, 0,
d15aac68
CY
596 doc: /* Eval args until one of them yields non-nil, then return
597that value.
598The remaining args are not evalled at all.
b8d4c8d0
GM
599If all args return nil, return nil.
600@end group
601@group
602usage: (or CONDITIONS ...) */)
b88746ba 603 (Lisp_Object args)
b8d4c8d0
GM
604@{
605 register Lisp_Object val = Qnil;
606 struct gcpro gcpro1;
607@end group
608
609@group
610 GCPRO1 (args);
611@end group
612
613@group
614 while (CONSP (args))
615 @{
7d2d7cc0 616 val = eval_sub (XCAR (args));
b8d4c8d0
GM
617 if (!NILP (val))
618 break;
619 args = XCDR (args);
620 @}
621@end group
622
623@group
624 UNGCPRO;
625 return val;
626@}
627@end group
628@end smallexample
629
630@cindex @code{DEFUN}, C macro to define Lisp primitives
631 Let's start with a precise explanation of the arguments to the
632@code{DEFUN} macro. Here is a template for them:
633
634@example
635DEFUN (@var{lname}, @var{fname}, @var{sname}, @var{min}, @var{max}, @var{interactive}, @var{doc})
636@end example
637
638@table @var
639@item lname
640This is the name of the Lisp symbol to define as the function name; in
641the example above, it is @code{or}.
642
643@item fname
d15aac68
CY
644This is the C function name for this function. This is the name that
645is used in C code for calling the function. The name is, by
646convention, @samp{F} prepended to the Lisp name, with all dashes
647(@samp{-}) in the Lisp name changed to underscores. Thus, to call
648this function from C code, call @code{For}.
b8d4c8d0
GM
649
650@item sname
651This is a C variable name to use for a structure that holds the data for
652the subr object that represents the function in Lisp. This structure
653conveys the Lisp symbol name to the initialization routine that will
654create the symbol and store the subr object as its definition. By
655convention, this name is always @var{fname} with @samp{F} replaced with
656@samp{S}.
657
658@item min
659This is the minimum number of arguments that the function requires. The
660function @code{or} allows a minimum of zero arguments.
661
662@item max
663This is the maximum number of arguments that the function accepts, if
664there is a fixed maximum. Alternatively, it can be @code{UNEVALLED},
665indicating a special form that receives unevaluated arguments, or
666@code{MANY}, indicating an unlimited number of evaluated arguments (the
667equivalent of @code{&rest}). Both @code{UNEVALLED} and @code{MANY} are
9658dc2a
GM
668macros. If @var{max} is a number, it must be more than @var{min} but
669less than 8.
b8d4c8d0 670
84ebefe9 671@cindex interactive specification in primitives
b8d4c8d0 672@item interactive
84ebefe9
XF
673This is an interactive specification, a string such as might be used
674as the argument of @code{interactive} in a Lisp function. In the case
675of @code{or}, it is 0 (a null pointer), indicating that @code{or}
b02b5481
GM
676cannot be called interactively. A value of @code{""} indicates a
677function that should receive no arguments when called interactively.
84ebefe9
XF
678If the value begins with a @samp{"(}, the string is evaluated as a
679Lisp form. For example:
680
b02b5481 681@example
84ebefe9 682@group
b02b5481
GM
683DEFUN ("foo", Ffoo, Sfoo, 0, UNEVALLED,
684 "(list (read-char-by-name \"Insert character: \")\
84ebefe9
XF
685 (prefix-numeric-value current-prefix-arg)\
686 t))",
687 doc: /* @dots{} /*)
688@end group
b02b5481 689@end example
b8d4c8d0
GM
690
691@item doc
692This is the documentation string. It uses C comment syntax rather
693than C string syntax because comment syntax requires nothing special
694to include multiple lines. The @samp{doc:} identifies the comment
695that follows as the documentation string. The @samp{/*} and @samp{*/}
696delimiters that begin and end the comment are not part of the
697documentation string.
698
699If the last line of the documentation string begins with the keyword
700@samp{usage:}, the rest of the line is treated as the argument list
701for documentation purposes. This way, you can use different argument
702names in the documentation string from the ones used in the C code.
703@samp{usage:} is required if the function has an unlimited number of
704arguments.
705
706All the usual rules for documentation strings in Lisp code
707(@pxref{Documentation Tips}) apply to C code documentation strings
708too.
709@end table
710
b88746ba 711 After the call to the @code{DEFUN} macro, you must write the
d15aac68
CY
712argument list for the C function, including the types for the
713arguments. If the primitive accepts a fixed maximum number of Lisp
714arguments, there must be one C argument for each Lisp argument, and
715each argument must be of type @code{Lisp_Object}. (Various macros and
716functions for creating values of type @code{Lisp_Object} are declared
717in the file @file{lisp.h}.) If the primitive has no upper limit on
718the number of Lisp arguments, it must have exactly two C arguments:
719the first is the number of Lisp arguments, and the second is the
720address of a block containing their values. These have types
39670ef4 721@code{int} and @w{@code{Lisp_Object *}} respectively. Since
74934dcc
DA
722@code{Lisp_Object} can hold any Lisp object of any data type, you
723can determine the actual data type only at run time; so if you want
724a primitive to accept only a certain type of argument, you must check
725the type explicitly using a suitable predicate (@pxref{Type Predicates}).
726@cindex type checking internals
b8d4c8d0
GM
727
728@cindex @code{GCPRO} and @code{UNGCPRO}
729@cindex protect C variables from garbage collection
730 Within the function @code{For} itself, note the use of the macros
d15aac68
CY
731@code{GCPRO1} and @code{UNGCPRO}. These macros are defined for the
732sake of the few platforms which do not use Emacs' default
733stack-marking garbage collector. The @code{GCPRO1} macro ``protects''
734a variable from garbage collection, explicitly informing the garbage
735collector that that variable and all its contents must be as
736accessible. GC protection is necessary in any function which can
737perform Lisp evaluation by calling @code{eval_sub} or @code{Feval} as
738a subroutine, either directly or indirectly.
b8d4c8d0
GM
739
740 It suffices to ensure that at least one pointer to each object is
d15aac68 741GC-protected. Thus, a particular local variable can do without
b8d4c8d0 742protection if it is certain that the object it points to will be
7d2d7cc0 743preserved by some other pointer (such as another local variable that
d15aac68
CY
744has a @code{GCPRO}). Otherwise, the local variable needs a
745@code{GCPRO}.
b8d4c8d0
GM
746
747 The macro @code{GCPRO1} protects just one local variable. If you
748want to protect two variables, use @code{GCPRO2} instead; repeating
749@code{GCPRO1} will not work. Macros @code{GCPRO3}, @code{GCPRO4},
750@code{GCPRO5}, and @code{GCPRO6} also exist. All these macros
751implicitly use local variables such as @code{gcpro1}; you must declare
752these explicitly, with type @code{struct gcpro}. Thus, if you use
753@code{GCPRO2}, you must declare @code{gcpro1} and @code{gcpro2}.
b8d4c8d0
GM
754
755 @code{UNGCPRO} cancels the protection of the variables that are
756protected in the current function. It is necessary to do this
757explicitly.
758
b8d4c8d0
GM
759 You must not use C initializers for static or global variables unless
760the variables are never written once Emacs is dumped. These variables
761with initializers are allocated in an area of memory that becomes
762read-only (on certain operating systems) as a result of dumping Emacs.
763@xref{Pure Storage}.
764
b8d4c8d0
GM
765@cindex @code{defsubr}, Lisp symbol for a primitive
766 Defining the C function is not enough to make a Lisp primitive
767available; you must also create the Lisp symbol for the primitive and
768store a suitable subr object in its function cell. The code looks like
769this:
770
771@example
7d2d7cc0 772defsubr (&@var{sname});
b8d4c8d0
GM
773@end example
774
775@noindent
7d2d7cc0 776Here @var{sname} is the name you used as the third argument to @code{DEFUN}.
b8d4c8d0
GM
777
778 If you add a new primitive to a file that already has Lisp primitives
779defined in it, find the function (near the end of the file) named
780@code{syms_of_@var{something}}, and add the call to @code{defsubr}
781there. If the file doesn't have this function, or if you create a new
782file, add to it a @code{syms_of_@var{filename}} (e.g.,
783@code{syms_of_myfile}). Then find the spot in @file{emacs.c} where all
784of these functions are called, and add a call to
785@code{syms_of_@var{filename}} there.
786
787@anchor{Defining Lisp variables in C}
788@vindex byte-boolean-vars
789@cindex defining Lisp variables in C
790@cindex @code{DEFVAR_INT}, @code{DEFVAR_LISP}, @code{DEFVAR_BOOL}
791 The function @code{syms_of_@var{filename}} is also the place to define
792any C variables that are to be visible as Lisp variables.
793@code{DEFVAR_LISP} makes a C variable of type @code{Lisp_Object} visible
794in Lisp. @code{DEFVAR_INT} makes a C variable of type @code{int}
795visible in Lisp with a value that is always an integer.
796@code{DEFVAR_BOOL} makes a C variable of type @code{int} visible in Lisp
797with a value that is either @code{t} or @code{nil}. Note that variables
798defined with @code{DEFVAR_BOOL} are automatically added to the list
799@code{byte-boolean-vars} used by the byte compiler.
800
7d2d7cc0
GM
801@cindex defining customization variables in C
802 If you want to make a Lisp variables that is defined in C behave
803like one declared with @code{defcustom}, add an appropriate entry to
804@file{cus-start.el}.
805
b8d4c8d0
GM
806@cindex @code{staticpro}, protection from GC
807 If you define a file-scope C variable of type @code{Lisp_Object},
808you must protect it from garbage-collection by calling @code{staticpro}
809in @code{syms_of_@var{filename}}, like this:
810
811@example
812staticpro (&@var{variable});
813@end example
814
815 Here is another example function, with more complicated arguments.
816This comes from the code in @file{window.c}, and it demonstrates the use
817of macros and functions to manipulate Lisp objects.
818
819@smallexample
820@group
821DEFUN ("coordinates-in-window-p", Fcoordinates_in_window_p,
7d2d7cc0
GM
822 Scoordinates_in_window_p, 2, 2, 0,
823 doc: /* Return non-nil if COORDINATES are in WINDOW.
824 ...
b8d4c8d0
GM
825@end group
826@group
7d2d7cc0
GM
827 or `right-margin' is returned. */)
828 (register Lisp_Object coordinates, Lisp_Object window)
b8d4c8d0 829@{
7d2d7cc0
GM
830 struct window *w;
831 struct frame *f;
b8d4c8d0 832 int x, y;
7d2d7cc0 833 Lisp_Object lx, ly;
b8d4c8d0
GM
834@end group
835
836@group
7d2d7cc0
GM
837 CHECK_LIVE_WINDOW (window);
838 w = XWINDOW (window);
839 f = XFRAME (w->frame);
840 CHECK_CONS (coordinates);
841 lx = Fcar (coordinates);
842 ly = Fcdr (coordinates);
843 CHECK_NUMBER_OR_FLOAT (lx);
844 CHECK_NUMBER_OR_FLOAT (ly);
845 x = FRAME_PIXEL_X_FROM_CANON_X (f, lx) + FRAME_INTERNAL_BORDER_WIDTH(f);
846 y = FRAME_PIXEL_Y_FROM_CANON_Y (f, ly) + FRAME_INTERNAL_BORDER_WIDTH(f);
b8d4c8d0
GM
847@end group
848
849@group
7d2d7cc0 850 switch (coordinates_in_window (w, x, y))
b8d4c8d0 851 @{
7d2d7cc0 852 case ON_NOTHING: /* NOT in window at all. */
b8d4c8d0
GM
853 return Qnil;
854@end group
855
7d2d7cc0 856 ...
b8d4c8d0
GM
857
858@group
7d2d7cc0 859 case ON_MODE_LINE: /* In mode line of window. */
b8d4c8d0
GM
860 return Qmode_line;
861@end group
862
7d2d7cc0
GM
863 ...
864
b8d4c8d0 865@group
7d2d7cc0
GM
866 case ON_SCROLL_BAR: /* On scroll-bar of window. */
867 /* Historically we are supposed to return nil in this case. */
868 return Qnil;
b8d4c8d0
GM
869@end group
870
871@group
872 default:
873 abort ();
874 @}
875@}
876@end group
877@end smallexample
878
879 Note that C code cannot call functions by name unless they are defined
1df7defd 880in C@. The way to call a function written in Lisp is to use
b8d4c8d0
GM
881@code{Ffuncall}, which embodies the Lisp function @code{funcall}. Since
882the Lisp function @code{funcall} accepts an unlimited number of
883arguments, in C it takes two: the number of Lisp-level arguments, and a
884one-dimensional array containing their values. The first Lisp-level
885argument is the Lisp function to call, and the rest are the arguments to
886pass to it. Since @code{Ffuncall} can call the evaluator, you must
887protect pointers from garbage collection around the call to
888@code{Ffuncall}.
889
890 The C functions @code{call0}, @code{call1}, @code{call2}, and so on,
891provide handy ways to call a Lisp function conveniently with a fixed
892number of arguments. They work by calling @code{Ffuncall}.
893
894 @file{eval.c} is a very good file to look through for examples;
895@file{lisp.h} contains the definitions for some important macros and
896functions.
897
898 If you define a function which is side-effect free, update the code
7d2d7cc0 899in @file{byte-opt.el} that binds @code{side-effect-free-fns} and
b8d4c8d0
GM
900@code{side-effect-and-error-free-fns} so that the compiler optimizer
901knows about it.
902
903@node Object Internals
520f2425 904@section Object Internals
b8d4c8d0
GM
905@cindex object internals
906
74934dcc 907 Emacs Lisp provides a rich set of the data types. Some of them, like cons
f24f2e22 908cells, integers and strings, are common to nearly all Lisp dialects. Some
74934dcc
DA
909others, like markers and buffers, are quite special and needed to provide
910the basic support to write editor commands in Lisp. To implement such
911a variety of object types and provide an efficient way to pass objects between
912the subsystems of an interpreter, there is a set of C data structures and
913a special type to represent the pointers to all of them, which is known as
914@dfn{tagged pointer}.
915
916 In C, the tagged pointer is an object of type @code{Lisp_Object}. Any
917initialized variable of such a type always holds the value of one of the
918following basic data types: integer, symbol, string, cons cell, float,
919vectorlike or miscellaneous object. Each of these data types has the
920corresponding tag value. All tags are enumerated by @code{enum Lisp_Type}
921and placed into a 3-bit bitfield of the @code{Lisp_Object}. The rest of the
09b73f08 922bits is the value itself. Integers are immediate, i.e., directly
74934dcc
DA
923represented by those @dfn{value bits}, and all other objects are represented
924by the C pointers to a corresponding object allocated from the heap. Width
925of the @code{Lisp_Object} is platform- and configuration-dependent: usually
39670ef4 926it's equal to the width of an underlying platform pointer (i.e., 32-bit on
74934dcc
DA
927a 32-bit machine and 64-bit on a 64-bit one), but also there is a special
928configuration where @code{Lisp_Object} is 64-bit but all pointers are 32-bit.
929The latter trick was designed to overcome the limited range of values for
930Lisp integers on a 32-bit system by using 64-bit @code{long long} type for
931@code{Lisp_Object}.
932
933 The following C data structures are defined in @file{lisp.h} to represent
934the basic data types beyond integers:
935
936@table @code
937@item struct Lisp_Cons
938Cons cell, an object used to construct lists.
939
940@item struct Lisp_String
941String, the basic object to represent a sequence of characters.
942
943@item struct Lisp_Vector
944Array, a fixed-size set of Lisp objects which may be accessed by an index.
945
946@item struct Lisp_Symbol
947Symbol, the unique-named entity commonly used as an identifier.
948
949@item struct Lisp_Float
09b73f08 950Floating-point value.
74934dcc
DA
951
952@item union Lisp_Misc
953Miscellaneous kinds of objects which don't fit into any of the above.
954@end table
955
956 These types are the first-class citizens of an internal type system.
957Since the tag space is limited, all other types are the subtypes of either
958@code{Lisp_Vectorlike} or @code{Lisp_Misc}. Vector subtypes are enumerated
959by @code{enum pvec_type}, and nearly all complex objects like windows, buffers,
960frames, and processes fall into this category. The rest of special types,
961including markers and overlays, are enumerated by @code{enum Lisp_Misc_Type}
962and form the set of subtypes of @code{Lisp_Misc}.
963
964 Below there is a description of a few subtypes of @code{Lisp_Vectorlike}.
965Buffer object represents the text to display and edit. Window is the part
966of display structure which shows the buffer or used as a container to
967recursively place other windows on the same frame. (Do not confuse Emacs Lisp
968window object with the window as an entity managed by the user interface
969system like X; in Emacs terminology, the latter is called frame.) Finally,
970process object is used to manage the subprocesses.
b8d4c8d0
GM
971
972@menu
973* Buffer Internals:: Components of a buffer structure.
974* Window Internals:: Components of a window structure.
975* Process Internals:: Components of a process structure.
976@end menu
977
978@node Buffer Internals
520f2425 979@subsection Buffer Internals
b8d4c8d0
GM
980@cindex internals, of buffer
981@cindex buffer internals
982
7d2d7cc0 983 Two structures (see @file{buffer.h}) are used to represent buffers
1df7defd 984in C@. The @code{buffer_text} structure contains fields describing the
7d2d7cc0
GM
985text of a buffer; the @code{buffer} structure holds other fields. In
986the case of indirect buffers, two or more @code{buffer} structures
987reference the same @code{buffer_text} structure.
b8d4c8d0 988
c773345a 989Here are some of the fields in @code{struct buffer_text}:
b8d4c8d0
GM
990
991@table @code
992@item beg
c773345a 993The address of the buffer contents.
b8d4c8d0
GM
994
995@item gpt
c773345a
CY
996@itemx gpt_byte
997The character and byte positions of the buffer gap. @xref{Buffer
998Gap}.
b8d4c8d0
GM
999
1000@item z
c773345a
CY
1001@itemx z_byte
1002The character and byte positions of the end of the buffer text.
b8d4c8d0
GM
1003
1004@item gap_size
c773345a 1005The size of buffer's gap. @xref{Buffer Gap}.
b8d4c8d0
GM
1006
1007@item modiff
c773345a
CY
1008@itemx save_modiff
1009@itemx chars_modiff
1010@itemx overlay_modiff
1011These fields count the number of buffer-modification events performed
1012in this buffer. @code{modiff} is incremented after each
1013buffer-modification event, and is never otherwise changed;
1014@code{save_modiff} contains the value of @code{modiff} the last time
1015the buffer was visited or saved; @code{chars_modiff} counts only
1016modifications to the characters in the buffer, ignoring all other
1017kinds of changes; and @code{overlay_modiff} counts only modifications
1018to the overlays.
b8d4c8d0
GM
1019
1020@item beg_unchanged
c773345a
CY
1021@itemx end_unchanged
1022The number of characters at the start and end of the text that are
1023known to be unchanged since the last complete redisplay.
b8d4c8d0
GM
1024
1025@item unchanged_modified
c773345a
CY
1026@itemx overlay_unchanged_modified
1027The values of @code{modiff} and @code{overlay_modiff}, respectively,
da6062e6 1028after the last complete redisplay. If their current values match
c773345a 1029@code{modiff} or @code{overlay_modiff}, that means
b8d4c8d0
GM
1030@code{beg_unchanged} and @code{end_unchanged} contain no useful
1031information.
1032
1033@item markers
1034The markers that refer to this buffer. This is actually a single
1035marker, and successive elements in its marker @code{chain} are the other
1036markers referring to this buffer text.
1037
1038@item intervals
c773345a 1039The interval tree which records the text properties of this buffer.
b8d4c8d0
GM
1040@end table
1041
c773345a 1042Some of the fields of @code{struct buffer} are:
b8d4c8d0
GM
1043
1044@table @code
7d2d7cc0 1045@item header
74934dcc
DA
1046A header of type @code{struct vectorlike_header} is common to all
1047vectorlike objects.
b8d4c8d0
GM
1048
1049@item own_text
c773345a
CY
1050A @code{struct buffer_text} structure that ordinarily holds the buffer
1051contents. In indirect buffers, this field is not used.
b8d4c8d0
GM
1052
1053@item text
c773345a
CY
1054A pointer to the @code{buffer_text} structure for this buffer. In an
1055ordinary buffer, this is the @code{own_text} field above. In an
1056indirect buffer, this is the @code{own_text} field of the base buffer.
b8d4c8d0 1057
74934dcc
DA
1058@item next
1059A pointer to the next buffer, in the chain of all buffers, including
1060killed buffers. This chain is used only for allocation and garbage
1061collection, in order to collect killed buffers properly.
1062
b8d4c8d0 1063@item pt
c773345a
CY
1064@itemx pt_byte
1065The character and byte positions of point in a buffer.
b8d4c8d0
GM
1066
1067@item begv
c773345a
CY
1068@itemx begv_byte
1069The character and byte positions of the beginning of the accessible
1070range of text in the buffer.
b8d4c8d0
GM
1071
1072@item zv
c773345a
CY
1073@itemx zv_byte
1074The character and byte positions of the end of the accessible range of
1075text in the buffer.
b8d4c8d0
GM
1076
1077@item base_buffer
1078In an indirect buffer, this points to the base buffer. In an ordinary
1079buffer, it is null.
1080
c773345a
CY
1081@item local_flags
1082This field contains flags indicating that certain variables are local
1083in this buffer. Such variables are declared in the C code using
1084@code{DEFVAR_PER_BUFFER}, and their buffer-local bindings are stored
1085in fields in the buffer structure itself. (Some of these fields are
b8d4c8d0
GM
1086described in this table.)
1087
1088@item modtime
c773345a
CY
1089The modification time of the visited file. It is set when the file is
1090written or read. Before writing the buffer into a file, this field is
1091compared to the modification time of the file to see if the file has
1092changed on disk. @xref{Buffer Modification}.
b8d4c8d0
GM
1093
1094@item auto_save_modified
c773345a 1095The time when the buffer was last auto-saved.
b8d4c8d0
GM
1096
1097@item last_window_start
c773345a
CY
1098The @code{window-start} position in the buffer as of the last time the
1099buffer was displayed in a window.
b8d4c8d0
GM
1100
1101@item clip_changed
c773345a
CY
1102This flag indicates that narrowing has changed in the buffer.
1103@xref{Narrowing}.
b8d4c8d0
GM
1104
1105@item prevent_redisplay_optimizations_p
c773345a
CY
1106This flag indicates that redisplay optimizations should not be used to
1107display this buffer.
b8d4c8d0 1108
c773345a
CY
1109@item overlay_center
1110This field holds the current overlay center position. @xref{Managing
1111Overlays}.
1112
1113@item overlays_before
1114@itemx overlays_after
1115These fields hold, respectively, a list of overlays that end at or
1116before the current overlay center, and a list of overlays that end
1117after the current overlay center. @xref{Managing Overlays}.
1118@code{overlays_before} is sorted in order of decreasing end position,
1119and @code{overlays_after} is sorted in order of increasing beginning
1120position.
b8d4c8d0 1121
7d2d7cc0
GM
1122@c FIXME? the following are now all Lisp_Object BUFFER_INTERNAL_FIELD (foo).
1123
b8d4c8d0 1124@item name
c773345a
CY
1125A Lisp string that names the buffer. It is guaranteed to be unique.
1126@xref{Buffer Names}.
b8d4c8d0 1127
c773345a
CY
1128@item save_length
1129The length of the file this buffer is visiting, when last read or
1130saved. This and other fields concerned with saving are not kept in
1131the @code{buffer_text} structure because indirect buffers are never
1132saved.
b8d4c8d0
GM
1133
1134@item directory
c773345a
CY
1135The directory for expanding relative file names. This is the value of
1136the buffer-local variable @code{default-directory} (@pxref{File Name Expansion}).
b8d4c8d0 1137
c773345a
CY
1138@item filename
1139The name of the file visited in this buffer, or @code{nil}. This is
1140the value of the buffer-local variable @code{buffer-file-name}
1141(@pxref{Buffer File Name}).
b8d4c8d0 1142
c773345a
CY
1143@item undo_list
1144@itemx backed_up
1145@itemx auto_save_file_name
7d2d7cc0 1146@itemx auto_save_file_format
c773345a
CY
1147@itemx read_only
1148@itemx file_format
1149@itemx file_truename
1150@itemx invisibility_spec
1151@itemx display_count
1152@itemx display_time
1153These fields store the values of Lisp variables that are automatically
1154buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1155variable names have the additional prefix @code{buffer-} and have
1156underscores replaced with dashes. For instance, @code{undo_list}
29157371 1157stores the value of @code{buffer-undo-list}.
b8d4c8d0
GM
1158
1159@item mark
c773345a
CY
1160The mark for the buffer. The mark is a marker, hence it is also
1161included on the list @code{markers}. @xref{The Mark}.
b8d4c8d0
GM
1162
1163@item local_var_alist
c773345a
CY
1164The association list describing the buffer-local variable bindings of
1165this buffer, not including the built-in buffer-local bindings that
1166have special slots in the buffer object. (Those slots are omitted
1167from this table.) @xref{Buffer-Local Variables}.
b8d4c8d0
GM
1168
1169@item major_mode
1170Symbol naming the major mode of this buffer, e.g., @code{lisp-mode}.
1171
1172@item mode_name
c773345a 1173Pretty name of the major mode, e.g., @code{"Lisp"}.
b8d4c8d0
GM
1174
1175@item keymap
c773345a
CY
1176@itemx abbrev_table
1177@itemx syntax_table
1178@itemx category_table
1179@itemx display_table
1180These fields store the buffer's local keymap (@pxref{Keymaps}), abbrev
1181table (@pxref{Abbrev Tables}), syntax table (@pxref{Syntax Tables}),
1182category table (@pxref{Categories}), and display table (@pxref{Display
1183Tables}).
b8d4c8d0
GM
1184
1185@item downcase_table
c773345a
CY
1186@itemx upcase_table
1187@itemx case_canon_table
1188These fields store the conversion tables for converting text to lower
1189case, upper case, and for canonicalizing text for case-fold search.
b8d4c8d0
GM
1190@xref{Case Tables}.
1191
b8d4c8d0
GM
1192@item minor_modes
1193An alist of the minor modes of this buffer.
1194
b8d4c8d0 1195@item pt_marker
c773345a
CY
1196@itemx begv_marker
1197@itemx zv_marker
1198These fields are only used in an indirect buffer, or in a buffer that
1199is the base of an indirect buffer. Each holds a marker that records
1200@code{pt}, @code{begv}, and @code{zv} respectively, for this buffer
b8d4c8d0
GM
1201when the buffer is not current.
1202
c773345a
CY
1203@item mode_line_format
1204@itemx header_line_format
1205@itemx case_fold_search
1206@itemx tab_width
1207@itemx fill_column
1208@itemx left_margin
1209@itemx auto_fill_function
c773345a
CY
1210@itemx truncate_lines
1211@itemx word_wrap
1212@itemx ctl_arrow
7d2d7cc0
GM
1213@itemx bidi_display_reordering
1214@itemx bidi_paragraph_direction
c773345a
CY
1215@itemx selective_display
1216@itemx selective_display_ellipses
1217@itemx overwrite_mode
1218@itemx abbrev_mode
c773345a
CY
1219@itemx mark_active
1220@itemx enable_multibyte_characters
1221@itemx buffer_file_coding_system
c773345a
CY
1222@itemx cache_long_line_scans
1223@itemx point_before_scroll
1224@itemx left_fringe_width
1225@itemx right_fringe_width
1226@itemx fringes_outside_margins
1227@itemx scroll_bar_width
1228@itemx indicate_empty_lines
1229@itemx indicate_buffer_boundaries
1230@itemx fringe_indicator_alist
1231@itemx fringe_cursor_alist
1232@itemx scroll_up_aggressively
1233@itemx scroll_down_aggressively
1234@itemx cursor_type
1235@itemx cursor_in_non_selected_windows
1236These fields store the values of Lisp variables that are automatically
1237buffer-local (@pxref{Buffer-Local Variables}), whose corresponding
1238variable names have underscores replaced with dashes. For instance,
1239@code{mode_line_format} stores the value of @code{mode-line-format}.
b8d4c8d0
GM
1240
1241@item last_selected_window
1242This is the last window that was selected with this buffer in it, or @code{nil}
1243if that window no longer displays this buffer.
b8d4c8d0
GM
1244@end table
1245
1246@node Window Internals
520f2425 1247@subsection Window Internals
b8d4c8d0
GM
1248@cindex internals, of window
1249@cindex window internals
1250
7d2d7cc0
GM
1251 The fields of a window (for a complete list, see the definition of
1252@code{struct window} in @file{window.h}) include:
b8d4c8d0
GM
1253
1254@table @code
1255@item frame
1256The frame that this window is on.
1257
1258@item mini_p
1259Non-@code{nil} if this window is a minibuffer window.
1260
1261@item parent
1262Internally, Emacs arranges windows in a tree; each group of siblings has
1263a parent window whose area includes all the siblings. This field points
1264to a window's parent.
1265
1266Parent windows do not display buffers, and play little role in display
1267except to shape their child windows. Emacs Lisp programs usually have
1268no access to the parent windows; they operate on the windows at the
1269leaves of the tree, which actually display buffers.
1270
37b2bf43
XF
1271@c FIXME: These two slots and the `buffer' slot below were replaced
1272@c with a single slot `contents' on 2013-03-28. --xfq
b8d4c8d0 1273@item hchild
ee2d5b5e
CY
1274@itemx vchild
1275These fields contain the window's leftmost child and its topmost child
1276respectively. @code{hchild} is used if the window is subdivided
1277horizontally by child windows, and @code{vchild} if it is subdivided
7d2d7cc0 1278vertically. In a live window, only one of @code{hchild}, @code{vchild},
1df7defd 1279and @code{buffer} (q.v.@:) is non-@code{nil}.
b8d4c8d0
GM
1280
1281@item next
ee2d5b5e
CY
1282@itemx prev
1283The next sibling and previous sibling of this window. @code{next} is
520f2425
GM
1284@code{nil} if the window is the right-most or bottom-most in its group;
1285@code{prev} is @code{nil} if it is the left-most or top-most in its
ee2d5b5e
CY
1286group.
1287
1288@item left_col
1289The left-hand edge of the window, measured in columns, relative to the
1290leftmost column in the frame (column 0).
1291
1292@item top_line
1293The top edge of the window, measured in lines, relative to the topmost
1294line in the frame (line 0).
1295
1296@item total_cols
1297@itemx total_lines
1298The width and height of the window, measured in columns and lines
1299respectively. The width includes the scroll bar and fringes, and/or
1300the separator line on the right of the window (if any).
b8d4c8d0
GM
1301
1302@item buffer
ee2d5b5e 1303The buffer that the window is displaying.
b8d4c8d0
GM
1304
1305@item start
ee2d5b5e
CY
1306A marker pointing to the position in the buffer that is the first
1307character displayed in the window.
b8d4c8d0
GM
1308
1309@item pointm
1310@cindex window point internals
1311This is the value of point in the current buffer when this window is
1312selected; when it is not selected, it retains its previous value.
1313
1314@item force_start
1315If this flag is non-@code{nil}, it says that the window has been
1316scrolled explicitly by the Lisp program. This affects what the next
1317redisplay does if point is off the screen: instead of scrolling the
1318window to show the text around point, it moves point to a location that
1319is on the screen.
1320
1321@item frozen_window_start_p
1322This field is set temporarily to 1 to indicate to redisplay that
1323@code{start} of this window should not be changed, even if point
1324gets invisible.
1325
1326@item start_at_line_beg
1327Non-@code{nil} means current value of @code{start} was the beginning of a line
1328when it was chosen.
1329
b8d4c8d0
GM
1330@item use_time
1331This is the last time that the window was selected. The function
1332@code{get-lru-window} uses this field.
1333
1334@item sequence_number
1335A unique number assigned to this window when it was created.
1336
1337@item last_modified
1338The @code{modiff} field of the window's buffer, as of the last time
1339a redisplay completed in this window.
1340
1341@item last_overlay_modified
1342The @code{overlay_modiff} field of the window's buffer, as of the last
1343time a redisplay completed in this window.
1344
1345@item last_point
1346The buffer's value of point, as of the last time a redisplay completed
1347in this window.
1348
1349@item last_had_star
1350A non-@code{nil} value means the window's buffer was ``modified'' when the
1351window was last updated.
1352
1353@item vertical_scroll_bar
1354This window's vertical scroll bar.
1355
7d2d7cc0
GM
1356@item left_margin_cols
1357@itemx right_margin_cols
ee2d5b5e 1358The widths of the left and right margins in this window. A value of
7d2d7cc0
GM
1359@code{nil} means no margin.
1360
1361@item left_fringe_width
1362@itemx right_fringe_width
1363The widths of the left and right fringes in this window. A value of
1364@code{nil} or @code{t} means use the values of the frame.
1365
1366@item fringes_outside_margins
1367A non-@code{nil} value means the fringes outside the display margins;
1368othersize they are between the margin and the text.
b8d4c8d0
GM
1369
1370@item window_end_pos
1371This is computed as @code{z} minus the buffer position of the last glyph
1372in the current matrix of the window. The value is only valid if
1373@code{window_end_valid} is not @code{nil}.
1374
1375@item window_end_bytepos
1376The byte position corresponding to @code{window_end_pos}.
1377
1378@item window_end_vpos
1379The window-relative vertical position of the line containing
1380@code{window_end_pos}.
1381
1382@item window_end_valid
1383This field is set to a non-@code{nil} value if @code{window_end_pos} is truly
7d2d7cc0 1384valid. This is @code{nil} if nontrivial redisplay is pre-empted, since in that
b8d4c8d0
GM
1385case the display that @code{window_end_pos} was computed for did not get
1386onto the screen.
1387
b8d4c8d0
GM
1388@item cursor
1389A structure describing where the cursor is in this window.
1390
1391@item last_cursor
1392The value of @code{cursor} as of the last redisplay that finished.
1393
1394@item phys_cursor
1395A structure describing where the cursor of this window physically is.
1396
1397@item phys_cursor_type
7d2d7cc0
GM
1398@c FIXME What is this?
1399@c itemx phys_cursor_ascent
1400@itemx phys_cursor_height
1401@itemx phys_cursor_width
1402The type, height, and width of the cursor that was last displayed on
1403this window.
b8d4c8d0
GM
1404
1405@item phys_cursor_on_p
1406This field is non-zero if the cursor is physically on.
1407
1408@item cursor_off_p
7d2d7cc0
GM
1409Non-zero means the cursor in this window is logically off. This is
1410used for blinking the cursor.
b8d4c8d0
GM
1411
1412@item last_cursor_off_p
1413This field contains the value of @code{cursor_off_p} as of the time of
1414the last redisplay.
1415
1416@item must_be_updated_p
1417This is set to 1 during redisplay when this window must be updated.
1418
1419@item hscroll
1420This is the number of columns that the display in the window is scrolled
1421horizontally to the left. Normally, this is 0.
1422
1423@item vscroll
1424Vertical scroll amount, in pixels. Normally, this is 0.
1425
1426@item dedicated
1427Non-@code{nil} if this window is dedicated to its buffer.
1428
1429@item display_table
1430The window's display table, or @code{nil} if none is specified for it.
1431
1432@item update_mode_line
1433Non-@code{nil} means this window's mode line needs to be updated.
1434
1435@item base_line_number
1436The line number of a certain position in the buffer, or @code{nil}.
1437This is used for displaying the line number of point in the mode line.
1438
1439@item base_line_pos
1440The position in the buffer for which the line number is known, or
7d2d7cc0
GM
1441@code{nil} meaning none is known. If it is a buffer, don't display
1442the line number as long as the window shows that buffer.
b8d4c8d0 1443
b8d4c8d0
GM
1444@item column_number_displayed
1445The column number currently displayed in this window's mode line, or @code{nil}
1446if column numbers are not being displayed.
1447
1448@item current_matrix
7d2d7cc0
GM
1449@itemx desired_matrix
1450Glyph matrices describing the current and desired display of this window.
b8d4c8d0
GM
1451@end table
1452
1453@node Process Internals
520f2425 1454@subsection Process Internals
b8d4c8d0
GM
1455@cindex internals, of process
1456@cindex process internals
1457
7d2d7cc0
GM
1458 The fields of a process (for a complete list, see the definition of
1459@code{struct Lisp_Process} in @file{process.h}) include:
b8d4c8d0
GM
1460
1461@table @code
1462@item name
1463A string, the name of the process.
1464
1465@item command
1466A list containing the command arguments that were used to start this
c73e02fa
GM
1467process. For a network or serial process, it is @code{nil} if the
1468process is running or @code{t} if the process is stopped.
b8d4c8d0
GM
1469
1470@item filter
458e643b 1471A function used to accept output from the process.
b8d4c8d0
GM
1472
1473@item sentinel
458e643b 1474A function called whenever the state of the process changes.
b8d4c8d0
GM
1475
1476@item buffer
1477The associated buffer of the process.
1478
1479@item pid
1480An integer, the operating system's process @acronym{ID}.
7d2d7cc0 1481Pseudo-processes such as network or serial connections use a value of 0.
b8d4c8d0
GM
1482
1483@item childp
7d2d7cc0
GM
1484A flag, @code{t} if this is really a child process. For a network or
1485serial connection, it is a plist based on the arguments to
1486@code{make-network-process} or @code{make-serial-process}.
b8d4c8d0
GM
1487
1488@item mark
1489A marker indicating the position of the end of the last output from this
1490process inserted into the buffer. This is often but not always the end
1491of the buffer.
1492
1493@item kill_without_query
ee2d5b5e
CY
1494If this is non-zero, killing Emacs while this process is still running
1495does not ask for confirmation about killing the process.
b8d4c8d0 1496
7d2d7cc0
GM
1497@item raw_status
1498The raw process status, as returned by the @code{wait} system call.
b8d4c8d0
GM
1499
1500@item status
1501The process status, as @code{process-status} should return it.
1502
1503@item tick
1504@itemx update_tick
1505If these two fields are not equal, a change in the status of the process
1506needs to be reported, either by running the sentinel or by inserting a
1507message in the process buffer.
1508
1509@item pty_flag
a2eb421b 1510Non-@code{nil} if communication with the subprocess uses a pty;
b8d4c8d0
GM
1511@code{nil} if it uses a pipe.
1512
1513@item infd
1514The file descriptor for input from the process.
1515
1516@item outfd
1517The file descriptor for output to the process.
1518
b8d4c8d0
GM
1519@item tty_name
1520The name of the terminal that the subprocess is using,
1521or @code{nil} if it is using pipes.
1522
1523@item decode_coding_system
1524Coding-system for decoding the input from this process.
1525
1526@item decoding_buf
1527A working buffer for decoding.
1528
1529@item decoding_carryover
1530Size of carryover in decoding.
1531
1532@item encode_coding_system
1533Coding-system for encoding the output to this process.
1534
1535@item encoding_buf
1536A working buffer for encoding.
1537
b8d4c8d0
GM
1538@item inherit_coding_system_flag
1539Flag to set @code{coding-system} of the process buffer from the
1540coding system used to decode process output.
c73e02fa
GM
1541
1542@item type
1543Symbol indicating the type of process: @code{real}, @code{network},
7d2d7cc0 1544@code{serial}.
c73e02fa 1545
b8d4c8d0 1546@end table
7d2d7cc0 1547
d92d9c95
PE
1548@node C Integer Types
1549@section C Integer Types
1550@cindex integer types (C programming language)
1551
1552Here are some guidelines for use of integer types in the Emacs C
1553source code. These guidelines sometimes give competing advice; common
1554sense is advised.
1555
1556@itemize @bullet
1557@item
1558Avoid arbitrary limits. For example, avoid @code{int len = strlen
1559(s);} unless the length of @code{s} is required for other reasons to
1560fit in @code{int} range.
1561
1562@item
1563Do not assume that signed integer arithmetic wraps around on overflow.
1564This is no longer true of Emacs porting targets: signed integer
1565overflow has undefined behavior in practice, and can dump core or
1566even cause earlier or later code to behave ``illogically''. Unsigned
1567overflow does wrap around reliably, modulo a power of two.
1568
1569@item
1570Prefer signed types to unsigned, as code gets confusing when signed
1571and unsigned types are combined. Many other guidelines assume that
1572types are signed; in the rarer cases where unsigned types are needed,
1573similar advice may apply to the unsigned counterparts (e.g.,
1574@code{size_t} instead of @code{ptrdiff_t}, or @code{uintptr_t} instead
1575of @code{intptr_t}).
1576
1577@item
1578Prefer @code{int} for Emacs character codes, in the range 0 ..@: 0x3FFFFF.
1579
1580@item
1581Prefer @code{ptrdiff_t} for sizes, i.e., for integers bounded by the
1582maximum size of any individual C object or by the maximum number of
1583elements in any C array. This is part of Emacs's general preference
1584for signed types. Using @code{ptrdiff_t} limits objects to
1585@code{PTRDIFF_MAX} bytes, but larger objects would cause trouble
1586anyway since they would break pointer subtraction, so this does not
1587impose an arbitrary limit.
1588
1589@item
1590Prefer @code{intptr_t} for internal representations of pointers, or
1591for integers bounded only by the number of objects that can exist at
1592any given time or by the total number of bytes that can be allocated.
1593Currently Emacs sometimes uses other types when @code{intptr_t} would
1594be better; fixing this is lower priority, as the code works as-is on
1595Emacs's current porting targets.
1596
1597@item
1598Prefer the Emacs-defined type @code{EMACS_INT} for representing values
1599converted to or from Emacs Lisp fixnums, as fixnum arithmetic is based
1600on @code{EMACS_INT}.
1601
1602@item
1603When representing a system value (such as a file size or a count of
1604seconds since the Epoch), prefer the corresponding system type (e.g.,
1605@code{off_t}, @code{time_t}). Do not assume that a system type is
1606signed, unless this assumption is known to be safe. For example,
1607although @code{off_t} is always signed, @code{time_t} need not be.
1608
1609@item
1610Prefer the Emacs-defined type @code{printmax_t} for representing
09b73f08 1611values that might be any signed integer that can be printed,
d92d9c95
PE
1612using a @code{printf}-family function.
1613
1614@item
1615Prefer @code{intmax_t} for representing values that might be any
1616signed integer value.
1617
1618@item
1619In bitfields, prefer @code{unsigned int} or @code{signed int} to
1620@code{int}, as @code{int} is less portable: it might be signed, and
1621might not be. Single-bit bit fields are invariably @code{unsigned
1622int} so that their values are 0 and 1.
1623
1624@item
a2326811
PE
1625Prefer @code{bool}, @code{false} and @code{true} for booleans.
1626Using @code{bool} can make programs easier to read and a bit faster than
1627using @code{int}. Although it is also OK to use @code{int}, @code{0}
1628and @code{1}, this older style is gradually being phased out. When
d92d9c95
PE
1629using @code{bool}, respect the limitations of the replacement
1630implementation of @code{bool}, as documented in the source file
1631@file{lib/stdbool.in.h}, so that Emacs remains portable to pre-C99
1632platforms.
1633@end itemize
1634
7d2d7cc0 1635@c FIXME Mention src/globals.h somewhere in this file?