Fix bug #8468 with redisplay and scroll-margin > 0.
[bpt/emacs.git] / doc / lispref / processes.texi
CommitLineData
b8d4c8d0
GM
1@c -*-texinfo-*-
2@c This is part of the GNU Emacs Lisp Reference Manual.
73b0cd50 3@c Copyright (C) 1990-1995, 1998-1999, 2001-2011
d24880de 4@c Free Software Foundation, Inc.
b8d4c8d0 5@c See the file elisp.texi for copying conditions.
6336d8c3 6@setfilename ../../info/processes
b8d4c8d0
GM
7@node Processes, Display, Abbrevs, Top
8@chapter Processes
9@cindex child process
10@cindex parent process
11@cindex subprocess
12@cindex process
13
14 In the terminology of operating systems, a @dfn{process} is a space in
15which a program can execute. Emacs runs in a process. Emacs Lisp
16programs can invoke other programs in processes of their own. These are
17called @dfn{subprocesses} or @dfn{child processes} of the Emacs process,
18which is their @dfn{parent process}.
19
20 A subprocess of Emacs may be @dfn{synchronous} or @dfn{asynchronous},
21depending on how it is created. When you create a synchronous
22subprocess, the Lisp program waits for the subprocess to terminate
23before continuing execution. When you create an asynchronous
24subprocess, it can run in parallel with the Lisp program. This kind of
25subprocess is represented within Emacs by a Lisp object which is also
26called a ``process.'' Lisp programs can use this object to communicate
27with the subprocess or to control it. For example, you can send
28signals, obtain status information, receive output from the process, or
29send input to it.
30
31@defun processp object
23dd4ecd
EZ
32This function returns @code{t} if @var{object} represents an Emacs
33subprocess, @code{nil} otherwise.
b8d4c8d0
GM
34@end defun
35
23dd4ecd
EZ
36 In addition to subprocesses of the current Emacs session, you can
37also access other processes running on your machine. @xref{System
38Processes}.
39
b8d4c8d0
GM
40@menu
41* Subprocess Creation:: Functions that start subprocesses.
42* Shell Arguments:: Quoting an argument to pass it to a shell.
43* Synchronous Processes:: Details of using synchronous subprocesses.
44* Asynchronous Processes:: Starting up an asynchronous subprocess.
45* Deleting Processes:: Eliminating an asynchronous subprocess.
46* Process Information:: Accessing run-status and other attributes.
47* Input to Processes:: Sending input to an asynchronous subprocess.
48* Signals to Processes:: Stopping, continuing or interrupting
49 an asynchronous subprocess.
50* Output from Processes:: Collecting output from an asynchronous subprocess.
51* Sentinels:: Sentinels run when process run-status changes.
52* Query Before Exit:: Whether to query if exiting will kill a process.
23dd4ecd 53* System Processes:: Accessing other processes running on your system.
d24880de 54* Transaction Queues:: Transaction-based communication with subprocesses.
b8d4c8d0
GM
55* Network:: Opening network connections.
56* Network Servers:: Network servers let Emacs accept net connections.
57* Datagrams:: UDP network connections.
58* Low-Level Network:: Lower-level but more general function
59 to create connections and servers.
d24880de 60* Misc Network:: Additional relevant functions for net connections.
c73e02fa 61* Serial Ports:: Communicating with serial ports.
b8d4c8d0
GM
62* Byte Packing:: Using bindat to pack and unpack binary data.
63@end menu
64
65@node Subprocess Creation
66@section Functions that Create Subprocesses
67
583d8b3c 68 There are three primitives that create a new subprocess in which to run
b8d4c8d0
GM
69a program. One of them, @code{start-process}, creates an asynchronous
70process and returns a process object (@pxref{Asynchronous Processes}).
71The other two, @code{call-process} and @code{call-process-region},
72create a synchronous process and do not return a process object
73(@pxref{Synchronous Processes}).
74
75 Synchronous and asynchronous processes are explained in the following
76sections. Since the three functions are all called in a similar
77fashion, their common arguments are described here.
78
79@cindex execute program
80@cindex @code{PATH} environment variable
81@cindex @code{HOME} environment variable
82 In all cases, the function's @var{program} argument specifies the
83program to be run. An error is signaled if the file is not found or
84cannot be executed. If the file name is relative, the variable
85@code{exec-path} contains a list of directories to search. Emacs
86initializes @code{exec-path} when it starts up, based on the value of
87the environment variable @code{PATH}. The standard file name
88constructs, @samp{~}, @samp{.}, and @samp{..}, are interpreted as
89usual in @code{exec-path}, but environment variable substitutions
90(@samp{$HOME}, etc.) are not recognized; use
91@code{substitute-in-file-name} to perform them (@pxref{File Name
92Expansion}). @code{nil} in this list refers to
93@code{default-directory}.
94
95 Executing a program can also try adding suffixes to the specified
96name:
97
98@defvar exec-suffixes
99This variable is a list of suffixes (strings) to try adding to the
100specified program file name. The list should include @code{""} if you
101want the name to be tried exactly as specified. The default value is
102system-dependent.
103@end defvar
104
105 @strong{Please note:} The argument @var{program} contains only the
106name of the program; it may not contain any command-line arguments. You
107must use @var{args} to provide those.
108
109 Each of the subprocess-creating functions has a @var{buffer-or-name}
110argument which specifies where the standard output from the program will
111go. It should be a buffer or a buffer name; if it is a buffer name,
112that will create the buffer if it does not already exist. It can also
113be @code{nil}, which says to discard the output unless a filter function
114handles it. (@xref{Filter Functions}, and @ref{Read and Print}.)
115Normally, you should avoid having multiple processes send output to the
116same buffer because their output would be intermixed randomly.
117
118@cindex program arguments
119 All three of the subprocess-creating functions have a @code{&rest}
120argument, @var{args}. The @var{args} must all be strings, and they are
121supplied to @var{program} as separate command line arguments. Wildcard
122characters and other shell constructs have no special meanings in these
123strings, since the strings are passed directly to the specified program.
124
125 The subprocess gets its current directory from the value of
126@code{default-directory} (@pxref{File Name Expansion}).
127
128@cindex environment variables, subprocesses
129 The subprocess inherits its environment from Emacs, but you can
130specify overrides for it with @code{process-environment}. @xref{System
131Environment}.
132
133@defvar exec-directory
134@pindex movemail
135The value of this variable is a string, the name of a directory that
136contains programs that come with GNU Emacs, programs intended for Emacs
137to invoke. The program @code{movemail} is an example of such a program;
138Rmail uses it to fetch new mail from an inbox.
139@end defvar
140
141@defopt exec-path
142The value of this variable is a list of directories to search for
143programs to run in subprocesses. Each element is either the name of a
144directory (i.e., a string), or @code{nil}, which stands for the default
145directory (which is the value of @code{default-directory}).
146@cindex program directories
147
148The value of @code{exec-path} is used by @code{call-process} and
149@code{start-process} when the @var{program} argument is not an absolute
150file name.
151@end defopt
152
153@node Shell Arguments
154@section Shell Arguments
155@cindex arguments for shell commands
156@cindex shell command arguments
157
158 Lisp programs sometimes need to run a shell and give it a command
159that contains file names that were specified by the user. These
160programs ought to be able to support any valid file name. But the shell
161gives special treatment to certain characters, and if these characters
162occur in the file name, they will confuse the shell. To handle these
163characters, use the function @code{shell-quote-argument}:
164
165@defun shell-quote-argument argument
166This function returns a string which represents, in shell syntax,
167an argument whose actual contents are @var{argument}. It should
168work reliably to concatenate the return value into a shell command
169and then pass it to a shell for execution.
170
171Precisely what this function does depends on your operating system. The
172function is designed to work with the syntax of your system's standard
173shell; if you use an unusual shell, you will need to redefine this
174function.
175
176@example
177;; @r{This example shows the behavior on GNU and Unix systems.}
178(shell-quote-argument "foo > bar")
179 @result{} "foo\\ \\>\\ bar"
180
181;; @r{This example shows the behavior on MS-DOS and MS-Windows.}
182(shell-quote-argument "foo > bar")
183 @result{} "\"foo > bar\""
184@end example
185
186Here's an example of using @code{shell-quote-argument} to construct
187a shell command:
188
189@example
190(concat "diff -c "
191 (shell-quote-argument oldfile)
192 " "
193 (shell-quote-argument newfile))
194@end example
195@end defun
196
3c73e30e
EZ
197@cindex quoting and unquoting command-line arguments
198@cindex minibuffer input, and command-line arguments
199@cindex @code{call-process}, command-line arguments from minibuffer
200@cindex @code{start-process}, command-line arguments from minibuffer
4bb49a92
EZ
201 The following two functions are useful for combining a list of
202individual command-line argument strings into a single string, and
203taking a string apart into a list of individual command-line
204arguments. These functions are mainly intended to be used for
205converting user input in the minibuffer, a Lisp string, into a list of
206string arguments to be passed to @code{call-process} or
3c73e30e
EZ
207@code{start-process}, or for the converting such lists of arguments in
208a single Lisp string to be presented in the minibuffer or echo area.
a873ee3d
EZ
209
210@defun split-string-and-unquote string &optional separators
211This function splits @var{string} into substrings at matches for the
212regular expression @var{separators}, like @code{split-string} does
0999039c
CY
213(@pxref{Creating Strings}); in addition, it removes quoting from the
214substrings. It then makes a list of the substrings and returns it.
a873ee3d 215
4185820c
CY
216If @var{separators} is omitted or @code{nil}, it defaults to
217@code{"\\s-+"}, which is a regular expression that matches one or more
218characters with whitespace syntax (@pxref{Syntax Class Table}).
a873ee3d 219
3c73e30e 220This function supports two types of quoting: enclosing a whole string
0999039c
CY
221in double quotes @code{"@dots{}"}, and quoting individual characters
222with a backslash escape @samp{\}. The latter is also used in Lisp
223strings, so this function can handle those as well.
a873ee3d
EZ
224@end defun
225
226@defun combine-and-quote-strings list-of-strings &optional separator
227This function concatenates @var{list-of-strings} into a single string,
0999039c
CY
228quoting each string as necessary. It also sticks the @var{separator}
229string between each pair of strings; if @var{separator} is omitted or
230@code{nil}, it defaults to @code{" "}. The return value is the
231resulting string.
a873ee3d
EZ
232
233The strings in @var{list-of-strings} that need quoting are those that
234include @var{separator} as their substring. Quoting a string encloses
235it in double quotes @code{"@dots{}"}. In the simplest case, if you
4bb49a92
EZ
236are consing a command from the individual command-line arguments,
237every argument that includes embedded blanks will be quoted.
a873ee3d
EZ
238@end defun
239
b8d4c8d0
GM
240@node Synchronous Processes
241@section Creating a Synchronous Process
242@cindex synchronous subprocess
243
244 After a @dfn{synchronous process} is created, Emacs waits for the
245process to terminate before continuing. Starting Dired on GNU or
246Unix@footnote{On other systems, Emacs uses a Lisp emulation of
247@code{ls}; see @ref{Contents of Directories}.} is an example of this: it
248runs @code{ls} in a synchronous process, then modifies the output
249slightly. Because the process is synchronous, the entire directory
250listing arrives in the buffer before Emacs tries to do anything with it.
251
252 While Emacs waits for the synchronous subprocess to terminate, the
253user can quit by typing @kbd{C-g}. The first @kbd{C-g} tries to kill
254the subprocess with a @code{SIGINT} signal; but it waits until the
255subprocess actually terminates before quitting. If during that time the
256user types another @kbd{C-g}, that kills the subprocess instantly with
257@code{SIGKILL} and quits immediately (except on MS-DOS, where killing
258other processes doesn't work). @xref{Quitting}.
259
260 The synchronous subprocess functions return an indication of how the
261process terminated.
262
263 The output from a synchronous subprocess is generally decoded using a
264coding system, much like text read from a file. The input sent to a
265subprocess by @code{call-process-region} is encoded using a coding
266system, much like text written into a file. @xref{Coding Systems}.
267
268@defun call-process program &optional infile destination display &rest args
b59a4335 269This function calls @var{program} and waits for it to finish.
b8d4c8d0 270
b59a4335 271The standard input for the new process comes from file @var{infile} if
b8d4c8d0
GM
272@var{infile} is not @code{nil}, and from the null device otherwise.
273The argument @var{destination} says where to put the process output.
274Here are the possibilities:
275
276@table @asis
277@item a buffer
278Insert the output in that buffer, before point. This includes both the
279standard output stream and the standard error stream of the process.
280
281@item a string
282Insert the output in a buffer with that name, before point.
283
284@item @code{t}
285Insert the output in the current buffer, before point.
286
287@item @code{nil}
288Discard the output.
289
290@item 0
291Discard the output, and return @code{nil} immediately without waiting
292for the subprocess to finish.
293
294In this case, the process is not truly synchronous, since it can run in
295parallel with Emacs; but you can think of it as synchronous in that
296Emacs is essentially finished with the subprocess as soon as this
297function returns.
298
299MS-DOS doesn't support asynchronous subprocesses, so this option doesn't
300work there.
301
302@item @code{(@var{real-destination} @var{error-destination})}
303Keep the standard output stream separate from the standard error stream;
304deal with the ordinary output as specified by @var{real-destination},
305and dispose of the error output according to @var{error-destination}.
306If @var{error-destination} is @code{nil}, that means to discard the
307error output, @code{t} means mix it with the ordinary output, and a
308string specifies a file name to redirect error output into.
309
310You can't directly specify a buffer to put the error output in; that is
311too difficult to implement. But you can achieve this result by sending
312the error output to a temporary file and then inserting the file into a
313buffer.
314@end table
315
316If @var{display} is non-@code{nil}, then @code{call-process} redisplays
317the buffer as output is inserted. (However, if the coding system chosen
318for decoding output is @code{undecided}, meaning deduce the encoding
319from the actual data, then redisplay sometimes cannot continue once
320non-@acronym{ASCII} characters are encountered. There are fundamental
321reasons why it is hard to fix this; see @ref{Output from Processes}.)
322
323Otherwise the function @code{call-process} does no redisplay, and the
324results become visible on the screen only when Emacs redisplays that
325buffer in the normal course of events.
326
327The remaining arguments, @var{args}, are strings that specify command
328line arguments for the program.
329
330The value returned by @code{call-process} (unless you told it not to
331wait) indicates the reason for process termination. A number gives the
332exit status of the subprocess; 0 means success, and any other value
333means failure. If the process terminated with a signal,
334@code{call-process} returns a string describing the signal.
335
336In the examples below, the buffer @samp{foo} is current.
337
338@smallexample
339@group
340(call-process "pwd" nil t)
341 @result{} 0
342
343---------- Buffer: foo ----------
344/usr/user/lewis/manual
345---------- Buffer: foo ----------
346@end group
347
348@group
349(call-process "grep" nil "bar" nil "lewis" "/etc/passwd")
350 @result{} 0
351
352---------- Buffer: bar ----------
353lewis:5LTsHm66CSWKg:398:21:Bil Lewis:/user/lewis:/bin/csh
354
355---------- Buffer: bar ----------
356@end group
357@end smallexample
358
359Here is a good example of the use of @code{call-process}, which used to
360be found in the definition of @code{insert-directory}:
361
362@smallexample
363@group
364(call-process insert-directory-program nil t nil @var{switches}
365 (if full-directory-p
366 (concat (file-name-as-directory file) ".")
367 file))
368@end group
369@end smallexample
370@end defun
371
372@defun process-file program &optional infile buffer display &rest args
373This function processes files synchronously in a separate process. It
374is similar to @code{call-process} but may invoke a file handler based
375on the value of the variable @code{default-directory}. The current
376working directory of the subprocess is @code{default-directory}.
377
378The arguments are handled in almost the same way as for
379@code{call-process}, with the following differences:
380
381Some file handlers may not support all combinations and forms of the
382arguments @var{infile}, @var{buffer}, and @var{display}. For example,
383some file handlers might behave as if @var{display} were @code{nil},
384regardless of the value actually passed. As another example, some
385file handlers might not support separating standard output and error
386output by way of the @var{buffer} argument.
387
388If a file handler is invoked, it determines the program to run based
389on the first argument @var{program}. For instance, consider that a
390handler for remote files is invoked. Then the path that is used for
391searching the program might be different than @code{exec-path}.
392
393The second argument @var{infile} may invoke a file handler. The file
394handler could be different from the handler chosen for the
395@code{process-file} function itself. (For example,
396@code{default-directory} could be on a remote host, whereas
397@var{infile} is on another remote host. Or @code{default-directory}
398could be non-special, whereas @var{infile} is on a remote host.)
399
400If @var{buffer} is a list of the form @code{(@var{real-destination}
401@var{error-destination})}, and @var{error-destination} names a file,
402then the same remarks as for @var{infile} apply.
403
404The remaining arguments (@var{args}) will be passed to the process
405verbatim. Emacs is not involved in processing file names that are
406present in @var{args}. To avoid confusion, it may be best to avoid
407absolute file names in @var{args}, but rather to specify all file
408names as relative to @code{default-directory}. The function
409@code{file-relative-name} is useful for constructing such relative
410file names.
411@end defun
412
3691a0a6
MA
413@defvar process-file-side-effects
414This variable indicates, whether a call of @code{process-file} changes
415remote files.
416
417Per default, this variable is always set to @code{t}, meaning that a
418call of @code{process-file} could potentially change any file on a
419remote host. When set to @code{nil}, a file handler could optimize
420its behaviour with respect to remote file attributes caching.
421
422This variable should never be changed by @code{setq}. Instead of, it
423shall be set only by let-binding.
424@end defvar
425
b8d4c8d0
GM
426@defun call-process-region start end program &optional delete destination display &rest args
427This function sends the text from @var{start} to @var{end} as
428standard input to a process running @var{program}. It deletes the text
429sent if @var{delete} is non-@code{nil}; this is useful when
430@var{destination} is @code{t}, to insert the output in the current
431buffer in place of the input.
432
433The arguments @var{destination} and @var{display} control what to do
434with the output from the subprocess, and whether to update the display
435as it comes in. For details, see the description of
436@code{call-process}, above. If @var{destination} is the integer 0,
437@code{call-process-region} discards the output and returns @code{nil}
438immediately, without waiting for the subprocess to finish (this only
439works if asynchronous subprocesses are supported).
440
441The remaining arguments, @var{args}, are strings that specify command
442line arguments for the program.
443
444The return value of @code{call-process-region} is just like that of
445@code{call-process}: @code{nil} if you told it to return without
446waiting; otherwise, a number or string which indicates how the
447subprocess terminated.
448
449In the following example, we use @code{call-process-region} to run the
450@code{cat} utility, with standard input being the first five characters
451in buffer @samp{foo} (the word @samp{input}). @code{cat} copies its
452standard input into its standard output. Since the argument
453@var{destination} is @code{t}, this output is inserted in the current
454buffer.
455
456@smallexample
457@group
458---------- Buffer: foo ----------
459input@point{}
460---------- Buffer: foo ----------
461@end group
462
463@group
464(call-process-region 1 6 "cat" nil t)
465 @result{} 0
466
467---------- Buffer: foo ----------
468inputinput@point{}
469---------- Buffer: foo ----------
470@end group
471@end smallexample
472
473 The @code{shell-command-on-region} command uses
474@code{call-process-region} like this:
475
476@smallexample
477@group
478(call-process-region
479 start end
480 shell-file-name ; @r{Name of program.}
481 nil ; @r{Do not delete region.}
482 buffer ; @r{Send output to @code{buffer}.}
483 nil ; @r{No redisplay during output.}
484 "-c" command) ; @r{Arguments for the shell.}
485@end group
486@end smallexample
487@end defun
488
489@defun call-process-shell-command command &optional infile destination display &rest args
b59a4335
CY
490This function executes the shell command @var{command} synchronously.
491The final arguments @var{args} are additional arguments to add at the
492end of @var{command}. The other arguments are handled as in
493@code{call-process}.
b8d4c8d0
GM
494@end defun
495
496@defun process-file-shell-command command &optional infile destination display &rest args
497This function is like @code{call-process-shell-command}, but uses
498@code{process-file} internally. Depending on @code{default-directory},
499@var{command} can be executed also on remote hosts.
500@end defun
501
502@defun shell-command-to-string command
503This function executes @var{command} (a string) as a shell command,
504then returns the command's output as a string.
505@end defun
506
583d8b3c 507@defun process-lines program &rest args
b59a4335
CY
508This function runs @var{program}, waits for it to finish, and returns
509its output as a list of strings. Each string in the list holds a
510single line of text output by the program; the end-of-line characters
511are stripped from each line. The arguments beyond @var{program},
512@var{args}, are strings that specify command-line arguments with which
513to run the program.
583d8b3c
EZ
514
515If @var{program} exits with a non-zero exit status, this function
516signals an error.
517
518This function works by calling @code{call-process}, so program output
519is decoded in the same way as for @code{call-process}.
520@end defun
521
b8d4c8d0
GM
522@node Asynchronous Processes
523@section Creating an Asynchronous Process
524@cindex asynchronous subprocess
525
526 After an @dfn{asynchronous process} is created, Emacs and the subprocess
527both continue running immediately. The process thereafter runs
528in parallel with Emacs, and the two can communicate with each other
529using the functions described in the following sections. However,
530communication is only partially asynchronous: Emacs sends data to the
531process only when certain functions are called, and Emacs accepts data
532from the process only when Emacs is waiting for input or for a time
533delay.
534
535 Here we describe how to create an asynchronous process.
536
537@defun start-process name buffer-or-name program &rest args
538This function creates a new asynchronous subprocess and starts the
539program @var{program} running in it. It returns a process object that
540stands for the new subprocess in Lisp. The argument @var{name}
541specifies the name for the process object; if a process with this name
542already exists, then @var{name} is modified (by appending @samp{<1>},
543etc.) to be unique. The buffer @var{buffer-or-name} is the buffer to
544associate with the process.
545
546The remaining arguments, @var{args}, are strings that specify command
547line arguments for the program.
548
549In the example below, the first process is started and runs (rather,
550sleeps) for 100 seconds. Meanwhile, the second process is started, and
551given the name @samp{my-process<1>} for the sake of uniqueness. It
552inserts the directory listing at the end of the buffer @samp{foo},
553before the first process finishes. Then it finishes, and a message to
554that effect is inserted in the buffer. Much later, the first process
555finishes, and another message is inserted in the buffer for it.
556
557@smallexample
558@group
559(start-process "my-process" "foo" "sleep" "100")
560 @result{} #<process my-process>
561@end group
562
563@group
564(start-process "my-process" "foo" "ls" "-l" "/user/lewis/bin")
565 @result{} #<process my-process<1>>
566
567---------- Buffer: foo ----------
568total 2
569lrwxrwxrwx 1 lewis 14 Jul 22 10:12 gnuemacs --> /emacs
570-rwxrwxrwx 1 lewis 19 Jul 30 21:02 lemon
571
572Process my-process<1> finished
573
574Process my-process finished
575---------- Buffer: foo ----------
576@end group
577@end smallexample
578@end defun
579
580@defun start-file-process name buffer-or-name program &rest args
581Like @code{start-process}, this function starts a new asynchronous
582subprocess running @var{program} in it, and returns its process
583object---when @code{default-directory} is not a magic file name.
584
585If @code{default-directory} is magic, the function invokes its file
586handler instead. This handler ought to run @var{program}, perhaps on
587the local host, perhaps on a remote host that corresponds to
588@code{default-directory}. In the latter case, the local part of
589@code{default-directory} becomes the working directory of the process.
590
591This function does not try to invoke file name handlers for
592@var{program} or for the @var{program-args}.
593
594Depending on the implementation of the file handler, it might not be
595possible to apply @code{process-filter} or @code{process-sentinel} to
596the resulting process object (@pxref{Filter Functions}, @pxref{Sentinels}).
597
598Some file handlers may not support @code{start-file-process} (for
599example @code{ange-ftp-hook-function}). In such cases, the function
600does nothing and returns @code{nil}.
601@end defun
602
03a74b84 603@defun start-process-shell-command name buffer-or-name command
b8d4c8d0
GM
604This function is like @code{start-process} except that it uses a shell
605to execute the specified command. The argument @var{command} is a shell
03a74b84 606command name. The variable @code{shell-file-name} specifies which shell to
b8d4c8d0
GM
607use.
608
609The point of running a program through the shell, rather than directly
610with @code{start-process}, is so that you can employ shell features such
611as wildcards in the arguments. It follows that if you include an
612arbitrary user-specified arguments in the command, you should quote it
613with @code{shell-quote-argument} first, so that any special shell
614characters do @emph{not} have their special shell meanings. @xref{Shell
615Arguments}.
616@end defun
617
03a74b84 618@defun start-file-process-shell-command name buffer-or-name command
b8d4c8d0
GM
619This function is like @code{start-process-shell-command}, but uses
620@code{start-file-process} internally. By this, @var{command} can be
621executed also on remote hosts, depending on @code{default-directory}.
622@end defun
623
624@defvar process-connection-type
625@cindex pipes
626@cindex @acronym{PTY}s
627This variable controls the type of device used to communicate with
628asynchronous subprocesses. If it is non-@code{nil}, then @acronym{PTY}s are
629used, when available. Otherwise, pipes are used.
630
631@acronym{PTY}s are usually preferable for processes visible to the user, as
632in Shell mode, because they allow job control (@kbd{C-c}, @kbd{C-z},
633etc.) to work between the process and its children, whereas pipes do
634not. For subprocesses used for internal purposes by programs, it is
635often better to use a pipe, because they are more efficient. In
636addition, the total number of @acronym{PTY}s is limited on many systems and
637it is good not to waste them.
638
639The value of @code{process-connection-type} takes effect when
640@code{start-process} is called. So you can specify how to communicate
641with one subprocess by binding the variable around the call to
642@code{start-process}.
643
644@smallexample
645@group
646(let ((process-connection-type nil)) ; @r{Use a pipe.}
647 (start-process @dots{}))
648@end group
649@end smallexample
650
651To determine whether a given subprocess actually got a pipe or a
652@acronym{PTY}, use the function @code{process-tty-name} (@pxref{Process
653Information}).
654@end defvar
655
656@node Deleting Processes
657@section Deleting Processes
658@cindex deleting processes
659
660 @dfn{Deleting a process} disconnects Emacs immediately from the
661subprocess. Processes are deleted automatically after they terminate,
662but not necessarily right away. You can delete a process explicitly
663at any time. If you delete a terminated process explicitly before it
664is deleted automatically, no harm results. Deleting a running
665process sends a signal to terminate it (and its child processes if
666any), and calls the process sentinel if it has one. @xref{Sentinels}.
667
668 When a process is deleted, the process object itself continues to
669exist as long as other Lisp objects point to it. All the Lisp
670primitives that work on process objects accept deleted processes, but
671those that do I/O or send signals will report an error. The process
672mark continues to point to the same place as before, usually into a
673buffer where output from the process was being inserted.
674
675@defopt delete-exited-processes
676This variable controls automatic deletion of processes that have
677terminated (due to calling @code{exit} or to a signal). If it is
678@code{nil}, then they continue to exist until the user runs
679@code{list-processes}. Otherwise, they are deleted immediately after
680they exit.
681@end defopt
682
683@defun delete-process process
684This function deletes a process, killing it with a @code{SIGKILL}
685signal. The argument may be a process, the name of a process, a
686buffer, or the name of a buffer. (A buffer or buffer-name stands for
687the process that @code{get-buffer-process} returns.) Calling
688@code{delete-process} on a running process terminates it, updates the
689process status, and runs the sentinel (if any) immediately. If the
690process has already terminated, calling @code{delete-process} has no
691effect on its status, or on the running of its sentinel (which will
692happen sooner or later).
693
694@smallexample
695@group
696(delete-process "*shell*")
697 @result{} nil
698@end group
699@end smallexample
700@end defun
701
702@node Process Information
703@section Process Information
704
705 Several functions return information about processes.
706@code{list-processes} is provided for interactive use.
707
708@deffn Command list-processes &optional query-only
709This command displays a listing of all living processes. In addition,
710it finally deletes any process whose status was @samp{Exited} or
711@samp{Signaled}. It returns @code{nil}.
712
713If @var{query-only} is non-@code{nil} then it lists only processes
714whose query flag is non-@code{nil}. @xref{Query Before Exit}.
715@end deffn
716
717@defun process-list
718This function returns a list of all processes that have not been deleted.
719
720@smallexample
721@group
722(process-list)
723 @result{} (#<process display-time> #<process shell>)
724@end group
725@end smallexample
726@end defun
727
728@defun get-process name
729This function returns the process named @var{name}, or @code{nil} if
730there is none. An error is signaled if @var{name} is not a string.
731
732@smallexample
733@group
734(get-process "shell")
735 @result{} #<process shell>
736@end group
737@end smallexample
738@end defun
739
740@defun process-command process
741This function returns the command that was executed to start
742@var{process}. This is a list of strings, the first string being the
743program executed and the rest of the strings being the arguments that
744were given to the program.
745
746@smallexample
747@group
748(process-command (get-process "shell"))
749 @result{} ("/bin/csh" "-i")
750@end group
751@end smallexample
752@end defun
753
c73e02fa
GM
754@defun process-contact process &optional key
755
756This function returns information about how a network or serial
757process was set up. For a network process, when @var{key} is
758@code{nil}, it returns @code{(@var{hostname} @var{service})} which
759specifies what you connected to. For a serial process, when @var{key}
760is @code{nil}, it returns @code{(@var{port} @var{speed})}. For an
761ordinary child process, this function always returns @code{t}.
762
763If @var{key} is @code{t}, the value is the complete status information
764for the connection, server, or serial port; that is, the list of
765keywords and values specified in @code{make-network-process} or
766@code{make-serial-process}, except that some of the values represent
767the current status instead of what you specified.
768
769For a network process:
770
771@table @code
772@item :buffer
773The associated value is the process buffer.
774@item :filter
775The associated value is the process filter function.
776@item :sentinel
777The associated value is the process sentinel function.
778@item :remote
779In a connection, the address in internal format of the remote peer.
780@item :local
781The local address, in internal format.
782@item :service
783In a server, if you specified @code{t} for @var{service},
784this value is the actual port number.
785@end table
786
787@code{:local} and @code{:remote} are included even if they were not
788specified explicitly in @code{make-network-process}.
789
790For a serial process, see @code{make-serial-process} and
791@code{serial-process-configure} for a list of keys.
792
793If @var{key} is a keyword, the function returns the value corresponding
794to that keyword.
795@end defun
796
b8d4c8d0
GM
797@defun process-id process
798This function returns the @acronym{PID} of @var{process}. This is an
799integer that distinguishes the process @var{process} from all other
800processes running on the same computer at the current time. The
801@acronym{PID} of a process is chosen by the operating system kernel when the
802process is started and remains constant as long as the process exists.
803@end defun
804
805@defun process-name process
806This function returns the name of @var{process}.
807@end defun
808
809@defun process-status process-name
810This function returns the status of @var{process-name} as a symbol.
170ddd97
CY
811The argument @var{process-name} must be a process, a buffer, or a
812process name (a string).
b8d4c8d0
GM
813
814The possible values for an actual subprocess are:
815
816@table @code
817@item run
818for a process that is running.
819@item stop
820for a process that is stopped but continuable.
821@item exit
822for a process that has exited.
823@item signal
824for a process that has received a fatal signal.
825@item open
826for a network connection that is open.
827@item closed
828for a network connection that is closed. Once a connection
829is closed, you cannot reopen it, though you might be able to open
830a new connection to the same place.
831@item connect
832for a non-blocking connection that is waiting to complete.
833@item failed
834for a non-blocking connection that has failed to complete.
835@item listen
836for a network server that is listening.
837@item nil
838if @var{process-name} is not the name of an existing process.
839@end table
840
841@smallexample
842@group
b8d4c8d0
GM
843(process-status (get-buffer "*shell*"))
844 @result{} run
845@end group
846@group
847x
848 @result{} #<process xx<1>>
849(process-status x)
850 @result{} exit
851@end group
852@end smallexample
853
854For a network connection, @code{process-status} returns one of the symbols
855@code{open} or @code{closed}. The latter means that the other side
856closed the connection, or Emacs did @code{delete-process}.
857@end defun
858
c73e02fa
GM
859@defun process-type process
860This function returns the symbol @code{network} for a network
861connection or server, @code{serial} for a serial port connection, or
862@code{real} for a real subprocess.
863@end defun
864
b8d4c8d0
GM
865@defun process-exit-status process
866This function returns the exit status of @var{process} or the signal
867number that killed it. (Use the result of @code{process-status} to
868determine which of those it is.) If @var{process} has not yet
869terminated, the value is 0.
870@end defun
871
872@defun process-tty-name process
873This function returns the terminal name that @var{process} is using for
874its communication with Emacs---or @code{nil} if it is using pipes
875instead of a terminal (see @code{process-connection-type} in
bace45fe
MA
876@ref{Asynchronous Processes}). If @var{process} represents a program
877running on a remote host, the terminal name used by that program on
878the remote host is provided as process property @code{remote-tty}.
b8d4c8d0
GM
879@end defun
880
881@defun process-coding-system process
882@anchor{Coding systems for a subprocess}
883This function returns a cons cell describing the coding systems in use
884for decoding output from @var{process} and for encoding input to
885@var{process} (@pxref{Coding Systems}). The value has this form:
886
887@example
888(@var{coding-system-for-decoding} . @var{coding-system-for-encoding})
889@end example
890@end defun
891
892@defun set-process-coding-system process &optional decoding-system encoding-system
893This function specifies the coding systems to use for subsequent output
894from and input to @var{process}. It will use @var{decoding-system} to
895decode subprocess output, and @var{encoding-system} to encode subprocess
896input.
897@end defun
898
899 Every process also has a property list that you can use to store
900miscellaneous values associated with the process.
901
902@defun process-get process propname
903This function returns the value of the @var{propname} property
904of @var{process}.
905@end defun
906
907@defun process-put process propname value
908This function sets the value of the @var{propname} property
909of @var{process} to @var{value}.
910@end defun
911
912@defun process-plist process
913This function returns the process plist of @var{process}.
914@end defun
915
916@defun set-process-plist process plist
917This function sets the process plist of @var{process} to @var{plist}.
918@end defun
919
920@node Input to Processes
921@section Sending Input to Processes
922@cindex process input
923
924 Asynchronous subprocesses receive input when it is sent to them by
925Emacs, which is done with the functions in this section. You must
926specify the process to send input to, and the input data to send. The
927data appears on the ``standard input'' of the subprocess.
928
929 Some operating systems have limited space for buffered input in a
930@acronym{PTY}. On these systems, Emacs sends an @acronym{EOF}
931periodically amidst the other characters, to force them through. For
932most programs, these @acronym{EOF}s do no harm.
933
934 Subprocess input is normally encoded using a coding system before the
935subprocess receives it, much like text written into a file. You can use
936@code{set-process-coding-system} to specify which coding system to use
937(@pxref{Process Information}). Otherwise, the coding system comes from
938@code{coding-system-for-write}, if that is non-@code{nil}; or else from
939the defaulting mechanism (@pxref{Default Coding Systems}).
940
941 Sometimes the system is unable to accept input for that process,
942because the input buffer is full. When this happens, the send functions
943wait a short while, accepting output from subprocesses, and then try
944again. This gives the subprocess a chance to read more of its pending
945input and make space in the buffer. It also allows filters, sentinels
946and timers to run---so take account of that in writing your code.
947
948 In these functions, the @var{process} argument can be a process or
949the name of a process, or a buffer or buffer name (which stands
950for a process via @code{get-buffer-process}). @code{nil} means
951the current buffer's process.
952
953@defun process-send-string process string
954This function sends @var{process} the contents of @var{string} as
955standard input. If it is @code{nil}, the current buffer's process is used.
956
957 The function returns @code{nil}.
958
959@smallexample
960@group
961(process-send-string "shell<1>" "ls\n")
962 @result{} nil
963@end group
964
965
966@group
967---------- Buffer: *shell* ----------
968...
969introduction.texi syntax-tables.texi~
970introduction.texi~ text.texi
971introduction.txt text.texi~
972...
973---------- Buffer: *shell* ----------
974@end group
975@end smallexample
976@end defun
977
978@defun process-send-region process start end
979This function sends the text in the region defined by @var{start} and
980@var{end} as standard input to @var{process}.
981
982An error is signaled unless both @var{start} and @var{end} are
983integers or markers that indicate positions in the current buffer. (It
984is unimportant which number is larger.)
985@end defun
986
987@defun process-send-eof &optional process
988This function makes @var{process} see an end-of-file in its
989input. The @acronym{EOF} comes after any text already sent to it.
990
991The function returns @var{process}.
992
993@smallexample
994@group
995(process-send-eof "shell")
996 @result{} "shell"
997@end group
998@end smallexample
999@end defun
1000
106e6894
CY
1001@defun process-running-child-p &optional process
1002This function will tell you whether a @var{process} has given control of
b8d4c8d0
GM
1003its terminal to its own child process. The value is @code{t} if this is
1004true, or if Emacs cannot tell; it is @code{nil} if Emacs can be certain
1005that this is not so.
1006@end defun
1007
1008@node Signals to Processes
1009@section Sending Signals to Processes
1010@cindex process signals
1011@cindex sending signals
1012@cindex signals
1013
1014 @dfn{Sending a signal} to a subprocess is a way of interrupting its
1015activities. There are several different signals, each with its own
1016meaning. The set of signals and their names is defined by the operating
1017system. For example, the signal @code{SIGINT} means that the user has
1018typed @kbd{C-c}, or that some analogous thing has happened.
1019
1020 Each signal has a standard effect on the subprocess. Most signals
1021kill the subprocess, but some stop or resume execution instead. Most
1022signals can optionally be handled by programs; if the program handles
1023the signal, then we can say nothing in general about its effects.
1024
1025 You can send signals explicitly by calling the functions in this
1026section. Emacs also sends signals automatically at certain times:
1027killing a buffer sends a @code{SIGHUP} signal to all its associated
1028processes; killing Emacs sends a @code{SIGHUP} signal to all remaining
1029processes. (@code{SIGHUP} is a signal that usually indicates that the
1030user hung up the phone.)
1031
1032 Each of the signal-sending functions takes two optional arguments:
1033@var{process} and @var{current-group}.
1034
1035 The argument @var{process} must be either a process, a process
1036name, a buffer, a buffer name, or @code{nil}. A buffer or buffer name
1037stands for a process through @code{get-buffer-process}. @code{nil}
1038stands for the process associated with the current buffer. An error
1039is signaled if @var{process} does not identify a process.
1040
1041 The argument @var{current-group} is a flag that makes a difference
1042when you are running a job-control shell as an Emacs subprocess. If it
1043is non-@code{nil}, then the signal is sent to the current process-group
1044of the terminal that Emacs uses to communicate with the subprocess. If
1045the process is a job-control shell, this means the shell's current
1046subjob. If it is @code{nil}, the signal is sent to the process group of
1047the immediate subprocess of Emacs. If the subprocess is a job-control
1048shell, this is the shell itself.
1049
1050 The flag @var{current-group} has no effect when a pipe is used to
1051communicate with the subprocess, because the operating system does not
1052support the distinction in the case of pipes. For the same reason,
1053job-control shells won't work when a pipe is used. See
1054@code{process-connection-type} in @ref{Asynchronous Processes}.
1055
1056@defun interrupt-process &optional process current-group
1057This function interrupts the process @var{process} by sending the
1058signal @code{SIGINT}. Outside of Emacs, typing the ``interrupt
1059character'' (normally @kbd{C-c} on some systems, and @code{DEL} on
1060others) sends this signal. When the argument @var{current-group} is
1061non-@code{nil}, you can think of this function as ``typing @kbd{C-c}''
1062on the terminal by which Emacs talks to the subprocess.
1063@end defun
1064
1065@defun kill-process &optional process current-group
1066This function kills the process @var{process} by sending the
1067signal @code{SIGKILL}. This signal kills the subprocess immediately,
1068and cannot be handled by the subprocess.
1069@end defun
1070
1071@defun quit-process &optional process current-group
1072This function sends the signal @code{SIGQUIT} to the process
1073@var{process}. This signal is the one sent by the ``quit
1074character'' (usually @kbd{C-b} or @kbd{C-\}) when you are not inside
1075Emacs.
1076@end defun
1077
1078@defun stop-process &optional process current-group
1079This function stops the process @var{process} by sending the
1080signal @code{SIGTSTP}. Use @code{continue-process} to resume its
1081execution.
1082
1083Outside of Emacs, on systems with job control, the ``stop character''
1084(usually @kbd{C-z}) normally sends this signal. When
1085@var{current-group} is non-@code{nil}, you can think of this function as
1086``typing @kbd{C-z}'' on the terminal Emacs uses to communicate with the
1087subprocess.
1088@end defun
1089
1090@defun continue-process &optional process current-group
1091This function resumes execution of the process @var{process} by sending
1092it the signal @code{SIGCONT}. This presumes that @var{process} was
1093stopped previously.
1094@end defun
1095
b8d4c8d0
GM
1096@defun signal-process process signal
1097This function sends a signal to process @var{process}. The argument
1098@var{signal} specifies which signal to send; it should be an integer.
1099
1100The @var{process} argument can be a system process @acronym{ID}; that
1101allows you to send signals to processes that are not children of
23dd4ecd 1102Emacs. @xref{System Processes}.
b8d4c8d0
GM
1103@end defun
1104
1105@node Output from Processes
1106@section Receiving Output from Processes
1107@cindex process output
1108@cindex output from processes
1109
1110 There are two ways to receive the output that a subprocess writes to
1111its standard output stream. The output can be inserted in a buffer,
1112which is called the associated buffer of the process, or a function
1113called the @dfn{filter function} can be called to act on the output. If
1114the process has no buffer and no filter function, its output is
1115discarded.
1116
1117 When a subprocess terminates, Emacs reads any pending output,
1118then stops reading output from that subprocess. Therefore, if the
1119subprocess has children that are still live and still producing
1120output, Emacs won't receive that output.
1121
1122 Output from a subprocess can arrive only while Emacs is waiting: when
1123reading terminal input, in @code{sit-for} and @code{sleep-for}
1124(@pxref{Waiting}), and in @code{accept-process-output} (@pxref{Accepting
1125Output}). This minimizes the problem of timing errors that usually
1126plague parallel programming. For example, you can safely create a
1127process and only then specify its buffer or filter function; no output
1128can arrive before you finish, if the code in between does not call any
1129primitive that waits.
1130
1131@defvar process-adaptive-read-buffering
1132On some systems, when Emacs reads the output from a subprocess, the
1133output data is read in very small blocks, potentially resulting in
1134very poor performance. This behavior can be remedied to some extent
1135by setting the variable @var{process-adaptive-read-buffering} to a
1136non-@code{nil} value (the default), as it will automatically delay reading
1137from such processes, thus allowing them to produce more output before
1138Emacs tries to read it.
1139@end defvar
1140
1141 It is impossible to separate the standard output and standard error
1142streams of the subprocess, because Emacs normally spawns the subprocess
1143inside a pseudo-TTY, and a pseudo-TTY has only one output channel. If
1144you want to keep the output to those streams separate, you should
1145redirect one of them to a file---for example, by using an appropriate
1146shell command.
1147
1148@menu
1149* Process Buffers:: If no filter, output is put in a buffer.
1150* Filter Functions:: Filter functions accept output from the process.
1151* Decoding Output:: Filters can get unibyte or multibyte strings.
1152* Accepting Output:: How to wait until process output arrives.
1153@end menu
1154
1155@node Process Buffers
1156@subsection Process Buffers
1157
1158 A process can (and usually does) have an @dfn{associated buffer},
1159which is an ordinary Emacs buffer that is used for two purposes: storing
1160the output from the process, and deciding when to kill the process. You
1161can also use the buffer to identify a process to operate on, since in
1162normal practice only one process is associated with any given buffer.
1163Many applications of processes also use the buffer for editing input to
1164be sent to the process, but this is not built into Emacs Lisp.
1165
1166 Unless the process has a filter function (@pxref{Filter Functions}),
1167its output is inserted in the associated buffer. The position to insert
1168the output is determined by the @code{process-mark}, which is then
1169updated to point to the end of the text just inserted. Usually, but not
1170always, the @code{process-mark} is at the end of the buffer.
1171
16d1ff5f
CY
1172@findex process-kill-buffer-query-function
1173 Killing the associated buffer of a process also kills the process.
1174Emacs asks for confirmation first, if the process's
1175@code{process-query-on-exit-flag} is non-@code{nil} (@pxref{Query
1176Before Exit}). This confirmation is done by the function
1177@code{process-kill-buffer-query-function}, which is run from
1178@code{kill-buffer-query-functions} (@pxref{Killing Buffers}).
1179
b8d4c8d0
GM
1180@defun process-buffer process
1181This function returns the associated buffer of the process
1182@var{process}.
1183
1184@smallexample
1185@group
1186(process-buffer (get-process "shell"))
1187 @result{} #<buffer *shell*>
1188@end group
1189@end smallexample
1190@end defun
1191
1192@defun process-mark process
1193This function returns the process marker for @var{process}, which is the
1194marker that says where to insert output from the process.
1195
1196If @var{process} does not have a buffer, @code{process-mark} returns a
1197marker that points nowhere.
1198
1199Insertion of process output in a buffer uses this marker to decide where
1200to insert, and updates it to point after the inserted text. That is why
1201successive batches of output are inserted consecutively.
1202
1203Filter functions normally should use this marker in the same fashion
1204as is done by direct insertion of output in the buffer. A good
1205example of a filter function that uses @code{process-mark} is found at
1206the end of the following section.
1207
1208When the user is expected to enter input in the process buffer for
1209transmission to the process, the process marker separates the new input
1210from previous output.
1211@end defun
1212
1213@defun set-process-buffer process buffer
1214This function sets the buffer associated with @var{process} to
1215@var{buffer}. If @var{buffer} is @code{nil}, the process becomes
1216associated with no buffer.
1217@end defun
1218
1219@defun get-buffer-process buffer-or-name
1220This function returns a nondeleted process associated with the buffer
1221specified by @var{buffer-or-name}. If there are several processes
1222associated with it, this function chooses one (currently, the one most
1223recently created, but don't count on that). Deletion of a process
1224(see @code{delete-process}) makes it ineligible for this function to
1225return.
1226
1227It is usually a bad idea to have more than one process associated with
1228the same buffer.
1229
1230@smallexample
1231@group
1232(get-buffer-process "*shell*")
1233 @result{} #<process shell>
1234@end group
1235@end smallexample
1236
1237Killing the process's buffer deletes the process, which kills the
1238subprocess with a @code{SIGHUP} signal (@pxref{Signals to Processes}).
1239@end defun
1240
1241@node Filter Functions
1242@subsection Process Filter Functions
1243@cindex filter function
1244@cindex process filter
1245
1246 A process @dfn{filter function} is a function that receives the
1247standard output from the associated process. If a process has a filter,
1248then @emph{all} output from that process is passed to the filter. The
1249process buffer is used directly for output from the process only when
1250there is no filter.
1251
1252 The filter function can only be called when Emacs is waiting for
1253something, because process output arrives only at such times. Emacs
1254waits when reading terminal input, in @code{sit-for} and
1255@code{sleep-for} (@pxref{Waiting}), and in @code{accept-process-output}
1256(@pxref{Accepting Output}).
1257
1258 A filter function must accept two arguments: the associated process
1259and a string, which is output just received from it. The function is
1260then free to do whatever it chooses with the output.
1261
1262 Quitting is normally inhibited within a filter function---otherwise,
1263the effect of typing @kbd{C-g} at command level or to quit a user
1264command would be unpredictable. If you want to permit quitting inside
1265a filter function, bind @code{inhibit-quit} to @code{nil}. In most
1266cases, the right way to do this is with the macro
1267@code{with-local-quit}. @xref{Quitting}.
1268
1269 If an error happens during execution of a filter function, it is
1270caught automatically, so that it doesn't stop the execution of whatever
1271program was running when the filter function was started. However, if
1272@code{debug-on-error} is non-@code{nil}, the error-catching is turned
1273off. This makes it possible to use the Lisp debugger to debug the
1274filter function. @xref{Debugger}.
1275
1276 Many filter functions sometimes or always insert the text in the
1277process's buffer, mimicking the actions of Emacs when there is no
1278filter. Such filter functions need to use @code{set-buffer} in order to
1279be sure to insert in that buffer. To avoid setting the current buffer
1280semipermanently, these filter functions must save and restore the
78e33835
CY
1281current buffer. They should also check whether the buffer is still
1282alive, update the process marker, and in some cases update the value
1283of point. Here is how to do these things:
b8d4c8d0
GM
1284
1285@smallexample
1286@group
1287(defun ordinary-insertion-filter (proc string)
78e33835
CY
1288 (when (buffer-live-p (process-buffer proc))
1289 (with-current-buffer (process-buffer proc)
1290 (let ((moving (= (point) (process-mark proc))))
b8d4c8d0
GM
1291@end group
1292@group
78e33835 1293 (save-excursion
1e5c1c80 1294 ;; @r{Insert the text, advancing the process marker.}
78e33835
CY
1295 (goto-char (process-mark proc))
1296 (insert string)
1297 (set-marker (process-mark proc) (point)))
1298 (if moving (goto-char (process-mark proc)))))))
b8d4c8d0
GM
1299@end group
1300@end smallexample
1301
1302@noindent
1303The reason to use @code{with-current-buffer}, rather than using
1304@code{save-excursion} to save and restore the current buffer, is so as
1305to preserve the change in point made by the second call to
1306@code{goto-char}.
1307
1308 To make the filter force the process buffer to be visible whenever new
1309text arrives, insert the following line just before the
1310@code{with-current-buffer} construct:
1311
1312@smallexample
1313(display-buffer (process-buffer proc))
1314@end smallexample
1315
1316 To force point to the end of the new output, no matter where it was
1317previously, eliminate the variable @code{moving} and call
1318@code{goto-char} unconditionally.
1319
1320 In earlier Emacs versions, every filter function that did regular
1321expression searching or matching had to explicitly save and restore the
1322match data. Now Emacs does this automatically for filter functions;
1323they never need to do it explicitly. @xref{Match Data}.
1324
b8d4c8d0
GM
1325 The output to the function may come in chunks of any size. A program
1326that produces the same output twice in a row may send it as one batch of
1327200 characters one time, and five batches of 40 characters the next. If
1328the filter looks for certain text strings in the subprocess output, make
1329sure to handle the case where one of these strings is split across two
fd211f0b
CY
1330or more batches of output; one way to do this is to insert the
1331received text into a temporary buffer, which can then be searched.
b8d4c8d0
GM
1332
1333@defun set-process-filter process filter
1334This function gives @var{process} the filter function @var{filter}. If
1335@var{filter} is @code{nil}, it gives the process no filter.
1336@end defun
1337
1338@defun process-filter process
1339This function returns the filter function of @var{process}, or @code{nil}
1340if it has none.
1341@end defun
1342
1343 Here is an example of use of a filter function:
1344
1345@smallexample
1346@group
1347(defun keep-output (process output)
1348 (setq kept (cons output kept)))
1349 @result{} keep-output
1350@end group
1351@group
1352(setq kept nil)
1353 @result{} nil
1354@end group
1355@group
1356(set-process-filter (get-process "shell") 'keep-output)
1357 @result{} keep-output
1358@end group
1359@group
1360(process-send-string "shell" "ls ~/other\n")
1361 @result{} nil
1362kept
1363 @result{} ("lewis@@slug[8] % "
1364@end group
1365@group
1366"FINAL-W87-SHORT.MSS backup.otl kolstad.mss~
1367address.txt backup.psf kolstad.psf
1368backup.bib~ david.mss resume-Dec-86.mss~
1369backup.err david.psf resume-Dec.psf
1370backup.mss dland syllabus.mss
1371"
1372"#backups.mss# backup.mss~ kolstad.mss
1373")
1374@end group
1375@end smallexample
1376
1377@ignore @c The code in this example doesn't show the right way to do things.
1378Here is another, more realistic example, which demonstrates how to use
1379the process mark to do insertion in the same fashion as is done when
1380there is no filter function:
1381
1382@smallexample
1383@group
1384;; @r{Insert input in the buffer specified by @code{my-shell-buffer}}
1385;; @r{and make sure that buffer is shown in some window.}
1386(defun my-process-filter (proc str)
1387 (let ((cur (selected-window))
1388 (pop-up-windows t))
1389 (pop-to-buffer my-shell-buffer)
1390@end group
1391@group
1392 (goto-char (point-max))
1393 (insert str)
1394 (set-marker (process-mark proc) (point-max))
1395 (select-window cur)))
1396@end group
1397@end smallexample
1398@end ignore
1399
1400@node Decoding Output
1401@subsection Decoding Process Output
1402@cindex decode process output
1403
1404 When Emacs writes process output directly into a multibyte buffer,
1405it decodes the output according to the process output coding system.
1406If the coding system is @code{raw-text} or @code{no-conversion}, Emacs
1407converts the unibyte output to multibyte using
1408@code{string-to-multibyte}, and inserts the resulting multibyte text.
1409
1410 You can use @code{set-process-coding-system} to specify which coding
1411system to use (@pxref{Process Information}). Otherwise, the coding
1412system comes from @code{coding-system-for-read}, if that is
1413non-@code{nil}; or else from the defaulting mechanism (@pxref{Default
3355f04d
EZ
1414Coding Systems}). If the text output by a process contains null
1415bytes, Emacs by default uses @code{no-conversion} for it; see
1416@ref{Lisp and Coding Systems, inhibit-null-byte-detection}, for how to
1417control this behavior.
b8d4c8d0
GM
1418
1419 @strong{Warning:} Coding systems such as @code{undecided} which
1420determine the coding system from the data do not work entirely
1421reliably with asynchronous subprocess output. This is because Emacs
1422has to process asynchronous subprocess output in batches, as it
1423arrives. Emacs must try to detect the proper coding system from one
1424batch at a time, and this does not always work. Therefore, if at all
1425possible, specify a coding system that determines both the character
1426code conversion and the end of line conversion---that is, one like
1427@code{latin-1-unix}, rather than @code{undecided} or @code{latin-1}.
1428
4972c361
SM
1429@c Let's keep the index entries that were there for
1430@c set-process-filter-multibyte and process-filter-multibyte-p,
b8d4c8d0
GM
1431@cindex filter multibyte flag, of process
1432@cindex process filter multibyte flag
1433 When Emacs calls a process filter function, it provides the process
1434output as a multibyte string or as a unibyte string according to the
4972c361
SM
1435process's filter coding system. Emacs
1436decodes the output according to the process output coding system,
1437which usually produces a multibyte string, except for coding systems
1438such as @code{binary} and @code{raw-text}
b8d4c8d0
GM
1439
1440@node Accepting Output
1441@subsection Accepting Output from Processes
1442@cindex accept input from processes
1443
1444 Output from asynchronous subprocesses normally arrives only while
1445Emacs is waiting for some sort of external event, such as elapsed time
1446or terminal input. Occasionally it is useful in a Lisp program to
1447explicitly permit output to arrive at a specific point, or even to wait
1448until output arrives from a process.
1449
1450@defun accept-process-output &optional process seconds millisec just-this-one
1451This function allows Emacs to read pending output from processes. The
1452output is inserted in the associated buffers or given to their filter
1453functions. If @var{process} is non-@code{nil} then this function does
1454not return until some output has been received from @var{process}.
1455
1456@c Emacs 19 feature
1457The arguments @var{seconds} and @var{millisec} let you specify timeout
1458periods. The former specifies a period measured in seconds and the
1459latter specifies one measured in milliseconds. The two time periods
1460thus specified are added together, and @code{accept-process-output}
1461returns after that much time, whether or not there has been any
1462subprocess output.
1463
1464The argument @var{millisec} is semi-obsolete nowadays because
1465@var{seconds} can be a floating point number to specify waiting a
1466fractional number of seconds. If @var{seconds} is 0, the function
1467accepts whatever output is pending but does not wait.
1468
1469@c Emacs 22.1 feature
1470If @var{process} is a process, and the argument @var{just-this-one} is
1471non-@code{nil}, only output from that process is handled, suspending output
1472from other processes until some output has been received from that
1473process or the timeout expires. If @var{just-this-one} is an integer,
1474also inhibit running timers. This feature is generally not
1475recommended, but may be necessary for specific applications, such as
1476speech synthesis.
1477
1478The function @code{accept-process-output} returns non-@code{nil} if it
1479did get some output, or @code{nil} if the timeout expired before output
1480arrived.
1481@end defun
1482
1483@node Sentinels
1484@section Sentinels: Detecting Process Status Changes
1485@cindex process sentinel
1486@cindex sentinel (of process)
1487
1488 A @dfn{process sentinel} is a function that is called whenever the
1489associated process changes status for any reason, including signals
1490(whether sent by Emacs or caused by the process's own actions) that
1491terminate, stop, or continue the process. The process sentinel is
1492also called if the process exits. The sentinel receives two
1493arguments: the process for which the event occurred, and a string
1494describing the type of event.
1495
1496 The string describing the event looks like one of the following:
1497
1498@itemize @bullet
1499@item
1500@code{"finished\n"}.
1501
1502@item
1503@code{"exited abnormally with code @var{exitcode}\n"}.
1504
1505@item
1506@code{"@var{name-of-signal}\n"}.
1507
1508@item
1509@code{"@var{name-of-signal} (core dumped)\n"}.
1510@end itemize
1511
1512 A sentinel runs only while Emacs is waiting (e.g., for terminal
1513input, or for time to elapse, or for process output). This avoids the
1514timing errors that could result from running them at random places in
1515the middle of other Lisp programs. A program can wait, so that
1516sentinels will run, by calling @code{sit-for} or @code{sleep-for}
1517(@pxref{Waiting}), or @code{accept-process-output} (@pxref{Accepting
1518Output}). Emacs also allows sentinels to run when the command loop is
1519reading input. @code{delete-process} calls the sentinel when it
1520terminates a running process.
1521
1522 Emacs does not keep a queue of multiple reasons to call the sentinel
1523of one process; it records just the current status and the fact that
1524there has been a change. Therefore two changes in status, coming in
1525quick succession, can call the sentinel just once. However, process
1526termination will always run the sentinel exactly once. This is
1527because the process status can't change again after termination.
1528
1529 Emacs explicitly checks for output from the process before running
1530the process sentinel. Once the sentinel runs due to process
1531termination, no further output can arrive from the process.
1532
1533 A sentinel that writes the output into the buffer of the process
1534should check whether the buffer is still alive. If it tries to insert
1535into a dead buffer, it will get an error. If the buffer is dead,
1536@code{(buffer-name (process-buffer @var{process}))} returns @code{nil}.
1537
1538 Quitting is normally inhibited within a sentinel---otherwise, the
1539effect of typing @kbd{C-g} at command level or to quit a user command
1540would be unpredictable. If you want to permit quitting inside a
1541sentinel, bind @code{inhibit-quit} to @code{nil}. In most cases, the
1542right way to do this is with the macro @code{with-local-quit}.
1543@xref{Quitting}.
1544
1545 If an error happens during execution of a sentinel, it is caught
1546automatically, so that it doesn't stop the execution of whatever
1547programs was running when the sentinel was started. However, if
1548@code{debug-on-error} is non-@code{nil}, the error-catching is turned
1549off. This makes it possible to use the Lisp debugger to debug the
1550sentinel. @xref{Debugger}.
1551
1552 While a sentinel is running, the process sentinel is temporarily
1553set to @code{nil} so that the sentinel won't run recursively.
1554For this reason it is not possible for a sentinel to specify
1555a new sentinel.
1556
1557 In earlier Emacs versions, every sentinel that did regular expression
1558searching or matching had to explicitly save and restore the match data.
1559Now Emacs does this automatically for sentinels; they never need to do
1560it explicitly. @xref{Match Data}.
1561
1562@defun set-process-sentinel process sentinel
1563This function associates @var{sentinel} with @var{process}. If
1564@var{sentinel} is @code{nil}, then the process will have no sentinel.
1565The default behavior when there is no sentinel is to insert a message in
1566the process's buffer when the process status changes.
1567
1568Changes in process sentinel take effect immediately---if the sentinel
1569is slated to be run but has not been called yet, and you specify a new
1570sentinel, the eventual call to the sentinel will use the new one.
1571
1572@smallexample
1573@group
1574(defun msg-me (process event)
1575 (princ
1576 (format "Process: %s had the event `%s'" process event)))
1577(set-process-sentinel (get-process "shell") 'msg-me)
1578 @result{} msg-me
1579@end group
1580@group
1581(kill-process (get-process "shell"))
1582 @print{} Process: #<process shell> had the event `killed'
1583 @result{} #<process shell>
1584@end group
1585@end smallexample
1586@end defun
1587
1588@defun process-sentinel process
1589This function returns the sentinel of @var{process}, or @code{nil} if it
1590has none.
1591@end defun
1592
1593@defun waiting-for-user-input-p
1594While a sentinel or filter function is running, this function returns
1595non-@code{nil} if Emacs was waiting for keyboard input from the user at
1596the time the sentinel or filter function was called, @code{nil} if it
1597was not.
1598@end defun
1599
1600@node Query Before Exit
1601@section Querying Before Exit
1602
1603 When Emacs exits, it terminates all its subprocesses by sending them
1604the @code{SIGHUP} signal. Because subprocesses may be doing
1605valuable work, Emacs normally asks the user to confirm that it is ok
1606to terminate them. Each process has a query flag which, if
1607non-@code{nil}, says that Emacs should ask for confirmation before
1608exiting and thus killing that process. The default for the query flag
1609is @code{t}, meaning @emph{do} query.
1610
1611@defun process-query-on-exit-flag process
1612This returns the query flag of @var{process}.
1613@end defun
1614
1615@defun set-process-query-on-exit-flag process flag
1616This function sets the query flag of @var{process} to @var{flag}. It
1617returns @var{flag}.
1618
1619@smallexample
1620@group
1621;; @r{Don't query about the shell process}
1622(set-process-query-on-exit-flag (get-process "shell") nil)
1623 @result{} t
1624@end group
1625@end smallexample
1626@end defun
1627
1628@defun process-kill-without-query process &optional do-query
1629This function clears the query flag of @var{process}, so that
1630Emacs will not query the user on account of that process.
1631
1632Actually, the function does more than that: it returns the old value of
1633the process's query flag, and sets the query flag to @var{do-query}.
1634Please don't use this function to do those things any more---please
1635use the newer, cleaner functions @code{process-query-on-exit-flag} and
1636@code{set-process-query-on-exit-flag} in all but the simplest cases.
1637The only way you should use @code{process-kill-without-query} nowadays
1638is like this:
1639
1640@smallexample
1641@group
1642;; @r{Don't query about the shell process}
1643(process-kill-without-query (get-process "shell"))
1644@end group
1645@end smallexample
1646@end defun
1647
23dd4ecd
EZ
1648@node System Processes
1649@section Accessing Other Processes
1650@cindex system processes
1651
1652 In addition to accessing and manipulating processes that are
1653subprocesses of the current Emacs session, Emacs Lisp programs can
1654also access other processes running on the same machine. We call
1655these @dfn{system processes}, to distinguish between them and Emacs
1656subprocesses.
1657
1658 Emacs provides several primitives for accessing system processes.
1659Not all platforms support these primitives; on those which don't,
1660these primitives return @code{nil}.
1661
1662@defun list-system-processes
1663This function returns a list of all the processes running on the
1664system. Each process is identified by its @acronym{PID}, a numerical
1665process ID that is assigned by the OS and distinguishes the process
1666from all the other processes running on the same machine at the same
1667time.
1668@end defun
1669
a20878b6 1670@defun process-attributes pid
23dd4ecd
EZ
1671This function returns an alist of attributes for the process specified
1672by its process ID @var{pid}. Each association in the alist is of the
1673form @code{(@var{key} . @var{value})}, where @var{key} designates the
1674attribute and @var{value} is the value of that attribute. The various
1675attribute @var{key}'s that this function can return are listed below.
1676Not all platforms support all of these attributes; if an attribute is
1677not supported, its association will not appear in the returned alist.
1678Values that are numbers can be either integer or floating-point,
1679depending on the magnitude of the value.
1680
1681@table @code
1682@item euid
1683The effective user ID of the user who invoked the process. The
1684corresponding @var{value} is a number. If the process was invoked by
1685the same user who runs the current Emacs session, the value is
1686identical to what @code{user-uid} returns (@pxref{User
1687Identification}).
1688
1689@item user
1690User name corresponding to the process's effective user ID, a string.
1691
1692@item egid
1693The group ID of the effective user ID, a number.
1694
1695@item group
1696Group name corresponding to the effective user's group ID, a string.
1697
1698@item comm
1699The name of the command that runs in the process. This is a string
1700that usually specifies the name of the executable file of the process,
1701without the leading directories. However, some special system
1702processes can report strings that do not correspond to an executable
1703file of a program.
1704
1705@item state
1706The state code of the process. This is a short string that encodes
1707the scheduling state of the process. Here's a list of the most
1708frequently seen codes:
1709
1710@table @code
1dca458f 1711@item "D"
23dd4ecd 1712uninterruptible sleep (usually I/O)
1dca458f 1713@item "R"
23dd4ecd 1714running
1dca458f 1715@item "S"
23dd4ecd 1716interruptible sleep (waiting for some event)
1dca458f 1717@item "T"
23dd4ecd 1718stopped, e.g., by a job control signal
1dca458f
EZ
1719@item "Z"
1720``zombie'': a process that terminated, but was not reaped by its parent
23dd4ecd
EZ
1721@end table
1722
1723@noindent
1724For the full list of the possible states, see the manual page of the
1725@command{ps} command.
1726
1727@item ppid
1728The process ID of the parent process, a number.
1729
1730@item pgrp
1731The process group ID of the process, a number.
1732
1733@item sess
1734The session ID of the process. This is a number that is the process
1735ID of the process's @dfn{session leader}.
1736
1737@item ttname
1738A string that is the name of the process's controlling terminal. On
1739Unix and GNU systems, this is normally the file name of the
1740corresponding terminal device, such as @file{/dev/pts65}.
1741
1742@item tpgid
1743The numerical process group ID of the foreground process group that
1744uses the process's terminal.
1745
1746@item minflt
1747The number of minor page faults caused by the process since its
1748beginning. (Minor page faults are those that don't involve reading
1749from disk.)
1750
1751@item majflt
1752The number of major page faults caused by the process since its
1753beginning. (Major page faults require a disk to be read, and are thus
1754more expensive than minor page faults.)
1755
1756@item cminflt
1757@itemx cmajflt
1758Like @code{minflt} and @code{majflt}, but include the number of page
1759faults for all the child processes of the given process.
1760
1761@item utime
1762Time spent by the process in the user context, for running the
1763application's code. The corresponding @var{value} is in the
1764@w{@code{(@var{high} @var{low} @var{microsec})}} format, the same
1765format used by functions @code{current-time} (@pxref{Time of Day,
1766current-time}) and @code{file-attributes} (@pxref{File Attributes}).
1767
1768@item stime
1769Time spent by the process in the system (kernel) context, for
1770processing system calls. The corresponding @var{value} is in the same
1771format as for @code{utime}.
1772
af34ad36
EZ
1773@item time
1774The sum of @code{utime} and @code{stime}. The corresponding
1775@var{value} is in the same format as for @code{utime}.
1776
23dd4ecd
EZ
1777@item cutime
1778@itemx cstime
af34ad36
EZ
1779@itemx ctime
1780Like @code{utime}, @code{stime}, and @code{time}, but include the
1781times of all the child processes of the given process.
23dd4ecd
EZ
1782
1783@item pri
1784The numerical priority of the process.
1785
1786@item nice
1dca458f
EZ
1787The @dfn{nice value} of the process, a number. (Processes with smaller
1788nice values get scheduled more favorably.)
23dd4ecd
EZ
1789
1790@item thcount
1791The number of threads in the process.
1792
1793@item start
1794The time the process was started, in the @w{@code{(@var{high}
1795@var{low} @var{microsec})}} format used by @code{current-time} and
1796@code{file-attributes}.
1797
1798@item etime
1799The time elapsed since the process started, in the @w{@code{(@var{high}
1800@var{low} @var{microsec})}} format.
1801
1802@item vsize
1803The virtual memory size of the process, measured in kilobytes.
1804
1805@item rss
1806The size of the process's @dfn{resident set}, the number of kilobytes
1807occupied by the process in the machine's physical memory.
1808
1809@item pcpu
1810The percentage of the CPU time used by the process since it started.
1811The corresponding @var{value} is a floating-point number between 0 and
1812100.
1813
1814@item pmem
1815The percentage of the total physical memory installed on the machine
1816used by the process's resident set. The value is a floating-point
1817number between 0 and 100.
1818
1819@item args
1820The command-line with which the process was invoked. This is a string
1821in which individual command-line arguments are separated by blanks;
1822whitespace characters that are embedded in the arguments are quoted as
1823appropriate for the system's shell: escaped by backslash characters on
1824GNU and Unix, and enclosed in double quote characters on Windows.
1825Thus, this command-line string can be directly used in primitives such
1826as @code{shell-command}.
1827@end table
1828
1829@end defun
1830
1831
b8d4c8d0
GM
1832@node Transaction Queues
1833@section Transaction Queues
1834@cindex transaction queue
1835
1836You can use a @dfn{transaction queue} to communicate with a subprocess
1837using transactions. First use @code{tq-create} to create a transaction
1838queue communicating with a specified process. Then you can call
1839@code{tq-enqueue} to send a transaction.
1840
1841@defun tq-create process
1842This function creates and returns a transaction queue communicating with
1843@var{process}. The argument @var{process} should be a subprocess
1844capable of sending and receiving streams of bytes. It may be a child
1845process, or it may be a TCP connection to a server, possibly on another
1846machine.
1847@end defun
1848
1849@defun tq-enqueue queue question regexp closure fn &optional delay-question
1850This function sends a transaction to queue @var{queue}. Specifying the
1851queue has the effect of specifying the subprocess to talk to.
1852
1853The argument @var{question} is the outgoing message that starts the
1854transaction. The argument @var{fn} is the function to call when the
1855corresponding answer comes back; it is called with two arguments:
1856@var{closure}, and the answer received.
1857
1858The argument @var{regexp} is a regular expression that should match
1859text at the end of the entire answer, but nothing before; that's how
1860@code{tq-enqueue} determines where the answer ends.
1861
4185820c
CY
1862If the argument @var{delay-question} is non-@code{nil}, delay sending
1863this question until the process has finished replying to any previous
b8d4c8d0
GM
1864questions. This produces more reliable results with some processes.
1865
1866The return value of @code{tq-enqueue} itself is not meaningful.
1867@end defun
1868
1869@defun tq-close queue
1870Shut down transaction queue @var{queue}, waiting for all pending transactions
1871to complete, and then terminate the connection or child process.
1872@end defun
1873
1874Transaction queues are implemented by means of a filter function.
1875@xref{Filter Functions}.
1876
1877@node Network
1878@section Network Connections
1879@cindex network connection
1880@cindex TCP
1881@cindex UDP
1882
1883 Emacs Lisp programs can open stream (TCP) and datagram (UDP) network
1884connections to other processes on the same machine or other machines.
1885A network connection is handled by Lisp much like a subprocess, and is
1886represented by a process object. However, the process you are
1887communicating with is not a child of the Emacs process, so it has no
1888process @acronym{ID}, and you can't kill it or send it signals. All you
1889can do is send and receive data. @code{delete-process} closes the
1890connection, but does not kill the program at the other end; that
1891program must decide what to do about closure of the connection.
1892
1893 Lisp programs can listen for connections by creating network
1894servers. A network server is also represented by a kind of process
1895object, but unlike a network connection, the network server never
1896transfers data itself. When it receives a connection request, it
1897creates a new network connection to represent the connection just
1898made. (The network connection inherits certain information, including
1899the process plist, from the server.) The network server then goes
1900back to listening for more connection requests.
1901
1902 Network connections and servers are created by calling
1903@code{make-network-process} with an argument list consisting of
1904keyword/argument pairs, for example @code{:server t} to create a
1905server process, or @code{:type 'datagram} to create a datagram
1906connection. @xref{Low-Level Network}, for details. You can also use
1907the @code{open-network-stream} function described below.
1908
c73e02fa
GM
1909 To distinguish the different types of processes, the
1910@code{process-type} function returns the symbol @code{network} for a
1911network connection or server, @code{serial} for a serial port
1912connection, or @code{real} for a real subprocess.
1913
1914 The @code{process-status} function returns @code{open},
1915@code{closed}, @code{connect}, and @code{failed} for network
1916connections. For a network server, the status is always
b8d4c8d0
GM
1917@code{listen}. None of those values is possible for a real
1918subprocess. @xref{Process Information}.
1919
1920 You can stop and resume operation of a network process by calling
1921@code{stop-process} and @code{continue-process}. For a server
1922process, being stopped means not accepting new connections. (Up to 5
1923connection requests will be queued for when you resume the server; you
1924can increase this limit, unless it is imposed by the operating
1925system.) For a network stream connection, being stopped means not
1926processing input (any arriving input waits until you resume the
1927connection). For a datagram connection, some number of packets may be
1928queued but input may be lost. You can use the function
1929@code{process-command} to determine whether a network connection or
1930server is stopped; a non-@code{nil} value means yes.
1931
1932@defun open-network-stream name buffer-or-name host service
1933This function opens a TCP connection, and returns a process object
1934that represents the connection.
1935
1936The @var{name} argument specifies the name for the process object. It
1937is modified as necessary to make it unique.
1938
1939The @var{buffer-or-name} argument is the buffer to associate with the
1940connection. Output from the connection is inserted in the buffer,
1941unless you specify a filter function to handle the output. If
1942@var{buffer-or-name} is @code{nil}, it means that the connection is not
1943associated with any buffer.
1944
1945The arguments @var{host} and @var{service} specify where to connect to;
1946@var{host} is the host name (a string), and @var{service} is the name of
1947a defined network service (a string) or a port number (an integer).
1948@end defun
1949
b8d4c8d0
GM
1950@node Network Servers
1951@section Network Servers
1952@cindex network servers
1953
1954 You create a server by calling @code{make-network-process} with
1955@code{:server t}. The server will listen for connection requests from
1956clients. When it accepts a client connection request, that creates a
1957new network connection, itself a process object, with the following
1958parameters:
1959
1960@itemize @bullet
1961@item
1962The connection's process name is constructed by concatenating the
1963server process' @var{name} with a client identification string. The
1964client identification string for an IPv4 connection looks like
1965@samp{<@var{a}.@var{b}.@var{c}.@var{d}:@var{p}>}. Otherwise, it is a
1966unique number in brackets, as in @samp{<@var{nnn}>}. The number
1967is unique for each connection in the Emacs session.
1968
1969@item
1970If the server's filter is non-@code{nil}, the connection process does
1971not get a separate process buffer; otherwise, Emacs creates a new
1972buffer for the purpose. The buffer name is the server's buffer name
1973or process name, concatenated with the client identification string.
1974
1975The server's process buffer value is never used directly by Emacs, but
1976it is passed to the log function, which can log connections by
1977inserting text there.
1978
1979@item
1980The communication type and the process filter and sentinel are
1981inherited from those of the server. The server never directly
1982uses its filter and sentinel; their sole purpose is to initialize
1983connections made to the server.
1984
1985@item
1986The connection's process contact info is set according to the client's
1987addressing information (typically an IP address and a port number).
1988This information is associated with the @code{process-contact}
1989keywords @code{:host}, @code{:service}, @code{:remote}.
1990
1991@item
1992The connection's local address is set up according to the port
1993number used for the connection.
1994
1995@item
1996The client process' plist is initialized from the server's plist.
1997@end itemize
1998
1999@node Datagrams
2000@section Datagrams
2001@cindex datagrams
2002
2003 A datagram connection communicates with individual packets rather
2004than streams of data. Each call to @code{process-send} sends one
2005datagram packet (@pxref{Input to Processes}), and each datagram
2006received results in one call to the filter function.
2007
2008 The datagram connection doesn't have to talk with the same remote
2009peer all the time. It has a @dfn{remote peer address} which specifies
2010where to send datagrams to. Each time an incoming datagram is passed
2011to the filter function, the peer address is set to the address that
2012datagram came from; that way, if the filter function sends a datagram,
2013it will go back to that place. You can specify the remote peer
2014address when you create the datagram connection using the
2015@code{:remote} keyword. You can change it later on by calling
2016@code{set-process-datagram-address}.
2017
2018@defun process-datagram-address process
2019If @var{process} is a datagram connection or server, this function
2020returns its remote peer address.
2021@end defun
2022
2023@defun set-process-datagram-address process address
2024If @var{process} is a datagram connection or server, this function
2025sets its remote peer address to @var{address}.
2026@end defun
2027
2028@node Low-Level Network
2029@section Low-Level Network Access
2030
2031 You can also create network connections by operating at a lower
2032level than that of @code{open-network-stream}, using
2033@code{make-network-process}.
2034
2035@menu
2036* Proc: Network Processes. Using @code{make-network-process}.
2037* Options: Network Options. Further control over network connections.
2038* Features: Network Feature Testing.
2039 Determining which network features work on
2040 the machine you are using.
2041@end menu
2042
2043@node Network Processes
2044@subsection @code{make-network-process}
2045
2046 The basic function for creating network connections and network
2047servers is @code{make-network-process}. It can do either of those
2048jobs, depending on the arguments you give it.
2049
2050@defun make-network-process &rest args
2051This function creates a network connection or server and returns the
2052process object that represents it. The arguments @var{args} are a
2053list of keyword/argument pairs. Omitting a keyword is always
2054equivalent to specifying it with value @code{nil}, except for
2055@code{:coding}, @code{:filter-multibyte}, and @code{:reuseaddr}. Here
2056are the meaningful keywords:
2057
2058@table @asis
2059@item :name @var{name}
2060Use the string @var{name} as the process name. It is modified if
2061necessary to make it unique.
2062
2063@item :type @var{type}
2064Specify the communication type. A value of @code{nil} specifies a
2065stream connection (the default); @code{datagram} specifies a datagram
f7704e26
CY
2066connection; @code{seqpacket} specifies a ``sequenced packet stream''
2067connection. Both connections and servers can be of these types.
b8d4c8d0
GM
2068
2069@item :server @var{server-flag}
2070If @var{server-flag} is non-@code{nil}, create a server. Otherwise,
2071create a connection. For a stream type server, @var{server-flag} may
2072be an integer which then specifies the length of the queue of pending
2073connections to the server. The default queue length is 5.
2074
2075@item :host @var{host}
2076Specify the host to connect to. @var{host} should be a host name or
2077Internet address, as a string, or the symbol @code{local} to specify
2078the local host. If you specify @var{host} for a server, it must
2079specify a valid address for the local host, and only clients
2080connecting to that address will be accepted.
2081
2082@item :service @var{service}
2083@var{service} specifies a port number to connect to, or, for a server,
2084the port number to listen on. It should be a service name that
2085translates to a port number, or an integer specifying the port number
2086directly. For a server, it can also be @code{t}, which means to let
2087the system select an unused port number.
2088
2089@item :family @var{family}
2090@var{family} specifies the address (and protocol) family for
2091communication. @code{nil} means determine the proper address family
2092automatically for the given @var{host} and @var{service}.
2093@code{local} specifies a Unix socket, in which case @var{host} is
2094ignored. @code{ipv4} and @code{ipv6} specify to use IPv4 and IPv6
2095respectively.
2096
2097@item :local @var{local-address}
2098For a server process, @var{local-address} is the address to listen on.
2099It overrides @var{family}, @var{host} and @var{service}, and you
2100may as well not specify them.
2101
2102@item :remote @var{remote-address}
2103For a connection, @var{remote-address} is the address to connect to.
2104It overrides @var{family}, @var{host} and @var{service}, and you
2105may as well not specify them.
2106
2107For a datagram server, @var{remote-address} specifies the initial
2108setting of the remote datagram address.
2109
2110The format of @var{local-address} or @var{remote-address} depends on
2111the address family:
2112
2113@itemize -
2114@item
2115An IPv4 address is represented as a five-element vector of four 8-bit
2116integers and one 16-bit integer
2117@code{[@var{a} @var{b} @var{c} @var{d} @var{p}]} corresponding to
2118numeric IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port number
2119@var{p}.
2120
2121@item
2122An IPv6 address is represented as a nine-element vector of 16-bit
2123integers @code{[@var{a} @var{b} @var{c} @var{d} @var{e} @var{f}
2124@var{g} @var{h} @var{p}]} corresponding to numeric IPv6 address
2125@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h} and
2126port number @var{p}.
2127
2128@item
2129A local address is represented as a string which specifies the address
2130in the local address space.
2131
2132@item
2133An ``unsupported family'' address is represented by a cons
2134@code{(@var{f} . @var{av})}, where @var{f} is the family number and
2135@var{av} is a vector specifying the socket address using one element
2136per address data byte. Do not rely on this format in portable code,
2137as it may depend on implementation defined constants, data sizes, and
2138data structure alignment.
2139@end itemize
2140
2141@item :nowait @var{bool}
2142If @var{bool} is non-@code{nil} for a stream connection, return
2143without waiting for the connection to complete. When the connection
2144succeeds or fails, Emacs will call the sentinel function, with a
2145second argument matching @code{"open"} (if successful) or
2146@code{"failed"}. The default is to block, so that
2147@code{make-network-process} does not return until the connection
2148has succeeded or failed.
2149
2150@item :stop @var{stopped}
2151Start the network connection or server in the `stopped' state if
2152@var{stopped} is non-@code{nil}.
2153
2154@item :buffer @var{buffer}
2155Use @var{buffer} as the process buffer.
2156
2157@item :coding @var{coding}
2158Use @var{coding} as the coding system for this process. To specify
2159different coding systems for decoding data from the connection and for
2160encoding data sent to it, specify @code{(@var{decoding} .
2161@var{encoding})} for @var{coding}.
2162
2163If you don't specify this keyword at all, the default
2164is to determine the coding systems from the data.
2165
2166@item :noquery @var{query-flag}
2167Initialize the process query flag to @var{query-flag}.
2168@xref{Query Before Exit}.
2169
2170@item :filter @var{filter}
2171Initialize the process filter to @var{filter}.
2172
b8d4c8d0
GM
2173@item :sentinel @var{sentinel}
2174Initialize the process sentinel to @var{sentinel}.
2175
2176@item :log @var{log}
2177Initialize the log function of a server process to @var{log}. The log
2178function is called each time the server accepts a network connection
2179from a client. The arguments passed to the log function are
2180@var{server}, @var{connection}, and @var{message}, where @var{server}
2181is the server process, @var{connection} is the new process for the
2182connection, and @var{message} is a string describing what has
2183happened.
2184
2185@item :plist @var{plist}
2186Initialize the process plist to @var{plist}.
2187@end table
2188
2189The original argument list, modified with the actual connection
2190information, is available via the @code{process-contact} function.
2191@end defun
2192
2193@node Network Options
2194@subsection Network Options
2195
2196 The following network options can be specified when you create a
2197network process. Except for @code{:reuseaddr}, you can also set or
2198modify these options later, using @code{set-network-process-option}.
2199
2200 For a server process, the options specified with
2201@code{make-network-process} are not inherited by the client
2202connections, so you will need to set the necessary options for each
2203child connection as it is created.
2204
2205@table @asis
2206@item :bindtodevice @var{device-name}
2207If @var{device-name} is a non-empty string identifying a network
2208interface name (see @code{network-interface-list}), only handle
2209packets received on that interface. If @var{device-name} is @code{nil}
2210(the default), handle packets received on any interface.
2211
2212Using this option may require special privileges on some systems.
2213
2214@item :broadcast @var{broadcast-flag}
2215If @var{broadcast-flag} is non-@code{nil} for a datagram process, the
2216process will receive datagram packet sent to a broadcast address, and
2217be able to send packets to a broadcast address. Ignored for a stream
2218connection.
2219
2220@item :dontroute @var{dontroute-flag}
2221If @var{dontroute-flag} is non-@code{nil}, the process can only send
2222to hosts on the same network as the local host.
2223
2224@item :keepalive @var{keepalive-flag}
2225If @var{keepalive-flag} is non-@code{nil} for a stream connection,
2226enable exchange of low-level keep-alive messages.
2227
2228@item :linger @var{linger-arg}
2229If @var{linger-arg} is non-@code{nil}, wait for successful
2230transmission of all queued packets on the connection before it is
2231deleted (see @code{delete-process}). If @var{linger-arg} is an
2232integer, it specifies the maximum time in seconds to wait for queued
2233packets to be sent before closing the connection. Default is
2234@code{nil} which means to discard unsent queued packets when the
2235process is deleted.
2236
2237@item :oobinline @var{oobinline-flag}
2238If @var{oobinline-flag} is non-@code{nil} for a stream connection,
2239receive out-of-band data in the normal data stream. Otherwise, ignore
2240out-of-band data.
2241
2242@item :priority @var{priority}
2243Set the priority for packets sent on this connection to the integer
2244@var{priority}. The interpretation of this number is protocol
2245specific, such as setting the TOS (type of service) field on IP
2246packets sent on this connection. It may also have system dependent
2247effects, such as selecting a specific output queue on the network
2248interface.
2249
2250@item :reuseaddr @var{reuseaddr-flag}
2251If @var{reuseaddr-flag} is non-@code{nil} (the default) for a stream
2252server process, allow this server to reuse a specific port number (see
2253@code{:service}) unless another process on this host is already
2254listening on that port. If @var{reuseaddr-flag} is @code{nil}, there
2255may be a period of time after the last use of that port (by any
2256process on the host), where it is not possible to make a new server on
2257that port.
2258@end table
2259
106e6894 2260@defun set-network-process-option process option value &optional no-error
b8d4c8d0
GM
2261This function sets or modifies a network option for network process
2262@var{process}. See @code{make-network-process} for details of options
106e6894
CY
2263@var{option} and their corresponding values @var{value}. If
2264@var{no-error} is non-@code{nil}, this function returns @code{nil}
2265instead of signaling an error if @var{option} is not a supported
2266option. If the function successfully completes, it returns @code{t}.
b8d4c8d0
GM
2267
2268The current setting of an option is available via the
2269@code{process-contact} function.
2270@end defun
2271
2272@node Network Feature Testing
2273@subsection Testing Availability of Network Features
2274
2275 To test for the availability of a given network feature, use
2276@code{featurep} like this:
2277
2278@example
2279(featurep 'make-network-process '(@var{keyword} @var{value}))
2280@end example
2281
2282@noindent
2283The result of the first form is @code{t} if it works to specify
2284@var{keyword} with value @var{value} in @code{make-network-process}.
2285The result of the second form is @code{t} if @var{keyword} is
2286supported by @code{make-network-process}. Here are some of the
2287@var{keyword}---@var{value} pairs you can test in
2288this way.
2289
2290@table @code
2291@item (:nowait t)
2292Non-@code{nil} if non-blocking connect is supported.
2293@item (:type datagram)
2294Non-@code{nil} if datagrams are supported.
2295@item (:family local)
2296Non-@code{nil} if local (a.k.a.@: ``UNIX domain'') sockets are supported.
2297@item (:family ipv6)
2298Non-@code{nil} if IPv6 is supported.
2299@item (:service t)
2300Non-@code{nil} if the system can select the port for a server.
2301@end table
2302
2303 To test for the availability of a given network option, use
2304@code{featurep} like this:
2305
2306@example
2307(featurep 'make-network-process '@var{keyword})
2308@end example
2309
2310@noindent
2311Here are some of the options you can test in this way.
2312
2313@table @code
2314@item :bindtodevice
2315@itemx :broadcast
2316@itemx :dontroute
2317@itemx :keepalive
2318@itemx :linger
2319@itemx :oobinline
2320@itemx :priority
2321@itemx :reuseaddr
2322That particular network option is supported by
2323@code{make-network-process} and @code{set-network-process-option}.
2324@end table
2325
2326@node Misc Network
2327@section Misc Network Facilities
2328
2329 These additional functions are useful for creating and operating
305a7ef2
EZ
2330on network connections. Note that they are supported only on some
2331systems.
b8d4c8d0
GM
2332
2333@defun network-interface-list
2334This function returns a list describing the network interfaces
2335of the machine you are using. The value is an alist whose
2336elements have the form @code{(@var{name} . @var{address})}.
2337@var{address} has the same form as the @var{local-address}
2338and @var{remote-address} arguments to @code{make-network-process}.
2339@end defun
2340
2341@defun network-interface-info ifname
2342This function returns information about the network interface named
2343@var{ifname}. The value is a list of the form
2344@code{(@var{addr} @var{bcast} @var{netmask} @var{hwaddr} @var{flags})}.
2345
2346@table @var
2347@item addr
2348The Internet protocol address.
2349@item bcast
2350The broadcast address.
2351@item netmask
2352The network mask.
2353@item hwaddr
2354The layer 2 address (Ethernet MAC address, for instance).
2355@item flags
2356The current flags of the interface.
2357@end table
2358@end defun
2359
2360@defun format-network-address address &optional omit-port
2361This function converts the Lisp representation of a network address to
2362a string.
2363
2364A five-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]}
2365represents an IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port
2366number @var{p}. @code{format-network-address} converts that to the
2367string @code{"@var{a}.@var{b}.@var{c}.@var{d}:@var{p}"}.
2368
2369A nine-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{e}
2370@var{f} @var{g} @var{h} @var{p}]} represents an IPv6 address along
2371with a port number. @code{format-network-address} converts that to
2372the string
2373@code{"[@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h}]:@var{p}"}.
2374
2375If the vector does not include the port number, @var{p}, or if
2376@var{omit-port} is non-@code{nil}, the result does not include the
2377@code{:@var{p}} suffix.
2378@end defun
2379
c73e02fa
GM
2380@node Serial Ports
2381@section Communicating with Serial Ports
2382@cindex @file{/dev/tty}
2383@cindex @file{COM1}
545c2782 2384@cindex serial connections
c73e02fa
GM
2385
2386 Emacs can communicate with serial ports. For interactive use,
2387@kbd{M-x serial-term} opens a terminal window. In a Lisp program,
2388@code{make-serial-process} creates a process object.
2389
2390 The serial port can be configured at run-time, without having to
2391close and re-open it. The function @code{serial-process-configure}
2392lets you change the speed, bytesize, and other parameters. In a
2393terminal window created by @code{serial-term}, you can click on the
2394mode line for configuration.
2395
2396 A serial connection is represented by a process object which can be
2397used similar to a subprocess or network process. You can send and
2398receive data and configure the serial port. A serial process object
80e6b6df
EZ
2399has no process ID, you can't send signals to it, and the status codes
2400are different from other types of processes.
c73e02fa
GM
2401@code{delete-process} on the process object or @code{kill-buffer} on
2402the process buffer close the connection, but this does not affect the
2403device connected to the serial port.
2404
2405 The function @code{process-type} returns the symbol @code{serial}
80e6b6df 2406for a process object representing a serial port connection.
c73e02fa
GM
2407
2408 Serial ports are available on GNU/Linux, Unix, and Windows systems.
2409
80e6b6df 2410@deffn Command serial-term port speed
c73e02fa 2411Start a terminal-emulator for a serial port in a new buffer.
80e6b6df
EZ
2412@var{port} is the name of the serial port to which to connect. For
2413example, this could be @file{/dev/ttyS0} on Unix. On Windows, this
2414could be @file{COM1}, or @file{\\.\COM10} (double the backslashes in
2415Lisp strings).
c73e02fa
GM
2416
2417@var{speed} is the speed of the serial port in bits per second. 9600
80e6b6df
EZ
2418is a common value. The buffer is in Term mode; see @ref{Term Mode,,,
2419emacs, The GNU Emacs Manual}, for the commands to use in that buffer.
2420You can change the speed and the configuration in the mode line menu.
2421@end deffn
c73e02fa
GM
2422
2423@defun make-serial-process &rest args
80e6b6df
EZ
2424This function creates a process and a buffer. Arguments are specified
2425as keyword/argument pairs. Here's the list of the meaningful keywords:
c73e02fa
GM
2426
2427@table @code
80e6b6df
EZ
2428@item :port @var{port}@r{ (mandatory)}
2429This is the name of the serial port. On Unix and GNU systems, this is
2430a file name such as @file{/dev/ttyS0}. On Windows, this could be
2431@file{COM1}, or @file{\\.\COM10} for ports higher than @file{COM9}
2432(double the backslashes in Lisp strings).
2433
2434@item :speed @var{speed}@r{ (mandatory)}
2435The speed of the serial port in bits per second. This function calls
2436@code{serial-process-configure} to handle the speed.
2437
2438@item :name @var{name}
2439The name of the process. If @var{name} is not given, @var{port} will
2440serve as the process name as well.
2441
2442@item :buffer @var{buffer}
2443The buffer to associate with the process. The value could be either a
2444buffer or a string that names a buffer. Process output goes at the
2445end of that buffer, unless you specify an output stream or filter
2446function to handle the output. If @var{buffer} is not given, the
2447process buffer's name is taken from the value of the @code{:name}
2448keyword.
2449
2450@item :coding @var{coding}
c73e02fa
GM
2451If @var{coding} is a symbol, it specifies the coding system used for
2452both reading and writing for this process. If @var{coding} is a cons
2453@code{(decoding . encoding)}, @var{decoding} is used for reading, and
80e6b6df
EZ
2454@var{encoding} is used for writing. If not specified, the default is
2455to determine the coding systems from data itself.
c73e02fa 2456
80e6b6df
EZ
2457@item :noquery @var{query-flag}
2458Initialize the process query flag to @var{query-flag}. @xref{Query
2459Before Exit}. The flags defaults to @code{nil} if unspecified.
c73e02fa 2460
80e6b6df 2461@item :stop @var{bool}
c73e02fa
GM
2462Start process in the @code{stopped} state if @var{bool} is
2463non-@code{nil}. In the stopped state, a serial process does not
2464accept incoming data, but you can send outgoing data. The stopped
2465state is cleared by @code{continue-process} and set by
2466@code{stop-process}.
2467
80e6b6df 2468@item :filter @var{filter}
c73e02fa
GM
2469Install @var{filter} as the process filter.
2470
80e6b6df 2471@item :sentinel @var{sentinel}
c73e02fa
GM
2472Install @var{sentinel} as the process sentinel.
2473
80e6b6df 2474@item :plist @var{plist}
c73e02fa
GM
2475Install @var{plist} as the initial plist of the process.
2476
2477@item :speed
2478@itemx :bytesize
2479@itemx :parity
2480@itemx :stopbits
2481@itemx :flowcontrol
2482These arguments are handled by @code{serial-process-configure}, which
2483is called by @code{make-serial-process}.
2484@end table
2485
2486The original argument list, possibly modified by later configuration,
2487is available via the function @code{process-contact}.
2488
2489Examples:
2490
2491@example
2492(make-serial-process :port "/dev/ttyS0" :speed 9600)
2493
2494(make-serial-process :port "COM1" :speed 115200 :stopbits 2)
2495
80e6b6df
EZ
2496(make-serial-process :port "\\\\.\\COM13" :speed 1200
2497 :bytesize 7 :parity 'odd)
c73e02fa 2498
57eedec1
GM
2499(make-serial-process :port "/dev/tty.BlueConsole-SPP-1"
2500 :speed nil)
c73e02fa
GM
2501@end example
2502@end defun
2503
2504@defun serial-process-configure &rest args
80e6b6df
EZ
2505@cindex baud, in serial connections
2506@cindex bytesize, in serial connections
2507@cindex parity, in serial connections
2508@cindex stopbits, in serial connections
2509@cindex flowcontrol, in serial connections
2510
2511This functions configures a serial port connection. Arguments are
2512specified as keyword/argument pairs. Attributes that are not given
2513are re-initialized from the process's current configuration (available
2514via the function @code{process-contact}) or set to reasonable default
2515values. The following arguments are defined:
c73e02fa
GM
2516
2517@table @code
80e6b6df
EZ
2518@item :process @var{process}
2519@itemx :name @var{name}
2520@itemx :buffer @var{buffer}
2521@itemx :port @var{port}
c73e02fa
GM
2522Any of these arguments can be given to identify the process that is to
2523be configured. If none of these arguments is given, the current
2524buffer's process is used.
2525
2526@item :speed @var{speed}
545c2782
EZ
2527The speed of the serial port in bits per second, a.k.a.@: @dfn{baud
2528rate}. The value can be any number, but most serial ports work only
2529at a few defined values between 1200 and 115200, with 9600 being the
2530most common value. If @var{speed} is @code{nil}, the function ignores
2531all other arguments and does not configure the port. This may be
2532useful for special serial ports such as Bluetooth-to-serial converters
2533which can only be configured through AT commands sent through the
538395d9
EZ
2534connection. The value of @code{nil} for @var{speed} is valid only for
2535connections that were already opened by a previous call to
80e6b6df 2536@code{make-serial-process} or @code{serial-term}.
c73e02fa
GM
2537
2538@item :bytesize @var{bytesize}
80e6b6df
EZ
2539The number of bits per byte, which can be 7 or 8. If @var{bytesize}
2540is not given or @code{nil}, it defaults to 8.
c73e02fa
GM
2541
2542@item :parity @var{parity}
80e6b6df 2543The value can be @code{nil} (don't use parity), the symbol
c73e02fa 2544@code{odd} (use odd parity), or the symbol @code{even} (use even
80e6b6df 2545parity). If @var{parity} is not given, it defaults to no parity.
c73e02fa
GM
2546
2547@item :stopbits @var{stopbits}
80e6b6df
EZ
2548The number of stopbits used to terminate a transmission
2549of each byte. @var{stopbits} can be 1 or 2. If @var{stopbits} is not
2550given or @code{nil}, it defaults to 1.
c73e02fa
GM
2551
2552@item :flowcontrol @var{flowcontrol}
80e6b6df
EZ
2553The type of flow control to use for this connection, which is either
2554@code{nil} (don't use flow control), the symbol @code{hw} (use RTS/CTS
2555hardware flow control), or the symbol @code{sw} (use XON/XOFF software
2556flow control). If @var{flowcontrol} is not given, it defaults to no
2557flow control.
c73e02fa
GM
2558@end table
2559
2560@code{serial-process-configure} is called by @code{make-serial-process} for the
2561initial configuration of the serial port.
2562
2563Examples:
2564
2565@example
2566(serial-process-configure :process "/dev/ttyS0" :speed 1200)
2567
57eedec1
GM
2568(serial-process-configure :buffer "COM1" :stopbits 1
2569 :parity 'odd :flowcontrol 'hw)
c73e02fa
GM
2570
2571(serial-process-configure :port "\\\\.\\COM13" :bytesize 7)
2572@end example
2573@end defun
2574
b8d4c8d0
GM
2575@node Byte Packing
2576@section Packing and Unpacking Byte Arrays
2577@cindex byte packing and unpacking
2578
2579 This section describes how to pack and unpack arrays of bytes,
2580usually for binary network protocols. These functions convert byte arrays
2581to alists, and vice versa. The byte array can be represented as a
2582unibyte string or as a vector of integers, while the alist associates
2583symbols either with fixed-size objects or with recursive sub-alists.
2584
2585@cindex serializing
2586@cindex deserializing
2587@cindex packing
2588@cindex unpacking
2589 Conversion from byte arrays to nested alists is also known as
2590@dfn{deserializing} or @dfn{unpacking}, while going in the opposite
2591direction is also known as @dfn{serializing} or @dfn{packing}.
2592
2593@menu
2594* Bindat Spec:: Describing data layout.
2595* Bindat Functions:: Doing the unpacking and packing.
2596* Bindat Examples:: Samples of what bindat.el can do for you!
2597@end menu
2598
2599@node Bindat Spec
2600@subsection Describing Data Layout
2601
2602 To control unpacking and packing, you write a @dfn{data layout
2603specification}, a special nested list describing named and typed
2604@dfn{fields}. This specification controls length of each field to be
2605processed, and how to pack or unpack it. We normally keep bindat specs
2606in variables whose names end in @samp{-bindat-spec}; that kind of name
2607is automatically recognized as ``risky.''
2608
2609@cindex endianness
2610@cindex big endian
2611@cindex little endian
2612@cindex network byte ordering
2613 A field's @dfn{type} describes the size (in bytes) of the object
2614that the field represents and, in the case of multibyte fields, how
2615the bytes are ordered within the field. The two possible orderings
2616are ``big endian'' (also known as ``network byte ordering'') and
2617``little endian.'' For instance, the number @code{#x23cd} (decimal
26189165) in big endian would be the two bytes @code{#x23} @code{#xcd};
2619and in little endian, @code{#xcd} @code{#x23}. Here are the possible
2620type values:
2621
2622@table @code
2623@item u8
2624@itemx byte
2625Unsigned byte, with length 1.
2626
2627@item u16
2628@itemx word
2629@itemx short
2630Unsigned integer in network byte order, with length 2.
2631
2632@item u24
2633Unsigned integer in network byte order, with length 3.
2634
2635@item u32
2636@itemx dword
2637@itemx long
2638Unsigned integer in network byte order, with length 4.
2639Note: These values may be limited by Emacs' integer implementation limits.
2640
2641@item u16r
2642@itemx u24r
2643@itemx u32r
2644Unsigned integer in little endian order, with length 2, 3 and 4, respectively.
2645
2646@item str @var{len}
2647String of length @var{len}.
2648
2649@item strz @var{len}
2650Zero-terminated string, in a fixed-size field with length @var{len}.
2651
2652@item vec @var{len} [@var{type}]
2653Vector of @var{len} elements of type @var{type}, or bytes if not
2654@var{type} is specified.
2655The @var{type} is any of the simple types above, or another vector
2656specified as a list @code{(vec @var{len} [@var{type}])}.
2657
2658@item ip
2659Four-byte vector representing an Internet address. For example:
2660@code{[127 0 0 1]} for localhost.
2661
2662@item bits @var{len}
2663List of set bits in @var{len} bytes. The bytes are taken in big
2664endian order and the bits are numbered starting with @code{8 *
2665@var{len} @minus{} 1} and ending with zero. For example: @code{bits
26662} unpacks @code{#x28} @code{#x1c} to @code{(2 3 4 11 13)} and
2667@code{#x1c} @code{#x28} to @code{(3 5 10 11 12)}.
2668
2669@item (eval @var{form})
2670@var{form} is a Lisp expression evaluated at the moment the field is
2671unpacked or packed. The result of the evaluation should be one of the
2672above-listed type specifications.
2673@end table
2674
2675For a fixed-size field, the length @var{len} is given as an integer
2676specifying the number of bytes in the field.
2677
2678When the length of a field is not fixed, it typically depends on the
2679value of a preceding field. In this case, the length @var{len} can be
2680given either as a list @code{(@var{name} ...)} identifying a
2681@dfn{field name} in the format specified for @code{bindat-get-field}
2682below, or by an expression @code{(eval @var{form})} where @var{form}
2683should evaluate to an integer, specifying the field length.
2684
2685A field specification generally has the form @code{([@var{name}]
2686@var{handler})}. The square braces indicate that @var{name} is
2687optional. (Don't use names that are symbols meaningful as type
2688specifications (above) or handler specifications (below), since that
2689would be ambiguous.) @var{name} can be a symbol or the expression
2690@code{(eval @var{form})}, in which case @var{form} should evaluate to
2691a symbol.
2692
2693@var{handler} describes how to unpack or pack the field and can be one
2694of the following:
2695
2696@table @code
2697@item @var{type}
2698Unpack/pack this field according to the type specification @var{type}.
2699
2700@item eval @var{form}
2701Evaluate @var{form}, a Lisp expression, for side-effect only. If the
2702field name is specified, the value is bound to that field name.
2703
2704@item fill @var{len}
2705Skip @var{len} bytes. In packing, this leaves them unchanged,
2706which normally means they remain zero. In unpacking, this means
2707they are ignored.
2708
2709@item align @var{len}
2710Skip to the next multiple of @var{len} bytes.
2711
2712@item struct @var{spec-name}
2713Process @var{spec-name} as a sub-specification. This describes a
2714structure nested within another structure.
2715
2716@item union @var{form} (@var{tag} @var{spec})@dots{}
2717@c ??? I don't see how one would actually use this.
2718@c ??? what kind of expression would be useful for @var{form}?
2719Evaluate @var{form}, a Lisp expression, find the first @var{tag}
2720that matches it, and process its associated data layout specification
2721@var{spec}. Matching can occur in one of three ways:
2722
2723@itemize
2724@item
2725If a @var{tag} has the form @code{(eval @var{expr})}, evaluate
2726@var{expr} with the variable @code{tag} dynamically bound to the value
2727of @var{form}. A non-@code{nil} result indicates a match.
2728
2729@item
2730@var{tag} matches if it is @code{equal} to the value of @var{form}.
2731
2732@item
2733@var{tag} matches unconditionally if it is @code{t}.
2734@end itemize
2735
2736@item repeat @var{count} @var{field-specs}@dots{}
2737Process the @var{field-specs} recursively, in order, then repeat
2738starting from the first one, processing all the specs @var{count}
2739times overall. The @var{count} is given using the same formats as a
2740field length---if an @code{eval} form is used, it is evaluated just once.
2741For correct operation, each spec in @var{field-specs} must include a name.
2742@end table
2743
2744For the @code{(eval @var{form})} forms used in a bindat specification,
2745the @var{form} can access and update these dynamically bound variables
2746during evaluation:
2747
2748@table @code
2749@item last
2750Value of the last field processed.
2751
2752@item bindat-raw
2753The data as a byte array.
2754
2755@item bindat-idx
2756Current index (within @code{bindat-raw}) for unpacking or packing.
2757
2758@item struct
2759The alist containing the structured data that have been unpacked so
2760far, or the entire structure being packed. You can use
2761@code{bindat-get-field} to access specific fields of this structure.
2762
2763@item count
2764@itemx index
2765Inside a @code{repeat} block, these contain the maximum number of
2766repetitions (as specified by the @var{count} parameter), and the
2767current repetition number (counting from 0). Setting @code{count} to
2768zero will terminate the inner-most repeat block after the current
2769repetition has completed.
2770@end table
2771
2772@node Bindat Functions
2773@subsection Functions to Unpack and Pack Bytes
2774
2775 In the following documentation, @var{spec} refers to a data layout
2776specification, @code{bindat-raw} to a byte array, and @var{struct} to an
2777alist representing unpacked field data.
2778
2779@defun bindat-unpack spec bindat-raw &optional bindat-idx
2780This function unpacks data from the unibyte string or byte
2781array @code{bindat-raw}
2782according to @var{spec}. Normally this starts unpacking at the
2783beginning of the byte array, but if @var{bindat-idx} is non-@code{nil}, it
2784specifies a zero-based starting position to use instead.
2785
2786The value is an alist or nested alist in which each element describes
2787one unpacked field.
2788@end defun
2789
2790@defun bindat-get-field struct &rest name
2791This function selects a field's data from the nested alist
2792@var{struct}. Usually @var{struct} was returned by
2793@code{bindat-unpack}. If @var{name} corresponds to just one argument,
2794that means to extract a top-level field value. Multiple @var{name}
2795arguments specify repeated lookup of sub-structures. An integer name
2796acts as an array index.
2797
2798For example, if @var{name} is @code{(a b 2 c)}, that means to find
2799field @code{c} in the third element of subfield @code{b} of field
2800@code{a}. (This corresponds to @code{struct.a.b[2].c} in C.)
2801@end defun
2802
2803 Although packing and unpacking operations change the organization of
2804data (in memory), they preserve the data's @dfn{total length}, which is
2805the sum of all the fields' lengths, in bytes. This value is not
2806generally inherent in either the specification or alist alone; instead,
2807both pieces of information contribute to its calculation. Likewise, the
2808length of a string or array being unpacked may be longer than the data's
2809total length as described by the specification.
2810
2811@defun bindat-length spec struct
2812This function returns the total length of the data in @var{struct},
2813according to @var{spec}.
2814@end defun
2815
2816@defun bindat-pack spec struct &optional bindat-raw bindat-idx
2817This function returns a byte array packed according to @var{spec} from
2818the data in the alist @var{struct}. Normally it creates and fills a
2819new byte array starting at the beginning. However, if @var{bindat-raw}
2820is non-@code{nil}, it specifies a pre-allocated unibyte string or vector to
2821pack into. If @var{bindat-idx} is non-@code{nil}, it specifies the starting
2822offset for packing into @code{bindat-raw}.
2823
2824When pre-allocating, you should make sure @code{(length @var{bindat-raw})}
2825meets or exceeds the total length to avoid an out-of-range error.
2826@end defun
2827
2828@defun bindat-ip-to-string ip
2829Convert the Internet address vector @var{ip} to a string in the usual
2830dotted notation.
2831
2832@example
2833(bindat-ip-to-string [127 0 0 1])
2834 @result{} "127.0.0.1"
2835@end example
2836@end defun
2837
2838@node Bindat Examples
2839@subsection Examples of Byte Unpacking and Packing
2840
2841 Here is a complete example of byte unpacking and packing:
2842
2843@lisp
2844(defvar fcookie-index-spec
2845 '((:version u32)
2846 (:count u32)
2847 (:longest u32)
2848 (:shortest u32)
2849 (:flags u32)
2850 (:delim u8)
2851 (:ignored fill 3)
2852 (:offset repeat (:count)
2853 (:foo u32)))
2854 "Description of a fortune cookie index file's contents.")
2855
2856(defun fcookie (cookies &optional index)
2857 "Display a random fortune cookie from file COOKIES.
2858Optional second arg INDEX specifies the associated index
2859filename, which is by default constructed by appending
2860\".dat\" to COOKIES. Display cookie text in possibly
2861new buffer \"*Fortune Cookie: BASENAME*\" where BASENAME
2862is COOKIES without the directory part."
2863 (interactive "fCookies file: ")
2864 (let* ((info (with-temp-buffer
2865 (insert-file-contents-literally
2866 (or index (concat cookies ".dat")))
2867 (bindat-unpack fcookie-index-spec
2868 (buffer-string))))
2869 (sel (random (bindat-get-field info :count)))
2870 (beg (cdar (bindat-get-field info :offset sel)))
2871 (end (or (cdar (bindat-get-field info
2872 :offset (1+ sel)))
2873 (nth 7 (file-attributes cookies)))))
2874 (switch-to-buffer
2875 (get-buffer-create
2876 (format "*Fortune Cookie: %s*"
2877 (file-name-nondirectory cookies))))
2878 (erase-buffer)
2879 (insert-file-contents-literally
2880 cookies nil beg (- end 3))))
2881
2882(defun fcookie-create-index (cookies &optional index delim)
2883 "Scan file COOKIES, and write out its index file.
2884Optional second arg INDEX specifies the index filename,
2885which is by default constructed by appending \".dat\" to
2886COOKIES. Optional third arg DELIM specifies the unibyte
2887character which, when found on a line of its own in
2888COOKIES, indicates the border between entries."
2889 (interactive "fCookies file: ")
2890 (setq delim (or delim ?%))
2891 (let ((delim-line (format "\n%c\n" delim))
2892 (count 0)
2893 (max 0)
2894 min p q len offsets)
2895 (unless (= 3 (string-bytes delim-line))
2896 (error "Delimiter cannot be represented in one byte"))
2897 (with-temp-buffer
2898 (insert-file-contents-literally cookies)
2899 (while (and (setq p (point))
2900 (search-forward delim-line (point-max) t)
2901 (setq len (- (point) 3 p)))
2902 (setq count (1+ count)
2903 max (max max len)
2904 min (min (or min max) len)
2905 offsets (cons (1- p) offsets))))
2906 (with-temp-buffer
2907 (set-buffer-multibyte nil)
2908 (insert
2909 (bindat-pack
2910 fcookie-index-spec
2911 `((:version . 2)
2912 (:count . ,count)
2913 (:longest . ,max)
2914 (:shortest . ,min)
2915 (:flags . 0)
2916 (:delim . ,delim)
2917 (:offset . ,(mapcar (lambda (o)
2918 (list (cons :foo o)))
2919 (nreverse offsets))))))
2920 (let ((coding-system-for-write 'raw-text-unix))
2921 (write-file (or index (concat cookies ".dat")))))))
2922@end lisp
2923
2924Following is an example of defining and unpacking a complex structure.
2925Consider the following C structures:
2926
2927@example
2928struct header @{
2929 unsigned long dest_ip;
2930 unsigned long src_ip;
2931 unsigned short dest_port;
2932 unsigned short src_port;
2933@};
2934
2935struct data @{
2936 unsigned char type;
2937 unsigned char opcode;
2938 unsigned short length; /* In network byte order */
2939 unsigned char id[8]; /* null-terminated string */
2940 unsigned char data[/* (length + 3) & ~3 */];
2941@};
2942
2943struct packet @{
2944 struct header header;
2945 unsigned long counters[2]; /* In little endian order */
2946 unsigned char items;
2947 unsigned char filler[3];
2948 struct data item[/* items */];
2949
2950@};
2951@end example
2952
2953The corresponding data layout specification:
2954
2955@lisp
2956(setq header-spec
2957 '((dest-ip ip)
2958 (src-ip ip)
2959 (dest-port u16)
2960 (src-port u16)))
2961
2962(setq data-spec
2963 '((type u8)
2964 (opcode u8)
2965 (length u16) ;; network byte order
2966 (id strz 8)
2967 (data vec (length))
2968 (align 4)))
2969
2970(setq packet-spec
2971 '((header struct header-spec)
2972 (counters vec 2 u32r) ;; little endian order
2973 (items u8)
2974 (fill 3)
2975 (item repeat (items)
2976 (struct data-spec))))
2977@end lisp
2978
2979A binary data representation:
2980
2981@lisp
2982(setq binary-data
2983 [ 192 168 1 100 192 168 1 101 01 28 21 32
2984 160 134 1 0 5 1 0 0 2 0 0 0
2985 2 3 0 5 ?A ?B ?C ?D ?E ?F 0 0 1 2 3 4 5 0 0 0
2986 1 4 0 7 ?B ?C ?D ?E ?F ?G 0 0 6 7 8 9 10 11 12 0 ])
2987@end lisp
2988
2989The corresponding decoded structure:
2990
2991@lisp
2992(setq decoded (bindat-unpack packet-spec binary-data))
2993 @result{}
2994((header
2995 (dest-ip . [192 168 1 100])
2996 (src-ip . [192 168 1 101])
2997 (dest-port . 284)
2998 (src-port . 5408))
2999 (counters . [100000 261])
3000 (items . 2)
3001 (item ((data . [1 2 3 4 5])
3002 (id . "ABCDEF")
3003 (length . 5)
3004 (opcode . 3)
3005 (type . 2))
3006 ((data . [6 7 8 9 10 11 12])
3007 (id . "BCDEFG")
3008 (length . 7)
3009 (opcode . 4)
3010 (type . 1))))
3011@end lisp
3012
3013Fetching data from this structure:
3014
3015@lisp
3016(bindat-get-field decoded 'item 1 'id)
3017 @result{} "BCDEFG"
3018@end lisp