Extend `call-process' to take the `(:file "file")' syntax to redirect
[bpt/emacs.git] / doc / lispref / processes.texi
CommitLineData
b8d4c8d0
GM
1@c -*-texinfo-*-
2@c This is part of the GNU Emacs Lisp Reference Manual.
73b0cd50 3@c Copyright (C) 1990-1995, 1998-1999, 2001-2011
d24880de 4@c Free Software Foundation, Inc.
b8d4c8d0 5@c See the file elisp.texi for copying conditions.
6336d8c3 6@setfilename ../../info/processes
b8d4c8d0
GM
7@node Processes, Display, Abbrevs, Top
8@chapter Processes
9@cindex child process
10@cindex parent process
11@cindex subprocess
12@cindex process
13
14 In the terminology of operating systems, a @dfn{process} is a space in
15which a program can execute. Emacs runs in a process. Emacs Lisp
16programs can invoke other programs in processes of their own. These are
17called @dfn{subprocesses} or @dfn{child processes} of the Emacs process,
18which is their @dfn{parent process}.
19
20 A subprocess of Emacs may be @dfn{synchronous} or @dfn{asynchronous},
21depending on how it is created. When you create a synchronous
22subprocess, the Lisp program waits for the subprocess to terminate
23before continuing execution. When you create an asynchronous
24subprocess, it can run in parallel with the Lisp program. This kind of
25subprocess is represented within Emacs by a Lisp object which is also
26called a ``process.'' Lisp programs can use this object to communicate
27with the subprocess or to control it. For example, you can send
28signals, obtain status information, receive output from the process, or
29send input to it.
30
31@defun processp object
23dd4ecd
EZ
32This function returns @code{t} if @var{object} represents an Emacs
33subprocess, @code{nil} otherwise.
b8d4c8d0
GM
34@end defun
35
23dd4ecd
EZ
36 In addition to subprocesses of the current Emacs session, you can
37also access other processes running on your machine. @xref{System
38Processes}.
39
b8d4c8d0
GM
40@menu
41* Subprocess Creation:: Functions that start subprocesses.
42* Shell Arguments:: Quoting an argument to pass it to a shell.
43* Synchronous Processes:: Details of using synchronous subprocesses.
44* Asynchronous Processes:: Starting up an asynchronous subprocess.
45* Deleting Processes:: Eliminating an asynchronous subprocess.
46* Process Information:: Accessing run-status and other attributes.
47* Input to Processes:: Sending input to an asynchronous subprocess.
48* Signals to Processes:: Stopping, continuing or interrupting
49 an asynchronous subprocess.
50* Output from Processes:: Collecting output from an asynchronous subprocess.
51* Sentinels:: Sentinels run when process run-status changes.
52* Query Before Exit:: Whether to query if exiting will kill a process.
23dd4ecd 53* System Processes:: Accessing other processes running on your system.
d24880de 54* Transaction Queues:: Transaction-based communication with subprocesses.
b8d4c8d0
GM
55* Network:: Opening network connections.
56* Network Servers:: Network servers let Emacs accept net connections.
57* Datagrams:: UDP network connections.
58* Low-Level Network:: Lower-level but more general function
59 to create connections and servers.
d24880de 60* Misc Network:: Additional relevant functions for net connections.
c73e02fa 61* Serial Ports:: Communicating with serial ports.
b8d4c8d0
GM
62* Byte Packing:: Using bindat to pack and unpack binary data.
63@end menu
64
65@node Subprocess Creation
66@section Functions that Create Subprocesses
67
583d8b3c 68 There are three primitives that create a new subprocess in which to run
b8d4c8d0
GM
69a program. One of them, @code{start-process}, creates an asynchronous
70process and returns a process object (@pxref{Asynchronous Processes}).
71The other two, @code{call-process} and @code{call-process-region},
72create a synchronous process and do not return a process object
73(@pxref{Synchronous Processes}).
74
75 Synchronous and asynchronous processes are explained in the following
76sections. Since the three functions are all called in a similar
77fashion, their common arguments are described here.
78
79@cindex execute program
80@cindex @code{PATH} environment variable
81@cindex @code{HOME} environment variable
82 In all cases, the function's @var{program} argument specifies the
83program to be run. An error is signaled if the file is not found or
84cannot be executed. If the file name is relative, the variable
85@code{exec-path} contains a list of directories to search. Emacs
86initializes @code{exec-path} when it starts up, based on the value of
87the environment variable @code{PATH}. The standard file name
88constructs, @samp{~}, @samp{.}, and @samp{..}, are interpreted as
89usual in @code{exec-path}, but environment variable substitutions
90(@samp{$HOME}, etc.) are not recognized; use
91@code{substitute-in-file-name} to perform them (@pxref{File Name
92Expansion}). @code{nil} in this list refers to
93@code{default-directory}.
94
95 Executing a program can also try adding suffixes to the specified
96name:
97
98@defvar exec-suffixes
99This variable is a list of suffixes (strings) to try adding to the
100specified program file name. The list should include @code{""} if you
101want the name to be tried exactly as specified. The default value is
102system-dependent.
103@end defvar
104
105 @strong{Please note:} The argument @var{program} contains only the
106name of the program; it may not contain any command-line arguments. You
107must use @var{args} to provide those.
108
109 Each of the subprocess-creating functions has a @var{buffer-or-name}
110argument which specifies where the standard output from the program will
111go. It should be a buffer or a buffer name; if it is a buffer name,
112that will create the buffer if it does not already exist. It can also
113be @code{nil}, which says to discard the output unless a filter function
114handles it. (@xref{Filter Functions}, and @ref{Read and Print}.)
115Normally, you should avoid having multiple processes send output to the
116same buffer because their output would be intermixed randomly.
117
118@cindex program arguments
119 All three of the subprocess-creating functions have a @code{&rest}
120argument, @var{args}. The @var{args} must all be strings, and they are
121supplied to @var{program} as separate command line arguments. Wildcard
122characters and other shell constructs have no special meanings in these
123strings, since the strings are passed directly to the specified program.
124
125 The subprocess gets its current directory from the value of
126@code{default-directory} (@pxref{File Name Expansion}).
127
128@cindex environment variables, subprocesses
129 The subprocess inherits its environment from Emacs, but you can
130specify overrides for it with @code{process-environment}. @xref{System
131Environment}.
132
133@defvar exec-directory
134@pindex movemail
135The value of this variable is a string, the name of a directory that
136contains programs that come with GNU Emacs, programs intended for Emacs
137to invoke. The program @code{movemail} is an example of such a program;
138Rmail uses it to fetch new mail from an inbox.
139@end defvar
140
141@defopt exec-path
142The value of this variable is a list of directories to search for
143programs to run in subprocesses. Each element is either the name of a
144directory (i.e., a string), or @code{nil}, which stands for the default
145directory (which is the value of @code{default-directory}).
146@cindex program directories
147
148The value of @code{exec-path} is used by @code{call-process} and
149@code{start-process} when the @var{program} argument is not an absolute
150file name.
151@end defopt
152
153@node Shell Arguments
154@section Shell Arguments
155@cindex arguments for shell commands
156@cindex shell command arguments
157
158 Lisp programs sometimes need to run a shell and give it a command
159that contains file names that were specified by the user. These
160programs ought to be able to support any valid file name. But the shell
161gives special treatment to certain characters, and if these characters
162occur in the file name, they will confuse the shell. To handle these
163characters, use the function @code{shell-quote-argument}:
164
165@defun shell-quote-argument argument
166This function returns a string which represents, in shell syntax,
167an argument whose actual contents are @var{argument}. It should
168work reliably to concatenate the return value into a shell command
169and then pass it to a shell for execution.
170
171Precisely what this function does depends on your operating system. The
172function is designed to work with the syntax of your system's standard
173shell; if you use an unusual shell, you will need to redefine this
174function.
175
176@example
177;; @r{This example shows the behavior on GNU and Unix systems.}
178(shell-quote-argument "foo > bar")
179 @result{} "foo\\ \\>\\ bar"
180
181;; @r{This example shows the behavior on MS-DOS and MS-Windows.}
182(shell-quote-argument "foo > bar")
183 @result{} "\"foo > bar\""
184@end example
185
186Here's an example of using @code{shell-quote-argument} to construct
187a shell command:
188
189@example
190(concat "diff -c "
191 (shell-quote-argument oldfile)
192 " "
193 (shell-quote-argument newfile))
194@end example
195@end defun
196
3c73e30e
EZ
197@cindex quoting and unquoting command-line arguments
198@cindex minibuffer input, and command-line arguments
199@cindex @code{call-process}, command-line arguments from minibuffer
200@cindex @code{start-process}, command-line arguments from minibuffer
4bb49a92
EZ
201 The following two functions are useful for combining a list of
202individual command-line argument strings into a single string, and
203taking a string apart into a list of individual command-line
204arguments. These functions are mainly intended to be used for
205converting user input in the minibuffer, a Lisp string, into a list of
206string arguments to be passed to @code{call-process} or
3c73e30e
EZ
207@code{start-process}, or for the converting such lists of arguments in
208a single Lisp string to be presented in the minibuffer or echo area.
a873ee3d
EZ
209
210@defun split-string-and-unquote string &optional separators
211This function splits @var{string} into substrings at matches for the
212regular expression @var{separators}, like @code{split-string} does
0999039c
CY
213(@pxref{Creating Strings}); in addition, it removes quoting from the
214substrings. It then makes a list of the substrings and returns it.
a873ee3d 215
4185820c
CY
216If @var{separators} is omitted or @code{nil}, it defaults to
217@code{"\\s-+"}, which is a regular expression that matches one or more
218characters with whitespace syntax (@pxref{Syntax Class Table}).
a873ee3d 219
3c73e30e 220This function supports two types of quoting: enclosing a whole string
0999039c
CY
221in double quotes @code{"@dots{}"}, and quoting individual characters
222with a backslash escape @samp{\}. The latter is also used in Lisp
223strings, so this function can handle those as well.
a873ee3d
EZ
224@end defun
225
226@defun combine-and-quote-strings list-of-strings &optional separator
227This function concatenates @var{list-of-strings} into a single string,
0999039c
CY
228quoting each string as necessary. It also sticks the @var{separator}
229string between each pair of strings; if @var{separator} is omitted or
230@code{nil}, it defaults to @code{" "}. The return value is the
231resulting string.
a873ee3d
EZ
232
233The strings in @var{list-of-strings} that need quoting are those that
234include @var{separator} as their substring. Quoting a string encloses
235it in double quotes @code{"@dots{}"}. In the simplest case, if you
4bb49a92
EZ
236are consing a command from the individual command-line arguments,
237every argument that includes embedded blanks will be quoted.
a873ee3d
EZ
238@end defun
239
b8d4c8d0
GM
240@node Synchronous Processes
241@section Creating a Synchronous Process
242@cindex synchronous subprocess
243
244 After a @dfn{synchronous process} is created, Emacs waits for the
245process to terminate before continuing. Starting Dired on GNU or
246Unix@footnote{On other systems, Emacs uses a Lisp emulation of
247@code{ls}; see @ref{Contents of Directories}.} is an example of this: it
248runs @code{ls} in a synchronous process, then modifies the output
249slightly. Because the process is synchronous, the entire directory
250listing arrives in the buffer before Emacs tries to do anything with it.
251
252 While Emacs waits for the synchronous subprocess to terminate, the
253user can quit by typing @kbd{C-g}. The first @kbd{C-g} tries to kill
254the subprocess with a @code{SIGINT} signal; but it waits until the
255subprocess actually terminates before quitting. If during that time the
256user types another @kbd{C-g}, that kills the subprocess instantly with
257@code{SIGKILL} and quits immediately (except on MS-DOS, where killing
258other processes doesn't work). @xref{Quitting}.
259
260 The synchronous subprocess functions return an indication of how the
261process terminated.
262
263 The output from a synchronous subprocess is generally decoded using a
264coding system, much like text read from a file. The input sent to a
265subprocess by @code{call-process-region} is encoded using a coding
266system, much like text written into a file. @xref{Coding Systems}.
267
268@defun call-process program &optional infile destination display &rest args
b59a4335 269This function calls @var{program} and waits for it to finish.
b8d4c8d0 270
b59a4335 271The standard input for the new process comes from file @var{infile} if
b8d4c8d0
GM
272@var{infile} is not @code{nil}, and from the null device otherwise.
273The argument @var{destination} says where to put the process output.
274Here are the possibilities:
275
276@table @asis
277@item a buffer
278Insert the output in that buffer, before point. This includes both the
279standard output stream and the standard error stream of the process.
280
281@item a string
282Insert the output in a buffer with that name, before point.
283
284@item @code{t}
285Insert the output in the current buffer, before point.
286
287@item @code{nil}
288Discard the output.
289
290@item 0
291Discard the output, and return @code{nil} immediately without waiting
292for the subprocess to finish.
293
294In this case, the process is not truly synchronous, since it can run in
295parallel with Emacs; but you can think of it as synchronous in that
296Emacs is essentially finished with the subprocess as soon as this
297function returns.
298
299MS-DOS doesn't support asynchronous subprocesses, so this option doesn't
300work there.
301
1ef14cb4
LMI
302@item @code{(:file @var{file-name})}
303Send the output to the file name specified.
304
b8d4c8d0
GM
305@item @code{(@var{real-destination} @var{error-destination})}
306Keep the standard output stream separate from the standard error stream;
307deal with the ordinary output as specified by @var{real-destination},
308and dispose of the error output according to @var{error-destination}.
309If @var{error-destination} is @code{nil}, that means to discard the
310error output, @code{t} means mix it with the ordinary output, and a
311string specifies a file name to redirect error output into.
312
313You can't directly specify a buffer to put the error output in; that is
314too difficult to implement. But you can achieve this result by sending
315the error output to a temporary file and then inserting the file into a
316buffer.
317@end table
318
319If @var{display} is non-@code{nil}, then @code{call-process} redisplays
320the buffer as output is inserted. (However, if the coding system chosen
321for decoding output is @code{undecided}, meaning deduce the encoding
322from the actual data, then redisplay sometimes cannot continue once
323non-@acronym{ASCII} characters are encountered. There are fundamental
324reasons why it is hard to fix this; see @ref{Output from Processes}.)
325
326Otherwise the function @code{call-process} does no redisplay, and the
327results become visible on the screen only when Emacs redisplays that
328buffer in the normal course of events.
329
330The remaining arguments, @var{args}, are strings that specify command
331line arguments for the program.
332
333The value returned by @code{call-process} (unless you told it not to
334wait) indicates the reason for process termination. A number gives the
335exit status of the subprocess; 0 means success, and any other value
336means failure. If the process terminated with a signal,
337@code{call-process} returns a string describing the signal.
338
339In the examples below, the buffer @samp{foo} is current.
340
341@smallexample
342@group
343(call-process "pwd" nil t)
344 @result{} 0
345
346---------- Buffer: foo ----------
347/usr/user/lewis/manual
348---------- Buffer: foo ----------
349@end group
350
351@group
352(call-process "grep" nil "bar" nil "lewis" "/etc/passwd")
353 @result{} 0
354
355---------- Buffer: bar ----------
356lewis:5LTsHm66CSWKg:398:21:Bil Lewis:/user/lewis:/bin/csh
357
358---------- Buffer: bar ----------
359@end group
360@end smallexample
361
362Here is a good example of the use of @code{call-process}, which used to
363be found in the definition of @code{insert-directory}:
364
365@smallexample
366@group
367(call-process insert-directory-program nil t nil @var{switches}
368 (if full-directory-p
369 (concat (file-name-as-directory file) ".")
370 file))
371@end group
372@end smallexample
373@end defun
374
375@defun process-file program &optional infile buffer display &rest args
376This function processes files synchronously in a separate process. It
377is similar to @code{call-process} but may invoke a file handler based
378on the value of the variable @code{default-directory}. The current
379working directory of the subprocess is @code{default-directory}.
380
381The arguments are handled in almost the same way as for
382@code{call-process}, with the following differences:
383
384Some file handlers may not support all combinations and forms of the
385arguments @var{infile}, @var{buffer}, and @var{display}. For example,
386some file handlers might behave as if @var{display} were @code{nil},
387regardless of the value actually passed. As another example, some
388file handlers might not support separating standard output and error
389output by way of the @var{buffer} argument.
390
391If a file handler is invoked, it determines the program to run based
392on the first argument @var{program}. For instance, consider that a
393handler for remote files is invoked. Then the path that is used for
394searching the program might be different than @code{exec-path}.
395
396The second argument @var{infile} may invoke a file handler. The file
397handler could be different from the handler chosen for the
398@code{process-file} function itself. (For example,
399@code{default-directory} could be on a remote host, whereas
400@var{infile} is on another remote host. Or @code{default-directory}
401could be non-special, whereas @var{infile} is on a remote host.)
402
403If @var{buffer} is a list of the form @code{(@var{real-destination}
404@var{error-destination})}, and @var{error-destination} names a file,
405then the same remarks as for @var{infile} apply.
406
407The remaining arguments (@var{args}) will be passed to the process
408verbatim. Emacs is not involved in processing file names that are
409present in @var{args}. To avoid confusion, it may be best to avoid
410absolute file names in @var{args}, but rather to specify all file
411names as relative to @code{default-directory}. The function
412@code{file-relative-name} is useful for constructing such relative
413file names.
414@end defun
415
3691a0a6
MA
416@defvar process-file-side-effects
417This variable indicates, whether a call of @code{process-file} changes
418remote files.
419
420Per default, this variable is always set to @code{t}, meaning that a
421call of @code{process-file} could potentially change any file on a
422remote host. When set to @code{nil}, a file handler could optimize
423its behaviour with respect to remote file attributes caching.
424
425This variable should never be changed by @code{setq}. Instead of, it
426shall be set only by let-binding.
427@end defvar
428
b8d4c8d0
GM
429@defun call-process-region start end program &optional delete destination display &rest args
430This function sends the text from @var{start} to @var{end} as
431standard input to a process running @var{program}. It deletes the text
432sent if @var{delete} is non-@code{nil}; this is useful when
433@var{destination} is @code{t}, to insert the output in the current
434buffer in place of the input.
435
436The arguments @var{destination} and @var{display} control what to do
437with the output from the subprocess, and whether to update the display
438as it comes in. For details, see the description of
439@code{call-process}, above. If @var{destination} is the integer 0,
440@code{call-process-region} discards the output and returns @code{nil}
441immediately, without waiting for the subprocess to finish (this only
442works if asynchronous subprocesses are supported).
443
444The remaining arguments, @var{args}, are strings that specify command
445line arguments for the program.
446
447The return value of @code{call-process-region} is just like that of
448@code{call-process}: @code{nil} if you told it to return without
449waiting; otherwise, a number or string which indicates how the
450subprocess terminated.
451
452In the following example, we use @code{call-process-region} to run the
453@code{cat} utility, with standard input being the first five characters
454in buffer @samp{foo} (the word @samp{input}). @code{cat} copies its
455standard input into its standard output. Since the argument
456@var{destination} is @code{t}, this output is inserted in the current
457buffer.
458
459@smallexample
460@group
461---------- Buffer: foo ----------
462input@point{}
463---------- Buffer: foo ----------
464@end group
465
466@group
467(call-process-region 1 6 "cat" nil t)
468 @result{} 0
469
470---------- Buffer: foo ----------
471inputinput@point{}
472---------- Buffer: foo ----------
473@end group
474@end smallexample
475
476 The @code{shell-command-on-region} command uses
477@code{call-process-region} like this:
478
479@smallexample
480@group
481(call-process-region
482 start end
483 shell-file-name ; @r{Name of program.}
484 nil ; @r{Do not delete region.}
485 buffer ; @r{Send output to @code{buffer}.}
486 nil ; @r{No redisplay during output.}
487 "-c" command) ; @r{Arguments for the shell.}
488@end group
489@end smallexample
490@end defun
491
492@defun call-process-shell-command command &optional infile destination display &rest args
b59a4335
CY
493This function executes the shell command @var{command} synchronously.
494The final arguments @var{args} are additional arguments to add at the
495end of @var{command}. The other arguments are handled as in
496@code{call-process}.
b8d4c8d0
GM
497@end defun
498
499@defun process-file-shell-command command &optional infile destination display &rest args
500This function is like @code{call-process-shell-command}, but uses
501@code{process-file} internally. Depending on @code{default-directory},
502@var{command} can be executed also on remote hosts.
503@end defun
504
505@defun shell-command-to-string command
506This function executes @var{command} (a string) as a shell command,
507then returns the command's output as a string.
508@end defun
509
583d8b3c 510@defun process-lines program &rest args
b59a4335
CY
511This function runs @var{program}, waits for it to finish, and returns
512its output as a list of strings. Each string in the list holds a
513single line of text output by the program; the end-of-line characters
514are stripped from each line. The arguments beyond @var{program},
515@var{args}, are strings that specify command-line arguments with which
516to run the program.
583d8b3c
EZ
517
518If @var{program} exits with a non-zero exit status, this function
519signals an error.
520
521This function works by calling @code{call-process}, so program output
522is decoded in the same way as for @code{call-process}.
523@end defun
524
b8d4c8d0
GM
525@node Asynchronous Processes
526@section Creating an Asynchronous Process
527@cindex asynchronous subprocess
528
529 After an @dfn{asynchronous process} is created, Emacs and the subprocess
530both continue running immediately. The process thereafter runs
531in parallel with Emacs, and the two can communicate with each other
532using the functions described in the following sections. However,
533communication is only partially asynchronous: Emacs sends data to the
534process only when certain functions are called, and Emacs accepts data
535from the process only when Emacs is waiting for input or for a time
536delay.
537
538 Here we describe how to create an asynchronous process.
539
540@defun start-process name buffer-or-name program &rest args
541This function creates a new asynchronous subprocess and starts the
542program @var{program} running in it. It returns a process object that
543stands for the new subprocess in Lisp. The argument @var{name}
544specifies the name for the process object; if a process with this name
545already exists, then @var{name} is modified (by appending @samp{<1>},
546etc.) to be unique. The buffer @var{buffer-or-name} is the buffer to
547associate with the process.
548
549The remaining arguments, @var{args}, are strings that specify command
550line arguments for the program.
551
552In the example below, the first process is started and runs (rather,
553sleeps) for 100 seconds. Meanwhile, the second process is started, and
554given the name @samp{my-process<1>} for the sake of uniqueness. It
555inserts the directory listing at the end of the buffer @samp{foo},
556before the first process finishes. Then it finishes, and a message to
557that effect is inserted in the buffer. Much later, the first process
558finishes, and another message is inserted in the buffer for it.
559
560@smallexample
561@group
562(start-process "my-process" "foo" "sleep" "100")
563 @result{} #<process my-process>
564@end group
565
566@group
567(start-process "my-process" "foo" "ls" "-l" "/user/lewis/bin")
568 @result{} #<process my-process<1>>
569
570---------- Buffer: foo ----------
571total 2
572lrwxrwxrwx 1 lewis 14 Jul 22 10:12 gnuemacs --> /emacs
573-rwxrwxrwx 1 lewis 19 Jul 30 21:02 lemon
574
575Process my-process<1> finished
576
577Process my-process finished
578---------- Buffer: foo ----------
579@end group
580@end smallexample
581@end defun
582
583@defun start-file-process name buffer-or-name program &rest args
584Like @code{start-process}, this function starts a new asynchronous
585subprocess running @var{program} in it, and returns its process
586object---when @code{default-directory} is not a magic file name.
587
588If @code{default-directory} is magic, the function invokes its file
589handler instead. This handler ought to run @var{program}, perhaps on
590the local host, perhaps on a remote host that corresponds to
591@code{default-directory}. In the latter case, the local part of
592@code{default-directory} becomes the working directory of the process.
593
594This function does not try to invoke file name handlers for
595@var{program} or for the @var{program-args}.
596
597Depending on the implementation of the file handler, it might not be
598possible to apply @code{process-filter} or @code{process-sentinel} to
599the resulting process object (@pxref{Filter Functions}, @pxref{Sentinels}).
600
601Some file handlers may not support @code{start-file-process} (for
602example @code{ange-ftp-hook-function}). In such cases, the function
603does nothing and returns @code{nil}.
604@end defun
605
03a74b84 606@defun start-process-shell-command name buffer-or-name command
b8d4c8d0
GM
607This function is like @code{start-process} except that it uses a shell
608to execute the specified command. The argument @var{command} is a shell
03a74b84 609command name. The variable @code{shell-file-name} specifies which shell to
b8d4c8d0
GM
610use.
611
612The point of running a program through the shell, rather than directly
613with @code{start-process}, is so that you can employ shell features such
614as wildcards in the arguments. It follows that if you include an
615arbitrary user-specified arguments in the command, you should quote it
616with @code{shell-quote-argument} first, so that any special shell
617characters do @emph{not} have their special shell meanings. @xref{Shell
618Arguments}.
619@end defun
620
03a74b84 621@defun start-file-process-shell-command name buffer-or-name command
b8d4c8d0
GM
622This function is like @code{start-process-shell-command}, but uses
623@code{start-file-process} internally. By this, @var{command} can be
624executed also on remote hosts, depending on @code{default-directory}.
625@end defun
626
627@defvar process-connection-type
628@cindex pipes
629@cindex @acronym{PTY}s
630This variable controls the type of device used to communicate with
631asynchronous subprocesses. If it is non-@code{nil}, then @acronym{PTY}s are
632used, when available. Otherwise, pipes are used.
633
634@acronym{PTY}s are usually preferable for processes visible to the user, as
635in Shell mode, because they allow job control (@kbd{C-c}, @kbd{C-z},
636etc.) to work between the process and its children, whereas pipes do
637not. For subprocesses used for internal purposes by programs, it is
638often better to use a pipe, because they are more efficient. In
639addition, the total number of @acronym{PTY}s is limited on many systems and
640it is good not to waste them.
641
642The value of @code{process-connection-type} takes effect when
643@code{start-process} is called. So you can specify how to communicate
644with one subprocess by binding the variable around the call to
645@code{start-process}.
646
647@smallexample
648@group
649(let ((process-connection-type nil)) ; @r{Use a pipe.}
650 (start-process @dots{}))
651@end group
652@end smallexample
653
654To determine whether a given subprocess actually got a pipe or a
655@acronym{PTY}, use the function @code{process-tty-name} (@pxref{Process
656Information}).
657@end defvar
658
659@node Deleting Processes
660@section Deleting Processes
661@cindex deleting processes
662
663 @dfn{Deleting a process} disconnects Emacs immediately from the
664subprocess. Processes are deleted automatically after they terminate,
665but not necessarily right away. You can delete a process explicitly
666at any time. If you delete a terminated process explicitly before it
667is deleted automatically, no harm results. Deleting a running
668process sends a signal to terminate it (and its child processes if
669any), and calls the process sentinel if it has one. @xref{Sentinels}.
670
671 When a process is deleted, the process object itself continues to
672exist as long as other Lisp objects point to it. All the Lisp
673primitives that work on process objects accept deleted processes, but
674those that do I/O or send signals will report an error. The process
675mark continues to point to the same place as before, usually into a
676buffer where output from the process was being inserted.
677
678@defopt delete-exited-processes
679This variable controls automatic deletion of processes that have
680terminated (due to calling @code{exit} or to a signal). If it is
681@code{nil}, then they continue to exist until the user runs
682@code{list-processes}. Otherwise, they are deleted immediately after
683they exit.
684@end defopt
685
686@defun delete-process process
687This function deletes a process, killing it with a @code{SIGKILL}
688signal. The argument may be a process, the name of a process, a
689buffer, or the name of a buffer. (A buffer or buffer-name stands for
690the process that @code{get-buffer-process} returns.) Calling
691@code{delete-process} on a running process terminates it, updates the
692process status, and runs the sentinel (if any) immediately. If the
693process has already terminated, calling @code{delete-process} has no
694effect on its status, or on the running of its sentinel (which will
695happen sooner or later).
696
697@smallexample
698@group
699(delete-process "*shell*")
700 @result{} nil
701@end group
702@end smallexample
703@end defun
704
705@node Process Information
706@section Process Information
707
708 Several functions return information about processes.
709@code{list-processes} is provided for interactive use.
710
711@deffn Command list-processes &optional query-only
712This command displays a listing of all living processes. In addition,
713it finally deletes any process whose status was @samp{Exited} or
714@samp{Signaled}. It returns @code{nil}.
715
716If @var{query-only} is non-@code{nil} then it lists only processes
717whose query flag is non-@code{nil}. @xref{Query Before Exit}.
718@end deffn
719
720@defun process-list
721This function returns a list of all processes that have not been deleted.
722
723@smallexample
724@group
725(process-list)
726 @result{} (#<process display-time> #<process shell>)
727@end group
728@end smallexample
729@end defun
730
731@defun get-process name
732This function returns the process named @var{name}, or @code{nil} if
733there is none. An error is signaled if @var{name} is not a string.
734
735@smallexample
736@group
737(get-process "shell")
738 @result{} #<process shell>
739@end group
740@end smallexample
741@end defun
742
743@defun process-command process
744This function returns the command that was executed to start
745@var{process}. This is a list of strings, the first string being the
746program executed and the rest of the strings being the arguments that
747were given to the program.
748
749@smallexample
750@group
751(process-command (get-process "shell"))
752 @result{} ("/bin/csh" "-i")
753@end group
754@end smallexample
755@end defun
756
c73e02fa
GM
757@defun process-contact process &optional key
758
759This function returns information about how a network or serial
760process was set up. For a network process, when @var{key} is
761@code{nil}, it returns @code{(@var{hostname} @var{service})} which
762specifies what you connected to. For a serial process, when @var{key}
763is @code{nil}, it returns @code{(@var{port} @var{speed})}. For an
764ordinary child process, this function always returns @code{t}.
765
766If @var{key} is @code{t}, the value is the complete status information
767for the connection, server, or serial port; that is, the list of
768keywords and values specified in @code{make-network-process} or
769@code{make-serial-process}, except that some of the values represent
770the current status instead of what you specified.
771
772For a network process:
773
774@table @code
775@item :buffer
776The associated value is the process buffer.
777@item :filter
778The associated value is the process filter function.
779@item :sentinel
780The associated value is the process sentinel function.
781@item :remote
782In a connection, the address in internal format of the remote peer.
783@item :local
784The local address, in internal format.
785@item :service
786In a server, if you specified @code{t} for @var{service},
787this value is the actual port number.
788@end table
789
790@code{:local} and @code{:remote} are included even if they were not
791specified explicitly in @code{make-network-process}.
792
793For a serial process, see @code{make-serial-process} and
794@code{serial-process-configure} for a list of keys.
795
796If @var{key} is a keyword, the function returns the value corresponding
797to that keyword.
798@end defun
799
b8d4c8d0
GM
800@defun process-id process
801This function returns the @acronym{PID} of @var{process}. This is an
802integer that distinguishes the process @var{process} from all other
803processes running on the same computer at the current time. The
804@acronym{PID} of a process is chosen by the operating system kernel when the
805process is started and remains constant as long as the process exists.
806@end defun
807
808@defun process-name process
809This function returns the name of @var{process}.
810@end defun
811
812@defun process-status process-name
813This function returns the status of @var{process-name} as a symbol.
170ddd97
CY
814The argument @var{process-name} must be a process, a buffer, or a
815process name (a string).
b8d4c8d0
GM
816
817The possible values for an actual subprocess are:
818
819@table @code
820@item run
821for a process that is running.
822@item stop
823for a process that is stopped but continuable.
824@item exit
825for a process that has exited.
826@item signal
827for a process that has received a fatal signal.
828@item open
829for a network connection that is open.
830@item closed
831for a network connection that is closed. Once a connection
832is closed, you cannot reopen it, though you might be able to open
833a new connection to the same place.
834@item connect
835for a non-blocking connection that is waiting to complete.
836@item failed
837for a non-blocking connection that has failed to complete.
838@item listen
839for a network server that is listening.
840@item nil
841if @var{process-name} is not the name of an existing process.
842@end table
843
844@smallexample
845@group
b8d4c8d0
GM
846(process-status (get-buffer "*shell*"))
847 @result{} run
848@end group
849@group
850x
851 @result{} #<process xx<1>>
852(process-status x)
853 @result{} exit
854@end group
855@end smallexample
856
857For a network connection, @code{process-status} returns one of the symbols
858@code{open} or @code{closed}. The latter means that the other side
859closed the connection, or Emacs did @code{delete-process}.
860@end defun
861
c73e02fa
GM
862@defun process-type process
863This function returns the symbol @code{network} for a network
864connection or server, @code{serial} for a serial port connection, or
865@code{real} for a real subprocess.
866@end defun
867
b8d4c8d0
GM
868@defun process-exit-status process
869This function returns the exit status of @var{process} or the signal
870number that killed it. (Use the result of @code{process-status} to
871determine which of those it is.) If @var{process} has not yet
872terminated, the value is 0.
873@end defun
874
875@defun process-tty-name process
876This function returns the terminal name that @var{process} is using for
877its communication with Emacs---or @code{nil} if it is using pipes
878instead of a terminal (see @code{process-connection-type} in
bace45fe
MA
879@ref{Asynchronous Processes}). If @var{process} represents a program
880running on a remote host, the terminal name used by that program on
881the remote host is provided as process property @code{remote-tty}.
b8d4c8d0
GM
882@end defun
883
884@defun process-coding-system process
885@anchor{Coding systems for a subprocess}
886This function returns a cons cell describing the coding systems in use
887for decoding output from @var{process} and for encoding input to
888@var{process} (@pxref{Coding Systems}). The value has this form:
889
890@example
891(@var{coding-system-for-decoding} . @var{coding-system-for-encoding})
892@end example
893@end defun
894
895@defun set-process-coding-system process &optional decoding-system encoding-system
896This function specifies the coding systems to use for subsequent output
897from and input to @var{process}. It will use @var{decoding-system} to
898decode subprocess output, and @var{encoding-system} to encode subprocess
899input.
900@end defun
901
902 Every process also has a property list that you can use to store
903miscellaneous values associated with the process.
904
905@defun process-get process propname
906This function returns the value of the @var{propname} property
907of @var{process}.
908@end defun
909
910@defun process-put process propname value
911This function sets the value of the @var{propname} property
912of @var{process} to @var{value}.
913@end defun
914
915@defun process-plist process
916This function returns the process plist of @var{process}.
917@end defun
918
919@defun set-process-plist process plist
920This function sets the process plist of @var{process} to @var{plist}.
921@end defun
922
923@node Input to Processes
924@section Sending Input to Processes
925@cindex process input
926
927 Asynchronous subprocesses receive input when it is sent to them by
928Emacs, which is done with the functions in this section. You must
929specify the process to send input to, and the input data to send. The
930data appears on the ``standard input'' of the subprocess.
931
932 Some operating systems have limited space for buffered input in a
933@acronym{PTY}. On these systems, Emacs sends an @acronym{EOF}
934periodically amidst the other characters, to force them through. For
935most programs, these @acronym{EOF}s do no harm.
936
937 Subprocess input is normally encoded using a coding system before the
938subprocess receives it, much like text written into a file. You can use
939@code{set-process-coding-system} to specify which coding system to use
940(@pxref{Process Information}). Otherwise, the coding system comes from
941@code{coding-system-for-write}, if that is non-@code{nil}; or else from
942the defaulting mechanism (@pxref{Default Coding Systems}).
943
944 Sometimes the system is unable to accept input for that process,
945because the input buffer is full. When this happens, the send functions
946wait a short while, accepting output from subprocesses, and then try
947again. This gives the subprocess a chance to read more of its pending
948input and make space in the buffer. It also allows filters, sentinels
949and timers to run---so take account of that in writing your code.
950
951 In these functions, the @var{process} argument can be a process or
952the name of a process, or a buffer or buffer name (which stands
953for a process via @code{get-buffer-process}). @code{nil} means
954the current buffer's process.
955
956@defun process-send-string process string
957This function sends @var{process} the contents of @var{string} as
958standard input. If it is @code{nil}, the current buffer's process is used.
959
960 The function returns @code{nil}.
961
962@smallexample
963@group
964(process-send-string "shell<1>" "ls\n")
965 @result{} nil
966@end group
967
968
969@group
970---------- Buffer: *shell* ----------
971...
972introduction.texi syntax-tables.texi~
973introduction.texi~ text.texi
974introduction.txt text.texi~
975...
976---------- Buffer: *shell* ----------
977@end group
978@end smallexample
979@end defun
980
981@defun process-send-region process start end
982This function sends the text in the region defined by @var{start} and
983@var{end} as standard input to @var{process}.
984
985An error is signaled unless both @var{start} and @var{end} are
986integers or markers that indicate positions in the current buffer. (It
987is unimportant which number is larger.)
988@end defun
989
990@defun process-send-eof &optional process
991This function makes @var{process} see an end-of-file in its
992input. The @acronym{EOF} comes after any text already sent to it.
993
994The function returns @var{process}.
995
996@smallexample
997@group
998(process-send-eof "shell")
999 @result{} "shell"
1000@end group
1001@end smallexample
1002@end defun
1003
106e6894
CY
1004@defun process-running-child-p &optional process
1005This function will tell you whether a @var{process} has given control of
b8d4c8d0
GM
1006its terminal to its own child process. The value is @code{t} if this is
1007true, or if Emacs cannot tell; it is @code{nil} if Emacs can be certain
1008that this is not so.
1009@end defun
1010
1011@node Signals to Processes
1012@section Sending Signals to Processes
1013@cindex process signals
1014@cindex sending signals
1015@cindex signals
1016
1017 @dfn{Sending a signal} to a subprocess is a way of interrupting its
1018activities. There are several different signals, each with its own
1019meaning. The set of signals and their names is defined by the operating
1020system. For example, the signal @code{SIGINT} means that the user has
1021typed @kbd{C-c}, or that some analogous thing has happened.
1022
1023 Each signal has a standard effect on the subprocess. Most signals
1024kill the subprocess, but some stop or resume execution instead. Most
1025signals can optionally be handled by programs; if the program handles
1026the signal, then we can say nothing in general about its effects.
1027
1028 You can send signals explicitly by calling the functions in this
1029section. Emacs also sends signals automatically at certain times:
1030killing a buffer sends a @code{SIGHUP} signal to all its associated
1031processes; killing Emacs sends a @code{SIGHUP} signal to all remaining
1032processes. (@code{SIGHUP} is a signal that usually indicates that the
1033user hung up the phone.)
1034
1035 Each of the signal-sending functions takes two optional arguments:
1036@var{process} and @var{current-group}.
1037
1038 The argument @var{process} must be either a process, a process
1039name, a buffer, a buffer name, or @code{nil}. A buffer or buffer name
1040stands for a process through @code{get-buffer-process}. @code{nil}
1041stands for the process associated with the current buffer. An error
1042is signaled if @var{process} does not identify a process.
1043
1044 The argument @var{current-group} is a flag that makes a difference
1045when you are running a job-control shell as an Emacs subprocess. If it
1046is non-@code{nil}, then the signal is sent to the current process-group
1047of the terminal that Emacs uses to communicate with the subprocess. If
1048the process is a job-control shell, this means the shell's current
1049subjob. If it is @code{nil}, the signal is sent to the process group of
1050the immediate subprocess of Emacs. If the subprocess is a job-control
1051shell, this is the shell itself.
1052
1053 The flag @var{current-group} has no effect when a pipe is used to
1054communicate with the subprocess, because the operating system does not
1055support the distinction in the case of pipes. For the same reason,
1056job-control shells won't work when a pipe is used. See
1057@code{process-connection-type} in @ref{Asynchronous Processes}.
1058
1059@defun interrupt-process &optional process current-group
1060This function interrupts the process @var{process} by sending the
1061signal @code{SIGINT}. Outside of Emacs, typing the ``interrupt
1062character'' (normally @kbd{C-c} on some systems, and @code{DEL} on
1063others) sends this signal. When the argument @var{current-group} is
1064non-@code{nil}, you can think of this function as ``typing @kbd{C-c}''
1065on the terminal by which Emacs talks to the subprocess.
1066@end defun
1067
1068@defun kill-process &optional process current-group
1069This function kills the process @var{process} by sending the
1070signal @code{SIGKILL}. This signal kills the subprocess immediately,
1071and cannot be handled by the subprocess.
1072@end defun
1073
1074@defun quit-process &optional process current-group
1075This function sends the signal @code{SIGQUIT} to the process
1076@var{process}. This signal is the one sent by the ``quit
1077character'' (usually @kbd{C-b} or @kbd{C-\}) when you are not inside
1078Emacs.
1079@end defun
1080
1081@defun stop-process &optional process current-group
1082This function stops the process @var{process} by sending the
1083signal @code{SIGTSTP}. Use @code{continue-process} to resume its
1084execution.
1085
1086Outside of Emacs, on systems with job control, the ``stop character''
1087(usually @kbd{C-z}) normally sends this signal. When
1088@var{current-group} is non-@code{nil}, you can think of this function as
1089``typing @kbd{C-z}'' on the terminal Emacs uses to communicate with the
1090subprocess.
1091@end defun
1092
1093@defun continue-process &optional process current-group
1094This function resumes execution of the process @var{process} by sending
1095it the signal @code{SIGCONT}. This presumes that @var{process} was
1096stopped previously.
1097@end defun
1098
b8d4c8d0
GM
1099@defun signal-process process signal
1100This function sends a signal to process @var{process}. The argument
1101@var{signal} specifies which signal to send; it should be an integer.
1102
1103The @var{process} argument can be a system process @acronym{ID}; that
1104allows you to send signals to processes that are not children of
23dd4ecd 1105Emacs. @xref{System Processes}.
b8d4c8d0
GM
1106@end defun
1107
1108@node Output from Processes
1109@section Receiving Output from Processes
1110@cindex process output
1111@cindex output from processes
1112
1113 There are two ways to receive the output that a subprocess writes to
1114its standard output stream. The output can be inserted in a buffer,
1115which is called the associated buffer of the process, or a function
1116called the @dfn{filter function} can be called to act on the output. If
1117the process has no buffer and no filter function, its output is
1118discarded.
1119
1120 When a subprocess terminates, Emacs reads any pending output,
1121then stops reading output from that subprocess. Therefore, if the
1122subprocess has children that are still live and still producing
1123output, Emacs won't receive that output.
1124
1125 Output from a subprocess can arrive only while Emacs is waiting: when
1126reading terminal input, in @code{sit-for} and @code{sleep-for}
1127(@pxref{Waiting}), and in @code{accept-process-output} (@pxref{Accepting
1128Output}). This minimizes the problem of timing errors that usually
1129plague parallel programming. For example, you can safely create a
1130process and only then specify its buffer or filter function; no output
1131can arrive before you finish, if the code in between does not call any
1132primitive that waits.
1133
1134@defvar process-adaptive-read-buffering
1135On some systems, when Emacs reads the output from a subprocess, the
1136output data is read in very small blocks, potentially resulting in
1137very poor performance. This behavior can be remedied to some extent
1138by setting the variable @var{process-adaptive-read-buffering} to a
1139non-@code{nil} value (the default), as it will automatically delay reading
1140from such processes, thus allowing them to produce more output before
1141Emacs tries to read it.
1142@end defvar
1143
1144 It is impossible to separate the standard output and standard error
1145streams of the subprocess, because Emacs normally spawns the subprocess
1146inside a pseudo-TTY, and a pseudo-TTY has only one output channel. If
1147you want to keep the output to those streams separate, you should
1148redirect one of them to a file---for example, by using an appropriate
1149shell command.
1150
1151@menu
1152* Process Buffers:: If no filter, output is put in a buffer.
1153* Filter Functions:: Filter functions accept output from the process.
1154* Decoding Output:: Filters can get unibyte or multibyte strings.
1155* Accepting Output:: How to wait until process output arrives.
1156@end menu
1157
1158@node Process Buffers
1159@subsection Process Buffers
1160
1161 A process can (and usually does) have an @dfn{associated buffer},
1162which is an ordinary Emacs buffer that is used for two purposes: storing
1163the output from the process, and deciding when to kill the process. You
1164can also use the buffer to identify a process to operate on, since in
1165normal practice only one process is associated with any given buffer.
1166Many applications of processes also use the buffer for editing input to
1167be sent to the process, but this is not built into Emacs Lisp.
1168
1169 Unless the process has a filter function (@pxref{Filter Functions}),
1170its output is inserted in the associated buffer. The position to insert
1171the output is determined by the @code{process-mark}, which is then
1172updated to point to the end of the text just inserted. Usually, but not
1173always, the @code{process-mark} is at the end of the buffer.
1174
16d1ff5f
CY
1175@findex process-kill-buffer-query-function
1176 Killing the associated buffer of a process also kills the process.
1177Emacs asks for confirmation first, if the process's
1178@code{process-query-on-exit-flag} is non-@code{nil} (@pxref{Query
1179Before Exit}). This confirmation is done by the function
1180@code{process-kill-buffer-query-function}, which is run from
1181@code{kill-buffer-query-functions} (@pxref{Killing Buffers}).
1182
b8d4c8d0
GM
1183@defun process-buffer process
1184This function returns the associated buffer of the process
1185@var{process}.
1186
1187@smallexample
1188@group
1189(process-buffer (get-process "shell"))
1190 @result{} #<buffer *shell*>
1191@end group
1192@end smallexample
1193@end defun
1194
1195@defun process-mark process
1196This function returns the process marker for @var{process}, which is the
1197marker that says where to insert output from the process.
1198
1199If @var{process} does not have a buffer, @code{process-mark} returns a
1200marker that points nowhere.
1201
1202Insertion of process output in a buffer uses this marker to decide where
1203to insert, and updates it to point after the inserted text. That is why
1204successive batches of output are inserted consecutively.
1205
1206Filter functions normally should use this marker in the same fashion
1207as is done by direct insertion of output in the buffer. A good
1208example of a filter function that uses @code{process-mark} is found at
1209the end of the following section.
1210
1211When the user is expected to enter input in the process buffer for
1212transmission to the process, the process marker separates the new input
1213from previous output.
1214@end defun
1215
1216@defun set-process-buffer process buffer
1217This function sets the buffer associated with @var{process} to
1218@var{buffer}. If @var{buffer} is @code{nil}, the process becomes
1219associated with no buffer.
1220@end defun
1221
1222@defun get-buffer-process buffer-or-name
1223This function returns a nondeleted process associated with the buffer
1224specified by @var{buffer-or-name}. If there are several processes
1225associated with it, this function chooses one (currently, the one most
1226recently created, but don't count on that). Deletion of a process
1227(see @code{delete-process}) makes it ineligible for this function to
1228return.
1229
1230It is usually a bad idea to have more than one process associated with
1231the same buffer.
1232
1233@smallexample
1234@group
1235(get-buffer-process "*shell*")
1236 @result{} #<process shell>
1237@end group
1238@end smallexample
1239
1240Killing the process's buffer deletes the process, which kills the
1241subprocess with a @code{SIGHUP} signal (@pxref{Signals to Processes}).
1242@end defun
1243
1244@node Filter Functions
1245@subsection Process Filter Functions
1246@cindex filter function
1247@cindex process filter
1248
1249 A process @dfn{filter function} is a function that receives the
1250standard output from the associated process. If a process has a filter,
1251then @emph{all} output from that process is passed to the filter. The
1252process buffer is used directly for output from the process only when
1253there is no filter.
1254
1255 The filter function can only be called when Emacs is waiting for
1256something, because process output arrives only at such times. Emacs
1257waits when reading terminal input, in @code{sit-for} and
1258@code{sleep-for} (@pxref{Waiting}), and in @code{accept-process-output}
1259(@pxref{Accepting Output}).
1260
1261 A filter function must accept two arguments: the associated process
1262and a string, which is output just received from it. The function is
1263then free to do whatever it chooses with the output.
1264
1265 Quitting is normally inhibited within a filter function---otherwise,
1266the effect of typing @kbd{C-g} at command level or to quit a user
1267command would be unpredictable. If you want to permit quitting inside
1268a filter function, bind @code{inhibit-quit} to @code{nil}. In most
1269cases, the right way to do this is with the macro
1270@code{with-local-quit}. @xref{Quitting}.
1271
1272 If an error happens during execution of a filter function, it is
1273caught automatically, so that it doesn't stop the execution of whatever
1274program was running when the filter function was started. However, if
1275@code{debug-on-error} is non-@code{nil}, the error-catching is turned
1276off. This makes it possible to use the Lisp debugger to debug the
1277filter function. @xref{Debugger}.
1278
1279 Many filter functions sometimes or always insert the text in the
1280process's buffer, mimicking the actions of Emacs when there is no
1281filter. Such filter functions need to use @code{set-buffer} in order to
1282be sure to insert in that buffer. To avoid setting the current buffer
1283semipermanently, these filter functions must save and restore the
78e33835
CY
1284current buffer. They should also check whether the buffer is still
1285alive, update the process marker, and in some cases update the value
1286of point. Here is how to do these things:
b8d4c8d0
GM
1287
1288@smallexample
1289@group
1290(defun ordinary-insertion-filter (proc string)
78e33835
CY
1291 (when (buffer-live-p (process-buffer proc))
1292 (with-current-buffer (process-buffer proc)
1293 (let ((moving (= (point) (process-mark proc))))
b8d4c8d0
GM
1294@end group
1295@group
78e33835 1296 (save-excursion
1e5c1c80 1297 ;; @r{Insert the text, advancing the process marker.}
78e33835
CY
1298 (goto-char (process-mark proc))
1299 (insert string)
1300 (set-marker (process-mark proc) (point)))
1301 (if moving (goto-char (process-mark proc)))))))
b8d4c8d0
GM
1302@end group
1303@end smallexample
1304
1305@noindent
1306The reason to use @code{with-current-buffer}, rather than using
1307@code{save-excursion} to save and restore the current buffer, is so as
1308to preserve the change in point made by the second call to
1309@code{goto-char}.
1310
1311 To make the filter force the process buffer to be visible whenever new
1312text arrives, insert the following line just before the
1313@code{with-current-buffer} construct:
1314
1315@smallexample
1316(display-buffer (process-buffer proc))
1317@end smallexample
1318
1319 To force point to the end of the new output, no matter where it was
1320previously, eliminate the variable @code{moving} and call
1321@code{goto-char} unconditionally.
1322
1323 In earlier Emacs versions, every filter function that did regular
1324expression searching or matching had to explicitly save and restore the
1325match data. Now Emacs does this automatically for filter functions;
1326they never need to do it explicitly. @xref{Match Data}.
1327
b8d4c8d0
GM
1328 The output to the function may come in chunks of any size. A program
1329that produces the same output twice in a row may send it as one batch of
1330200 characters one time, and five batches of 40 characters the next. If
1331the filter looks for certain text strings in the subprocess output, make
1332sure to handle the case where one of these strings is split across two
fd211f0b
CY
1333or more batches of output; one way to do this is to insert the
1334received text into a temporary buffer, which can then be searched.
b8d4c8d0
GM
1335
1336@defun set-process-filter process filter
1337This function gives @var{process} the filter function @var{filter}. If
1338@var{filter} is @code{nil}, it gives the process no filter.
1339@end defun
1340
1341@defun process-filter process
1342This function returns the filter function of @var{process}, or @code{nil}
1343if it has none.
1344@end defun
1345
1346 Here is an example of use of a filter function:
1347
1348@smallexample
1349@group
1350(defun keep-output (process output)
1351 (setq kept (cons output kept)))
1352 @result{} keep-output
1353@end group
1354@group
1355(setq kept nil)
1356 @result{} nil
1357@end group
1358@group
1359(set-process-filter (get-process "shell") 'keep-output)
1360 @result{} keep-output
1361@end group
1362@group
1363(process-send-string "shell" "ls ~/other\n")
1364 @result{} nil
1365kept
1366 @result{} ("lewis@@slug[8] % "
1367@end group
1368@group
1369"FINAL-W87-SHORT.MSS backup.otl kolstad.mss~
1370address.txt backup.psf kolstad.psf
1371backup.bib~ david.mss resume-Dec-86.mss~
1372backup.err david.psf resume-Dec.psf
1373backup.mss dland syllabus.mss
1374"
1375"#backups.mss# backup.mss~ kolstad.mss
1376")
1377@end group
1378@end smallexample
1379
1380@ignore @c The code in this example doesn't show the right way to do things.
1381Here is another, more realistic example, which demonstrates how to use
1382the process mark to do insertion in the same fashion as is done when
1383there is no filter function:
1384
1385@smallexample
1386@group
1387;; @r{Insert input in the buffer specified by @code{my-shell-buffer}}
1388;; @r{and make sure that buffer is shown in some window.}
1389(defun my-process-filter (proc str)
1390 (let ((cur (selected-window))
1391 (pop-up-windows t))
1392 (pop-to-buffer my-shell-buffer)
1393@end group
1394@group
1395 (goto-char (point-max))
1396 (insert str)
1397 (set-marker (process-mark proc) (point-max))
1398 (select-window cur)))
1399@end group
1400@end smallexample
1401@end ignore
1402
1403@node Decoding Output
1404@subsection Decoding Process Output
1405@cindex decode process output
1406
1407 When Emacs writes process output directly into a multibyte buffer,
1408it decodes the output according to the process output coding system.
1409If the coding system is @code{raw-text} or @code{no-conversion}, Emacs
1410converts the unibyte output to multibyte using
1411@code{string-to-multibyte}, and inserts the resulting multibyte text.
1412
1413 You can use @code{set-process-coding-system} to specify which coding
1414system to use (@pxref{Process Information}). Otherwise, the coding
1415system comes from @code{coding-system-for-read}, if that is
1416non-@code{nil}; or else from the defaulting mechanism (@pxref{Default
3355f04d
EZ
1417Coding Systems}). If the text output by a process contains null
1418bytes, Emacs by default uses @code{no-conversion} for it; see
1419@ref{Lisp and Coding Systems, inhibit-null-byte-detection}, for how to
1420control this behavior.
b8d4c8d0
GM
1421
1422 @strong{Warning:} Coding systems such as @code{undecided} which
1423determine the coding system from the data do not work entirely
1424reliably with asynchronous subprocess output. This is because Emacs
1425has to process asynchronous subprocess output in batches, as it
1426arrives. Emacs must try to detect the proper coding system from one
1427batch at a time, and this does not always work. Therefore, if at all
1428possible, specify a coding system that determines both the character
1429code conversion and the end of line conversion---that is, one like
1430@code{latin-1-unix}, rather than @code{undecided} or @code{latin-1}.
1431
4972c361
SM
1432@c Let's keep the index entries that were there for
1433@c set-process-filter-multibyte and process-filter-multibyte-p,
b8d4c8d0
GM
1434@cindex filter multibyte flag, of process
1435@cindex process filter multibyte flag
1436 When Emacs calls a process filter function, it provides the process
1437output as a multibyte string or as a unibyte string according to the
4972c361
SM
1438process's filter coding system. Emacs
1439decodes the output according to the process output coding system,
1440which usually produces a multibyte string, except for coding systems
1441such as @code{binary} and @code{raw-text}
b8d4c8d0
GM
1442
1443@node Accepting Output
1444@subsection Accepting Output from Processes
1445@cindex accept input from processes
1446
1447 Output from asynchronous subprocesses normally arrives only while
1448Emacs is waiting for some sort of external event, such as elapsed time
1449or terminal input. Occasionally it is useful in a Lisp program to
1450explicitly permit output to arrive at a specific point, or even to wait
1451until output arrives from a process.
1452
1453@defun accept-process-output &optional process seconds millisec just-this-one
1454This function allows Emacs to read pending output from processes. The
1455output is inserted in the associated buffers or given to their filter
1456functions. If @var{process} is non-@code{nil} then this function does
1457not return until some output has been received from @var{process}.
1458
1459@c Emacs 19 feature
1460The arguments @var{seconds} and @var{millisec} let you specify timeout
1461periods. The former specifies a period measured in seconds and the
1462latter specifies one measured in milliseconds. The two time periods
1463thus specified are added together, and @code{accept-process-output}
1464returns after that much time, whether or not there has been any
1465subprocess output.
1466
1467The argument @var{millisec} is semi-obsolete nowadays because
1468@var{seconds} can be a floating point number to specify waiting a
1469fractional number of seconds. If @var{seconds} is 0, the function
1470accepts whatever output is pending but does not wait.
1471
1472@c Emacs 22.1 feature
1473If @var{process} is a process, and the argument @var{just-this-one} is
1474non-@code{nil}, only output from that process is handled, suspending output
1475from other processes until some output has been received from that
1476process or the timeout expires. If @var{just-this-one} is an integer,
1477also inhibit running timers. This feature is generally not
1478recommended, but may be necessary for specific applications, such as
1479speech synthesis.
1480
1481The function @code{accept-process-output} returns non-@code{nil} if it
1482did get some output, or @code{nil} if the timeout expired before output
1483arrived.
1484@end defun
1485
1486@node Sentinels
1487@section Sentinels: Detecting Process Status Changes
1488@cindex process sentinel
1489@cindex sentinel (of process)
1490
1491 A @dfn{process sentinel} is a function that is called whenever the
1492associated process changes status for any reason, including signals
1493(whether sent by Emacs or caused by the process's own actions) that
1494terminate, stop, or continue the process. The process sentinel is
1495also called if the process exits. The sentinel receives two
1496arguments: the process for which the event occurred, and a string
1497describing the type of event.
1498
1499 The string describing the event looks like one of the following:
1500
1501@itemize @bullet
1502@item
1503@code{"finished\n"}.
1504
1505@item
1506@code{"exited abnormally with code @var{exitcode}\n"}.
1507
1508@item
1509@code{"@var{name-of-signal}\n"}.
1510
1511@item
1512@code{"@var{name-of-signal} (core dumped)\n"}.
1513@end itemize
1514
1515 A sentinel runs only while Emacs is waiting (e.g., for terminal
1516input, or for time to elapse, or for process output). This avoids the
1517timing errors that could result from running them at random places in
1518the middle of other Lisp programs. A program can wait, so that
1519sentinels will run, by calling @code{sit-for} or @code{sleep-for}
1520(@pxref{Waiting}), or @code{accept-process-output} (@pxref{Accepting
1521Output}). Emacs also allows sentinels to run when the command loop is
1522reading input. @code{delete-process} calls the sentinel when it
1523terminates a running process.
1524
1525 Emacs does not keep a queue of multiple reasons to call the sentinel
1526of one process; it records just the current status and the fact that
1527there has been a change. Therefore two changes in status, coming in
1528quick succession, can call the sentinel just once. However, process
1529termination will always run the sentinel exactly once. This is
1530because the process status can't change again after termination.
1531
1532 Emacs explicitly checks for output from the process before running
1533the process sentinel. Once the sentinel runs due to process
1534termination, no further output can arrive from the process.
1535
1536 A sentinel that writes the output into the buffer of the process
1537should check whether the buffer is still alive. If it tries to insert
1538into a dead buffer, it will get an error. If the buffer is dead,
1539@code{(buffer-name (process-buffer @var{process}))} returns @code{nil}.
1540
1541 Quitting is normally inhibited within a sentinel---otherwise, the
1542effect of typing @kbd{C-g} at command level or to quit a user command
1543would be unpredictable. If you want to permit quitting inside a
1544sentinel, bind @code{inhibit-quit} to @code{nil}. In most cases, the
1545right way to do this is with the macro @code{with-local-quit}.
1546@xref{Quitting}.
1547
1548 If an error happens during execution of a sentinel, it is caught
1549automatically, so that it doesn't stop the execution of whatever
1550programs was running when the sentinel was started. However, if
1551@code{debug-on-error} is non-@code{nil}, the error-catching is turned
1552off. This makes it possible to use the Lisp debugger to debug the
1553sentinel. @xref{Debugger}.
1554
1555 While a sentinel is running, the process sentinel is temporarily
1556set to @code{nil} so that the sentinel won't run recursively.
1557For this reason it is not possible for a sentinel to specify
1558a new sentinel.
1559
1560 In earlier Emacs versions, every sentinel that did regular expression
1561searching or matching had to explicitly save and restore the match data.
1562Now Emacs does this automatically for sentinels; they never need to do
1563it explicitly. @xref{Match Data}.
1564
1565@defun set-process-sentinel process sentinel
1566This function associates @var{sentinel} with @var{process}. If
1567@var{sentinel} is @code{nil}, then the process will have no sentinel.
1568The default behavior when there is no sentinel is to insert a message in
1569the process's buffer when the process status changes.
1570
1571Changes in process sentinel take effect immediately---if the sentinel
1572is slated to be run but has not been called yet, and you specify a new
1573sentinel, the eventual call to the sentinel will use the new one.
1574
1575@smallexample
1576@group
1577(defun msg-me (process event)
1578 (princ
1579 (format "Process: %s had the event `%s'" process event)))
1580(set-process-sentinel (get-process "shell") 'msg-me)
1581 @result{} msg-me
1582@end group
1583@group
1584(kill-process (get-process "shell"))
1585 @print{} Process: #<process shell> had the event `killed'
1586 @result{} #<process shell>
1587@end group
1588@end smallexample
1589@end defun
1590
1591@defun process-sentinel process
1592This function returns the sentinel of @var{process}, or @code{nil} if it
1593has none.
1594@end defun
1595
1596@defun waiting-for-user-input-p
1597While a sentinel or filter function is running, this function returns
1598non-@code{nil} if Emacs was waiting for keyboard input from the user at
1599the time the sentinel or filter function was called, @code{nil} if it
1600was not.
1601@end defun
1602
1603@node Query Before Exit
1604@section Querying Before Exit
1605
1606 When Emacs exits, it terminates all its subprocesses by sending them
1607the @code{SIGHUP} signal. Because subprocesses may be doing
1608valuable work, Emacs normally asks the user to confirm that it is ok
1609to terminate them. Each process has a query flag which, if
1610non-@code{nil}, says that Emacs should ask for confirmation before
1611exiting and thus killing that process. The default for the query flag
1612is @code{t}, meaning @emph{do} query.
1613
1614@defun process-query-on-exit-flag process
1615This returns the query flag of @var{process}.
1616@end defun
1617
1618@defun set-process-query-on-exit-flag process flag
1619This function sets the query flag of @var{process} to @var{flag}. It
1620returns @var{flag}.
1621
1622@smallexample
1623@group
1624;; @r{Don't query about the shell process}
1625(set-process-query-on-exit-flag (get-process "shell") nil)
1626 @result{} t
1627@end group
1628@end smallexample
1629@end defun
1630
1631@defun process-kill-without-query process &optional do-query
1632This function clears the query flag of @var{process}, so that
1633Emacs will not query the user on account of that process.
1634
1635Actually, the function does more than that: it returns the old value of
1636the process's query flag, and sets the query flag to @var{do-query}.
1637Please don't use this function to do those things any more---please
1638use the newer, cleaner functions @code{process-query-on-exit-flag} and
1639@code{set-process-query-on-exit-flag} in all but the simplest cases.
1640The only way you should use @code{process-kill-without-query} nowadays
1641is like this:
1642
1643@smallexample
1644@group
1645;; @r{Don't query about the shell process}
1646(process-kill-without-query (get-process "shell"))
1647@end group
1648@end smallexample
1649@end defun
1650
23dd4ecd
EZ
1651@node System Processes
1652@section Accessing Other Processes
1653@cindex system processes
1654
1655 In addition to accessing and manipulating processes that are
1656subprocesses of the current Emacs session, Emacs Lisp programs can
1657also access other processes running on the same machine. We call
1658these @dfn{system processes}, to distinguish between them and Emacs
1659subprocesses.
1660
1661 Emacs provides several primitives for accessing system processes.
1662Not all platforms support these primitives; on those which don't,
1663these primitives return @code{nil}.
1664
1665@defun list-system-processes
1666This function returns a list of all the processes running on the
1667system. Each process is identified by its @acronym{PID}, a numerical
1668process ID that is assigned by the OS and distinguishes the process
1669from all the other processes running on the same machine at the same
1670time.
1671@end defun
1672
a20878b6 1673@defun process-attributes pid
23dd4ecd
EZ
1674This function returns an alist of attributes for the process specified
1675by its process ID @var{pid}. Each association in the alist is of the
1676form @code{(@var{key} . @var{value})}, where @var{key} designates the
1677attribute and @var{value} is the value of that attribute. The various
1678attribute @var{key}'s that this function can return are listed below.
1679Not all platforms support all of these attributes; if an attribute is
1680not supported, its association will not appear in the returned alist.
1681Values that are numbers can be either integer or floating-point,
1682depending on the magnitude of the value.
1683
1684@table @code
1685@item euid
1686The effective user ID of the user who invoked the process. The
1687corresponding @var{value} is a number. If the process was invoked by
1688the same user who runs the current Emacs session, the value is
1689identical to what @code{user-uid} returns (@pxref{User
1690Identification}).
1691
1692@item user
1693User name corresponding to the process's effective user ID, a string.
1694
1695@item egid
1696The group ID of the effective user ID, a number.
1697
1698@item group
1699Group name corresponding to the effective user's group ID, a string.
1700
1701@item comm
1702The name of the command that runs in the process. This is a string
1703that usually specifies the name of the executable file of the process,
1704without the leading directories. However, some special system
1705processes can report strings that do not correspond to an executable
1706file of a program.
1707
1708@item state
1709The state code of the process. This is a short string that encodes
1710the scheduling state of the process. Here's a list of the most
1711frequently seen codes:
1712
1713@table @code
1dca458f 1714@item "D"
23dd4ecd 1715uninterruptible sleep (usually I/O)
1dca458f 1716@item "R"
23dd4ecd 1717running
1dca458f 1718@item "S"
23dd4ecd 1719interruptible sleep (waiting for some event)
1dca458f 1720@item "T"
23dd4ecd 1721stopped, e.g., by a job control signal
1dca458f
EZ
1722@item "Z"
1723``zombie'': a process that terminated, but was not reaped by its parent
23dd4ecd
EZ
1724@end table
1725
1726@noindent
1727For the full list of the possible states, see the manual page of the
1728@command{ps} command.
1729
1730@item ppid
1731The process ID of the parent process, a number.
1732
1733@item pgrp
1734The process group ID of the process, a number.
1735
1736@item sess
1737The session ID of the process. This is a number that is the process
1738ID of the process's @dfn{session leader}.
1739
1740@item ttname
1741A string that is the name of the process's controlling terminal. On
1742Unix and GNU systems, this is normally the file name of the
1743corresponding terminal device, such as @file{/dev/pts65}.
1744
1745@item tpgid
1746The numerical process group ID of the foreground process group that
1747uses the process's terminal.
1748
1749@item minflt
1750The number of minor page faults caused by the process since its
1751beginning. (Minor page faults are those that don't involve reading
1752from disk.)
1753
1754@item majflt
1755The number of major page faults caused by the process since its
1756beginning. (Major page faults require a disk to be read, and are thus
1757more expensive than minor page faults.)
1758
1759@item cminflt
1760@itemx cmajflt
1761Like @code{minflt} and @code{majflt}, but include the number of page
1762faults for all the child processes of the given process.
1763
1764@item utime
1765Time spent by the process in the user context, for running the
1766application's code. The corresponding @var{value} is in the
1767@w{@code{(@var{high} @var{low} @var{microsec})}} format, the same
1768format used by functions @code{current-time} (@pxref{Time of Day,
1769current-time}) and @code{file-attributes} (@pxref{File Attributes}).
1770
1771@item stime
1772Time spent by the process in the system (kernel) context, for
1773processing system calls. The corresponding @var{value} is in the same
1774format as for @code{utime}.
1775
af34ad36
EZ
1776@item time
1777The sum of @code{utime} and @code{stime}. The corresponding
1778@var{value} is in the same format as for @code{utime}.
1779
23dd4ecd
EZ
1780@item cutime
1781@itemx cstime
af34ad36
EZ
1782@itemx ctime
1783Like @code{utime}, @code{stime}, and @code{time}, but include the
1784times of all the child processes of the given process.
23dd4ecd
EZ
1785
1786@item pri
1787The numerical priority of the process.
1788
1789@item nice
1dca458f
EZ
1790The @dfn{nice value} of the process, a number. (Processes with smaller
1791nice values get scheduled more favorably.)
23dd4ecd
EZ
1792
1793@item thcount
1794The number of threads in the process.
1795
1796@item start
1797The time the process was started, in the @w{@code{(@var{high}
1798@var{low} @var{microsec})}} format used by @code{current-time} and
1799@code{file-attributes}.
1800
1801@item etime
1802The time elapsed since the process started, in the @w{@code{(@var{high}
1803@var{low} @var{microsec})}} format.
1804
1805@item vsize
1806The virtual memory size of the process, measured in kilobytes.
1807
1808@item rss
1809The size of the process's @dfn{resident set}, the number of kilobytes
1810occupied by the process in the machine's physical memory.
1811
1812@item pcpu
1813The percentage of the CPU time used by the process since it started.
1814The corresponding @var{value} is a floating-point number between 0 and
1815100.
1816
1817@item pmem
1818The percentage of the total physical memory installed on the machine
1819used by the process's resident set. The value is a floating-point
1820number between 0 and 100.
1821
1822@item args
1823The command-line with which the process was invoked. This is a string
1824in which individual command-line arguments are separated by blanks;
1825whitespace characters that are embedded in the arguments are quoted as
1826appropriate for the system's shell: escaped by backslash characters on
1827GNU and Unix, and enclosed in double quote characters on Windows.
1828Thus, this command-line string can be directly used in primitives such
1829as @code{shell-command}.
1830@end table
1831
1832@end defun
1833
1834
b8d4c8d0
GM
1835@node Transaction Queues
1836@section Transaction Queues
1837@cindex transaction queue
1838
1839You can use a @dfn{transaction queue} to communicate with a subprocess
1840using transactions. First use @code{tq-create} to create a transaction
1841queue communicating with a specified process. Then you can call
1842@code{tq-enqueue} to send a transaction.
1843
1844@defun tq-create process
1845This function creates and returns a transaction queue communicating with
1846@var{process}. The argument @var{process} should be a subprocess
1847capable of sending and receiving streams of bytes. It may be a child
1848process, or it may be a TCP connection to a server, possibly on another
1849machine.
1850@end defun
1851
1852@defun tq-enqueue queue question regexp closure fn &optional delay-question
1853This function sends a transaction to queue @var{queue}. Specifying the
1854queue has the effect of specifying the subprocess to talk to.
1855
1856The argument @var{question} is the outgoing message that starts the
1857transaction. The argument @var{fn} is the function to call when the
1858corresponding answer comes back; it is called with two arguments:
1859@var{closure}, and the answer received.
1860
1861The argument @var{regexp} is a regular expression that should match
1862text at the end of the entire answer, but nothing before; that's how
1863@code{tq-enqueue} determines where the answer ends.
1864
4185820c
CY
1865If the argument @var{delay-question} is non-@code{nil}, delay sending
1866this question until the process has finished replying to any previous
b8d4c8d0
GM
1867questions. This produces more reliable results with some processes.
1868
1869The return value of @code{tq-enqueue} itself is not meaningful.
1870@end defun
1871
1872@defun tq-close queue
1873Shut down transaction queue @var{queue}, waiting for all pending transactions
1874to complete, and then terminate the connection or child process.
1875@end defun
1876
1877Transaction queues are implemented by means of a filter function.
1878@xref{Filter Functions}.
1879
1880@node Network
1881@section Network Connections
1882@cindex network connection
1883@cindex TCP
1884@cindex UDP
1885
1886 Emacs Lisp programs can open stream (TCP) and datagram (UDP) network
1887connections to other processes on the same machine or other machines.
1888A network connection is handled by Lisp much like a subprocess, and is
1889represented by a process object. However, the process you are
1890communicating with is not a child of the Emacs process, so it has no
1891process @acronym{ID}, and you can't kill it or send it signals. All you
1892can do is send and receive data. @code{delete-process} closes the
1893connection, but does not kill the program at the other end; that
1894program must decide what to do about closure of the connection.
1895
1896 Lisp programs can listen for connections by creating network
1897servers. A network server is also represented by a kind of process
1898object, but unlike a network connection, the network server never
1899transfers data itself. When it receives a connection request, it
1900creates a new network connection to represent the connection just
1901made. (The network connection inherits certain information, including
1902the process plist, from the server.) The network server then goes
1903back to listening for more connection requests.
1904
1905 Network connections and servers are created by calling
1906@code{make-network-process} with an argument list consisting of
1907keyword/argument pairs, for example @code{:server t} to create a
1908server process, or @code{:type 'datagram} to create a datagram
1909connection. @xref{Low-Level Network}, for details. You can also use
1910the @code{open-network-stream} function described below.
1911
c73e02fa
GM
1912 To distinguish the different types of processes, the
1913@code{process-type} function returns the symbol @code{network} for a
1914network connection or server, @code{serial} for a serial port
1915connection, or @code{real} for a real subprocess.
1916
1917 The @code{process-status} function returns @code{open},
1918@code{closed}, @code{connect}, and @code{failed} for network
1919connections. For a network server, the status is always
b8d4c8d0
GM
1920@code{listen}. None of those values is possible for a real
1921subprocess. @xref{Process Information}.
1922
1923 You can stop and resume operation of a network process by calling
1924@code{stop-process} and @code{continue-process}. For a server
1925process, being stopped means not accepting new connections. (Up to 5
1926connection requests will be queued for when you resume the server; you
1927can increase this limit, unless it is imposed by the operating
1928system.) For a network stream connection, being stopped means not
1929processing input (any arriving input waits until you resume the
1930connection). For a datagram connection, some number of packets may be
1931queued but input may be lost. You can use the function
1932@code{process-command} to determine whether a network connection or
1933server is stopped; a non-@code{nil} value means yes.
1934
1935@defun open-network-stream name buffer-or-name host service
1936This function opens a TCP connection, and returns a process object
1937that represents the connection.
1938
1939The @var{name} argument specifies the name for the process object. It
1940is modified as necessary to make it unique.
1941
1942The @var{buffer-or-name} argument is the buffer to associate with the
1943connection. Output from the connection is inserted in the buffer,
1944unless you specify a filter function to handle the output. If
1945@var{buffer-or-name} is @code{nil}, it means that the connection is not
1946associated with any buffer.
1947
1948The arguments @var{host} and @var{service} specify where to connect to;
1949@var{host} is the host name (a string), and @var{service} is the name of
1950a defined network service (a string) or a port number (an integer).
1951@end defun
1952
b8d4c8d0
GM
1953@node Network Servers
1954@section Network Servers
1955@cindex network servers
1956
1957 You create a server by calling @code{make-network-process} with
1958@code{:server t}. The server will listen for connection requests from
1959clients. When it accepts a client connection request, that creates a
1960new network connection, itself a process object, with the following
1961parameters:
1962
1963@itemize @bullet
1964@item
1965The connection's process name is constructed by concatenating the
1966server process' @var{name} with a client identification string. The
1967client identification string for an IPv4 connection looks like
1968@samp{<@var{a}.@var{b}.@var{c}.@var{d}:@var{p}>}. Otherwise, it is a
1969unique number in brackets, as in @samp{<@var{nnn}>}. The number
1970is unique for each connection in the Emacs session.
1971
1972@item
1973If the server's filter is non-@code{nil}, the connection process does
1974not get a separate process buffer; otherwise, Emacs creates a new
1975buffer for the purpose. The buffer name is the server's buffer name
1976or process name, concatenated with the client identification string.
1977
1978The server's process buffer value is never used directly by Emacs, but
1979it is passed to the log function, which can log connections by
1980inserting text there.
1981
1982@item
1983The communication type and the process filter and sentinel are
1984inherited from those of the server. The server never directly
1985uses its filter and sentinel; their sole purpose is to initialize
1986connections made to the server.
1987
1988@item
1989The connection's process contact info is set according to the client's
1990addressing information (typically an IP address and a port number).
1991This information is associated with the @code{process-contact}
1992keywords @code{:host}, @code{:service}, @code{:remote}.
1993
1994@item
1995The connection's local address is set up according to the port
1996number used for the connection.
1997
1998@item
1999The client process' plist is initialized from the server's plist.
2000@end itemize
2001
2002@node Datagrams
2003@section Datagrams
2004@cindex datagrams
2005
2006 A datagram connection communicates with individual packets rather
2007than streams of data. Each call to @code{process-send} sends one
2008datagram packet (@pxref{Input to Processes}), and each datagram
2009received results in one call to the filter function.
2010
2011 The datagram connection doesn't have to talk with the same remote
2012peer all the time. It has a @dfn{remote peer address} which specifies
2013where to send datagrams to. Each time an incoming datagram is passed
2014to the filter function, the peer address is set to the address that
2015datagram came from; that way, if the filter function sends a datagram,
2016it will go back to that place. You can specify the remote peer
2017address when you create the datagram connection using the
2018@code{:remote} keyword. You can change it later on by calling
2019@code{set-process-datagram-address}.
2020
2021@defun process-datagram-address process
2022If @var{process} is a datagram connection or server, this function
2023returns its remote peer address.
2024@end defun
2025
2026@defun set-process-datagram-address process address
2027If @var{process} is a datagram connection or server, this function
2028sets its remote peer address to @var{address}.
2029@end defun
2030
2031@node Low-Level Network
2032@section Low-Level Network Access
2033
2034 You can also create network connections by operating at a lower
2035level than that of @code{open-network-stream}, using
2036@code{make-network-process}.
2037
2038@menu
2039* Proc: Network Processes. Using @code{make-network-process}.
2040* Options: Network Options. Further control over network connections.
2041* Features: Network Feature Testing.
2042 Determining which network features work on
2043 the machine you are using.
2044@end menu
2045
2046@node Network Processes
2047@subsection @code{make-network-process}
2048
2049 The basic function for creating network connections and network
2050servers is @code{make-network-process}. It can do either of those
2051jobs, depending on the arguments you give it.
2052
2053@defun make-network-process &rest args
2054This function creates a network connection or server and returns the
2055process object that represents it. The arguments @var{args} are a
2056list of keyword/argument pairs. Omitting a keyword is always
2057equivalent to specifying it with value @code{nil}, except for
2058@code{:coding}, @code{:filter-multibyte}, and @code{:reuseaddr}. Here
2059are the meaningful keywords:
2060
2061@table @asis
2062@item :name @var{name}
2063Use the string @var{name} as the process name. It is modified if
2064necessary to make it unique.
2065
2066@item :type @var{type}
2067Specify the communication type. A value of @code{nil} specifies a
2068stream connection (the default); @code{datagram} specifies a datagram
f7704e26
CY
2069connection; @code{seqpacket} specifies a ``sequenced packet stream''
2070connection. Both connections and servers can be of these types.
b8d4c8d0
GM
2071
2072@item :server @var{server-flag}
2073If @var{server-flag} is non-@code{nil}, create a server. Otherwise,
2074create a connection. For a stream type server, @var{server-flag} may
2075be an integer which then specifies the length of the queue of pending
2076connections to the server. The default queue length is 5.
2077
2078@item :host @var{host}
2079Specify the host to connect to. @var{host} should be a host name or
2080Internet address, as a string, or the symbol @code{local} to specify
2081the local host. If you specify @var{host} for a server, it must
2082specify a valid address for the local host, and only clients
2083connecting to that address will be accepted.
2084
2085@item :service @var{service}
2086@var{service} specifies a port number to connect to, or, for a server,
2087the port number to listen on. It should be a service name that
2088translates to a port number, or an integer specifying the port number
2089directly. For a server, it can also be @code{t}, which means to let
2090the system select an unused port number.
2091
2092@item :family @var{family}
2093@var{family} specifies the address (and protocol) family for
2094communication. @code{nil} means determine the proper address family
2095automatically for the given @var{host} and @var{service}.
2096@code{local} specifies a Unix socket, in which case @var{host} is
2097ignored. @code{ipv4} and @code{ipv6} specify to use IPv4 and IPv6
2098respectively.
2099
2100@item :local @var{local-address}
2101For a server process, @var{local-address} is the address to listen on.
2102It overrides @var{family}, @var{host} and @var{service}, and you
2103may as well not specify them.
2104
2105@item :remote @var{remote-address}
2106For a connection, @var{remote-address} is the address to connect to.
2107It overrides @var{family}, @var{host} and @var{service}, and you
2108may as well not specify them.
2109
2110For a datagram server, @var{remote-address} specifies the initial
2111setting of the remote datagram address.
2112
2113The format of @var{local-address} or @var{remote-address} depends on
2114the address family:
2115
2116@itemize -
2117@item
2118An IPv4 address is represented as a five-element vector of four 8-bit
2119integers and one 16-bit integer
2120@code{[@var{a} @var{b} @var{c} @var{d} @var{p}]} corresponding to
2121numeric IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port number
2122@var{p}.
2123
2124@item
2125An IPv6 address is represented as a nine-element vector of 16-bit
2126integers @code{[@var{a} @var{b} @var{c} @var{d} @var{e} @var{f}
2127@var{g} @var{h} @var{p}]} corresponding to numeric IPv6 address
2128@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h} and
2129port number @var{p}.
2130
2131@item
2132A local address is represented as a string which specifies the address
2133in the local address space.
2134
2135@item
2136An ``unsupported family'' address is represented by a cons
2137@code{(@var{f} . @var{av})}, where @var{f} is the family number and
2138@var{av} is a vector specifying the socket address using one element
2139per address data byte. Do not rely on this format in portable code,
2140as it may depend on implementation defined constants, data sizes, and
2141data structure alignment.
2142@end itemize
2143
2144@item :nowait @var{bool}
2145If @var{bool} is non-@code{nil} for a stream connection, return
2146without waiting for the connection to complete. When the connection
2147succeeds or fails, Emacs will call the sentinel function, with a
2148second argument matching @code{"open"} (if successful) or
2149@code{"failed"}. The default is to block, so that
2150@code{make-network-process} does not return until the connection
2151has succeeded or failed.
2152
2153@item :stop @var{stopped}
2154Start the network connection or server in the `stopped' state if
2155@var{stopped} is non-@code{nil}.
2156
2157@item :buffer @var{buffer}
2158Use @var{buffer} as the process buffer.
2159
2160@item :coding @var{coding}
2161Use @var{coding} as the coding system for this process. To specify
2162different coding systems for decoding data from the connection and for
2163encoding data sent to it, specify @code{(@var{decoding} .
2164@var{encoding})} for @var{coding}.
2165
2166If you don't specify this keyword at all, the default
2167is to determine the coding systems from the data.
2168
2169@item :noquery @var{query-flag}
2170Initialize the process query flag to @var{query-flag}.
2171@xref{Query Before Exit}.
2172
2173@item :filter @var{filter}
2174Initialize the process filter to @var{filter}.
2175
b8d4c8d0
GM
2176@item :sentinel @var{sentinel}
2177Initialize the process sentinel to @var{sentinel}.
2178
2179@item :log @var{log}
2180Initialize the log function of a server process to @var{log}. The log
2181function is called each time the server accepts a network connection
2182from a client. The arguments passed to the log function are
2183@var{server}, @var{connection}, and @var{message}, where @var{server}
2184is the server process, @var{connection} is the new process for the
2185connection, and @var{message} is a string describing what has
2186happened.
2187
2188@item :plist @var{plist}
2189Initialize the process plist to @var{plist}.
2190@end table
2191
2192The original argument list, modified with the actual connection
2193information, is available via the @code{process-contact} function.
2194@end defun
2195
2196@node Network Options
2197@subsection Network Options
2198
2199 The following network options can be specified when you create a
2200network process. Except for @code{:reuseaddr}, you can also set or
2201modify these options later, using @code{set-network-process-option}.
2202
2203 For a server process, the options specified with
2204@code{make-network-process} are not inherited by the client
2205connections, so you will need to set the necessary options for each
2206child connection as it is created.
2207
2208@table @asis
2209@item :bindtodevice @var{device-name}
2210If @var{device-name} is a non-empty string identifying a network
2211interface name (see @code{network-interface-list}), only handle
2212packets received on that interface. If @var{device-name} is @code{nil}
2213(the default), handle packets received on any interface.
2214
2215Using this option may require special privileges on some systems.
2216
2217@item :broadcast @var{broadcast-flag}
2218If @var{broadcast-flag} is non-@code{nil} for a datagram process, the
2219process will receive datagram packet sent to a broadcast address, and
2220be able to send packets to a broadcast address. Ignored for a stream
2221connection.
2222
2223@item :dontroute @var{dontroute-flag}
2224If @var{dontroute-flag} is non-@code{nil}, the process can only send
2225to hosts on the same network as the local host.
2226
2227@item :keepalive @var{keepalive-flag}
2228If @var{keepalive-flag} is non-@code{nil} for a stream connection,
2229enable exchange of low-level keep-alive messages.
2230
2231@item :linger @var{linger-arg}
2232If @var{linger-arg} is non-@code{nil}, wait for successful
2233transmission of all queued packets on the connection before it is
2234deleted (see @code{delete-process}). If @var{linger-arg} is an
2235integer, it specifies the maximum time in seconds to wait for queued
2236packets to be sent before closing the connection. Default is
2237@code{nil} which means to discard unsent queued packets when the
2238process is deleted.
2239
2240@item :oobinline @var{oobinline-flag}
2241If @var{oobinline-flag} is non-@code{nil} for a stream connection,
2242receive out-of-band data in the normal data stream. Otherwise, ignore
2243out-of-band data.
2244
2245@item :priority @var{priority}
2246Set the priority for packets sent on this connection to the integer
2247@var{priority}. The interpretation of this number is protocol
2248specific, such as setting the TOS (type of service) field on IP
2249packets sent on this connection. It may also have system dependent
2250effects, such as selecting a specific output queue on the network
2251interface.
2252
2253@item :reuseaddr @var{reuseaddr-flag}
2254If @var{reuseaddr-flag} is non-@code{nil} (the default) for a stream
2255server process, allow this server to reuse a specific port number (see
2256@code{:service}) unless another process on this host is already
2257listening on that port. If @var{reuseaddr-flag} is @code{nil}, there
2258may be a period of time after the last use of that port (by any
2259process on the host), where it is not possible to make a new server on
2260that port.
2261@end table
2262
106e6894 2263@defun set-network-process-option process option value &optional no-error
b8d4c8d0
GM
2264This function sets or modifies a network option for network process
2265@var{process}. See @code{make-network-process} for details of options
106e6894
CY
2266@var{option} and their corresponding values @var{value}. If
2267@var{no-error} is non-@code{nil}, this function returns @code{nil}
2268instead of signaling an error if @var{option} is not a supported
2269option. If the function successfully completes, it returns @code{t}.
b8d4c8d0
GM
2270
2271The current setting of an option is available via the
2272@code{process-contact} function.
2273@end defun
2274
2275@node Network Feature Testing
2276@subsection Testing Availability of Network Features
2277
2278 To test for the availability of a given network feature, use
2279@code{featurep} like this:
2280
2281@example
2282(featurep 'make-network-process '(@var{keyword} @var{value}))
2283@end example
2284
2285@noindent
2286The result of the first form is @code{t} if it works to specify
2287@var{keyword} with value @var{value} in @code{make-network-process}.
2288The result of the second form is @code{t} if @var{keyword} is
2289supported by @code{make-network-process}. Here are some of the
2290@var{keyword}---@var{value} pairs you can test in
2291this way.
2292
2293@table @code
2294@item (:nowait t)
2295Non-@code{nil} if non-blocking connect is supported.
2296@item (:type datagram)
2297Non-@code{nil} if datagrams are supported.
2298@item (:family local)
2299Non-@code{nil} if local (a.k.a.@: ``UNIX domain'') sockets are supported.
2300@item (:family ipv6)
2301Non-@code{nil} if IPv6 is supported.
2302@item (:service t)
2303Non-@code{nil} if the system can select the port for a server.
2304@end table
2305
2306 To test for the availability of a given network option, use
2307@code{featurep} like this:
2308
2309@example
2310(featurep 'make-network-process '@var{keyword})
2311@end example
2312
2313@noindent
2314Here are some of the options you can test in this way.
2315
2316@table @code
2317@item :bindtodevice
2318@itemx :broadcast
2319@itemx :dontroute
2320@itemx :keepalive
2321@itemx :linger
2322@itemx :oobinline
2323@itemx :priority
2324@itemx :reuseaddr
2325That particular network option is supported by
2326@code{make-network-process} and @code{set-network-process-option}.
2327@end table
2328
2329@node Misc Network
2330@section Misc Network Facilities
2331
2332 These additional functions are useful for creating and operating
305a7ef2
EZ
2333on network connections. Note that they are supported only on some
2334systems.
b8d4c8d0
GM
2335
2336@defun network-interface-list
2337This function returns a list describing the network interfaces
2338of the machine you are using. The value is an alist whose
2339elements have the form @code{(@var{name} . @var{address})}.
2340@var{address} has the same form as the @var{local-address}
2341and @var{remote-address} arguments to @code{make-network-process}.
2342@end defun
2343
2344@defun network-interface-info ifname
2345This function returns information about the network interface named
2346@var{ifname}. The value is a list of the form
2347@code{(@var{addr} @var{bcast} @var{netmask} @var{hwaddr} @var{flags})}.
2348
2349@table @var
2350@item addr
2351The Internet protocol address.
2352@item bcast
2353The broadcast address.
2354@item netmask
2355The network mask.
2356@item hwaddr
2357The layer 2 address (Ethernet MAC address, for instance).
2358@item flags
2359The current flags of the interface.
2360@end table
2361@end defun
2362
2363@defun format-network-address address &optional omit-port
2364This function converts the Lisp representation of a network address to
2365a string.
2366
2367A five-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]}
2368represents an IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port
2369number @var{p}. @code{format-network-address} converts that to the
2370string @code{"@var{a}.@var{b}.@var{c}.@var{d}:@var{p}"}.
2371
2372A nine-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{e}
2373@var{f} @var{g} @var{h} @var{p}]} represents an IPv6 address along
2374with a port number. @code{format-network-address} converts that to
2375the string
2376@code{"[@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h}]:@var{p}"}.
2377
2378If the vector does not include the port number, @var{p}, or if
2379@var{omit-port} is non-@code{nil}, the result does not include the
2380@code{:@var{p}} suffix.
2381@end defun
2382
c73e02fa
GM
2383@node Serial Ports
2384@section Communicating with Serial Ports
2385@cindex @file{/dev/tty}
2386@cindex @file{COM1}
545c2782 2387@cindex serial connections
c73e02fa
GM
2388
2389 Emacs can communicate with serial ports. For interactive use,
2390@kbd{M-x serial-term} opens a terminal window. In a Lisp program,
2391@code{make-serial-process} creates a process object.
2392
2393 The serial port can be configured at run-time, without having to
2394close and re-open it. The function @code{serial-process-configure}
2395lets you change the speed, bytesize, and other parameters. In a
2396terminal window created by @code{serial-term}, you can click on the
2397mode line for configuration.
2398
2399 A serial connection is represented by a process object which can be
2400used similar to a subprocess or network process. You can send and
2401receive data and configure the serial port. A serial process object
80e6b6df
EZ
2402has no process ID, you can't send signals to it, and the status codes
2403are different from other types of processes.
c73e02fa
GM
2404@code{delete-process} on the process object or @code{kill-buffer} on
2405the process buffer close the connection, but this does not affect the
2406device connected to the serial port.
2407
2408 The function @code{process-type} returns the symbol @code{serial}
80e6b6df 2409for a process object representing a serial port connection.
c73e02fa
GM
2410
2411 Serial ports are available on GNU/Linux, Unix, and Windows systems.
2412
80e6b6df 2413@deffn Command serial-term port speed
c73e02fa 2414Start a terminal-emulator for a serial port in a new buffer.
80e6b6df
EZ
2415@var{port} is the name of the serial port to which to connect. For
2416example, this could be @file{/dev/ttyS0} on Unix. On Windows, this
2417could be @file{COM1}, or @file{\\.\COM10} (double the backslashes in
2418Lisp strings).
c73e02fa
GM
2419
2420@var{speed} is the speed of the serial port in bits per second. 9600
80e6b6df
EZ
2421is a common value. The buffer is in Term mode; see @ref{Term Mode,,,
2422emacs, The GNU Emacs Manual}, for the commands to use in that buffer.
2423You can change the speed and the configuration in the mode line menu.
2424@end deffn
c73e02fa
GM
2425
2426@defun make-serial-process &rest args
80e6b6df
EZ
2427This function creates a process and a buffer. Arguments are specified
2428as keyword/argument pairs. Here's the list of the meaningful keywords:
c73e02fa
GM
2429
2430@table @code
80e6b6df
EZ
2431@item :port @var{port}@r{ (mandatory)}
2432This is the name of the serial port. On Unix and GNU systems, this is
2433a file name such as @file{/dev/ttyS0}. On Windows, this could be
2434@file{COM1}, or @file{\\.\COM10} for ports higher than @file{COM9}
2435(double the backslashes in Lisp strings).
2436
2437@item :speed @var{speed}@r{ (mandatory)}
2438The speed of the serial port in bits per second. This function calls
2439@code{serial-process-configure} to handle the speed.
2440
2441@item :name @var{name}
2442The name of the process. If @var{name} is not given, @var{port} will
2443serve as the process name as well.
2444
2445@item :buffer @var{buffer}
2446The buffer to associate with the process. The value could be either a
2447buffer or a string that names a buffer. Process output goes at the
2448end of that buffer, unless you specify an output stream or filter
2449function to handle the output. If @var{buffer} is not given, the
2450process buffer's name is taken from the value of the @code{:name}
2451keyword.
2452
2453@item :coding @var{coding}
c73e02fa
GM
2454If @var{coding} is a symbol, it specifies the coding system used for
2455both reading and writing for this process. If @var{coding} is a cons
2456@code{(decoding . encoding)}, @var{decoding} is used for reading, and
80e6b6df
EZ
2457@var{encoding} is used for writing. If not specified, the default is
2458to determine the coding systems from data itself.
c73e02fa 2459
80e6b6df
EZ
2460@item :noquery @var{query-flag}
2461Initialize the process query flag to @var{query-flag}. @xref{Query
2462Before Exit}. The flags defaults to @code{nil} if unspecified.
c73e02fa 2463
80e6b6df 2464@item :stop @var{bool}
c73e02fa
GM
2465Start process in the @code{stopped} state if @var{bool} is
2466non-@code{nil}. In the stopped state, a serial process does not
2467accept incoming data, but you can send outgoing data. The stopped
2468state is cleared by @code{continue-process} and set by
2469@code{stop-process}.
2470
80e6b6df 2471@item :filter @var{filter}
c73e02fa
GM
2472Install @var{filter} as the process filter.
2473
80e6b6df 2474@item :sentinel @var{sentinel}
c73e02fa
GM
2475Install @var{sentinel} as the process sentinel.
2476
80e6b6df 2477@item :plist @var{plist}
c73e02fa
GM
2478Install @var{plist} as the initial plist of the process.
2479
2480@item :speed
2481@itemx :bytesize
2482@itemx :parity
2483@itemx :stopbits
2484@itemx :flowcontrol
2485These arguments are handled by @code{serial-process-configure}, which
2486is called by @code{make-serial-process}.
2487@end table
2488
2489The original argument list, possibly modified by later configuration,
2490is available via the function @code{process-contact}.
2491
2492Examples:
2493
2494@example
2495(make-serial-process :port "/dev/ttyS0" :speed 9600)
2496
2497(make-serial-process :port "COM1" :speed 115200 :stopbits 2)
2498
80e6b6df
EZ
2499(make-serial-process :port "\\\\.\\COM13" :speed 1200
2500 :bytesize 7 :parity 'odd)
c73e02fa 2501
57eedec1
GM
2502(make-serial-process :port "/dev/tty.BlueConsole-SPP-1"
2503 :speed nil)
c73e02fa
GM
2504@end example
2505@end defun
2506
2507@defun serial-process-configure &rest args
80e6b6df
EZ
2508@cindex baud, in serial connections
2509@cindex bytesize, in serial connections
2510@cindex parity, in serial connections
2511@cindex stopbits, in serial connections
2512@cindex flowcontrol, in serial connections
2513
2514This functions configures a serial port connection. Arguments are
2515specified as keyword/argument pairs. Attributes that are not given
2516are re-initialized from the process's current configuration (available
2517via the function @code{process-contact}) or set to reasonable default
2518values. The following arguments are defined:
c73e02fa
GM
2519
2520@table @code
80e6b6df
EZ
2521@item :process @var{process}
2522@itemx :name @var{name}
2523@itemx :buffer @var{buffer}
2524@itemx :port @var{port}
c73e02fa
GM
2525Any of these arguments can be given to identify the process that is to
2526be configured. If none of these arguments is given, the current
2527buffer's process is used.
2528
2529@item :speed @var{speed}
545c2782
EZ
2530The speed of the serial port in bits per second, a.k.a.@: @dfn{baud
2531rate}. The value can be any number, but most serial ports work only
2532at a few defined values between 1200 and 115200, with 9600 being the
2533most common value. If @var{speed} is @code{nil}, the function ignores
2534all other arguments and does not configure the port. This may be
2535useful for special serial ports such as Bluetooth-to-serial converters
2536which can only be configured through AT commands sent through the
538395d9
EZ
2537connection. The value of @code{nil} for @var{speed} is valid only for
2538connections that were already opened by a previous call to
80e6b6df 2539@code{make-serial-process} or @code{serial-term}.
c73e02fa
GM
2540
2541@item :bytesize @var{bytesize}
80e6b6df
EZ
2542The number of bits per byte, which can be 7 or 8. If @var{bytesize}
2543is not given or @code{nil}, it defaults to 8.
c73e02fa
GM
2544
2545@item :parity @var{parity}
80e6b6df 2546The value can be @code{nil} (don't use parity), the symbol
c73e02fa 2547@code{odd} (use odd parity), or the symbol @code{even} (use even
80e6b6df 2548parity). If @var{parity} is not given, it defaults to no parity.
c73e02fa
GM
2549
2550@item :stopbits @var{stopbits}
80e6b6df
EZ
2551The number of stopbits used to terminate a transmission
2552of each byte. @var{stopbits} can be 1 or 2. If @var{stopbits} is not
2553given or @code{nil}, it defaults to 1.
c73e02fa
GM
2554
2555@item :flowcontrol @var{flowcontrol}
80e6b6df
EZ
2556The type of flow control to use for this connection, which is either
2557@code{nil} (don't use flow control), the symbol @code{hw} (use RTS/CTS
2558hardware flow control), or the symbol @code{sw} (use XON/XOFF software
2559flow control). If @var{flowcontrol} is not given, it defaults to no
2560flow control.
c73e02fa
GM
2561@end table
2562
2563@code{serial-process-configure} is called by @code{make-serial-process} for the
2564initial configuration of the serial port.
2565
2566Examples:
2567
2568@example
2569(serial-process-configure :process "/dev/ttyS0" :speed 1200)
2570
57eedec1
GM
2571(serial-process-configure :buffer "COM1" :stopbits 1
2572 :parity 'odd :flowcontrol 'hw)
c73e02fa
GM
2573
2574(serial-process-configure :port "\\\\.\\COM13" :bytesize 7)
2575@end example
2576@end defun
2577
b8d4c8d0
GM
2578@node Byte Packing
2579@section Packing and Unpacking Byte Arrays
2580@cindex byte packing and unpacking
2581
2582 This section describes how to pack and unpack arrays of bytes,
2583usually for binary network protocols. These functions convert byte arrays
2584to alists, and vice versa. The byte array can be represented as a
2585unibyte string or as a vector of integers, while the alist associates
2586symbols either with fixed-size objects or with recursive sub-alists.
2587
2588@cindex serializing
2589@cindex deserializing
2590@cindex packing
2591@cindex unpacking
2592 Conversion from byte arrays to nested alists is also known as
2593@dfn{deserializing} or @dfn{unpacking}, while going in the opposite
2594direction is also known as @dfn{serializing} or @dfn{packing}.
2595
2596@menu
2597* Bindat Spec:: Describing data layout.
2598* Bindat Functions:: Doing the unpacking and packing.
2599* Bindat Examples:: Samples of what bindat.el can do for you!
2600@end menu
2601
2602@node Bindat Spec
2603@subsection Describing Data Layout
2604
2605 To control unpacking and packing, you write a @dfn{data layout
2606specification}, a special nested list describing named and typed
2607@dfn{fields}. This specification controls length of each field to be
2608processed, and how to pack or unpack it. We normally keep bindat specs
2609in variables whose names end in @samp{-bindat-spec}; that kind of name
2610is automatically recognized as ``risky.''
2611
2612@cindex endianness
2613@cindex big endian
2614@cindex little endian
2615@cindex network byte ordering
2616 A field's @dfn{type} describes the size (in bytes) of the object
2617that the field represents and, in the case of multibyte fields, how
2618the bytes are ordered within the field. The two possible orderings
2619are ``big endian'' (also known as ``network byte ordering'') and
2620``little endian.'' For instance, the number @code{#x23cd} (decimal
26219165) in big endian would be the two bytes @code{#x23} @code{#xcd};
2622and in little endian, @code{#xcd} @code{#x23}. Here are the possible
2623type values:
2624
2625@table @code
2626@item u8
2627@itemx byte
2628Unsigned byte, with length 1.
2629
2630@item u16
2631@itemx word
2632@itemx short
2633Unsigned integer in network byte order, with length 2.
2634
2635@item u24
2636Unsigned integer in network byte order, with length 3.
2637
2638@item u32
2639@itemx dword
2640@itemx long
2641Unsigned integer in network byte order, with length 4.
2642Note: These values may be limited by Emacs' integer implementation limits.
2643
2644@item u16r
2645@itemx u24r
2646@itemx u32r
2647Unsigned integer in little endian order, with length 2, 3 and 4, respectively.
2648
2649@item str @var{len}
2650String of length @var{len}.
2651
2652@item strz @var{len}
2653Zero-terminated string, in a fixed-size field with length @var{len}.
2654
2655@item vec @var{len} [@var{type}]
2656Vector of @var{len} elements of type @var{type}, or bytes if not
2657@var{type} is specified.
2658The @var{type} is any of the simple types above, or another vector
2659specified as a list @code{(vec @var{len} [@var{type}])}.
2660
2661@item ip
2662Four-byte vector representing an Internet address. For example:
2663@code{[127 0 0 1]} for localhost.
2664
2665@item bits @var{len}
2666List of set bits in @var{len} bytes. The bytes are taken in big
2667endian order and the bits are numbered starting with @code{8 *
2668@var{len} @minus{} 1} and ending with zero. For example: @code{bits
26692} unpacks @code{#x28} @code{#x1c} to @code{(2 3 4 11 13)} and
2670@code{#x1c} @code{#x28} to @code{(3 5 10 11 12)}.
2671
2672@item (eval @var{form})
2673@var{form} is a Lisp expression evaluated at the moment the field is
2674unpacked or packed. The result of the evaluation should be one of the
2675above-listed type specifications.
2676@end table
2677
2678For a fixed-size field, the length @var{len} is given as an integer
2679specifying the number of bytes in the field.
2680
2681When the length of a field is not fixed, it typically depends on the
2682value of a preceding field. In this case, the length @var{len} can be
2683given either as a list @code{(@var{name} ...)} identifying a
2684@dfn{field name} in the format specified for @code{bindat-get-field}
2685below, or by an expression @code{(eval @var{form})} where @var{form}
2686should evaluate to an integer, specifying the field length.
2687
2688A field specification generally has the form @code{([@var{name}]
2689@var{handler})}. The square braces indicate that @var{name} is
2690optional. (Don't use names that are symbols meaningful as type
2691specifications (above) or handler specifications (below), since that
2692would be ambiguous.) @var{name} can be a symbol or the expression
2693@code{(eval @var{form})}, in which case @var{form} should evaluate to
2694a symbol.
2695
2696@var{handler} describes how to unpack or pack the field and can be one
2697of the following:
2698
2699@table @code
2700@item @var{type}
2701Unpack/pack this field according to the type specification @var{type}.
2702
2703@item eval @var{form}
2704Evaluate @var{form}, a Lisp expression, for side-effect only. If the
2705field name is specified, the value is bound to that field name.
2706
2707@item fill @var{len}
2708Skip @var{len} bytes. In packing, this leaves them unchanged,
2709which normally means they remain zero. In unpacking, this means
2710they are ignored.
2711
2712@item align @var{len}
2713Skip to the next multiple of @var{len} bytes.
2714
2715@item struct @var{spec-name}
2716Process @var{spec-name} as a sub-specification. This describes a
2717structure nested within another structure.
2718
2719@item union @var{form} (@var{tag} @var{spec})@dots{}
2720@c ??? I don't see how one would actually use this.
2721@c ??? what kind of expression would be useful for @var{form}?
2722Evaluate @var{form}, a Lisp expression, find the first @var{tag}
2723that matches it, and process its associated data layout specification
2724@var{spec}. Matching can occur in one of three ways:
2725
2726@itemize
2727@item
2728If a @var{tag} has the form @code{(eval @var{expr})}, evaluate
2729@var{expr} with the variable @code{tag} dynamically bound to the value
2730of @var{form}. A non-@code{nil} result indicates a match.
2731
2732@item
2733@var{tag} matches if it is @code{equal} to the value of @var{form}.
2734
2735@item
2736@var{tag} matches unconditionally if it is @code{t}.
2737@end itemize
2738
2739@item repeat @var{count} @var{field-specs}@dots{}
2740Process the @var{field-specs} recursively, in order, then repeat
2741starting from the first one, processing all the specs @var{count}
2742times overall. The @var{count} is given using the same formats as a
2743field length---if an @code{eval} form is used, it is evaluated just once.
2744For correct operation, each spec in @var{field-specs} must include a name.
2745@end table
2746
2747For the @code{(eval @var{form})} forms used in a bindat specification,
2748the @var{form} can access and update these dynamically bound variables
2749during evaluation:
2750
2751@table @code
2752@item last
2753Value of the last field processed.
2754
2755@item bindat-raw
2756The data as a byte array.
2757
2758@item bindat-idx
2759Current index (within @code{bindat-raw}) for unpacking or packing.
2760
2761@item struct
2762The alist containing the structured data that have been unpacked so
2763far, or the entire structure being packed. You can use
2764@code{bindat-get-field} to access specific fields of this structure.
2765
2766@item count
2767@itemx index
2768Inside a @code{repeat} block, these contain the maximum number of
2769repetitions (as specified by the @var{count} parameter), and the
2770current repetition number (counting from 0). Setting @code{count} to
2771zero will terminate the inner-most repeat block after the current
2772repetition has completed.
2773@end table
2774
2775@node Bindat Functions
2776@subsection Functions to Unpack and Pack Bytes
2777
2778 In the following documentation, @var{spec} refers to a data layout
2779specification, @code{bindat-raw} to a byte array, and @var{struct} to an
2780alist representing unpacked field data.
2781
2782@defun bindat-unpack spec bindat-raw &optional bindat-idx
2783This function unpacks data from the unibyte string or byte
2784array @code{bindat-raw}
2785according to @var{spec}. Normally this starts unpacking at the
2786beginning of the byte array, but if @var{bindat-idx} is non-@code{nil}, it
2787specifies a zero-based starting position to use instead.
2788
2789The value is an alist or nested alist in which each element describes
2790one unpacked field.
2791@end defun
2792
2793@defun bindat-get-field struct &rest name
2794This function selects a field's data from the nested alist
2795@var{struct}. Usually @var{struct} was returned by
2796@code{bindat-unpack}. If @var{name} corresponds to just one argument,
2797that means to extract a top-level field value. Multiple @var{name}
2798arguments specify repeated lookup of sub-structures. An integer name
2799acts as an array index.
2800
2801For example, if @var{name} is @code{(a b 2 c)}, that means to find
2802field @code{c} in the third element of subfield @code{b} of field
2803@code{a}. (This corresponds to @code{struct.a.b[2].c} in C.)
2804@end defun
2805
2806 Although packing and unpacking operations change the organization of
2807data (in memory), they preserve the data's @dfn{total length}, which is
2808the sum of all the fields' lengths, in bytes. This value is not
2809generally inherent in either the specification or alist alone; instead,
2810both pieces of information contribute to its calculation. Likewise, the
2811length of a string or array being unpacked may be longer than the data's
2812total length as described by the specification.
2813
2814@defun bindat-length spec struct
2815This function returns the total length of the data in @var{struct},
2816according to @var{spec}.
2817@end defun
2818
2819@defun bindat-pack spec struct &optional bindat-raw bindat-idx
2820This function returns a byte array packed according to @var{spec} from
2821the data in the alist @var{struct}. Normally it creates and fills a
2822new byte array starting at the beginning. However, if @var{bindat-raw}
2823is non-@code{nil}, it specifies a pre-allocated unibyte string or vector to
2824pack into. If @var{bindat-idx} is non-@code{nil}, it specifies the starting
2825offset for packing into @code{bindat-raw}.
2826
2827When pre-allocating, you should make sure @code{(length @var{bindat-raw})}
2828meets or exceeds the total length to avoid an out-of-range error.
2829@end defun
2830
2831@defun bindat-ip-to-string ip
2832Convert the Internet address vector @var{ip} to a string in the usual
2833dotted notation.
2834
2835@example
2836(bindat-ip-to-string [127 0 0 1])
2837 @result{} "127.0.0.1"
2838@end example
2839@end defun
2840
2841@node Bindat Examples
2842@subsection Examples of Byte Unpacking and Packing
2843
2844 Here is a complete example of byte unpacking and packing:
2845
2846@lisp
2847(defvar fcookie-index-spec
2848 '((:version u32)
2849 (:count u32)
2850 (:longest u32)
2851 (:shortest u32)
2852 (:flags u32)
2853 (:delim u8)
2854 (:ignored fill 3)
2855 (:offset repeat (:count)
2856 (:foo u32)))
2857 "Description of a fortune cookie index file's contents.")
2858
2859(defun fcookie (cookies &optional index)
2860 "Display a random fortune cookie from file COOKIES.
2861Optional second arg INDEX specifies the associated index
2862filename, which is by default constructed by appending
2863\".dat\" to COOKIES. Display cookie text in possibly
2864new buffer \"*Fortune Cookie: BASENAME*\" where BASENAME
2865is COOKIES without the directory part."
2866 (interactive "fCookies file: ")
2867 (let* ((info (with-temp-buffer
2868 (insert-file-contents-literally
2869 (or index (concat cookies ".dat")))
2870 (bindat-unpack fcookie-index-spec
2871 (buffer-string))))
2872 (sel (random (bindat-get-field info :count)))
2873 (beg (cdar (bindat-get-field info :offset sel)))
2874 (end (or (cdar (bindat-get-field info
2875 :offset (1+ sel)))
2876 (nth 7 (file-attributes cookies)))))
2877 (switch-to-buffer
2878 (get-buffer-create
2879 (format "*Fortune Cookie: %s*"
2880 (file-name-nondirectory cookies))))
2881 (erase-buffer)
2882 (insert-file-contents-literally
2883 cookies nil beg (- end 3))))
2884
2885(defun fcookie-create-index (cookies &optional index delim)
2886 "Scan file COOKIES, and write out its index file.
2887Optional second arg INDEX specifies the index filename,
2888which is by default constructed by appending \".dat\" to
2889COOKIES. Optional third arg DELIM specifies the unibyte
2890character which, when found on a line of its own in
2891COOKIES, indicates the border between entries."
2892 (interactive "fCookies file: ")
2893 (setq delim (or delim ?%))
2894 (let ((delim-line (format "\n%c\n" delim))
2895 (count 0)
2896 (max 0)
2897 min p q len offsets)
2898 (unless (= 3 (string-bytes delim-line))
2899 (error "Delimiter cannot be represented in one byte"))
2900 (with-temp-buffer
2901 (insert-file-contents-literally cookies)
2902 (while (and (setq p (point))
2903 (search-forward delim-line (point-max) t)
2904 (setq len (- (point) 3 p)))
2905 (setq count (1+ count)
2906 max (max max len)
2907 min (min (or min max) len)
2908 offsets (cons (1- p) offsets))))
2909 (with-temp-buffer
2910 (set-buffer-multibyte nil)
2911 (insert
2912 (bindat-pack
2913 fcookie-index-spec
2914 `((:version . 2)
2915 (:count . ,count)
2916 (:longest . ,max)
2917 (:shortest . ,min)
2918 (:flags . 0)
2919 (:delim . ,delim)
2920 (:offset . ,(mapcar (lambda (o)
2921 (list (cons :foo o)))
2922 (nreverse offsets))))))
2923 (let ((coding-system-for-write 'raw-text-unix))
2924 (write-file (or index (concat cookies ".dat")))))))
2925@end lisp
2926
2927Following is an example of defining and unpacking a complex structure.
2928Consider the following C structures:
2929
2930@example
2931struct header @{
2932 unsigned long dest_ip;
2933 unsigned long src_ip;
2934 unsigned short dest_port;
2935 unsigned short src_port;
2936@};
2937
2938struct data @{
2939 unsigned char type;
2940 unsigned char opcode;
2941 unsigned short length; /* In network byte order */
2942 unsigned char id[8]; /* null-terminated string */
2943 unsigned char data[/* (length + 3) & ~3 */];
2944@};
2945
2946struct packet @{
2947 struct header header;
2948 unsigned long counters[2]; /* In little endian order */
2949 unsigned char items;
2950 unsigned char filler[3];
2951 struct data item[/* items */];
2952
2953@};
2954@end example
2955
2956The corresponding data layout specification:
2957
2958@lisp
2959(setq header-spec
2960 '((dest-ip ip)
2961 (src-ip ip)
2962 (dest-port u16)
2963 (src-port u16)))
2964
2965(setq data-spec
2966 '((type u8)
2967 (opcode u8)
2968 (length u16) ;; network byte order
2969 (id strz 8)
2970 (data vec (length))
2971 (align 4)))
2972
2973(setq packet-spec
2974 '((header struct header-spec)
2975 (counters vec 2 u32r) ;; little endian order
2976 (items u8)
2977 (fill 3)
2978 (item repeat (items)
2979 (struct data-spec))))
2980@end lisp
2981
2982A binary data representation:
2983
2984@lisp
2985(setq binary-data
2986 [ 192 168 1 100 192 168 1 101 01 28 21 32
2987 160 134 1 0 5 1 0 0 2 0 0 0
2988 2 3 0 5 ?A ?B ?C ?D ?E ?F 0 0 1 2 3 4 5 0 0 0
2989 1 4 0 7 ?B ?C ?D ?E ?F ?G 0 0 6 7 8 9 10 11 12 0 ])
2990@end lisp
2991
2992The corresponding decoded structure:
2993
2994@lisp
2995(setq decoded (bindat-unpack packet-spec binary-data))
2996 @result{}
2997((header
2998 (dest-ip . [192 168 1 100])
2999 (src-ip . [192 168 1 101])
3000 (dest-port . 284)
3001 (src-port . 5408))
3002 (counters . [100000 261])
3003 (items . 2)
3004 (item ((data . [1 2 3 4 5])
3005 (id . "ABCDEF")
3006 (length . 5)
3007 (opcode . 3)
3008 (type . 2))
3009 ((data . [6 7 8 9 10 11 12])
3010 (id . "BCDEFG")
3011 (length . 7)
3012 (opcode . 4)
3013 (type . 1))))
3014@end lisp
3015
3016Fetching data from this structure:
3017
3018@lisp
3019(bindat-get-field decoded 'item 1 'id)
3020 @result{} "BCDEFG"
3021@end lisp