(Processor Run Time): Fix typo.
[bpt/emacs.git] / doc / lispref / processes.texi
1 @c -*-texinfo-*-
2 @c This is part of the GNU Emacs Lisp Reference Manual.
3 @c Copyright (C) 1990, 1991, 1992, 1993, 1994, 1995, 1998, 1999, 2001,
4 @c 2002, 2003, 2004, 2005, 2006, 2007, 2008 Free Software Foundation, Inc.
5 @c See the file elisp.texi for copying conditions.
6 @setfilename ../../info/processes
7 @node Processes, Display, Abbrevs, Top
8 @chapter Processes
9 @cindex child process
10 @cindex parent process
11 @cindex subprocess
12 @cindex process
13
14 In the terminology of operating systems, a @dfn{process} is a space in
15 which a program can execute. Emacs runs in a process. Emacs Lisp
16 programs can invoke other programs in processes of their own. These are
17 called @dfn{subprocesses} or @dfn{child processes} of the Emacs process,
18 which is their @dfn{parent process}.
19
20 A subprocess of Emacs may be @dfn{synchronous} or @dfn{asynchronous},
21 depending on how it is created. When you create a synchronous
22 subprocess, the Lisp program waits for the subprocess to terminate
23 before continuing execution. When you create an asynchronous
24 subprocess, it can run in parallel with the Lisp program. This kind of
25 subprocess is represented within Emacs by a Lisp object which is also
26 called a ``process.'' Lisp programs can use this object to communicate
27 with the subprocess or to control it. For example, you can send
28 signals, obtain status information, receive output from the process, or
29 send input to it.
30
31 @defun processp object
32 This function returns @code{t} if @var{object} represents an Emacs
33 subprocess, @code{nil} otherwise.
34 @end defun
35
36 In addition to subprocesses of the current Emacs session, you can
37 also access other processes running on your machine. @xref{System
38 Processes}.
39
40 @menu
41 * Subprocess Creation:: Functions that start subprocesses.
42 * Shell Arguments:: Quoting an argument to pass it to a shell.
43 * Synchronous Processes:: Details of using synchronous subprocesses.
44 * Asynchronous Processes:: Starting up an asynchronous subprocess.
45 * Deleting Processes:: Eliminating an asynchronous subprocess.
46 * Process Information:: Accessing run-status and other attributes.
47 * Input to Processes:: Sending input to an asynchronous subprocess.
48 * Signals to Processes:: Stopping, continuing or interrupting
49 an asynchronous subprocess.
50 * Output from Processes:: Collecting output from an asynchronous subprocess.
51 * Sentinels:: Sentinels run when process run-status changes.
52 * Query Before Exit:: Whether to query if exiting will kill a process.
53 * System Processes:: Accessing other processes running on your system.
54 * Transaction Queues:: Transaction-based communication with subprocesses.
55 * Network:: Opening network connections.
56 * Network Servers:: Network servers let Emacs accept net connections.
57 * Datagrams:: UDP network connections.
58 * Low-Level Network:: Lower-level but more general function
59 to create connections and servers.
60 * Misc Network:: Additional relevant functions for network connections.
61 * Serial Ports:: Communicating with serial ports.
62 * Byte Packing:: Using bindat to pack and unpack binary data.
63 @end menu
64
65 @node Subprocess Creation
66 @section Functions that Create Subprocesses
67
68 There are three primitives that create a new subprocess in which to run
69 a program. One of them, @code{start-process}, creates an asynchronous
70 process and returns a process object (@pxref{Asynchronous Processes}).
71 The other two, @code{call-process} and @code{call-process-region},
72 create a synchronous process and do not return a process object
73 (@pxref{Synchronous Processes}).
74
75 Synchronous and asynchronous processes are explained in the following
76 sections. Since the three functions are all called in a similar
77 fashion, their common arguments are described here.
78
79 @cindex execute program
80 @cindex @code{PATH} environment variable
81 @cindex @code{HOME} environment variable
82 In all cases, the function's @var{program} argument specifies the
83 program to be run. An error is signaled if the file is not found or
84 cannot be executed. If the file name is relative, the variable
85 @code{exec-path} contains a list of directories to search. Emacs
86 initializes @code{exec-path} when it starts up, based on the value of
87 the environment variable @code{PATH}. The standard file name
88 constructs, @samp{~}, @samp{.}, and @samp{..}, are interpreted as
89 usual in @code{exec-path}, but environment variable substitutions
90 (@samp{$HOME}, etc.) are not recognized; use
91 @code{substitute-in-file-name} to perform them (@pxref{File Name
92 Expansion}). @code{nil} in this list refers to
93 @code{default-directory}.
94
95 Executing a program can also try adding suffixes to the specified
96 name:
97
98 @defvar exec-suffixes
99 This variable is a list of suffixes (strings) to try adding to the
100 specified program file name. The list should include @code{""} if you
101 want the name to be tried exactly as specified. The default value is
102 system-dependent.
103 @end defvar
104
105 @strong{Please note:} The argument @var{program} contains only the
106 name of the program; it may not contain any command-line arguments. You
107 must use @var{args} to provide those.
108
109 Each of the subprocess-creating functions has a @var{buffer-or-name}
110 argument which specifies where the standard output from the program will
111 go. It should be a buffer or a buffer name; if it is a buffer name,
112 that will create the buffer if it does not already exist. It can also
113 be @code{nil}, which says to discard the output unless a filter function
114 handles it. (@xref{Filter Functions}, and @ref{Read and Print}.)
115 Normally, you should avoid having multiple processes send output to the
116 same buffer because their output would be intermixed randomly.
117
118 @cindex program arguments
119 All three of the subprocess-creating functions have a @code{&rest}
120 argument, @var{args}. The @var{args} must all be strings, and they are
121 supplied to @var{program} as separate command line arguments. Wildcard
122 characters and other shell constructs have no special meanings in these
123 strings, since the strings are passed directly to the specified program.
124
125 The subprocess gets its current directory from the value of
126 @code{default-directory} (@pxref{File Name Expansion}).
127
128 @cindex environment variables, subprocesses
129 The subprocess inherits its environment from Emacs, but you can
130 specify overrides for it with @code{process-environment}. @xref{System
131 Environment}.
132
133 @defvar exec-directory
134 @pindex movemail
135 The value of this variable is a string, the name of a directory that
136 contains programs that come with GNU Emacs, programs intended for Emacs
137 to invoke. The program @code{movemail} is an example of such a program;
138 Rmail uses it to fetch new mail from an inbox.
139 @end defvar
140
141 @defopt exec-path
142 The value of this variable is a list of directories to search for
143 programs to run in subprocesses. Each element is either the name of a
144 directory (i.e., a string), or @code{nil}, which stands for the default
145 directory (which is the value of @code{default-directory}).
146 @cindex program directories
147
148 The value of @code{exec-path} is used by @code{call-process} and
149 @code{start-process} when the @var{program} argument is not an absolute
150 file name.
151 @end defopt
152
153 @node Shell Arguments
154 @section Shell Arguments
155 @cindex arguments for shell commands
156 @cindex shell command arguments
157
158 Lisp programs sometimes need to run a shell and give it a command
159 that contains file names that were specified by the user. These
160 programs ought to be able to support any valid file name. But the shell
161 gives special treatment to certain characters, and if these characters
162 occur in the file name, they will confuse the shell. To handle these
163 characters, use the function @code{shell-quote-argument}:
164
165 @defun shell-quote-argument argument
166 This function returns a string which represents, in shell syntax,
167 an argument whose actual contents are @var{argument}. It should
168 work reliably to concatenate the return value into a shell command
169 and then pass it to a shell for execution.
170
171 Precisely what this function does depends on your operating system. The
172 function is designed to work with the syntax of your system's standard
173 shell; if you use an unusual shell, you will need to redefine this
174 function.
175
176 @example
177 ;; @r{This example shows the behavior on GNU and Unix systems.}
178 (shell-quote-argument "foo > bar")
179 @result{} "foo\\ \\>\\ bar"
180
181 ;; @r{This example shows the behavior on MS-DOS and MS-Windows.}
182 (shell-quote-argument "foo > bar")
183 @result{} "\"foo > bar\""
184 @end example
185
186 Here's an example of using @code{shell-quote-argument} to construct
187 a shell command:
188
189 @example
190 (concat "diff -c "
191 (shell-quote-argument oldfile)
192 " "
193 (shell-quote-argument newfile))
194 @end example
195 @end defun
196
197 @cindex quoting and unquoting shell command line
198 The following two functions help creating shell commands from
199 individual argument strings and taking shell command lines apart into
200 individual arguments.
201
202 @defun split-string-and-unquote string &optional separators
203 This function splits @var{string} into substrings at matches for the
204 regular expression @var{separators}, like @code{split-string} does
205 (@pxref{Creating Strings}), but it additionally removes quoting from
206 the substrings. It then makes a list of the substrings and returns
207 it.
208
209 If @var{separators} is omitted or nil, it defaults to @code{"\\s-+"},
210 which is a regular expression that matches one or more characters with
211 whitespace syntax (@pxref{Syntax Class Table}).
212
213 The quoting this function supports is of 2 styles: by enclosing a
214 whole string in double quotes @code{"@dots{}"}, or by quoting
215 individual characters with a backslash escape @samp{\}. The latter is
216 also used in Lisp strings, so this function can handle those as well.
217 @end defun
218
219 @defun combine-and-quote-strings list-of-strings &optional separator
220 This function concatenates @var{list-of-strings} into a single string,
221 quoting each string in the list that needs quoting as it goes. It
222 also sticks the @var{separator} string in between each pair of strings
223 in the result, and returns that result. If @var{separator} is omitted
224 or @code{nil}, it defaults to a blank @code{" "}.
225
226 The strings in @var{list-of-strings} that need quoting are those that
227 include @var{separator} as their substring. Quoting a string encloses
228 it in double quotes @code{"@dots{}"}. In the simplest case, if you
229 are consing a shell command from the individual command-line
230 arguments, every argument that includes embedded blanks will be
231 quoted.
232 @end defun
233
234 @node Synchronous Processes
235 @section Creating a Synchronous Process
236 @cindex synchronous subprocess
237
238 After a @dfn{synchronous process} is created, Emacs waits for the
239 process to terminate before continuing. Starting Dired on GNU or
240 Unix@footnote{On other systems, Emacs uses a Lisp emulation of
241 @code{ls}; see @ref{Contents of Directories}.} is an example of this: it
242 runs @code{ls} in a synchronous process, then modifies the output
243 slightly. Because the process is synchronous, the entire directory
244 listing arrives in the buffer before Emacs tries to do anything with it.
245
246 While Emacs waits for the synchronous subprocess to terminate, the
247 user can quit by typing @kbd{C-g}. The first @kbd{C-g} tries to kill
248 the subprocess with a @code{SIGINT} signal; but it waits until the
249 subprocess actually terminates before quitting. If during that time the
250 user types another @kbd{C-g}, that kills the subprocess instantly with
251 @code{SIGKILL} and quits immediately (except on MS-DOS, where killing
252 other processes doesn't work). @xref{Quitting}.
253
254 The synchronous subprocess functions return an indication of how the
255 process terminated.
256
257 The output from a synchronous subprocess is generally decoded using a
258 coding system, much like text read from a file. The input sent to a
259 subprocess by @code{call-process-region} is encoded using a coding
260 system, much like text written into a file. @xref{Coding Systems}.
261
262 @defun call-process program &optional infile destination display &rest args
263 This function calls @var{program} in a separate process and waits for
264 it to finish.
265
266 The standard input for the process comes from file @var{infile} if
267 @var{infile} is not @code{nil}, and from the null device otherwise.
268 The argument @var{destination} says where to put the process output.
269 Here are the possibilities:
270
271 @table @asis
272 @item a buffer
273 Insert the output in that buffer, before point. This includes both the
274 standard output stream and the standard error stream of the process.
275
276 @item a string
277 Insert the output in a buffer with that name, before point.
278
279 @item @code{t}
280 Insert the output in the current buffer, before point.
281
282 @item @code{nil}
283 Discard the output.
284
285 @item 0
286 Discard the output, and return @code{nil} immediately without waiting
287 for the subprocess to finish.
288
289 In this case, the process is not truly synchronous, since it can run in
290 parallel with Emacs; but you can think of it as synchronous in that
291 Emacs is essentially finished with the subprocess as soon as this
292 function returns.
293
294 MS-DOS doesn't support asynchronous subprocesses, so this option doesn't
295 work there.
296
297 @item @code{(@var{real-destination} @var{error-destination})}
298 Keep the standard output stream separate from the standard error stream;
299 deal with the ordinary output as specified by @var{real-destination},
300 and dispose of the error output according to @var{error-destination}.
301 If @var{error-destination} is @code{nil}, that means to discard the
302 error output, @code{t} means mix it with the ordinary output, and a
303 string specifies a file name to redirect error output into.
304
305 You can't directly specify a buffer to put the error output in; that is
306 too difficult to implement. But you can achieve this result by sending
307 the error output to a temporary file and then inserting the file into a
308 buffer.
309 @end table
310
311 If @var{display} is non-@code{nil}, then @code{call-process} redisplays
312 the buffer as output is inserted. (However, if the coding system chosen
313 for decoding output is @code{undecided}, meaning deduce the encoding
314 from the actual data, then redisplay sometimes cannot continue once
315 non-@acronym{ASCII} characters are encountered. There are fundamental
316 reasons why it is hard to fix this; see @ref{Output from Processes}.)
317
318 Otherwise the function @code{call-process} does no redisplay, and the
319 results become visible on the screen only when Emacs redisplays that
320 buffer in the normal course of events.
321
322 The remaining arguments, @var{args}, are strings that specify command
323 line arguments for the program.
324
325 The value returned by @code{call-process} (unless you told it not to
326 wait) indicates the reason for process termination. A number gives the
327 exit status of the subprocess; 0 means success, and any other value
328 means failure. If the process terminated with a signal,
329 @code{call-process} returns a string describing the signal.
330
331 In the examples below, the buffer @samp{foo} is current.
332
333 @smallexample
334 @group
335 (call-process "pwd" nil t)
336 @result{} 0
337
338 ---------- Buffer: foo ----------
339 /usr/user/lewis/manual
340 ---------- Buffer: foo ----------
341 @end group
342
343 @group
344 (call-process "grep" nil "bar" nil "lewis" "/etc/passwd")
345 @result{} 0
346
347 ---------- Buffer: bar ----------
348 lewis:5LTsHm66CSWKg:398:21:Bil Lewis:/user/lewis:/bin/csh
349
350 ---------- Buffer: bar ----------
351 @end group
352 @end smallexample
353
354 Here is a good example of the use of @code{call-process}, which used to
355 be found in the definition of @code{insert-directory}:
356
357 @smallexample
358 @group
359 (call-process insert-directory-program nil t nil @var{switches}
360 (if full-directory-p
361 (concat (file-name-as-directory file) ".")
362 file))
363 @end group
364 @end smallexample
365 @end defun
366
367 @defun process-file program &optional infile buffer display &rest args
368 This function processes files synchronously in a separate process. It
369 is similar to @code{call-process} but may invoke a file handler based
370 on the value of the variable @code{default-directory}. The current
371 working directory of the subprocess is @code{default-directory}.
372
373 The arguments are handled in almost the same way as for
374 @code{call-process}, with the following differences:
375
376 Some file handlers may not support all combinations and forms of the
377 arguments @var{infile}, @var{buffer}, and @var{display}. For example,
378 some file handlers might behave as if @var{display} were @code{nil},
379 regardless of the value actually passed. As another example, some
380 file handlers might not support separating standard output and error
381 output by way of the @var{buffer} argument.
382
383 If a file handler is invoked, it determines the program to run based
384 on the first argument @var{program}. For instance, consider that a
385 handler for remote files is invoked. Then the path that is used for
386 searching the program might be different than @code{exec-path}.
387
388 The second argument @var{infile} may invoke a file handler. The file
389 handler could be different from the handler chosen for the
390 @code{process-file} function itself. (For example,
391 @code{default-directory} could be on a remote host, whereas
392 @var{infile} is on another remote host. Or @code{default-directory}
393 could be non-special, whereas @var{infile} is on a remote host.)
394
395 If @var{buffer} is a list of the form @code{(@var{real-destination}
396 @var{error-destination})}, and @var{error-destination} names a file,
397 then the same remarks as for @var{infile} apply.
398
399 The remaining arguments (@var{args}) will be passed to the process
400 verbatim. Emacs is not involved in processing file names that are
401 present in @var{args}. To avoid confusion, it may be best to avoid
402 absolute file names in @var{args}, but rather to specify all file
403 names as relative to @code{default-directory}. The function
404 @code{file-relative-name} is useful for constructing such relative
405 file names.
406 @end defun
407
408 @defun call-process-region start end program &optional delete destination display &rest args
409 This function sends the text from @var{start} to @var{end} as
410 standard input to a process running @var{program}. It deletes the text
411 sent if @var{delete} is non-@code{nil}; this is useful when
412 @var{destination} is @code{t}, to insert the output in the current
413 buffer in place of the input.
414
415 The arguments @var{destination} and @var{display} control what to do
416 with the output from the subprocess, and whether to update the display
417 as it comes in. For details, see the description of
418 @code{call-process}, above. If @var{destination} is the integer 0,
419 @code{call-process-region} discards the output and returns @code{nil}
420 immediately, without waiting for the subprocess to finish (this only
421 works if asynchronous subprocesses are supported).
422
423 The remaining arguments, @var{args}, are strings that specify command
424 line arguments for the program.
425
426 The return value of @code{call-process-region} is just like that of
427 @code{call-process}: @code{nil} if you told it to return without
428 waiting; otherwise, a number or string which indicates how the
429 subprocess terminated.
430
431 In the following example, we use @code{call-process-region} to run the
432 @code{cat} utility, with standard input being the first five characters
433 in buffer @samp{foo} (the word @samp{input}). @code{cat} copies its
434 standard input into its standard output. Since the argument
435 @var{destination} is @code{t}, this output is inserted in the current
436 buffer.
437
438 @smallexample
439 @group
440 ---------- Buffer: foo ----------
441 input@point{}
442 ---------- Buffer: foo ----------
443 @end group
444
445 @group
446 (call-process-region 1 6 "cat" nil t)
447 @result{} 0
448
449 ---------- Buffer: foo ----------
450 inputinput@point{}
451 ---------- Buffer: foo ----------
452 @end group
453 @end smallexample
454
455 The @code{shell-command-on-region} command uses
456 @code{call-process-region} like this:
457
458 @smallexample
459 @group
460 (call-process-region
461 start end
462 shell-file-name ; @r{Name of program.}
463 nil ; @r{Do not delete region.}
464 buffer ; @r{Send output to @code{buffer}.}
465 nil ; @r{No redisplay during output.}
466 "-c" command) ; @r{Arguments for the shell.}
467 @end group
468 @end smallexample
469 @end defun
470
471 @defun call-process-shell-command command &optional infile destination display &rest args
472 This function executes the shell command @var{command} synchronously
473 in a separate process. The final arguments @var{args} are additional
474 arguments to add at the end of @var{command}. The other arguments
475 are handled as in @code{call-process}.
476 @end defun
477
478 @defun process-file-shell-command command &optional infile destination display &rest args
479 This function is like @code{call-process-shell-command}, but uses
480 @code{process-file} internally. Depending on @code{default-directory},
481 @var{command} can be executed also on remote hosts.
482 @end defun
483
484 @defun shell-command-to-string command
485 This function executes @var{command} (a string) as a shell command,
486 then returns the command's output as a string.
487 @end defun
488
489 @defun process-lines program &rest args
490 This function runs @var{program} in a separate process, waits for it
491 to finish, and returns its output as a list of strings. Each string
492 in the list holds a single line of text output by the program; the
493 end-of-line characters are stripped from each line. The arguments
494 beyond @var{program}, @var{args}, are strings that specify
495 command-line arguments with which to run the program.
496
497 If @var{program} exits with a non-zero exit status, this function
498 signals an error.
499
500 This function works by calling @code{call-process}, so program output
501 is decoded in the same way as for @code{call-process}.
502 @end defun
503
504 @node Asynchronous Processes
505 @section Creating an Asynchronous Process
506 @cindex asynchronous subprocess
507
508 After an @dfn{asynchronous process} is created, Emacs and the subprocess
509 both continue running immediately. The process thereafter runs
510 in parallel with Emacs, and the two can communicate with each other
511 using the functions described in the following sections. However,
512 communication is only partially asynchronous: Emacs sends data to the
513 process only when certain functions are called, and Emacs accepts data
514 from the process only when Emacs is waiting for input or for a time
515 delay.
516
517 Here we describe how to create an asynchronous process.
518
519 @defun start-process name buffer-or-name program &rest args
520 This function creates a new asynchronous subprocess and starts the
521 program @var{program} running in it. It returns a process object that
522 stands for the new subprocess in Lisp. The argument @var{name}
523 specifies the name for the process object; if a process with this name
524 already exists, then @var{name} is modified (by appending @samp{<1>},
525 etc.) to be unique. The buffer @var{buffer-or-name} is the buffer to
526 associate with the process.
527
528 The remaining arguments, @var{args}, are strings that specify command
529 line arguments for the program.
530
531 In the example below, the first process is started and runs (rather,
532 sleeps) for 100 seconds. Meanwhile, the second process is started, and
533 given the name @samp{my-process<1>} for the sake of uniqueness. It
534 inserts the directory listing at the end of the buffer @samp{foo},
535 before the first process finishes. Then it finishes, and a message to
536 that effect is inserted in the buffer. Much later, the first process
537 finishes, and another message is inserted in the buffer for it.
538
539 @smallexample
540 @group
541 (start-process "my-process" "foo" "sleep" "100")
542 @result{} #<process my-process>
543 @end group
544
545 @group
546 (start-process "my-process" "foo" "ls" "-l" "/user/lewis/bin")
547 @result{} #<process my-process<1>>
548
549 ---------- Buffer: foo ----------
550 total 2
551 lrwxrwxrwx 1 lewis 14 Jul 22 10:12 gnuemacs --> /emacs
552 -rwxrwxrwx 1 lewis 19 Jul 30 21:02 lemon
553
554 Process my-process<1> finished
555
556 Process my-process finished
557 ---------- Buffer: foo ----------
558 @end group
559 @end smallexample
560 @end defun
561
562 @defun start-file-process name buffer-or-name program &rest args
563 Like @code{start-process}, this function starts a new asynchronous
564 subprocess running @var{program} in it, and returns its process
565 object---when @code{default-directory} is not a magic file name.
566
567 If @code{default-directory} is magic, the function invokes its file
568 handler instead. This handler ought to run @var{program}, perhaps on
569 the local host, perhaps on a remote host that corresponds to
570 @code{default-directory}. In the latter case, the local part of
571 @code{default-directory} becomes the working directory of the process.
572
573 This function does not try to invoke file name handlers for
574 @var{program} or for the @var{program-args}.
575
576 Depending on the implementation of the file handler, it might not be
577 possible to apply @code{process-filter} or @code{process-sentinel} to
578 the resulting process object (@pxref{Filter Functions}, @pxref{Sentinels}).
579
580 Some file handlers may not support @code{start-file-process} (for
581 example @code{ange-ftp-hook-function}). In such cases, the function
582 does nothing and returns @code{nil}.
583 @end defun
584
585 @defun start-process-shell-command name buffer-or-name command &rest command-args
586 This function is like @code{start-process} except that it uses a shell
587 to execute the specified command. The argument @var{command} is a shell
588 command name, and @var{command-args} are the arguments for the shell
589 command. The variable @code{shell-file-name} specifies which shell to
590 use.
591
592 The point of running a program through the shell, rather than directly
593 with @code{start-process}, is so that you can employ shell features such
594 as wildcards in the arguments. It follows that if you include an
595 arbitrary user-specified arguments in the command, you should quote it
596 with @code{shell-quote-argument} first, so that any special shell
597 characters do @emph{not} have their special shell meanings. @xref{Shell
598 Arguments}.
599 @end defun
600
601 @defun start-file-process-shell-command name buffer-or-name command &rest command-args
602 This function is like @code{start-process-shell-command}, but uses
603 @code{start-file-process} internally. By this, @var{command} can be
604 executed also on remote hosts, depending on @code{default-directory}.
605 @end defun
606
607 @defvar process-connection-type
608 @cindex pipes
609 @cindex @acronym{PTY}s
610 This variable controls the type of device used to communicate with
611 asynchronous subprocesses. If it is non-@code{nil}, then @acronym{PTY}s are
612 used, when available. Otherwise, pipes are used.
613
614 @acronym{PTY}s are usually preferable for processes visible to the user, as
615 in Shell mode, because they allow job control (@kbd{C-c}, @kbd{C-z},
616 etc.) to work between the process and its children, whereas pipes do
617 not. For subprocesses used for internal purposes by programs, it is
618 often better to use a pipe, because they are more efficient. In
619 addition, the total number of @acronym{PTY}s is limited on many systems and
620 it is good not to waste them.
621
622 The value of @code{process-connection-type} takes effect when
623 @code{start-process} is called. So you can specify how to communicate
624 with one subprocess by binding the variable around the call to
625 @code{start-process}.
626
627 @smallexample
628 @group
629 (let ((process-connection-type nil)) ; @r{Use a pipe.}
630 (start-process @dots{}))
631 @end group
632 @end smallexample
633
634 To determine whether a given subprocess actually got a pipe or a
635 @acronym{PTY}, use the function @code{process-tty-name} (@pxref{Process
636 Information}).
637 @end defvar
638
639 @node Deleting Processes
640 @section Deleting Processes
641 @cindex deleting processes
642
643 @dfn{Deleting a process} disconnects Emacs immediately from the
644 subprocess. Processes are deleted automatically after they terminate,
645 but not necessarily right away. You can delete a process explicitly
646 at any time. If you delete a terminated process explicitly before it
647 is deleted automatically, no harm results. Deleting a running
648 process sends a signal to terminate it (and its child processes if
649 any), and calls the process sentinel if it has one. @xref{Sentinels}.
650
651 When a process is deleted, the process object itself continues to
652 exist as long as other Lisp objects point to it. All the Lisp
653 primitives that work on process objects accept deleted processes, but
654 those that do I/O or send signals will report an error. The process
655 mark continues to point to the same place as before, usually into a
656 buffer where output from the process was being inserted.
657
658 @defopt delete-exited-processes
659 This variable controls automatic deletion of processes that have
660 terminated (due to calling @code{exit} or to a signal). If it is
661 @code{nil}, then they continue to exist until the user runs
662 @code{list-processes}. Otherwise, they are deleted immediately after
663 they exit.
664 @end defopt
665
666 @defun delete-process process
667 This function deletes a process, killing it with a @code{SIGKILL}
668 signal. The argument may be a process, the name of a process, a
669 buffer, or the name of a buffer. (A buffer or buffer-name stands for
670 the process that @code{get-buffer-process} returns.) Calling
671 @code{delete-process} on a running process terminates it, updates the
672 process status, and runs the sentinel (if any) immediately. If the
673 process has already terminated, calling @code{delete-process} has no
674 effect on its status, or on the running of its sentinel (which will
675 happen sooner or later).
676
677 @smallexample
678 @group
679 (delete-process "*shell*")
680 @result{} nil
681 @end group
682 @end smallexample
683 @end defun
684
685 @node Process Information
686 @section Process Information
687
688 Several functions return information about processes.
689 @code{list-processes} is provided for interactive use.
690
691 @deffn Command list-processes &optional query-only
692 This command displays a listing of all living processes. In addition,
693 it finally deletes any process whose status was @samp{Exited} or
694 @samp{Signaled}. It returns @code{nil}.
695
696 If @var{query-only} is non-@code{nil} then it lists only processes
697 whose query flag is non-@code{nil}. @xref{Query Before Exit}.
698 @end deffn
699
700 @defun process-list
701 This function returns a list of all processes that have not been deleted.
702
703 @smallexample
704 @group
705 (process-list)
706 @result{} (#<process display-time> #<process shell>)
707 @end group
708 @end smallexample
709 @end defun
710
711 @defun get-process name
712 This function returns the process named @var{name}, or @code{nil} if
713 there is none. An error is signaled if @var{name} is not a string.
714
715 @smallexample
716 @group
717 (get-process "shell")
718 @result{} #<process shell>
719 @end group
720 @end smallexample
721 @end defun
722
723 @defun process-command process
724 This function returns the command that was executed to start
725 @var{process}. This is a list of strings, the first string being the
726 program executed and the rest of the strings being the arguments that
727 were given to the program.
728
729 @smallexample
730 @group
731 (process-command (get-process "shell"))
732 @result{} ("/bin/csh" "-i")
733 @end group
734 @end smallexample
735 @end defun
736
737 @defun process-contact process &optional key
738
739 This function returns information about how a network or serial
740 process was set up. For a network process, when @var{key} is
741 @code{nil}, it returns @code{(@var{hostname} @var{service})} which
742 specifies what you connected to. For a serial process, when @var{key}
743 is @code{nil}, it returns @code{(@var{port} @var{speed})}. For an
744 ordinary child process, this function always returns @code{t}.
745
746 If @var{key} is @code{t}, the value is the complete status information
747 for the connection, server, or serial port; that is, the list of
748 keywords and values specified in @code{make-network-process} or
749 @code{make-serial-process}, except that some of the values represent
750 the current status instead of what you specified.
751
752 For a network process:
753
754 @table @code
755 @item :buffer
756 The associated value is the process buffer.
757 @item :filter
758 The associated value is the process filter function.
759 @item :sentinel
760 The associated value is the process sentinel function.
761 @item :remote
762 In a connection, the address in internal format of the remote peer.
763 @item :local
764 The local address, in internal format.
765 @item :service
766 In a server, if you specified @code{t} for @var{service},
767 this value is the actual port number.
768 @end table
769
770 @code{:local} and @code{:remote} are included even if they were not
771 specified explicitly in @code{make-network-process}.
772
773 For a serial process, see @code{make-serial-process} and
774 @code{serial-process-configure} for a list of keys.
775
776 If @var{key} is a keyword, the function returns the value corresponding
777 to that keyword.
778 @end defun
779
780 @defun process-id process
781 This function returns the @acronym{PID} of @var{process}. This is an
782 integer that distinguishes the process @var{process} from all other
783 processes running on the same computer at the current time. The
784 @acronym{PID} of a process is chosen by the operating system kernel when the
785 process is started and remains constant as long as the process exists.
786 @end defun
787
788 @defun process-name process
789 This function returns the name of @var{process}.
790 @end defun
791
792 @defun process-status process-name
793 This function returns the status of @var{process-name} as a symbol.
794 The argument @var{process-name} must be a process, a buffer, or a
795 process name (a string).
796
797 The possible values for an actual subprocess are:
798
799 @table @code
800 @item run
801 for a process that is running.
802 @item stop
803 for a process that is stopped but continuable.
804 @item exit
805 for a process that has exited.
806 @item signal
807 for a process that has received a fatal signal.
808 @item open
809 for a network connection that is open.
810 @item closed
811 for a network connection that is closed. Once a connection
812 is closed, you cannot reopen it, though you might be able to open
813 a new connection to the same place.
814 @item connect
815 for a non-blocking connection that is waiting to complete.
816 @item failed
817 for a non-blocking connection that has failed to complete.
818 @item listen
819 for a network server that is listening.
820 @item nil
821 if @var{process-name} is not the name of an existing process.
822 @end table
823
824 @smallexample
825 @group
826 (process-status (get-buffer "*shell*"))
827 @result{} run
828 @end group
829 @group
830 x
831 @result{} #<process xx<1>>
832 (process-status x)
833 @result{} exit
834 @end group
835 @end smallexample
836
837 For a network connection, @code{process-status} returns one of the symbols
838 @code{open} or @code{closed}. The latter means that the other side
839 closed the connection, or Emacs did @code{delete-process}.
840 @end defun
841
842 @defun process-type process
843 This function returns the symbol @code{network} for a network
844 connection or server, @code{serial} for a serial port connection, or
845 @code{real} for a real subprocess.
846 @end defun
847
848 @defun process-exit-status process
849 This function returns the exit status of @var{process} or the signal
850 number that killed it. (Use the result of @code{process-status} to
851 determine which of those it is.) If @var{process} has not yet
852 terminated, the value is 0.
853 @end defun
854
855 @defun process-tty-name process
856 This function returns the terminal name that @var{process} is using for
857 its communication with Emacs---or @code{nil} if it is using pipes
858 instead of a terminal (see @code{process-connection-type} in
859 @ref{Asynchronous Processes}).
860 @end defun
861
862 @defun process-coding-system process
863 @anchor{Coding systems for a subprocess}
864 This function returns a cons cell describing the coding systems in use
865 for decoding output from @var{process} and for encoding input to
866 @var{process} (@pxref{Coding Systems}). The value has this form:
867
868 @example
869 (@var{coding-system-for-decoding} . @var{coding-system-for-encoding})
870 @end example
871 @end defun
872
873 @defun set-process-coding-system process &optional decoding-system encoding-system
874 This function specifies the coding systems to use for subsequent output
875 from and input to @var{process}. It will use @var{decoding-system} to
876 decode subprocess output, and @var{encoding-system} to encode subprocess
877 input.
878 @end defun
879
880 Every process also has a property list that you can use to store
881 miscellaneous values associated with the process.
882
883 @defun process-get process propname
884 This function returns the value of the @var{propname} property
885 of @var{process}.
886 @end defun
887
888 @defun process-put process propname value
889 This function sets the value of the @var{propname} property
890 of @var{process} to @var{value}.
891 @end defun
892
893 @defun process-plist process
894 This function returns the process plist of @var{process}.
895 @end defun
896
897 @defun set-process-plist process plist
898 This function sets the process plist of @var{process} to @var{plist}.
899 @end defun
900
901 @node Input to Processes
902 @section Sending Input to Processes
903 @cindex process input
904
905 Asynchronous subprocesses receive input when it is sent to them by
906 Emacs, which is done with the functions in this section. You must
907 specify the process to send input to, and the input data to send. The
908 data appears on the ``standard input'' of the subprocess.
909
910 Some operating systems have limited space for buffered input in a
911 @acronym{PTY}. On these systems, Emacs sends an @acronym{EOF}
912 periodically amidst the other characters, to force them through. For
913 most programs, these @acronym{EOF}s do no harm.
914
915 Subprocess input is normally encoded using a coding system before the
916 subprocess receives it, much like text written into a file. You can use
917 @code{set-process-coding-system} to specify which coding system to use
918 (@pxref{Process Information}). Otherwise, the coding system comes from
919 @code{coding-system-for-write}, if that is non-@code{nil}; or else from
920 the defaulting mechanism (@pxref{Default Coding Systems}).
921
922 Sometimes the system is unable to accept input for that process,
923 because the input buffer is full. When this happens, the send functions
924 wait a short while, accepting output from subprocesses, and then try
925 again. This gives the subprocess a chance to read more of its pending
926 input and make space in the buffer. It also allows filters, sentinels
927 and timers to run---so take account of that in writing your code.
928
929 In these functions, the @var{process} argument can be a process or
930 the name of a process, or a buffer or buffer name (which stands
931 for a process via @code{get-buffer-process}). @code{nil} means
932 the current buffer's process.
933
934 @defun process-send-string process string
935 This function sends @var{process} the contents of @var{string} as
936 standard input. If it is @code{nil}, the current buffer's process is used.
937
938 The function returns @code{nil}.
939
940 @smallexample
941 @group
942 (process-send-string "shell<1>" "ls\n")
943 @result{} nil
944 @end group
945
946
947 @group
948 ---------- Buffer: *shell* ----------
949 ...
950 introduction.texi syntax-tables.texi~
951 introduction.texi~ text.texi
952 introduction.txt text.texi~
953 ...
954 ---------- Buffer: *shell* ----------
955 @end group
956 @end smallexample
957 @end defun
958
959 @defun process-send-region process start end
960 This function sends the text in the region defined by @var{start} and
961 @var{end} as standard input to @var{process}.
962
963 An error is signaled unless both @var{start} and @var{end} are
964 integers or markers that indicate positions in the current buffer. (It
965 is unimportant which number is larger.)
966 @end defun
967
968 @defun process-send-eof &optional process
969 This function makes @var{process} see an end-of-file in its
970 input. The @acronym{EOF} comes after any text already sent to it.
971
972 The function returns @var{process}.
973
974 @smallexample
975 @group
976 (process-send-eof "shell")
977 @result{} "shell"
978 @end group
979 @end smallexample
980 @end defun
981
982 @defun process-running-child-p process
983 This function will tell you whether a subprocess has given control of
984 its terminal to its own child process. The value is @code{t} if this is
985 true, or if Emacs cannot tell; it is @code{nil} if Emacs can be certain
986 that this is not so.
987 @end defun
988
989 @node Signals to Processes
990 @section Sending Signals to Processes
991 @cindex process signals
992 @cindex sending signals
993 @cindex signals
994
995 @dfn{Sending a signal} to a subprocess is a way of interrupting its
996 activities. There are several different signals, each with its own
997 meaning. The set of signals and their names is defined by the operating
998 system. For example, the signal @code{SIGINT} means that the user has
999 typed @kbd{C-c}, or that some analogous thing has happened.
1000
1001 Each signal has a standard effect on the subprocess. Most signals
1002 kill the subprocess, but some stop or resume execution instead. Most
1003 signals can optionally be handled by programs; if the program handles
1004 the signal, then we can say nothing in general about its effects.
1005
1006 You can send signals explicitly by calling the functions in this
1007 section. Emacs also sends signals automatically at certain times:
1008 killing a buffer sends a @code{SIGHUP} signal to all its associated
1009 processes; killing Emacs sends a @code{SIGHUP} signal to all remaining
1010 processes. (@code{SIGHUP} is a signal that usually indicates that the
1011 user hung up the phone.)
1012
1013 Each of the signal-sending functions takes two optional arguments:
1014 @var{process} and @var{current-group}.
1015
1016 The argument @var{process} must be either a process, a process
1017 name, a buffer, a buffer name, or @code{nil}. A buffer or buffer name
1018 stands for a process through @code{get-buffer-process}. @code{nil}
1019 stands for the process associated with the current buffer. An error
1020 is signaled if @var{process} does not identify a process.
1021
1022 The argument @var{current-group} is a flag that makes a difference
1023 when you are running a job-control shell as an Emacs subprocess. If it
1024 is non-@code{nil}, then the signal is sent to the current process-group
1025 of the terminal that Emacs uses to communicate with the subprocess. If
1026 the process is a job-control shell, this means the shell's current
1027 subjob. If it is @code{nil}, the signal is sent to the process group of
1028 the immediate subprocess of Emacs. If the subprocess is a job-control
1029 shell, this is the shell itself.
1030
1031 The flag @var{current-group} has no effect when a pipe is used to
1032 communicate with the subprocess, because the operating system does not
1033 support the distinction in the case of pipes. For the same reason,
1034 job-control shells won't work when a pipe is used. See
1035 @code{process-connection-type} in @ref{Asynchronous Processes}.
1036
1037 @defun interrupt-process &optional process current-group
1038 This function interrupts the process @var{process} by sending the
1039 signal @code{SIGINT}. Outside of Emacs, typing the ``interrupt
1040 character'' (normally @kbd{C-c} on some systems, and @code{DEL} on
1041 others) sends this signal. When the argument @var{current-group} is
1042 non-@code{nil}, you can think of this function as ``typing @kbd{C-c}''
1043 on the terminal by which Emacs talks to the subprocess.
1044 @end defun
1045
1046 @defun kill-process &optional process current-group
1047 This function kills the process @var{process} by sending the
1048 signal @code{SIGKILL}. This signal kills the subprocess immediately,
1049 and cannot be handled by the subprocess.
1050 @end defun
1051
1052 @defun quit-process &optional process current-group
1053 This function sends the signal @code{SIGQUIT} to the process
1054 @var{process}. This signal is the one sent by the ``quit
1055 character'' (usually @kbd{C-b} or @kbd{C-\}) when you are not inside
1056 Emacs.
1057 @end defun
1058
1059 @defun stop-process &optional process current-group
1060 This function stops the process @var{process} by sending the
1061 signal @code{SIGTSTP}. Use @code{continue-process} to resume its
1062 execution.
1063
1064 Outside of Emacs, on systems with job control, the ``stop character''
1065 (usually @kbd{C-z}) normally sends this signal. When
1066 @var{current-group} is non-@code{nil}, you can think of this function as
1067 ``typing @kbd{C-z}'' on the terminal Emacs uses to communicate with the
1068 subprocess.
1069 @end defun
1070
1071 @defun continue-process &optional process current-group
1072 This function resumes execution of the process @var{process} by sending
1073 it the signal @code{SIGCONT}. This presumes that @var{process} was
1074 stopped previously.
1075 @end defun
1076
1077 @c Emacs 19 feature
1078 @defun signal-process process signal
1079 This function sends a signal to process @var{process}. The argument
1080 @var{signal} specifies which signal to send; it should be an integer.
1081
1082 The @var{process} argument can be a system process @acronym{ID}; that
1083 allows you to send signals to processes that are not children of
1084 Emacs. @xref{System Processes}.
1085 @end defun
1086
1087 @node Output from Processes
1088 @section Receiving Output from Processes
1089 @cindex process output
1090 @cindex output from processes
1091
1092 There are two ways to receive the output that a subprocess writes to
1093 its standard output stream. The output can be inserted in a buffer,
1094 which is called the associated buffer of the process, or a function
1095 called the @dfn{filter function} can be called to act on the output. If
1096 the process has no buffer and no filter function, its output is
1097 discarded.
1098
1099 When a subprocess terminates, Emacs reads any pending output,
1100 then stops reading output from that subprocess. Therefore, if the
1101 subprocess has children that are still live and still producing
1102 output, Emacs won't receive that output.
1103
1104 Output from a subprocess can arrive only while Emacs is waiting: when
1105 reading terminal input, in @code{sit-for} and @code{sleep-for}
1106 (@pxref{Waiting}), and in @code{accept-process-output} (@pxref{Accepting
1107 Output}). This minimizes the problem of timing errors that usually
1108 plague parallel programming. For example, you can safely create a
1109 process and only then specify its buffer or filter function; no output
1110 can arrive before you finish, if the code in between does not call any
1111 primitive that waits.
1112
1113 @defvar process-adaptive-read-buffering
1114 On some systems, when Emacs reads the output from a subprocess, the
1115 output data is read in very small blocks, potentially resulting in
1116 very poor performance. This behavior can be remedied to some extent
1117 by setting the variable @var{process-adaptive-read-buffering} to a
1118 non-@code{nil} value (the default), as it will automatically delay reading
1119 from such processes, thus allowing them to produce more output before
1120 Emacs tries to read it.
1121 @end defvar
1122
1123 It is impossible to separate the standard output and standard error
1124 streams of the subprocess, because Emacs normally spawns the subprocess
1125 inside a pseudo-TTY, and a pseudo-TTY has only one output channel. If
1126 you want to keep the output to those streams separate, you should
1127 redirect one of them to a file---for example, by using an appropriate
1128 shell command.
1129
1130 @menu
1131 * Process Buffers:: If no filter, output is put in a buffer.
1132 * Filter Functions:: Filter functions accept output from the process.
1133 * Decoding Output:: Filters can get unibyte or multibyte strings.
1134 * Accepting Output:: How to wait until process output arrives.
1135 @end menu
1136
1137 @node Process Buffers
1138 @subsection Process Buffers
1139
1140 A process can (and usually does) have an @dfn{associated buffer},
1141 which is an ordinary Emacs buffer that is used for two purposes: storing
1142 the output from the process, and deciding when to kill the process. You
1143 can also use the buffer to identify a process to operate on, since in
1144 normal practice only one process is associated with any given buffer.
1145 Many applications of processes also use the buffer for editing input to
1146 be sent to the process, but this is not built into Emacs Lisp.
1147
1148 Unless the process has a filter function (@pxref{Filter Functions}),
1149 its output is inserted in the associated buffer. The position to insert
1150 the output is determined by the @code{process-mark}, which is then
1151 updated to point to the end of the text just inserted. Usually, but not
1152 always, the @code{process-mark} is at the end of the buffer.
1153
1154 @defun process-buffer process
1155 This function returns the associated buffer of the process
1156 @var{process}.
1157
1158 @smallexample
1159 @group
1160 (process-buffer (get-process "shell"))
1161 @result{} #<buffer *shell*>
1162 @end group
1163 @end smallexample
1164 @end defun
1165
1166 @defun process-mark process
1167 This function returns the process marker for @var{process}, which is the
1168 marker that says where to insert output from the process.
1169
1170 If @var{process} does not have a buffer, @code{process-mark} returns a
1171 marker that points nowhere.
1172
1173 Insertion of process output in a buffer uses this marker to decide where
1174 to insert, and updates it to point after the inserted text. That is why
1175 successive batches of output are inserted consecutively.
1176
1177 Filter functions normally should use this marker in the same fashion
1178 as is done by direct insertion of output in the buffer. A good
1179 example of a filter function that uses @code{process-mark} is found at
1180 the end of the following section.
1181
1182 When the user is expected to enter input in the process buffer for
1183 transmission to the process, the process marker separates the new input
1184 from previous output.
1185 @end defun
1186
1187 @defun set-process-buffer process buffer
1188 This function sets the buffer associated with @var{process} to
1189 @var{buffer}. If @var{buffer} is @code{nil}, the process becomes
1190 associated with no buffer.
1191 @end defun
1192
1193 @defun get-buffer-process buffer-or-name
1194 This function returns a nondeleted process associated with the buffer
1195 specified by @var{buffer-or-name}. If there are several processes
1196 associated with it, this function chooses one (currently, the one most
1197 recently created, but don't count on that). Deletion of a process
1198 (see @code{delete-process}) makes it ineligible for this function to
1199 return.
1200
1201 It is usually a bad idea to have more than one process associated with
1202 the same buffer.
1203
1204 @smallexample
1205 @group
1206 (get-buffer-process "*shell*")
1207 @result{} #<process shell>
1208 @end group
1209 @end smallexample
1210
1211 Killing the process's buffer deletes the process, which kills the
1212 subprocess with a @code{SIGHUP} signal (@pxref{Signals to Processes}).
1213 @end defun
1214
1215 @node Filter Functions
1216 @subsection Process Filter Functions
1217 @cindex filter function
1218 @cindex process filter
1219
1220 A process @dfn{filter function} is a function that receives the
1221 standard output from the associated process. If a process has a filter,
1222 then @emph{all} output from that process is passed to the filter. The
1223 process buffer is used directly for output from the process only when
1224 there is no filter.
1225
1226 The filter function can only be called when Emacs is waiting for
1227 something, because process output arrives only at such times. Emacs
1228 waits when reading terminal input, in @code{sit-for} and
1229 @code{sleep-for} (@pxref{Waiting}), and in @code{accept-process-output}
1230 (@pxref{Accepting Output}).
1231
1232 A filter function must accept two arguments: the associated process
1233 and a string, which is output just received from it. The function is
1234 then free to do whatever it chooses with the output.
1235
1236 Quitting is normally inhibited within a filter function---otherwise,
1237 the effect of typing @kbd{C-g} at command level or to quit a user
1238 command would be unpredictable. If you want to permit quitting inside
1239 a filter function, bind @code{inhibit-quit} to @code{nil}. In most
1240 cases, the right way to do this is with the macro
1241 @code{with-local-quit}. @xref{Quitting}.
1242
1243 If an error happens during execution of a filter function, it is
1244 caught automatically, so that it doesn't stop the execution of whatever
1245 program was running when the filter function was started. However, if
1246 @code{debug-on-error} is non-@code{nil}, the error-catching is turned
1247 off. This makes it possible to use the Lisp debugger to debug the
1248 filter function. @xref{Debugger}.
1249
1250 Many filter functions sometimes or always insert the text in the
1251 process's buffer, mimicking the actions of Emacs when there is no
1252 filter. Such filter functions need to use @code{set-buffer} in order to
1253 be sure to insert in that buffer. To avoid setting the current buffer
1254 semipermanently, these filter functions must save and restore the
1255 current buffer. They should also update the process marker, and in some
1256 cases update the value of point. Here is how to do these things:
1257
1258 @smallexample
1259 @group
1260 (defun ordinary-insertion-filter (proc string)
1261 (with-current-buffer (process-buffer proc)
1262 (let ((moving (= (point) (process-mark proc))))
1263 @end group
1264 @group
1265 (save-excursion
1266 ;; @r{Insert the text, advancing the process marker.}
1267 (goto-char (process-mark proc))
1268 (insert string)
1269 (set-marker (process-mark proc) (point)))
1270 (if moving (goto-char (process-mark proc))))))
1271 @end group
1272 @end smallexample
1273
1274 @noindent
1275 The reason to use @code{with-current-buffer}, rather than using
1276 @code{save-excursion} to save and restore the current buffer, is so as
1277 to preserve the change in point made by the second call to
1278 @code{goto-char}.
1279
1280 To make the filter force the process buffer to be visible whenever new
1281 text arrives, insert the following line just before the
1282 @code{with-current-buffer} construct:
1283
1284 @smallexample
1285 (display-buffer (process-buffer proc))
1286 @end smallexample
1287
1288 To force point to the end of the new output, no matter where it was
1289 previously, eliminate the variable @code{moving} and call
1290 @code{goto-char} unconditionally.
1291
1292 In earlier Emacs versions, every filter function that did regular
1293 expression searching or matching had to explicitly save and restore the
1294 match data. Now Emacs does this automatically for filter functions;
1295 they never need to do it explicitly. @xref{Match Data}.
1296
1297 A filter function that writes the output into the buffer of the
1298 process should check whether the buffer is still alive. If it tries to
1299 insert into a dead buffer, it will get an error. The expression
1300 @code{(buffer-name (process-buffer @var{process}))} returns @code{nil}
1301 if the buffer is dead.
1302
1303 The output to the function may come in chunks of any size. A program
1304 that produces the same output twice in a row may send it as one batch of
1305 200 characters one time, and five batches of 40 characters the next. If
1306 the filter looks for certain text strings in the subprocess output, make
1307 sure to handle the case where one of these strings is split across two
1308 or more batches of output.
1309
1310 @defun set-process-filter process filter
1311 This function gives @var{process} the filter function @var{filter}. If
1312 @var{filter} is @code{nil}, it gives the process no filter.
1313 @end defun
1314
1315 @defun process-filter process
1316 This function returns the filter function of @var{process}, or @code{nil}
1317 if it has none.
1318 @end defun
1319
1320 Here is an example of use of a filter function:
1321
1322 @smallexample
1323 @group
1324 (defun keep-output (process output)
1325 (setq kept (cons output kept)))
1326 @result{} keep-output
1327 @end group
1328 @group
1329 (setq kept nil)
1330 @result{} nil
1331 @end group
1332 @group
1333 (set-process-filter (get-process "shell") 'keep-output)
1334 @result{} keep-output
1335 @end group
1336 @group
1337 (process-send-string "shell" "ls ~/other\n")
1338 @result{} nil
1339 kept
1340 @result{} ("lewis@@slug[8] % "
1341 @end group
1342 @group
1343 "FINAL-W87-SHORT.MSS backup.otl kolstad.mss~
1344 address.txt backup.psf kolstad.psf
1345 backup.bib~ david.mss resume-Dec-86.mss~
1346 backup.err david.psf resume-Dec.psf
1347 backup.mss dland syllabus.mss
1348 "
1349 "#backups.mss# backup.mss~ kolstad.mss
1350 ")
1351 @end group
1352 @end smallexample
1353
1354 @ignore @c The code in this example doesn't show the right way to do things.
1355 Here is another, more realistic example, which demonstrates how to use
1356 the process mark to do insertion in the same fashion as is done when
1357 there is no filter function:
1358
1359 @smallexample
1360 @group
1361 ;; @r{Insert input in the buffer specified by @code{my-shell-buffer}}
1362 ;; @r{and make sure that buffer is shown in some window.}
1363 (defun my-process-filter (proc str)
1364 (let ((cur (selected-window))
1365 (pop-up-windows t))
1366 (pop-to-buffer my-shell-buffer)
1367 @end group
1368 @group
1369 (goto-char (point-max))
1370 (insert str)
1371 (set-marker (process-mark proc) (point-max))
1372 (select-window cur)))
1373 @end group
1374 @end smallexample
1375 @end ignore
1376
1377 @node Decoding Output
1378 @subsection Decoding Process Output
1379 @cindex decode process output
1380
1381 When Emacs writes process output directly into a multibyte buffer,
1382 it decodes the output according to the process output coding system.
1383 If the coding system is @code{raw-text} or @code{no-conversion}, Emacs
1384 converts the unibyte output to multibyte using
1385 @code{string-to-multibyte}, and inserts the resulting multibyte text.
1386
1387 You can use @code{set-process-coding-system} to specify which coding
1388 system to use (@pxref{Process Information}). Otherwise, the coding
1389 system comes from @code{coding-system-for-read}, if that is
1390 non-@code{nil}; or else from the defaulting mechanism (@pxref{Default
1391 Coding Systems}).
1392
1393 @strong{Warning:} Coding systems such as @code{undecided} which
1394 determine the coding system from the data do not work entirely
1395 reliably with asynchronous subprocess output. This is because Emacs
1396 has to process asynchronous subprocess output in batches, as it
1397 arrives. Emacs must try to detect the proper coding system from one
1398 batch at a time, and this does not always work. Therefore, if at all
1399 possible, specify a coding system that determines both the character
1400 code conversion and the end of line conversion---that is, one like
1401 @code{latin-1-unix}, rather than @code{undecided} or @code{latin-1}.
1402
1403 @c Let's keep the index entries that were there for
1404 @c set-process-filter-multibyte and process-filter-multibyte-p,
1405 @cindex filter multibyte flag, of process
1406 @cindex process filter multibyte flag
1407 When Emacs calls a process filter function, it provides the process
1408 output as a multibyte string or as a unibyte string according to the
1409 process's filter coding system. Emacs
1410 decodes the output according to the process output coding system,
1411 which usually produces a multibyte string, except for coding systems
1412 such as @code{binary} and @code{raw-text}
1413
1414 @node Accepting Output
1415 @subsection Accepting Output from Processes
1416 @cindex accept input from processes
1417
1418 Output from asynchronous subprocesses normally arrives only while
1419 Emacs is waiting for some sort of external event, such as elapsed time
1420 or terminal input. Occasionally it is useful in a Lisp program to
1421 explicitly permit output to arrive at a specific point, or even to wait
1422 until output arrives from a process.
1423
1424 @defun accept-process-output &optional process seconds millisec just-this-one
1425 This function allows Emacs to read pending output from processes. The
1426 output is inserted in the associated buffers or given to their filter
1427 functions. If @var{process} is non-@code{nil} then this function does
1428 not return until some output has been received from @var{process}.
1429
1430 @c Emacs 19 feature
1431 The arguments @var{seconds} and @var{millisec} let you specify timeout
1432 periods. The former specifies a period measured in seconds and the
1433 latter specifies one measured in milliseconds. The two time periods
1434 thus specified are added together, and @code{accept-process-output}
1435 returns after that much time, whether or not there has been any
1436 subprocess output.
1437
1438 The argument @var{millisec} is semi-obsolete nowadays because
1439 @var{seconds} can be a floating point number to specify waiting a
1440 fractional number of seconds. If @var{seconds} is 0, the function
1441 accepts whatever output is pending but does not wait.
1442
1443 @c Emacs 22.1 feature
1444 If @var{process} is a process, and the argument @var{just-this-one} is
1445 non-@code{nil}, only output from that process is handled, suspending output
1446 from other processes until some output has been received from that
1447 process or the timeout expires. If @var{just-this-one} is an integer,
1448 also inhibit running timers. This feature is generally not
1449 recommended, but may be necessary for specific applications, such as
1450 speech synthesis.
1451
1452 The function @code{accept-process-output} returns non-@code{nil} if it
1453 did get some output, or @code{nil} if the timeout expired before output
1454 arrived.
1455 @end defun
1456
1457 @node Sentinels
1458 @section Sentinels: Detecting Process Status Changes
1459 @cindex process sentinel
1460 @cindex sentinel (of process)
1461
1462 A @dfn{process sentinel} is a function that is called whenever the
1463 associated process changes status for any reason, including signals
1464 (whether sent by Emacs or caused by the process's own actions) that
1465 terminate, stop, or continue the process. The process sentinel is
1466 also called if the process exits. The sentinel receives two
1467 arguments: the process for which the event occurred, and a string
1468 describing the type of event.
1469
1470 The string describing the event looks like one of the following:
1471
1472 @itemize @bullet
1473 @item
1474 @code{"finished\n"}.
1475
1476 @item
1477 @code{"exited abnormally with code @var{exitcode}\n"}.
1478
1479 @item
1480 @code{"@var{name-of-signal}\n"}.
1481
1482 @item
1483 @code{"@var{name-of-signal} (core dumped)\n"}.
1484 @end itemize
1485
1486 A sentinel runs only while Emacs is waiting (e.g., for terminal
1487 input, or for time to elapse, or for process output). This avoids the
1488 timing errors that could result from running them at random places in
1489 the middle of other Lisp programs. A program can wait, so that
1490 sentinels will run, by calling @code{sit-for} or @code{sleep-for}
1491 (@pxref{Waiting}), or @code{accept-process-output} (@pxref{Accepting
1492 Output}). Emacs also allows sentinels to run when the command loop is
1493 reading input. @code{delete-process} calls the sentinel when it
1494 terminates a running process.
1495
1496 Emacs does not keep a queue of multiple reasons to call the sentinel
1497 of one process; it records just the current status and the fact that
1498 there has been a change. Therefore two changes in status, coming in
1499 quick succession, can call the sentinel just once. However, process
1500 termination will always run the sentinel exactly once. This is
1501 because the process status can't change again after termination.
1502
1503 Emacs explicitly checks for output from the process before running
1504 the process sentinel. Once the sentinel runs due to process
1505 termination, no further output can arrive from the process.
1506
1507 A sentinel that writes the output into the buffer of the process
1508 should check whether the buffer is still alive. If it tries to insert
1509 into a dead buffer, it will get an error. If the buffer is dead,
1510 @code{(buffer-name (process-buffer @var{process}))} returns @code{nil}.
1511
1512 Quitting is normally inhibited within a sentinel---otherwise, the
1513 effect of typing @kbd{C-g} at command level or to quit a user command
1514 would be unpredictable. If you want to permit quitting inside a
1515 sentinel, bind @code{inhibit-quit} to @code{nil}. In most cases, the
1516 right way to do this is with the macro @code{with-local-quit}.
1517 @xref{Quitting}.
1518
1519 If an error happens during execution of a sentinel, it is caught
1520 automatically, so that it doesn't stop the execution of whatever
1521 programs was running when the sentinel was started. However, if
1522 @code{debug-on-error} is non-@code{nil}, the error-catching is turned
1523 off. This makes it possible to use the Lisp debugger to debug the
1524 sentinel. @xref{Debugger}.
1525
1526 While a sentinel is running, the process sentinel is temporarily
1527 set to @code{nil} so that the sentinel won't run recursively.
1528 For this reason it is not possible for a sentinel to specify
1529 a new sentinel.
1530
1531 In earlier Emacs versions, every sentinel that did regular expression
1532 searching or matching had to explicitly save and restore the match data.
1533 Now Emacs does this automatically for sentinels; they never need to do
1534 it explicitly. @xref{Match Data}.
1535
1536 @defun set-process-sentinel process sentinel
1537 This function associates @var{sentinel} with @var{process}. If
1538 @var{sentinel} is @code{nil}, then the process will have no sentinel.
1539 The default behavior when there is no sentinel is to insert a message in
1540 the process's buffer when the process status changes.
1541
1542 Changes in process sentinel take effect immediately---if the sentinel
1543 is slated to be run but has not been called yet, and you specify a new
1544 sentinel, the eventual call to the sentinel will use the new one.
1545
1546 @smallexample
1547 @group
1548 (defun msg-me (process event)
1549 (princ
1550 (format "Process: %s had the event `%s'" process event)))
1551 (set-process-sentinel (get-process "shell") 'msg-me)
1552 @result{} msg-me
1553 @end group
1554 @group
1555 (kill-process (get-process "shell"))
1556 @print{} Process: #<process shell> had the event `killed'
1557 @result{} #<process shell>
1558 @end group
1559 @end smallexample
1560 @end defun
1561
1562 @defun process-sentinel process
1563 This function returns the sentinel of @var{process}, or @code{nil} if it
1564 has none.
1565 @end defun
1566
1567 @defun waiting-for-user-input-p
1568 While a sentinel or filter function is running, this function returns
1569 non-@code{nil} if Emacs was waiting for keyboard input from the user at
1570 the time the sentinel or filter function was called, @code{nil} if it
1571 was not.
1572 @end defun
1573
1574 @node Query Before Exit
1575 @section Querying Before Exit
1576
1577 When Emacs exits, it terminates all its subprocesses by sending them
1578 the @code{SIGHUP} signal. Because subprocesses may be doing
1579 valuable work, Emacs normally asks the user to confirm that it is ok
1580 to terminate them. Each process has a query flag which, if
1581 non-@code{nil}, says that Emacs should ask for confirmation before
1582 exiting and thus killing that process. The default for the query flag
1583 is @code{t}, meaning @emph{do} query.
1584
1585 @defun process-query-on-exit-flag process
1586 This returns the query flag of @var{process}.
1587 @end defun
1588
1589 @defun set-process-query-on-exit-flag process flag
1590 This function sets the query flag of @var{process} to @var{flag}. It
1591 returns @var{flag}.
1592
1593 @smallexample
1594 @group
1595 ;; @r{Don't query about the shell process}
1596 (set-process-query-on-exit-flag (get-process "shell") nil)
1597 @result{} t
1598 @end group
1599 @end smallexample
1600 @end defun
1601
1602 @defun process-kill-without-query process &optional do-query
1603 This function clears the query flag of @var{process}, so that
1604 Emacs will not query the user on account of that process.
1605
1606 Actually, the function does more than that: it returns the old value of
1607 the process's query flag, and sets the query flag to @var{do-query}.
1608 Please don't use this function to do those things any more---please
1609 use the newer, cleaner functions @code{process-query-on-exit-flag} and
1610 @code{set-process-query-on-exit-flag} in all but the simplest cases.
1611 The only way you should use @code{process-kill-without-query} nowadays
1612 is like this:
1613
1614 @smallexample
1615 @group
1616 ;; @r{Don't query about the shell process}
1617 (process-kill-without-query (get-process "shell"))
1618 @end group
1619 @end smallexample
1620 @end defun
1621
1622 @node System Processes
1623 @section Accessing Other Processes
1624 @cindex system processes
1625
1626 In addition to accessing and manipulating processes that are
1627 subprocesses of the current Emacs session, Emacs Lisp programs can
1628 also access other processes running on the same machine. We call
1629 these @dfn{system processes}, to distinguish between them and Emacs
1630 subprocesses.
1631
1632 Emacs provides several primitives for accessing system processes.
1633 Not all platforms support these primitives; on those which don't,
1634 these primitives return @code{nil}.
1635
1636 @defun list-system-processes
1637 This function returns a list of all the processes running on the
1638 system. Each process is identified by its @acronym{PID}, a numerical
1639 process ID that is assigned by the OS and distinguishes the process
1640 from all the other processes running on the same machine at the same
1641 time.
1642 @end defun
1643
1644 @defun system-process-attributes pid
1645 This function returns an alist of attributes for the process specified
1646 by its process ID @var{pid}. Each association in the alist is of the
1647 form @code{(@var{key} . @var{value})}, where @var{key} designates the
1648 attribute and @var{value} is the value of that attribute. The various
1649 attribute @var{key}'s that this function can return are listed below.
1650 Not all platforms support all of these attributes; if an attribute is
1651 not supported, its association will not appear in the returned alist.
1652 Values that are numbers can be either integer or floating-point,
1653 depending on the magnitude of the value.
1654
1655 @table @code
1656 @item euid
1657 The effective user ID of the user who invoked the process. The
1658 corresponding @var{value} is a number. If the process was invoked by
1659 the same user who runs the current Emacs session, the value is
1660 identical to what @code{user-uid} returns (@pxref{User
1661 Identification}).
1662
1663 @item user
1664 User name corresponding to the process's effective user ID, a string.
1665
1666 @item egid
1667 The group ID of the effective user ID, a number.
1668
1669 @item group
1670 Group name corresponding to the effective user's group ID, a string.
1671
1672 @item comm
1673 The name of the command that runs in the process. This is a string
1674 that usually specifies the name of the executable file of the process,
1675 without the leading directories. However, some special system
1676 processes can report strings that do not correspond to an executable
1677 file of a program.
1678
1679 @item state
1680 The state code of the process. This is a short string that encodes
1681 the scheduling state of the process. Here's a list of the most
1682 frequently seen codes:
1683
1684 @table @code
1685 @item "D"
1686 uninterruptible sleep (usually I/O)
1687 @item "R"
1688 running
1689 @item "S"
1690 interruptible sleep (waiting for some event)
1691 @item "T"
1692 stopped, e.g., by a job control signal
1693 @item "Z"
1694 ``zombie'': a process that terminated, but was not reaped by its parent
1695 @end table
1696
1697 @noindent
1698 For the full list of the possible states, see the manual page of the
1699 @command{ps} command.
1700
1701 @item ppid
1702 The process ID of the parent process, a number.
1703
1704 @item pgrp
1705 The process group ID of the process, a number.
1706
1707 @item sess
1708 The session ID of the process. This is a number that is the process
1709 ID of the process's @dfn{session leader}.
1710
1711 @item ttname
1712 A string that is the name of the process's controlling terminal. On
1713 Unix and GNU systems, this is normally the file name of the
1714 corresponding terminal device, such as @file{/dev/pts65}.
1715
1716 @item tpgid
1717 The numerical process group ID of the foreground process group that
1718 uses the process's terminal.
1719
1720 @item minflt
1721 The number of minor page faults caused by the process since its
1722 beginning. (Minor page faults are those that don't involve reading
1723 from disk.)
1724
1725 @item majflt
1726 The number of major page faults caused by the process since its
1727 beginning. (Major page faults require a disk to be read, and are thus
1728 more expensive than minor page faults.)
1729
1730 @item cminflt
1731 @itemx cmajflt
1732 Like @code{minflt} and @code{majflt}, but include the number of page
1733 faults for all the child processes of the given process.
1734
1735 @item utime
1736 Time spent by the process in the user context, for running the
1737 application's code. The corresponding @var{value} is in the
1738 @w{@code{(@var{high} @var{low} @var{microsec})}} format, the same
1739 format used by functions @code{current-time} (@pxref{Time of Day,
1740 current-time}) and @code{file-attributes} (@pxref{File Attributes}).
1741
1742 @item stime
1743 Time spent by the process in the system (kernel) context, for
1744 processing system calls. The corresponding @var{value} is in the same
1745 format as for @code{utime}.
1746
1747 @item cutime
1748 @itemx cstime
1749 Like @code{utime} and @code{stime}, but includes the times of all the
1750 child processes of the given process.
1751
1752 @item pri
1753 The numerical priority of the process.
1754
1755 @item nice
1756 The @dfn{nice value} of the process, a number. (Processes with smaller
1757 nice values get scheduled more favorably.)
1758
1759 @item thcount
1760 The number of threads in the process.
1761
1762 @item start
1763 The time the process was started, in the @w{@code{(@var{high}
1764 @var{low} @var{microsec})}} format used by @code{current-time} and
1765 @code{file-attributes}.
1766
1767 @item etime
1768 The time elapsed since the process started, in the @w{@code{(@var{high}
1769 @var{low} @var{microsec})}} format.
1770
1771 @item vsize
1772 The virtual memory size of the process, measured in kilobytes.
1773
1774 @item rss
1775 The size of the process's @dfn{resident set}, the number of kilobytes
1776 occupied by the process in the machine's physical memory.
1777
1778 @item pcpu
1779 The percentage of the CPU time used by the process since it started.
1780 The corresponding @var{value} is a floating-point number between 0 and
1781 100.
1782
1783 @item pmem
1784 The percentage of the total physical memory installed on the machine
1785 used by the process's resident set. The value is a floating-point
1786 number between 0 and 100.
1787
1788 @item args
1789 The command-line with which the process was invoked. This is a string
1790 in which individual command-line arguments are separated by blanks;
1791 whitespace characters that are embedded in the arguments are quoted as
1792 appropriate for the system's shell: escaped by backslash characters on
1793 GNU and Unix, and enclosed in double quote characters on Windows.
1794 Thus, this command-line string can be directly used in primitives such
1795 as @code{shell-command}.
1796 @end table
1797
1798 @end defun
1799
1800
1801 @node Transaction Queues
1802 @section Transaction Queues
1803 @cindex transaction queue
1804
1805 You can use a @dfn{transaction queue} to communicate with a subprocess
1806 using transactions. First use @code{tq-create} to create a transaction
1807 queue communicating with a specified process. Then you can call
1808 @code{tq-enqueue} to send a transaction.
1809
1810 @defun tq-create process
1811 This function creates and returns a transaction queue communicating with
1812 @var{process}. The argument @var{process} should be a subprocess
1813 capable of sending and receiving streams of bytes. It may be a child
1814 process, or it may be a TCP connection to a server, possibly on another
1815 machine.
1816 @end defun
1817
1818 @defun tq-enqueue queue question regexp closure fn &optional delay-question
1819 This function sends a transaction to queue @var{queue}. Specifying the
1820 queue has the effect of specifying the subprocess to talk to.
1821
1822 The argument @var{question} is the outgoing message that starts the
1823 transaction. The argument @var{fn} is the function to call when the
1824 corresponding answer comes back; it is called with two arguments:
1825 @var{closure}, and the answer received.
1826
1827 The argument @var{regexp} is a regular expression that should match
1828 text at the end of the entire answer, but nothing before; that's how
1829 @code{tq-enqueue} determines where the answer ends.
1830
1831 If the argument @var{delay-question} is non-nil, delay sending this
1832 question until the process has finished replying to any previous
1833 questions. This produces more reliable results with some processes.
1834
1835 The return value of @code{tq-enqueue} itself is not meaningful.
1836 @end defun
1837
1838 @defun tq-close queue
1839 Shut down transaction queue @var{queue}, waiting for all pending transactions
1840 to complete, and then terminate the connection or child process.
1841 @end defun
1842
1843 Transaction queues are implemented by means of a filter function.
1844 @xref{Filter Functions}.
1845
1846 @node Network
1847 @section Network Connections
1848 @cindex network connection
1849 @cindex TCP
1850 @cindex UDP
1851
1852 Emacs Lisp programs can open stream (TCP) and datagram (UDP) network
1853 connections to other processes on the same machine or other machines.
1854 A network connection is handled by Lisp much like a subprocess, and is
1855 represented by a process object. However, the process you are
1856 communicating with is not a child of the Emacs process, so it has no
1857 process @acronym{ID}, and you can't kill it or send it signals. All you
1858 can do is send and receive data. @code{delete-process} closes the
1859 connection, but does not kill the program at the other end; that
1860 program must decide what to do about closure of the connection.
1861
1862 Lisp programs can listen for connections by creating network
1863 servers. A network server is also represented by a kind of process
1864 object, but unlike a network connection, the network server never
1865 transfers data itself. When it receives a connection request, it
1866 creates a new network connection to represent the connection just
1867 made. (The network connection inherits certain information, including
1868 the process plist, from the server.) The network server then goes
1869 back to listening for more connection requests.
1870
1871 Network connections and servers are created by calling
1872 @code{make-network-process} with an argument list consisting of
1873 keyword/argument pairs, for example @code{:server t} to create a
1874 server process, or @code{:type 'datagram} to create a datagram
1875 connection. @xref{Low-Level Network}, for details. You can also use
1876 the @code{open-network-stream} function described below.
1877
1878 To distinguish the different types of processes, the
1879 @code{process-type} function returns the symbol @code{network} for a
1880 network connection or server, @code{serial} for a serial port
1881 connection, or @code{real} for a real subprocess.
1882
1883 The @code{process-status} function returns @code{open},
1884 @code{closed}, @code{connect}, and @code{failed} for network
1885 connections. For a network server, the status is always
1886 @code{listen}. None of those values is possible for a real
1887 subprocess. @xref{Process Information}.
1888
1889 You can stop and resume operation of a network process by calling
1890 @code{stop-process} and @code{continue-process}. For a server
1891 process, being stopped means not accepting new connections. (Up to 5
1892 connection requests will be queued for when you resume the server; you
1893 can increase this limit, unless it is imposed by the operating
1894 system.) For a network stream connection, being stopped means not
1895 processing input (any arriving input waits until you resume the
1896 connection). For a datagram connection, some number of packets may be
1897 queued but input may be lost. You can use the function
1898 @code{process-command} to determine whether a network connection or
1899 server is stopped; a non-@code{nil} value means yes.
1900
1901 @defun open-network-stream name buffer-or-name host service
1902 This function opens a TCP connection, and returns a process object
1903 that represents the connection.
1904
1905 The @var{name} argument specifies the name for the process object. It
1906 is modified as necessary to make it unique.
1907
1908 The @var{buffer-or-name} argument is the buffer to associate with the
1909 connection. Output from the connection is inserted in the buffer,
1910 unless you specify a filter function to handle the output. If
1911 @var{buffer-or-name} is @code{nil}, it means that the connection is not
1912 associated with any buffer.
1913
1914 The arguments @var{host} and @var{service} specify where to connect to;
1915 @var{host} is the host name (a string), and @var{service} is the name of
1916 a defined network service (a string) or a port number (an integer).
1917 @end defun
1918
1919 @node Network Servers
1920 @section Network Servers
1921 @cindex network servers
1922
1923 You create a server by calling @code{make-network-process} with
1924 @code{:server t}. The server will listen for connection requests from
1925 clients. When it accepts a client connection request, that creates a
1926 new network connection, itself a process object, with the following
1927 parameters:
1928
1929 @itemize @bullet
1930 @item
1931 The connection's process name is constructed by concatenating the
1932 server process' @var{name} with a client identification string. The
1933 client identification string for an IPv4 connection looks like
1934 @samp{<@var{a}.@var{b}.@var{c}.@var{d}:@var{p}>}. Otherwise, it is a
1935 unique number in brackets, as in @samp{<@var{nnn}>}. The number
1936 is unique for each connection in the Emacs session.
1937
1938 @item
1939 If the server's filter is non-@code{nil}, the connection process does
1940 not get a separate process buffer; otherwise, Emacs creates a new
1941 buffer for the purpose. The buffer name is the server's buffer name
1942 or process name, concatenated with the client identification string.
1943
1944 The server's process buffer value is never used directly by Emacs, but
1945 it is passed to the log function, which can log connections by
1946 inserting text there.
1947
1948 @item
1949 The communication type and the process filter and sentinel are
1950 inherited from those of the server. The server never directly
1951 uses its filter and sentinel; their sole purpose is to initialize
1952 connections made to the server.
1953
1954 @item
1955 The connection's process contact info is set according to the client's
1956 addressing information (typically an IP address and a port number).
1957 This information is associated with the @code{process-contact}
1958 keywords @code{:host}, @code{:service}, @code{:remote}.
1959
1960 @item
1961 The connection's local address is set up according to the port
1962 number used for the connection.
1963
1964 @item
1965 The client process' plist is initialized from the server's plist.
1966 @end itemize
1967
1968 @node Datagrams
1969 @section Datagrams
1970 @cindex datagrams
1971
1972 A datagram connection communicates with individual packets rather
1973 than streams of data. Each call to @code{process-send} sends one
1974 datagram packet (@pxref{Input to Processes}), and each datagram
1975 received results in one call to the filter function.
1976
1977 The datagram connection doesn't have to talk with the same remote
1978 peer all the time. It has a @dfn{remote peer address} which specifies
1979 where to send datagrams to. Each time an incoming datagram is passed
1980 to the filter function, the peer address is set to the address that
1981 datagram came from; that way, if the filter function sends a datagram,
1982 it will go back to that place. You can specify the remote peer
1983 address when you create the datagram connection using the
1984 @code{:remote} keyword. You can change it later on by calling
1985 @code{set-process-datagram-address}.
1986
1987 @defun process-datagram-address process
1988 If @var{process} is a datagram connection or server, this function
1989 returns its remote peer address.
1990 @end defun
1991
1992 @defun set-process-datagram-address process address
1993 If @var{process} is a datagram connection or server, this function
1994 sets its remote peer address to @var{address}.
1995 @end defun
1996
1997 @node Low-Level Network
1998 @section Low-Level Network Access
1999
2000 You can also create network connections by operating at a lower
2001 level than that of @code{open-network-stream}, using
2002 @code{make-network-process}.
2003
2004 @menu
2005 * Proc: Network Processes. Using @code{make-network-process}.
2006 * Options: Network Options. Further control over network connections.
2007 * Features: Network Feature Testing.
2008 Determining which network features work on
2009 the machine you are using.
2010 @end menu
2011
2012 @node Network Processes
2013 @subsection @code{make-network-process}
2014
2015 The basic function for creating network connections and network
2016 servers is @code{make-network-process}. It can do either of those
2017 jobs, depending on the arguments you give it.
2018
2019 @defun make-network-process &rest args
2020 This function creates a network connection or server and returns the
2021 process object that represents it. The arguments @var{args} are a
2022 list of keyword/argument pairs. Omitting a keyword is always
2023 equivalent to specifying it with value @code{nil}, except for
2024 @code{:coding}, @code{:filter-multibyte}, and @code{:reuseaddr}. Here
2025 are the meaningful keywords:
2026
2027 @table @asis
2028 @item :name @var{name}
2029 Use the string @var{name} as the process name. It is modified if
2030 necessary to make it unique.
2031
2032 @item :type @var{type}
2033 Specify the communication type. A value of @code{nil} specifies a
2034 stream connection (the default); @code{datagram} specifies a datagram
2035 connection. Both connections and servers can be of either type.
2036
2037 @item :server @var{server-flag}
2038 If @var{server-flag} is non-@code{nil}, create a server. Otherwise,
2039 create a connection. For a stream type server, @var{server-flag} may
2040 be an integer which then specifies the length of the queue of pending
2041 connections to the server. The default queue length is 5.
2042
2043 @item :host @var{host}
2044 Specify the host to connect to. @var{host} should be a host name or
2045 Internet address, as a string, or the symbol @code{local} to specify
2046 the local host. If you specify @var{host} for a server, it must
2047 specify a valid address for the local host, and only clients
2048 connecting to that address will be accepted.
2049
2050 @item :service @var{service}
2051 @var{service} specifies a port number to connect to, or, for a server,
2052 the port number to listen on. It should be a service name that
2053 translates to a port number, or an integer specifying the port number
2054 directly. For a server, it can also be @code{t}, which means to let
2055 the system select an unused port number.
2056
2057 @item :family @var{family}
2058 @var{family} specifies the address (and protocol) family for
2059 communication. @code{nil} means determine the proper address family
2060 automatically for the given @var{host} and @var{service}.
2061 @code{local} specifies a Unix socket, in which case @var{host} is
2062 ignored. @code{ipv4} and @code{ipv6} specify to use IPv4 and IPv6
2063 respectively.
2064
2065 @item :local @var{local-address}
2066 For a server process, @var{local-address} is the address to listen on.
2067 It overrides @var{family}, @var{host} and @var{service}, and you
2068 may as well not specify them.
2069
2070 @item :remote @var{remote-address}
2071 For a connection, @var{remote-address} is the address to connect to.
2072 It overrides @var{family}, @var{host} and @var{service}, and you
2073 may as well not specify them.
2074
2075 For a datagram server, @var{remote-address} specifies the initial
2076 setting of the remote datagram address.
2077
2078 The format of @var{local-address} or @var{remote-address} depends on
2079 the address family:
2080
2081 @itemize -
2082 @item
2083 An IPv4 address is represented as a five-element vector of four 8-bit
2084 integers and one 16-bit integer
2085 @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]} corresponding to
2086 numeric IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port number
2087 @var{p}.
2088
2089 @item
2090 An IPv6 address is represented as a nine-element vector of 16-bit
2091 integers @code{[@var{a} @var{b} @var{c} @var{d} @var{e} @var{f}
2092 @var{g} @var{h} @var{p}]} corresponding to numeric IPv6 address
2093 @var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h} and
2094 port number @var{p}.
2095
2096 @item
2097 A local address is represented as a string which specifies the address
2098 in the local address space.
2099
2100 @item
2101 An ``unsupported family'' address is represented by a cons
2102 @code{(@var{f} . @var{av})}, where @var{f} is the family number and
2103 @var{av} is a vector specifying the socket address using one element
2104 per address data byte. Do not rely on this format in portable code,
2105 as it may depend on implementation defined constants, data sizes, and
2106 data structure alignment.
2107 @end itemize
2108
2109 @item :nowait @var{bool}
2110 If @var{bool} is non-@code{nil} for a stream connection, return
2111 without waiting for the connection to complete. When the connection
2112 succeeds or fails, Emacs will call the sentinel function, with a
2113 second argument matching @code{"open"} (if successful) or
2114 @code{"failed"}. The default is to block, so that
2115 @code{make-network-process} does not return until the connection
2116 has succeeded or failed.
2117
2118 @item :stop @var{stopped}
2119 Start the network connection or server in the `stopped' state if
2120 @var{stopped} is non-@code{nil}.
2121
2122 @item :buffer @var{buffer}
2123 Use @var{buffer} as the process buffer.
2124
2125 @item :coding @var{coding}
2126 Use @var{coding} as the coding system for this process. To specify
2127 different coding systems for decoding data from the connection and for
2128 encoding data sent to it, specify @code{(@var{decoding} .
2129 @var{encoding})} for @var{coding}.
2130
2131 If you don't specify this keyword at all, the default
2132 is to determine the coding systems from the data.
2133
2134 @item :noquery @var{query-flag}
2135 Initialize the process query flag to @var{query-flag}.
2136 @xref{Query Before Exit}.
2137
2138 @item :filter @var{filter}
2139 Initialize the process filter to @var{filter}.
2140
2141 @item :filter-multibyte @var{bool}
2142 If @var{bool} is non-@code{nil}, strings given to the process filter
2143 are multibyte, otherwise they are unibyte. If you don't specify this
2144 keyword at all, the default is that the strings are multibyte if
2145 @code{default-enable-multibyte-characters} is non-@code{nil}.
2146
2147 @item :sentinel @var{sentinel}
2148 Initialize the process sentinel to @var{sentinel}.
2149
2150 @item :log @var{log}
2151 Initialize the log function of a server process to @var{log}. The log
2152 function is called each time the server accepts a network connection
2153 from a client. The arguments passed to the log function are
2154 @var{server}, @var{connection}, and @var{message}, where @var{server}
2155 is the server process, @var{connection} is the new process for the
2156 connection, and @var{message} is a string describing what has
2157 happened.
2158
2159 @item :plist @var{plist}
2160 Initialize the process plist to @var{plist}.
2161 @end table
2162
2163 The original argument list, modified with the actual connection
2164 information, is available via the @code{process-contact} function.
2165 @end defun
2166
2167 @node Network Options
2168 @subsection Network Options
2169
2170 The following network options can be specified when you create a
2171 network process. Except for @code{:reuseaddr}, you can also set or
2172 modify these options later, using @code{set-network-process-option}.
2173
2174 For a server process, the options specified with
2175 @code{make-network-process} are not inherited by the client
2176 connections, so you will need to set the necessary options for each
2177 child connection as it is created.
2178
2179 @table @asis
2180 @item :bindtodevice @var{device-name}
2181 If @var{device-name} is a non-empty string identifying a network
2182 interface name (see @code{network-interface-list}), only handle
2183 packets received on that interface. If @var{device-name} is @code{nil}
2184 (the default), handle packets received on any interface.
2185
2186 Using this option may require special privileges on some systems.
2187
2188 @item :broadcast @var{broadcast-flag}
2189 If @var{broadcast-flag} is non-@code{nil} for a datagram process, the
2190 process will receive datagram packet sent to a broadcast address, and
2191 be able to send packets to a broadcast address. Ignored for a stream
2192 connection.
2193
2194 @item :dontroute @var{dontroute-flag}
2195 If @var{dontroute-flag} is non-@code{nil}, the process can only send
2196 to hosts on the same network as the local host.
2197
2198 @item :keepalive @var{keepalive-flag}
2199 If @var{keepalive-flag} is non-@code{nil} for a stream connection,
2200 enable exchange of low-level keep-alive messages.
2201
2202 @item :linger @var{linger-arg}
2203 If @var{linger-arg} is non-@code{nil}, wait for successful
2204 transmission of all queued packets on the connection before it is
2205 deleted (see @code{delete-process}). If @var{linger-arg} is an
2206 integer, it specifies the maximum time in seconds to wait for queued
2207 packets to be sent before closing the connection. Default is
2208 @code{nil} which means to discard unsent queued packets when the
2209 process is deleted.
2210
2211 @item :oobinline @var{oobinline-flag}
2212 If @var{oobinline-flag} is non-@code{nil} for a stream connection,
2213 receive out-of-band data in the normal data stream. Otherwise, ignore
2214 out-of-band data.
2215
2216 @item :priority @var{priority}
2217 Set the priority for packets sent on this connection to the integer
2218 @var{priority}. The interpretation of this number is protocol
2219 specific, such as setting the TOS (type of service) field on IP
2220 packets sent on this connection. It may also have system dependent
2221 effects, such as selecting a specific output queue on the network
2222 interface.
2223
2224 @item :reuseaddr @var{reuseaddr-flag}
2225 If @var{reuseaddr-flag} is non-@code{nil} (the default) for a stream
2226 server process, allow this server to reuse a specific port number (see
2227 @code{:service}) unless another process on this host is already
2228 listening on that port. If @var{reuseaddr-flag} is @code{nil}, there
2229 may be a period of time after the last use of that port (by any
2230 process on the host), where it is not possible to make a new server on
2231 that port.
2232 @end table
2233
2234 @defun set-network-process-option process option value
2235 This function sets or modifies a network option for network process
2236 @var{process}. See @code{make-network-process} for details of options
2237 @var{option} and their corresponding values @var{value}.
2238
2239 The current setting of an option is available via the
2240 @code{process-contact} function.
2241 @end defun
2242
2243 @node Network Feature Testing
2244 @subsection Testing Availability of Network Features
2245
2246 To test for the availability of a given network feature, use
2247 @code{featurep} like this:
2248
2249 @example
2250 (featurep 'make-network-process '(@var{keyword} @var{value}))
2251 @end example
2252
2253 @noindent
2254 The result of the first form is @code{t} if it works to specify
2255 @var{keyword} with value @var{value} in @code{make-network-process}.
2256 The result of the second form is @code{t} if @var{keyword} is
2257 supported by @code{make-network-process}. Here are some of the
2258 @var{keyword}---@var{value} pairs you can test in
2259 this way.
2260
2261 @table @code
2262 @item (:nowait t)
2263 Non-@code{nil} if non-blocking connect is supported.
2264 @item (:type datagram)
2265 Non-@code{nil} if datagrams are supported.
2266 @item (:family local)
2267 Non-@code{nil} if local (a.k.a.@: ``UNIX domain'') sockets are supported.
2268 @item (:family ipv6)
2269 Non-@code{nil} if IPv6 is supported.
2270 @item (:service t)
2271 Non-@code{nil} if the system can select the port for a server.
2272 @end table
2273
2274 To test for the availability of a given network option, use
2275 @code{featurep} like this:
2276
2277 @example
2278 (featurep 'make-network-process '@var{keyword})
2279 @end example
2280
2281 @noindent
2282 Here are some of the options you can test in this way.
2283
2284 @table @code
2285 @item :bindtodevice
2286 @itemx :broadcast
2287 @itemx :dontroute
2288 @itemx :keepalive
2289 @itemx :linger
2290 @itemx :oobinline
2291 @itemx :priority
2292 @itemx :reuseaddr
2293 That particular network option is supported by
2294 @code{make-network-process} and @code{set-network-process-option}.
2295 @end table
2296
2297 @node Misc Network
2298 @section Misc Network Facilities
2299
2300 These additional functions are useful for creating and operating
2301 on network connections. Note that they are supported only on some
2302 systems.
2303
2304 @defun network-interface-list
2305 This function returns a list describing the network interfaces
2306 of the machine you are using. The value is an alist whose
2307 elements have the form @code{(@var{name} . @var{address})}.
2308 @var{address} has the same form as the @var{local-address}
2309 and @var{remote-address} arguments to @code{make-network-process}.
2310 @end defun
2311
2312 @defun network-interface-info ifname
2313 This function returns information about the network interface named
2314 @var{ifname}. The value is a list of the form
2315 @code{(@var{addr} @var{bcast} @var{netmask} @var{hwaddr} @var{flags})}.
2316
2317 @table @var
2318 @item addr
2319 The Internet protocol address.
2320 @item bcast
2321 The broadcast address.
2322 @item netmask
2323 The network mask.
2324 @item hwaddr
2325 The layer 2 address (Ethernet MAC address, for instance).
2326 @item flags
2327 The current flags of the interface.
2328 @end table
2329 @end defun
2330
2331 @defun format-network-address address &optional omit-port
2332 This function converts the Lisp representation of a network address to
2333 a string.
2334
2335 A five-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]}
2336 represents an IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port
2337 number @var{p}. @code{format-network-address} converts that to the
2338 string @code{"@var{a}.@var{b}.@var{c}.@var{d}:@var{p}"}.
2339
2340 A nine-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{e}
2341 @var{f} @var{g} @var{h} @var{p}]} represents an IPv6 address along
2342 with a port number. @code{format-network-address} converts that to
2343 the string
2344 @code{"[@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h}]:@var{p}"}.
2345
2346 If the vector does not include the port number, @var{p}, or if
2347 @var{omit-port} is non-@code{nil}, the result does not include the
2348 @code{:@var{p}} suffix.
2349 @end defun
2350
2351 @node Serial Ports
2352 @section Communicating with Serial Ports
2353 @cindex @file{/dev/tty}
2354 @cindex @file{COM1}
2355 @cindex serial connections
2356
2357 Emacs can communicate with serial ports. For interactive use,
2358 @kbd{M-x serial-term} opens a terminal window. In a Lisp program,
2359 @code{make-serial-process} creates a process object.
2360
2361 The serial port can be configured at run-time, without having to
2362 close and re-open it. The function @code{serial-process-configure}
2363 lets you change the speed, bytesize, and other parameters. In a
2364 terminal window created by @code{serial-term}, you can click on the
2365 mode line for configuration.
2366
2367 A serial connection is represented by a process object which can be
2368 used similar to a subprocess or network process. You can send and
2369 receive data and configure the serial port. A serial process object
2370 has no process ID, you can't send signals to it, and the status codes
2371 are different from other types of processes.
2372 @code{delete-process} on the process object or @code{kill-buffer} on
2373 the process buffer close the connection, but this does not affect the
2374 device connected to the serial port.
2375
2376 The function @code{process-type} returns the symbol @code{serial}
2377 for a process object representing a serial port connection.
2378
2379 Serial ports are available on GNU/Linux, Unix, and Windows systems.
2380
2381 @deffn Command serial-term port speed
2382 Start a terminal-emulator for a serial port in a new buffer.
2383 @var{port} is the name of the serial port to which to connect. For
2384 example, this could be @file{/dev/ttyS0} on Unix. On Windows, this
2385 could be @file{COM1}, or @file{\\.\COM10} (double the backslashes in
2386 Lisp strings).
2387
2388 @var{speed} is the speed of the serial port in bits per second. 9600
2389 is a common value. The buffer is in Term mode; see @ref{Term Mode,,,
2390 emacs, The GNU Emacs Manual}, for the commands to use in that buffer.
2391 You can change the speed and the configuration in the mode line menu.
2392 @end deffn
2393
2394 @defun make-serial-process &rest args
2395 This function creates a process and a buffer. Arguments are specified
2396 as keyword/argument pairs. Here's the list of the meaningful keywords:
2397
2398 @table @code
2399 @item :port @var{port}@r{ (mandatory)}
2400 This is the name of the serial port. On Unix and GNU systems, this is
2401 a file name such as @file{/dev/ttyS0}. On Windows, this could be
2402 @file{COM1}, or @file{\\.\COM10} for ports higher than @file{COM9}
2403 (double the backslashes in Lisp strings).
2404
2405 @item :speed @var{speed}@r{ (mandatory)}
2406 The speed of the serial port in bits per second. This function calls
2407 @code{serial-process-configure} to handle the speed.
2408
2409 @item :name @var{name}
2410 The name of the process. If @var{name} is not given, @var{port} will
2411 serve as the process name as well.
2412
2413 @item :buffer @var{buffer}
2414 The buffer to associate with the process. The value could be either a
2415 buffer or a string that names a buffer. Process output goes at the
2416 end of that buffer, unless you specify an output stream or filter
2417 function to handle the output. If @var{buffer} is not given, the
2418 process buffer's name is taken from the value of the @code{:name}
2419 keyword.
2420
2421 @item :coding @var{coding}
2422 If @var{coding} is a symbol, it specifies the coding system used for
2423 both reading and writing for this process. If @var{coding} is a cons
2424 @code{(decoding . encoding)}, @var{decoding} is used for reading, and
2425 @var{encoding} is used for writing. If not specified, the default is
2426 to determine the coding systems from data itself.
2427
2428 @item :noquery @var{query-flag}
2429 Initialize the process query flag to @var{query-flag}. @xref{Query
2430 Before Exit}. The flags defaults to @code{nil} if unspecified.
2431
2432 @item :stop @var{bool}
2433 Start process in the @code{stopped} state if @var{bool} is
2434 non-@code{nil}. In the stopped state, a serial process does not
2435 accept incoming data, but you can send outgoing data. The stopped
2436 state is cleared by @code{continue-process} and set by
2437 @code{stop-process}.
2438
2439 @item :filter @var{filter}
2440 Install @var{filter} as the process filter.
2441
2442 @item :sentinel @var{sentinel}
2443 Install @var{sentinel} as the process sentinel.
2444
2445 @item :plist @var{plist}
2446 Install @var{plist} as the initial plist of the process.
2447
2448 @item :speed
2449 @itemx :bytesize
2450 @itemx :parity
2451 @itemx :stopbits
2452 @itemx :flowcontrol
2453 These arguments are handled by @code{serial-process-configure}, which
2454 is called by @code{make-serial-process}.
2455 @end table
2456
2457 The original argument list, possibly modified by later configuration,
2458 is available via the function @code{process-contact}.
2459
2460 Examples:
2461
2462 @example
2463 (make-serial-process :port "/dev/ttyS0" :speed 9600)
2464
2465 (make-serial-process :port "COM1" :speed 115200 :stopbits 2)
2466
2467 (make-serial-process :port "\\\\.\\COM13" :speed 1200
2468 :bytesize 7 :parity 'odd)
2469
2470 (make-serial-process :port "/dev/tty.BlueConsole-SPP-1" :speed nil)
2471 @end example
2472 @end defun
2473
2474 @defun serial-process-configure &rest args
2475 @cindex baud, in serial connections
2476 @cindex bytesize, in serial connections
2477 @cindex parity, in serial connections
2478 @cindex stopbits, in serial connections
2479 @cindex flowcontrol, in serial connections
2480
2481 This functions configures a serial port connection. Arguments are
2482 specified as keyword/argument pairs. Attributes that are not given
2483 are re-initialized from the process's current configuration (available
2484 via the function @code{process-contact}) or set to reasonable default
2485 values. The following arguments are defined:
2486
2487 @table @code
2488 @item :process @var{process}
2489 @itemx :name @var{name}
2490 @itemx :buffer @var{buffer}
2491 @itemx :port @var{port}
2492 Any of these arguments can be given to identify the process that is to
2493 be configured. If none of these arguments is given, the current
2494 buffer's process is used.
2495
2496 @item :speed @var{speed}
2497 The speed of the serial port in bits per second, a.k.a.@: @dfn{baud
2498 rate}. The value can be any number, but most serial ports work only
2499 at a few defined values between 1200 and 115200, with 9600 being the
2500 most common value. If @var{speed} is @code{nil}, the function ignores
2501 all other arguments and does not configure the port. This may be
2502 useful for special serial ports such as Bluetooth-to-serial converters
2503 which can only be configured through AT commands sent through the
2504 connection. You can use the value of @code{nil} for @var{speed} only
2505 for connections that are already open by a previous call to
2506 @code{make-serial-process} or @code{serial-term}.
2507
2508 @item :bytesize @var{bytesize}
2509 The number of bits per byte, which can be 7 or 8. If @var{bytesize}
2510 is not given or @code{nil}, it defaults to 8.
2511
2512 @item :parity @var{parity}
2513 The value can be @code{nil} (don't use parity), the symbol
2514 @code{odd} (use odd parity), or the symbol @code{even} (use even
2515 parity). If @var{parity} is not given, it defaults to no parity.
2516
2517 @item :stopbits @var{stopbits}
2518 The number of stopbits used to terminate a transmission
2519 of each byte. @var{stopbits} can be 1 or 2. If @var{stopbits} is not
2520 given or @code{nil}, it defaults to 1.
2521
2522 @item :flowcontrol @var{flowcontrol}
2523 The type of flow control to use for this connection, which is either
2524 @code{nil} (don't use flow control), the symbol @code{hw} (use RTS/CTS
2525 hardware flow control), or the symbol @code{sw} (use XON/XOFF software
2526 flow control). If @var{flowcontrol} is not given, it defaults to no
2527 flow control.
2528 @end table
2529
2530 @code{serial-process-configure} is called by @code{make-serial-process} for the
2531 initial configuration of the serial port.
2532
2533 Examples:
2534
2535 @example
2536 (serial-process-configure :process "/dev/ttyS0" :speed 1200)
2537
2538 (serial-process-configure :buffer "COM1" :stopbits 1 :parity 'odd :flowcontrol 'hw)
2539
2540 (serial-process-configure :port "\\\\.\\COM13" :bytesize 7)
2541 @end example
2542 @end defun
2543
2544 @node Byte Packing
2545 @section Packing and Unpacking Byte Arrays
2546 @cindex byte packing and unpacking
2547
2548 This section describes how to pack and unpack arrays of bytes,
2549 usually for binary network protocols. These functions convert byte arrays
2550 to alists, and vice versa. The byte array can be represented as a
2551 unibyte string or as a vector of integers, while the alist associates
2552 symbols either with fixed-size objects or with recursive sub-alists.
2553
2554 @cindex serializing
2555 @cindex deserializing
2556 @cindex packing
2557 @cindex unpacking
2558 Conversion from byte arrays to nested alists is also known as
2559 @dfn{deserializing} or @dfn{unpacking}, while going in the opposite
2560 direction is also known as @dfn{serializing} or @dfn{packing}.
2561
2562 @menu
2563 * Bindat Spec:: Describing data layout.
2564 * Bindat Functions:: Doing the unpacking and packing.
2565 * Bindat Examples:: Samples of what bindat.el can do for you!
2566 @end menu
2567
2568 @node Bindat Spec
2569 @subsection Describing Data Layout
2570
2571 To control unpacking and packing, you write a @dfn{data layout
2572 specification}, a special nested list describing named and typed
2573 @dfn{fields}. This specification controls length of each field to be
2574 processed, and how to pack or unpack it. We normally keep bindat specs
2575 in variables whose names end in @samp{-bindat-spec}; that kind of name
2576 is automatically recognized as ``risky.''
2577
2578 @cindex endianness
2579 @cindex big endian
2580 @cindex little endian
2581 @cindex network byte ordering
2582 A field's @dfn{type} describes the size (in bytes) of the object
2583 that the field represents and, in the case of multibyte fields, how
2584 the bytes are ordered within the field. The two possible orderings
2585 are ``big endian'' (also known as ``network byte ordering'') and
2586 ``little endian.'' For instance, the number @code{#x23cd} (decimal
2587 9165) in big endian would be the two bytes @code{#x23} @code{#xcd};
2588 and in little endian, @code{#xcd} @code{#x23}. Here are the possible
2589 type values:
2590
2591 @table @code
2592 @item u8
2593 @itemx byte
2594 Unsigned byte, with length 1.
2595
2596 @item u16
2597 @itemx word
2598 @itemx short
2599 Unsigned integer in network byte order, with length 2.
2600
2601 @item u24
2602 Unsigned integer in network byte order, with length 3.
2603
2604 @item u32
2605 @itemx dword
2606 @itemx long
2607 Unsigned integer in network byte order, with length 4.
2608 Note: These values may be limited by Emacs' integer implementation limits.
2609
2610 @item u16r
2611 @itemx u24r
2612 @itemx u32r
2613 Unsigned integer in little endian order, with length 2, 3 and 4, respectively.
2614
2615 @item str @var{len}
2616 String of length @var{len}.
2617
2618 @item strz @var{len}
2619 Zero-terminated string, in a fixed-size field with length @var{len}.
2620
2621 @item vec @var{len} [@var{type}]
2622 Vector of @var{len} elements of type @var{type}, or bytes if not
2623 @var{type} is specified.
2624 The @var{type} is any of the simple types above, or another vector
2625 specified as a list @code{(vec @var{len} [@var{type}])}.
2626
2627 @item ip
2628 Four-byte vector representing an Internet address. For example:
2629 @code{[127 0 0 1]} for localhost.
2630
2631 @item bits @var{len}
2632 List of set bits in @var{len} bytes. The bytes are taken in big
2633 endian order and the bits are numbered starting with @code{8 *
2634 @var{len} @minus{} 1} and ending with zero. For example: @code{bits
2635 2} unpacks @code{#x28} @code{#x1c} to @code{(2 3 4 11 13)} and
2636 @code{#x1c} @code{#x28} to @code{(3 5 10 11 12)}.
2637
2638 @item (eval @var{form})
2639 @var{form} is a Lisp expression evaluated at the moment the field is
2640 unpacked or packed. The result of the evaluation should be one of the
2641 above-listed type specifications.
2642 @end table
2643
2644 For a fixed-size field, the length @var{len} is given as an integer
2645 specifying the number of bytes in the field.
2646
2647 When the length of a field is not fixed, it typically depends on the
2648 value of a preceding field. In this case, the length @var{len} can be
2649 given either as a list @code{(@var{name} ...)} identifying a
2650 @dfn{field name} in the format specified for @code{bindat-get-field}
2651 below, or by an expression @code{(eval @var{form})} where @var{form}
2652 should evaluate to an integer, specifying the field length.
2653
2654 A field specification generally has the form @code{([@var{name}]
2655 @var{handler})}. The square braces indicate that @var{name} is
2656 optional. (Don't use names that are symbols meaningful as type
2657 specifications (above) or handler specifications (below), since that
2658 would be ambiguous.) @var{name} can be a symbol or the expression
2659 @code{(eval @var{form})}, in which case @var{form} should evaluate to
2660 a symbol.
2661
2662 @var{handler} describes how to unpack or pack the field and can be one
2663 of the following:
2664
2665 @table @code
2666 @item @var{type}
2667 Unpack/pack this field according to the type specification @var{type}.
2668
2669 @item eval @var{form}
2670 Evaluate @var{form}, a Lisp expression, for side-effect only. If the
2671 field name is specified, the value is bound to that field name.
2672
2673 @item fill @var{len}
2674 Skip @var{len} bytes. In packing, this leaves them unchanged,
2675 which normally means they remain zero. In unpacking, this means
2676 they are ignored.
2677
2678 @item align @var{len}
2679 Skip to the next multiple of @var{len} bytes.
2680
2681 @item struct @var{spec-name}
2682 Process @var{spec-name} as a sub-specification. This describes a
2683 structure nested within another structure.
2684
2685 @item union @var{form} (@var{tag} @var{spec})@dots{}
2686 @c ??? I don't see how one would actually use this.
2687 @c ??? what kind of expression would be useful for @var{form}?
2688 Evaluate @var{form}, a Lisp expression, find the first @var{tag}
2689 that matches it, and process its associated data layout specification
2690 @var{spec}. Matching can occur in one of three ways:
2691
2692 @itemize
2693 @item
2694 If a @var{tag} has the form @code{(eval @var{expr})}, evaluate
2695 @var{expr} with the variable @code{tag} dynamically bound to the value
2696 of @var{form}. A non-@code{nil} result indicates a match.
2697
2698 @item
2699 @var{tag} matches if it is @code{equal} to the value of @var{form}.
2700
2701 @item
2702 @var{tag} matches unconditionally if it is @code{t}.
2703 @end itemize
2704
2705 @item repeat @var{count} @var{field-specs}@dots{}
2706 Process the @var{field-specs} recursively, in order, then repeat
2707 starting from the first one, processing all the specs @var{count}
2708 times overall. The @var{count} is given using the same formats as a
2709 field length---if an @code{eval} form is used, it is evaluated just once.
2710 For correct operation, each spec in @var{field-specs} must include a name.
2711 @end table
2712
2713 For the @code{(eval @var{form})} forms used in a bindat specification,
2714 the @var{form} can access and update these dynamically bound variables
2715 during evaluation:
2716
2717 @table @code
2718 @item last
2719 Value of the last field processed.
2720
2721 @item bindat-raw
2722 The data as a byte array.
2723
2724 @item bindat-idx
2725 Current index (within @code{bindat-raw}) for unpacking or packing.
2726
2727 @item struct
2728 The alist containing the structured data that have been unpacked so
2729 far, or the entire structure being packed. You can use
2730 @code{bindat-get-field} to access specific fields of this structure.
2731
2732 @item count
2733 @itemx index
2734 Inside a @code{repeat} block, these contain the maximum number of
2735 repetitions (as specified by the @var{count} parameter), and the
2736 current repetition number (counting from 0). Setting @code{count} to
2737 zero will terminate the inner-most repeat block after the current
2738 repetition has completed.
2739 @end table
2740
2741 @node Bindat Functions
2742 @subsection Functions to Unpack and Pack Bytes
2743
2744 In the following documentation, @var{spec} refers to a data layout
2745 specification, @code{bindat-raw} to a byte array, and @var{struct} to an
2746 alist representing unpacked field data.
2747
2748 @defun bindat-unpack spec bindat-raw &optional bindat-idx
2749 This function unpacks data from the unibyte string or byte
2750 array @code{bindat-raw}
2751 according to @var{spec}. Normally this starts unpacking at the
2752 beginning of the byte array, but if @var{bindat-idx} is non-@code{nil}, it
2753 specifies a zero-based starting position to use instead.
2754
2755 The value is an alist or nested alist in which each element describes
2756 one unpacked field.
2757 @end defun
2758
2759 @defun bindat-get-field struct &rest name
2760 This function selects a field's data from the nested alist
2761 @var{struct}. Usually @var{struct} was returned by
2762 @code{bindat-unpack}. If @var{name} corresponds to just one argument,
2763 that means to extract a top-level field value. Multiple @var{name}
2764 arguments specify repeated lookup of sub-structures. An integer name
2765 acts as an array index.
2766
2767 For example, if @var{name} is @code{(a b 2 c)}, that means to find
2768 field @code{c} in the third element of subfield @code{b} of field
2769 @code{a}. (This corresponds to @code{struct.a.b[2].c} in C.)
2770 @end defun
2771
2772 Although packing and unpacking operations change the organization of
2773 data (in memory), they preserve the data's @dfn{total length}, which is
2774 the sum of all the fields' lengths, in bytes. This value is not
2775 generally inherent in either the specification or alist alone; instead,
2776 both pieces of information contribute to its calculation. Likewise, the
2777 length of a string or array being unpacked may be longer than the data's
2778 total length as described by the specification.
2779
2780 @defun bindat-length spec struct
2781 This function returns the total length of the data in @var{struct},
2782 according to @var{spec}.
2783 @end defun
2784
2785 @defun bindat-pack spec struct &optional bindat-raw bindat-idx
2786 This function returns a byte array packed according to @var{spec} from
2787 the data in the alist @var{struct}. Normally it creates and fills a
2788 new byte array starting at the beginning. However, if @var{bindat-raw}
2789 is non-@code{nil}, it specifies a pre-allocated unibyte string or vector to
2790 pack into. If @var{bindat-idx} is non-@code{nil}, it specifies the starting
2791 offset for packing into @code{bindat-raw}.
2792
2793 When pre-allocating, you should make sure @code{(length @var{bindat-raw})}
2794 meets or exceeds the total length to avoid an out-of-range error.
2795 @end defun
2796
2797 @defun bindat-ip-to-string ip
2798 Convert the Internet address vector @var{ip} to a string in the usual
2799 dotted notation.
2800
2801 @example
2802 (bindat-ip-to-string [127 0 0 1])
2803 @result{} "127.0.0.1"
2804 @end example
2805 @end defun
2806
2807 @node Bindat Examples
2808 @subsection Examples of Byte Unpacking and Packing
2809
2810 Here is a complete example of byte unpacking and packing:
2811
2812 @lisp
2813 (defvar fcookie-index-spec
2814 '((:version u32)
2815 (:count u32)
2816 (:longest u32)
2817 (:shortest u32)
2818 (:flags u32)
2819 (:delim u8)
2820 (:ignored fill 3)
2821 (:offset repeat (:count)
2822 (:foo u32)))
2823 "Description of a fortune cookie index file's contents.")
2824
2825 (defun fcookie (cookies &optional index)
2826 "Display a random fortune cookie from file COOKIES.
2827 Optional second arg INDEX specifies the associated index
2828 filename, which is by default constructed by appending
2829 \".dat\" to COOKIES. Display cookie text in possibly
2830 new buffer \"*Fortune Cookie: BASENAME*\" where BASENAME
2831 is COOKIES without the directory part."
2832 (interactive "fCookies file: ")
2833 (let* ((info (with-temp-buffer
2834 (insert-file-contents-literally
2835 (or index (concat cookies ".dat")))
2836 (bindat-unpack fcookie-index-spec
2837 (buffer-string))))
2838 (sel (random (bindat-get-field info :count)))
2839 (beg (cdar (bindat-get-field info :offset sel)))
2840 (end (or (cdar (bindat-get-field info
2841 :offset (1+ sel)))
2842 (nth 7 (file-attributes cookies)))))
2843 (switch-to-buffer
2844 (get-buffer-create
2845 (format "*Fortune Cookie: %s*"
2846 (file-name-nondirectory cookies))))
2847 (erase-buffer)
2848 (insert-file-contents-literally
2849 cookies nil beg (- end 3))))
2850
2851 (defun fcookie-create-index (cookies &optional index delim)
2852 "Scan file COOKIES, and write out its index file.
2853 Optional second arg INDEX specifies the index filename,
2854 which is by default constructed by appending \".dat\" to
2855 COOKIES. Optional third arg DELIM specifies the unibyte
2856 character which, when found on a line of its own in
2857 COOKIES, indicates the border between entries."
2858 (interactive "fCookies file: ")
2859 (setq delim (or delim ?%))
2860 (let ((delim-line (format "\n%c\n" delim))
2861 (count 0)
2862 (max 0)
2863 min p q len offsets)
2864 (unless (= 3 (string-bytes delim-line))
2865 (error "Delimiter cannot be represented in one byte"))
2866 (with-temp-buffer
2867 (insert-file-contents-literally cookies)
2868 (while (and (setq p (point))
2869 (search-forward delim-line (point-max) t)
2870 (setq len (- (point) 3 p)))
2871 (setq count (1+ count)
2872 max (max max len)
2873 min (min (or min max) len)
2874 offsets (cons (1- p) offsets))))
2875 (with-temp-buffer
2876 (set-buffer-multibyte nil)
2877 (insert
2878 (bindat-pack
2879 fcookie-index-spec
2880 `((:version . 2)
2881 (:count . ,count)
2882 (:longest . ,max)
2883 (:shortest . ,min)
2884 (:flags . 0)
2885 (:delim . ,delim)
2886 (:offset . ,(mapcar (lambda (o)
2887 (list (cons :foo o)))
2888 (nreverse offsets))))))
2889 (let ((coding-system-for-write 'raw-text-unix))
2890 (write-file (or index (concat cookies ".dat")))))))
2891 @end lisp
2892
2893 Following is an example of defining and unpacking a complex structure.
2894 Consider the following C structures:
2895
2896 @example
2897 struct header @{
2898 unsigned long dest_ip;
2899 unsigned long src_ip;
2900 unsigned short dest_port;
2901 unsigned short src_port;
2902 @};
2903
2904 struct data @{
2905 unsigned char type;
2906 unsigned char opcode;
2907 unsigned short length; /* In network byte order */
2908 unsigned char id[8]; /* null-terminated string */
2909 unsigned char data[/* (length + 3) & ~3 */];
2910 @};
2911
2912 struct packet @{
2913 struct header header;
2914 unsigned long counters[2]; /* In little endian order */
2915 unsigned char items;
2916 unsigned char filler[3];
2917 struct data item[/* items */];
2918
2919 @};
2920 @end example
2921
2922 The corresponding data layout specification:
2923
2924 @lisp
2925 (setq header-spec
2926 '((dest-ip ip)
2927 (src-ip ip)
2928 (dest-port u16)
2929 (src-port u16)))
2930
2931 (setq data-spec
2932 '((type u8)
2933 (opcode u8)
2934 (length u16) ;; network byte order
2935 (id strz 8)
2936 (data vec (length))
2937 (align 4)))
2938
2939 (setq packet-spec
2940 '((header struct header-spec)
2941 (counters vec 2 u32r) ;; little endian order
2942 (items u8)
2943 (fill 3)
2944 (item repeat (items)
2945 (struct data-spec))))
2946 @end lisp
2947
2948 A binary data representation:
2949
2950 @lisp
2951 (setq binary-data
2952 [ 192 168 1 100 192 168 1 101 01 28 21 32
2953 160 134 1 0 5 1 0 0 2 0 0 0
2954 2 3 0 5 ?A ?B ?C ?D ?E ?F 0 0 1 2 3 4 5 0 0 0
2955 1 4 0 7 ?B ?C ?D ?E ?F ?G 0 0 6 7 8 9 10 11 12 0 ])
2956 @end lisp
2957
2958 The corresponding decoded structure:
2959
2960 @lisp
2961 (setq decoded (bindat-unpack packet-spec binary-data))
2962 @result{}
2963 ((header
2964 (dest-ip . [192 168 1 100])
2965 (src-ip . [192 168 1 101])
2966 (dest-port . 284)
2967 (src-port . 5408))
2968 (counters . [100000 261])
2969 (items . 2)
2970 (item ((data . [1 2 3 4 5])
2971 (id . "ABCDEF")
2972 (length . 5)
2973 (opcode . 3)
2974 (type . 2))
2975 ((data . [6 7 8 9 10 11 12])
2976 (id . "BCDEFG")
2977 (length . 7)
2978 (opcode . 4)
2979 (type . 1))))
2980 @end lisp
2981
2982 Fetching data from this structure:
2983
2984 @lisp
2985 (bindat-get-field decoded 'item 1 'id)
2986 @result{} "BCDEFG"
2987 @end lisp
2988
2989 @ignore
2990 arch-tag: ba9da253-e65f-4e7f-b727-08fba0a1df7a
2991 @end ignore