* doc/lispref/processes.texi (Network Servers): Standardize apostrophe usage.
[bpt/emacs.git] / doc / lispref / processes.texi
1 @c -*-texinfo-*-
2 @c This is part of the GNU Emacs Lisp Reference Manual.
3 @c Copyright (C) 1990-1995, 1998-1999, 2001-2012
4 @c Free Software Foundation, Inc.
5 @c See the file elisp.texi for copying conditions.
6 @setfilename ../../info/processes
7 @node Processes, Display, Abbrevs, Top
8 @chapter Processes
9 @cindex child process
10 @cindex parent process
11 @cindex subprocess
12 @cindex process
13
14 In the terminology of operating systems, a @dfn{process} is a space in
15 which a program can execute. Emacs runs in a process. Emacs Lisp
16 programs can invoke other programs in processes of their own. These are
17 called @dfn{subprocesses} or @dfn{child processes} of the Emacs process,
18 which is their @dfn{parent process}.
19
20 A subprocess of Emacs may be @dfn{synchronous} or @dfn{asynchronous},
21 depending on how it is created. When you create a synchronous
22 subprocess, the Lisp program waits for the subprocess to terminate
23 before continuing execution. When you create an asynchronous
24 subprocess, it can run in parallel with the Lisp program. This kind of
25 subprocess is represented within Emacs by a Lisp object which is also
26 called a ``process.'' Lisp programs can use this object to communicate
27 with the subprocess or to control it. For example, you can send
28 signals, obtain status information, receive output from the process, or
29 send input to it.
30
31 @defun processp object
32 This function returns @code{t} if @var{object} represents an Emacs
33 subprocess, @code{nil} otherwise.
34 @end defun
35
36 In addition to subprocesses of the current Emacs session, you can
37 also access other processes running on your machine. @xref{System
38 Processes}.
39
40 @menu
41 * Subprocess Creation:: Functions that start subprocesses.
42 * Shell Arguments:: Quoting an argument to pass it to a shell.
43 * Synchronous Processes:: Details of using synchronous subprocesses.
44 * Asynchronous Processes:: Starting up an asynchronous subprocess.
45 * Deleting Processes:: Eliminating an asynchronous subprocess.
46 * Process Information:: Accessing run-status and other attributes.
47 * Input to Processes:: Sending input to an asynchronous subprocess.
48 * Signals to Processes:: Stopping, continuing or interrupting
49 an asynchronous subprocess.
50 * Output from Processes:: Collecting output from an asynchronous subprocess.
51 * Sentinels:: Sentinels run when process run-status changes.
52 * Query Before Exit:: Whether to query if exiting will kill a process.
53 * System Processes:: Accessing other processes running on your system.
54 * Transaction Queues:: Transaction-based communication with subprocesses.
55 * Network:: Opening network connections.
56 * Network Servers:: Network servers let Emacs accept net connections.
57 * Datagrams:: UDP network connections.
58 * Low-Level Network:: Lower-level but more general function
59 to create connections and servers.
60 * Misc Network:: Additional relevant functions for net connections.
61 * Serial Ports:: Communicating with serial ports.
62 * Byte Packing:: Using bindat to pack and unpack binary data.
63 @end menu
64
65 @node Subprocess Creation
66 @section Functions that Create Subprocesses
67
68 There are three primitives that create a new subprocess in which to run
69 a program. One of them, @code{start-process}, creates an asynchronous
70 process and returns a process object (@pxref{Asynchronous Processes}).
71 The other two, @code{call-process} and @code{call-process-region},
72 create a synchronous process and do not return a process object
73 (@pxref{Synchronous Processes}).
74
75 Synchronous and asynchronous processes are explained in the following
76 sections. Since the three functions are all called in a similar
77 fashion, their common arguments are described here.
78
79 @cindex execute program
80 @cindex @code{PATH} environment variable
81 @cindex @code{HOME} environment variable
82 In all cases, the function's @var{program} argument specifies the
83 program to be run. An error is signaled if the file is not found or
84 cannot be executed. If the file name is relative, the variable
85 @code{exec-path} contains a list of directories to search. Emacs
86 initializes @code{exec-path} when it starts up, based on the value of
87 the environment variable @code{PATH}. The standard file name
88 constructs, @samp{~}, @samp{.}, and @samp{..}, are interpreted as
89 usual in @code{exec-path}, but environment variable substitutions
90 (@samp{$HOME}, etc.) are not recognized; use
91 @code{substitute-in-file-name} to perform them (@pxref{File Name
92 Expansion}). @code{nil} in this list refers to
93 @code{default-directory}.
94
95 Executing a program can also try adding suffixes to the specified
96 name:
97
98 @defvar exec-suffixes
99 This variable is a list of suffixes (strings) to try adding to the
100 specified program file name. The list should include @code{""} if you
101 want the name to be tried exactly as specified. The default value is
102 system-dependent.
103 @end defvar
104
105 @strong{Please note:} The argument @var{program} contains only the
106 name of the program; it may not contain any command-line arguments. You
107 must use @var{args} to provide those.
108
109 Each of the subprocess-creating functions has a @var{buffer-or-name}
110 argument which specifies where the standard output from the program will
111 go. It should be a buffer or a buffer name; if it is a buffer name,
112 that will create the buffer if it does not already exist. It can also
113 be @code{nil}, which says to discard the output unless a filter function
114 handles it. (@xref{Filter Functions}, and @ref{Read and Print}.)
115 Normally, you should avoid having multiple processes send output to the
116 same buffer because their output would be intermixed randomly.
117
118 @cindex program arguments
119 All three of the subprocess-creating functions have a @code{&rest}
120 argument, @var{args}. The @var{args} must all be strings, and they are
121 supplied to @var{program} as separate command line arguments. Wildcard
122 characters and other shell constructs have no special meanings in these
123 strings, since the strings are passed directly to the specified program.
124
125 The subprocess gets its current directory from the value of
126 @code{default-directory} (@pxref{File Name Expansion}).
127
128 @cindex environment variables, subprocesses
129 The subprocess inherits its environment from Emacs, but you can
130 specify overrides for it with @code{process-environment}. @xref{System
131 Environment}.
132
133 @defvar exec-directory
134 @pindex movemail
135 The value of this variable is a string, the name of a directory that
136 contains programs that come with GNU Emacs, programs intended for Emacs
137 to invoke. The program @code{movemail} is an example of such a program;
138 Rmail uses it to fetch new mail from an inbox.
139 @end defvar
140
141 @defopt exec-path
142 The value of this variable is a list of directories to search for
143 programs to run in subprocesses. Each element is either the name of a
144 directory (i.e., a string), or @code{nil}, which stands for the default
145 directory (which is the value of @code{default-directory}).
146 @cindex program directories
147
148 The value of @code{exec-path} is used by @code{call-process} and
149 @code{start-process} when the @var{program} argument is not an absolute
150 file name.
151 @end defopt
152
153 @node Shell Arguments
154 @section Shell Arguments
155 @cindex arguments for shell commands
156 @cindex shell command arguments
157
158 Lisp programs sometimes need to run a shell and give it a command
159 that contains file names that were specified by the user. These
160 programs ought to be able to support any valid file name. But the shell
161 gives special treatment to certain characters, and if these characters
162 occur in the file name, they will confuse the shell. To handle these
163 characters, use the function @code{shell-quote-argument}:
164
165 @defun shell-quote-argument argument
166 This function returns a string which represents, in shell syntax,
167 an argument whose actual contents are @var{argument}. It should
168 work reliably to concatenate the return value into a shell command
169 and then pass it to a shell for execution.
170
171 Precisely what this function does depends on your operating system. The
172 function is designed to work with the syntax of your system's standard
173 shell; if you use an unusual shell, you will need to redefine this
174 function.
175
176 @example
177 ;; @r{This example shows the behavior on GNU and Unix systems.}
178 (shell-quote-argument "foo > bar")
179 @result{} "foo\\ \\>\\ bar"
180
181 ;; @r{This example shows the behavior on MS-DOS and MS-Windows.}
182 (shell-quote-argument "foo > bar")
183 @result{} "\"foo > bar\""
184 @end example
185
186 Here's an example of using @code{shell-quote-argument} to construct
187 a shell command:
188
189 @example
190 (concat "diff -c "
191 (shell-quote-argument oldfile)
192 " "
193 (shell-quote-argument newfile))
194 @end example
195 @end defun
196
197 @cindex quoting and unquoting command-line arguments
198 @cindex minibuffer input, and command-line arguments
199 @cindex @code{call-process}, command-line arguments from minibuffer
200 @cindex @code{start-process}, command-line arguments from minibuffer
201 The following two functions are useful for combining a list of
202 individual command-line argument strings into a single string, and
203 taking a string apart into a list of individual command-line
204 arguments. These functions are mainly intended to be used for
205 converting user input in the minibuffer, a Lisp string, into a list of
206 string arguments to be passed to @code{call-process} or
207 @code{start-process}, or for the converting such lists of arguments in
208 a single Lisp string to be presented in the minibuffer or echo area.
209
210 @defun split-string-and-unquote string &optional separators
211 This function splits @var{string} into substrings at matches for the
212 regular expression @var{separators}, like @code{split-string} does
213 (@pxref{Creating Strings}); in addition, it removes quoting from the
214 substrings. It then makes a list of the substrings and returns it.
215
216 If @var{separators} is omitted or @code{nil}, it defaults to
217 @code{"\\s-+"}, which is a regular expression that matches one or more
218 characters with whitespace syntax (@pxref{Syntax Class Table}).
219
220 This function supports two types of quoting: enclosing a whole string
221 in double quotes @code{"@dots{}"}, and quoting individual characters
222 with a backslash escape @samp{\}. The latter is also used in Lisp
223 strings, so this function can handle those as well.
224 @end defun
225
226 @defun combine-and-quote-strings list-of-strings &optional separator
227 This function concatenates @var{list-of-strings} into a single string,
228 quoting each string as necessary. It also sticks the @var{separator}
229 string between each pair of strings; if @var{separator} is omitted or
230 @code{nil}, it defaults to @code{" "}. The return value is the
231 resulting string.
232
233 The strings in @var{list-of-strings} that need quoting are those that
234 include @var{separator} as their substring. Quoting a string encloses
235 it in double quotes @code{"@dots{}"}. In the simplest case, if you
236 are consing a command from the individual command-line arguments,
237 every argument that includes embedded blanks will be quoted.
238 @end defun
239
240 @node Synchronous Processes
241 @section Creating a Synchronous Process
242 @cindex synchronous subprocess
243
244 After a @dfn{synchronous process} is created, Emacs waits for the
245 process to terminate before continuing. Starting Dired on GNU or
246 Unix@footnote{On other systems, Emacs uses a Lisp emulation of
247 @code{ls}; see @ref{Contents of Directories}.} is an example of this: it
248 runs @code{ls} in a synchronous process, then modifies the output
249 slightly. Because the process is synchronous, the entire directory
250 listing arrives in the buffer before Emacs tries to do anything with it.
251
252 While Emacs waits for the synchronous subprocess to terminate, the
253 user can quit by typing @kbd{C-g}. The first @kbd{C-g} tries to kill
254 the subprocess with a @code{SIGINT} signal; but it waits until the
255 subprocess actually terminates before quitting. If during that time the
256 user types another @kbd{C-g}, that kills the subprocess instantly with
257 @code{SIGKILL} and quits immediately (except on MS-DOS, where killing
258 other processes doesn't work). @xref{Quitting}.
259
260 The synchronous subprocess functions return an indication of how the
261 process terminated.
262
263 The output from a synchronous subprocess is generally decoded using a
264 coding system, much like text read from a file. The input sent to a
265 subprocess by @code{call-process-region} is encoded using a coding
266 system, much like text written into a file. @xref{Coding Systems}.
267
268 @defun call-process program &optional infile destination display &rest args
269 This function calls @var{program} and waits for it to finish.
270
271 The standard input for the new process comes from file @var{infile} if
272 @var{infile} is not @code{nil}, and from the null device otherwise.
273 The argument @var{destination} says where to put the process output.
274 Here are the possibilities:
275
276 @table @asis
277 @item a buffer
278 Insert the output in that buffer, before point. This includes both the
279 standard output stream and the standard error stream of the process.
280
281 @item a string
282 Insert the output in a buffer with that name, before point.
283
284 @item @code{t}
285 Insert the output in the current buffer, before point.
286
287 @item @code{nil}
288 Discard the output.
289
290 @item 0
291 Discard the output, and return @code{nil} immediately without waiting
292 for the subprocess to finish.
293
294 In this case, the process is not truly synchronous, since it can run in
295 parallel with Emacs; but you can think of it as synchronous in that
296 Emacs is essentially finished with the subprocess as soon as this
297 function returns.
298
299 MS-DOS doesn't support asynchronous subprocesses, so this option doesn't
300 work there.
301
302 @item @code{(:file @var{file-name})}
303 Send the output to the file name specified, overwriting it if it
304 already exists.
305
306 @item @code{(@var{real-destination} @var{error-destination})}
307 Keep the standard output stream separate from the standard error stream;
308 deal with the ordinary output as specified by @var{real-destination},
309 and dispose of the error output according to @var{error-destination}.
310 If @var{error-destination} is @code{nil}, that means to discard the
311 error output, @code{t} means mix it with the ordinary output, and a
312 string specifies a file name to redirect error output into.
313
314 You can't directly specify a buffer to put the error output in; that is
315 too difficult to implement. But you can achieve this result by sending
316 the error output to a temporary file and then inserting the file into a
317 buffer.
318 @end table
319
320 If @var{display} is non-@code{nil}, then @code{call-process} redisplays
321 the buffer as output is inserted. (However, if the coding system chosen
322 for decoding output is @code{undecided}, meaning deduce the encoding
323 from the actual data, then redisplay sometimes cannot continue once
324 non-@acronym{ASCII} characters are encountered. There are fundamental
325 reasons why it is hard to fix this; see @ref{Output from Processes}.)
326
327 Otherwise the function @code{call-process} does no redisplay, and the
328 results become visible on the screen only when Emacs redisplays that
329 buffer in the normal course of events.
330
331 The remaining arguments, @var{args}, are strings that specify command
332 line arguments for the program.
333
334 The value returned by @code{call-process} (unless you told it not to
335 wait) indicates the reason for process termination. A number gives the
336 exit status of the subprocess; 0 means success, and any other value
337 means failure. If the process terminated with a signal,
338 @code{call-process} returns a string describing the signal.
339
340 In the examples below, the buffer @samp{foo} is current.
341
342 @smallexample
343 @group
344 (call-process "pwd" nil t)
345 @result{} 0
346
347 ---------- Buffer: foo ----------
348 /usr/user/lewis/manual
349 ---------- Buffer: foo ----------
350 @end group
351
352 @group
353 (call-process "grep" nil "bar" nil "lewis" "/etc/passwd")
354 @result{} 0
355
356 ---------- Buffer: bar ----------
357 lewis:5LTsHm66CSWKg:398:21:Bil Lewis:/user/lewis:/bin/csh
358
359 ---------- Buffer: bar ----------
360 @end group
361 @end smallexample
362
363 Here is a good example of the use of @code{call-process}, which used to
364 be found in the definition of @code{insert-directory}:
365
366 @smallexample
367 @group
368 (call-process insert-directory-program nil t nil @var{switches}
369 (if full-directory-p
370 (concat (file-name-as-directory file) ".")
371 file))
372 @end group
373 @end smallexample
374 @end defun
375
376 @defun process-file program &optional infile buffer display &rest args
377 This function processes files synchronously in a separate process. It
378 is similar to @code{call-process} but may invoke a file handler based
379 on the value of the variable @code{default-directory}. The current
380 working directory of the subprocess is @code{default-directory}.
381
382 The arguments are handled in almost the same way as for
383 @code{call-process}, with the following differences:
384
385 Some file handlers may not support all combinations and forms of the
386 arguments @var{infile}, @var{buffer}, and @var{display}. For example,
387 some file handlers might behave as if @var{display} were @code{nil},
388 regardless of the value actually passed. As another example, some
389 file handlers might not support separating standard output and error
390 output by way of the @var{buffer} argument.
391
392 If a file handler is invoked, it determines the program to run based
393 on the first argument @var{program}. For instance, consider that a
394 handler for remote files is invoked. Then the path that is used for
395 searching the program might be different than @code{exec-path}.
396
397 The second argument @var{infile} may invoke a file handler. The file
398 handler could be different from the handler chosen for the
399 @code{process-file} function itself. (For example,
400 @code{default-directory} could be on a remote host, whereas
401 @var{infile} is on another remote host. Or @code{default-directory}
402 could be non-special, whereas @var{infile} is on a remote host.)
403
404 If @var{buffer} is a list of the form @code{(@var{real-destination}
405 @var{error-destination})}, and @var{error-destination} names a file,
406 then the same remarks as for @var{infile} apply.
407
408 The remaining arguments (@var{args}) will be passed to the process
409 verbatim. Emacs is not involved in processing file names that are
410 present in @var{args}. To avoid confusion, it may be best to avoid
411 absolute file names in @var{args}, but rather to specify all file
412 names as relative to @code{default-directory}. The function
413 @code{file-relative-name} is useful for constructing such relative
414 file names.
415 @end defun
416
417 @defvar process-file-side-effects
418 This variable indicates, whether a call of @code{process-file} changes
419 remote files.
420
421 Per default, this variable is always set to @code{t}, meaning that a
422 call of @code{process-file} could potentially change any file on a
423 remote host. When set to @code{nil}, a file handler could optimize
424 its behavior with respect to remote file attributes caching.
425
426 This variable should never be changed by @code{setq}. Instead of, it
427 shall be set only by let-binding.
428 @end defvar
429
430 @defun call-process-region start end program &optional delete destination display &rest args
431 This function sends the text from @var{start} to @var{end} as
432 standard input to a process running @var{program}. It deletes the text
433 sent if @var{delete} is non-@code{nil}; this is useful when
434 @var{destination} is @code{t}, to insert the output in the current
435 buffer in place of the input.
436
437 The arguments @var{destination} and @var{display} control what to do
438 with the output from the subprocess, and whether to update the display
439 as it comes in. For details, see the description of
440 @code{call-process}, above. If @var{destination} is the integer 0,
441 @code{call-process-region} discards the output and returns @code{nil}
442 immediately, without waiting for the subprocess to finish (this only
443 works if asynchronous subprocesses are supported).
444
445 The remaining arguments, @var{args}, are strings that specify command
446 line arguments for the program.
447
448 The return value of @code{call-process-region} is just like that of
449 @code{call-process}: @code{nil} if you told it to return without
450 waiting; otherwise, a number or string which indicates how the
451 subprocess terminated.
452
453 In the following example, we use @code{call-process-region} to run the
454 @code{cat} utility, with standard input being the first five characters
455 in buffer @samp{foo} (the word @samp{input}). @code{cat} copies its
456 standard input into its standard output. Since the argument
457 @var{destination} is @code{t}, this output is inserted in the current
458 buffer.
459
460 @smallexample
461 @group
462 ---------- Buffer: foo ----------
463 input@point{}
464 ---------- Buffer: foo ----------
465 @end group
466
467 @group
468 (call-process-region 1 6 "cat" nil t)
469 @result{} 0
470
471 ---------- Buffer: foo ----------
472 inputinput@point{}
473 ---------- Buffer: foo ----------
474 @end group
475 @end smallexample
476
477 The @code{shell-command-on-region} command uses
478 @code{call-process-region} like this:
479
480 @smallexample
481 @group
482 (call-process-region
483 start end
484 shell-file-name ; @r{Name of program.}
485 nil ; @r{Do not delete region.}
486 buffer ; @r{Send output to @code{buffer}.}
487 nil ; @r{No redisplay during output.}
488 "-c" command) ; @r{Arguments for the shell.}
489 @end group
490 @end smallexample
491 @end defun
492
493 @defun call-process-shell-command command &optional infile destination display &rest args
494 This function executes the shell command @var{command} synchronously.
495 The final arguments @var{args} are additional arguments to add at the
496 end of @var{command}. The other arguments are handled as in
497 @code{call-process}.
498 @end defun
499
500 @defun process-file-shell-command command &optional infile destination display &rest args
501 This function is like @code{call-process-shell-command}, but uses
502 @code{process-file} internally. Depending on @code{default-directory},
503 @var{command} can be executed also on remote hosts.
504 @end defun
505
506 @defun shell-command-to-string command
507 This function executes @var{command} (a string) as a shell command,
508 then returns the command's output as a string.
509 @end defun
510
511 @defun process-lines program &rest args
512 This function runs @var{program}, waits for it to finish, and returns
513 its output as a list of strings. Each string in the list holds a
514 single line of text output by the program; the end-of-line characters
515 are stripped from each line. The arguments beyond @var{program},
516 @var{args}, are strings that specify command-line arguments with which
517 to run the program.
518
519 If @var{program} exits with a non-zero exit status, this function
520 signals an error.
521
522 This function works by calling @code{call-process}, so program output
523 is decoded in the same way as for @code{call-process}.
524 @end defun
525
526 @node Asynchronous Processes
527 @section Creating an Asynchronous Process
528 @cindex asynchronous subprocess
529
530 After an @dfn{asynchronous process} is created, Emacs and the subprocess
531 both continue running immediately. The process thereafter runs
532 in parallel with Emacs, and the two can communicate with each other
533 using the functions described in the following sections. However,
534 communication is only partially asynchronous: Emacs sends data to the
535 process only when certain functions are called, and Emacs accepts data
536 from the process only when Emacs is waiting for input or for a time
537 delay.
538
539 Here we describe how to create an asynchronous process.
540
541 @defun start-process name buffer-or-name program &rest args
542 This function creates a new asynchronous subprocess and starts the
543 program @var{program} running in it. It returns a process object that
544 stands for the new subprocess in Lisp. The argument @var{name}
545 specifies the name for the process object; if a process with this name
546 already exists, then @var{name} is modified (by appending @samp{<1>},
547 etc.) to be unique. The buffer @var{buffer-or-name} is the buffer to
548 associate with the process.
549
550 The remaining arguments, @var{args}, are strings that specify command
551 line arguments for the program.
552
553 In the example below, the first process is started and runs (rather,
554 sleeps) for 100 seconds. Meanwhile, the second process is started, and
555 given the name @samp{my-process<1>} for the sake of uniqueness. It
556 inserts the directory listing at the end of the buffer @samp{foo},
557 before the first process finishes. Then it finishes, and a message to
558 that effect is inserted in the buffer. Much later, the first process
559 finishes, and another message is inserted in the buffer for it.
560
561 @smallexample
562 @group
563 (start-process "my-process" "foo" "sleep" "100")
564 @result{} #<process my-process>
565 @end group
566
567 @group
568 (start-process "my-process" "foo" "ls" "-l" "/user/lewis/bin")
569 @result{} #<process my-process<1>>
570
571 ---------- Buffer: foo ----------
572 total 2
573 lrwxrwxrwx 1 lewis 14 Jul 22 10:12 gnuemacs --> /emacs
574 -rwxrwxrwx 1 lewis 19 Jul 30 21:02 lemon
575
576 Process my-process<1> finished
577
578 Process my-process finished
579 ---------- Buffer: foo ----------
580 @end group
581 @end smallexample
582 @end defun
583
584 @defun start-file-process name buffer-or-name program &rest args
585 Like @code{start-process}, this function starts a new asynchronous
586 subprocess running @var{program} in it, and returns its process
587 object---when @code{default-directory} is not a magic file name.
588
589 If @code{default-directory} is magic, the function invokes its file
590 handler instead. This handler ought to run @var{program}, perhaps on
591 the local host, perhaps on a remote host that corresponds to
592 @code{default-directory}. In the latter case, the local part of
593 @code{default-directory} becomes the working directory of the process.
594
595 This function does not try to invoke file name handlers for
596 @var{program} or for the @var{program-args}.
597
598 Depending on the implementation of the file handler, it might not be
599 possible to apply @code{process-filter} or @code{process-sentinel} to
600 the resulting process object (@pxref{Filter Functions}, @pxref{Sentinels}).
601
602 Some file handlers may not support @code{start-file-process} (for
603 example @code{ange-ftp-hook-function}). In such cases, the function
604 does nothing and returns @code{nil}.
605 @end defun
606
607 @defun start-process-shell-command name buffer-or-name command
608 This function is like @code{start-process} except that it uses a shell
609 to execute the specified command. The argument @var{command} is a shell
610 command name. The variable @code{shell-file-name} specifies which shell to
611 use.
612
613 The point of running a program through the shell, rather than directly
614 with @code{start-process}, is so that you can employ shell features such
615 as wildcards in the arguments. It follows that if you include an
616 arbitrary user-specified arguments in the command, you should quote it
617 with @code{shell-quote-argument} first, so that any special shell
618 characters do @emph{not} have their special shell meanings. @xref{Shell
619 Arguments}.
620 @end defun
621
622 @defun start-file-process-shell-command name buffer-or-name command
623 This function is like @code{start-process-shell-command}, but uses
624 @code{start-file-process} internally. By this, @var{command} can be
625 executed also on remote hosts, depending on @code{default-directory}.
626 @end defun
627
628 @defvar process-connection-type
629 @cindex pipes
630 @cindex @acronym{PTY}s
631 This variable controls the type of device used to communicate with
632 asynchronous subprocesses. If it is non-@code{nil}, then @acronym{PTY}s are
633 used, when available. Otherwise, pipes are used.
634
635 @acronym{PTY}s are usually preferable for processes visible to the user, as
636 in Shell mode, because they allow job control (@kbd{C-c}, @kbd{C-z},
637 etc.) to work between the process and its children, whereas pipes do
638 not. For subprocesses used for internal purposes by programs, it is
639 often better to use a pipe, because they are more efficient. In
640 addition, the total number of @acronym{PTY}s is limited on many systems and
641 it is good not to waste them.
642
643 The value of @code{process-connection-type} takes effect when
644 @code{start-process} is called. So you can specify how to communicate
645 with one subprocess by binding the variable around the call to
646 @code{start-process}.
647
648 @smallexample
649 @group
650 (let ((process-connection-type nil)) ; @r{Use a pipe.}
651 (start-process @dots{}))
652 @end group
653 @end smallexample
654
655 To determine whether a given subprocess actually got a pipe or a
656 @acronym{PTY}, use the function @code{process-tty-name} (@pxref{Process
657 Information}).
658 @end defvar
659
660 @node Deleting Processes
661 @section Deleting Processes
662 @cindex deleting processes
663
664 @dfn{Deleting a process} disconnects Emacs immediately from the
665 subprocess. Processes are deleted automatically after they terminate,
666 but not necessarily right away. You can delete a process explicitly
667 at any time. If you delete a terminated process explicitly before it
668 is deleted automatically, no harm results. Deleting a running
669 process sends a signal to terminate it (and its child processes if
670 any), and calls the process sentinel if it has one. @xref{Sentinels}.
671
672 When a process is deleted, the process object itself continues to
673 exist as long as other Lisp objects point to it. All the Lisp
674 primitives that work on process objects accept deleted processes, but
675 those that do I/O or send signals will report an error. The process
676 mark continues to point to the same place as before, usually into a
677 buffer where output from the process was being inserted.
678
679 @defopt delete-exited-processes
680 This variable controls automatic deletion of processes that have
681 terminated (due to calling @code{exit} or to a signal). If it is
682 @code{nil}, then they continue to exist until the user runs
683 @code{list-processes}. Otherwise, they are deleted immediately after
684 they exit.
685 @end defopt
686
687 @defun delete-process process
688 This function deletes a process, killing it with a @code{SIGKILL}
689 signal. The argument may be a process, the name of a process, a
690 buffer, or the name of a buffer. (A buffer or buffer-name stands for
691 the process that @code{get-buffer-process} returns.) Calling
692 @code{delete-process} on a running process terminates it, updates the
693 process status, and runs the sentinel (if any) immediately. If the
694 process has already terminated, calling @code{delete-process} has no
695 effect on its status, or on the running of its sentinel (which will
696 happen sooner or later).
697
698 @smallexample
699 @group
700 (delete-process "*shell*")
701 @result{} nil
702 @end group
703 @end smallexample
704 @end defun
705
706 @node Process Information
707 @section Process Information
708
709 Several functions return information about processes.
710 @code{list-processes} is provided for interactive use.
711
712 @deffn Command list-processes &optional query-only
713 This command displays a listing of all living processes. In addition,
714 it finally deletes any process whose status was @samp{Exited} or
715 @samp{Signaled}. It returns @code{nil}.
716
717 The processes are shown in a buffer named @samp{*Process List*}, whose
718 major mode is named Process Menu mode.
719
720 If @var{query-only} is non-@code{nil} then it lists only processes
721 whose query flag is non-@code{nil}. @xref{Query Before Exit}.
722 @end deffn
723
724 @defun process-list
725 This function returns a list of all processes that have not been deleted.
726
727 @smallexample
728 @group
729 (process-list)
730 @result{} (#<process display-time> #<process shell>)
731 @end group
732 @end smallexample
733 @end defun
734
735 @defun get-process name
736 This function returns the process named @var{name}, or @code{nil} if
737 there is none. An error is signaled if @var{name} is not a string.
738
739 @smallexample
740 @group
741 (get-process "shell")
742 @result{} #<process shell>
743 @end group
744 @end smallexample
745 @end defun
746
747 @defun process-command process
748 This function returns the command that was executed to start
749 @var{process}. This is a list of strings, the first string being the
750 program executed and the rest of the strings being the arguments that
751 were given to the program.
752
753 @smallexample
754 @group
755 (process-command (get-process "shell"))
756 @result{} ("/bin/csh" "-i")
757 @end group
758 @end smallexample
759 @end defun
760
761 @defun process-contact process &optional key
762
763 This function returns information about how a network or serial
764 process was set up. For a network process, when @var{key} is
765 @code{nil}, it returns @code{(@var{hostname} @var{service})} which
766 specifies what you connected to. For a serial process, when @var{key}
767 is @code{nil}, it returns @code{(@var{port} @var{speed})}. For an
768 ordinary child process, this function always returns @code{t}.
769
770 If @var{key} is @code{t}, the value is the complete status information
771 for the connection, server, or serial port; that is, the list of
772 keywords and values specified in @code{make-network-process} or
773 @code{make-serial-process}, except that some of the values represent
774 the current status instead of what you specified.
775
776 For a network process:
777
778 @table @code
779 @item :buffer
780 The associated value is the process buffer.
781 @item :filter
782 The associated value is the process filter function.
783 @item :sentinel
784 The associated value is the process sentinel function.
785 @item :remote
786 In a connection, the address in internal format of the remote peer.
787 @item :local
788 The local address, in internal format.
789 @item :service
790 In a server, if you specified @code{t} for @var{service},
791 this value is the actual port number.
792 @end table
793
794 @code{:local} and @code{:remote} are included even if they were not
795 specified explicitly in @code{make-network-process}.
796
797 For a serial process, see @code{make-serial-process} and
798 @code{serial-process-configure} for a list of keys.
799
800 If @var{key} is a keyword, the function returns the value corresponding
801 to that keyword.
802 @end defun
803
804 @defun process-id process
805 This function returns the @acronym{PID} of @var{process}. This is an
806 integer that distinguishes the process @var{process} from all other
807 processes running on the same computer at the current time. The
808 @acronym{PID} of a process is chosen by the operating system kernel when the
809 process is started and remains constant as long as the process exists.
810 @end defun
811
812 @defun process-name process
813 This function returns the name of @var{process}.
814 @end defun
815
816 @defun process-status process-name
817 This function returns the status of @var{process-name} as a symbol.
818 The argument @var{process-name} must be a process, a buffer, or a
819 process name (a string).
820
821 The possible values for an actual subprocess are:
822
823 @table @code
824 @item run
825 for a process that is running.
826 @item stop
827 for a process that is stopped but continuable.
828 @item exit
829 for a process that has exited.
830 @item signal
831 for a process that has received a fatal signal.
832 @item open
833 for a network connection that is open.
834 @item closed
835 for a network connection that is closed. Once a connection
836 is closed, you cannot reopen it, though you might be able to open
837 a new connection to the same place.
838 @item connect
839 for a non-blocking connection that is waiting to complete.
840 @item failed
841 for a non-blocking connection that has failed to complete.
842 @item listen
843 for a network server that is listening.
844 @item nil
845 if @var{process-name} is not the name of an existing process.
846 @end table
847
848 @smallexample
849 @group
850 (process-status (get-buffer "*shell*"))
851 @result{} run
852 @end group
853 @group
854 x
855 @result{} #<process xx<1>>
856 (process-status x)
857 @result{} exit
858 @end group
859 @end smallexample
860
861 For a network connection, @code{process-status} returns one of the symbols
862 @code{open} or @code{closed}. The latter means that the other side
863 closed the connection, or Emacs did @code{delete-process}.
864 @end defun
865
866 @defun process-live-p process
867 This function returns nin-@code{nil} if @var{process} is alive. A
868 process is considered alive if its status is @code{run}, @code{open},
869 @code{listen}, @code{connect} or @code{stop}.
870 @end defun
871
872 @defun process-type process
873 This function returns the symbol @code{network} for a network
874 connection or server, @code{serial} for a serial port connection, or
875 @code{real} for a real subprocess.
876 @end defun
877
878 @defun process-exit-status process
879 This function returns the exit status of @var{process} or the signal
880 number that killed it. (Use the result of @code{process-status} to
881 determine which of those it is.) If @var{process} has not yet
882 terminated, the value is 0.
883 @end defun
884
885 @defun process-tty-name process
886 This function returns the terminal name that @var{process} is using for
887 its communication with Emacs---or @code{nil} if it is using pipes
888 instead of a terminal (see @code{process-connection-type} in
889 @ref{Asynchronous Processes}). If @var{process} represents a program
890 running on a remote host, the terminal name used by that program on
891 the remote host is provided as process property @code{remote-tty}.
892 @end defun
893
894 @defun process-coding-system process
895 @anchor{Coding systems for a subprocess}
896 This function returns a cons cell describing the coding systems in use
897 for decoding output from @var{process} and for encoding input to
898 @var{process} (@pxref{Coding Systems}). The value has this form:
899
900 @example
901 (@var{coding-system-for-decoding} . @var{coding-system-for-encoding})
902 @end example
903 @end defun
904
905 @defun set-process-coding-system process &optional decoding-system encoding-system
906 This function specifies the coding systems to use for subsequent output
907 from and input to @var{process}. It will use @var{decoding-system} to
908 decode subprocess output, and @var{encoding-system} to encode subprocess
909 input.
910 @end defun
911
912 Every process also has a property list that you can use to store
913 miscellaneous values associated with the process.
914
915 @defun process-get process propname
916 This function returns the value of the @var{propname} property
917 of @var{process}.
918 @end defun
919
920 @defun process-put process propname value
921 This function sets the value of the @var{propname} property
922 of @var{process} to @var{value}.
923 @end defun
924
925 @defun process-plist process
926 This function returns the process plist of @var{process}.
927 @end defun
928
929 @defun set-process-plist process plist
930 This function sets the process plist of @var{process} to @var{plist}.
931 @end defun
932
933 @node Input to Processes
934 @section Sending Input to Processes
935 @cindex process input
936
937 Asynchronous subprocesses receive input when it is sent to them by
938 Emacs, which is done with the functions in this section. You must
939 specify the process to send input to, and the input data to send. The
940 data appears on the ``standard input'' of the subprocess.
941
942 Some operating systems have limited space for buffered input in a
943 @acronym{PTY}. On these systems, Emacs sends an @acronym{EOF}
944 periodically amidst the other characters, to force them through. For
945 most programs, these @acronym{EOF}s do no harm.
946
947 Subprocess input is normally encoded using a coding system before the
948 subprocess receives it, much like text written into a file. You can use
949 @code{set-process-coding-system} to specify which coding system to use
950 (@pxref{Process Information}). Otherwise, the coding system comes from
951 @code{coding-system-for-write}, if that is non-@code{nil}; or else from
952 the defaulting mechanism (@pxref{Default Coding Systems}).
953
954 Sometimes the system is unable to accept input for that process,
955 because the input buffer is full. When this happens, the send functions
956 wait a short while, accepting output from subprocesses, and then try
957 again. This gives the subprocess a chance to read more of its pending
958 input and make space in the buffer. It also allows filters, sentinels
959 and timers to run---so take account of that in writing your code.
960
961 In these functions, the @var{process} argument can be a process or
962 the name of a process, or a buffer or buffer name (which stands
963 for a process via @code{get-buffer-process}). @code{nil} means
964 the current buffer's process.
965
966 @defun process-send-string process string
967 This function sends @var{process} the contents of @var{string} as
968 standard input. If it is @code{nil}, the current buffer's process is used.
969
970 The function returns @code{nil}.
971
972 @smallexample
973 @group
974 (process-send-string "shell<1>" "ls\n")
975 @result{} nil
976 @end group
977
978
979 @group
980 ---------- Buffer: *shell* ----------
981 ...
982 introduction.texi syntax-tables.texi~
983 introduction.texi~ text.texi
984 introduction.txt text.texi~
985 ...
986 ---------- Buffer: *shell* ----------
987 @end group
988 @end smallexample
989 @end defun
990
991 @defun process-send-region process start end
992 This function sends the text in the region defined by @var{start} and
993 @var{end} as standard input to @var{process}.
994
995 An error is signaled unless both @var{start} and @var{end} are
996 integers or markers that indicate positions in the current buffer. (It
997 is unimportant which number is larger.)
998 @end defun
999
1000 @defun process-send-eof &optional process
1001 This function makes @var{process} see an end-of-file in its
1002 input. The @acronym{EOF} comes after any text already sent to it.
1003
1004 The function returns @var{process}.
1005
1006 @smallexample
1007 @group
1008 (process-send-eof "shell")
1009 @result{} "shell"
1010 @end group
1011 @end smallexample
1012 @end defun
1013
1014 @defun process-running-child-p &optional process
1015 This function will tell you whether a @var{process} has given control of
1016 its terminal to its own child process. The value is @code{t} if this is
1017 true, or if Emacs cannot tell; it is @code{nil} if Emacs can be certain
1018 that this is not so.
1019 @end defun
1020
1021 @node Signals to Processes
1022 @section Sending Signals to Processes
1023 @cindex process signals
1024 @cindex sending signals
1025 @cindex signals
1026
1027 @dfn{Sending a signal} to a subprocess is a way of interrupting its
1028 activities. There are several different signals, each with its own
1029 meaning. The set of signals and their names is defined by the operating
1030 system. For example, the signal @code{SIGINT} means that the user has
1031 typed @kbd{C-c}, or that some analogous thing has happened.
1032
1033 Each signal has a standard effect on the subprocess. Most signals
1034 kill the subprocess, but some stop or resume execution instead. Most
1035 signals can optionally be handled by programs; if the program handles
1036 the signal, then we can say nothing in general about its effects.
1037
1038 You can send signals explicitly by calling the functions in this
1039 section. Emacs also sends signals automatically at certain times:
1040 killing a buffer sends a @code{SIGHUP} signal to all its associated
1041 processes; killing Emacs sends a @code{SIGHUP} signal to all remaining
1042 processes. (@code{SIGHUP} is a signal that usually indicates that the
1043 user hung up the phone.)
1044
1045 Each of the signal-sending functions takes two optional arguments:
1046 @var{process} and @var{current-group}.
1047
1048 The argument @var{process} must be either a process, a process
1049 name, a buffer, a buffer name, or @code{nil}. A buffer or buffer name
1050 stands for a process through @code{get-buffer-process}. @code{nil}
1051 stands for the process associated with the current buffer. An error
1052 is signaled if @var{process} does not identify a process.
1053
1054 The argument @var{current-group} is a flag that makes a difference
1055 when you are running a job-control shell as an Emacs subprocess. If it
1056 is non-@code{nil}, then the signal is sent to the current process-group
1057 of the terminal that Emacs uses to communicate with the subprocess. If
1058 the process is a job-control shell, this means the shell's current
1059 subjob. If it is @code{nil}, the signal is sent to the process group of
1060 the immediate subprocess of Emacs. If the subprocess is a job-control
1061 shell, this is the shell itself.
1062
1063 The flag @var{current-group} has no effect when a pipe is used to
1064 communicate with the subprocess, because the operating system does not
1065 support the distinction in the case of pipes. For the same reason,
1066 job-control shells won't work when a pipe is used. See
1067 @code{process-connection-type} in @ref{Asynchronous Processes}.
1068
1069 @defun interrupt-process &optional process current-group
1070 This function interrupts the process @var{process} by sending the
1071 signal @code{SIGINT}. Outside of Emacs, typing the ``interrupt
1072 character'' (normally @kbd{C-c} on some systems, and @code{DEL} on
1073 others) sends this signal. When the argument @var{current-group} is
1074 non-@code{nil}, you can think of this function as ``typing @kbd{C-c}''
1075 on the terminal by which Emacs talks to the subprocess.
1076 @end defun
1077
1078 @defun kill-process &optional process current-group
1079 This function kills the process @var{process} by sending the
1080 signal @code{SIGKILL}. This signal kills the subprocess immediately,
1081 and cannot be handled by the subprocess.
1082 @end defun
1083
1084 @defun quit-process &optional process current-group
1085 This function sends the signal @code{SIGQUIT} to the process
1086 @var{process}. This signal is the one sent by the ``quit
1087 character'' (usually @kbd{C-b} or @kbd{C-\}) when you are not inside
1088 Emacs.
1089 @end defun
1090
1091 @defun stop-process &optional process current-group
1092 This function stops the process @var{process} by sending the
1093 signal @code{SIGTSTP}. Use @code{continue-process} to resume its
1094 execution.
1095
1096 Outside of Emacs, on systems with job control, the ``stop character''
1097 (usually @kbd{C-z}) normally sends this signal. When
1098 @var{current-group} is non-@code{nil}, you can think of this function as
1099 ``typing @kbd{C-z}'' on the terminal Emacs uses to communicate with the
1100 subprocess.
1101 @end defun
1102
1103 @defun continue-process &optional process current-group
1104 This function resumes execution of the process @var{process} by sending
1105 it the signal @code{SIGCONT}. This presumes that @var{process} was
1106 stopped previously.
1107 @end defun
1108
1109 @defun signal-process process signal
1110 This function sends a signal to process @var{process}. The argument
1111 @var{signal} specifies which signal to send; it should be an integer.
1112
1113 The @var{process} argument can be a system process @acronym{ID}; that
1114 allows you to send signals to processes that are not children of
1115 Emacs. @xref{System Processes}.
1116 @end defun
1117
1118 @node Output from Processes
1119 @section Receiving Output from Processes
1120 @cindex process output
1121 @cindex output from processes
1122
1123 There are two ways to receive the output that a subprocess writes to
1124 its standard output stream. The output can be inserted in a buffer,
1125 which is called the associated buffer of the process, or a function
1126 called the @dfn{filter function} can be called to act on the output. If
1127 the process has no buffer and no filter function, its output is
1128 discarded.
1129
1130 When a subprocess terminates, Emacs reads any pending output,
1131 then stops reading output from that subprocess. Therefore, if the
1132 subprocess has children that are still live and still producing
1133 output, Emacs won't receive that output.
1134
1135 Output from a subprocess can arrive only while Emacs is waiting: when
1136 reading terminal input, in @code{sit-for} and @code{sleep-for}
1137 (@pxref{Waiting}), and in @code{accept-process-output} (@pxref{Accepting
1138 Output}). This minimizes the problem of timing errors that usually
1139 plague parallel programming. For example, you can safely create a
1140 process and only then specify its buffer or filter function; no output
1141 can arrive before you finish, if the code in between does not call any
1142 primitive that waits.
1143
1144 @defvar process-adaptive-read-buffering
1145 On some systems, when Emacs reads the output from a subprocess, the
1146 output data is read in very small blocks, potentially resulting in
1147 very poor performance. This behavior can be remedied to some extent
1148 by setting the variable @var{process-adaptive-read-buffering} to a
1149 non-@code{nil} value (the default), as it will automatically delay reading
1150 from such processes, thus allowing them to produce more output before
1151 Emacs tries to read it.
1152 @end defvar
1153
1154 It is impossible to separate the standard output and standard error
1155 streams of the subprocess, because Emacs normally spawns the subprocess
1156 inside a pseudo-TTY, and a pseudo-TTY has only one output channel. If
1157 you want to keep the output to those streams separate, you should
1158 redirect one of them to a file---for example, by using an appropriate
1159 shell command.
1160
1161 @menu
1162 * Process Buffers:: If no filter, output is put in a buffer.
1163 * Filter Functions:: Filter functions accept output from the process.
1164 * Decoding Output:: Filters can get unibyte or multibyte strings.
1165 * Accepting Output:: How to wait until process output arrives.
1166 @end menu
1167
1168 @node Process Buffers
1169 @subsection Process Buffers
1170
1171 A process can (and usually does) have an @dfn{associated buffer},
1172 which is an ordinary Emacs buffer that is used for two purposes: storing
1173 the output from the process, and deciding when to kill the process. You
1174 can also use the buffer to identify a process to operate on, since in
1175 normal practice only one process is associated with any given buffer.
1176 Many applications of processes also use the buffer for editing input to
1177 be sent to the process, but this is not built into Emacs Lisp.
1178
1179 Unless the process has a filter function (@pxref{Filter Functions}),
1180 its output is inserted in the associated buffer. The position to insert
1181 the output is determined by the @code{process-mark}, which is then
1182 updated to point to the end of the text just inserted. Usually, but not
1183 always, the @code{process-mark} is at the end of the buffer.
1184
1185 @findex process-kill-buffer-query-function
1186 Killing the associated buffer of a process also kills the process.
1187 Emacs asks for confirmation first, if the process's
1188 @code{process-query-on-exit-flag} is non-@code{nil} (@pxref{Query
1189 Before Exit}). This confirmation is done by the function
1190 @code{process-kill-buffer-query-function}, which is run from
1191 @code{kill-buffer-query-functions} (@pxref{Killing Buffers}).
1192
1193 @defun process-buffer process
1194 This function returns the associated buffer of the process
1195 @var{process}.
1196
1197 @smallexample
1198 @group
1199 (process-buffer (get-process "shell"))
1200 @result{} #<buffer *shell*>
1201 @end group
1202 @end smallexample
1203 @end defun
1204
1205 @defun process-mark process
1206 This function returns the process marker for @var{process}, which is the
1207 marker that says where to insert output from the process.
1208
1209 If @var{process} does not have a buffer, @code{process-mark} returns a
1210 marker that points nowhere.
1211
1212 Insertion of process output in a buffer uses this marker to decide where
1213 to insert, and updates it to point after the inserted text. That is why
1214 successive batches of output are inserted consecutively.
1215
1216 Filter functions normally should use this marker in the same fashion
1217 as is done by direct insertion of output in the buffer. A good
1218 example of a filter function that uses @code{process-mark} is found at
1219 the end of the following section.
1220
1221 When the user is expected to enter input in the process buffer for
1222 transmission to the process, the process marker separates the new input
1223 from previous output.
1224 @end defun
1225
1226 @defun set-process-buffer process buffer
1227 This function sets the buffer associated with @var{process} to
1228 @var{buffer}. If @var{buffer} is @code{nil}, the process becomes
1229 associated with no buffer.
1230 @end defun
1231
1232 @defun get-buffer-process buffer-or-name
1233 This function returns a nondeleted process associated with the buffer
1234 specified by @var{buffer-or-name}. If there are several processes
1235 associated with it, this function chooses one (currently, the one most
1236 recently created, but don't count on that). Deletion of a process
1237 (see @code{delete-process}) makes it ineligible for this function to
1238 return.
1239
1240 It is usually a bad idea to have more than one process associated with
1241 the same buffer.
1242
1243 @smallexample
1244 @group
1245 (get-buffer-process "*shell*")
1246 @result{} #<process shell>
1247 @end group
1248 @end smallexample
1249
1250 Killing the process's buffer deletes the process, which kills the
1251 subprocess with a @code{SIGHUP} signal (@pxref{Signals to Processes}).
1252 @end defun
1253
1254 @node Filter Functions
1255 @subsection Process Filter Functions
1256 @cindex filter function
1257 @cindex process filter
1258
1259 A process @dfn{filter function} is a function that receives the
1260 standard output from the associated process. If a process has a filter,
1261 then @emph{all} output from that process is passed to the filter. The
1262 process buffer is used directly for output from the process only when
1263 there is no filter.
1264
1265 The filter function can only be called when Emacs is waiting for
1266 something, because process output arrives only at such times. Emacs
1267 waits when reading terminal input, in @code{sit-for} and
1268 @code{sleep-for} (@pxref{Waiting}), and in @code{accept-process-output}
1269 (@pxref{Accepting Output}).
1270
1271 A filter function must accept two arguments: the associated process
1272 and a string, which is output just received from it. The function is
1273 then free to do whatever it chooses with the output.
1274
1275 Quitting is normally inhibited within a filter function---otherwise,
1276 the effect of typing @kbd{C-g} at command level or to quit a user
1277 command would be unpredictable. If you want to permit quitting inside
1278 a filter function, bind @code{inhibit-quit} to @code{nil}. In most
1279 cases, the right way to do this is with the macro
1280 @code{with-local-quit}. @xref{Quitting}.
1281
1282 If an error happens during execution of a filter function, it is
1283 caught automatically, so that it doesn't stop the execution of whatever
1284 program was running when the filter function was started. However, if
1285 @code{debug-on-error} is non-@code{nil}, the error-catching is turned
1286 off. This makes it possible to use the Lisp debugger to debug the
1287 filter function. @xref{Debugger}.
1288
1289 Many filter functions sometimes or always insert the text in the
1290 process's buffer, mimicking the actions of Emacs when there is no
1291 filter. Such filter functions need to use @code{set-buffer} in order to
1292 be sure to insert in that buffer. To avoid setting the current buffer
1293 semipermanently, these filter functions must save and restore the
1294 current buffer. They should also check whether the buffer is still
1295 alive, update the process marker, and in some cases update the value
1296 of point. Here is how to do these things:
1297
1298 @smallexample
1299 @group
1300 (defun ordinary-insertion-filter (proc string)
1301 (when (buffer-live-p (process-buffer proc))
1302 (with-current-buffer (process-buffer proc)
1303 (let ((moving (= (point) (process-mark proc))))
1304 @end group
1305 @group
1306 (save-excursion
1307 ;; @r{Insert the text, advancing the process marker.}
1308 (goto-char (process-mark proc))
1309 (insert string)
1310 (set-marker (process-mark proc) (point)))
1311 (if moving (goto-char (process-mark proc)))))))
1312 @end group
1313 @end smallexample
1314
1315 @noindent
1316 The reason to use @code{with-current-buffer}, rather than using
1317 @code{save-excursion} to save and restore the current buffer, is so as
1318 to preserve the change in point made by the second call to
1319 @code{goto-char}.
1320
1321 To make the filter force the process buffer to be visible whenever new
1322 text arrives, insert the following line just before the
1323 @code{with-current-buffer} construct:
1324
1325 @smallexample
1326 (display-buffer (process-buffer proc))
1327 @end smallexample
1328
1329 To force point to the end of the new output, no matter where it was
1330 previously, eliminate the variable @code{moving} and call
1331 @code{goto-char} unconditionally.
1332
1333 In earlier Emacs versions, every filter function that did regular
1334 expression searching or matching had to explicitly save and restore the
1335 match data. Now Emacs does this automatically for filter functions;
1336 they never need to do it explicitly. @xref{Match Data}.
1337
1338 The output to the function may come in chunks of any size. A program
1339 that produces the same output twice in a row may send it as one batch of
1340 200 characters one time, and five batches of 40 characters the next. If
1341 the filter looks for certain text strings in the subprocess output, make
1342 sure to handle the case where one of these strings is split across two
1343 or more batches of output; one way to do this is to insert the
1344 received text into a temporary buffer, which can then be searched.
1345
1346 @defun set-process-filter process filter
1347 This function gives @var{process} the filter function @var{filter}. If
1348 @var{filter} is @code{nil}, it gives the process no filter.
1349 @end defun
1350
1351 @defun process-filter process
1352 This function returns the filter function of @var{process}, or @code{nil}
1353 if it has none.
1354 @end defun
1355
1356 Here is an example of use of a filter function:
1357
1358 @smallexample
1359 @group
1360 (defun keep-output (process output)
1361 (setq kept (cons output kept)))
1362 @result{} keep-output
1363 @end group
1364 @group
1365 (setq kept nil)
1366 @result{} nil
1367 @end group
1368 @group
1369 (set-process-filter (get-process "shell") 'keep-output)
1370 @result{} keep-output
1371 @end group
1372 @group
1373 (process-send-string "shell" "ls ~/other\n")
1374 @result{} nil
1375 kept
1376 @result{} ("lewis@@slug[8] % "
1377 @end group
1378 @group
1379 "FINAL-W87-SHORT.MSS backup.otl kolstad.mss~
1380 address.txt backup.psf kolstad.psf
1381 backup.bib~ david.mss resume-Dec-86.mss~
1382 backup.err david.psf resume-Dec.psf
1383 backup.mss dland syllabus.mss
1384 "
1385 "#backups.mss# backup.mss~ kolstad.mss
1386 ")
1387 @end group
1388 @end smallexample
1389
1390 @ignore @c The code in this example doesn't show the right way to do things.
1391 Here is another, more realistic example, which demonstrates how to use
1392 the process mark to do insertion in the same fashion as is done when
1393 there is no filter function:
1394
1395 @smallexample
1396 @group
1397 ;; @r{Insert input in the buffer specified by @code{my-shell-buffer}}
1398 ;; @r{and make sure that buffer is shown in some window.}
1399 (defun my-process-filter (proc str)
1400 (let ((cur (selected-window))
1401 (pop-up-windows t))
1402 (pop-to-buffer my-shell-buffer)
1403 @end group
1404 @group
1405 (goto-char (point-max))
1406 (insert str)
1407 (set-marker (process-mark proc) (point-max))
1408 (select-window cur)))
1409 @end group
1410 @end smallexample
1411 @end ignore
1412
1413 @node Decoding Output
1414 @subsection Decoding Process Output
1415 @cindex decode process output
1416
1417 When Emacs writes process output directly into a multibyte buffer,
1418 it decodes the output according to the process output coding system.
1419 If the coding system is @code{raw-text} or @code{no-conversion}, Emacs
1420 converts the unibyte output to multibyte using
1421 @code{string-to-multibyte}, and inserts the resulting multibyte text.
1422
1423 You can use @code{set-process-coding-system} to specify which coding
1424 system to use (@pxref{Process Information}). Otherwise, the coding
1425 system comes from @code{coding-system-for-read}, if that is
1426 non-@code{nil}; or else from the defaulting mechanism (@pxref{Default
1427 Coding Systems}). If the text output by a process contains null
1428 bytes, Emacs by default uses @code{no-conversion} for it; see
1429 @ref{Lisp and Coding Systems, inhibit-null-byte-detection}, for how to
1430 control this behavior.
1431
1432 @strong{Warning:} Coding systems such as @code{undecided} which
1433 determine the coding system from the data do not work entirely
1434 reliably with asynchronous subprocess output. This is because Emacs
1435 has to process asynchronous subprocess output in batches, as it
1436 arrives. Emacs must try to detect the proper coding system from one
1437 batch at a time, and this does not always work. Therefore, if at all
1438 possible, specify a coding system that determines both the character
1439 code conversion and the end of line conversion---that is, one like
1440 @code{latin-1-unix}, rather than @code{undecided} or @code{latin-1}.
1441
1442 @c Let's keep the index entries that were there for
1443 @c set-process-filter-multibyte and process-filter-multibyte-p,
1444 @cindex filter multibyte flag, of process
1445 @cindex process filter multibyte flag
1446 When Emacs calls a process filter function, it provides the process
1447 output as a multibyte string or as a unibyte string according to the
1448 process's filter coding system. Emacs
1449 decodes the output according to the process output coding system,
1450 which usually produces a multibyte string, except for coding systems
1451 such as @code{binary} and @code{raw-text}
1452
1453 @node Accepting Output
1454 @subsection Accepting Output from Processes
1455 @cindex accept input from processes
1456
1457 Output from asynchronous subprocesses normally arrives only while
1458 Emacs is waiting for some sort of external event, such as elapsed time
1459 or terminal input. Occasionally it is useful in a Lisp program to
1460 explicitly permit output to arrive at a specific point, or even to wait
1461 until output arrives from a process.
1462
1463 @defun accept-process-output &optional process seconds millisec just-this-one
1464 This function allows Emacs to read pending output from processes. The
1465 output is inserted in the associated buffers or given to their filter
1466 functions. If @var{process} is non-@code{nil} then this function does
1467 not return until some output has been received from @var{process}.
1468
1469 @c Emacs 19 feature
1470 The arguments @var{seconds} and @var{millisec} let you specify timeout
1471 periods. The former specifies a period measured in seconds and the
1472 latter specifies one measured in milliseconds. The two time periods
1473 thus specified are added together, and @code{accept-process-output}
1474 returns after that much time, whether or not there has been any
1475 subprocess output.
1476
1477 The argument @var{millisec} is semi-obsolete nowadays because
1478 @var{seconds} can be a floating point number to specify waiting a
1479 fractional number of seconds. If @var{seconds} is 0, the function
1480 accepts whatever output is pending but does not wait.
1481
1482 @c Emacs 22.1 feature
1483 If @var{process} is a process, and the argument @var{just-this-one} is
1484 non-@code{nil}, only output from that process is handled, suspending output
1485 from other processes until some output has been received from that
1486 process or the timeout expires. If @var{just-this-one} is an integer,
1487 also inhibit running timers. This feature is generally not
1488 recommended, but may be necessary for specific applications, such as
1489 speech synthesis.
1490
1491 The function @code{accept-process-output} returns non-@code{nil} if it
1492 did get some output, or @code{nil} if the timeout expired before output
1493 arrived.
1494 @end defun
1495
1496 @node Sentinels
1497 @section Sentinels: Detecting Process Status Changes
1498 @cindex process sentinel
1499 @cindex sentinel (of process)
1500
1501 A @dfn{process sentinel} is a function that is called whenever the
1502 associated process changes status for any reason, including signals
1503 (whether sent by Emacs or caused by the process's own actions) that
1504 terminate, stop, or continue the process. The process sentinel is
1505 also called if the process exits. The sentinel receives two
1506 arguments: the process for which the event occurred, and a string
1507 describing the type of event.
1508
1509 The string describing the event looks like one of the following:
1510
1511 @itemize @bullet
1512 @item
1513 @code{"finished\n"}.
1514
1515 @item
1516 @code{"exited abnormally with code @var{exitcode}\n"}.
1517
1518 @item
1519 @code{"@var{name-of-signal}\n"}.
1520
1521 @item
1522 @code{"@var{name-of-signal} (core dumped)\n"}.
1523 @end itemize
1524
1525 A sentinel runs only while Emacs is waiting (e.g., for terminal
1526 input, or for time to elapse, or for process output). This avoids the
1527 timing errors that could result from running them at random places in
1528 the middle of other Lisp programs. A program can wait, so that
1529 sentinels will run, by calling @code{sit-for} or @code{sleep-for}
1530 (@pxref{Waiting}), or @code{accept-process-output} (@pxref{Accepting
1531 Output}). Emacs also allows sentinels to run when the command loop is
1532 reading input. @code{delete-process} calls the sentinel when it
1533 terminates a running process.
1534
1535 Emacs does not keep a queue of multiple reasons to call the sentinel
1536 of one process; it records just the current status and the fact that
1537 there has been a change. Therefore two changes in status, coming in
1538 quick succession, can call the sentinel just once. However, process
1539 termination will always run the sentinel exactly once. This is
1540 because the process status can't change again after termination.
1541
1542 Emacs explicitly checks for output from the process before running
1543 the process sentinel. Once the sentinel runs due to process
1544 termination, no further output can arrive from the process.
1545
1546 A sentinel that writes the output into the buffer of the process
1547 should check whether the buffer is still alive. If it tries to insert
1548 into a dead buffer, it will get an error. If the buffer is dead,
1549 @code{(buffer-name (process-buffer @var{process}))} returns @code{nil}.
1550
1551 Quitting is normally inhibited within a sentinel---otherwise, the
1552 effect of typing @kbd{C-g} at command level or to quit a user command
1553 would be unpredictable. If you want to permit quitting inside a
1554 sentinel, bind @code{inhibit-quit} to @code{nil}. In most cases, the
1555 right way to do this is with the macro @code{with-local-quit}.
1556 @xref{Quitting}.
1557
1558 If an error happens during execution of a sentinel, it is caught
1559 automatically, so that it doesn't stop the execution of whatever
1560 programs was running when the sentinel was started. However, if
1561 @code{debug-on-error} is non-@code{nil}, the error-catching is turned
1562 off. This makes it possible to use the Lisp debugger to debug the
1563 sentinel. @xref{Debugger}.
1564
1565 While a sentinel is running, the process sentinel is temporarily
1566 set to @code{nil} so that the sentinel won't run recursively.
1567 For this reason it is not possible for a sentinel to specify
1568 a new sentinel.
1569
1570 In earlier Emacs versions, every sentinel that did regular expression
1571 searching or matching had to explicitly save and restore the match data.
1572 Now Emacs does this automatically for sentinels; they never need to do
1573 it explicitly. @xref{Match Data}.
1574
1575 @defun set-process-sentinel process sentinel
1576 This function associates @var{sentinel} with @var{process}. If
1577 @var{sentinel} is @code{nil}, then the process will have no sentinel.
1578 The default behavior when there is no sentinel is to insert a message in
1579 the process's buffer when the process status changes.
1580
1581 Changes in process sentinel take effect immediately---if the sentinel
1582 is slated to be run but has not been called yet, and you specify a new
1583 sentinel, the eventual call to the sentinel will use the new one.
1584
1585 @smallexample
1586 @group
1587 (defun msg-me (process event)
1588 (princ
1589 (format "Process: %s had the event `%s'" process event)))
1590 (set-process-sentinel (get-process "shell") 'msg-me)
1591 @result{} msg-me
1592 @end group
1593 @group
1594 (kill-process (get-process "shell"))
1595 @print{} Process: #<process shell> had the event `killed'
1596 @result{} #<process shell>
1597 @end group
1598 @end smallexample
1599 @end defun
1600
1601 @defun process-sentinel process
1602 This function returns the sentinel of @var{process}, or @code{nil} if it
1603 has none.
1604 @end defun
1605
1606 @defun waiting-for-user-input-p
1607 While a sentinel or filter function is running, this function returns
1608 non-@code{nil} if Emacs was waiting for keyboard input from the user at
1609 the time the sentinel or filter function was called, @code{nil} if it
1610 was not.
1611 @end defun
1612
1613 @node Query Before Exit
1614 @section Querying Before Exit
1615
1616 When Emacs exits, it terminates all its subprocesses by sending them
1617 the @code{SIGHUP} signal. Because subprocesses may be doing
1618 valuable work, Emacs normally asks the user to confirm that it is ok
1619 to terminate them. Each process has a query flag which, if
1620 non-@code{nil}, says that Emacs should ask for confirmation before
1621 exiting and thus killing that process. The default for the query flag
1622 is @code{t}, meaning @emph{do} query.
1623
1624 @defun process-query-on-exit-flag process
1625 This returns the query flag of @var{process}.
1626 @end defun
1627
1628 @defun set-process-query-on-exit-flag process flag
1629 This function sets the query flag of @var{process} to @var{flag}. It
1630 returns @var{flag}.
1631
1632 @smallexample
1633 @group
1634 ;; @r{Don't query about the shell process}
1635 (set-process-query-on-exit-flag (get-process "shell") nil)
1636 @result{} t
1637 @end group
1638 @end smallexample
1639 @end defun
1640
1641 @defun process-kill-without-query process &optional do-query
1642 This function clears the query flag of @var{process}, so that
1643 Emacs will not query the user on account of that process.
1644
1645 Actually, the function does more than that: it returns the old value of
1646 the process's query flag, and sets the query flag to @var{do-query}.
1647 Please don't use this function to do those things any more---please
1648 use the newer, cleaner functions @code{process-query-on-exit-flag} and
1649 @code{set-process-query-on-exit-flag} in all but the simplest cases.
1650 The only way you should use @code{process-kill-without-query} nowadays
1651 is like this:
1652
1653 @smallexample
1654 @group
1655 ;; @r{Don't query about the shell process}
1656 (process-kill-without-query (get-process "shell"))
1657 @end group
1658 @end smallexample
1659 @end defun
1660
1661 @node System Processes
1662 @section Accessing Other Processes
1663 @cindex system processes
1664
1665 In addition to accessing and manipulating processes that are
1666 subprocesses of the current Emacs session, Emacs Lisp programs can
1667 also access other processes running on the same machine. We call
1668 these @dfn{system processes}, to distinguish between them and Emacs
1669 subprocesses.
1670
1671 Emacs provides several primitives for accessing system processes.
1672 Not all platforms support these primitives; on those which don't,
1673 these primitives return @code{nil}.
1674
1675 @defun list-system-processes
1676 This function returns a list of all the processes running on the
1677 system. Each process is identified by its @acronym{PID}, a numerical
1678 process ID that is assigned by the OS and distinguishes the process
1679 from all the other processes running on the same machine at the same
1680 time.
1681 @end defun
1682
1683 @defun process-attributes pid
1684 This function returns an alist of attributes for the process specified
1685 by its process ID @var{pid}. Each association in the alist is of the
1686 form @code{(@var{key} . @var{value})}, where @var{key} designates the
1687 attribute and @var{value} is the value of that attribute. The various
1688 attribute @var{key}'s that this function can return are listed below.
1689 Not all platforms support all of these attributes; if an attribute is
1690 not supported, its association will not appear in the returned alist.
1691 Values that are numbers can be either integer or floating-point,
1692 depending on the magnitude of the value.
1693
1694 @table @code
1695 @item euid
1696 The effective user ID of the user who invoked the process. The
1697 corresponding @var{value} is a number. If the process was invoked by
1698 the same user who runs the current Emacs session, the value is
1699 identical to what @code{user-uid} returns (@pxref{User
1700 Identification}).
1701
1702 @item user
1703 User name corresponding to the process's effective user ID, a string.
1704
1705 @item egid
1706 The group ID of the effective user ID, a number.
1707
1708 @item group
1709 Group name corresponding to the effective user's group ID, a string.
1710
1711 @item comm
1712 The name of the command that runs in the process. This is a string
1713 that usually specifies the name of the executable file of the process,
1714 without the leading directories. However, some special system
1715 processes can report strings that do not correspond to an executable
1716 file of a program.
1717
1718 @item state
1719 The state code of the process. This is a short string that encodes
1720 the scheduling state of the process. Here's a list of the most
1721 frequently seen codes:
1722
1723 @table @code
1724 @item "D"
1725 uninterruptible sleep (usually I/O)
1726 @item "R"
1727 running
1728 @item "S"
1729 interruptible sleep (waiting for some event)
1730 @item "T"
1731 stopped, e.g., by a job control signal
1732 @item "Z"
1733 ``zombie'': a process that terminated, but was not reaped by its parent
1734 @end table
1735
1736 @noindent
1737 For the full list of the possible states, see the manual page of the
1738 @command{ps} command.
1739
1740 @item ppid
1741 The process ID of the parent process, a number.
1742
1743 @item pgrp
1744 The process group ID of the process, a number.
1745
1746 @item sess
1747 The session ID of the process. This is a number that is the process
1748 ID of the process's @dfn{session leader}.
1749
1750 @item ttname
1751 A string that is the name of the process's controlling terminal. On
1752 Unix and GNU systems, this is normally the file name of the
1753 corresponding terminal device, such as @file{/dev/pts65}.
1754
1755 @item tpgid
1756 The numerical process group ID of the foreground process group that
1757 uses the process's terminal.
1758
1759 @item minflt
1760 The number of minor page faults caused by the process since its
1761 beginning. (Minor page faults are those that don't involve reading
1762 from disk.)
1763
1764 @item majflt
1765 The number of major page faults caused by the process since its
1766 beginning. (Major page faults require a disk to be read, and are thus
1767 more expensive than minor page faults.)
1768
1769 @item cminflt
1770 @itemx cmajflt
1771 Like @code{minflt} and @code{majflt}, but include the number of page
1772 faults for all the child processes of the given process.
1773
1774 @item utime
1775 Time spent by the process in the user context, for running the
1776 application's code. The corresponding @var{value} is in the
1777 @w{@code{(@var{high} @var{low} @var{microsec})}} format, the same
1778 format used by functions @code{current-time} (@pxref{Time of Day,
1779 current-time}) and @code{file-attributes} (@pxref{File Attributes}).
1780
1781 @item stime
1782 Time spent by the process in the system (kernel) context, for
1783 processing system calls. The corresponding @var{value} is in the same
1784 format as for @code{utime}.
1785
1786 @item time
1787 The sum of @code{utime} and @code{stime}. The corresponding
1788 @var{value} is in the same format as for @code{utime}.
1789
1790 @item cutime
1791 @itemx cstime
1792 @itemx ctime
1793 Like @code{utime}, @code{stime}, and @code{time}, but include the
1794 times of all the child processes of the given process.
1795
1796 @item pri
1797 The numerical priority of the process.
1798
1799 @item nice
1800 The @dfn{nice value} of the process, a number. (Processes with smaller
1801 nice values get scheduled more favorably.)
1802
1803 @item thcount
1804 The number of threads in the process.
1805
1806 @item start
1807 The time when the process was started, in the same
1808 @w{@code{(@var{high} @var{low} @var{microsec})}} format used by
1809 @code{current-time} and @code{file-attributes}.
1810
1811 @item etime
1812 The time elapsed since the process started, in the @w{@code{(@var{high}
1813 @var{low} @var{microsec})}} format.
1814
1815 @item vsize
1816 The virtual memory size of the process, measured in kilobytes.
1817
1818 @item rss
1819 The size of the process's @dfn{resident set}, the number of kilobytes
1820 occupied by the process in the machine's physical memory.
1821
1822 @item pcpu
1823 The percentage of the CPU time used by the process since it started.
1824 The corresponding @var{value} is a floating-point number between 0 and
1825 100.
1826
1827 @item pmem
1828 The percentage of the total physical memory installed on the machine
1829 used by the process's resident set. The value is a floating-point
1830 number between 0 and 100.
1831
1832 @item args
1833 The command-line with which the process was invoked. This is a string
1834 in which individual command-line arguments are separated by blanks;
1835 whitespace characters that are embedded in the arguments are quoted as
1836 appropriate for the system's shell: escaped by backslash characters on
1837 GNU and Unix, and enclosed in double quote characters on Windows.
1838 Thus, this command-line string can be directly used in primitives such
1839 as @code{shell-command}.
1840 @end table
1841
1842 @end defun
1843
1844
1845 @node Transaction Queues
1846 @section Transaction Queues
1847 @cindex transaction queue
1848
1849 You can use a @dfn{transaction queue} to communicate with a subprocess
1850 using transactions. First use @code{tq-create} to create a transaction
1851 queue communicating with a specified process. Then you can call
1852 @code{tq-enqueue} to send a transaction.
1853
1854 @defun tq-create process
1855 This function creates and returns a transaction queue communicating with
1856 @var{process}. The argument @var{process} should be a subprocess
1857 capable of sending and receiving streams of bytes. It may be a child
1858 process, or it may be a TCP connection to a server, possibly on another
1859 machine.
1860 @end defun
1861
1862 @defun tq-enqueue queue question regexp closure fn &optional delay-question
1863 This function sends a transaction to queue @var{queue}. Specifying the
1864 queue has the effect of specifying the subprocess to talk to.
1865
1866 The argument @var{question} is the outgoing message that starts the
1867 transaction. The argument @var{fn} is the function to call when the
1868 corresponding answer comes back; it is called with two arguments:
1869 @var{closure}, and the answer received.
1870
1871 The argument @var{regexp} is a regular expression that should match
1872 text at the end of the entire answer, but nothing before; that's how
1873 @code{tq-enqueue} determines where the answer ends.
1874
1875 If the argument @var{delay-question} is non-@code{nil}, delay sending
1876 this question until the process has finished replying to any previous
1877 questions. This produces more reliable results with some processes.
1878
1879 The return value of @code{tq-enqueue} itself is not meaningful.
1880 @end defun
1881
1882 @defun tq-close queue
1883 Shut down transaction queue @var{queue}, waiting for all pending transactions
1884 to complete, and then terminate the connection or child process.
1885 @end defun
1886
1887 Transaction queues are implemented by means of a filter function.
1888 @xref{Filter Functions}.
1889
1890 @node Network
1891 @section Network Connections
1892 @cindex network connection
1893 @cindex TCP
1894 @cindex UDP
1895
1896 Emacs Lisp programs can open stream (TCP) and datagram (UDP) network
1897 connections to other processes on the same machine or other machines.
1898 A network connection is handled by Lisp much like a subprocess, and is
1899 represented by a process object. However, the process you are
1900 communicating with is not a child of the Emacs process, so it has no
1901 process @acronym{ID}, and you can't kill it or send it signals. All you
1902 can do is send and receive data. @code{delete-process} closes the
1903 connection, but does not kill the program at the other end; that
1904 program must decide what to do about closure of the connection.
1905
1906 Lisp programs can listen for connections by creating network
1907 servers. A network server is also represented by a kind of process
1908 object, but unlike a network connection, the network server never
1909 transfers data itself. When it receives a connection request, it
1910 creates a new network connection to represent the connection just
1911 made. (The network connection inherits certain information, including
1912 the process plist, from the server.) The network server then goes
1913 back to listening for more connection requests.
1914
1915 Network connections and servers are created by calling
1916 @code{make-network-process} with an argument list consisting of
1917 keyword/argument pairs, for example @code{:server t} to create a
1918 server process, or @code{:type 'datagram} to create a datagram
1919 connection. @xref{Low-Level Network}, for details. You can also use
1920 the @code{open-network-stream} function described below.
1921
1922 To distinguish the different types of processes, the
1923 @code{process-type} function returns the symbol @code{network} for a
1924 network connection or server, @code{serial} for a serial port
1925 connection, or @code{real} for a real subprocess.
1926
1927 The @code{process-status} function returns @code{open},
1928 @code{closed}, @code{connect}, and @code{failed} for network
1929 connections. For a network server, the status is always
1930 @code{listen}. None of those values is possible for a real
1931 subprocess. @xref{Process Information}.
1932
1933 You can stop and resume operation of a network process by calling
1934 @code{stop-process} and @code{continue-process}. For a server
1935 process, being stopped means not accepting new connections. (Up to 5
1936 connection requests will be queued for when you resume the server; you
1937 can increase this limit, unless it is imposed by the operating
1938 system.) For a network stream connection, being stopped means not
1939 processing input (any arriving input waits until you resume the
1940 connection). For a datagram connection, some number of packets may be
1941 queued but input may be lost. You can use the function
1942 @code{process-command} to determine whether a network connection or
1943 server is stopped; a non-@code{nil} value means yes.
1944
1945 @cindex network connection, encrypted
1946 @cindex encrypted network connections
1947 @cindex TLS network connections
1948 @cindex STARTTLS network connections
1949 @defun open-network-stream name buffer-or-name host service &rest parameters
1950 This function opens a TCP connection, with optional encryption, and
1951 returns a process object that represents the connection.
1952
1953 The @var{name} argument specifies the name for the process object. It
1954 is modified as necessary to make it unique.
1955
1956 The @var{buffer-or-name} argument is the buffer to associate with the
1957 connection. Output from the connection is inserted in the buffer,
1958 unless you specify a filter function to handle the output. If
1959 @var{buffer-or-name} is @code{nil}, it means that the connection is not
1960 associated with any buffer.
1961
1962 The arguments @var{host} and @var{service} specify where to connect to;
1963 @var{host} is the host name (a string), and @var{service} is the name of
1964 a defined network service (a string) or a port number (an integer).
1965
1966 @c FIXME? Is this too lengthy for the printed manual?
1967 The remaining arguments @var{parameters} are keyword/argument pairs
1968 that are mainly relevant to encrypted connections:
1969
1970 @table @code
1971
1972 @item :nowait @var{boolean}
1973 If non-@code{nil}, try to make an asynchronous connection.
1974
1975 @item :type @var{type}
1976 The type of connection. Options are:
1977
1978 @table @code
1979 @item plain
1980 An ordinary, unencrypted connection.
1981 @item tls
1982 @itemx ssl
1983 A TLS (``Transport Layer Security'') connection.
1984 @item nil
1985 @itemx network
1986 Start with a plain connection, and if parameters @samp{:success}
1987 and @samp{:capability-command} are supplied, try to upgrade to an encrypted
1988 connection via STARTTLS. If that fails, retain the unencrypted connection.
1989 @item starttls
1990 As for @code{nil}, but if STARTTLS fails drop the connection.
1991 @item shell
1992 A shell connection.
1993 @end table
1994
1995 @item :always-query-capabilities @var{boolean}
1996 If non-@code{nil}, always ask for the server's capabilities, even when
1997 doing a @samp{plain} connection.
1998
1999 @item :capability-command @var{capability-command}
2000 Command string to query the host capabilities.
2001
2002 @item :end-of-command @var{regexp}
2003 @itemx :end-of-capability @var{regexp}
2004 Regular expression matching the end of a command, or the end of the
2005 command @var{capability-command}. The latter defaults to the former.
2006
2007 @item :starttls-function @var{function}
2008 Function of one argument (the response to @var{capability-command}),
2009 which returns either @code{nil}, or the command to activate STARTTLS
2010 if supported.
2011
2012 @item :success @var{regexp}
2013 Regular expression matching a successful STARTTLS negotiation.
2014
2015 @item :use-starttls-if-possible @var{boolean}
2016 If non-@code{nil}, do opportunistic STARTTLS upgrades even if Emacs
2017 doesn't have built-in TLS support.
2018
2019 @item :client-certificate @var{list-or-t}
2020 Either a list of the form @code{(@var{key-file} @var{cert-file})},
2021 naming the certificate key file and certificate file itself, or
2022 @code{t}, meaning to query @code{auth-source} for this information
2023 (@pxref{Top,,auth-source, auth, Emacs auth-source Library}).
2024 Only used for TLS or STARTTLS.
2025
2026 @item :return-list @var{cons-or-nil}
2027 The return value of this function. If omitted or @code{nil}, return a
2028 process object. Otherwise, a cons of the form @code{(@var{process-object}
2029 . @var{plist})}, where @var{plist} has keywords:
2030
2031 @table @code
2032 @item :greeting @var{string-or-nil}
2033 If non-@code{nil}, the greeting string returned by the host.
2034 @item :capabilities @var{string-or-nil}
2035 If non-@code{nil}, the host's capability string.
2036 @item :type @var{symbol}
2037 The connection type: @samp{plain} or @samp{tls}.
2038 @end table
2039
2040 @end table
2041
2042 @end defun
2043
2044 @node Network Servers
2045 @section Network Servers
2046 @cindex network servers
2047
2048 You create a server by calling @code{make-network-process} with
2049 @code{:server t}. The server will listen for connection requests from
2050 clients. When it accepts a client connection request, that creates a
2051 new network connection, itself a process object, with the following
2052 parameters:
2053
2054 @itemize @bullet
2055 @item
2056 The connection's process name is constructed by concatenating the
2057 server process's @var{name} with a client identification string. The
2058 client identification string for an IPv4 connection looks like
2059 @samp{<@var{a}.@var{b}.@var{c}.@var{d}:@var{p}>}. Otherwise, it is a
2060 unique number in brackets, as in @samp{<@var{nnn}>}. The number
2061 is unique for each connection in the Emacs session.
2062
2063 @item
2064 If the server's filter is non-@code{nil}, the connection process does
2065 not get a separate process buffer; otherwise, Emacs creates a new
2066 buffer for the purpose. The buffer name is the server's buffer name
2067 or process name, concatenated with the client identification string.
2068
2069 The server's process buffer value is never used directly, but the log
2070 function can retrieve it and use it to log connections by inserting
2071 text there.
2072
2073 @item
2074 The communication type and the process filter and sentinel are
2075 inherited from those of the server. The server never directly
2076 uses its filter and sentinel; their sole purpose is to initialize
2077 connections made to the server.
2078
2079 @item
2080 The connection's process contact info is set according to the client's
2081 addressing information (typically an IP address and a port number).
2082 This information is associated with the @code{process-contact}
2083 keywords @code{:host}, @code{:service}, @code{:remote}.
2084
2085 @item
2086 The connection's local address is set up according to the port
2087 number used for the connection.
2088
2089 @item
2090 The client process's plist is initialized from the server's plist.
2091 @end itemize
2092
2093 @node Datagrams
2094 @section Datagrams
2095 @cindex datagrams
2096
2097 A datagram connection communicates with individual packets rather
2098 than streams of data. Each call to @code{process-send} sends one
2099 datagram packet (@pxref{Input to Processes}), and each datagram
2100 received results in one call to the filter function.
2101
2102 The datagram connection doesn't have to talk with the same remote
2103 peer all the time. It has a @dfn{remote peer address} which specifies
2104 where to send datagrams to. Each time an incoming datagram is passed
2105 to the filter function, the peer address is set to the address that
2106 datagram came from; that way, if the filter function sends a datagram,
2107 it will go back to that place. You can specify the remote peer
2108 address when you create the datagram connection using the
2109 @code{:remote} keyword. You can change it later on by calling
2110 @code{set-process-datagram-address}.
2111
2112 @defun process-datagram-address process
2113 If @var{process} is a datagram connection or server, this function
2114 returns its remote peer address.
2115 @end defun
2116
2117 @defun set-process-datagram-address process address
2118 If @var{process} is a datagram connection or server, this function
2119 sets its remote peer address to @var{address}.
2120 @end defun
2121
2122 @node Low-Level Network
2123 @section Low-Level Network Access
2124
2125 You can also create network connections by operating at a lower
2126 level than that of @code{open-network-stream}, using
2127 @code{make-network-process}.
2128
2129 @menu
2130 * Proc: Network Processes. Using @code{make-network-process}.
2131 * Options: Network Options. Further control over network connections.
2132 * Features: Network Feature Testing.
2133 Determining which network features work on
2134 the machine you are using.
2135 @end menu
2136
2137 @node Network Processes
2138 @subsection @code{make-network-process}
2139
2140 The basic function for creating network connections and network
2141 servers is @code{make-network-process}. It can do either of those
2142 jobs, depending on the arguments you give it.
2143
2144 @defun make-network-process &rest args
2145 This function creates a network connection or server and returns the
2146 process object that represents it. The arguments @var{args} are a
2147 list of keyword/argument pairs. Omitting a keyword is always
2148 equivalent to specifying it with value @code{nil}, except for
2149 @code{:coding}, @code{:filter-multibyte}, and @code{:reuseaddr}. Here
2150 are the meaningful keywords:
2151
2152 @table @asis
2153 @item :name @var{name}
2154 Use the string @var{name} as the process name. It is modified if
2155 necessary to make it unique.
2156
2157 @item :type @var{type}
2158 Specify the communication type. A value of @code{nil} specifies a
2159 stream connection (the default); @code{datagram} specifies a datagram
2160 connection; @code{seqpacket} specifies a ``sequenced packet stream''
2161 connection. Both connections and servers can be of these types.
2162
2163 @item :server @var{server-flag}
2164 If @var{server-flag} is non-@code{nil}, create a server. Otherwise,
2165 create a connection. For a stream type server, @var{server-flag} may
2166 be an integer which then specifies the length of the queue of pending
2167 connections to the server. The default queue length is 5.
2168
2169 @item :host @var{host}
2170 Specify the host to connect to. @var{host} should be a host name or
2171 Internet address, as a string, or the symbol @code{local} to specify
2172 the local host. If you specify @var{host} for a server, it must
2173 specify a valid address for the local host, and only clients
2174 connecting to that address will be accepted.
2175
2176 @item :service @var{service}
2177 @var{service} specifies a port number to connect to, or, for a server,
2178 the port number to listen on. It should be a service name that
2179 translates to a port number, or an integer specifying the port number
2180 directly. For a server, it can also be @code{t}, which means to let
2181 the system select an unused port number.
2182
2183 @item :family @var{family}
2184 @var{family} specifies the address (and protocol) family for
2185 communication. @code{nil} means determine the proper address family
2186 automatically for the given @var{host} and @var{service}.
2187 @code{local} specifies a Unix socket, in which case @var{host} is
2188 ignored. @code{ipv4} and @code{ipv6} specify to use IPv4 and IPv6
2189 respectively.
2190
2191 @item :local @var{local-address}
2192 For a server process, @var{local-address} is the address to listen on.
2193 It overrides @var{family}, @var{host} and @var{service}, and you
2194 may as well not specify them.
2195
2196 @item :remote @var{remote-address}
2197 For a connection, @var{remote-address} is the address to connect to.
2198 It overrides @var{family}, @var{host} and @var{service}, and you
2199 may as well not specify them.
2200
2201 For a datagram server, @var{remote-address} specifies the initial
2202 setting of the remote datagram address.
2203
2204 The format of @var{local-address} or @var{remote-address} depends on
2205 the address family:
2206
2207 @itemize -
2208 @item
2209 An IPv4 address is represented as a five-element vector of four 8-bit
2210 integers and one 16-bit integer
2211 @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]} corresponding to
2212 numeric IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port number
2213 @var{p}.
2214
2215 @item
2216 An IPv6 address is represented as a nine-element vector of 16-bit
2217 integers @code{[@var{a} @var{b} @var{c} @var{d} @var{e} @var{f}
2218 @var{g} @var{h} @var{p}]} corresponding to numeric IPv6 address
2219 @var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h} and
2220 port number @var{p}.
2221
2222 @item
2223 A local address is represented as a string which specifies the address
2224 in the local address space.
2225
2226 @item
2227 An ``unsupported family'' address is represented by a cons
2228 @code{(@var{f} . @var{av})}, where @var{f} is the family number and
2229 @var{av} is a vector specifying the socket address using one element
2230 per address data byte. Do not rely on this format in portable code,
2231 as it may depend on implementation defined constants, data sizes, and
2232 data structure alignment.
2233 @end itemize
2234
2235 @item :nowait @var{bool}
2236 If @var{bool} is non-@code{nil} for a stream connection, return
2237 without waiting for the connection to complete. When the connection
2238 succeeds or fails, Emacs will call the sentinel function, with a
2239 second argument matching @code{"open"} (if successful) or
2240 @code{"failed"}. The default is to block, so that
2241 @code{make-network-process} does not return until the connection
2242 has succeeded or failed.
2243
2244 @item :stop @var{stopped}
2245 Start the network connection or server in the `stopped' state if
2246 @var{stopped} is non-@code{nil}.
2247
2248 @item :buffer @var{buffer}
2249 Use @var{buffer} as the process buffer.
2250
2251 @item :coding @var{coding}
2252 Use @var{coding} as the coding system for this process. To specify
2253 different coding systems for decoding data from the connection and for
2254 encoding data sent to it, specify @code{(@var{decoding} .
2255 @var{encoding})} for @var{coding}.
2256
2257 If you don't specify this keyword at all, the default
2258 is to determine the coding systems from the data.
2259
2260 @item :noquery @var{query-flag}
2261 Initialize the process query flag to @var{query-flag}.
2262 @xref{Query Before Exit}.
2263
2264 @item :filter @var{filter}
2265 Initialize the process filter to @var{filter}.
2266
2267 @item :sentinel @var{sentinel}
2268 Initialize the process sentinel to @var{sentinel}.
2269
2270 @item :log @var{log}
2271 Initialize the log function of a server process to @var{log}. The log
2272 function is called each time the server accepts a network connection
2273 from a client. The arguments passed to the log function are
2274 @var{server}, @var{connection}, and @var{message}, where @var{server}
2275 is the server process, @var{connection} is the new process for the
2276 connection, and @var{message} is a string describing what has
2277 happened.
2278
2279 @item :plist @var{plist}
2280 Initialize the process plist to @var{plist}.
2281 @end table
2282
2283 The original argument list, modified with the actual connection
2284 information, is available via the @code{process-contact} function.
2285 @end defun
2286
2287 @node Network Options
2288 @subsection Network Options
2289
2290 The following network options can be specified when you create a
2291 network process. Except for @code{:reuseaddr}, you can also set or
2292 modify these options later, using @code{set-network-process-option}.
2293
2294 For a server process, the options specified with
2295 @code{make-network-process} are not inherited by the client
2296 connections, so you will need to set the necessary options for each
2297 child connection as it is created.
2298
2299 @table @asis
2300 @item :bindtodevice @var{device-name}
2301 If @var{device-name} is a non-empty string identifying a network
2302 interface name (see @code{network-interface-list}), only handle
2303 packets received on that interface. If @var{device-name} is @code{nil}
2304 (the default), handle packets received on any interface.
2305
2306 Using this option may require special privileges on some systems.
2307
2308 @item :broadcast @var{broadcast-flag}
2309 If @var{broadcast-flag} is non-@code{nil} for a datagram process, the
2310 process will receive datagram packet sent to a broadcast address, and
2311 be able to send packets to a broadcast address. Ignored for a stream
2312 connection.
2313
2314 @item :dontroute @var{dontroute-flag}
2315 If @var{dontroute-flag} is non-@code{nil}, the process can only send
2316 to hosts on the same network as the local host.
2317
2318 @item :keepalive @var{keepalive-flag}
2319 If @var{keepalive-flag} is non-@code{nil} for a stream connection,
2320 enable exchange of low-level keep-alive messages.
2321
2322 @item :linger @var{linger-arg}
2323 If @var{linger-arg} is non-@code{nil}, wait for successful
2324 transmission of all queued packets on the connection before it is
2325 deleted (see @code{delete-process}). If @var{linger-arg} is an
2326 integer, it specifies the maximum time in seconds to wait for queued
2327 packets to be sent before closing the connection. Default is
2328 @code{nil} which means to discard unsent queued packets when the
2329 process is deleted.
2330
2331 @item :oobinline @var{oobinline-flag}
2332 If @var{oobinline-flag} is non-@code{nil} for a stream connection,
2333 receive out-of-band data in the normal data stream. Otherwise, ignore
2334 out-of-band data.
2335
2336 @item :priority @var{priority}
2337 Set the priority for packets sent on this connection to the integer
2338 @var{priority}. The interpretation of this number is protocol
2339 specific, such as setting the TOS (type of service) field on IP
2340 packets sent on this connection. It may also have system dependent
2341 effects, such as selecting a specific output queue on the network
2342 interface.
2343
2344 @item :reuseaddr @var{reuseaddr-flag}
2345 If @var{reuseaddr-flag} is non-@code{nil} (the default) for a stream
2346 server process, allow this server to reuse a specific port number (see
2347 @code{:service}) unless another process on this host is already
2348 listening on that port. If @var{reuseaddr-flag} is @code{nil}, there
2349 may be a period of time after the last use of that port (by any
2350 process on the host), where it is not possible to make a new server on
2351 that port.
2352 @end table
2353
2354 @defun set-network-process-option process option value &optional no-error
2355 This function sets or modifies a network option for network process
2356 @var{process}. See @code{make-network-process} for details of options
2357 @var{option} and their corresponding values @var{value}. If
2358 @var{no-error} is non-@code{nil}, this function returns @code{nil}
2359 instead of signaling an error if @var{option} is not a supported
2360 option. If the function successfully completes, it returns @code{t}.
2361
2362 The current setting of an option is available via the
2363 @code{process-contact} function.
2364 @end defun
2365
2366 @node Network Feature Testing
2367 @subsection Testing Availability of Network Features
2368
2369 To test for the availability of a given network feature, use
2370 @code{featurep} like this:
2371
2372 @example
2373 (featurep 'make-network-process '(@var{keyword} @var{value}))
2374 @end example
2375
2376 @noindent
2377 The result of the first form is @code{t} if it works to specify
2378 @var{keyword} with value @var{value} in @code{make-network-process}.
2379 The result of the second form is @code{t} if @var{keyword} is
2380 supported by @code{make-network-process}. Here are some of the
2381 @var{keyword}---@var{value} pairs you can test in
2382 this way.
2383
2384 @table @code
2385 @item (:nowait t)
2386 Non-@code{nil} if non-blocking connect is supported.
2387 @item (:type datagram)
2388 Non-@code{nil} if datagrams are supported.
2389 @item (:family local)
2390 Non-@code{nil} if local (a.k.a.@: ``UNIX domain'') sockets are supported.
2391 @item (:family ipv6)
2392 Non-@code{nil} if IPv6 is supported.
2393 @item (:service t)
2394 Non-@code{nil} if the system can select the port for a server.
2395 @end table
2396
2397 To test for the availability of a given network option, use
2398 @code{featurep} like this:
2399
2400 @example
2401 (featurep 'make-network-process '@var{keyword})
2402 @end example
2403
2404 @noindent
2405 Here are some of the options you can test in this way.
2406
2407 @table @code
2408 @item :bindtodevice
2409 @itemx :broadcast
2410 @itemx :dontroute
2411 @itemx :keepalive
2412 @itemx :linger
2413 @itemx :oobinline
2414 @itemx :priority
2415 @itemx :reuseaddr
2416 That particular network option is supported by
2417 @code{make-network-process} and @code{set-network-process-option}.
2418 @end table
2419
2420 @node Misc Network
2421 @section Misc Network Facilities
2422
2423 These additional functions are useful for creating and operating
2424 on network connections. Note that they are supported only on some
2425 systems.
2426
2427 @defun network-interface-list
2428 This function returns a list describing the network interfaces
2429 of the machine you are using. The value is an alist whose
2430 elements have the form @code{(@var{name} . @var{address})}.
2431 @var{address} has the same form as the @var{local-address}
2432 and @var{remote-address} arguments to @code{make-network-process}.
2433 @end defun
2434
2435 @defun network-interface-info ifname
2436 This function returns information about the network interface named
2437 @var{ifname}. The value is a list of the form
2438 @code{(@var{addr} @var{bcast} @var{netmask} @var{hwaddr} @var{flags})}.
2439
2440 @table @var
2441 @item addr
2442 The Internet protocol address.
2443 @item bcast
2444 The broadcast address.
2445 @item netmask
2446 The network mask.
2447 @item hwaddr
2448 The layer 2 address (Ethernet MAC address, for instance).
2449 @item flags
2450 The current flags of the interface.
2451 @end table
2452 @end defun
2453
2454 @defun format-network-address address &optional omit-port
2455 This function converts the Lisp representation of a network address to
2456 a string.
2457
2458 A five-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]}
2459 represents an IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port
2460 number @var{p}. @code{format-network-address} converts that to the
2461 string @code{"@var{a}.@var{b}.@var{c}.@var{d}:@var{p}"}.
2462
2463 A nine-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{e}
2464 @var{f} @var{g} @var{h} @var{p}]} represents an IPv6 address along
2465 with a port number. @code{format-network-address} converts that to
2466 the string
2467 @code{"[@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h}]:@var{p}"}.
2468
2469 If the vector does not include the port number, @var{p}, or if
2470 @var{omit-port} is non-@code{nil}, the result does not include the
2471 @code{:@var{p}} suffix.
2472 @end defun
2473
2474 @node Serial Ports
2475 @section Communicating with Serial Ports
2476 @cindex @file{/dev/tty}
2477 @cindex @file{COM1}
2478 @cindex serial connections
2479
2480 Emacs can communicate with serial ports. For interactive use,
2481 @kbd{M-x serial-term} opens a terminal window. In a Lisp program,
2482 @code{make-serial-process} creates a process object.
2483
2484 The serial port can be configured at run-time, without having to
2485 close and re-open it. The function @code{serial-process-configure}
2486 lets you change the speed, bytesize, and other parameters. In a
2487 terminal window created by @code{serial-term}, you can click on the
2488 mode line for configuration.
2489
2490 A serial connection is represented by a process object which can be
2491 used similar to a subprocess or network process. You can send and
2492 receive data and configure the serial port. A serial process object
2493 has no process ID, you can't send signals to it, and the status codes
2494 are different from other types of processes.
2495 @code{delete-process} on the process object or @code{kill-buffer} on
2496 the process buffer close the connection, but this does not affect the
2497 device connected to the serial port.
2498
2499 The function @code{process-type} returns the symbol @code{serial}
2500 for a process object representing a serial port connection.
2501
2502 Serial ports are available on GNU/Linux, Unix, and Windows systems.
2503
2504 @deffn Command serial-term port speed
2505 Start a terminal-emulator for a serial port in a new buffer.
2506 @var{port} is the name of the serial port to which to connect. For
2507 example, this could be @file{/dev/ttyS0} on Unix. On Windows, this
2508 could be @file{COM1}, or @file{\\.\COM10} (double the backslashes in
2509 Lisp strings).
2510
2511 @var{speed} is the speed of the serial port in bits per second. 9600
2512 is a common value. The buffer is in Term mode; see @ref{Term Mode,,,
2513 emacs, The GNU Emacs Manual}, for the commands to use in that buffer.
2514 You can change the speed and the configuration in the mode line menu.
2515 @end deffn
2516
2517 @defun make-serial-process &rest args
2518 This function creates a process and a buffer. Arguments are specified
2519 as keyword/argument pairs. Here's the list of the meaningful keywords:
2520
2521 @table @code
2522 @item :port @var{port}@r{ (mandatory)}
2523 This is the name of the serial port. On Unix and GNU systems, this is
2524 a file name such as @file{/dev/ttyS0}. On Windows, this could be
2525 @file{COM1}, or @file{\\.\COM10} for ports higher than @file{COM9}
2526 (double the backslashes in Lisp strings).
2527
2528 @item :speed @var{speed}@r{ (mandatory)}
2529 The speed of the serial port in bits per second. This function calls
2530 @code{serial-process-configure} to handle the speed.
2531
2532 @item :name @var{name}
2533 The name of the process. If @var{name} is not given, @var{port} will
2534 serve as the process name as well.
2535
2536 @item :buffer @var{buffer}
2537 The buffer to associate with the process. The value could be either a
2538 buffer or a string that names a buffer. Process output goes at the
2539 end of that buffer, unless you specify an output stream or filter
2540 function to handle the output. If @var{buffer} is not given, the
2541 process buffer's name is taken from the value of the @code{:name}
2542 keyword.
2543
2544 @item :coding @var{coding}
2545 If @var{coding} is a symbol, it specifies the coding system used for
2546 both reading and writing for this process. If @var{coding} is a cons
2547 @code{(decoding . encoding)}, @var{decoding} is used for reading, and
2548 @var{encoding} is used for writing. If not specified, the default is
2549 to determine the coding systems from data itself.
2550
2551 @item :noquery @var{query-flag}
2552 Initialize the process query flag to @var{query-flag}. @xref{Query
2553 Before Exit}. The flags defaults to @code{nil} if unspecified.
2554
2555 @item :stop @var{bool}
2556 Start process in the @code{stopped} state if @var{bool} is
2557 non-@code{nil}. In the stopped state, a serial process does not
2558 accept incoming data, but you can send outgoing data. The stopped
2559 state is cleared by @code{continue-process} and set by
2560 @code{stop-process}.
2561
2562 @item :filter @var{filter}
2563 Install @var{filter} as the process filter.
2564
2565 @item :sentinel @var{sentinel}
2566 Install @var{sentinel} as the process sentinel.
2567
2568 @item :plist @var{plist}
2569 Install @var{plist} as the initial plist of the process.
2570
2571 @item :speed
2572 @itemx :bytesize
2573 @itemx :parity
2574 @itemx :stopbits
2575 @itemx :flowcontrol
2576 These are handled by @code{serial-process-configure}, which is called
2577 by @code{make-serial-process}.
2578 @end table
2579
2580 The original argument list, possibly modified by later configuration,
2581 is available via the function @code{process-contact}.
2582
2583 Here is an example:
2584
2585 @example
2586 (make-serial-process :port "/dev/ttyS0" :speed 9600)
2587 @end example
2588 @end defun
2589
2590 @defun serial-process-configure &rest args
2591 @cindex baud, in serial connections
2592 @cindex bytesize, in serial connections
2593 @cindex parity, in serial connections
2594 @cindex stopbits, in serial connections
2595 @cindex flowcontrol, in serial connections
2596
2597 This functions configures a serial port connection. Arguments are
2598 specified as keyword/argument pairs. Attributes that are not given
2599 are re-initialized from the process's current configuration (available
2600 via the function @code{process-contact}) or set to reasonable default
2601 values. The following arguments are defined:
2602
2603 @table @code
2604 @item :process @var{process}
2605 @itemx :name @var{name}
2606 @itemx :buffer @var{buffer}
2607 @itemx :port @var{port}
2608 Any of these arguments can be given to identify the process that is to
2609 be configured. If none of these arguments is given, the current
2610 buffer's process is used.
2611
2612 @item :speed @var{speed}
2613 The speed of the serial port in bits per second, a.k.a.@: @dfn{baud
2614 rate}. The value can be any number, but most serial ports work only
2615 at a few defined values between 1200 and 115200, with 9600 being the
2616 most common value. If @var{speed} is @code{nil}, the function ignores
2617 all other arguments and does not configure the port. This may be
2618 useful for special serial ports such as Bluetooth-to-serial converters
2619 which can only be configured through AT commands sent through the
2620 connection. The value of @code{nil} for @var{speed} is valid only for
2621 connections that were already opened by a previous call to
2622 @code{make-serial-process} or @code{serial-term}.
2623
2624 @item :bytesize @var{bytesize}
2625 The number of bits per byte, which can be 7 or 8. If @var{bytesize}
2626 is not given or @code{nil}, it defaults to 8.
2627
2628 @item :parity @var{parity}
2629 The value can be @code{nil} (don't use parity), the symbol
2630 @code{odd} (use odd parity), or the symbol @code{even} (use even
2631 parity). If @var{parity} is not given, it defaults to no parity.
2632
2633 @item :stopbits @var{stopbits}
2634 The number of stopbits used to terminate a transmission
2635 of each byte. @var{stopbits} can be 1 or 2. If @var{stopbits} is not
2636 given or @code{nil}, it defaults to 1.
2637
2638 @item :flowcontrol @var{flowcontrol}
2639 The type of flow control to use for this connection, which is either
2640 @code{nil} (don't use flow control), the symbol @code{hw} (use RTS/CTS
2641 hardware flow control), or the symbol @code{sw} (use XON/XOFF software
2642 flow control). If @var{flowcontrol} is not given, it defaults to no
2643 flow control.
2644 @end table
2645
2646 @code{serial-process-configure} is called by
2647 @code{make-serial-process} for the initial configuration of the serial
2648 port.
2649 @end defun
2650
2651 @node Byte Packing
2652 @section Packing and Unpacking Byte Arrays
2653 @cindex byte packing and unpacking
2654
2655 This section describes how to pack and unpack arrays of bytes,
2656 usually for binary network protocols. These functions convert byte arrays
2657 to alists, and vice versa. The byte array can be represented as a
2658 unibyte string or as a vector of integers, while the alist associates
2659 symbols either with fixed-size objects or with recursive sub-alists.
2660
2661 @cindex serializing
2662 @cindex deserializing
2663 @cindex packing
2664 @cindex unpacking
2665 Conversion from byte arrays to nested alists is also known as
2666 @dfn{deserializing} or @dfn{unpacking}, while going in the opposite
2667 direction is also known as @dfn{serializing} or @dfn{packing}.
2668
2669 @menu
2670 * Bindat Spec:: Describing data layout.
2671 * Bindat Functions:: Doing the unpacking and packing.
2672 * Bindat Examples:: Samples of what bindat.el can do for you!
2673 @end menu
2674
2675 @node Bindat Spec
2676 @subsection Describing Data Layout
2677
2678 To control unpacking and packing, you write a @dfn{data layout
2679 specification}, a special nested list describing named and typed
2680 @dfn{fields}. This specification controls length of each field to be
2681 processed, and how to pack or unpack it. We normally keep bindat specs
2682 in variables whose names end in @samp{-bindat-spec}; that kind of name
2683 is automatically recognized as ``risky.''
2684
2685 @cindex endianness
2686 @cindex big endian
2687 @cindex little endian
2688 @cindex network byte ordering
2689 A field's @dfn{type} describes the size (in bytes) of the object
2690 that the field represents and, in the case of multibyte fields, how
2691 the bytes are ordered within the field. The two possible orderings
2692 are ``big endian'' (also known as ``network byte ordering'') and
2693 ``little endian.'' For instance, the number @code{#x23cd} (decimal
2694 9165) in big endian would be the two bytes @code{#x23} @code{#xcd};
2695 and in little endian, @code{#xcd} @code{#x23}. Here are the possible
2696 type values:
2697
2698 @table @code
2699 @item u8
2700 @itemx byte
2701 Unsigned byte, with length 1.
2702
2703 @item u16
2704 @itemx word
2705 @itemx short
2706 Unsigned integer in network byte order, with length 2.
2707
2708 @item u24
2709 Unsigned integer in network byte order, with length 3.
2710
2711 @item u32
2712 @itemx dword
2713 @itemx long
2714 Unsigned integer in network byte order, with length 4.
2715 Note: These values may be limited by Emacs's integer implementation limits.
2716
2717 @item u16r
2718 @itemx u24r
2719 @itemx u32r
2720 Unsigned integer in little endian order, with length 2, 3 and 4, respectively.
2721
2722 @item str @var{len}
2723 String of length @var{len}.
2724
2725 @item strz @var{len}
2726 Zero-terminated string, in a fixed-size field with length @var{len}.
2727
2728 @item vec @var{len} [@var{type}]
2729 Vector of @var{len} elements of type @var{type}, or bytes if not
2730 @var{type} is specified.
2731 The @var{type} is any of the simple types above, or another vector
2732 specified as a list @code{(vec @var{len} [@var{type}])}.
2733
2734 @item ip
2735 Four-byte vector representing an Internet address. For example:
2736 @code{[127 0 0 1]} for localhost.
2737
2738 @item bits @var{len}
2739 List of set bits in @var{len} bytes. The bytes are taken in big
2740 endian order and the bits are numbered starting with @code{8 *
2741 @var{len} @minus{} 1} and ending with zero. For example: @code{bits
2742 2} unpacks @code{#x28} @code{#x1c} to @code{(2 3 4 11 13)} and
2743 @code{#x1c} @code{#x28} to @code{(3 5 10 11 12)}.
2744
2745 @item (eval @var{form})
2746 @var{form} is a Lisp expression evaluated at the moment the field is
2747 unpacked or packed. The result of the evaluation should be one of the
2748 above-listed type specifications.
2749 @end table
2750
2751 For a fixed-size field, the length @var{len} is given as an integer
2752 specifying the number of bytes in the field.
2753
2754 When the length of a field is not fixed, it typically depends on the
2755 value of a preceding field. In this case, the length @var{len} can be
2756 given either as a list @code{(@var{name} ...)} identifying a
2757 @dfn{field name} in the format specified for @code{bindat-get-field}
2758 below, or by an expression @code{(eval @var{form})} where @var{form}
2759 should evaluate to an integer, specifying the field length.
2760
2761 A field specification generally has the form @code{([@var{name}]
2762 @var{handler})}. The square braces indicate that @var{name} is
2763 optional. (Don't use names that are symbols meaningful as type
2764 specifications (above) or handler specifications (below), since that
2765 would be ambiguous.) @var{name} can be a symbol or the expression
2766 @code{(eval @var{form})}, in which case @var{form} should evaluate to
2767 a symbol.
2768
2769 @var{handler} describes how to unpack or pack the field and can be one
2770 of the following:
2771
2772 @table @code
2773 @item @var{type}
2774 Unpack/pack this field according to the type specification @var{type}.
2775
2776 @item eval @var{form}
2777 Evaluate @var{form}, a Lisp expression, for side-effect only. If the
2778 field name is specified, the value is bound to that field name.
2779
2780 @item fill @var{len}
2781 Skip @var{len} bytes. In packing, this leaves them unchanged,
2782 which normally means they remain zero. In unpacking, this means
2783 they are ignored.
2784
2785 @item align @var{len}
2786 Skip to the next multiple of @var{len} bytes.
2787
2788 @item struct @var{spec-name}
2789 Process @var{spec-name} as a sub-specification. This describes a
2790 structure nested within another structure.
2791
2792 @item union @var{form} (@var{tag} @var{spec})@dots{}
2793 @c ??? I don't see how one would actually use this.
2794 @c ??? what kind of expression would be useful for @var{form}?
2795 Evaluate @var{form}, a Lisp expression, find the first @var{tag}
2796 that matches it, and process its associated data layout specification
2797 @var{spec}. Matching can occur in one of three ways:
2798
2799 @itemize
2800 @item
2801 If a @var{tag} has the form @code{(eval @var{expr})}, evaluate
2802 @var{expr} with the variable @code{tag} dynamically bound to the value
2803 of @var{form}. A non-@code{nil} result indicates a match.
2804
2805 @item
2806 @var{tag} matches if it is @code{equal} to the value of @var{form}.
2807
2808 @item
2809 @var{tag} matches unconditionally if it is @code{t}.
2810 @end itemize
2811
2812 @item repeat @var{count} @var{field-specs}@dots{}
2813 Process the @var{field-specs} recursively, in order, then repeat
2814 starting from the first one, processing all the specs @var{count}
2815 times overall. The @var{count} is given using the same formats as a
2816 field length---if an @code{eval} form is used, it is evaluated just once.
2817 For correct operation, each spec in @var{field-specs} must include a name.
2818 @end table
2819
2820 For the @code{(eval @var{form})} forms used in a bindat specification,
2821 the @var{form} can access and update these dynamically bound variables
2822 during evaluation:
2823
2824 @table @code
2825 @item last
2826 Value of the last field processed.
2827
2828 @item bindat-raw
2829 The data as a byte array.
2830
2831 @item bindat-idx
2832 Current index (within @code{bindat-raw}) for unpacking or packing.
2833
2834 @item struct
2835 The alist containing the structured data that have been unpacked so
2836 far, or the entire structure being packed. You can use
2837 @code{bindat-get-field} to access specific fields of this structure.
2838
2839 @item count
2840 @itemx index
2841 Inside a @code{repeat} block, these contain the maximum number of
2842 repetitions (as specified by the @var{count} parameter), and the
2843 current repetition number (counting from 0). Setting @code{count} to
2844 zero will terminate the inner-most repeat block after the current
2845 repetition has completed.
2846 @end table
2847
2848 @node Bindat Functions
2849 @subsection Functions to Unpack and Pack Bytes
2850
2851 In the following documentation, @var{spec} refers to a data layout
2852 specification, @code{bindat-raw} to a byte array, and @var{struct} to an
2853 alist representing unpacked field data.
2854
2855 @defun bindat-unpack spec bindat-raw &optional bindat-idx
2856 This function unpacks data from the unibyte string or byte
2857 array @code{bindat-raw}
2858 according to @var{spec}. Normally this starts unpacking at the
2859 beginning of the byte array, but if @var{bindat-idx} is non-@code{nil}, it
2860 specifies a zero-based starting position to use instead.
2861
2862 The value is an alist or nested alist in which each element describes
2863 one unpacked field.
2864 @end defun
2865
2866 @defun bindat-get-field struct &rest name
2867 This function selects a field's data from the nested alist
2868 @var{struct}. Usually @var{struct} was returned by
2869 @code{bindat-unpack}. If @var{name} corresponds to just one argument,
2870 that means to extract a top-level field value. Multiple @var{name}
2871 arguments specify repeated lookup of sub-structures. An integer name
2872 acts as an array index.
2873
2874 For example, if @var{name} is @code{(a b 2 c)}, that means to find
2875 field @code{c} in the third element of subfield @code{b} of field
2876 @code{a}. (This corresponds to @code{struct.a.b[2].c} in C.)
2877 @end defun
2878
2879 Although packing and unpacking operations change the organization of
2880 data (in memory), they preserve the data's @dfn{total length}, which is
2881 the sum of all the fields' lengths, in bytes. This value is not
2882 generally inherent in either the specification or alist alone; instead,
2883 both pieces of information contribute to its calculation. Likewise, the
2884 length of a string or array being unpacked may be longer than the data's
2885 total length as described by the specification.
2886
2887 @defun bindat-length spec struct
2888 This function returns the total length of the data in @var{struct},
2889 according to @var{spec}.
2890 @end defun
2891
2892 @defun bindat-pack spec struct &optional bindat-raw bindat-idx
2893 This function returns a byte array packed according to @var{spec} from
2894 the data in the alist @var{struct}. Normally it creates and fills a
2895 new byte array starting at the beginning. However, if @var{bindat-raw}
2896 is non-@code{nil}, it specifies a pre-allocated unibyte string or vector to
2897 pack into. If @var{bindat-idx} is non-@code{nil}, it specifies the starting
2898 offset for packing into @code{bindat-raw}.
2899
2900 When pre-allocating, you should make sure @code{(length @var{bindat-raw})}
2901 meets or exceeds the total length to avoid an out-of-range error.
2902 @end defun
2903
2904 @defun bindat-ip-to-string ip
2905 Convert the Internet address vector @var{ip} to a string in the usual
2906 dotted notation.
2907
2908 @example
2909 (bindat-ip-to-string [127 0 0 1])
2910 @result{} "127.0.0.1"
2911 @end example
2912 @end defun
2913
2914 @node Bindat Examples
2915 @subsection Examples of Byte Unpacking and Packing
2916
2917 Here is a complete example of byte unpacking and packing:
2918
2919 @lisp
2920 (defvar fcookie-index-spec
2921 '((:version u32)
2922 (:count u32)
2923 (:longest u32)
2924 (:shortest u32)
2925 (:flags u32)
2926 (:delim u8)
2927 (:ignored fill 3)
2928 (:offset repeat (:count)
2929 (:foo u32)))
2930 "Description of a fortune cookie index file's contents.")
2931
2932 (defun fcookie (cookies &optional index)
2933 "Display a random fortune cookie from file COOKIES.
2934 Optional second arg INDEX specifies the associated index
2935 filename, which is by default constructed by appending
2936 \".dat\" to COOKIES. Display cookie text in possibly
2937 new buffer \"*Fortune Cookie: BASENAME*\" where BASENAME
2938 is COOKIES without the directory part."
2939 (interactive "fCookies file: ")
2940 (let* ((info (with-temp-buffer
2941 (insert-file-contents-literally
2942 (or index (concat cookies ".dat")))
2943 (bindat-unpack fcookie-index-spec
2944 (buffer-string))))
2945 (sel (random (bindat-get-field info :count)))
2946 (beg (cdar (bindat-get-field info :offset sel)))
2947 (end (or (cdar (bindat-get-field info
2948 :offset (1+ sel)))
2949 (nth 7 (file-attributes cookies)))))
2950 (switch-to-buffer
2951 (get-buffer-create
2952 (format "*Fortune Cookie: %s*"
2953 (file-name-nondirectory cookies))))
2954 (erase-buffer)
2955 (insert-file-contents-literally
2956 cookies nil beg (- end 3))))
2957
2958 (defun fcookie-create-index (cookies &optional index delim)
2959 "Scan file COOKIES, and write out its index file.
2960 Optional second arg INDEX specifies the index filename,
2961 which is by default constructed by appending \".dat\" to
2962 COOKIES. Optional third arg DELIM specifies the unibyte
2963 character which, when found on a line of its own in
2964 COOKIES, indicates the border between entries."
2965 (interactive "fCookies file: ")
2966 (setq delim (or delim ?%))
2967 (let ((delim-line (format "\n%c\n" delim))
2968 (count 0)
2969 (max 0)
2970 min p q len offsets)
2971 (unless (= 3 (string-bytes delim-line))
2972 (error "Delimiter cannot be represented in one byte"))
2973 (with-temp-buffer
2974 (insert-file-contents-literally cookies)
2975 (while (and (setq p (point))
2976 (search-forward delim-line (point-max) t)
2977 (setq len (- (point) 3 p)))
2978 (setq count (1+ count)
2979 max (max max len)
2980 min (min (or min max) len)
2981 offsets (cons (1- p) offsets))))
2982 (with-temp-buffer
2983 (set-buffer-multibyte nil)
2984 (insert
2985 (bindat-pack
2986 fcookie-index-spec
2987 `((:version . 2)
2988 (:count . ,count)
2989 (:longest . ,max)
2990 (:shortest . ,min)
2991 (:flags . 0)
2992 (:delim . ,delim)
2993 (:offset . ,(mapcar (lambda (o)
2994 (list (cons :foo o)))
2995 (nreverse offsets))))))
2996 (let ((coding-system-for-write 'raw-text-unix))
2997 (write-file (or index (concat cookies ".dat")))))))
2998 @end lisp
2999
3000 Following is an example of defining and unpacking a complex structure.
3001 Consider the following C structures:
3002
3003 @example
3004 struct header @{
3005 unsigned long dest_ip;
3006 unsigned long src_ip;
3007 unsigned short dest_port;
3008 unsigned short src_port;
3009 @};
3010
3011 struct data @{
3012 unsigned char type;
3013 unsigned char opcode;
3014 unsigned short length; /* In network byte order */
3015 unsigned char id[8]; /* null-terminated string */
3016 unsigned char data[/* (length + 3) & ~3 */];
3017 @};
3018
3019 struct packet @{
3020 struct header header;
3021 unsigned long counters[2]; /* In little endian order */
3022 unsigned char items;
3023 unsigned char filler[3];
3024 struct data item[/* items */];
3025
3026 @};
3027 @end example
3028
3029 The corresponding data layout specification:
3030
3031 @lisp
3032 (setq header-spec
3033 '((dest-ip ip)
3034 (src-ip ip)
3035 (dest-port u16)
3036 (src-port u16)))
3037
3038 (setq data-spec
3039 '((type u8)
3040 (opcode u8)
3041 (length u16) ;; network byte order
3042 (id strz 8)
3043 (data vec (length))
3044 (align 4)))
3045
3046 (setq packet-spec
3047 '((header struct header-spec)
3048 (counters vec 2 u32r) ;; little endian order
3049 (items u8)
3050 (fill 3)
3051 (item repeat (items)
3052 (struct data-spec))))
3053 @end lisp
3054
3055 A binary data representation:
3056
3057 @lisp
3058 (setq binary-data
3059 [ 192 168 1 100 192 168 1 101 01 28 21 32
3060 160 134 1 0 5 1 0 0 2 0 0 0
3061 2 3 0 5 ?A ?B ?C ?D ?E ?F 0 0 1 2 3 4 5 0 0 0
3062 1 4 0 7 ?B ?C ?D ?E ?F ?G 0 0 6 7 8 9 10 11 12 0 ])
3063 @end lisp
3064
3065 The corresponding decoded structure:
3066
3067 @lisp
3068 (setq decoded (bindat-unpack packet-spec binary-data))
3069 @result{}
3070 ((header
3071 (dest-ip . [192 168 1 100])
3072 (src-ip . [192 168 1 101])
3073 (dest-port . 284)
3074 (src-port . 5408))
3075 (counters . [100000 261])
3076 (items . 2)
3077 (item ((data . [1 2 3 4 5])
3078 (id . "ABCDEF")
3079 (length . 5)
3080 (opcode . 3)
3081 (type . 2))
3082 ((data . [6 7 8 9 10 11 12])
3083 (id . "BCDEFG")
3084 (length . 7)
3085 (opcode . 4)
3086 (type . 1))))
3087 @end lisp
3088
3089 Fetching data from this structure:
3090
3091 @lisp
3092 (bindat-get-field decoded 'item 1 'id)
3093 @result{} "BCDEFG"
3094 @end lisp