doc/lispref/anti.texi small edits
[bpt/emacs.git] / doc / lispref / processes.texi
CommitLineData
b8d4c8d0
GM
1@c -*-texinfo-*-
2@c This is part of the GNU Emacs Lisp Reference Manual.
acaf905b 3@c Copyright (C) 1990-1995, 1998-1999, 2001-2012
d24880de 4@c Free Software Foundation, Inc.
b8d4c8d0 5@c See the file elisp.texi for copying conditions.
6336d8c3 6@setfilename ../../info/processes
b8d4c8d0
GM
7@node Processes, Display, Abbrevs, Top
8@chapter Processes
9@cindex child process
10@cindex parent process
11@cindex subprocess
12@cindex process
13
14 In the terminology of operating systems, a @dfn{process} is a space in
15which a program can execute. Emacs runs in a process. Emacs Lisp
16programs can invoke other programs in processes of their own. These are
17called @dfn{subprocesses} or @dfn{child processes} of the Emacs process,
18which is their @dfn{parent process}.
19
20 A subprocess of Emacs may be @dfn{synchronous} or @dfn{asynchronous},
21depending on how it is created. When you create a synchronous
22subprocess, the Lisp program waits for the subprocess to terminate
23before continuing execution. When you create an asynchronous
24subprocess, it can run in parallel with the Lisp program. This kind of
25subprocess is represented within Emacs by a Lisp object which is also
26called a ``process.'' Lisp programs can use this object to communicate
27with the subprocess or to control it. For example, you can send
28signals, obtain status information, receive output from the process, or
29send input to it.
30
31@defun processp object
23dd4ecd
EZ
32This function returns @code{t} if @var{object} represents an Emacs
33subprocess, @code{nil} otherwise.
b8d4c8d0
GM
34@end defun
35
23dd4ecd
EZ
36 In addition to subprocesses of the current Emacs session, you can
37also access other processes running on your machine. @xref{System
38Processes}.
39
b8d4c8d0
GM
40@menu
41* Subprocess Creation:: Functions that start subprocesses.
42* Shell Arguments:: Quoting an argument to pass it to a shell.
43* Synchronous Processes:: Details of using synchronous subprocesses.
44* Asynchronous Processes:: Starting up an asynchronous subprocess.
45* Deleting Processes:: Eliminating an asynchronous subprocess.
46* Process Information:: Accessing run-status and other attributes.
47* Input to Processes:: Sending input to an asynchronous subprocess.
48* Signals to Processes:: Stopping, continuing or interrupting
49 an asynchronous subprocess.
50* Output from Processes:: Collecting output from an asynchronous subprocess.
51* Sentinels:: Sentinels run when process run-status changes.
52* Query Before Exit:: Whether to query if exiting will kill a process.
23dd4ecd 53* System Processes:: Accessing other processes running on your system.
d24880de 54* Transaction Queues:: Transaction-based communication with subprocesses.
b8d4c8d0
GM
55* Network:: Opening network connections.
56* Network Servers:: Network servers let Emacs accept net connections.
57* Datagrams:: UDP network connections.
58* Low-Level Network:: Lower-level but more general function
59 to create connections and servers.
d24880de 60* Misc Network:: Additional relevant functions for net connections.
c73e02fa 61* Serial Ports:: Communicating with serial ports.
b8d4c8d0
GM
62* Byte Packing:: Using bindat to pack and unpack binary data.
63@end menu
64
65@node Subprocess Creation
66@section Functions that Create Subprocesses
67
583d8b3c 68 There are three primitives that create a new subprocess in which to run
b8d4c8d0
GM
69a program. One of them, @code{start-process}, creates an asynchronous
70process and returns a process object (@pxref{Asynchronous Processes}).
71The other two, @code{call-process} and @code{call-process-region},
72create a synchronous process and do not return a process object
73(@pxref{Synchronous Processes}).
74
75 Synchronous and asynchronous processes are explained in the following
76sections. Since the three functions are all called in a similar
77fashion, their common arguments are described here.
78
79@cindex execute program
8fc85b20
GM
80@cindex @env{PATH} environment variable
81@cindex @env{HOME} environment variable
b8d4c8d0
GM
82 In all cases, the function's @var{program} argument specifies the
83program to be run. An error is signaled if the file is not found or
84cannot be executed. If the file name is relative, the variable
85@code{exec-path} contains a list of directories to search. Emacs
86initializes @code{exec-path} when it starts up, based on the value of
8fc85b20 87the environment variable @env{PATH}. The standard file name
b8d4c8d0
GM
88constructs, @samp{~}, @samp{.}, and @samp{..}, are interpreted as
89usual in @code{exec-path}, but environment variable substitutions
90(@samp{$HOME}, etc.) are not recognized; use
91@code{substitute-in-file-name} to perform them (@pxref{File Name
92Expansion}). @code{nil} in this list refers to
93@code{default-directory}.
94
95 Executing a program can also try adding suffixes to the specified
96name:
97
98@defvar exec-suffixes
99This variable is a list of suffixes (strings) to try adding to the
100specified program file name. The list should include @code{""} if you
101want the name to be tried exactly as specified. The default value is
102system-dependent.
103@end defvar
104
105 @strong{Please note:} The argument @var{program} contains only the
106name of the program; it may not contain any command-line arguments. You
107must use @var{args} to provide those.
108
109 Each of the subprocess-creating functions has a @var{buffer-or-name}
110argument which specifies where the standard output from the program will
111go. It should be a buffer or a buffer name; if it is a buffer name,
112that will create the buffer if it does not already exist. It can also
113be @code{nil}, which says to discard the output unless a filter function
114handles it. (@xref{Filter Functions}, and @ref{Read and Print}.)
115Normally, you should avoid having multiple processes send output to the
116same buffer because their output would be intermixed randomly.
117
118@cindex program arguments
119 All three of the subprocess-creating functions have a @code{&rest}
120argument, @var{args}. The @var{args} must all be strings, and they are
121supplied to @var{program} as separate command line arguments. Wildcard
122characters and other shell constructs have no special meanings in these
123strings, since the strings are passed directly to the specified program.
124
125 The subprocess gets its current directory from the value of
126@code{default-directory} (@pxref{File Name Expansion}).
127
128@cindex environment variables, subprocesses
129 The subprocess inherits its environment from Emacs, but you can
130specify overrides for it with @code{process-environment}. @xref{System
131Environment}.
132
133@defvar exec-directory
134@pindex movemail
135The value of this variable is a string, the name of a directory that
136contains programs that come with GNU Emacs, programs intended for Emacs
137to invoke. The program @code{movemail} is an example of such a program;
138Rmail uses it to fetch new mail from an inbox.
139@end defvar
140
141@defopt exec-path
142The value of this variable is a list of directories to search for
143programs to run in subprocesses. Each element is either the name of a
144directory (i.e., a string), or @code{nil}, which stands for the default
145directory (which is the value of @code{default-directory}).
146@cindex program directories
147
148The value of @code{exec-path} is used by @code{call-process} and
149@code{start-process} when the @var{program} argument is not an absolute
150file name.
151@end defopt
152
153@node Shell Arguments
154@section Shell Arguments
155@cindex arguments for shell commands
156@cindex shell command arguments
157
158 Lisp programs sometimes need to run a shell and give it a command
159that contains file names that were specified by the user. These
160programs ought to be able to support any valid file name. But the shell
161gives special treatment to certain characters, and if these characters
162occur in the file name, they will confuse the shell. To handle these
163characters, use the function @code{shell-quote-argument}:
164
165@defun shell-quote-argument argument
166This function returns a string which represents, in shell syntax,
167an argument whose actual contents are @var{argument}. It should
168work reliably to concatenate the return value into a shell command
169and then pass it to a shell for execution.
170
171Precisely what this function does depends on your operating system. The
172function is designed to work with the syntax of your system's standard
173shell; if you use an unusual shell, you will need to redefine this
174function.
175
176@example
177;; @r{This example shows the behavior on GNU and Unix systems.}
178(shell-quote-argument "foo > bar")
179 @result{} "foo\\ \\>\\ bar"
180
181;; @r{This example shows the behavior on MS-DOS and MS-Windows.}
182(shell-quote-argument "foo > bar")
183 @result{} "\"foo > bar\""
184@end example
185
186Here's an example of using @code{shell-quote-argument} to construct
187a shell command:
188
189@example
190(concat "diff -c "
191 (shell-quote-argument oldfile)
192 " "
193 (shell-quote-argument newfile))
194@end example
195@end defun
196
3c73e30e
EZ
197@cindex quoting and unquoting command-line arguments
198@cindex minibuffer input, and command-line arguments
199@cindex @code{call-process}, command-line arguments from minibuffer
200@cindex @code{start-process}, command-line arguments from minibuffer
4bb49a92
EZ
201 The following two functions are useful for combining a list of
202individual command-line argument strings into a single string, and
203taking a string apart into a list of individual command-line
204arguments. These functions are mainly intended to be used for
205converting user input in the minibuffer, a Lisp string, into a list of
206string arguments to be passed to @code{call-process} or
3c73e30e
EZ
207@code{start-process}, or for the converting such lists of arguments in
208a single Lisp string to be presented in the minibuffer or echo area.
a873ee3d
EZ
209
210@defun split-string-and-unquote string &optional separators
211This function splits @var{string} into substrings at matches for the
212regular expression @var{separators}, like @code{split-string} does
0999039c
CY
213(@pxref{Creating Strings}); in addition, it removes quoting from the
214substrings. It then makes a list of the substrings and returns it.
a873ee3d 215
4185820c
CY
216If @var{separators} is omitted or @code{nil}, it defaults to
217@code{"\\s-+"}, which is a regular expression that matches one or more
218characters with whitespace syntax (@pxref{Syntax Class Table}).
a873ee3d 219
3c73e30e 220This function supports two types of quoting: enclosing a whole string
0999039c
CY
221in double quotes @code{"@dots{}"}, and quoting individual characters
222with a backslash escape @samp{\}. The latter is also used in Lisp
223strings, so this function can handle those as well.
a873ee3d
EZ
224@end defun
225
226@defun combine-and-quote-strings list-of-strings &optional separator
227This function concatenates @var{list-of-strings} into a single string,
0999039c
CY
228quoting each string as necessary. It also sticks the @var{separator}
229string between each pair of strings; if @var{separator} is omitted or
230@code{nil}, it defaults to @code{" "}. The return value is the
231resulting string.
a873ee3d
EZ
232
233The strings in @var{list-of-strings} that need quoting are those that
234include @var{separator} as their substring. Quoting a string encloses
235it in double quotes @code{"@dots{}"}. In the simplest case, if you
4bb49a92
EZ
236are consing a command from the individual command-line arguments,
237every argument that includes embedded blanks will be quoted.
a873ee3d
EZ
238@end defun
239
b8d4c8d0
GM
240@node Synchronous Processes
241@section Creating a Synchronous Process
242@cindex synchronous subprocess
243
244 After a @dfn{synchronous process} is created, Emacs waits for the
245process to terminate before continuing. Starting Dired on GNU or
246Unix@footnote{On other systems, Emacs uses a Lisp emulation of
247@code{ls}; see @ref{Contents of Directories}.} is an example of this: it
248runs @code{ls} in a synchronous process, then modifies the output
249slightly. Because the process is synchronous, the entire directory
250listing arrives in the buffer before Emacs tries to do anything with it.
251
252 While Emacs waits for the synchronous subprocess to terminate, the
253user can quit by typing @kbd{C-g}. The first @kbd{C-g} tries to kill
254the subprocess with a @code{SIGINT} signal; but it waits until the
255subprocess actually terminates before quitting. If during that time the
256user types another @kbd{C-g}, that kills the subprocess instantly with
257@code{SIGKILL} and quits immediately (except on MS-DOS, where killing
258other processes doesn't work). @xref{Quitting}.
259
260 The synchronous subprocess functions return an indication of how the
261process terminated.
262
263 The output from a synchronous subprocess is generally decoded using a
264coding system, much like text read from a file. The input sent to a
265subprocess by @code{call-process-region} is encoded using a coding
266system, much like text written into a file. @xref{Coding Systems}.
267
268@defun call-process program &optional infile destination display &rest args
b59a4335 269This function calls @var{program} and waits for it to finish.
b8d4c8d0 270
b59a4335 271The standard input for the new process comes from file @var{infile} if
b8d4c8d0
GM
272@var{infile} is not @code{nil}, and from the null device otherwise.
273The argument @var{destination} says where to put the process output.
274Here are the possibilities:
275
276@table @asis
277@item a buffer
278Insert the output in that buffer, before point. This includes both the
279standard output stream and the standard error stream of the process.
280
281@item a string
282Insert the output in a buffer with that name, before point.
283
284@item @code{t}
285Insert the output in the current buffer, before point.
286
287@item @code{nil}
288Discard the output.
289
290@item 0
291Discard the output, and return @code{nil} immediately without waiting
292for the subprocess to finish.
293
294In this case, the process is not truly synchronous, since it can run in
295parallel with Emacs; but you can think of it as synchronous in that
296Emacs is essentially finished with the subprocess as soon as this
297function returns.
298
299MS-DOS doesn't support asynchronous subprocesses, so this option doesn't
300work there.
301
1ef14cb4 302@item @code{(:file @var{file-name})}
1b9f60cc
GM
303Send the output to the file name specified, overwriting it if it
304already exists.
1ef14cb4 305
b8d4c8d0
GM
306@item @code{(@var{real-destination} @var{error-destination})}
307Keep the standard output stream separate from the standard error stream;
308deal with the ordinary output as specified by @var{real-destination},
309and dispose of the error output according to @var{error-destination}.
310If @var{error-destination} is @code{nil}, that means to discard the
311error output, @code{t} means mix it with the ordinary output, and a
312string specifies a file name to redirect error output into.
313
314You can't directly specify a buffer to put the error output in; that is
315too difficult to implement. But you can achieve this result by sending
316the error output to a temporary file and then inserting the file into a
317buffer.
318@end table
319
320If @var{display} is non-@code{nil}, then @code{call-process} redisplays
321the buffer as output is inserted. (However, if the coding system chosen
322for decoding output is @code{undecided}, meaning deduce the encoding
323from the actual data, then redisplay sometimes cannot continue once
324non-@acronym{ASCII} characters are encountered. There are fundamental
325reasons why it is hard to fix this; see @ref{Output from Processes}.)
326
327Otherwise the function @code{call-process} does no redisplay, and the
328results become visible on the screen only when Emacs redisplays that
329buffer in the normal course of events.
330
331The remaining arguments, @var{args}, are strings that specify command
332line arguments for the program.
333
334The value returned by @code{call-process} (unless you told it not to
335wait) indicates the reason for process termination. A number gives the
336exit status of the subprocess; 0 means success, and any other value
337means failure. If the process terminated with a signal,
338@code{call-process} returns a string describing the signal.
339
340In the examples below, the buffer @samp{foo} is current.
341
342@smallexample
343@group
344(call-process "pwd" nil t)
345 @result{} 0
346
347---------- Buffer: foo ----------
348/usr/user/lewis/manual
349---------- Buffer: foo ----------
350@end group
351
352@group
353(call-process "grep" nil "bar" nil "lewis" "/etc/passwd")
354 @result{} 0
355
356---------- Buffer: bar ----------
357lewis:5LTsHm66CSWKg:398:21:Bil Lewis:/user/lewis:/bin/csh
358
359---------- Buffer: bar ----------
360@end group
361@end smallexample
362
363Here is a good example of the use of @code{call-process}, which used to
364be found in the definition of @code{insert-directory}:
365
366@smallexample
367@group
368(call-process insert-directory-program nil t nil @var{switches}
369 (if full-directory-p
370 (concat (file-name-as-directory file) ".")
371 file))
372@end group
373@end smallexample
374@end defun
375
376@defun process-file program &optional infile buffer display &rest args
377This function processes files synchronously in a separate process. It
378is similar to @code{call-process} but may invoke a file handler based
379on the value of the variable @code{default-directory}. The current
380working directory of the subprocess is @code{default-directory}.
381
382The arguments are handled in almost the same way as for
383@code{call-process}, with the following differences:
384
385Some file handlers may not support all combinations and forms of the
386arguments @var{infile}, @var{buffer}, and @var{display}. For example,
387some file handlers might behave as if @var{display} were @code{nil},
388regardless of the value actually passed. As another example, some
389file handlers might not support separating standard output and error
390output by way of the @var{buffer} argument.
391
392If a file handler is invoked, it determines the program to run based
393on the first argument @var{program}. For instance, consider that a
394handler for remote files is invoked. Then the path that is used for
395searching the program might be different than @code{exec-path}.
396
397The second argument @var{infile} may invoke a file handler. The file
398handler could be different from the handler chosen for the
399@code{process-file} function itself. (For example,
400@code{default-directory} could be on a remote host, whereas
401@var{infile} is on another remote host. Or @code{default-directory}
402could be non-special, whereas @var{infile} is on a remote host.)
403
404If @var{buffer} is a list of the form @code{(@var{real-destination}
405@var{error-destination})}, and @var{error-destination} names a file,
406then the same remarks as for @var{infile} apply.
407
408The remaining arguments (@var{args}) will be passed to the process
409verbatim. Emacs is not involved in processing file names that are
410present in @var{args}. To avoid confusion, it may be best to avoid
411absolute file names in @var{args}, but rather to specify all file
412names as relative to @code{default-directory}. The function
413@code{file-relative-name} is useful for constructing such relative
414file names.
415@end defun
416
3691a0a6
MA
417@defvar process-file-side-effects
418This variable indicates, whether a call of @code{process-file} changes
419remote files.
420
421Per default, this variable is always set to @code{t}, meaning that a
422call of @code{process-file} could potentially change any file on a
423remote host. When set to @code{nil}, a file handler could optimize
91af3942 424its behavior with respect to remote file attributes caching.
3691a0a6
MA
425
426This variable should never be changed by @code{setq}. Instead of, it
427shall be set only by let-binding.
428@end defvar
429
b8d4c8d0
GM
430@defun call-process-region start end program &optional delete destination display &rest args
431This function sends the text from @var{start} to @var{end} as
432standard input to a process running @var{program}. It deletes the text
433sent if @var{delete} is non-@code{nil}; this is useful when
434@var{destination} is @code{t}, to insert the output in the current
435buffer in place of the input.
436
437The arguments @var{destination} and @var{display} control what to do
438with the output from the subprocess, and whether to update the display
439as it comes in. For details, see the description of
440@code{call-process}, above. If @var{destination} is the integer 0,
441@code{call-process-region} discards the output and returns @code{nil}
442immediately, without waiting for the subprocess to finish (this only
443works if asynchronous subprocesses are supported).
444
445The remaining arguments, @var{args}, are strings that specify command
446line arguments for the program.
447
448The return value of @code{call-process-region} is just like that of
449@code{call-process}: @code{nil} if you told it to return without
450waiting; otherwise, a number or string which indicates how the
451subprocess terminated.
452
453In the following example, we use @code{call-process-region} to run the
454@code{cat} utility, with standard input being the first five characters
455in buffer @samp{foo} (the word @samp{input}). @code{cat} copies its
456standard input into its standard output. Since the argument
457@var{destination} is @code{t}, this output is inserted in the current
458buffer.
459
460@smallexample
461@group
462---------- Buffer: foo ----------
463input@point{}
464---------- Buffer: foo ----------
465@end group
466
467@group
468(call-process-region 1 6 "cat" nil t)
469 @result{} 0
470
471---------- Buffer: foo ----------
472inputinput@point{}
473---------- Buffer: foo ----------
474@end group
475@end smallexample
476
477 The @code{shell-command-on-region} command uses
478@code{call-process-region} like this:
479
480@smallexample
481@group
482(call-process-region
483 start end
484 shell-file-name ; @r{Name of program.}
485 nil ; @r{Do not delete region.}
486 buffer ; @r{Send output to @code{buffer}.}
487 nil ; @r{No redisplay during output.}
488 "-c" command) ; @r{Arguments for the shell.}
489@end group
490@end smallexample
491@end defun
492
493@defun call-process-shell-command command &optional infile destination display &rest args
b59a4335
CY
494This function executes the shell command @var{command} synchronously.
495The final arguments @var{args} are additional arguments to add at the
496end of @var{command}. The other arguments are handled as in
497@code{call-process}.
b8d4c8d0
GM
498@end defun
499
500@defun process-file-shell-command command &optional infile destination display &rest args
501This function is like @code{call-process-shell-command}, but uses
502@code{process-file} internally. Depending on @code{default-directory},
503@var{command} can be executed also on remote hosts.
504@end defun
505
506@defun shell-command-to-string command
507This function executes @var{command} (a string) as a shell command,
508then returns the command's output as a string.
509@end defun
510
583d8b3c 511@defun process-lines program &rest args
b59a4335
CY
512This function runs @var{program}, waits for it to finish, and returns
513its output as a list of strings. Each string in the list holds a
514single line of text output by the program; the end-of-line characters
515are stripped from each line. The arguments beyond @var{program},
516@var{args}, are strings that specify command-line arguments with which
517to run the program.
583d8b3c
EZ
518
519If @var{program} exits with a non-zero exit status, this function
520signals an error.
521
522This function works by calling @code{call-process}, so program output
523is decoded in the same way as for @code{call-process}.
524@end defun
525
b8d4c8d0
GM
526@node Asynchronous Processes
527@section Creating an Asynchronous Process
528@cindex asynchronous subprocess
529
530 After an @dfn{asynchronous process} is created, Emacs and the subprocess
531both continue running immediately. The process thereafter runs
532in parallel with Emacs, and the two can communicate with each other
533using the functions described in the following sections. However,
534communication is only partially asynchronous: Emacs sends data to the
535process only when certain functions are called, and Emacs accepts data
536from the process only when Emacs is waiting for input or for a time
537delay.
538
539 Here we describe how to create an asynchronous process.
540
541@defun start-process name buffer-or-name program &rest args
542This function creates a new asynchronous subprocess and starts the
543program @var{program} running in it. It returns a process object that
544stands for the new subprocess in Lisp. The argument @var{name}
545specifies the name for the process object; if a process with this name
546already exists, then @var{name} is modified (by appending @samp{<1>},
547etc.) to be unique. The buffer @var{buffer-or-name} is the buffer to
548associate with the process.
549
550The remaining arguments, @var{args}, are strings that specify command
551line arguments for the program.
552
553In the example below, the first process is started and runs (rather,
554sleeps) for 100 seconds. Meanwhile, the second process is started, and
555given the name @samp{my-process<1>} for the sake of uniqueness. It
556inserts the directory listing at the end of the buffer @samp{foo},
557before the first process finishes. Then it finishes, and a message to
558that effect is inserted in the buffer. Much later, the first process
559finishes, and another message is inserted in the buffer for it.
560
561@smallexample
562@group
563(start-process "my-process" "foo" "sleep" "100")
564 @result{} #<process my-process>
565@end group
566
567@group
568(start-process "my-process" "foo" "ls" "-l" "/user/lewis/bin")
569 @result{} #<process my-process<1>>
570
571---------- Buffer: foo ----------
572total 2
573lrwxrwxrwx 1 lewis 14 Jul 22 10:12 gnuemacs --> /emacs
574-rwxrwxrwx 1 lewis 19 Jul 30 21:02 lemon
575
576Process my-process<1> finished
577
578Process my-process finished
579---------- Buffer: foo ----------
580@end group
581@end smallexample
582@end defun
583
584@defun start-file-process name buffer-or-name program &rest args
585Like @code{start-process}, this function starts a new asynchronous
586subprocess running @var{program} in it, and returns its process
587object---when @code{default-directory} is not a magic file name.
588
589If @code{default-directory} is magic, the function invokes its file
590handler instead. This handler ought to run @var{program}, perhaps on
591the local host, perhaps on a remote host that corresponds to
592@code{default-directory}. In the latter case, the local part of
593@code{default-directory} becomes the working directory of the process.
594
595This function does not try to invoke file name handlers for
596@var{program} or for the @var{program-args}.
597
598Depending on the implementation of the file handler, it might not be
599possible to apply @code{process-filter} or @code{process-sentinel} to
600the resulting process object (@pxref{Filter Functions}, @pxref{Sentinels}).
601
602Some file handlers may not support @code{start-file-process} (for
603example @code{ange-ftp-hook-function}). In such cases, the function
604does nothing and returns @code{nil}.
605@end defun
606
03a74b84 607@defun start-process-shell-command name buffer-or-name command
b8d4c8d0
GM
608This function is like @code{start-process} except that it uses a shell
609to execute the specified command. The argument @var{command} is a shell
03a74b84 610command name. The variable @code{shell-file-name} specifies which shell to
b8d4c8d0
GM
611use.
612
613The point of running a program through the shell, rather than directly
614with @code{start-process}, is so that you can employ shell features such
615as wildcards in the arguments. It follows that if you include an
616arbitrary user-specified arguments in the command, you should quote it
617with @code{shell-quote-argument} first, so that any special shell
618characters do @emph{not} have their special shell meanings. @xref{Shell
619Arguments}.
620@end defun
621
03a74b84 622@defun start-file-process-shell-command name buffer-or-name command
b8d4c8d0
GM
623This function is like @code{start-process-shell-command}, but uses
624@code{start-file-process} internally. By this, @var{command} can be
625executed also on remote hosts, depending on @code{default-directory}.
626@end defun
627
628@defvar process-connection-type
629@cindex pipes
630@cindex @acronym{PTY}s
631This variable controls the type of device used to communicate with
632asynchronous subprocesses. If it is non-@code{nil}, then @acronym{PTY}s are
633used, when available. Otherwise, pipes are used.
634
635@acronym{PTY}s are usually preferable for processes visible to the user, as
636in Shell mode, because they allow job control (@kbd{C-c}, @kbd{C-z},
637etc.) to work between the process and its children, whereas pipes do
638not. For subprocesses used for internal purposes by programs, it is
639often better to use a pipe, because they are more efficient. In
640addition, the total number of @acronym{PTY}s is limited on many systems and
641it is good not to waste them.
642
643The value of @code{process-connection-type} takes effect when
644@code{start-process} is called. So you can specify how to communicate
645with one subprocess by binding the variable around the call to
646@code{start-process}.
647
648@smallexample
649@group
650(let ((process-connection-type nil)) ; @r{Use a pipe.}
651 (start-process @dots{}))
652@end group
653@end smallexample
654
655To determine whether a given subprocess actually got a pipe or a
656@acronym{PTY}, use the function @code{process-tty-name} (@pxref{Process
657Information}).
658@end defvar
659
660@node Deleting Processes
661@section Deleting Processes
662@cindex deleting processes
663
664 @dfn{Deleting a process} disconnects Emacs immediately from the
665subprocess. Processes are deleted automatically after they terminate,
666but not necessarily right away. You can delete a process explicitly
667at any time. If you delete a terminated process explicitly before it
668is deleted automatically, no harm results. Deleting a running
669process sends a signal to terminate it (and its child processes if
670any), and calls the process sentinel if it has one. @xref{Sentinels}.
671
672 When a process is deleted, the process object itself continues to
673exist as long as other Lisp objects point to it. All the Lisp
674primitives that work on process objects accept deleted processes, but
675those that do I/O or send signals will report an error. The process
676mark continues to point to the same place as before, usually into a
677buffer where output from the process was being inserted.
678
679@defopt delete-exited-processes
680This variable controls automatic deletion of processes that have
681terminated (due to calling @code{exit} or to a signal). If it is
682@code{nil}, then they continue to exist until the user runs
683@code{list-processes}. Otherwise, they are deleted immediately after
684they exit.
685@end defopt
686
687@defun delete-process process
688This function deletes a process, killing it with a @code{SIGKILL}
689signal. The argument may be a process, the name of a process, a
690buffer, or the name of a buffer. (A buffer or buffer-name stands for
691the process that @code{get-buffer-process} returns.) Calling
692@code{delete-process} on a running process terminates it, updates the
693process status, and runs the sentinel (if any) immediately. If the
694process has already terminated, calling @code{delete-process} has no
695effect on its status, or on the running of its sentinel (which will
696happen sooner or later).
697
698@smallexample
699@group
700(delete-process "*shell*")
701 @result{} nil
702@end group
703@end smallexample
704@end defun
705
706@node Process Information
707@section Process Information
708
709 Several functions return information about processes.
710@code{list-processes} is provided for interactive use.
711
712@deffn Command list-processes &optional query-only
713This command displays a listing of all living processes. In addition,
714it finally deletes any process whose status was @samp{Exited} or
715@samp{Signaled}. It returns @code{nil}.
716
2bb0eca1 717The processes are shown in a buffer named @file{*Process List*}, whose
82233bea
CY
718major mode is named Process Menu mode.
719
b8d4c8d0
GM
720If @var{query-only} is non-@code{nil} then it lists only processes
721whose query flag is non-@code{nil}. @xref{Query Before Exit}.
722@end deffn
723
724@defun process-list
725This function returns a list of all processes that have not been deleted.
726
727@smallexample
728@group
729(process-list)
730 @result{} (#<process display-time> #<process shell>)
731@end group
732@end smallexample
733@end defun
734
735@defun get-process name
736This function returns the process named @var{name}, or @code{nil} if
737there is none. An error is signaled if @var{name} is not a string.
738
739@smallexample
740@group
741(get-process "shell")
742 @result{} #<process shell>
743@end group
744@end smallexample
745@end defun
746
747@defun process-command process
748This function returns the command that was executed to start
749@var{process}. This is a list of strings, the first string being the
750program executed and the rest of the strings being the arguments that
751were given to the program.
752
753@smallexample
754@group
755(process-command (get-process "shell"))
756 @result{} ("/bin/csh" "-i")
757@end group
758@end smallexample
759@end defun
760
c73e02fa
GM
761@defun process-contact process &optional key
762
763This function returns information about how a network or serial
764process was set up. For a network process, when @var{key} is
765@code{nil}, it returns @code{(@var{hostname} @var{service})} which
766specifies what you connected to. For a serial process, when @var{key}
767is @code{nil}, it returns @code{(@var{port} @var{speed})}. For an
768ordinary child process, this function always returns @code{t}.
769
770If @var{key} is @code{t}, the value is the complete status information
771for the connection, server, or serial port; that is, the list of
772keywords and values specified in @code{make-network-process} or
773@code{make-serial-process}, except that some of the values represent
774the current status instead of what you specified.
775
776For a network process:
777
778@table @code
779@item :buffer
780The associated value is the process buffer.
781@item :filter
782The associated value is the process filter function.
783@item :sentinel
784The associated value is the process sentinel function.
785@item :remote
786In a connection, the address in internal format of the remote peer.
787@item :local
788The local address, in internal format.
789@item :service
790In a server, if you specified @code{t} for @var{service},
791this value is the actual port number.
792@end table
793
794@code{:local} and @code{:remote} are included even if they were not
795specified explicitly in @code{make-network-process}.
796
797For a serial process, see @code{make-serial-process} and
798@code{serial-process-configure} for a list of keys.
799
800If @var{key} is a keyword, the function returns the value corresponding
801to that keyword.
802@end defun
803
b8d4c8d0
GM
804@defun process-id process
805This function returns the @acronym{PID} of @var{process}. This is an
806integer that distinguishes the process @var{process} from all other
807processes running on the same computer at the current time. The
808@acronym{PID} of a process is chosen by the operating system kernel when the
809process is started and remains constant as long as the process exists.
810@end defun
811
812@defun process-name process
813This function returns the name of @var{process}.
814@end defun
815
816@defun process-status process-name
817This function returns the status of @var{process-name} as a symbol.
170ddd97
CY
818The argument @var{process-name} must be a process, a buffer, or a
819process name (a string).
b8d4c8d0
GM
820
821The possible values for an actual subprocess are:
822
823@table @code
824@item run
825for a process that is running.
826@item stop
827for a process that is stopped but continuable.
828@item exit
829for a process that has exited.
830@item signal
831for a process that has received a fatal signal.
832@item open
833for a network connection that is open.
834@item closed
835for a network connection that is closed. Once a connection
836is closed, you cannot reopen it, though you might be able to open
837a new connection to the same place.
838@item connect
839for a non-blocking connection that is waiting to complete.
840@item failed
841for a non-blocking connection that has failed to complete.
842@item listen
843for a network server that is listening.
844@item nil
845if @var{process-name} is not the name of an existing process.
846@end table
847
848@smallexample
849@group
b8d4c8d0
GM
850(process-status (get-buffer "*shell*"))
851 @result{} run
852@end group
853@group
854x
855 @result{} #<process xx<1>>
856(process-status x)
857 @result{} exit
858@end group
859@end smallexample
860
861For a network connection, @code{process-status} returns one of the symbols
862@code{open} or @code{closed}. The latter means that the other side
863closed the connection, or Emacs did @code{delete-process}.
864@end defun
865
b96e6cde 866@defun process-live-p process
bcd54f83
LMI
867This function returns nin-@code{nil} if @var{process} is alive. A
868process is considered alive if its status is @code{run}, @code{open},
869@code{listen}, @code{connect} or @code{stop}.
870@end defun
871
c73e02fa
GM
872@defun process-type process
873This function returns the symbol @code{network} for a network
874connection or server, @code{serial} for a serial port connection, or
875@code{real} for a real subprocess.
876@end defun
877
b8d4c8d0
GM
878@defun process-exit-status process
879This function returns the exit status of @var{process} or the signal
880number that killed it. (Use the result of @code{process-status} to
881determine which of those it is.) If @var{process} has not yet
882terminated, the value is 0.
883@end defun
884
885@defun process-tty-name process
886This function returns the terminal name that @var{process} is using for
887its communication with Emacs---or @code{nil} if it is using pipes
888instead of a terminal (see @code{process-connection-type} in
bace45fe
MA
889@ref{Asynchronous Processes}). If @var{process} represents a program
890running on a remote host, the terminal name used by that program on
891the remote host is provided as process property @code{remote-tty}.
b8d4c8d0
GM
892@end defun
893
894@defun process-coding-system process
895@anchor{Coding systems for a subprocess}
896This function returns a cons cell describing the coding systems in use
897for decoding output from @var{process} and for encoding input to
898@var{process} (@pxref{Coding Systems}). The value has this form:
899
900@example
901(@var{coding-system-for-decoding} . @var{coding-system-for-encoding})
902@end example
903@end defun
904
905@defun set-process-coding-system process &optional decoding-system encoding-system
906This function specifies the coding systems to use for subsequent output
907from and input to @var{process}. It will use @var{decoding-system} to
908decode subprocess output, and @var{encoding-system} to encode subprocess
909input.
910@end defun
911
912 Every process also has a property list that you can use to store
913miscellaneous values associated with the process.
914
915@defun process-get process propname
916This function returns the value of the @var{propname} property
917of @var{process}.
918@end defun
919
920@defun process-put process propname value
921This function sets the value of the @var{propname} property
922of @var{process} to @var{value}.
923@end defun
924
925@defun process-plist process
926This function returns the process plist of @var{process}.
927@end defun
928
929@defun set-process-plist process plist
930This function sets the process plist of @var{process} to @var{plist}.
931@end defun
932
933@node Input to Processes
934@section Sending Input to Processes
935@cindex process input
936
937 Asynchronous subprocesses receive input when it is sent to them by
938Emacs, which is done with the functions in this section. You must
939specify the process to send input to, and the input data to send. The
940data appears on the ``standard input'' of the subprocess.
941
942 Some operating systems have limited space for buffered input in a
943@acronym{PTY}. On these systems, Emacs sends an @acronym{EOF}
944periodically amidst the other characters, to force them through. For
945most programs, these @acronym{EOF}s do no harm.
946
947 Subprocess input is normally encoded using a coding system before the
948subprocess receives it, much like text written into a file. You can use
949@code{set-process-coding-system} to specify which coding system to use
950(@pxref{Process Information}). Otherwise, the coding system comes from
951@code{coding-system-for-write}, if that is non-@code{nil}; or else from
952the defaulting mechanism (@pxref{Default Coding Systems}).
953
954 Sometimes the system is unable to accept input for that process,
955because the input buffer is full. When this happens, the send functions
956wait a short while, accepting output from subprocesses, and then try
957again. This gives the subprocess a chance to read more of its pending
958input and make space in the buffer. It also allows filters, sentinels
959and timers to run---so take account of that in writing your code.
960
961 In these functions, the @var{process} argument can be a process or
962the name of a process, or a buffer or buffer name (which stands
963for a process via @code{get-buffer-process}). @code{nil} means
964the current buffer's process.
965
966@defun process-send-string process string
967This function sends @var{process} the contents of @var{string} as
968standard input. If it is @code{nil}, the current buffer's process is used.
969
970 The function returns @code{nil}.
971
972@smallexample
973@group
974(process-send-string "shell<1>" "ls\n")
975 @result{} nil
976@end group
977
978
979@group
980---------- Buffer: *shell* ----------
981...
982introduction.texi syntax-tables.texi~
983introduction.texi~ text.texi
984introduction.txt text.texi~
985...
986---------- Buffer: *shell* ----------
987@end group
988@end smallexample
989@end defun
990
991@defun process-send-region process start end
992This function sends the text in the region defined by @var{start} and
993@var{end} as standard input to @var{process}.
994
995An error is signaled unless both @var{start} and @var{end} are
996integers or markers that indicate positions in the current buffer. (It
997is unimportant which number is larger.)
998@end defun
999
1000@defun process-send-eof &optional process
1001This function makes @var{process} see an end-of-file in its
1002input. The @acronym{EOF} comes after any text already sent to it.
1003
1004The function returns @var{process}.
1005
1006@smallexample
1007@group
1008(process-send-eof "shell")
1009 @result{} "shell"
1010@end group
1011@end smallexample
1012@end defun
1013
106e6894
CY
1014@defun process-running-child-p &optional process
1015This function will tell you whether a @var{process} has given control of
b8d4c8d0
GM
1016its terminal to its own child process. The value is @code{t} if this is
1017true, or if Emacs cannot tell; it is @code{nil} if Emacs can be certain
1018that this is not so.
1019@end defun
1020
1021@node Signals to Processes
1022@section Sending Signals to Processes
1023@cindex process signals
1024@cindex sending signals
1025@cindex signals
1026
1027 @dfn{Sending a signal} to a subprocess is a way of interrupting its
1028activities. There are several different signals, each with its own
1029meaning. The set of signals and their names is defined by the operating
1030system. For example, the signal @code{SIGINT} means that the user has
1031typed @kbd{C-c}, or that some analogous thing has happened.
1032
1033 Each signal has a standard effect on the subprocess. Most signals
1034kill the subprocess, but some stop or resume execution instead. Most
1035signals can optionally be handled by programs; if the program handles
1036the signal, then we can say nothing in general about its effects.
1037
1038 You can send signals explicitly by calling the functions in this
1039section. Emacs also sends signals automatically at certain times:
1040killing a buffer sends a @code{SIGHUP} signal to all its associated
1041processes; killing Emacs sends a @code{SIGHUP} signal to all remaining
1042processes. (@code{SIGHUP} is a signal that usually indicates that the
1043user hung up the phone.)
1044
1045 Each of the signal-sending functions takes two optional arguments:
1046@var{process} and @var{current-group}.
1047
1048 The argument @var{process} must be either a process, a process
1049name, a buffer, a buffer name, or @code{nil}. A buffer or buffer name
1050stands for a process through @code{get-buffer-process}. @code{nil}
1051stands for the process associated with the current buffer. An error
1052is signaled if @var{process} does not identify a process.
1053
1054 The argument @var{current-group} is a flag that makes a difference
1055when you are running a job-control shell as an Emacs subprocess. If it
1056is non-@code{nil}, then the signal is sent to the current process-group
1057of the terminal that Emacs uses to communicate with the subprocess. If
1058the process is a job-control shell, this means the shell's current
1059subjob. If it is @code{nil}, the signal is sent to the process group of
1060the immediate subprocess of Emacs. If the subprocess is a job-control
1061shell, this is the shell itself.
1062
1063 The flag @var{current-group} has no effect when a pipe is used to
1064communicate with the subprocess, because the operating system does not
1065support the distinction in the case of pipes. For the same reason,
1066job-control shells won't work when a pipe is used. See
1067@code{process-connection-type} in @ref{Asynchronous Processes}.
1068
1069@defun interrupt-process &optional process current-group
1070This function interrupts the process @var{process} by sending the
1071signal @code{SIGINT}. Outside of Emacs, typing the ``interrupt
1072character'' (normally @kbd{C-c} on some systems, and @code{DEL} on
1073others) sends this signal. When the argument @var{current-group} is
1074non-@code{nil}, you can think of this function as ``typing @kbd{C-c}''
1075on the terminal by which Emacs talks to the subprocess.
1076@end defun
1077
1078@defun kill-process &optional process current-group
1079This function kills the process @var{process} by sending the
1080signal @code{SIGKILL}. This signal kills the subprocess immediately,
1081and cannot be handled by the subprocess.
1082@end defun
1083
1084@defun quit-process &optional process current-group
1085This function sends the signal @code{SIGQUIT} to the process
1086@var{process}. This signal is the one sent by the ``quit
1087character'' (usually @kbd{C-b} or @kbd{C-\}) when you are not inside
1088Emacs.
1089@end defun
1090
1091@defun stop-process &optional process current-group
1092This function stops the process @var{process} by sending the
1093signal @code{SIGTSTP}. Use @code{continue-process} to resume its
1094execution.
1095
1096Outside of Emacs, on systems with job control, the ``stop character''
1097(usually @kbd{C-z}) normally sends this signal. When
1098@var{current-group} is non-@code{nil}, you can think of this function as
1099``typing @kbd{C-z}'' on the terminal Emacs uses to communicate with the
1100subprocess.
1101@end defun
1102
1103@defun continue-process &optional process current-group
1104This function resumes execution of the process @var{process} by sending
1105it the signal @code{SIGCONT}. This presumes that @var{process} was
1106stopped previously.
1107@end defun
1108
b8d4c8d0
GM
1109@defun signal-process process signal
1110This function sends a signal to process @var{process}. The argument
1111@var{signal} specifies which signal to send; it should be an integer.
1112
1113The @var{process} argument can be a system process @acronym{ID}; that
1114allows you to send signals to processes that are not children of
23dd4ecd 1115Emacs. @xref{System Processes}.
b8d4c8d0
GM
1116@end defun
1117
1118@node Output from Processes
1119@section Receiving Output from Processes
1120@cindex process output
1121@cindex output from processes
1122
1123 There are two ways to receive the output that a subprocess writes to
1124its standard output stream. The output can be inserted in a buffer,
1125which is called the associated buffer of the process, or a function
1126called the @dfn{filter function} can be called to act on the output. If
1127the process has no buffer and no filter function, its output is
1128discarded.
1129
1130 When a subprocess terminates, Emacs reads any pending output,
1131then stops reading output from that subprocess. Therefore, if the
1132subprocess has children that are still live and still producing
1133output, Emacs won't receive that output.
1134
1135 Output from a subprocess can arrive only while Emacs is waiting: when
1136reading terminal input, in @code{sit-for} and @code{sleep-for}
1137(@pxref{Waiting}), and in @code{accept-process-output} (@pxref{Accepting
1138Output}). This minimizes the problem of timing errors that usually
1139plague parallel programming. For example, you can safely create a
1140process and only then specify its buffer or filter function; no output
1141can arrive before you finish, if the code in between does not call any
1142primitive that waits.
1143
1144@defvar process-adaptive-read-buffering
1145On some systems, when Emacs reads the output from a subprocess, the
1146output data is read in very small blocks, potentially resulting in
1147very poor performance. This behavior can be remedied to some extent
1148by setting the variable @var{process-adaptive-read-buffering} to a
1149non-@code{nil} value (the default), as it will automatically delay reading
1150from such processes, thus allowing them to produce more output before
1151Emacs tries to read it.
1152@end defvar
1153
1154 It is impossible to separate the standard output and standard error
1155streams of the subprocess, because Emacs normally spawns the subprocess
1156inside a pseudo-TTY, and a pseudo-TTY has only one output channel. If
1157you want to keep the output to those streams separate, you should
1158redirect one of them to a file---for example, by using an appropriate
1159shell command.
1160
1161@menu
1162* Process Buffers:: If no filter, output is put in a buffer.
1163* Filter Functions:: Filter functions accept output from the process.
1164* Decoding Output:: Filters can get unibyte or multibyte strings.
1165* Accepting Output:: How to wait until process output arrives.
1166@end menu
1167
1168@node Process Buffers
1169@subsection Process Buffers
1170
1171 A process can (and usually does) have an @dfn{associated buffer},
1172which is an ordinary Emacs buffer that is used for two purposes: storing
1173the output from the process, and deciding when to kill the process. You
1174can also use the buffer to identify a process to operate on, since in
1175normal practice only one process is associated with any given buffer.
1176Many applications of processes also use the buffer for editing input to
1177be sent to the process, but this is not built into Emacs Lisp.
1178
1179 Unless the process has a filter function (@pxref{Filter Functions}),
1180its output is inserted in the associated buffer. The position to insert
1181the output is determined by the @code{process-mark}, which is then
1182updated to point to the end of the text just inserted. Usually, but not
1183always, the @code{process-mark} is at the end of the buffer.
1184
16d1ff5f
CY
1185@findex process-kill-buffer-query-function
1186 Killing the associated buffer of a process also kills the process.
1187Emacs asks for confirmation first, if the process's
1188@code{process-query-on-exit-flag} is non-@code{nil} (@pxref{Query
1189Before Exit}). This confirmation is done by the function
1190@code{process-kill-buffer-query-function}, which is run from
1191@code{kill-buffer-query-functions} (@pxref{Killing Buffers}).
1192
b8d4c8d0
GM
1193@defun process-buffer process
1194This function returns the associated buffer of the process
1195@var{process}.
1196
1197@smallexample
1198@group
1199(process-buffer (get-process "shell"))
1200 @result{} #<buffer *shell*>
1201@end group
1202@end smallexample
1203@end defun
1204
1205@defun process-mark process
1206This function returns the process marker for @var{process}, which is the
1207marker that says where to insert output from the process.
1208
1209If @var{process} does not have a buffer, @code{process-mark} returns a
1210marker that points nowhere.
1211
1212Insertion of process output in a buffer uses this marker to decide where
1213to insert, and updates it to point after the inserted text. That is why
1214successive batches of output are inserted consecutively.
1215
1216Filter functions normally should use this marker in the same fashion
1217as is done by direct insertion of output in the buffer. A good
1218example of a filter function that uses @code{process-mark} is found at
1219the end of the following section.
1220
1221When the user is expected to enter input in the process buffer for
1222transmission to the process, the process marker separates the new input
1223from previous output.
1224@end defun
1225
1226@defun set-process-buffer process buffer
1227This function sets the buffer associated with @var{process} to
1228@var{buffer}. If @var{buffer} is @code{nil}, the process becomes
1229associated with no buffer.
1230@end defun
1231
1232@defun get-buffer-process buffer-or-name
1233This function returns a nondeleted process associated with the buffer
1234specified by @var{buffer-or-name}. If there are several processes
1235associated with it, this function chooses one (currently, the one most
1236recently created, but don't count on that). Deletion of a process
1237(see @code{delete-process}) makes it ineligible for this function to
1238return.
1239
1240It is usually a bad idea to have more than one process associated with
1241the same buffer.
1242
1243@smallexample
1244@group
1245(get-buffer-process "*shell*")
1246 @result{} #<process shell>
1247@end group
1248@end smallexample
1249
1250Killing the process's buffer deletes the process, which kills the
1251subprocess with a @code{SIGHUP} signal (@pxref{Signals to Processes}).
1252@end defun
1253
1254@node Filter Functions
1255@subsection Process Filter Functions
1256@cindex filter function
1257@cindex process filter
1258
1259 A process @dfn{filter function} is a function that receives the
1260standard output from the associated process. If a process has a filter,
1261then @emph{all} output from that process is passed to the filter. The
1262process buffer is used directly for output from the process only when
1263there is no filter.
1264
1265 The filter function can only be called when Emacs is waiting for
1266something, because process output arrives only at such times. Emacs
1267waits when reading terminal input, in @code{sit-for} and
1268@code{sleep-for} (@pxref{Waiting}), and in @code{accept-process-output}
1269(@pxref{Accepting Output}).
1270
1271 A filter function must accept two arguments: the associated process
1272and a string, which is output just received from it. The function is
1273then free to do whatever it chooses with the output.
1274
1275 Quitting is normally inhibited within a filter function---otherwise,
1276the effect of typing @kbd{C-g} at command level or to quit a user
1277command would be unpredictable. If you want to permit quitting inside
1278a filter function, bind @code{inhibit-quit} to @code{nil}. In most
1279cases, the right way to do this is with the macro
1280@code{with-local-quit}. @xref{Quitting}.
1281
1282 If an error happens during execution of a filter function, it is
1283caught automatically, so that it doesn't stop the execution of whatever
1284program was running when the filter function was started. However, if
1285@code{debug-on-error} is non-@code{nil}, the error-catching is turned
1286off. This makes it possible to use the Lisp debugger to debug the
1287filter function. @xref{Debugger}.
1288
1289 Many filter functions sometimes or always insert the text in the
1290process's buffer, mimicking the actions of Emacs when there is no
1291filter. Such filter functions need to use @code{set-buffer} in order to
1292be sure to insert in that buffer. To avoid setting the current buffer
1293semipermanently, these filter functions must save and restore the
78e33835
CY
1294current buffer. They should also check whether the buffer is still
1295alive, update the process marker, and in some cases update the value
1296of point. Here is how to do these things:
b8d4c8d0
GM
1297
1298@smallexample
1299@group
1300(defun ordinary-insertion-filter (proc string)
78e33835
CY
1301 (when (buffer-live-p (process-buffer proc))
1302 (with-current-buffer (process-buffer proc)
1303 (let ((moving (= (point) (process-mark proc))))
b8d4c8d0
GM
1304@end group
1305@group
78e33835 1306 (save-excursion
1e5c1c80 1307 ;; @r{Insert the text, advancing the process marker.}
78e33835
CY
1308 (goto-char (process-mark proc))
1309 (insert string)
1310 (set-marker (process-mark proc) (point)))
1311 (if moving (goto-char (process-mark proc)))))))
b8d4c8d0
GM
1312@end group
1313@end smallexample
1314
1315@noindent
1316The reason to use @code{with-current-buffer}, rather than using
1317@code{save-excursion} to save and restore the current buffer, is so as
1318to preserve the change in point made by the second call to
1319@code{goto-char}.
1320
1321 To make the filter force the process buffer to be visible whenever new
1322text arrives, insert the following line just before the
1323@code{with-current-buffer} construct:
1324
1325@smallexample
1326(display-buffer (process-buffer proc))
1327@end smallexample
1328
1329 To force point to the end of the new output, no matter where it was
1330previously, eliminate the variable @code{moving} and call
1331@code{goto-char} unconditionally.
1332
1333 In earlier Emacs versions, every filter function that did regular
1334expression searching or matching had to explicitly save and restore the
1335match data. Now Emacs does this automatically for filter functions;
1336they never need to do it explicitly. @xref{Match Data}.
1337
b8d4c8d0
GM
1338 The output to the function may come in chunks of any size. A program
1339that produces the same output twice in a row may send it as one batch of
1340200 characters one time, and five batches of 40 characters the next. If
1341the filter looks for certain text strings in the subprocess output, make
1342sure to handle the case where one of these strings is split across two
fd211f0b
CY
1343or more batches of output; one way to do this is to insert the
1344received text into a temporary buffer, which can then be searched.
b8d4c8d0
GM
1345
1346@defun set-process-filter process filter
1347This function gives @var{process} the filter function @var{filter}. If
1348@var{filter} is @code{nil}, it gives the process no filter.
1349@end defun
1350
1351@defun process-filter process
1352This function returns the filter function of @var{process}, or @code{nil}
1353if it has none.
1354@end defun
1355
1356 Here is an example of use of a filter function:
1357
1358@smallexample
1359@group
1360(defun keep-output (process output)
1361 (setq kept (cons output kept)))
1362 @result{} keep-output
1363@end group
1364@group
1365(setq kept nil)
1366 @result{} nil
1367@end group
1368@group
1369(set-process-filter (get-process "shell") 'keep-output)
1370 @result{} keep-output
1371@end group
1372@group
1373(process-send-string "shell" "ls ~/other\n")
1374 @result{} nil
1375kept
1376 @result{} ("lewis@@slug[8] % "
1377@end group
1378@group
1379"FINAL-W87-SHORT.MSS backup.otl kolstad.mss~
1380address.txt backup.psf kolstad.psf
1381backup.bib~ david.mss resume-Dec-86.mss~
1382backup.err david.psf resume-Dec.psf
1383backup.mss dland syllabus.mss
1384"
1385"#backups.mss# backup.mss~ kolstad.mss
1386")
1387@end group
1388@end smallexample
1389
1390@ignore @c The code in this example doesn't show the right way to do things.
1391Here is another, more realistic example, which demonstrates how to use
1392the process mark to do insertion in the same fashion as is done when
1393there is no filter function:
1394
1395@smallexample
1396@group
1397;; @r{Insert input in the buffer specified by @code{my-shell-buffer}}
1398;; @r{and make sure that buffer is shown in some window.}
1399(defun my-process-filter (proc str)
1400 (let ((cur (selected-window))
1401 (pop-up-windows t))
1402 (pop-to-buffer my-shell-buffer)
1403@end group
1404@group
1405 (goto-char (point-max))
1406 (insert str)
1407 (set-marker (process-mark proc) (point-max))
1408 (select-window cur)))
1409@end group
1410@end smallexample
1411@end ignore
1412
1413@node Decoding Output
1414@subsection Decoding Process Output
1415@cindex decode process output
1416
1417 When Emacs writes process output directly into a multibyte buffer,
1418it decodes the output according to the process output coding system.
1419If the coding system is @code{raw-text} or @code{no-conversion}, Emacs
1420converts the unibyte output to multibyte using
1421@code{string-to-multibyte}, and inserts the resulting multibyte text.
1422
1423 You can use @code{set-process-coding-system} to specify which coding
1424system to use (@pxref{Process Information}). Otherwise, the coding
1425system comes from @code{coding-system-for-read}, if that is
1426non-@code{nil}; or else from the defaulting mechanism (@pxref{Default
3355f04d
EZ
1427Coding Systems}). If the text output by a process contains null
1428bytes, Emacs by default uses @code{no-conversion} for it; see
1429@ref{Lisp and Coding Systems, inhibit-null-byte-detection}, for how to
1430control this behavior.
b8d4c8d0
GM
1431
1432 @strong{Warning:} Coding systems such as @code{undecided} which
1433determine the coding system from the data do not work entirely
1434reliably with asynchronous subprocess output. This is because Emacs
1435has to process asynchronous subprocess output in batches, as it
1436arrives. Emacs must try to detect the proper coding system from one
1437batch at a time, and this does not always work. Therefore, if at all
1438possible, specify a coding system that determines both the character
1439code conversion and the end of line conversion---that is, one like
1440@code{latin-1-unix}, rather than @code{undecided} or @code{latin-1}.
1441
4972c361
SM
1442@c Let's keep the index entries that were there for
1443@c set-process-filter-multibyte and process-filter-multibyte-p,
b8d4c8d0
GM
1444@cindex filter multibyte flag, of process
1445@cindex process filter multibyte flag
1446 When Emacs calls a process filter function, it provides the process
1447output as a multibyte string or as a unibyte string according to the
4972c361
SM
1448process's filter coding system. Emacs
1449decodes the output according to the process output coding system,
1450which usually produces a multibyte string, except for coding systems
1451such as @code{binary} and @code{raw-text}
b8d4c8d0
GM
1452
1453@node Accepting Output
1454@subsection Accepting Output from Processes
1455@cindex accept input from processes
1456
1457 Output from asynchronous subprocesses normally arrives only while
1458Emacs is waiting for some sort of external event, such as elapsed time
1459or terminal input. Occasionally it is useful in a Lisp program to
1460explicitly permit output to arrive at a specific point, or even to wait
1461until output arrives from a process.
1462
1463@defun accept-process-output &optional process seconds millisec just-this-one
1464This function allows Emacs to read pending output from processes. The
1465output is inserted in the associated buffers or given to their filter
1466functions. If @var{process} is non-@code{nil} then this function does
1467not return until some output has been received from @var{process}.
1468
1469@c Emacs 19 feature
1470The arguments @var{seconds} and @var{millisec} let you specify timeout
1471periods. The former specifies a period measured in seconds and the
1472latter specifies one measured in milliseconds. The two time periods
1473thus specified are added together, and @code{accept-process-output}
1474returns after that much time, whether or not there has been any
1475subprocess output.
1476
1477The argument @var{millisec} is semi-obsolete nowadays because
1478@var{seconds} can be a floating point number to specify waiting a
1479fractional number of seconds. If @var{seconds} is 0, the function
1480accepts whatever output is pending but does not wait.
1481
1482@c Emacs 22.1 feature
1483If @var{process} is a process, and the argument @var{just-this-one} is
1484non-@code{nil}, only output from that process is handled, suspending output
1485from other processes until some output has been received from that
1486process or the timeout expires. If @var{just-this-one} is an integer,
1487also inhibit running timers. This feature is generally not
1488recommended, but may be necessary for specific applications, such as
1489speech synthesis.
1490
1491The function @code{accept-process-output} returns non-@code{nil} if it
1492did get some output, or @code{nil} if the timeout expired before output
1493arrived.
1494@end defun
1495
1496@node Sentinels
1497@section Sentinels: Detecting Process Status Changes
1498@cindex process sentinel
1499@cindex sentinel (of process)
1500
1501 A @dfn{process sentinel} is a function that is called whenever the
1502associated process changes status for any reason, including signals
1503(whether sent by Emacs or caused by the process's own actions) that
1504terminate, stop, or continue the process. The process sentinel is
1505also called if the process exits. The sentinel receives two
1506arguments: the process for which the event occurred, and a string
1507describing the type of event.
1508
1509 The string describing the event looks like one of the following:
1510
1511@itemize @bullet
1512@item
1513@code{"finished\n"}.
1514
1515@item
1516@code{"exited abnormally with code @var{exitcode}\n"}.
1517
1518@item
1519@code{"@var{name-of-signal}\n"}.
1520
1521@item
1522@code{"@var{name-of-signal} (core dumped)\n"}.
1523@end itemize
1524
1525 A sentinel runs only while Emacs is waiting (e.g., for terminal
1526input, or for time to elapse, or for process output). This avoids the
1527timing errors that could result from running them at random places in
1528the middle of other Lisp programs. A program can wait, so that
1529sentinels will run, by calling @code{sit-for} or @code{sleep-for}
1530(@pxref{Waiting}), or @code{accept-process-output} (@pxref{Accepting
1531Output}). Emacs also allows sentinels to run when the command loop is
1532reading input. @code{delete-process} calls the sentinel when it
1533terminates a running process.
1534
1535 Emacs does not keep a queue of multiple reasons to call the sentinel
1536of one process; it records just the current status and the fact that
1537there has been a change. Therefore two changes in status, coming in
1538quick succession, can call the sentinel just once. However, process
1539termination will always run the sentinel exactly once. This is
1540because the process status can't change again after termination.
1541
1542 Emacs explicitly checks for output from the process before running
1543the process sentinel. Once the sentinel runs due to process
1544termination, no further output can arrive from the process.
1545
1546 A sentinel that writes the output into the buffer of the process
1547should check whether the buffer is still alive. If it tries to insert
1548into a dead buffer, it will get an error. If the buffer is dead,
1549@code{(buffer-name (process-buffer @var{process}))} returns @code{nil}.
1550
1551 Quitting is normally inhibited within a sentinel---otherwise, the
1552effect of typing @kbd{C-g} at command level or to quit a user command
1553would be unpredictable. If you want to permit quitting inside a
1554sentinel, bind @code{inhibit-quit} to @code{nil}. In most cases, the
1555right way to do this is with the macro @code{with-local-quit}.
1556@xref{Quitting}.
1557
1558 If an error happens during execution of a sentinel, it is caught
1559automatically, so that it doesn't stop the execution of whatever
1560programs was running when the sentinel was started. However, if
1561@code{debug-on-error} is non-@code{nil}, the error-catching is turned
1562off. This makes it possible to use the Lisp debugger to debug the
1563sentinel. @xref{Debugger}.
1564
1565 While a sentinel is running, the process sentinel is temporarily
1566set to @code{nil} so that the sentinel won't run recursively.
1567For this reason it is not possible for a sentinel to specify
1568a new sentinel.
1569
1570 In earlier Emacs versions, every sentinel that did regular expression
1571searching or matching had to explicitly save and restore the match data.
1572Now Emacs does this automatically for sentinels; they never need to do
1573it explicitly. @xref{Match Data}.
1574
1575@defun set-process-sentinel process sentinel
1576This function associates @var{sentinel} with @var{process}. If
1577@var{sentinel} is @code{nil}, then the process will have no sentinel.
1578The default behavior when there is no sentinel is to insert a message in
1579the process's buffer when the process status changes.
1580
1581Changes in process sentinel take effect immediately---if the sentinel
1582is slated to be run but has not been called yet, and you specify a new
1583sentinel, the eventual call to the sentinel will use the new one.
1584
1585@smallexample
1586@group
1587(defun msg-me (process event)
1588 (princ
1589 (format "Process: %s had the event `%s'" process event)))
1590(set-process-sentinel (get-process "shell") 'msg-me)
1591 @result{} msg-me
1592@end group
1593@group
1594(kill-process (get-process "shell"))
1595 @print{} Process: #<process shell> had the event `killed'
1596 @result{} #<process shell>
1597@end group
1598@end smallexample
1599@end defun
1600
1601@defun process-sentinel process
1602This function returns the sentinel of @var{process}, or @code{nil} if it
1603has none.
1604@end defun
1605
1606@defun waiting-for-user-input-p
1607While a sentinel or filter function is running, this function returns
1608non-@code{nil} if Emacs was waiting for keyboard input from the user at
1609the time the sentinel or filter function was called, @code{nil} if it
1610was not.
1611@end defun
1612
1613@node Query Before Exit
1614@section Querying Before Exit
1615
1616 When Emacs exits, it terminates all its subprocesses by sending them
1617the @code{SIGHUP} signal. Because subprocesses may be doing
1618valuable work, Emacs normally asks the user to confirm that it is ok
1619to terminate them. Each process has a query flag which, if
1620non-@code{nil}, says that Emacs should ask for confirmation before
1621exiting and thus killing that process. The default for the query flag
1622is @code{t}, meaning @emph{do} query.
1623
1624@defun process-query-on-exit-flag process
1625This returns the query flag of @var{process}.
1626@end defun
1627
1628@defun set-process-query-on-exit-flag process flag
1629This function sets the query flag of @var{process} to @var{flag}. It
1630returns @var{flag}.
1631
9fe9631c
CY
1632Here is an example of using @code{set-process-query-on-exit-flag} on a
1633shell process to avoid querying:
1634
b8d4c8d0
GM
1635@smallexample
1636@group
b8d4c8d0
GM
1637(set-process-query-on-exit-flag (get-process "shell") nil)
1638 @result{} t
1639@end group
1640@end smallexample
1641@end defun
1642
23dd4ecd
EZ
1643@node System Processes
1644@section Accessing Other Processes
1645@cindex system processes
1646
1647 In addition to accessing and manipulating processes that are
1648subprocesses of the current Emacs session, Emacs Lisp programs can
1649also access other processes running on the same machine. We call
1650these @dfn{system processes}, to distinguish between them and Emacs
1651subprocesses.
1652
1653 Emacs provides several primitives for accessing system processes.
1654Not all platforms support these primitives; on those which don't,
1655these primitives return @code{nil}.
1656
1657@defun list-system-processes
1658This function returns a list of all the processes running on the
1659system. Each process is identified by its @acronym{PID}, a numerical
1660process ID that is assigned by the OS and distinguishes the process
1661from all the other processes running on the same machine at the same
1662time.
1663@end defun
1664
a20878b6 1665@defun process-attributes pid
23dd4ecd
EZ
1666This function returns an alist of attributes for the process specified
1667by its process ID @var{pid}. Each association in the alist is of the
1668form @code{(@var{key} . @var{value})}, where @var{key} designates the
1669attribute and @var{value} is the value of that attribute. The various
1670attribute @var{key}'s that this function can return are listed below.
1671Not all platforms support all of these attributes; if an attribute is
1672not supported, its association will not appear in the returned alist.
1673Values that are numbers can be either integer or floating-point,
1674depending on the magnitude of the value.
1675
1676@table @code
1677@item euid
1678The effective user ID of the user who invoked the process. The
1679corresponding @var{value} is a number. If the process was invoked by
1680the same user who runs the current Emacs session, the value is
1681identical to what @code{user-uid} returns (@pxref{User
1682Identification}).
1683
1684@item user
1685User name corresponding to the process's effective user ID, a string.
1686
1687@item egid
1688The group ID of the effective user ID, a number.
1689
1690@item group
1691Group name corresponding to the effective user's group ID, a string.
1692
1693@item comm
1694The name of the command that runs in the process. This is a string
1695that usually specifies the name of the executable file of the process,
1696without the leading directories. However, some special system
1697processes can report strings that do not correspond to an executable
1698file of a program.
1699
1700@item state
1701The state code of the process. This is a short string that encodes
1702the scheduling state of the process. Here's a list of the most
1703frequently seen codes:
1704
1705@table @code
1dca458f 1706@item "D"
23dd4ecd 1707uninterruptible sleep (usually I/O)
1dca458f 1708@item "R"
23dd4ecd 1709running
1dca458f 1710@item "S"
23dd4ecd 1711interruptible sleep (waiting for some event)
1dca458f 1712@item "T"
23dd4ecd 1713stopped, e.g., by a job control signal
1dca458f
EZ
1714@item "Z"
1715``zombie'': a process that terminated, but was not reaped by its parent
23dd4ecd
EZ
1716@end table
1717
1718@noindent
1719For the full list of the possible states, see the manual page of the
1720@command{ps} command.
1721
1722@item ppid
1723The process ID of the parent process, a number.
1724
1725@item pgrp
1726The process group ID of the process, a number.
1727
1728@item sess
1729The session ID of the process. This is a number that is the process
1730ID of the process's @dfn{session leader}.
1731
1732@item ttname
1733A string that is the name of the process's controlling terminal. On
1734Unix and GNU systems, this is normally the file name of the
1735corresponding terminal device, such as @file{/dev/pts65}.
1736
1737@item tpgid
1738The numerical process group ID of the foreground process group that
1739uses the process's terminal.
1740
1741@item minflt
1742The number of minor page faults caused by the process since its
1743beginning. (Minor page faults are those that don't involve reading
1744from disk.)
1745
1746@item majflt
1747The number of major page faults caused by the process since its
1748beginning. (Major page faults require a disk to be read, and are thus
1749more expensive than minor page faults.)
1750
1751@item cminflt
1752@itemx cmajflt
1753Like @code{minflt} and @code{majflt}, but include the number of page
1754faults for all the child processes of the given process.
1755
1756@item utime
1757Time spent by the process in the user context, for running the
1758application's code. The corresponding @var{value} is in the
1759@w{@code{(@var{high} @var{low} @var{microsec})}} format, the same
1760format used by functions @code{current-time} (@pxref{Time of Day,
1761current-time}) and @code{file-attributes} (@pxref{File Attributes}).
1762
1763@item stime
1764Time spent by the process in the system (kernel) context, for
1765processing system calls. The corresponding @var{value} is in the same
1766format as for @code{utime}.
1767
af34ad36
EZ
1768@item time
1769The sum of @code{utime} and @code{stime}. The corresponding
1770@var{value} is in the same format as for @code{utime}.
1771
23dd4ecd
EZ
1772@item cutime
1773@itemx cstime
af34ad36
EZ
1774@itemx ctime
1775Like @code{utime}, @code{stime}, and @code{time}, but include the
1776times of all the child processes of the given process.
23dd4ecd
EZ
1777
1778@item pri
1779The numerical priority of the process.
1780
1781@item nice
1dca458f
EZ
1782The @dfn{nice value} of the process, a number. (Processes with smaller
1783nice values get scheduled more favorably.)
23dd4ecd
EZ
1784
1785@item thcount
1786The number of threads in the process.
1787
1788@item start
049bcbcb
CY
1789The time when the process was started, in the same
1790@w{@code{(@var{high} @var{low} @var{microsec})}} format used by
1791@code{current-time} and @code{file-attributes}.
23dd4ecd
EZ
1792
1793@item etime
1794The time elapsed since the process started, in the @w{@code{(@var{high}
1795@var{low} @var{microsec})}} format.
1796
1797@item vsize
1798The virtual memory size of the process, measured in kilobytes.
1799
1800@item rss
1801The size of the process's @dfn{resident set}, the number of kilobytes
1802occupied by the process in the machine's physical memory.
1803
1804@item pcpu
1805The percentage of the CPU time used by the process since it started.
1806The corresponding @var{value} is a floating-point number between 0 and
1807100.
1808
1809@item pmem
1810The percentage of the total physical memory installed on the machine
1811used by the process's resident set. The value is a floating-point
1812number between 0 and 100.
1813
1814@item args
1815The command-line with which the process was invoked. This is a string
1816in which individual command-line arguments are separated by blanks;
1817whitespace characters that are embedded in the arguments are quoted as
1818appropriate for the system's shell: escaped by backslash characters on
1819GNU and Unix, and enclosed in double quote characters on Windows.
1820Thus, this command-line string can be directly used in primitives such
1821as @code{shell-command}.
1822@end table
1823
1824@end defun
1825
1826
b8d4c8d0
GM
1827@node Transaction Queues
1828@section Transaction Queues
1829@cindex transaction queue
1830
1831You can use a @dfn{transaction queue} to communicate with a subprocess
1832using transactions. First use @code{tq-create} to create a transaction
1833queue communicating with a specified process. Then you can call
1834@code{tq-enqueue} to send a transaction.
1835
1836@defun tq-create process
1837This function creates and returns a transaction queue communicating with
1838@var{process}. The argument @var{process} should be a subprocess
1839capable of sending and receiving streams of bytes. It may be a child
1840process, or it may be a TCP connection to a server, possibly on another
1841machine.
1842@end defun
1843
1844@defun tq-enqueue queue question regexp closure fn &optional delay-question
1845This function sends a transaction to queue @var{queue}. Specifying the
1846queue has the effect of specifying the subprocess to talk to.
1847
1848The argument @var{question} is the outgoing message that starts the
1849transaction. The argument @var{fn} is the function to call when the
1850corresponding answer comes back; it is called with two arguments:
1851@var{closure}, and the answer received.
1852
1853The argument @var{regexp} is a regular expression that should match
1854text at the end of the entire answer, but nothing before; that's how
1855@code{tq-enqueue} determines where the answer ends.
1856
4185820c
CY
1857If the argument @var{delay-question} is non-@code{nil}, delay sending
1858this question until the process has finished replying to any previous
b8d4c8d0
GM
1859questions. This produces more reliable results with some processes.
1860
1861The return value of @code{tq-enqueue} itself is not meaningful.
1862@end defun
1863
1864@defun tq-close queue
1865Shut down transaction queue @var{queue}, waiting for all pending transactions
1866to complete, and then terminate the connection or child process.
1867@end defun
1868
1869Transaction queues are implemented by means of a filter function.
1870@xref{Filter Functions}.
1871
1872@node Network
1873@section Network Connections
1874@cindex network connection
1875@cindex TCP
1876@cindex UDP
1877
1878 Emacs Lisp programs can open stream (TCP) and datagram (UDP) network
1879connections to other processes on the same machine or other machines.
1880A network connection is handled by Lisp much like a subprocess, and is
1881represented by a process object. However, the process you are
1882communicating with is not a child of the Emacs process, so it has no
1883process @acronym{ID}, and you can't kill it or send it signals. All you
1884can do is send and receive data. @code{delete-process} closes the
1885connection, but does not kill the program at the other end; that
1886program must decide what to do about closure of the connection.
1887
1888 Lisp programs can listen for connections by creating network
1889servers. A network server is also represented by a kind of process
1890object, but unlike a network connection, the network server never
1891transfers data itself. When it receives a connection request, it
1892creates a new network connection to represent the connection just
1893made. (The network connection inherits certain information, including
1894the process plist, from the server.) The network server then goes
1895back to listening for more connection requests.
1896
1897 Network connections and servers are created by calling
1898@code{make-network-process} with an argument list consisting of
1899keyword/argument pairs, for example @code{:server t} to create a
1900server process, or @code{:type 'datagram} to create a datagram
1901connection. @xref{Low-Level Network}, for details. You can also use
1902the @code{open-network-stream} function described below.
1903
c73e02fa
GM
1904 To distinguish the different types of processes, the
1905@code{process-type} function returns the symbol @code{network} for a
1906network connection or server, @code{serial} for a serial port
1907connection, or @code{real} for a real subprocess.
1908
1909 The @code{process-status} function returns @code{open},
1910@code{closed}, @code{connect}, and @code{failed} for network
1911connections. For a network server, the status is always
b8d4c8d0
GM
1912@code{listen}. None of those values is possible for a real
1913subprocess. @xref{Process Information}.
1914
1915 You can stop and resume operation of a network process by calling
1916@code{stop-process} and @code{continue-process}. For a server
1917process, being stopped means not accepting new connections. (Up to 5
1918connection requests will be queued for when you resume the server; you
1919can increase this limit, unless it is imposed by the operating
1920system.) For a network stream connection, being stopped means not
1921processing input (any arriving input waits until you resume the
1922connection). For a datagram connection, some number of packets may be
1923queued but input may be lost. You can use the function
1924@code{process-command} to determine whether a network connection or
1925server is stopped; a non-@code{nil} value means yes.
1926
fcacfa8d 1927@cindex network connection, encrypted
d7dbb11a 1928@cindex encrypted network connections
fcacfa8d
GM
1929@cindex TLS network connections
1930@cindex STARTTLS network connections
d7dbb11a
GM
1931@defun open-network-stream name buffer-or-name host service &rest parameters
1932This function opens a TCP connection, with optional encryption, and
1933returns a process object that represents the connection.
b8d4c8d0
GM
1934
1935The @var{name} argument specifies the name for the process object. It
1936is modified as necessary to make it unique.
1937
1938The @var{buffer-or-name} argument is the buffer to associate with the
1939connection. Output from the connection is inserted in the buffer,
1940unless you specify a filter function to handle the output. If
1941@var{buffer-or-name} is @code{nil}, it means that the connection is not
1942associated with any buffer.
1943
1944The arguments @var{host} and @var{service} specify where to connect to;
1945@var{host} is the host name (a string), and @var{service} is the name of
1946a defined network service (a string) or a port number (an integer).
d7dbb11a
GM
1947
1948@c FIXME? Is this too lengthy for the printed manual?
1949The remaining arguments @var{parameters} are keyword/argument pairs
1950that are mainly relevant to encrypted connections:
1951
1952@table @code
1953
1954@item :nowait @var{boolean}
1955If non-@code{nil}, try to make an asynchronous connection.
1956
1957@item :type @var{type}
1958The type of connection. Options are:
1959
1960@table @code
1961@item plain
1962An ordinary, unencrypted connection.
1963@item tls
1964@itemx ssl
1965A TLS (``Transport Layer Security'') connection.
1966@item nil
1967@itemx network
1968Start with a plain connection, and if parameters @samp{:success}
1969and @samp{:capability-command} are supplied, try to upgrade to an encrypted
1970connection via STARTTLS. If that fails, retain the unencrypted connection.
1971@item starttls
1972As for @code{nil}, but if STARTTLS fails drop the connection.
1973@item shell
1974A shell connection.
1975@end table
1976
1977@item :always-query-capabilities @var{boolean}
1978If non-@code{nil}, always ask for the server's capabilities, even when
1979doing a @samp{plain} connection.
1980
1981@item :capability-command @var{capability-command}
1982Command string to query the host capabilities.
1983
1984@item :end-of-command @var{regexp}
1985@itemx :end-of-capability @var{regexp}
1986Regular expression matching the end of a command, or the end of the
1987command @var{capability-command}. The latter defaults to the former.
1988
1989@item :starttls-function @var{function}
1990Function of one argument (the response to @var{capability-command}),
1991which returns either @code{nil}, or the command to activate STARTTLS
1992if supported.
1993
1994@item :success @var{regexp}
1995Regular expression matching a successful STARTTLS negotiation.
1996
1997@item :use-starttls-if-possible @var{boolean}
1998If non-@code{nil}, do opportunistic STARTTLS upgrades even if Emacs
1999doesn't have built-in TLS support.
2000
2001@item :client-certificate @var{list-or-t}
2002Either a list of the form @code{(@var{key-file} @var{cert-file})},
2003naming the certificate key file and certificate file itself, or
2004@code{t}, meaning to query @code{auth-source} for this information
2005(@pxref{Top,,auth-source, auth, Emacs auth-source Library}).
2006Only used for TLS or STARTTLS.
2007
2008@item :return-list @var{cons-or-nil}
2009The return value of this function. If omitted or @code{nil}, return a
2010process object. Otherwise, a cons of the form @code{(@var{process-object}
2011. @var{plist})}, where @var{plist} has keywords:
2012
2013@table @code
2014@item :greeting @var{string-or-nil}
2015If non-@code{nil}, the greeting string returned by the host.
2016@item :capabilities @var{string-or-nil}
2017If non-@code{nil}, the host's capability string.
2018@item :type @var{symbol}
2019The connection type: @samp{plain} or @samp{tls}.
2020@end table
2021
2022@end table
2023
b8d4c8d0
GM
2024@end defun
2025
b8d4c8d0
GM
2026@node Network Servers
2027@section Network Servers
2028@cindex network servers
2029
2030 You create a server by calling @code{make-network-process} with
2031@code{:server t}. The server will listen for connection requests from
2032clients. When it accepts a client connection request, that creates a
2033new network connection, itself a process object, with the following
2034parameters:
2035
2036@itemize @bullet
2037@item
2038The connection's process name is constructed by concatenating the
9364727b 2039server process's @var{name} with a client identification string. The
b8d4c8d0
GM
2040client identification string for an IPv4 connection looks like
2041@samp{<@var{a}.@var{b}.@var{c}.@var{d}:@var{p}>}. Otherwise, it is a
2042unique number in brackets, as in @samp{<@var{nnn}>}. The number
2043is unique for each connection in the Emacs session.
2044
2045@item
2046If the server's filter is non-@code{nil}, the connection process does
2047not get a separate process buffer; otherwise, Emacs creates a new
2048buffer for the purpose. The buffer name is the server's buffer name
2049or process name, concatenated with the client identification string.
2050
cec2eab8
JB
2051The server's process buffer value is never used directly, but the log
2052function can retrieve it and use it to log connections by inserting
2053text there.
b8d4c8d0
GM
2054
2055@item
2056The communication type and the process filter and sentinel are
2057inherited from those of the server. The server never directly
2058uses its filter and sentinel; their sole purpose is to initialize
2059connections made to the server.
2060
2061@item
2062The connection's process contact info is set according to the client's
2063addressing information (typically an IP address and a port number).
2064This information is associated with the @code{process-contact}
2065keywords @code{:host}, @code{:service}, @code{:remote}.
2066
2067@item
2068The connection's local address is set up according to the port
2069number used for the connection.
2070
2071@item
9364727b 2072The client process's plist is initialized from the server's plist.
b8d4c8d0
GM
2073@end itemize
2074
2075@node Datagrams
2076@section Datagrams
2077@cindex datagrams
2078
2079 A datagram connection communicates with individual packets rather
2080than streams of data. Each call to @code{process-send} sends one
2081datagram packet (@pxref{Input to Processes}), and each datagram
2082received results in one call to the filter function.
2083
2084 The datagram connection doesn't have to talk with the same remote
2085peer all the time. It has a @dfn{remote peer address} which specifies
2086where to send datagrams to. Each time an incoming datagram is passed
2087to the filter function, the peer address is set to the address that
2088datagram came from; that way, if the filter function sends a datagram,
2089it will go back to that place. You can specify the remote peer
2090address when you create the datagram connection using the
2091@code{:remote} keyword. You can change it later on by calling
2092@code{set-process-datagram-address}.
2093
2094@defun process-datagram-address process
2095If @var{process} is a datagram connection or server, this function
2096returns its remote peer address.
2097@end defun
2098
2099@defun set-process-datagram-address process address
2100If @var{process} is a datagram connection or server, this function
2101sets its remote peer address to @var{address}.
2102@end defun
2103
2104@node Low-Level Network
2105@section Low-Level Network Access
2106
2107 You can also create network connections by operating at a lower
2108level than that of @code{open-network-stream}, using
2109@code{make-network-process}.
2110
2111@menu
2112* Proc: Network Processes. Using @code{make-network-process}.
2113* Options: Network Options. Further control over network connections.
2114* Features: Network Feature Testing.
2115 Determining which network features work on
2116 the machine you are using.
2117@end menu
2118
2119@node Network Processes
2120@subsection @code{make-network-process}
2121
2122 The basic function for creating network connections and network
2123servers is @code{make-network-process}. It can do either of those
2124jobs, depending on the arguments you give it.
2125
2126@defun make-network-process &rest args
2127This function creates a network connection or server and returns the
2128process object that represents it. The arguments @var{args} are a
2129list of keyword/argument pairs. Omitting a keyword is always
2130equivalent to specifying it with value @code{nil}, except for
2131@code{:coding}, @code{:filter-multibyte}, and @code{:reuseaddr}. Here
2132are the meaningful keywords:
2133
2134@table @asis
2135@item :name @var{name}
2136Use the string @var{name} as the process name. It is modified if
2137necessary to make it unique.
2138
2139@item :type @var{type}
2140Specify the communication type. A value of @code{nil} specifies a
2141stream connection (the default); @code{datagram} specifies a datagram
f7704e26
CY
2142connection; @code{seqpacket} specifies a ``sequenced packet stream''
2143connection. Both connections and servers can be of these types.
b8d4c8d0
GM
2144
2145@item :server @var{server-flag}
2146If @var{server-flag} is non-@code{nil}, create a server. Otherwise,
2147create a connection. For a stream type server, @var{server-flag} may
2148be an integer which then specifies the length of the queue of pending
2149connections to the server. The default queue length is 5.
2150
2151@item :host @var{host}
2152Specify the host to connect to. @var{host} should be a host name or
2153Internet address, as a string, or the symbol @code{local} to specify
2154the local host. If you specify @var{host} for a server, it must
2155specify a valid address for the local host, and only clients
2156connecting to that address will be accepted.
2157
2158@item :service @var{service}
2159@var{service} specifies a port number to connect to, or, for a server,
2160the port number to listen on. It should be a service name that
2161translates to a port number, or an integer specifying the port number
2162directly. For a server, it can also be @code{t}, which means to let
2163the system select an unused port number.
2164
2165@item :family @var{family}
2166@var{family} specifies the address (and protocol) family for
2167communication. @code{nil} means determine the proper address family
2168automatically for the given @var{host} and @var{service}.
2169@code{local} specifies a Unix socket, in which case @var{host} is
2170ignored. @code{ipv4} and @code{ipv6} specify to use IPv4 and IPv6
2171respectively.
2172
2173@item :local @var{local-address}
2174For a server process, @var{local-address} is the address to listen on.
2175It overrides @var{family}, @var{host} and @var{service}, and you
2176may as well not specify them.
2177
2178@item :remote @var{remote-address}
2179For a connection, @var{remote-address} is the address to connect to.
2180It overrides @var{family}, @var{host} and @var{service}, and you
2181may as well not specify them.
2182
2183For a datagram server, @var{remote-address} specifies the initial
2184setting of the remote datagram address.
2185
2186The format of @var{local-address} or @var{remote-address} depends on
2187the address family:
2188
2189@itemize -
2190@item
2191An IPv4 address is represented as a five-element vector of four 8-bit
2192integers and one 16-bit integer
2193@code{[@var{a} @var{b} @var{c} @var{d} @var{p}]} corresponding to
2194numeric IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port number
2195@var{p}.
2196
2197@item
2198An IPv6 address is represented as a nine-element vector of 16-bit
2199integers @code{[@var{a} @var{b} @var{c} @var{d} @var{e} @var{f}
2200@var{g} @var{h} @var{p}]} corresponding to numeric IPv6 address
2201@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h} and
2202port number @var{p}.
2203
2204@item
2205A local address is represented as a string which specifies the address
2206in the local address space.
2207
2208@item
2209An ``unsupported family'' address is represented by a cons
2210@code{(@var{f} . @var{av})}, where @var{f} is the family number and
2211@var{av} is a vector specifying the socket address using one element
2212per address data byte. Do not rely on this format in portable code,
2213as it may depend on implementation defined constants, data sizes, and
2214data structure alignment.
2215@end itemize
2216
2217@item :nowait @var{bool}
2218If @var{bool} is non-@code{nil} for a stream connection, return
2219without waiting for the connection to complete. When the connection
2220succeeds or fails, Emacs will call the sentinel function, with a
2221second argument matching @code{"open"} (if successful) or
2222@code{"failed"}. The default is to block, so that
2223@code{make-network-process} does not return until the connection
2224has succeeded or failed.
2225
2226@item :stop @var{stopped}
2227Start the network connection or server in the `stopped' state if
2228@var{stopped} is non-@code{nil}.
2229
2230@item :buffer @var{buffer}
2231Use @var{buffer} as the process buffer.
2232
2233@item :coding @var{coding}
2234Use @var{coding} as the coding system for this process. To specify
2235different coding systems for decoding data from the connection and for
2236encoding data sent to it, specify @code{(@var{decoding} .
2237@var{encoding})} for @var{coding}.
2238
2239If you don't specify this keyword at all, the default
2240is to determine the coding systems from the data.
2241
2242@item :noquery @var{query-flag}
2243Initialize the process query flag to @var{query-flag}.
2244@xref{Query Before Exit}.
2245
2246@item :filter @var{filter}
2247Initialize the process filter to @var{filter}.
2248
b8d4c8d0
GM
2249@item :sentinel @var{sentinel}
2250Initialize the process sentinel to @var{sentinel}.
2251
2252@item :log @var{log}
2253Initialize the log function of a server process to @var{log}. The log
2254function is called each time the server accepts a network connection
2255from a client. The arguments passed to the log function are
2256@var{server}, @var{connection}, and @var{message}, where @var{server}
2257is the server process, @var{connection} is the new process for the
2258connection, and @var{message} is a string describing what has
2259happened.
2260
2261@item :plist @var{plist}
2262Initialize the process plist to @var{plist}.
2263@end table
2264
2265The original argument list, modified with the actual connection
2266information, is available via the @code{process-contact} function.
2267@end defun
2268
2269@node Network Options
2270@subsection Network Options
2271
2272 The following network options can be specified when you create a
2273network process. Except for @code{:reuseaddr}, you can also set or
2274modify these options later, using @code{set-network-process-option}.
2275
2276 For a server process, the options specified with
2277@code{make-network-process} are not inherited by the client
2278connections, so you will need to set the necessary options for each
2279child connection as it is created.
2280
2281@table @asis
2282@item :bindtodevice @var{device-name}
2283If @var{device-name} is a non-empty string identifying a network
2284interface name (see @code{network-interface-list}), only handle
2285packets received on that interface. If @var{device-name} is @code{nil}
2286(the default), handle packets received on any interface.
2287
2288Using this option may require special privileges on some systems.
2289
2290@item :broadcast @var{broadcast-flag}
2291If @var{broadcast-flag} is non-@code{nil} for a datagram process, the
2292process will receive datagram packet sent to a broadcast address, and
2293be able to send packets to a broadcast address. Ignored for a stream
2294connection.
2295
2296@item :dontroute @var{dontroute-flag}
2297If @var{dontroute-flag} is non-@code{nil}, the process can only send
2298to hosts on the same network as the local host.
2299
2300@item :keepalive @var{keepalive-flag}
2301If @var{keepalive-flag} is non-@code{nil} for a stream connection,
2302enable exchange of low-level keep-alive messages.
2303
2304@item :linger @var{linger-arg}
2305If @var{linger-arg} is non-@code{nil}, wait for successful
2306transmission of all queued packets on the connection before it is
2307deleted (see @code{delete-process}). If @var{linger-arg} is an
2308integer, it specifies the maximum time in seconds to wait for queued
2309packets to be sent before closing the connection. Default is
2310@code{nil} which means to discard unsent queued packets when the
2311process is deleted.
2312
2313@item :oobinline @var{oobinline-flag}
2314If @var{oobinline-flag} is non-@code{nil} for a stream connection,
2315receive out-of-band data in the normal data stream. Otherwise, ignore
2316out-of-band data.
2317
2318@item :priority @var{priority}
2319Set the priority for packets sent on this connection to the integer
2320@var{priority}. The interpretation of this number is protocol
2321specific, such as setting the TOS (type of service) field on IP
2322packets sent on this connection. It may also have system dependent
2323effects, such as selecting a specific output queue on the network
2324interface.
2325
2326@item :reuseaddr @var{reuseaddr-flag}
2327If @var{reuseaddr-flag} is non-@code{nil} (the default) for a stream
2328server process, allow this server to reuse a specific port number (see
2329@code{:service}) unless another process on this host is already
2330listening on that port. If @var{reuseaddr-flag} is @code{nil}, there
2331may be a period of time after the last use of that port (by any
2332process on the host), where it is not possible to make a new server on
2333that port.
2334@end table
2335
106e6894 2336@defun set-network-process-option process option value &optional no-error
b8d4c8d0
GM
2337This function sets or modifies a network option for network process
2338@var{process}. See @code{make-network-process} for details of options
106e6894
CY
2339@var{option} and their corresponding values @var{value}. If
2340@var{no-error} is non-@code{nil}, this function returns @code{nil}
2341instead of signaling an error if @var{option} is not a supported
2342option. If the function successfully completes, it returns @code{t}.
b8d4c8d0
GM
2343
2344The current setting of an option is available via the
2345@code{process-contact} function.
2346@end defun
2347
2348@node Network Feature Testing
2349@subsection Testing Availability of Network Features
2350
2351 To test for the availability of a given network feature, use
2352@code{featurep} like this:
2353
2354@example
2355(featurep 'make-network-process '(@var{keyword} @var{value}))
2356@end example
2357
2358@noindent
2359The result of the first form is @code{t} if it works to specify
2360@var{keyword} with value @var{value} in @code{make-network-process}.
2361The result of the second form is @code{t} if @var{keyword} is
2362supported by @code{make-network-process}. Here are some of the
2363@var{keyword}---@var{value} pairs you can test in
2364this way.
2365
2366@table @code
2367@item (:nowait t)
2368Non-@code{nil} if non-blocking connect is supported.
2369@item (:type datagram)
2370Non-@code{nil} if datagrams are supported.
2371@item (:family local)
2372Non-@code{nil} if local (a.k.a.@: ``UNIX domain'') sockets are supported.
2373@item (:family ipv6)
2374Non-@code{nil} if IPv6 is supported.
2375@item (:service t)
2376Non-@code{nil} if the system can select the port for a server.
2377@end table
2378
2379 To test for the availability of a given network option, use
2380@code{featurep} like this:
2381
2382@example
2383(featurep 'make-network-process '@var{keyword})
2384@end example
2385
2386@noindent
2387Here are some of the options you can test in this way.
2388
2389@table @code
2390@item :bindtodevice
2391@itemx :broadcast
2392@itemx :dontroute
2393@itemx :keepalive
2394@itemx :linger
2395@itemx :oobinline
2396@itemx :priority
2397@itemx :reuseaddr
2398That particular network option is supported by
2399@code{make-network-process} and @code{set-network-process-option}.
2400@end table
2401
2402@node Misc Network
2403@section Misc Network Facilities
2404
2405 These additional functions are useful for creating and operating
305a7ef2
EZ
2406on network connections. Note that they are supported only on some
2407systems.
b8d4c8d0
GM
2408
2409@defun network-interface-list
2410This function returns a list describing the network interfaces
2411of the machine you are using. The value is an alist whose
2412elements have the form @code{(@var{name} . @var{address})}.
2413@var{address} has the same form as the @var{local-address}
2414and @var{remote-address} arguments to @code{make-network-process}.
2415@end defun
2416
2417@defun network-interface-info ifname
2418This function returns information about the network interface named
2419@var{ifname}. The value is a list of the form
2420@code{(@var{addr} @var{bcast} @var{netmask} @var{hwaddr} @var{flags})}.
2421
2422@table @var
2423@item addr
2424The Internet protocol address.
2425@item bcast
2426The broadcast address.
2427@item netmask
2428The network mask.
2429@item hwaddr
2430The layer 2 address (Ethernet MAC address, for instance).
2431@item flags
2432The current flags of the interface.
2433@end table
2434@end defun
2435
2436@defun format-network-address address &optional omit-port
2437This function converts the Lisp representation of a network address to
2438a string.
2439
2440A five-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{p}]}
2441represents an IPv4 address @var{a}.@var{b}.@var{c}.@var{d} and port
2442number @var{p}. @code{format-network-address} converts that to the
2443string @code{"@var{a}.@var{b}.@var{c}.@var{d}:@var{p}"}.
2444
2445A nine-element vector @code{[@var{a} @var{b} @var{c} @var{d} @var{e}
2446@var{f} @var{g} @var{h} @var{p}]} represents an IPv6 address along
2447with a port number. @code{format-network-address} converts that to
2448the string
2449@code{"[@var{a}:@var{b}:@var{c}:@var{d}:@var{e}:@var{f}:@var{g}:@var{h}]:@var{p}"}.
2450
2451If the vector does not include the port number, @var{p}, or if
2452@var{omit-port} is non-@code{nil}, the result does not include the
2453@code{:@var{p}} suffix.
2454@end defun
2455
c73e02fa
GM
2456@node Serial Ports
2457@section Communicating with Serial Ports
2458@cindex @file{/dev/tty}
2459@cindex @file{COM1}
545c2782 2460@cindex serial connections
c73e02fa
GM
2461
2462 Emacs can communicate with serial ports. For interactive use,
2463@kbd{M-x serial-term} opens a terminal window. In a Lisp program,
2464@code{make-serial-process} creates a process object.
2465
2466 The serial port can be configured at run-time, without having to
2467close and re-open it. The function @code{serial-process-configure}
2468lets you change the speed, bytesize, and other parameters. In a
2469terminal window created by @code{serial-term}, you can click on the
2470mode line for configuration.
2471
2472 A serial connection is represented by a process object which can be
2473used similar to a subprocess or network process. You can send and
2474receive data and configure the serial port. A serial process object
80e6b6df
EZ
2475has no process ID, you can't send signals to it, and the status codes
2476are different from other types of processes.
c73e02fa
GM
2477@code{delete-process} on the process object or @code{kill-buffer} on
2478the process buffer close the connection, but this does not affect the
2479device connected to the serial port.
2480
2481 The function @code{process-type} returns the symbol @code{serial}
80e6b6df 2482for a process object representing a serial port connection.
c73e02fa
GM
2483
2484 Serial ports are available on GNU/Linux, Unix, and Windows systems.
2485
80e6b6df 2486@deffn Command serial-term port speed
c73e02fa 2487Start a terminal-emulator for a serial port in a new buffer.
80e6b6df
EZ
2488@var{port} is the name of the serial port to which to connect. For
2489example, this could be @file{/dev/ttyS0} on Unix. On Windows, this
2490could be @file{COM1}, or @file{\\.\COM10} (double the backslashes in
2491Lisp strings).
c73e02fa
GM
2492
2493@var{speed} is the speed of the serial port in bits per second. 9600
80e6b6df
EZ
2494is a common value. The buffer is in Term mode; see @ref{Term Mode,,,
2495emacs, The GNU Emacs Manual}, for the commands to use in that buffer.
2496You can change the speed and the configuration in the mode line menu.
2497@end deffn
c73e02fa
GM
2498
2499@defun make-serial-process &rest args
80e6b6df
EZ
2500This function creates a process and a buffer. Arguments are specified
2501as keyword/argument pairs. Here's the list of the meaningful keywords:
c73e02fa
GM
2502
2503@table @code
80e6b6df
EZ
2504@item :port @var{port}@r{ (mandatory)}
2505This is the name of the serial port. On Unix and GNU systems, this is
2506a file name such as @file{/dev/ttyS0}. On Windows, this could be
2507@file{COM1}, or @file{\\.\COM10} for ports higher than @file{COM9}
2508(double the backslashes in Lisp strings).
2509
2510@item :speed @var{speed}@r{ (mandatory)}
2511The speed of the serial port in bits per second. This function calls
2512@code{serial-process-configure} to handle the speed.
2513
2514@item :name @var{name}
2515The name of the process. If @var{name} is not given, @var{port} will
2516serve as the process name as well.
2517
2518@item :buffer @var{buffer}
2519The buffer to associate with the process. The value could be either a
2520buffer or a string that names a buffer. Process output goes at the
2521end of that buffer, unless you specify an output stream or filter
2522function to handle the output. If @var{buffer} is not given, the
2523process buffer's name is taken from the value of the @code{:name}
2524keyword.
2525
2526@item :coding @var{coding}
c73e02fa
GM
2527If @var{coding} is a symbol, it specifies the coding system used for
2528both reading and writing for this process. If @var{coding} is a cons
2529@code{(decoding . encoding)}, @var{decoding} is used for reading, and
80e6b6df
EZ
2530@var{encoding} is used for writing. If not specified, the default is
2531to determine the coding systems from data itself.
c73e02fa 2532
80e6b6df
EZ
2533@item :noquery @var{query-flag}
2534Initialize the process query flag to @var{query-flag}. @xref{Query
2535Before Exit}. The flags defaults to @code{nil} if unspecified.
c73e02fa 2536
80e6b6df 2537@item :stop @var{bool}
c73e02fa
GM
2538Start process in the @code{stopped} state if @var{bool} is
2539non-@code{nil}. In the stopped state, a serial process does not
2540accept incoming data, but you can send outgoing data. The stopped
2541state is cleared by @code{continue-process} and set by
2542@code{stop-process}.
2543
80e6b6df 2544@item :filter @var{filter}
c73e02fa
GM
2545Install @var{filter} as the process filter.
2546
80e6b6df 2547@item :sentinel @var{sentinel}
c73e02fa
GM
2548Install @var{sentinel} as the process sentinel.
2549
80e6b6df 2550@item :plist @var{plist}
c73e02fa
GM
2551Install @var{plist} as the initial plist of the process.
2552
2553@item :speed
2554@itemx :bytesize
2555@itemx :parity
2556@itemx :stopbits
2557@itemx :flowcontrol
049bcbcb
CY
2558These are handled by @code{serial-process-configure}, which is called
2559by @code{make-serial-process}.
c73e02fa
GM
2560@end table
2561
2562The original argument list, possibly modified by later configuration,
2563is available via the function @code{process-contact}.
2564
049bcbcb 2565Here is an example:
c73e02fa
GM
2566
2567@example
2568(make-serial-process :port "/dev/ttyS0" :speed 9600)
c73e02fa
GM
2569@end example
2570@end defun
2571
2572@defun serial-process-configure &rest args
80e6b6df
EZ
2573@cindex baud, in serial connections
2574@cindex bytesize, in serial connections
2575@cindex parity, in serial connections
2576@cindex stopbits, in serial connections
2577@cindex flowcontrol, in serial connections
2578
2579This functions configures a serial port connection. Arguments are
2580specified as keyword/argument pairs. Attributes that are not given
2581are re-initialized from the process's current configuration (available
2582via the function @code{process-contact}) or set to reasonable default
2583values. The following arguments are defined:
c73e02fa
GM
2584
2585@table @code
80e6b6df
EZ
2586@item :process @var{process}
2587@itemx :name @var{name}
2588@itemx :buffer @var{buffer}
2589@itemx :port @var{port}
c73e02fa
GM
2590Any of these arguments can be given to identify the process that is to
2591be configured. If none of these arguments is given, the current
2592buffer's process is used.
2593
2594@item :speed @var{speed}
545c2782
EZ
2595The speed of the serial port in bits per second, a.k.a.@: @dfn{baud
2596rate}. The value can be any number, but most serial ports work only
2597at a few defined values between 1200 and 115200, with 9600 being the
2598most common value. If @var{speed} is @code{nil}, the function ignores
2599all other arguments and does not configure the port. This may be
2600useful for special serial ports such as Bluetooth-to-serial converters
2601which can only be configured through AT commands sent through the
538395d9
EZ
2602connection. The value of @code{nil} for @var{speed} is valid only for
2603connections that were already opened by a previous call to
80e6b6df 2604@code{make-serial-process} or @code{serial-term}.
c73e02fa
GM
2605
2606@item :bytesize @var{bytesize}
80e6b6df
EZ
2607The number of bits per byte, which can be 7 or 8. If @var{bytesize}
2608is not given or @code{nil}, it defaults to 8.
c73e02fa
GM
2609
2610@item :parity @var{parity}
80e6b6df 2611The value can be @code{nil} (don't use parity), the symbol
c73e02fa 2612@code{odd} (use odd parity), or the symbol @code{even} (use even
80e6b6df 2613parity). If @var{parity} is not given, it defaults to no parity.
c73e02fa
GM
2614
2615@item :stopbits @var{stopbits}
80e6b6df
EZ
2616The number of stopbits used to terminate a transmission
2617of each byte. @var{stopbits} can be 1 or 2. If @var{stopbits} is not
2618given or @code{nil}, it defaults to 1.
c73e02fa
GM
2619
2620@item :flowcontrol @var{flowcontrol}
80e6b6df
EZ
2621The type of flow control to use for this connection, which is either
2622@code{nil} (don't use flow control), the symbol @code{hw} (use RTS/CTS
2623hardware flow control), or the symbol @code{sw} (use XON/XOFF software
2624flow control). If @var{flowcontrol} is not given, it defaults to no
2625flow control.
c73e02fa
GM
2626@end table
2627
049bcbcb
CY
2628@code{serial-process-configure} is called by
2629@code{make-serial-process} for the initial configuration of the serial
2630port.
c73e02fa
GM
2631@end defun
2632
b8d4c8d0
GM
2633@node Byte Packing
2634@section Packing and Unpacking Byte Arrays
2635@cindex byte packing and unpacking
2636
2637 This section describes how to pack and unpack arrays of bytes,
2638usually for binary network protocols. These functions convert byte arrays
2639to alists, and vice versa. The byte array can be represented as a
2640unibyte string or as a vector of integers, while the alist associates
2641symbols either with fixed-size objects or with recursive sub-alists.
2642
2643@cindex serializing
2644@cindex deserializing
2645@cindex packing
2646@cindex unpacking
2647 Conversion from byte arrays to nested alists is also known as
2648@dfn{deserializing} or @dfn{unpacking}, while going in the opposite
2649direction is also known as @dfn{serializing} or @dfn{packing}.
2650
2651@menu
2652* Bindat Spec:: Describing data layout.
2653* Bindat Functions:: Doing the unpacking and packing.
2654* Bindat Examples:: Samples of what bindat.el can do for you!
2655@end menu
2656
2657@node Bindat Spec
2658@subsection Describing Data Layout
2659
2660 To control unpacking and packing, you write a @dfn{data layout
2661specification}, a special nested list describing named and typed
2662@dfn{fields}. This specification controls length of each field to be
2663processed, and how to pack or unpack it. We normally keep bindat specs
2664in variables whose names end in @samp{-bindat-spec}; that kind of name
2665is automatically recognized as ``risky.''
2666
2667@cindex endianness
2668@cindex big endian
2669@cindex little endian
2670@cindex network byte ordering
2671 A field's @dfn{type} describes the size (in bytes) of the object
2672that the field represents and, in the case of multibyte fields, how
2673the bytes are ordered within the field. The two possible orderings
2674are ``big endian'' (also known as ``network byte ordering'') and
2675``little endian.'' For instance, the number @code{#x23cd} (decimal
26769165) in big endian would be the two bytes @code{#x23} @code{#xcd};
2677and in little endian, @code{#xcd} @code{#x23}. Here are the possible
2678type values:
2679
2680@table @code
2681@item u8
2682@itemx byte
2683Unsigned byte, with length 1.
2684
2685@item u16
2686@itemx word
2687@itemx short
2688Unsigned integer in network byte order, with length 2.
2689
2690@item u24
2691Unsigned integer in network byte order, with length 3.
2692
2693@item u32
2694@itemx dword
2695@itemx long
2696Unsigned integer in network byte order, with length 4.
44e97401 2697Note: These values may be limited by Emacs's integer implementation limits.
b8d4c8d0
GM
2698
2699@item u16r
2700@itemx u24r
2701@itemx u32r
2702Unsigned integer in little endian order, with length 2, 3 and 4, respectively.
2703
2704@item str @var{len}
2705String of length @var{len}.
2706
2707@item strz @var{len}
2708Zero-terminated string, in a fixed-size field with length @var{len}.
2709
2710@item vec @var{len} [@var{type}]
2711Vector of @var{len} elements of type @var{type}, or bytes if not
2712@var{type} is specified.
2713The @var{type} is any of the simple types above, or another vector
2714specified as a list @code{(vec @var{len} [@var{type}])}.
2715
2716@item ip
2717Four-byte vector representing an Internet address. For example:
2718@code{[127 0 0 1]} for localhost.
2719
2720@item bits @var{len}
2721List of set bits in @var{len} bytes. The bytes are taken in big
2722endian order and the bits are numbered starting with @code{8 *
2723@var{len} @minus{} 1} and ending with zero. For example: @code{bits
27242} unpacks @code{#x28} @code{#x1c} to @code{(2 3 4 11 13)} and
2725@code{#x1c} @code{#x28} to @code{(3 5 10 11 12)}.
2726
2727@item (eval @var{form})
2728@var{form} is a Lisp expression evaluated at the moment the field is
2729unpacked or packed. The result of the evaluation should be one of the
2730above-listed type specifications.
2731@end table
2732
2733For a fixed-size field, the length @var{len} is given as an integer
2734specifying the number of bytes in the field.
2735
2736When the length of a field is not fixed, it typically depends on the
2737value of a preceding field. In this case, the length @var{len} can be
2738given either as a list @code{(@var{name} ...)} identifying a
2739@dfn{field name} in the format specified for @code{bindat-get-field}
2740below, or by an expression @code{(eval @var{form})} where @var{form}
2741should evaluate to an integer, specifying the field length.
2742
2743A field specification generally has the form @code{([@var{name}]
2744@var{handler})}. The square braces indicate that @var{name} is
2745optional. (Don't use names that are symbols meaningful as type
2746specifications (above) or handler specifications (below), since that
2747would be ambiguous.) @var{name} can be a symbol or the expression
2748@code{(eval @var{form})}, in which case @var{form} should evaluate to
2749a symbol.
2750
2751@var{handler} describes how to unpack or pack the field and can be one
2752of the following:
2753
2754@table @code
2755@item @var{type}
2756Unpack/pack this field according to the type specification @var{type}.
2757
2758@item eval @var{form}
2759Evaluate @var{form}, a Lisp expression, for side-effect only. If the
2760field name is specified, the value is bound to that field name.
2761
2762@item fill @var{len}
2763Skip @var{len} bytes. In packing, this leaves them unchanged,
2764which normally means they remain zero. In unpacking, this means
2765they are ignored.
2766
2767@item align @var{len}
2768Skip to the next multiple of @var{len} bytes.
2769
2770@item struct @var{spec-name}
2771Process @var{spec-name} as a sub-specification. This describes a
2772structure nested within another structure.
2773
2774@item union @var{form} (@var{tag} @var{spec})@dots{}
2775@c ??? I don't see how one would actually use this.
2776@c ??? what kind of expression would be useful for @var{form}?
2777Evaluate @var{form}, a Lisp expression, find the first @var{tag}
2778that matches it, and process its associated data layout specification
2779@var{spec}. Matching can occur in one of three ways:
2780
2781@itemize
2782@item
2783If a @var{tag} has the form @code{(eval @var{expr})}, evaluate
2784@var{expr} with the variable @code{tag} dynamically bound to the value
2785of @var{form}. A non-@code{nil} result indicates a match.
2786
2787@item
2788@var{tag} matches if it is @code{equal} to the value of @var{form}.
2789
2790@item
2791@var{tag} matches unconditionally if it is @code{t}.
2792@end itemize
2793
2794@item repeat @var{count} @var{field-specs}@dots{}
2795Process the @var{field-specs} recursively, in order, then repeat
2796starting from the first one, processing all the specs @var{count}
2797times overall. The @var{count} is given using the same formats as a
2798field length---if an @code{eval} form is used, it is evaluated just once.
2799For correct operation, each spec in @var{field-specs} must include a name.
2800@end table
2801
2802For the @code{(eval @var{form})} forms used in a bindat specification,
2803the @var{form} can access and update these dynamically bound variables
2804during evaluation:
2805
2806@table @code
2807@item last
2808Value of the last field processed.
2809
2810@item bindat-raw
2811The data as a byte array.
2812
2813@item bindat-idx
2814Current index (within @code{bindat-raw}) for unpacking or packing.
2815
2816@item struct
2817The alist containing the structured data that have been unpacked so
2818far, or the entire structure being packed. You can use
2819@code{bindat-get-field} to access specific fields of this structure.
2820
2821@item count
2822@itemx index
2823Inside a @code{repeat} block, these contain the maximum number of
2824repetitions (as specified by the @var{count} parameter), and the
2825current repetition number (counting from 0). Setting @code{count} to
2826zero will terminate the inner-most repeat block after the current
2827repetition has completed.
2828@end table
2829
2830@node Bindat Functions
2831@subsection Functions to Unpack and Pack Bytes
2832
2833 In the following documentation, @var{spec} refers to a data layout
2834specification, @code{bindat-raw} to a byte array, and @var{struct} to an
2835alist representing unpacked field data.
2836
2837@defun bindat-unpack spec bindat-raw &optional bindat-idx
2838This function unpacks data from the unibyte string or byte
2839array @code{bindat-raw}
2840according to @var{spec}. Normally this starts unpacking at the
2841beginning of the byte array, but if @var{bindat-idx} is non-@code{nil}, it
2842specifies a zero-based starting position to use instead.
2843
2844The value is an alist or nested alist in which each element describes
2845one unpacked field.
2846@end defun
2847
2848@defun bindat-get-field struct &rest name
2849This function selects a field's data from the nested alist
2850@var{struct}. Usually @var{struct} was returned by
2851@code{bindat-unpack}. If @var{name} corresponds to just one argument,
2852that means to extract a top-level field value. Multiple @var{name}
2853arguments specify repeated lookup of sub-structures. An integer name
2854acts as an array index.
2855
2856For example, if @var{name} is @code{(a b 2 c)}, that means to find
2857field @code{c} in the third element of subfield @code{b} of field
2858@code{a}. (This corresponds to @code{struct.a.b[2].c} in C.)
2859@end defun
2860
2861 Although packing and unpacking operations change the organization of
2862data (in memory), they preserve the data's @dfn{total length}, which is
2863the sum of all the fields' lengths, in bytes. This value is not
2864generally inherent in either the specification or alist alone; instead,
2865both pieces of information contribute to its calculation. Likewise, the
2866length of a string or array being unpacked may be longer than the data's
2867total length as described by the specification.
2868
2869@defun bindat-length spec struct
2870This function returns the total length of the data in @var{struct},
2871according to @var{spec}.
2872@end defun
2873
2874@defun bindat-pack spec struct &optional bindat-raw bindat-idx
2875This function returns a byte array packed according to @var{spec} from
2876the data in the alist @var{struct}. Normally it creates and fills a
2877new byte array starting at the beginning. However, if @var{bindat-raw}
2878is non-@code{nil}, it specifies a pre-allocated unibyte string or vector to
2879pack into. If @var{bindat-idx} is non-@code{nil}, it specifies the starting
2880offset for packing into @code{bindat-raw}.
2881
2882When pre-allocating, you should make sure @code{(length @var{bindat-raw})}
2883meets or exceeds the total length to avoid an out-of-range error.
2884@end defun
2885
2886@defun bindat-ip-to-string ip
2887Convert the Internet address vector @var{ip} to a string in the usual
2888dotted notation.
2889
2890@example
2891(bindat-ip-to-string [127 0 0 1])
2892 @result{} "127.0.0.1"
2893@end example
2894@end defun
2895
2896@node Bindat Examples
2897@subsection Examples of Byte Unpacking and Packing
2898
2899 Here is a complete example of byte unpacking and packing:
2900
2901@lisp
2902(defvar fcookie-index-spec
2903 '((:version u32)
2904 (:count u32)
2905 (:longest u32)
2906 (:shortest u32)
2907 (:flags u32)
2908 (:delim u8)
2909 (:ignored fill 3)
2910 (:offset repeat (:count)
2911 (:foo u32)))
2912 "Description of a fortune cookie index file's contents.")
2913
2914(defun fcookie (cookies &optional index)
2915 "Display a random fortune cookie from file COOKIES.
2916Optional second arg INDEX specifies the associated index
2917filename, which is by default constructed by appending
2918\".dat\" to COOKIES. Display cookie text in possibly
2919new buffer \"*Fortune Cookie: BASENAME*\" where BASENAME
2920is COOKIES without the directory part."
2921 (interactive "fCookies file: ")
2922 (let* ((info (with-temp-buffer
2923 (insert-file-contents-literally
2924 (or index (concat cookies ".dat")))
2925 (bindat-unpack fcookie-index-spec
2926 (buffer-string))))
2927 (sel (random (bindat-get-field info :count)))
2928 (beg (cdar (bindat-get-field info :offset sel)))
2929 (end (or (cdar (bindat-get-field info
2930 :offset (1+ sel)))
2931 (nth 7 (file-attributes cookies)))))
2932 (switch-to-buffer
2933 (get-buffer-create
2934 (format "*Fortune Cookie: %s*"
2935 (file-name-nondirectory cookies))))
2936 (erase-buffer)
2937 (insert-file-contents-literally
2938 cookies nil beg (- end 3))))
2939
2940(defun fcookie-create-index (cookies &optional index delim)
2941 "Scan file COOKIES, and write out its index file.
2942Optional second arg INDEX specifies the index filename,
2943which is by default constructed by appending \".dat\" to
2944COOKIES. Optional third arg DELIM specifies the unibyte
2945character which, when found on a line of its own in
2946COOKIES, indicates the border between entries."
2947 (interactive "fCookies file: ")
2948 (setq delim (or delim ?%))
2949 (let ((delim-line (format "\n%c\n" delim))
2950 (count 0)
2951 (max 0)
2952 min p q len offsets)
2953 (unless (= 3 (string-bytes delim-line))
2954 (error "Delimiter cannot be represented in one byte"))
2955 (with-temp-buffer
2956 (insert-file-contents-literally cookies)
2957 (while (and (setq p (point))
2958 (search-forward delim-line (point-max) t)
2959 (setq len (- (point) 3 p)))
2960 (setq count (1+ count)
2961 max (max max len)
2962 min (min (or min max) len)
2963 offsets (cons (1- p) offsets))))
2964 (with-temp-buffer
2965 (set-buffer-multibyte nil)
2966 (insert
2967 (bindat-pack
2968 fcookie-index-spec
2969 `((:version . 2)
2970 (:count . ,count)
2971 (:longest . ,max)
2972 (:shortest . ,min)
2973 (:flags . 0)
2974 (:delim . ,delim)
2975 (:offset . ,(mapcar (lambda (o)
2976 (list (cons :foo o)))
2977 (nreverse offsets))))))
2978 (let ((coding-system-for-write 'raw-text-unix))
2979 (write-file (or index (concat cookies ".dat")))))))
2980@end lisp
2981
2982Following is an example of defining and unpacking a complex structure.
2983Consider the following C structures:
2984
2985@example
2986struct header @{
2987 unsigned long dest_ip;
2988 unsigned long src_ip;
2989 unsigned short dest_port;
2990 unsigned short src_port;
2991@};
2992
2993struct data @{
2994 unsigned char type;
2995 unsigned char opcode;
2996 unsigned short length; /* In network byte order */
2997 unsigned char id[8]; /* null-terminated string */
2998 unsigned char data[/* (length + 3) & ~3 */];
2999@};
3000
3001struct packet @{
3002 struct header header;
3003 unsigned long counters[2]; /* In little endian order */
3004 unsigned char items;
3005 unsigned char filler[3];
3006 struct data item[/* items */];
3007
3008@};
3009@end example
3010
3011The corresponding data layout specification:
3012
3013@lisp
3014(setq header-spec
3015 '((dest-ip ip)
3016 (src-ip ip)
3017 (dest-port u16)
3018 (src-port u16)))
3019
3020(setq data-spec
3021 '((type u8)
3022 (opcode u8)
3023 (length u16) ;; network byte order
3024 (id strz 8)
3025 (data vec (length))
3026 (align 4)))
3027
3028(setq packet-spec
3029 '((header struct header-spec)
3030 (counters vec 2 u32r) ;; little endian order
3031 (items u8)
3032 (fill 3)
3033 (item repeat (items)
3034 (struct data-spec))))
3035@end lisp
3036
3037A binary data representation:
3038
3039@lisp
3040(setq binary-data
3041 [ 192 168 1 100 192 168 1 101 01 28 21 32
3042 160 134 1 0 5 1 0 0 2 0 0 0
3043 2 3 0 5 ?A ?B ?C ?D ?E ?F 0 0 1 2 3 4 5 0 0 0
3044 1 4 0 7 ?B ?C ?D ?E ?F ?G 0 0 6 7 8 9 10 11 12 0 ])
3045@end lisp
3046
3047The corresponding decoded structure:
3048
3049@lisp
3050(setq decoded (bindat-unpack packet-spec binary-data))
3051 @result{}
3052((header
3053 (dest-ip . [192 168 1 100])
3054 (src-ip . [192 168 1 101])
3055 (dest-port . 284)
3056 (src-port . 5408))
3057 (counters . [100000 261])
3058 (items . 2)
3059 (item ((data . [1 2 3 4 5])
3060 (id . "ABCDEF")
3061 (length . 5)
3062 (opcode . 3)
3063 (type . 2))
3064 ((data . [6 7 8 9 10 11 12])
3065 (id . "BCDEFG")
3066 (length . 7)
3067 (opcode . 4)
3068 (type . 1))))
3069@end lisp
3070
3071Fetching data from this structure:
3072
3073@lisp
3074(bindat-get-field decoded 'item 1 'id)
3075 @result{} "BCDEFG"
3076@end lisp