Simplify last change to ido.el
[bpt/emacs.git] / doc / misc / eshell.texi
1 \input texinfo @c -*-texinfo-*-
2 @c %**start of header
3 @setfilename ../../info/eshell
4 @settitle Eshell: The Emacs Shell
5 @defindex cm
6 @synindex vr fn
7 @c %**end of header
8
9 @copying
10 This manual is for Eshell, the Emacs shell.
11
12 Copyright @copyright{} 1999--2013 Free Software Foundation, Inc.
13
14 @quotation
15 Permission is granted to copy, distribute and/or modify this document
16 under the terms of the GNU Free Documentation License, Version 1.3 or
17 any later version published by the Free Software Foundation; with no
18 Invariant Sections, with the Front-Cover texts being ``A GNU Manual'',
19 and with the Back-Cover Texts as in (a) below. A copy of the license
20 is included in the section entitled ``GNU Free Documentation License''.
21
22 (a) The FSF's Back-Cover Text is: ``You have the freedom to copy and
23 modify this GNU manual.''
24 @end quotation
25 @end copying
26
27 @dircategory Emacs misc features
28 @direntry
29 * Eshell: (eshell). A command shell implemented in Emacs Lisp.
30 @end direntry
31
32 @titlepage
33 @sp 4
34 @c The title is printed in a large font.
35 @center @titlefont{User's Guide}
36 @sp 1
37 @center @titlefont{to}
38 @sp 1
39 @center @titlefont{Eshell: The Emacs Shell}
40 @ignore
41 @sp 2
42 @center release 2.4
43 @c -release-
44 @end ignore
45 @sp 3
46 @center John Wiegley & Aidan Gauland
47 @c -date-
48
49 @page
50 @vskip 0pt plus 1filll
51 @insertcopying
52 @end titlepage
53
54 @contents
55
56 @c ================================================================
57 @c The real text starts here
58 @c ================================================================
59
60 @ifnottex
61 @node Top
62 @top Eshell
63
64 Eshell is a shell-like command interpreter
65 implemented in Emacs Lisp. It invokes no external processes except for
66 those requested by the user. It is intended to be a functional
67 replacement for command shells such as @command{bash}, @command{zsh},
68 @command{rc}, or @command{4dos}; since Emacs itself is capable of
69 handling the sort of tasks accomplished by those tools.
70 @c This manual is updated to release 2.4 of Eshell.
71
72 @insertcopying
73 @end ifnottex
74
75 @menu
76 * What is Eshell?:: A brief introduction to the Emacs Shell.
77 * Command basics:: The basics of command usage.
78 * Commands::
79 * Expansion::
80 * Input/Output::
81 * Extension modules::
82 * Bugs and ideas:: Known problems, and future ideas.
83 * GNU Free Documentation License:: The license for this documentation.
84 * Concept Index::
85 * Function and Variable Index::
86 * Command Index::
87 * Key Index::
88 @end menu
89
90 @node What is Eshell?
91 @chapter What is Eshell?
92 @cindex what is Eshell?
93 @cindex Eshell, what it is
94
95 Eshell is a @dfn{command shell} written in Emacs Lisp. Everything it
96 does, it uses Emacs's facilities to do. This means that Eshell is as
97 portable as Emacs itself. It also means that cooperation with Lisp code
98 is natural and seamless.
99
100 What is a command shell? To properly understand the role of a shell,
101 it's necessary to visualize what a computer does for you. Basically, a
102 computer is a tool; in order to use that tool, you must tell it what to
103 do---or give it ``commands.'' These commands take many forms, such as
104 clicking with a mouse on certain parts of the screen. But that is only
105 one form of command input.
106
107 By far the most versatile way to express what you want the computer to
108 do is by using an abbreviated language called @dfn{script}. In
109 script, instead of telling the computer, ``list my files, please'',
110 one writes a standard abbreviated command word---@samp{ls}. Typing
111 @samp{ls} in a command shell is a script way of telling the computer
112 to list your files.@footnote{This is comparable to viewing the
113 contents of a folder using a graphical display.}
114
115 The real flexibility of this approach is apparent only when you realize
116 that there are many, many different ways to list files. Perhaps you
117 want them sorted by name, sorted by date, in reverse order, or grouped
118 by type. Most graphical browsers have simple ways to express this. But
119 what about showing only a few files, or only files that meet a certain
120 criteria? In very complex and specific situations, the request becomes
121 too difficult to express using a mouse or pointing device. It is just
122 these kinds of requests that are easily solved using a command shell.
123
124 For example, what if you want to list every Word file on your hard
125 drive, larger than 100 kilobytes in size, and which hasn't been looked
126 at in over six months? That is a good candidate list for deletion, when
127 you go to clean up your hard drive. But have you ever tried asking your
128 computer for such a list? There is no way to do it! At least, not
129 without using a command shell.
130
131 The role of a command shell is to give you more control over what your
132 computer does for you. Not everyone needs this amount of control, and
133 it does come at a cost: Learning the necessary script commands to
134 express what you want done. A complicated query, such as the example
135 above, takes time to learn. But if you find yourself using your
136 computer frequently enough, it is more than worthwhile in the long run.
137 Any tool you use often deserves the time spent learning to master it.
138 @footnote{For the understandably curious, here is what that command
139 looks like: But don't let it fool you; once you know what's going on,
140 it's easier than it looks: @code{ls -lt **/*.doc(Lk+50aM+5)}.}
141
142 @menu
143 * Contributors to Eshell:: People who have helped out!
144 @end menu
145
146 @node Contributors to Eshell
147 @section Contributors to Eshell
148 @cindex contributors
149 @cindex authors
150
151 Contributions to Eshell are welcome. I have limited time to work on
152 this project, but I will gladly add any code you contribute to me to
153 this package.
154
155 The following persons have made contributions to Eshell.
156
157 @itemize @bullet
158 @item
159 Eli Zaretskii made it possible for Eshell to run without requiring
160 asynchronous subprocess support. This is important for MS-DOS, which
161 does not have such support.@refill
162
163 @item
164 Miles Bader contributed many fixes during the port to Emacs 21.@refill
165
166 @item
167 Stefan Monnier fixed the things which bothered him, which of course made
168 things better for all.@refill
169
170 @item
171 Gerd Moellmann also helped to contribute bug fixes during the initial
172 integration with Emacs 21.@refill
173
174 @item
175 Alex Schroeder contributed code for interactively querying the user
176 before overwriting files.@refill
177
178 @item
179 Sudish Joseph helped with some XEmacs compatibility issues.@refill
180 @end itemize
181
182 Apart from these, a lot of people have sent suggestions, ideas,
183 requests, bug reports and encouragement. Thanks a lot! Without you
184 there would be no new releases of Eshell.
185
186 @node Command basics
187 @chapter Basic overview
188
189 A command shell is a means of entering verbally-formed commands. This
190 is really all that it does, and every feature described in this manual
191 is a means to that end. Therefore, it's important to take firm hold on
192 exactly what a command is, and how it fits in the overall picture of
193 things.
194
195 @menu
196 * Commands verbs:: Commands always begin with a verb.
197 * Command arguments:: Some verbs require arguments.
198 @end menu
199
200 @node Commands verbs
201 @section Commands verbs
202
203 Commands are expressed using @dfn{script}, a special shorthand language
204 computers can understand with no trouble. Script is an extremely simple
205 language; oddly enough, this is what makes it look so complicated!
206 Whereas normal languages use a variety of embellishments, the form of a
207 script command is always:
208
209 @example
210 @var{verb} [@var{arguments}]
211 @end example
212
213 The verb expresses what you want your computer to do. There are a fixed
214 number of verbs, although this number is usually quite large. On the
215 author's computer, it reaches almost 1400 in number. But of course,
216 only a handful of these are really necessary.
217
218 Sometimes, the verb is all that's written. A verb is always a single
219 word, usually related to the task it performs. @command{reboot} is a
220 good example. Entering that on GNU/Linux will reboot the
221 computer---assuming you have sufficient privileges.
222
223 Other verbs require more information. These are usually very capable
224 verbs, and must be told specifically what to do. The extra information
225 is given in the form of @dfn{arguments}. For example, the
226 @command{echo} verb prints back whatever arguments you type. It
227 requires these arguments to know what to echo. A proper use of
228 @command{echo} looks like this:
229
230 @example
231 echo This is an example of using echo!
232 @end example
233
234 This script command causes the computer to echo back: ``This is an
235 example of using echo!''
236
237 Although command verbs are always simple words, like @command{reboot} or
238 @command{echo}, arguments may have a wide variety of forms. There are
239 textual arguments, numerical arguments---even Lisp arguments.
240 Distinguishing these different types of arguments requires special
241 typing, for the computer to know exactly what you mean.
242
243 @node Command arguments
244 @section Command arguments
245
246 Eshell recognizes several different kinds of command arguments:
247
248 @enumerate
249 @item Strings (also called textual arguments)
250 @item Numbers (floating point or integer)
251 @item Lisp lists
252 @item Lisp symbols
253 @item Emacs buffers
254 @item Emacs process handles
255 @end enumerate
256
257 Most users need to worry only about the first two. The third, Lisp lists,
258 occur very frequently, but almost always behind the scenes.
259
260 Strings are the most common type of argument, and consist of nearly any
261 character. Special characters---those used by Eshell
262 specifically---must be preceded by a backslash (@samp{\}). When in doubt, it
263 is safe to add backslashes anywhere and everywhere.
264
265 Here is a more complicated @command{echo} example:
266
267 @example
268 echo A\ Multi-word\ Argument\ With\ A\ \$\ dollar
269 @end example
270
271 Beyond this, things get a bit more complicated. While not beyond the
272 reach of someone wishing to learn, it is definitely beyond the scope of
273 this manual to present it all in a simplistic manner. Get comfortable
274 with Eshell as a basic command invocation tool, and learn more about the
275 commands on your system; then come back when it all sits more familiarly
276 on your mind. Have fun!
277
278 @node Commands
279 @chapter Commands
280
281 In a command shell, everything is done by invoking commands. This
282 chapter covers command invocations in Eshell, including the command
283 history and invoking commands in a script file.
284
285 @menu
286 * Invocation::
287 * Arguments::
288 * Built-ins::
289 * Variables::
290 * Aliases::
291 * History::
292 * Completion::
293 * for loop::
294 * Scripts::
295 @end menu
296
297 @node Invocation
298 @section Invocation
299 Unlike regular system shells, Eshell never invokes kernel functions
300 directly, such as @code{exec(3)}. Instead, it uses the Lisp functions
301 available in the Emacs Lisp library. It does this by transforming the
302 input line into a callable Lisp form.@footnote{To see the Lisp form that will be invoked, type: @samp{eshell-parse-command "echo hello"}}
303
304 The command can be either an Elisp function or an external command.
305 Eshell looks first for an @ref{Aliases, alias} with the same name as the
306 command, then a @ref{Built-ins, built-in command} or a function with the
307 same name; if there is no match, it then tries to execute it as an
308 external command.
309
310 The semicolon (@code{;}) can be used to separate multiple command
311 invocations on a single line. A command invocation followed by an
312 ampersand (@code{&}) will be run in the background. Eshell has no job
313 control, so you can not suspend or background the current process, or
314 bring a background process into the foreground. That said, background
315 processes invoked from Eshell can be controlled the same way as any
316 other background process in Emacs.
317
318 @node Arguments
319 @section Arguments
320 Command arguments are passed to the functions as either strings or
321 numbers, depending on what the parser thinks they look like. If you
322 need to use a function that takes some other data type, you will need to
323 call it in an Elisp expression (which can also be used with
324 @ref{Expansion, expansions}). As with other shells, you can
325 escape special characters and spaces with the backslash (@code{\}) and
326 the single (@code{''}) and double (@code{""}) quotes.
327
328 @node Built-ins
329
330 @section Built-in commands
331 Several commands are built-in in Eshell. In order to call the
332 external variant of a built-in command @code{foo}, you could call
333 @code{*foo}. Usually, this should not be necessary. You can check
334 what will be applied by the @code{which} command:
335
336 @example
337 ~ $ which ls
338 eshell/ls is a compiled Lisp function in `em-ls.el'
339 ~ $ which *ls
340 /bin/ls
341 @end example
342
343 If you want to discard a given built-in command, you could declare an
344 alias, @ref{Aliases}. Example:
345
346 @example
347 ~ $ which sudo
348 eshell/sudo is a compiled Lisp function in `em-unix.el'
349 ~ $ alias sudo '*sudo $*'
350 ~ $ which sudo
351 sudo is an alias, defined as "*sudo $*"
352 @end example
353
354 @vindex eshell-prefer-lisp-functions
355 If you would prefer to use the built-in commands instead of the external
356 commands, set @var{eshell-prefer-lisp-functions} to @code{t}.
357
358 Some of the built-in commands have different behaviour from their
359 external counterparts, and some have no external counterpart. Most of
360 these will print a usage message when given the @code{--help} option.
361
362 @table @code
363
364 @item addpath
365 @cmindex addpath
366 Adds a given path or set of paths to the PATH environment variable, or,
367 with no arguments, prints the current paths in this variable.
368
369 @item alias
370 @cmindex alias
371 Define an alias (@pxref{Aliases}). This does not add it to the aliases
372 file.
373
374 @item date
375 @cmindex date
376 Similar to, but slightly different from, the GNU Coreutils
377 @command{date} command.
378
379 @item define
380 @cmindex define
381 Define a varalias. @xref{Variable Aliases, , , elisp}.
382
383 @item diff
384 @cmindex diff
385 Use Emacs's internal @code{diff} (not to be confused with
386 @code{ediff}). @xref{Comparing Files, , , elisp}.
387
388 @item grep
389 @cmindex grep
390 @itemx agrep
391 @cmindex agrep
392 @itemx egrep
393 @cmindex egrep
394 @itemx fgrep
395 @cmindex fgrep
396 @itemx glimpse
397 @cmindex glimpse
398 The @command{grep} commands are compatible with GNU @command{grep}, but
399 use Emacs's internal @code{grep} instead.
400
401 @item info
402 @cmindex info
403 Same as the external @command{info} command, but uses Emacs's internal
404 Info reader.
405
406 @item jobs
407 @cmindex jobs
408 List subprocesses of the Emacs process, if any, using the function
409 @code{list-processes}.
410
411 @item kill
412 @cmindex kill
413 Kill processes. Takes a PID or a process object and an optional
414 signal specifier.
415
416 @item listify
417 @cmindex listify
418 Eshell version of @code{list}. Allows you to create a list using Eshell
419 syntax, rather than Elisp syntax. For example, @samp{listify foo bar}
420 and @code{("foo" "bar")} both evaluate to @code{("foo" "bar")}.
421
422 @item locate
423 @cmindex locate
424 Alias to Emacs's @code{locate} function, which simply runs the external
425 @command{locate} command and parses the results. @xref{Dired and `find', , , elisp}.
426
427 @item make
428 @cmindex make
429 Run @command{make} through @code{compile}. @xref{Running Compilations under Emacs, , , elisp}.
430
431 @item occur
432 @cmindex occur
433 Alias to Emacs's @code{occur}. @xref{Other Search-and-Loop Commands, , , elisp}.
434
435 @item printnl
436 @cmindex printnl
437 Print the arguments separated by newlines.
438
439 @item cd
440 @cmindex cd
441 This command changes the current working directory. Usually, it is
442 invoked as @samp{cd foo} where @file{foo} is the new working directory.
443 But @command{cd} knows about a few special arguments:
444
445 When it receives no argument at all, it changes to the home directory.
446
447 Giving the command @samp{cd -} changes back to the previous working
448 directory (this is the same as @samp{cd $-}).
449
450 The command @samp{cd =} shows the directory stack. Each line is
451 numbered.
452
453 With @samp{cd =foo}, Eshell searches the directory stack for a directory
454 matching the regular expression @samp{foo} and changes to that
455 directory.
456
457 With @samp{cd -42}, you can access the directory stack by number.
458
459 @item su
460 @cmindex su
461 @itemx sudo
462 @cmindex sudo
463 Uses TRAMP's @command{su} or @command{sudo} method @pxref{Inline methods, , , tramp}
464 to run a command via @command{su} or @command{sudo}. These commands
465 are in the eshell-tramp module, which is disabled by default.
466
467 @end table
468
469 @subsection Built-in variables
470 Eshell knows a few built-in variables:
471
472 @table @code
473
474 @item $+
475 @vindex $+
476 This variable always contains the current working directory.
477
478 @item $-
479 @vindex $-
480 This variable always contains the previous working directory (the
481 current working directory from before the last @code{cd} command).
482
483 @item $_
484 @vindex $_
485 It refers to the last argument of the last command.
486
487 @item $$
488 @vindex $$
489 This is the result of the last command. In case of an external
490 command, it is @code{t} or @code{nil}.
491
492 @item $?
493 @vindex $?
494 This variable contains the exit code of the last command (0 or 1 for
495 Lisp functions, based on successful completion).
496
497 @end table
498
499 @node Variables
500 @section Variables
501 Since Eshell is just an Emacs REPL@footnote{Read-Eval-Print Loop}, it
502 does not have its own scope, and simply stores variables the same you
503 would in an Elisp program. Eshell provides a command version of
504 @code{setq} for convenience.
505
506 @node Aliases
507 @section Aliases
508
509 Aliases are commands that expand to a longer input line. For example,
510 @command{ll} is a common alias for @code{ls -l}, and would be defined
511 with the command invocation @samp{alias ll ls -l}; with this defined,
512 running @samp{ll foo} in Eshell will actually run @samp{ls -l foo}.
513 Aliases defined (or deleted) by the @command{alias} command are
514 automatically written to the file named by @var{eshell-aliases-file},
515 which you can also edit directly (although you will have to manually
516 reload it).
517
518 @node History
519 @section History
520 @cmindex history
521 The @samp{history} command shows all commands kept in the history ring
522 as numbered list. If the history ring contains
523 @code{eshell-history-size} commands, those numbers change after every
524 command invocation, therefore the @samp{history} command shall be
525 applied before using the expansion mechanism with history numbers.
526
527 The n-th entry of the history ring can be applied with the @samp{!n}
528 command. If @code{n} is negative, the entry is counted from the end
529 of the history ring.
530
531 @samp{!foo} expands to the last command beginning with @code{foo}, and
532 @samp{!?foo} to the last command containing @code{foo}. The n-th
533 argument of the last command beginning with @code{foo} is accessible
534 by @code{!foo:n}.
535
536 The history ring is loaded from a file at the start of every session,
537 and written back to the file at the end of every session. The file path
538 is specified in @var{eshell-history-file-name}. Unlike other shells,
539 such as Bash, Eshell can not be configured to keep a history ring of a
540 different size than that of the history file.
541
542 Since the default buffer navigation and searching key-bindings are
543 still present in the Eshell buffer, the commands for history
544 navigation and searching are bound to different keys:
545
546 @table @kbd
547 @item M-r
548 @itemx M-s
549 History I-search.
550
551 @item M-p
552 @itemx M-n
553 Previous and next history line. If there is anything on the input
554 line when you run these commands, they will instead jump to the
555 precious or next line that begins with that string.
556 @end table
557
558 @node Completion
559 @section Completion
560 Eshell uses the pcomplete package for programmable completion, similar
561 to that of other command shells. Argument completion differs depending
562 on the preceding command: for example, possible completions for
563 @command{rmdir} are only directories, while @command{rm} completions can
564 be directories @emph{and} files. Eshell provides predefined completions
565 for the built-in functions and some common external commands, and you
566 can define your own for any command.
567
568 Eshell completion also works for lisp forms and glob patterns. If the
569 point is on a lisp form, then @key{TAB} will behave similarly to completion
570 in @code{elisp-mode} and @code{lisp-interaction-mode}. For glob
571 patterns, If there are few enough possible completions of the patterns,
572 they will be cycled when @key{TAB} is pressed, otherwise it will be removed
573 from the input line and the possible completions will be listed.
574
575 If you want to see the entire list of possible completions when it's
576 below the cycling threshold, press @kbd{M-?}.
577
578 @subsection pcomplete
579 Pcomplete, short for programmable completion, is the completion
580 library originally written for Eshell, but usable for command
581 completion@footnote{Command completion as opposed to code completion,
582 which is a beyond the scope of pcomplete.} in other modes.
583
584 Completions are defined as functions (with @code{defun}) named
585 @code{pcomplete/COMMAND}, where @code{COMMAND} is the name of the
586 command for which this function provides completions; you can also name
587 the function @code{pcomplete/MAJOR-MODE/COMMAND} to define completions
588 for a specific major mode.
589
590 @node for loop
591 @section @code{for} loop
592 Because Eshell commands can not (easily) be combined with lisp forms,
593 Eshell provides a command-oriented @command{for}-loop for convenience.
594 The syntax is as follows:
595
596 @example
597 @code{for VAR in TOKENS @{ command invocation(s) @}}
598 @end example
599
600 where @samp{TOKENS} is a space-separated sequence of values of
601 @var{VAR} for each iteration. This can even be the output of a
602 command if @samp{TOKENS} is replaced with @samp{@{ command invocation @}}.
603
604 @node Scripts
605 @section Scripts
606 @cmindex source
607 @fnindex eshell-source-file
608 You can run Eshell scripts much like scripts for other shells; the main
609 difference is that since Eshell is not a system command, you have to run
610 it from within Emacs. An Eshell script is simply a file containing a
611 sequence of commands, as with almost any other shell script. Scripts
612 are invoked from Eshell with @command{source}, or from anywhere in Emacs
613 with @code{eshell-source-file}.
614
615 @cmindex .
616 If you wish to load a script into your @emph{current} environment,
617 rather than in a subshell, use the @code{.} command.
618
619 @node Expansion
620 @chapter Expansion
621 Expansion in a command shell is somewhat like macro expansion in macro
622 parsers (such as @command{cpp} and @command{m4}), but in a command
623 shell, they are less often used for constants, and usually for using
624 variables and string manipulation.@footnote{Eshell has no
625 string-manipulation expansions because the Elisp library already
626 provides many functions for this.} For example, @code{$var} on a line
627 expands to the value of the variable @code{var} when the line is
628 executed. Expansions are usually passed as arguments, but may also be
629 used as commands.@footnote{E.g., entering just @samp{$var} at the prompt
630 is equivalent to entering the value of @code{var} at the prompt.}
631
632 @menu
633 * Dollars Expansion::
634 * Globbing::
635 @end menu
636
637 @node Dollars Expansion
638 @section Dollars Expansion
639 Eshell has different @code{$} expansion syntax from other shells. There
640 are some similarities, but don't let these lull you into a false sense
641 of familiarity.
642
643 @table @code
644
645 @item $var
646 Expands to the value bound to @code{var}. This is the main way to use
647 variables in command invocations.
648
649 @item $#var
650 Expands to the length of the value bound to @code{var}. Raises an error
651 if the value is not a sequence (@pxref{Sequences Arrays and Vectors, Sequences, , elisp}).
652
653 @item $(lisp)
654 Expands to the result of evaluating the S-expression @code{(lisp)}. On
655 its own, this is identical to just @code{(lisp)}, but with the @code{$},
656 it can be used in a string, such as @samp{/some/path/$(lisp).txt}.
657
658 @item $@{command@}
659 Returns the output of @command{command}, which can be any valid Eshell
660 command invocation, and may even contain expansions.
661
662 @item $var[i]
663 Expands to the @code{i}th element of the value bound to @code{var}. If
664 the value is a string, it will be split at whitespace to make it a list.
665 Again, raises an error if the value is not a sequence.
666
667 @item $var[: i]
668 As above, but now splitting occurs at the colon character.
669
670 @item $var[: i j]
671 As above, but instead of returning just a string, it now returns a list
672 of two strings. If the result is being interpolated into a larger
673 string, this list will be flattened into one big string, with each
674 element separated by a space.
675
676 @item $var["\\\\" i]
677 Separate on backslash characters. Actually, the first argument -- if it
678 doesn't have the form of a number, or a plain variable name -- can be
679 any regular expression. So to split on numbers, use @samp{$var["[0-9]+" 10 20]}.
680
681 @item $var[hello]
682 Calls @code{assoc} on @code{var} with @code{"hello"}, expecting it to be
683 an alist (@pxref{Association List Type, Association Lists, , elisp}).
684
685 @item $#var[hello]
686 Returns the length of the cdr of the element of @code{var} who car is equal
687 to @code{"hello"}.
688
689 @end table
690
691 @node Globbing
692 @section Globbing
693 Eshell's globbing syntax is very similar to that of Zsh. Users coming
694 from Bash can still use Bash-style globbing, as there are no
695 incompatibilities. Most globbing is pattern-based expansion, but there
696 is also predicate-based expansion. See @ref{Filename Generation, , , zsh}
697 for full syntax. To customize the syntax and behaviour of globbing in
698 Eshell see the Customize@footnote{@xref{Customization Settings, Customize, , elisp}.}
699 groups ``eshell-glob'' and ``eshell-pred''.
700
701 @node Input/Output
702 @chapter Input/Output
703 Since Eshell does not communicate with a terminal like most command
704 shells, IO is a little different.
705
706 @section Visual Commands
707 If you try to run programs from within Eshell that are not
708 line-oriented, such as programs that use ncurses, you will just get
709 garbage output, since the Eshell buffer is not a terminal emulator.
710 Eshell solves this problem by running such programs in Emacs's
711 terminal emulator.
712
713 Programs that need a terminal to display output properly are referred
714 to in this manual as ``visual commands,'' because they are not simply
715 line-oriented. You must tell Eshell which commands are visual, by
716 adding them to @var{eshell-visual-commands}; for commands that are
717 visual for only certain @emph{sub}-commands -- e.g. @samp{git log} but
718 not @samp{git status} -- use @var{eshell-visual-subcommands}; and for
719 commands that are visual only when passed certain options, use
720 @var{eshell-visual-options}.
721
722 @section Redirection
723 Redirection is mostly the same in Eshell as it is in other command
724 shells. The output redirection operators @code{>} and @code{>>} as
725 well as pipes are supported, but there is not yet any support for
726 input redirection. Output can also be redirected to buffers, using
727 the @code{>>>} redirection operator, and Elisp functions, using
728 virtual devices.
729
730 The buffer redirection operator, @code{>>>}, expects a buffer object
731 on the right-hand side, into which it inserts the output of the
732 left-hand side. e.g., @samp{echo hello >>> #<buffer *scratch*>}
733 inserts the string @code{"hello"} into the @code{*scratch*} buffer.
734
735 @var{eshell-virtual-targets} is a list of mappings of virtual device
736 names to functions. Eshell comes with two virtual devices:
737 @file{/dev/kill}, which sends the text to the kill ring, and
738 @file{/dev/clip}, which sends text to the clipboard.
739
740 You can, of course, define your own virtual targets. They are defined
741 by adding a list of the form @code{("/dev/name" function mode)} to
742 @var{eshell-virtual-targets}. The first element is the device name;
743 @code{function} may be either a lambda or a function name. If
744 @code{mode} is nil, then the function is the output function; if it is
745 non-nil, then the function is passed the redirection mode as a
746 symbol--@code{overwrite} for @code{>}, @code{append} for @code{>>}, or
747 @code{insert} for @code{>>>}--and the function is expected to return
748 the output function.
749
750 The output function is called once on each line of output until
751 @code{nil} is passed, indicating end of output.
752
753 @node Extension modules
754 @chapter Extension modules
755 Eshell provides a facility for defining extension modules so that they
756 can be disabled and enabled without having to unload and reload them,
757 and to provide a common parent Customize group for the
758 modules.@footnote{ERC provides a similar module facility.} An Eshell
759 module is defined the same as any other library but one requirement: the
760 module must define a Customize@footnote{@xref{Customization Settings, Customize, , elisp}.}
761 group using @code{eshell-defgroup} (in place of @code{defgroup}) with
762 @code{eshell-module} as the parent group.@footnote{If the module has
763 no user-customizable options, then there is no need to define it as an
764 Eshell module.} You also need to load the following as shown:
765
766 @example
767 (eval-when-compile
768 (require 'cl)
769 (require 'esh-mode)
770 (require 'eshell))
771
772 (require 'esh-util)
773 @end example
774
775 @menu
776 * Writing a module::
777 * Module testing::
778 * Directory handling::
779 * Key rebinding::
780 * Smart scrolling::
781 * Terminal emulation::
782 @end menu
783
784 @node Writing a module
785 @section Writing a module
786
787 @node Module testing
788 @section Module testing
789
790 @node Directory handling
791 @section Directory handling
792
793 @node Key rebinding
794 @section Key rebinding
795
796 @node Smart scrolling
797 @section Smart scrolling
798
799 @node Terminal emulation
800 @section Terminal emulation
801
802 @node Bugs and ideas
803 @chapter Bugs and ideas
804 @cindex reporting bugs and ideas
805 @cindex bugs, how to report them
806 @cindex author, how to reach
807 @cindex email to the author
808 @cindex FAQ
809 @cindex problems, list of common
810 @cindex known bugs
811 @cindex bugs, known
812
813 If you find a bug or misfeature, don't hesitate to let me know! Send
814 email to @email{johnw@@gnu.org}. Feature requests should also be sent
815 there. I prefer discussing one thing at a time. If you find several
816 unrelated bugs, please report them separately.
817
818 If you have ideas for improvements, or if you have written some
819 extensions to this package, I would like to hear from you. I hope you
820 find this package useful!
821
822 Below is a complete list of known problems with Eshell version 2.4.2,
823 which is the version included with Emacs 22.
824
825 @table @asis
826 @item Documentation incomplete
827
828 @item Differentiate between aliases and functions
829
830 Allow for a Bash-compatible syntax, such as:
831
832 @example
833 alias arg=blah
834 function arg () @{ blah $* @}
835 @end example
836
837 @item @samp{for i in 1 2 3 @{ grep -q a b && *echo has it @} | wc -l} outputs result after prompt
838
839 In fact, piping to a process from a looping construct doesn't work in
840 general. If I change the call to @code{eshell-copy-handles} in
841 @code{eshell-rewrite-for-command} to use @code{eshell-protect}, it seems
842 to work, but the output occurs after the prompt is displayed. The whole
843 structured command thing is too complicated at present.
844
845 @item Error with @command{bc} in @code{eshell-test}
846
847 On some XEmacs system, the subprocess interaction test fails
848 inexplicably, although @command{bc} works fine at the command prompt.
849
850 @item Eshell does not delete @file{*Help*} buffers in XEmacs 21.1.8+
851
852 In XEmacs 21.1.8, the @file{*Help*} buffer has been renamed such that
853 multiple instances of the @file{*Help*} buffer can exist.
854
855 @item Pcomplete sometimes gets stuck
856
857 You press @key{TAB}, but no completions appear, even though the
858 directory has matching files. This behavior is rare.
859
860 @item @samp{grep python $<rpm -qa>} doesn't work, but using @samp{*grep} does
861
862 This happens because the @code{grep} Lisp function returns immediately,
863 and then the asynchronous @command{grep} process expects to examine the
864 temporary file, which has since been deleted.
865
866 @item Problem with C-r repeating text
867
868 If the text @emph{before point} reads "./run", and you type @kbd{C-r r u
869 n}, it will repeat the line for every character typed.
870
871 @item Backspace doesn't scroll back after continuing (in smart mode)
872
873 Hitting space during a process invocation, such as @command{make}, will
874 cause it to track the bottom of the output; but backspace no longer
875 scrolls back.
876
877 @item It's not possible to fully @code{unload-feature} Eshell
878
879 @item Menu support was removed, but never put back
880
881 @item Using C-p and C-n with rebind gets into a locked state
882
883 This happened a few times in Emacs 21, but has been irreproducible
884 since.
885
886 @item If an interactive process is currently running, @kbd{M-!} doesn't work
887
888 @item Use a timer instead of @code{sleep-for} when killing child processes
889
890 @item Piping to a Lisp function is not supported
891
892 Make it so that the Lisp command on the right of the pipe is repeatedly
893 called with the input strings as arguments. This will require changing
894 @code{eshell-do-pipeline} to handle non-process targets.
895
896 @item Input redirection is not supported
897
898 See the above entry.
899
900 @item Problem running @command{less} without arguments on Windows
901
902 The result in the Eshell buffer is:
903
904 @example
905 Spawning child process: invalid argument
906 @end example
907
908 Also a new @command{less} buffer was created with nothing in it@dots{}
909 (presumably this holds the output of @command{less}).
910
911 If @command{less.exe} is invoked from the Eshell command line, the
912 expected output is written to the buffer.
913
914 Note that this happens on NT-Emacs 20.6.1 on Windows 2000. The term.el
915 package and the supplied shell both use the @command{cmdproxy} program
916 for running shells.
917
918 @item Implement @samp{-r}, @samp{-n} and @samp{-s} switches for @command{cp}
919
920 @item Make @kbd{M-5 M-x eshell} switch to ``*eshell<5>*'', creating if need be
921
922 @item @samp{mv @var{dir} @var{file}.tar} does not remove directories
923
924 This is because the tar option --remove-files doesn't do so. Should it
925 be Eshell's job?
926
927 @item Bind @code{standard-output} and @code{standard-error}
928
929 This would be so that if a Lisp function calls @code{print}, everything
930 will happen as it should (albeit slowly).
931
932 @item When an extension module fails to load, @samp{cd /} gives a Lisp error
933
934 @item If a globbing pattern returns one match, should it be a list?
935
936 @item Make sure syntax table is correct in Eshell mode
937
938 So that @kbd{M-DEL} acts in a predictable manner, etc.
939
940 @item Allow all Eshell buffers to share the same history and list-dir
941
942 @item There is a problem with script commands that output to @file{/dev/null}
943
944 If a script file, somewhere in the middle, uses @samp{> /dev/null},
945 output from all subsequent commands is swallowed.
946
947 @item Split up parsing of text after @samp{$} in @file{esh-var.el}
948
949 Make it similar to the way that @file{esh-arg.el} is structured.
950 Then add parsing of @samp{$[?\n]}.
951
952 @item After pressing @kbd{M-RET}, redisplay before running the next command
953
954 @item Argument predicates and modifiers should work anywhere in a path
955
956 @example
957 /usr/local/src/editors/vim $ vi **/CVS(/)/Root(.)
958 Invalid regexp: "Unmatched ( or \\("
959 @end example
960
961 With @command{zsh}, the glob above expands to all files named
962 @file{Root} in directories named @file{CVS}.
963
964 @item Typing @samp{echo $@{locate locate@}/bin<TAB>} results in a Lisp error
965
966 Perhaps it should interpolate all permutations, and make that the
967 globbing result, since otherwise hitting return here will result in
968 ``(list of filenames)/bin'', which is never valuable. Thus, one could
969 @command{cat} only C backup files by using @samp{ls $@{identity *.c@}~}.
970 In that case, having an alias command name @command{glob} for
971 @command{identity} would be useful.
972
973 @item Once symbolic mode is supported for @command{umask}, implement @command{chmod} in Lisp
974
975 @item Create @code{eshell-expand-file-name}
976
977 This would use a data table to transform things such as @samp{~+},
978 @samp{...}, etc.
979
980 @item Abstract @file{em-smart.el} into @file{smart-scroll.el}
981
982 It only really needs: to be hooked onto the output filter and the
983 pre-command hook, and to have the input-end and input-start markers.
984 And to know whether the last output group was ``successful.''
985
986 @item Allow for fully persisting the state of Eshell
987
988 This would include: variables, history, buffer, input, dir stack, etc.
989
990 @item Implement D as an argument predicate
991
992 It means that files beginning with a dot should be included in the
993 glob match.
994
995 @item A comma in a predicate list should mean OR
996
997 At the moment, this is not supported.
998
999 @item Error if a glob doesn't expand due to a predicate
1000
1001 An error should be generated only if @code{eshell-error-if-no-glob} is
1002 non-@code{nil}.
1003
1004 @item @samp{(+ RET SPC TAB} does not cause @code{indent-according-to-mode} to occur
1005
1006 @item Create @code{eshell-auto-accumulate-list}
1007
1008 This is a list of commands for which, if the user presses @kbd{RET}, the
1009 text is staged as the next Eshell command, rather than being sent to the
1010 current interactive process.
1011
1012 @item Display file and line number if an error occurs in a script
1013
1014 @item @command{wait} doesn't work with process ids at the moment
1015
1016 @item Enable the direct-to-process input code in @file{em-term.el}
1017
1018 @item Problem with repeating @samp{echo $@{find /tmp@}}
1019
1020 With smart display active, if @kbd{RET} is held down, after a while it
1021 can't keep up anymore and starts outputting blank lines. It only
1022 happens if an asynchronous process is involved@dots{}
1023
1024 I think the problem is that @code{eshell-send-input} is resetting the
1025 input target location, so that if the asynchronous process is not done
1026 by the time the next @kbd{RET} is received, the input processor thinks
1027 that the input is meant for the process; which, when smart display is
1028 enabled, will be the text of the last command line! That is a bug in
1029 itself.
1030
1031 In holding down @kbd{RET} while an asynchronous process is running,
1032 there will be a point in between termination of the process, and the
1033 running of @code{eshell-post-command-hook}, which would cause
1034 @code{eshell-send-input} to call @code{eshell-copy-old-input}, and then
1035 process that text as a command to be run after the process. Perhaps
1036 there should be a way of killing pending input between the death of the
1037 process, and the @code{post-command-hook}.
1038
1039 @item Allow for a more aggressive smart display mode
1040
1041 Perhaps toggled by a command, that makes each output block a smart
1042 display block.
1043
1044 @item Create more meta variables
1045
1046 @table @samp
1047 @item $!
1048 The reason for the failure of the last disk command, or the text of the
1049 last Lisp error.
1050
1051 @item $=
1052 A special associate array, which can take references of the form
1053 @samp{$=[REGEXP]}. It indexes into the directory ring.
1054 @end table
1055
1056 @item Eshell scripts can't execute in the background
1057
1058 @item Support zsh's ``Parameter Expansion'' syntax, i.e., @samp{$@{@var{name}:-@var{val}@}}
1059
1060 @item Write an @command{info} alias that can take arguments
1061
1062 So that the user can enter @samp{info chmod}, for example.
1063
1064 @item Create a mode @code{eshell-browse}
1065
1066 It would treat the Eshell buffer as a outline. Collapsing the outline
1067 hides all of the output text. Collapsing again would show only the
1068 first command run in each directory
1069
1070 @item Allow other revisions of a file to be referenced using @samp{file@{rev@}}
1071
1072 This would be expanded by @code{eshell-expand-file-name} (see above).
1073
1074 @item Print ``You have new mail'' when the ``Mail'' icon is turned on
1075
1076 @item Implement @kbd{M-|} for Eshell
1077
1078 @item Implement input redirection
1079
1080 If it's a Lisp function, input redirection implies @command{xargs} (in a
1081 way@dots{}). If input redirection is added, also update the
1082 @code{file-name-quote-list}, and the delimiter list.
1083
1084 @item Allow @samp{#<@var{word} @var{arg}>} as a generic syntax
1085
1086 With the handling of @emph{word} specified by an
1087 @code{eshell-special-alist}.
1088
1089 @item In @code{eshell-eval-using-options}, allow a @code{:complete} tag
1090
1091 It would be used to provide completion rules for that command. Then the
1092 macro will automagically define the completion function.
1093
1094 @item For @code{eshell-command-on-region}, apply redirections to the result
1095
1096 So that @samp{+ > 'blah} would cause the result of the @code{+} (using
1097 input from the current region) to be inserting into the symbol
1098 @code{blah}.
1099
1100 If an external command is being invoked, the input is sent as standard
1101 input, as if a @samp{cat <region> |} had been invoked.
1102
1103 If a Lisp command, or an alias, is invoked, then if the line has no
1104 newline characters, it is divided by whitespace and passed as arguments
1105 to the Lisp function. Otherwise, it is divided at the newline
1106 characters. Thus, invoking @code{+} on a series of numbers will add
1107 them; @code{min} would display the smallest figure, etc.
1108
1109 @item Write @code{eshell-script-mode} as a minor mode
1110
1111 It would provide syntax, abbrev, highlighting and indenting support like
1112 @code{emacs-lisp-mode} and @code{shell-mode}.
1113
1114 @item In the history mechanism, finish the Bash-style support
1115
1116 This means @samp{!n}, @samp{!#}, @samp{!:%}, and @samp{!:1-} as separate
1117 from @samp{!:1*}.
1118
1119 @item Support the -n command line option for @command{history}
1120
1121 @item Implement @command{fc} in Lisp
1122
1123 @item Specifying a frame as a redirection target should imply the currently active window's buffer
1124
1125 @item Implement @samp{>@var{func-or-func-list}}
1126
1127 This would allow for an ``output translators'', that take a function to
1128 modify output with, and a target. Devise a syntax that works well with
1129 pipes, and can accommodate multiple functions (i.e., @samp{>'(upcase
1130 regexp-quote)} or @samp{>'upcase}).
1131
1132 @item Allow Eshell to read/write to/from standard input and output
1133
1134 This would be optional, rather than always using the Eshell buffer.
1135 This would allow it to be run from the command line (perhaps).
1136
1137 @item Write a @command{help} command
1138
1139 It would call subcommands with @option{--help}, or @option{-h} or
1140 @option{/?}, as appropriate.
1141
1142 @item Implement @command{stty} in Lisp
1143
1144 @item Support @command{rc}'s matching operator, e.g., @samp{~ (@var{list}) @var{regexp}}
1145
1146 @item Implement @command{bg} and @command{fg} as editors of @code{eshell-process-list}
1147
1148 Using @command{bg} on a process that is already in the background does
1149 nothing. Specifying redirection targets replaces (or adds) to the list
1150 current being used.
1151
1152 @item Have @command{jobs} print only the processes for the current shell
1153
1154 @item How can Eshell learn if a background process has requested input?
1155
1156 @item Support @samp{2>&1} and @samp{>&} and @samp{2>} and @samp{|&}
1157
1158 The syntax table for parsing these should be customizable, such that the
1159 user could change it to use rc syntax: @samp{>[2=1]}.
1160
1161 @item Allow @samp{$_[-1]}, which would indicate the last element of the array
1162
1163 @item Make @samp{$x[*]} equal to listing out the full contents of @samp{x}
1164
1165 Return them as a list, so that @samp{$_[*]} is all the arguments of the
1166 last command.
1167
1168 @item Copy ANSI code handling from @file{term.el} into @file{em-term.el}
1169
1170 Make it possible for the user to send char-by-char to the underlying
1171 process. Ultimately, I should be able to move away from using term.el
1172 altogether, since everything but the ANSI code handling is already part
1173 of Eshell. Then, things would work correctly on MS-Windows as well
1174 (which doesn't have @file{/bin/sh}, although @file{term.el} tries to use
1175 it).
1176
1177 @item Make the shell spawning commands be visual
1178
1179 That is, make (@command{su}, @command{bash}, @command{telnet},
1180 @command{rlogin}, @command{rsh}, etc.)@: be part of
1181 @code{eshell-visual-commands}. The only exception is if the shell is
1182 being used to invoke a single command. Then, the behavior should be
1183 based on what that command is.
1184
1185 @item Create a smart viewing command named @command{open}
1186
1187 This would search for some way to open its argument (similar to opening
1188 a file in the Windows Explorer).
1189
1190 @item Alias @command{read} to be the same as @command{open}, only read-only
1191
1192 @item Write a @command{tail} command which uses @code{view-file}
1193
1194 It would move point to the end of the buffer, and then turns on
1195 auto-revert mode in that buffer at frequent intervals---and a
1196 @command{head} alias which assumes an upper limit of
1197 @code{eshell-maximum-line-length} characters per line.
1198
1199 @item Make @command{dgrep} load @code{dired}, mark everything, then invoke @code{dired-do-search}
1200
1201 @item Write mesh.c
1202
1203 This would run Emacs with the appropriate arguments to invoke Eshell
1204 only. That way, it could be listed as a login shell.
1205
1206 @item Use an intangible @code{PS2} string for multi-line input prompts
1207
1208 @item Auto-detect when a command is visual, by checking @code{TERMCAP} usage
1209
1210 @item The first keypress after @kbd{M-x watson} triggers `eshell-send-input'
1211
1212 @item Make @kbd{/} electric
1213
1214 So that it automatically expands and corrects pathnames. Or make
1215 pathname completion for Pcomplete auto-expand @samp{/u/i/std<TAB>} to
1216 @samp{/usr/include/std<TAB>}.
1217
1218 @item Write the @command{pushd} stack to disk along with @code{last-dir-ring}
1219
1220 @item Add options to @code{eshell/cat} which would allow it to sort and uniq
1221
1222 @item Implement @command{wc} in Lisp
1223
1224 Add support for counting sentences, paragraphs, pages, etc.
1225
1226 @item Once piping is added, implement @command{sort} and @command{uniq} in Lisp
1227
1228 @item Implement @command{touch} in Lisp
1229
1230 @item Implement @command{comm} in Lisp
1231
1232 @item Implement an @command{epatch} command in Lisp
1233
1234 This would call @code{ediff-patch-file}, or @code{ediff-patch-buffer},
1235 depending on its argument.
1236
1237 @item Have an option such that @samp{ls -l} generates a dired buffer
1238
1239 @item Write a version of @command{xargs} based on command rewriting
1240
1241 That is, @samp{find X | xargs Y} would be indicated using @samp{Y
1242 $@{find X@}}. Maybe @code{eshell-do-pipelines} could be changed to
1243 perform this on-thy-fly rewriting.
1244
1245 @item Write an alias for @command{less} that brings up a @code{view-mode} buffer
1246
1247 Such that the user can press @key{SPC} and @key{DEL}, and then @key{q}
1248 to return to Eshell. It would be equivalent to:
1249 @samp{X > #<buffer Y>; view-buffer #<buffer Y>}.
1250
1251 @item Make @code{eshell-mode} as much a full citizen as @code{shell-mode}
1252
1253 Everywhere in Emacs where @code{shell-mode} is specially noticed, add
1254 @code{eshell-mode} there.
1255
1256 @item Permit the umask to be selectively set on a @command{cp} target
1257
1258 @item Problem using @kbd{M-x eshell} after using @code{eshell-command}
1259
1260 If the first thing that I do after entering Emacs is to run
1261 @code{eshell-command} and invoke @command{ls}, and then use @kbd{M-x
1262 eshell}, it doesn't display anything.
1263
1264 @item @kbd{M-RET} during a long command (using smart display) doesn't work
1265
1266 Since it keeps the cursor up where the command was invoked.
1267
1268 @end table
1269
1270 @node GNU Free Documentation License
1271 @appendix GNU Free Documentation License
1272 @include doclicense.texi
1273
1274 @node Concept Index
1275 @unnumbered Concept Index
1276
1277 @printindex cp
1278
1279 @node Function and Variable Index
1280 @unnumbered Function and Variable Index
1281
1282 @printindex fn
1283
1284 @node Command Index
1285 @unnumbered Command Index
1286
1287 @printindex cm
1288
1289 @node Key Index
1290 @unnumbered Key Index
1291
1292 @printindex ky
1293 @bye