Escape an `@'.
[bpt/emacs.git] / man / mule.texi
CommitLineData
6bf7aab6 1@c This is part of the Emacs manual.
9952f1f8 2@c Copyright (C) 1997, 1999, 2000, 2001 Free Software Foundation, Inc.
6bf7aab6
DL
3@c See file emacs.texi for copying conditions.
4@node International, Major Modes, Frames, Top
5@chapter International Character Set Support
6@cindex MULE
7@cindex international scripts
8@cindex multibyte characters
9@cindex encoding of characters
10
cca7bf28 11@cindex Celtic
6bf7aab6 12@cindex Chinese
fbc164de 13@cindex Cyrillic
cca7bf28 14@cindex Czech
6bf7aab6
DL
15@cindex Devanagari
16@cindex Hindi
17@cindex Marathi
fbc164de 18@cindex Ethiopic
cca7bf28 19@cindex German
6bf7aab6 20@cindex Greek
fbc164de 21@cindex Hebrew
6bf7aab6
DL
22@cindex IPA
23@cindex Japanese
24@cindex Korean
25@cindex Lao
cca7bf28
EZ
26@cindex Latin
27@cindex Polish
28@cindex Romanian
29@cindex Slovak
30@cindex Slovenian
6bf7aab6
DL
31@cindex Thai
32@cindex Tibetan
cca7bf28 33@cindex Turkish
6bf7aab6 34@cindex Vietnamese
732b9cdd
GM
35@cindex Dutch
36@cindex Spanish
6bf7aab6
DL
37 Emacs supports a wide variety of international character sets,
38including European variants of the Latin alphabet, as well as Chinese,
fbc164de
PE
39Cyrillic, Devanagari (Hindi and Marathi), Ethiopic, Greek, Hebrew, IPA,
40Japanese, Korean, Lao, Thai, Tibetan, and Vietnamese scripts. These features
6bf7aab6
DL
41have been merged from the modified version of Emacs known as MULE (for
42``MULti-lingual Enhancement to GNU Emacs'')
43
9d9c2e39 44 Emacs also supports various encodings of these characters used by
4b40407a 45other internationalized software, such as word processors and mailers.
9d9c2e39 46
8561e53a
EZ
47 Emacs allows editing text with international characters by supporting
48all the related activities:
49
50@itemize @bullet
51@item
52You can visit files with non-ASCII characters, save non-ASCII text, and
53pass non-ASCII text between Emacs and programs it invokes (such as
54compilers, spell-checkers, and mailers). Setting your language
55environment (@pxref{Language Environments}) takes care of setting up the
56coding systems and other options for a specific language or culture.
57Alternatively, you can specify how Emacs should encode or decode text
58for each command; see @ref{Specify Coding}.
59
60@item
61You can display non-ASCII characters encoded by the various scripts.
62This works by using appropriate fonts on X and similar graphics
63displays (@pxref{Defining Fontsets}), and by sending special codes to
64text-only displays (@pxref{Specify Coding}). If some characters are
65displayed incorrectly, refer to @ref{Undisplayable Characters}, which
66describes possible problems and explains how to solve them.
67
68@item
69You can insert non-ASCII characters or search for them. To do that,
70you can specify an input method (@pxref{Select Input Method}) suitable
71for your language, or use the default input method set up when you set
72your language environment. (Emacs input methods are part of the Leim
73package, which must be installed for you to be able to use them.) If
74your keyboard can produce non-ASCII characters, you can select an
75appropriate keyboard coding system (@pxref{Specify Coding}), and Emacs
76will accept those characters. Latin-1 characters can also be input by
77using the @kbd{C-x 8} prefix, see @ref{Single-Byte Character Support,
579cb67d 78C-x 8}. On X Window systems, your locale should be set to an
e20b7447 79appropriate value to make sure Emacs interprets keyboard input
afcdd7bd 80correctly; see @ref{Language Environments, locales}.
8561e53a
EZ
81@end itemize
82
83 The rest of this chapter describes these issues in detail.
84
6bf7aab6 85@menu
cb1fa3f5 86* International Chars:: Basic concepts of multibyte characters.
6bf7aab6
DL
87* Enabling Multibyte:: Controlling whether to use multibyte characters.
88* Language Environments:: Setting things up for the language you use.
89* Input Methods:: Entering text characters not on your keyboard.
90* Select Input Method:: Specifying your choice of input methods.
91* Multibyte Conversion:: How single-byte characters convert to multibyte.
92* Coding Systems:: Character set conversion when you read and
93 write files, and so on.
94* Recognize Coding:: How Emacs figures out which conversion to use.
95* Specify Coding:: Various ways to choose which conversion to use.
96* Fontsets:: Fontsets are collections of fonts
97 that cover the whole spectrum of characters.
98* Defining Fontsets:: Defining a new fontset.
60245086 99* Undisplayable Characters:: When characters don't display.
521ab838 100* Single-Byte Character Support::
6bf7aab6
DL
101 You can pick one European character set
102 to use without multibyte characters.
52254d1a 103* Charsets:: How Emacs groups its internal character codes.
6bf7aab6
DL
104@end menu
105
cb1fa3f5 106@node International Chars
6bf7aab6
DL
107@section Introduction to International Character Sets
108
2565a55e
EZ
109 The users of international character sets and scripts have established
110many more-or-less standard coding systems for storing files. Emacs
111internally uses a single multibyte character encoding, so that it can
112intermix characters from all these scripts in a single buffer or string.
113This encoding represents each non-ASCII character as a sequence of bytes
114in the range 0200 through 0377. Emacs translates between the multibyte
115character encoding and various other coding systems when reading and
116writing files, when exchanging data with subprocesses, and (in some
117cases) in the @kbd{C-q} command (@pxref{Multibyte Conversion}).
6bf7aab6
DL
118
119@kindex C-h h
120@findex view-hello-file
457b792c 121@cindex undisplayable characters
4b40407a 122@cindex @samp{?} in display
6bf7aab6
DL
123 The command @kbd{C-h h} (@code{view-hello-file}) displays the file
124@file{etc/HELLO}, which shows how to say ``hello'' in many languages.
4b40407a
RS
125This illustrates various scripts. If some characters can't be
126displayed on your terminal, they appear as @samp{?} or as hollow boxes
127(@pxref{Undisplayable Characters}).
128
129 Keyboards, even in the countries where these character sets are used,
130generally don't have keys for all the characters in them. So Emacs
131supports various @dfn{input methods}, typically one for each script or
132language, to make it convenient to type them.
133
134@kindex C-x RET
135 The prefix key @kbd{C-x @key{RET}} is used for commands that pertain
136to multibyte characters, coding systems, and input methods.
137
6bf7aab6
DL
138@node Enabling Multibyte
139@section Enabling Multibyte Characters
140
8561e53a 141@cindex turn multibyte support on or off
6bf7aab6
DL
142 You can enable or disable multibyte character support, either for
143Emacs as a whole, or for a single buffer. When multibyte characters are
144disabled in a buffer, then each byte in that buffer represents a
145character, even codes 0200 through 0377. The old features for
146supporting the European character sets, ISO Latin-1 and ISO Latin-2,
147work as they did in Emacs 19 and also work for the other ISO 8859
148character sets.
149
150 However, there is no need to turn off multibyte character support to
151use ISO Latin; the Emacs multibyte character set includes all the
152characters in these character sets, and Emacs can translate
153automatically to and from the ISO codes.
154
8561e53a
EZ
155 By default, Emacs starts in multibyte mode, because that allows you to
156use all the supported languages and scripts without limitations.
157
6bf7aab6
DL
158 To edit a particular file in unibyte representation, visit it using
159@code{find-file-literally}. @xref{Visiting}. To convert a buffer in
160multibyte representation into a single-byte representation of the same
161characters, the easiest way is to save the contents in a file, kill the
162buffer, and find the file again with @code{find-file-literally}. You
163can also use @kbd{C-x @key{RET} c}
164(@code{universal-coding-system-argument}) and specify @samp{raw-text} as
165the coding system with which to find or save a file. @xref{Specify
166Coding}. Finding a file as @samp{raw-text} doesn't disable format
167conversion, uncompression and auto mode selection as
168@code{find-file-literally} does.
169
170@vindex enable-multibyte-characters
171@vindex default-enable-multibyte-characters
172 To turn off multibyte character support by default, start Emacs with
173the @samp{--unibyte} option (@pxref{Initial Options}), or set the
60a96371 174environment variable @env{EMACS_UNIBYTE}. You can also customize
6bf7aab6 175@code{enable-multibyte-characters} or, equivalently, directly set the
8561e53a
EZ
176variable @code{default-enable-multibyte-characters} to @code{nil} in
177your init file to have basically the same effect as @samp{--unibyte}.
178
179@findex toggle-enable-multibyte-characters
180 To convert a unibyte session to a multibyte session, set
181@code{default-enable-multibyte-characters} to @code{t}. Buffers which
182were created in the unibyte session before you turn on multibyte support
183will stay unibyte. You can turn on multibyte support in a specific
184buffer by invoking the command @code{toggle-enable-multibyte-characters}
185in that buffer.
6bf7aab6 186
576f17ff
EZ
187@cindex Lisp files, and multibyte operation
188@cindex multibyte operation, and Lisp files
189@cindex unibyte operation, and Lisp files
190@cindex init file, and non-ASCII characters
191@cindex environment variables, and non-ASCII characters
4b40407a
RS
192 With @samp{--unibyte}, multibyte strings are not created during
193initialization from the values of environment variables,
194@file{/etc/passwd} entries etc.@: that contain non-ASCII 8-bit
195characters.
196
197 Emacs normally loads Lisp files as multibyte, regardless of whether
198you used @samp{--unibyte}. This includes the Emacs initialization
199file, @file{.emacs}, and the initialization files of Emacs packages
200such as Gnus. However, you can specify unibyte loading for a
12de6e26
EZ
201particular Lisp file, by putting @w{@samp{-*-unibyte: t;-*-}} in a
202comment on the first line. Then that file is always loaded as unibyte
203text, even if you did not start Emacs with @samp{--unibyte}. The
204motivation for these conventions is that it is more reliable to always
205load any particular Lisp file in the same way. However, you can load
206a Lisp file as unibyte, on any one occasion, by typing @kbd{C-x
207@key{RET} c raw-text @key{RET}} immediately before loading it.
6bf7aab6
DL
208
209 The mode line indicates whether multibyte character support is enabled
210in the current buffer. If it is, there are two or more characters (most
211often two dashes) before the colon near the beginning of the mode line.
212When multibyte characters are not enabled, just one dash precedes the
213colon.
214
215@node Language Environments
216@section Language Environments
217@cindex language environments
218
219 All supported character sets are supported in Emacs buffers whenever
220multibyte characters are enabled; there is no need to select a
221particular language in order to display its characters in an Emacs
222buffer. However, it is important to select a @dfn{language environment}
223in order to set various defaults. The language environment really
224represents a choice of preferred script (more or less) rather than a
225choice of language.
226
227 The language environment controls which coding systems to recognize
228when reading text (@pxref{Recognize Coding}). This applies to files,
229incoming mail, netnews, and any other text you read into Emacs. It may
230also specify the default coding system to use when you create a file.
231Each language environment also specifies a default input method.
232
233@findex set-language-environment
fbc164de 234@vindex current-language-environment
65b4fec5 235 To select a language environment, you can customize the variable
fbc164de 236@code{current-language-environment} or use the command @kbd{M-x
6bf7aab6
DL
237set-language-environment}. It makes no difference which buffer is
238current when you use this command, because the effects apply globally to
239the Emacs session. The supported language environments include:
240
60245086 241@cindex Euro sign
4c2b3186 242@cindex UTF-8
6bf7aab6 243@quotation
fbc164de 244Chinese-BIG5, Chinese-CNS, Chinese-GB, Cyrillic-ALT, Cyrillic-ISO,
ea6f077a
RS
245Cyrillic-KOI8, Czech, Devanagari, Dutch, English, Ethiopic, German,
246Greek, Hebrew, IPA, Japanese, Korean, Lao, Latin-1, Latin-2, Latin-3,
247Latin-4, Latin-5, Latin-8 (Celtic), Latin-9 (updated Latin-1, with the
4c2b3186
EZ
248Euro sign), Polish, Romanian, Slovak, Slovenian, Spanish, Thai, Tibetan,
249Turkish, UTF-8 (for a setup which prefers Unicode characters and files
250encoded in UTF-8), and Vietnamese.
6bf7aab6
DL
251@end quotation
252
4b40407a 253@cindex fonts for various scripts
0d314165 254@cindex Intlfonts package, installation
4b40407a
RS
255 To display the script(s) used by your language environment on a
256graphical display, you need to have a suitable font. If some of the
257characters appear as empty boxes, you should install the GNU Intlfonts
0d314165
EZ
258package, which includes fonts for all supported scripts.@footnote{If
259you run Emacs on X, you need to inform the X server about the location
260of the newly installed fonts with the following commands:
261
262@example
263 xset fp+ /usr/local/share/emacs/fonts
264 xset fp rehash
265@end example
266}
4b40407a 267@xref{Fontsets}, for more details about setting up your fonts.
9aeaea42 268
fbc164de
PE
269@findex set-locale-environment
270@vindex locale-language-names
271@vindex locale-charset-language-names
60245086 272@cindex locales
80f0ce09
EZ
273 Some operating systems let you specify the character-set locale you
274are using by setting the locale environment variables @env{LC_ALL},
275@env{LC_CTYPE}, or @env{LANG}.@footnote{If more than one of these is
276set, the first one that is nonempty specifies your locale for this
277purpose.} During startup, Emacs looks up your character-set locale's
278name in the system locale alias table, matches its canonical name
279against entries in the value of the variables
280@code{locale-charset-language-names} and @code{locale-language-names},
281and selects the corresponding language environment if a match is found.
282(The former variable overrides the latter.) It also adjusts the display
579cb67d
EZ
283table and terminal coding system, the locale coding system, the
284preferred coding system as needed for the locale, and---last but not
285least---the way Emacs decodes non-ASCII characters sent by your keyboard.
4b40407a
RS
286
287 If you modify the @env{LC_ALL}, @env{LC_CTYPE}, or @env{LANG}
288environment variables while running Emacs, you may want to invoke the
a9749dab 289@code{set-locale-environment} function afterwards to readjust the
4b40407a 290language environment from the new locale.
fa71a532 291
fbc164de
PE
292@vindex locale-preferred-coding-systems
293 The @code{set-locale-environment} function normally uses the preferred
294coding system established by the language environment to decode system
295messages. But if your locale matches an entry in the variable
296@code{locale-preferred-coding-systems}, Emacs uses the corresponding
297coding system instead. For example, if the locale @samp{ja_JP.PCK}
298matches @code{japanese-shift-jis} in
299@code{locale-preferred-coding-systems}, Emacs uses that encoding even
300though it might normally use @code{japanese-iso-8bit}.
301
4b40407a
RS
302 You can override the language environment chosen at startup with
303explicit use of the command @code{set-language-environment}, or with
304customization of @code{current-language-environment} in your init
305file.
6bf7aab6
DL
306
307@kindex C-h L
308@findex describe-language-environment
309 To display information about the effects of a certain language
310environment @var{lang-env}, use the command @kbd{C-h L @var{lang-env}
311@key{RET}} (@code{describe-language-environment}). This tells you which
312languages this language environment is useful for, and lists the
313character sets, coding systems, and input methods that go with it. It
314also shows some sample text to illustrate scripts used in this language
315environment. By default, this command describes the chosen language
316environment.
317
318@vindex set-language-environment-hook
319 You can customize any language environment with the normal hook
320@code{set-language-environment-hook}. The command
321@code{set-language-environment} runs that hook after setting up the new
322language environment. The hook functions can test for a specific
323language environment by checking the variable
0d314165
EZ
324@code{current-language-environment}. This hook is where you should
325put non-default settings for specific language environment, such as
326coding systems for keyboard input and terminal output, the default
327input method, etc.
6bf7aab6
DL
328
329@vindex exit-language-environment-hook
330 Before it starts to set up the new language environment,
331@code{set-language-environment} first runs the hook
332@code{exit-language-environment-hook}. This hook is useful for undoing
333customizations that were made with @code{set-language-environment-hook}.
334For instance, if you set up a special key binding in a specific language
335environment using @code{set-language-environment-hook}, you should set
336up @code{exit-language-environment-hook} to restore the normal binding
337for that key.
338
339@node Input Methods
340@section Input Methods
341
342@cindex input methods
343 An @dfn{input method} is a kind of character conversion designed
344specifically for interactive input. In Emacs, typically each language
345has its own input method; sometimes several languages which use the same
346characters can share one input method. A few languages support several
347input methods.
348
0d314165 349 The simplest kind of input method works by mapping ASCII letters
a9749dab
RS
350into another alphabet; this allows you to use one other alphabet
351instead of ASCII. The Greek and Russian input methods
352work this way.
6bf7aab6
DL
353
354 A more powerful technique is composition: converting sequences of
355characters into one letter. Many European input methods use composition
356to produce a single non-ASCII letter from a sequence that consists of a
357letter followed by accent characters (or vice versa). For example, some
358methods convert the sequence @kbd{a'} into a single accented letter.
359These input methods have no special commands of their own; all they do
360is compose sequences of printing characters.
361
362 The input methods for syllabic scripts typically use mapping followed
363by composition. The input methods for Thai and Korean work this way.
364First, letters are mapped into symbols for particular sounds or tone
365marks; then, sequences of these which make up a whole syllable are
366mapped into one syllable sign.
367
368 Chinese and Japanese require more complex methods. In Chinese input
369methods, first you enter the phonetic spelling of a Chinese word (in
27b81dec
EZ
370input method @code{chinese-py}, among others), or a sequence of
371portions of the character (input methods @code{chinese-4corner} and
a9749dab
RS
372@code{chinese-sw}, and others). One input sequence typically
373corresponds to many possible Chinese characters. You select the one
27b81dec
EZ
374you mean using keys such as @kbd{C-f}, @kbd{C-b}, @kbd{C-n},
375@kbd{C-p}, and digits, which have special meanings in this situation.
376
377 The possible characters are conceptually arranged in several rows,
378with each row holding up to 10 alternatives. Normally, Emacs displays
379just one row at a time, in the echo area; @code{(@var{i}/@var{j})}
380appears at the beginning, to indicate that this is the @var{i}th row
381out of a total of @var{j} rows. Type @kbd{C-n} or @kbd{C-p} to
382display the next row or the previous row.
383
384 Type @kbd{C-f} and @kbd{C-b} to move forward and backward among
385the alternatives in the current row. As you do this, Emacs highlights
386the current alternative with a special color; type @code{C-@key{SPC}}
387to select the current alternative and use it as input. The
388alternatives in the row are also numbered; the number appears before
389the alternative. Typing a digit @var{n} selects the @var{n}th
390alternative of the current row and uses it as input.
391
392 @key{TAB} in these Chinese input methods displays a buffer showing
393all the possible characters at once; then clicking @kbd{Mouse-2} on
394one of them selects that alternative. The keys @kbd{C-f}, @kbd{C-b},
a9749dab
RS
395@kbd{C-n}, @kbd{C-p}, and digits continue to work as usual, but they
396do the highlighting in the buffer showing the possible characters,
397rather than in the echo area.
27b81dec
EZ
398
399 In Japanese input methods, first you input a whole word using
400phonetic spelling; then, after the word is in the buffer, Emacs
401converts it into one or more characters using a large dictionary. One
402phonetic spelling corresponds to a number of different Japanese words;
403to select one of them, use @kbd{C-n} and @kbd{C-p} to cycle through
6bf7aab6
DL
404the alternatives.
405
406 Sometimes it is useful to cut off input method processing so that the
407characters you have just entered will not combine with subsequent
408characters. For example, in input method @code{latin-1-postfix}, the
409sequence @kbd{e '} combines to form an @samp{e} with an accent. What if
410you want to enter them as separate characters?
411
12de6e26 412 One way is to type the accent twice; this is a special feature for
6bf7aab6
DL
413entering the separate letter and accent. For example, @kbd{e ' '} gives
414you the two characters @samp{e'}. Another way is to type another letter
415after the @kbd{e}---something that won't combine with that---and
416immediately delete it. For example, you could type @kbd{e e @key{DEL}
417'} to get separate @samp{e} and @samp{'}.
418
419 Another method, more general but not quite as easy to type, is to use
420@kbd{C-\ C-\} between two characters to stop them from combining. This
421is the command @kbd{C-\} (@code{toggle-input-method}) used twice.
422@ifinfo
423@xref{Select Input Method}.
424@end ifinfo
425
0d314165 426@cindex incremental search, input method interference
6bf7aab6
DL
427 @kbd{C-\ C-\} is especially useful inside an incremental search,
428because it stops waiting for more characters to combine, and starts
429searching for what you have already entered.
430
431@vindex input-method-verbose-flag
432@vindex input-method-highlight-flag
433 The variables @code{input-method-highlight-flag} and
ea6f077a
RS
434@code{input-method-verbose-flag} control how input methods explain
435what is happening. If @code{input-method-highlight-flag} is
436non-@code{nil}, the partial sequence is highlighted in the buffer (for
437most input methods---some disable this feature). If
438@code{input-method-verbose-flag} is non-@code{nil}, the list of
439possible characters to type next is displayed in the echo area (but
440not when you are in the minibuffer).
6bf7aab6 441
98c271eb 442@cindex Leim package
4b40407a
RS
443 Input methods are implemented in the separate Leim package: they are
444available only if the system administrator used Leim when building
445Emacs. If Emacs was built without Leim, you will find that no input
446methods are defined.
98c271eb 447
6bf7aab6
DL
448@node Select Input Method
449@section Selecting an Input Method
450
451@table @kbd
452@item C-\
453Enable or disable use of the selected input method.
454
455@item C-x @key{RET} C-\ @var{method} @key{RET}
456Select a new input method for the current buffer.
457
458@item C-h I @var{method} @key{RET}
459@itemx C-h C-\ @var{method} @key{RET}
460@findex describe-input-method
461@kindex C-h I
462@kindex C-h C-\
463Describe the input method @var{method} (@code{describe-input-method}).
67320f8d
DL
464By default, it describes the current input method (if any). This
465description should give you the full details of how to use any
a39fb83d 466particular input method.
6bf7aab6
DL
467
468@item M-x list-input-methods
469Display a list of all the supported input methods.
470@end table
471
472@findex set-input-method
473@vindex current-input-method
474@kindex C-x RET C-\
475 To choose an input method for the current buffer, use @kbd{C-x
476@key{RET} C-\} (@code{set-input-method}). This command reads the
12de6e26 477input method name from the minibuffer; the name normally starts with the
6bf7aab6
DL
478language environment that it is meant to be used with. The variable
479@code{current-input-method} records which input method is selected.
480
481@findex toggle-input-method
482@kindex C-\
483 Input methods use various sequences of ASCII characters to stand for
484non-ASCII characters. Sometimes it is useful to turn off the input
485method temporarily. To do this, type @kbd{C-\}
486(@code{toggle-input-method}). To reenable the input method, type
487@kbd{C-\} again.
488
489 If you type @kbd{C-\} and you have not yet selected an input method,
490it prompts for you to specify one. This has the same effect as using
491@kbd{C-x @key{RET} C-\} to specify an input method.
492
dbee590b
EZ
493 When invoked with a numeric argument, as in @kbd{C-u C-\},
494@code{toggle-input-method} always prompts you for an input method,
495suggesting the most recently selected one as the default.
496
6bf7aab6
DL
497@vindex default-input-method
498 Selecting a language environment specifies a default input method for
499use in various buffers. When you have a default input method, you can
500select it in the current buffer by typing @kbd{C-\}. The variable
501@code{default-input-method} specifies the default input method
502(@code{nil} means there is none).
503
0d314165
EZ
504 In some language environments, which support several different input
505methods, you might want to use an input method different from the
506default chosen by @code{set-language-environment}. You can instruct
507Emacs to select a different default input method for a certain
ea6f077a 508language environment, if you wish, by using
0d314165
EZ
509@code{set-language-environment-hook} (@pxref{Language Environments,
510set-language-environment-hook}). For example:
511
512@lisp
513(defun my-chinese-setup ()
514 "Set up my private Chinese environment."
515 (if (equal current-language-environment "Chinese-GB")
516 (setq default-input-method "chinese-tonepy")))
517(add-hook 'set-language-environment-hook 'my-chinese-setup)
518@end lisp
519
520@noindent
521This sets the default input method to be @code{chinese-tonepy}
522whenever you choose a Chinese-GB language environment.
523
6bf7aab6
DL
524@findex quail-set-keyboard-layout
525 Some input methods for alphabetic scripts work by (in effect)
526remapping the keyboard to emulate various keyboard layouts commonly used
527for those scripts. How to do this remapping properly depends on your
528actual keyboard layout. To specify which layout your keyboard has, use
529the command @kbd{M-x quail-set-keyboard-layout}.
530
531@findex list-input-methods
532 To display a list of all the supported input methods, type @kbd{M-x
533list-input-methods}. The list gives information about each input
534method, including the string that stands for it in the mode line.
535
536@node Multibyte Conversion
537@section Unibyte and Multibyte Non-ASCII characters
538
539 When multibyte characters are enabled, character codes 0240 (octal)
540through 0377 (octal) are not really legitimate in the buffer. The valid
541non-ASCII printing characters have codes that start from 0400.
542
4b40407a
RS
543 If you type a self-inserting character in the range 0240 through
5440377, or if you use @kbd{C-q} to insert one, Emacs assumes you
545intended to use one of the ISO Latin-@var{n} character sets, and
546converts it to the Emacs code representing that Latin-@var{n}
547character. You select @emph{which} ISO Latin character set to use
548through your choice of language environment
6bf7aab6
DL
549@iftex
550(see above).
551@end iftex
552@ifinfo
553(@pxref{Language Environments}).
554@end ifinfo
555If you do not specify a choice, the default is Latin-1.
556
4b40407a
RS
557 If you insert a character in the range 0200 through 0237, which
558forms the @code{eight-bit-control} character set, it is inserted
60245086
DL
559literally. You should normally avoid doing this since buffers
560containing such characters have to be written out in either the
4b40407a
RS
561@code{emacs-mule} or @code{raw-text} coding system, which is usually
562not what you want.
6bf7aab6
DL
563
564@node Coding Systems
565@section Coding Systems
566@cindex coding systems
567
568 Users of various languages have established many more-or-less standard
569coding systems for representing them. Emacs does not use these coding
570systems internally; instead, it converts from various coding systems to
571its own system when reading data, and converts the internal coding
572system to other coding systems when writing data. Conversion is
573possible in reading or writing files, in sending or receiving from the
574terminal, and in exchanging data with subprocesses.
575
576 Emacs assigns a name to each coding system. Most coding systems are
577used for one language, and the name of the coding system starts with the
578language name. Some coding systems are used for several languages;
579their names usually start with @samp{iso}. There are also special
580coding systems @code{no-conversion}, @code{raw-text} and
581@code{emacs-mule} which do not convert printing characters at all.
582
8561e53a 583@cindex international files from DOS/Windows systems
9d9c2e39
EZ
584 A special class of coding systems, collectively known as
585@dfn{codepages}, is designed to support text encoded by MS-Windows and
586MS-DOS software. To use any of these systems, you need to create it
8561e53a
EZ
587with @kbd{M-x codepage-setup}. @xref{MS-DOS and MULE}. After
588creating the coding system for the codepage, you can use it as any
589other coding system. For example, to visit a file encoded in codepage
590850, type @kbd{C-x @key{RET} c cp850 @key{RET} C-x C-f @var{filename}
591@key{RET}}.
9d9c2e39 592
6bf7aab6
DL
593 In addition to converting various representations of non-ASCII
594characters, a coding system can perform end-of-line conversion. Emacs
595handles three different conventions for how to separate lines in a file:
596newline, carriage-return linefeed, and just carriage-return.
597
598@table @kbd
599@item C-h C @var{coding} @key{RET}
600Describe coding system @var{coding}.
601
602@item C-h C @key{RET}
603Describe the coding systems currently in use.
604
605@item M-x list-coding-systems
606Display a list of all the supported coding systems.
607@end table
608
609@kindex C-h C
610@findex describe-coding-system
611 The command @kbd{C-h C} (@code{describe-coding-system}) displays
612information about particular coding systems. You can specify a coding
12de6e26 613system name as the argument; alternatively, with an empty argument, it
6bf7aab6
DL
614describes the coding systems currently selected for various purposes,
615both in the current buffer and as the defaults, and the priority list
616for recognizing coding systems (@pxref{Recognize Coding}).
617
618@findex list-coding-systems
619 To display a list of all the supported coding systems, type @kbd{M-x
620list-coding-systems}. The list gives information about each coding
621system, including the letter that stands for it in the mode line
622(@pxref{Mode Line}).
623
624@cindex end-of-line conversion
625@cindex MS-DOS end-of-line conversion
626@cindex Macintosh end-of-line conversion
627 Each of the coding systems that appear in this list---except for
628@code{no-conversion}, which means no conversion of any kind---specifies
629how and whether to convert printing characters, but leaves the choice of
630end-of-line conversion to be decided based on the contents of each file.
631For example, if the file appears to use the sequence carriage-return
632linefeed to separate lines, DOS end-of-line conversion will be used.
633
634 Each of the listed coding systems has three variants which specify
635exactly what to do for end-of-line conversion:
636
637@table @code
638@item @dots{}-unix
639Don't do any end-of-line conversion; assume the file uses
640newline to separate lines. (This is the convention normally used
641on Unix and GNU systems.)
642
643@item @dots{}-dos
644Assume the file uses carriage-return linefeed to separate lines, and do
645the appropriate conversion. (This is the convention normally used on
2684ed46 646Microsoft systems.@footnote{It is also specified for MIME @samp{text/*}
6bf7aab6
DL
647bodies and in other network transport contexts. It is different
648from the SGML reference syntax record-start/record-end format which
649Emacs doesn't support directly.})
650
651@item @dots{}-mac
652Assume the file uses carriage-return to separate lines, and do the
653appropriate conversion. (This is the convention normally used on the
654Macintosh system.)
655@end table
656
657 These variant coding systems are omitted from the
658@code{list-coding-systems} display for brevity, since they are entirely
659predictable. For example, the coding system @code{iso-latin-1} has
660variants @code{iso-latin-1-unix}, @code{iso-latin-1-dos} and
661@code{iso-latin-1-mac}.
662
663 The coding system @code{raw-text} is good for a file which is mainly
664ASCII text, but may contain byte values above 127 which are not meant to
665encode non-ASCII characters. With @code{raw-text}, Emacs copies those
666byte values unchanged, and sets @code{enable-multibyte-characters} to
667@code{nil} in the current buffer so that they will be interpreted
668properly. @code{raw-text} handles end-of-line conversion in the usual
669way, based on the data encountered, and has the usual three variants to
670specify the kind of end-of-line conversion to use.
671
672 In contrast, the coding system @code{no-conversion} specifies no
673character code conversion at all---none for non-ASCII byte values and
674none for end of line. This is useful for reading or writing binary
675files, tar files, and other files that must be examined verbatim. It,
676too, sets @code{enable-multibyte-characters} to @code{nil}.
677
678 The easiest way to edit a file with no conversion of any kind is with
679the @kbd{M-x find-file-literally} command. This uses
680@code{no-conversion}, and also suppresses other Emacs features that
681might convert the file contents before you see them. @xref{Visiting}.
682
683 The coding system @code{emacs-mule} means that the file contains
684non-ASCII characters stored with the internal Emacs encoding. It
685handles end-of-line conversion based on the data encountered, and has
686the usual three variants to specify the kind of end-of-line conversion.
687
688@node Recognize Coding
689@section Recognizing Coding Systems
690
8561e53a
EZ
691 Emacs tries to recognize which coding system to use for a given text
692as an integral part of reading that text. (This applies to files
693being read, output from subprocesses, text from X selections, etc.)
694Emacs can select the right coding system automatically most of the
695time---once you have specified your preferences.
6bf7aab6
DL
696
697 Some coding systems can be recognized or distinguished by which byte
698sequences appear in the data. However, there are coding systems that
699cannot be distinguished, not even potentially. For example, there is no
700way to distinguish between Latin-1 and Latin-2; they use the same byte
701values with different meanings.
702
703 Emacs handles this situation by means of a priority list of coding
704systems. Whenever Emacs reads a file, if you do not specify the coding
705system to use, Emacs checks the data against each coding system,
706starting with the first in priority and working down the list, until it
707finds a coding system that fits the data. Then it converts the file
708contents assuming that they are represented in this coding system.
709
710 The priority list of coding systems depends on the selected language
711environment (@pxref{Language Environments}). For example, if you use
712French, you probably want Emacs to prefer Latin-1 to Latin-2; if you use
713Czech, you probably want Latin-2 to be preferred. This is one of the
714reasons to specify a language environment.
715
716@findex prefer-coding-system
65b4fec5
RS
717 However, you can alter the coding system priority list in detail
718with the command @kbd{M-x prefer-coding-system}. This command reads
719the name of a coding system from the minibuffer, and adds it to the
720front of the priority list, so that it is preferred to all others. If
721you use this command several times, each use adds one element to the
722front of the priority list.
6bf7aab6
DL
723
724 If you use a coding system that specifies the end-of-line conversion
12de6e26 725type, such as @code{iso-8859-1-dos}, what this means is that Emacs
6bf7aab6 726should attempt to recognize @code{iso-8859-1} with priority, and should
a9749dab 727use DOS end-of-line conversion when it does recognize @code{iso-8859-1}.
6bf7aab6
DL
728
729@vindex file-coding-system-alist
730 Sometimes a file name indicates which coding system to use for the
731file. The variable @code{file-coding-system-alist} specifies this
732correspondence. There is a special function
733@code{modify-coding-system-alist} for adding elements to this list. For
734example, to read and write all @samp{.txt} files using the coding system
735@code{china-iso-8bit}, you can execute this Lisp expression:
736
737@smallexample
738(modify-coding-system-alist 'file "\\.txt\\'" 'china-iso-8bit)
739@end smallexample
740
741@noindent
742The first argument should be @code{file}, the second argument should be
743a regular expression that determines which files this applies to, and
744the third argument says which coding system to use for these files.
745
746@vindex inhibit-eol-conversion
5be757c3 747@cindex DOS-style end-of-line display
6bf7aab6
DL
748 Emacs recognizes which kind of end-of-line conversion to use based on
749the contents of the file: if it sees only carriage-returns, or only
750carriage-return linefeed sequences, then it chooses the end-of-line
751conversion accordingly. You can inhibit the automatic use of
752end-of-line conversion by setting the variable @code{inhibit-eol-conversion}
0d314165
EZ
753to non-@code{nil}. If you do that, DOS-style files will be displayed
754with the @samp{^M} characters visible in the buffer; some people
755prefer this to the more subtle @samp{(DOS)} end-of-line type
756indication near the left edge of the mode line (@pxref{Mode Line,
1deddb56 757eol-mnemonic}).
6bf7aab6 758
5be757c3
EZ
759@vindex inhibit-iso-escape-detection
760@cindex escape sequences in files
761 By default, the automatic detection of coding system is sensitive to
762escape sequences. If Emacs sees a sequence of characters that begin
4b40407a
RS
763with an escape character, and the sequence is valid as an ISO-2022
764code, that tells Emacs to use one of the ISO-2022 encodings to decode
765the file.
5be757c3 766
4b40407a
RS
767 However, there may be cases that you want to read escape sequences
768in a file as is. In such a case, you can set the variable
5be757c3 769@code{inhibit-iso-escape-detection} to non-@code{nil}. Then the code
4b40407a
RS
770detection ignores any escape sequences, and never uses an ISO-2022
771encoding. The result is that all escape sequences become visible in
772the buffer.
5be757c3
EZ
773
774 The default value of @code{inhibit-iso-escape-detection} is
4b40407a
RS
775@code{nil}. We recommend that you not change it permanently, only for
776one specific operation. That's because many Emacs Lisp source files
12de6e26
EZ
777in the Emacs distribution contain non-ASCII characters encoded in the
778coding system @code{iso-2022-7bit}, and they won't be
4b40407a
RS
779decoded correctly when you visit those files if you suppress the
780escape sequence detection.
5be757c3 781
6bf7aab6
DL
782@vindex coding
783 You can specify the coding system for a particular file using the
12de6e26
EZ
784@w{@samp{-*-@dots{}-*-}} construct at the beginning of a file, or a
785local variables list at the end (@pxref{File Variables}). You do this
786by defining a value for the ``variable'' named @code{coding}. Emacs
787does not really have a variable @code{coding}; instead of setting a
a9749dab 788variable, this uses the specified coding system for the file. For
12de6e26 789example, @samp{-*-mode: C; coding: latin-1;-*-} specifies use of the
a9749dab 790Latin-1 coding system, as well as C mode. When you specify the coding
12de6e26
EZ
791explicitly in the file, that overrides
792@code{file-coding-system-alist}.
6bf7aab6
DL
793
794@vindex auto-coding-alist
9952f1f8 795@vindex auto-coding-regexp-alist
1d83df13
CW
796@vindex auto-coding-functions
797 The variables @code{auto-coding-alist},
798@code{auto-coding-regexp-alist} and @code{auto-coding-functions} are
799the strongest way to specify the coding system for certain patterns of
800file names, or for files containing certain patterns; these variables
801even override @samp{-*-coding:-*-} tags in the file itself. Emacs
802uses @code{auto-coding-alist} for tar and archive files, to prevent it
9952f1f8
GM
803from being confused by a @samp{-*-coding:-*-} tag in a member of the
804archive and thinking it applies to the archive file as a whole.
805Likewise, Emacs uses @code{auto-coding-regexp-alist} to ensure that
1d83df13
CW
806RMAIL files, whose names in general don't match any particular
807pattern, are decoded correctly. One of the builtin
808@code{auto-coding-functions} detects the encoding for XML files.
6bf7aab6 809
8561e53a
EZ
810 If Emacs recognizes the encoding of a file incorrectly, you can
811reread the file using the correct coding system by typing @kbd{C-x
812@key{RET} c @var{coding-system} @key{RET} M-x revert-buffer
5336b0e0
RS
813@key{RET}}. To see what coding system Emacs actually used to decode
814the file, look at the coding system mnemonic letter near the left edge
815of the mode line (@pxref{Mode Line}), or type @kbd{C-h C @key{RET}}.
8561e53a 816
ba2cf799
RS
817@findex unify-8859-on-decoding-mode
818 The command @code{unify-8859-on-decoding-mode} enables a mode that
819``unifies'' the Latin alphabets when decoding text. This works by
820converting all non-ASCII Latin-@var{n} characters to either Latin-1 or
821Unicode characters. This way it is easier to use various
822Latin-@var{n} alphabets together. In a future Emacs version we hope
823to move towards full Unicode support and complete unification of
824character sets.
825
6bf7aab6
DL
826@vindex buffer-file-coding-system
827 Once Emacs has chosen a coding system for a buffer, it stores that
828coding system in @code{buffer-file-coding-system} and uses that coding
829system, by default, for operations that write from this buffer into a
830file. This includes the commands @code{save-buffer} and
831@code{write-region}. If you want to write files from this buffer using
832a different coding system, you can specify a different coding system for
833the buffer using @code{set-buffer-file-coding-system} (@pxref{Specify
834Coding}).
835
4b40407a
RS
836 You can insert any possible character into any Emacs buffer, but
837most coding systems can only handle some of the possible characters.
12de6e26
EZ
838This means that it is possible for you to insert characters that
839cannot be encoded with the coding system that will be used to save the
840buffer. For example, you could start with an ASCII file and insert a
841few Latin-1 characters into it, or you could edit a text file in
a9749dab
RS
842Polish encoded in @code{iso-8859-2} and add some Russian words to it.
843When you save the buffer, Emacs cannot use the current value of
844@code{buffer-file-coding-system}, because the characters you added
845cannot be encoded by that coding system.
2a886892
EZ
846
847 When that happens, Emacs tries the most-preferred coding system (set
848by @kbd{M-x prefer-coding-system} or @kbd{M-x
4b40407a
RS
849set-language-environment}), and if that coding system can safely
850encode all of the characters in the buffer, Emacs uses it, and stores
851its value in @code{buffer-file-coding-system}. Otherwise, Emacs
852displays a list of coding systems suitable for encoding the buffer's
cd6eaa1e 853contents, and asks you to choose one of those coding systems.
4b40407a
RS
854
855 If you insert the unsuitable characters in a mail message, Emacs
856behaves a bit differently. It additionally checks whether the
857most-preferred coding system is recommended for use in MIME messages;
9efa2777 858if not, Emacs tells you that the most-preferred coding system is
4b40407a
RS
859not recommended and prompts you for another coding system. This is so
860you won't inadvertently send a message encoded in a way that your
861recipient's mail software will have difficulty decoding. (If you do
cd6eaa1e 862want to use the most-preferred coding system, you can still type its
5336b0e0 863name in response to the question.)
2a886892 864
6bf7aab6
DL
865@vindex sendmail-coding-system
866 When you send a message with Mail mode (@pxref{Sending Mail}), Emacs has
867four different ways to determine the coding system to use for encoding
868the message text. It tries the buffer's own value of
869@code{buffer-file-coding-system}, if that is non-@code{nil}. Otherwise,
870it uses the value of @code{sendmail-coding-system}, if that is
871non-@code{nil}. The third way is to use the default coding system for
872new files, which is controlled by your choice of language environment,
873if that is non-@code{nil}. If all of these three values are @code{nil},
874Emacs encodes outgoing mail using the Latin-1 coding system.
875
876@vindex rmail-decode-mime-charset
877 When you get new mail in Rmail, each message is translated
12de6e26 878automatically from the coding system it is written in, as if it were a
6bf7aab6
DL
879separate file. This uses the priority list of coding systems that you
880have specified. If a MIME message specifies a character set, Rmail
881obeys that specification, unless @code{rmail-decode-mime-charset} is
882@code{nil}.
883
884@vindex rmail-file-coding-system
885 For reading and saving Rmail files themselves, Emacs uses the coding
886system specified by the variable @code{rmail-file-coding-system}. The
887default value is @code{nil}, which means that Rmail files are not
888translated (they are read and written in the Emacs internal character
889code).
890
891@node Specify Coding
892@section Specifying a Coding System
893
894 In cases where Emacs does not automatically choose the right coding
895system, you can use these commands to specify one:
896
897@table @kbd
898@item C-x @key{RET} f @var{coding} @key{RET}
201e6b46
RS
899Use coding system @var{coding} for saving or revisiting the visited
900file in the current buffer.
6bf7aab6
DL
901
902@item C-x @key{RET} c @var{coding} @key{RET}
903Specify coding system @var{coding} for the immediately following
904command.
905
906@item C-x @key{RET} k @var{coding} @key{RET}
907Use coding system @var{coding} for keyboard input.
908
909@item C-x @key{RET} t @var{coding} @key{RET}
910Use coding system @var{coding} for terminal output.
911
912@item C-x @key{RET} p @var{input-coding} @key{RET} @var{output-coding} @key{RET}
913Use coding systems @var{input-coding} and @var{output-coding} for
914subprocess input and output in the current buffer.
915
916@item C-x @key{RET} x @var{coding} @key{RET}
917Use coding system @var{coding} for transferring selections to and from
918other programs through the window system.
919
920@item C-x @key{RET} X @var{coding} @key{RET}
921Use coding system @var{coding} for transferring @emph{one}
922selection---the next one---to or from the window system.
923@end table
924
925@kindex C-x RET f
926@findex set-buffer-file-coding-system
201e6b46
RS
927 The command @kbd{C-x @key{RET} f}
928(@code{set-buffer-file-coding-system}) sets the file coding system for
929the current buffer---in other words, it says which coding system to
930use when saving or reverting the visited file. You specify which
931coding system using the minibuffer. If you specify a coding system
932that cannot handle all of the characters in the buffer, Emacs warns
933you about the troublesome characters when you actually save the
934buffer.
6bf7aab6
DL
935
936@kindex C-x RET c
937@findex universal-coding-system-argument
938 Another way to specify the coding system for a file is when you visit
939the file. First use the command @kbd{C-x @key{RET} c}
940(@code{universal-coding-system-argument}); this command uses the
941minibuffer to read a coding system name. After you exit the minibuffer,
942the specified coding system is used for @emph{the immediately following
943command}.
944
945 So if the immediately following command is @kbd{C-x C-f}, for example,
946it reads the file using that coding system (and records the coding
201e6b46 947system for when you later save the file). Or if the immediately following
6bf7aab6 948command is @kbd{C-x C-w}, it writes the file using that coding system.
201e6b46
RS
949When you specify the coding system for saving in this way, instead
950of with @kbd{C-x @key{RET} f}, there is no warning if the buffer
951contains characters that the coding system cannot handle.
6bf7aab6 952
201e6b46
RS
953 Other file commands affected by a specified coding system include
954@kbd{C-x C-i} and @kbd{C-x C-v}, as well as the other-window variants
955of @kbd{C-x C-f}. @kbd{C-x @key{RET} c} also affects commands that
956start subprocesses, including @kbd{M-x shell} (@pxref{Shell}).
6bf7aab6 957
201e6b46
RS
958 If the immediately following command does not use the coding system,
959then @kbd{C-x @key{RET} c} ultimately has no effect.
6bf7aab6
DL
960
961 An easy way to visit a file with no conversion is with the @kbd{M-x
962find-file-literally} command. @xref{Visiting}.
963
964@vindex default-buffer-file-coding-system
965 The variable @code{default-buffer-file-coding-system} specifies the
966choice of coding system to use when you create a new file. It applies
967when you find a new file, and when you create a buffer and then save it
968in a file. Selecting a language environment typically sets this
969variable to a good choice of default coding system for that language
970environment.
971
972@kindex C-x RET t
973@findex set-terminal-coding-system
974 The command @kbd{C-x @key{RET} t} (@code{set-terminal-coding-system})
975specifies the coding system for terminal output. If you specify a
976character code for terminal output, all characters output to the
977terminal are translated into that coding system.
978
979 This feature is useful for certain character-only terminals built to
980support specific languages or character sets---for example, European
981terminals that support one of the ISO Latin character sets. You need to
982specify the terminal coding system when using multibyte text, so that
983Emacs knows which characters the terminal can actually handle.
984
985 By default, output to the terminal is not translated at all, unless
60245086
DL
986Emacs can deduce the proper coding system from your terminal type or
987your locale specification (@pxref{Language Environments}).
6bf7aab6
DL
988
989@kindex C-x RET k
990@findex set-keyboard-coding-system
aa120288 991@vindex keyboard-coding-system
6bf7aab6 992 The command @kbd{C-x @key{RET} k} (@code{set-keyboard-coding-system})
aa120288 993or the Custom option @code{keyboard-coding-system}
6bf7aab6
DL
994specifies the coding system for keyboard input. Character-code
995translation of keyboard input is useful for terminals with keys that
996send non-ASCII graphic characters---for example, some terminals designed
997for ISO Latin-1 or subsets of it.
998
dfa56e2b
RS
999 By default, keyboard input is translated based on your system locale
1000setting. If your terminal does not really support the encoding
1001implied by your locale (for example, if you find it inserts a
1002non-ASCII character if you type @kbd{M-i}), you will need to set
1003@code{keyboard-coding-system} to @code{nil} to turn off encoding.
1004You can do this by putting
1005
1006@lisp
1007(set-keyboard-coding-system nil)
1008@end lisp
1009
1010@noindent
1011in your @file{~/.emacs} file.
6bf7aab6
DL
1012
1013 There is a similarity between using a coding system translation for
1014keyboard input, and using an input method: both define sequences of
1015keyboard input that translate into single characters. However, input
1016methods are designed to be convenient for interactive use by humans, and
1017the sequences that are translated are typically sequences of ASCII
1018printing characters. Coding systems typically translate sequences of
1019non-graphic characters.
1020
1021@kindex C-x RET x
1022@kindex C-x RET X
1023@findex set-selection-coding-system
1024@findex set-next-selection-coding-system
1025 The command @kbd{C-x @key{RET} x} (@code{set-selection-coding-system})
1026specifies the coding system for sending selected text to the window
1027system, and for receiving the text of selections made in other
1028applications. This command applies to all subsequent selections, until
1029you override it by using the command again. The command @kbd{C-x
1030@key{RET} X} (@code{set-next-selection-coding-system}) specifies the
1031coding system for the next selection made in Emacs or read by Emacs.
1032
1033@kindex C-x RET p
1034@findex set-buffer-process-coding-system
1035 The command @kbd{C-x @key{RET} p} (@code{set-buffer-process-coding-system})
1036specifies the coding system for input and output to a subprocess. This
1037command applies to the current buffer; normally, each subprocess has its
1038own buffer, and thus you can use this command to specify translation to
1039and from a particular subprocess by giving the command in the
1040corresponding buffer.
1041
a895a5a5
KH
1042 The default for translation of process input and output depends on the
1043current language environment.
6bf7aab6
DL
1044
1045@vindex file-name-coding-system
0d314165 1046@cindex file names with non-ASCII characters
6bf7aab6
DL
1047 The variable @code{file-name-coding-system} specifies a coding system
1048to use for encoding file names. If you set the variable to a coding
1049system name (as a Lisp symbol or a string), Emacs encodes file names
1050using that coding system for all file operations. This makes it
1051possible to use non-ASCII characters in file names---or, at least, those
1052non-ASCII characters which the specified coding system can encode.
1053
1054 If @code{file-name-coding-system} is @code{nil}, Emacs uses a default
1055coding system determined by the selected language environment. In the
1056default language environment, any non-ASCII characters in file names are
1057not encoded specially; they appear in the file system using the internal
1058Emacs representation.
1059
1060 @strong{Warning:} if you change @code{file-name-coding-system} (or the
1061language environment) in the middle of an Emacs session, problems can
1062result if you have already visited files whose names were encoded using
1063the earlier coding system and cannot be encoded (or are encoded
1064differently) under the new coding system. If you try to save one of
1065these buffers under the visited file name, saving may use the wrong file
1066name, or it may get an error. If such a problem happens, use @kbd{C-x
1067C-w} to specify a new file name for that buffer.
1068
fbc164de 1069@vindex locale-coding-system
e7960874 1070@cindex decoding non-ASCII keyboard input on X
4b40407a
RS
1071 The variable @code{locale-coding-system} specifies a coding system
1072to use when encoding and decoding system strings such as system error
579cb67d
EZ
1073messages and @code{format-time-string} formats and time stamps. That
1074coding system is also used for decoding non-ASCII keyboard input on X
1075Window systems. You should choose a coding system that is compatible
1076with the underlying system's text representation, which is normally
1077specified by one of the environment variables @env{LC_ALL},
1078@env{LC_CTYPE}, and @env{LANG}. (The first one, in the order
1079specified above, whose value is nonempty is the one that determines
1080the text representation.)
fbc164de 1081
6bf7aab6
DL
1082@node Fontsets
1083@section Fontsets
1084@cindex fontsets
1085
12de6e26 1086 A font for X typically defines shapes for a single alphabet or script.
97878c08
EZ
1087Therefore, displaying the entire range of scripts that Emacs supports
1088requires a collection of many fonts. In Emacs, such a collection is
1089called a @dfn{fontset}. A fontset is defined by a list of fonts, each
1090assigned to handle a range of character codes.
6bf7aab6
DL
1091
1092 Each fontset has a name, like a font. The available X fonts are
1093defined by the X server; fontsets, however, are defined within Emacs
1094itself. Once you have defined a fontset, you can use it within Emacs by
1095specifying its name, anywhere that you could use a single font. Of
1096course, Emacs fontsets can use only the fonts that the X server
1097supports; if certain characters appear on the screen as hollow boxes,
1098this means that the fontset in use for them has no font for those
4b40407a 1099characters.@footnote{The Emacs installation instructions have information on
60245086 1100additional font support.}
6bf7aab6
DL
1101
1102 Emacs creates two fontsets automatically: the @dfn{standard fontset}
1103and the @dfn{startup fontset}. The standard fontset is most likely to
1104have fonts for a wide variety of non-ASCII characters; however, this is
1105not the default for Emacs to use. (By default, Emacs tries to find a
12de6e26 1106font that has bold and italic variants.) You can specify use of the
6bf7aab6
DL
1107standard fontset with the @samp{-fn} option, or with the @samp{Font} X
1108resource (@pxref{Font X}). For example,
1109
1110@example
1111emacs -fn fontset-standard
1112@end example
1113
1114 A fontset does not necessarily specify a font for every character
1115code. If a fontset specifies no font for a certain character, or if it
1116specifies a font that does not exist on your system, then it cannot
1117display that character properly. It will display that character as an
1118empty box instead.
1119
6bf7aab6
DL
1120@node Defining Fontsets
1121@section Defining fontsets
1122
1123@vindex standard-fontset-spec
1124@cindex standard fontset
1125 Emacs creates a standard fontset automatically according to the value
1126of @code{standard-fontset-spec}. This fontset's name is
1127
1128@example
1129-*-fixed-medium-r-normal-*-16-*-*-*-*-*-fontset-standard
1130@end example
1131
1132@noindent
1133or just @samp{fontset-standard} for short.
1134
1135 Bold, italic, and bold-italic variants of the standard fontset are
1136created automatically. Their names have @samp{bold} instead of
1137@samp{medium}, or @samp{i} instead of @samp{r}, or both.
1138
1139@cindex startup fontset
1140 If you specify a default ASCII font with the @samp{Font} resource or
1141the @samp{-fn} argument, Emacs generates a fontset from it
1142automatically. This is the @dfn{startup fontset} and its name is
1143@code{fontset-startup}. It does this by replacing the @var{foundry},
1144@var{family}, @var{add_style}, and @var{average_width} fields of the
1145font name with @samp{*}, replacing @var{charset_registry} field with
1146@samp{fontset}, and replacing @var{charset_encoding} field with
1147@samp{startup}, then using the resulting string to specify a fontset.
1148
1149 For instance, if you start Emacs this way,
1150
1151@example
1152emacs -fn "*courier-medium-r-normal--14-140-*-iso8859-1"
1153@end example
1154
1155@noindent
1156Emacs generates the following fontset and uses it for the initial X
1157window frame:
1158
1159@example
1160-*-*-medium-r-normal-*-14-140-*-*-*-*-fontset-startup
1161@end example
1162
1163 With the X resource @samp{Emacs.Font}, you can specify a fontset name
1164just like an actual font name. But be careful not to specify a fontset
1165name in a wildcard resource like @samp{Emacs*Font}---that wildcard
bf74cba1 1166specification matches various other resources, such as for menus, and
6bf7aab6
DL
1167menus cannot handle fontsets.
1168
1169 You can specify additional fontsets using X resources named
1170@samp{Fontset-@var{n}}, where @var{n} is an integer starting from 0.
1171The resource value should have this form:
1172
1173@smallexample
1174@var{fontpattern}, @r{[}@var{charsetname}:@var{fontname}@r{]@dots{}}
1175@end smallexample
1176
1177@noindent
1178@var{fontpattern} should have the form of a standard X font name, except
1179for the last two fields. They should have the form
1180@samp{fontset-@var{alias}}.
1181
1182 The fontset has two names, one long and one short. The long name is
1183@var{fontpattern}. The short name is @samp{fontset-@var{alias}}. You
1184can refer to the fontset by either name.
1185
1186 The construct @samp{@var{charset}:@var{font}} specifies which font to
1187use (in this fontset) for one particular character set. Here,
1188@var{charset} is the name of a character set, and @var{font} is the
1189font to use for that character set. You can use this construct any
1190number of times in defining one fontset.
1191
1192 For the other character sets, Emacs chooses a font based on
1193@var{fontpattern}. It replaces @samp{fontset-@var{alias}} with values
1194that describe the character set. For the ASCII character font,
1195@samp{fontset-@var{alias}} is replaced with @samp{ISO8859-1}.
1196
1197 In addition, when several consecutive fields are wildcards, Emacs
1198collapses them into a single wildcard. This is to prevent use of
1199auto-scaled fonts. Fonts made by scaling larger fonts are not usable
1200for editing, and scaling a smaller font is not useful because it is
12de6e26
EZ
1201better to use the smaller font in its own size, which is what Emacs
1202does.
6bf7aab6
DL
1203
1204 Thus if @var{fontpattern} is this,
1205
1206@example
1207-*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24
1208@end example
1209
1210@noindent
1211the font specification for ASCII characters would be this:
1212
1213@example
1214-*-fixed-medium-r-normal-*-24-*-ISO8859-1
1215@end example
1216
1217@noindent
1218and the font specification for Chinese GB2312 characters would be this:
1219
1220@example
1221-*-fixed-medium-r-normal-*-24-*-gb2312*-*
1222@end example
1223
1224 You may not have any Chinese font matching the above font
1225specification. Most X distributions include only Chinese fonts that
1226have @samp{song ti} or @samp{fangsong ti} in @var{family} field. In
1227such a case, @samp{Fontset-@var{n}} can be specified as below:
1228
1229@smallexample
1230Emacs.Fontset-0: -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24,\
1231 chinese-gb2312:-*-*-medium-r-normal-*-24-*-gb2312*-*
1232@end smallexample
1233
1234@noindent
1235Then, the font specifications for all but Chinese GB2312 characters have
1236@samp{fixed} in the @var{family} field, and the font specification for
1237Chinese GB2312 characters has a wild card @samp{*} in the @var{family}
1238field.
1239
1240@findex create-fontset-from-fontset-spec
1241 The function that processes the fontset resource value to create the
1242fontset is called @code{create-fontset-from-fontset-spec}. You can also
1243call this function explicitly to create a fontset.
1244
1245 @xref{Font X}, for more information about font naming in X.
1246
60245086
DL
1247@node Undisplayable Characters
1248@section Undisplayable Characters
1249
65b4fec5
RS
1250 There may be a some non-ASCII characters that your terminal cannot
1251display. Most non-windowing terminals support just a single character
1252set (use the variable @code{default-terminal-coding-system}
4b40407a
RS
1253(@pxref{Specify Coding}) to tell Emacs which one); characters which
1254can't be encoded in that coding system are displayed as @samp{?} by
1255default.
1256
1257 Windowing terminals can display a broader range of characters, but
1258you may not have fonts installed for all of them; characters that have
1259no font appear as a hollow box.
60245086 1260
4b40407a 1261 If you use Latin-1 characters but your terminal can't display
6eb5fac3 1262Latin-1, you can arrange to display mnemonic ASCII sequences
4b40407a
RS
1263instead, e.g.@: @samp{"o} for o-umlaut. Load the library
1264@file{iso-ascii} to do this.
60245086 1265
741c4ff9 1266@vindex latin1-display
4b40407a
RS
1267 If your terminal can display Latin-1, you can display characters
1268from other European character sets using a mixture of equivalent
bb61b038
RS
1269Latin-1 characters and ASCII mnemonics. Use the Custom option
1270@code{latin1-display} to enable this. The mnemonic ASCII
4b40407a 1271sequences mostly correspond to those of the prefix input methods.
60245086 1272
521ab838
DL
1273@node Single-Byte Character Support
1274@section Single-byte Character Set Support
6bf7aab6
DL
1275
1276@cindex European character sets
1277@cindex accented characters
1278@cindex ISO Latin character sets
1279@cindex Unibyte operation
6bf7aab6 1280 The ISO 8859 Latin-@var{n} character sets define character codes in
12de6e26
EZ
1281the range 0240 to 0377 octal (160 to 255 decimal) to handle the
1282accented letters and punctuation needed by various European languages
1283(and some non-European ones). If you disable multibyte characters,
1284Emacs can still handle @emph{one} of these character codes at a time.
1285To specify @emph{which} of these codes to use, invoke @kbd{M-x
1286set-language-environment} and specify a suitable language environment
1287such as @samp{Latin-@var{n}}.
6bf7aab6
DL
1288
1289 For more information about unibyte operation, see @ref{Enabling
1290Multibyte}. Note particularly that you probably want to ensure that
1291your initialization files are read as unibyte if they contain non-ASCII
1292characters.
1293
1294@vindex unibyte-display-via-language-environment
1295 Emacs can also display those characters, provided the terminal or font
1296in use supports them. This works automatically. Alternatively, if you
1297are using a window system, Emacs can also display single-byte characters
1298through fontsets, in effect by displaying the equivalent multibyte
1299characters according to the current language environment. To request
1300this, set the variable @code{unibyte-display-via-language-environment}
1301to a non-@code{nil} value.
1302
1303@cindex @code{iso-ascii} library
1304 If your terminal does not support display of the Latin-1 character
1305set, Emacs can display these characters as ASCII sequences which at
1306least give you a clear idea of what the characters are. To do this,
1307load the library @code{iso-ascii}. Similar libraries for other
1308Latin-@var{n} character sets could be implemented, but we don't have
1309them yet.
1310
1311@findex standard-display-8bit
1312@cindex 8-bit display
12de6e26 1313 Normally non-ISO-8859 characters (decimal codes between 128 and 159
6bf7aab6 1314inclusive) are displayed as octal escapes. You can change this for
2684ed46 1315non-standard ``extended'' versions of ISO-8859 character sets by using the
6bf7aab6
DL
1316function @code{standard-display-8bit} in the @code{disp-table} library.
1317
133f8c71 1318 There are several ways you can input single-byte non-ASCII
6bf7aab6
DL
1319characters:
1320
1321@itemize @bullet
521ab838 1322@cindex 8-bit input
6bf7aab6 1323@item
12de6e26
EZ
1324If your keyboard can generate character codes 128 (decimal) and up,
1325representing non-ASCII characters, you can type those character codes
1326directly.
4b40407a
RS
1327
1328On a windowing terminal, you should not need to do anything special to
1329use these keys; they should simply work. On a text-only terminal, you
1330should use the command @code{M-x set-keyboard-coding-system} or the
1331Custom option @code{keyboard-coding-system} to specify which coding
1332system your keyboard uses (@pxref{Specify Coding}). Enabling this
1333feature will probably require you to use @kbd{ESC} to type Meta
1334characters; however, on a Linux console or in @code{xterm}, you can
1335arrange for Meta to be converted to @kbd{ESC} and still be able type
13368-bit characters present directly on the keyboard or using
1337@kbd{Compose} or @kbd{AltGr} keys. @xref{User Input}.
521ab838 1338
6bf7aab6
DL
1339@item
1340You can use an input method for the selected language environment.
1341@xref{Input Methods}. When you use an input method in a unibyte buffer,
1342the non-ASCII character you specify with it is converted to unibyte.
1343
1344@kindex C-x 8
1345@cindex @code{iso-transl} library
98c271eb
DL
1346@cindex compose character
1347@cindex dead character
6bf7aab6
DL
1348@item
1349For Latin-1 only, you can use the
1350key @kbd{C-x 8} as a ``compose character'' prefix for entry of
1351non-ASCII Latin-1 printing characters. @kbd{C-x 8} is good for
1352insertion (in the minibuffer as well as other buffers), for searching,
1353and in any other context where a key sequence is allowed.
1354
1355@kbd{C-x 8} works by loading the @code{iso-transl} library. Once that
1356library is loaded, the @key{ALT} modifier key, if you have one, serves
1357the same purpose as @kbd{C-x 8}; use @key{ALT} together with an accent
1358character to modify the following letter. In addition, if you have keys
4b40407a 1359for the Latin-1 ``dead accent characters,'' they too are defined to
6bf7aab6 1360compose with the following character, once @code{iso-transl} is loaded.
133f8c71
DL
1361Use @kbd{C-x 8 C-h} to list the available translations as mnemonic
1362command names.
1363
133f8c71 1364@item
98c271eb
DL
1365@cindex @code{iso-acc} library
1366@cindex ISO Accents mode
1367@findex iso-accents-mode
13142d70 1368@cindex Latin-1, Latin-2 and Latin-3 input mode
5336b0e0
RS
1369For Latin-1, Latin-2 and Latin-3, @kbd{M-x iso-accents-mode} enables
1370a minor mode that works much like the @code{latin-1-prefix} input
cd6eaa1e 1371method, but does not depend on having the input methods installed. This
4b40407a
RS
1372mode is buffer-local. It can be customized for various languages with
1373@kbd{M-x iso-accents-customize}.
6bf7aab6 1374@end itemize
52254d1a
RS
1375
1376@node Charsets
1377@section Charsets
1378@cindex charsets
1379
1380 Emacs groups all supported characters into disjoint @dfn{charsets}.
1381Each character code belongs to one and only one charset. For
1382historical reasons, Emacs typically divides an 8-bit character code
1383for an extended version of ASCII into two charsets: ASCII, which
1384covers the codes 0 through 127, plus another charset which covers the
1385``right-hand part'' (the codes 128 and up). For instance, the
1386characters of Latin-1 include the Emacs charset @code{ascii} plus the
1387Emacs charset @code{latin-iso8859-1}.
1388
1389 Emacs characters belonging to different charsets may look the same,
1390but they are still different characters. For example, the letter
1391@samp{o} with acute accent in charset @code{latin-iso8859-1}, used for
1392Latin-1, is different from the letter @samp{o} with acute accent in
1393charset @code{latin-iso8859-2}, used for Latin-2.
1394
1395@findex list-charset-chars
1396@cindex characters in a certain charset
1397@findex describe-character-set
1398 There are two commands for obtaining information about Emacs
1399charsets. The command @kbd{M-x list-charset-chars} prompts for a name
1400of a character set, and displays all the characters in that character
1401set. The command @kbd{M-x describe-character-set} prompts for a
1402charset name and displays information about that charset, including
1403its internal representation within Emacs.
1404
1405 To find out which charset a character in the buffer belongs to,
1406put point before it and type @kbd{C-u C-x =}.