(log-view-mode-map): Bind `M-n' and `M-p', not `M n'
[bpt/emacs.git] / man / mule.texi
1 @c This is part of the Emacs manual.
2 @c Copyright (C) 1997, 1999, 2000, 2001 Free Software Foundation, Inc.
3 @c See file emacs.texi for copying conditions.
4 @node International, Major Modes, Frames, Top
5 @chapter International Character Set Support
6 @cindex MULE
7 @cindex international scripts
8 @cindex multibyte characters
9 @cindex encoding of characters
10
11 @cindex Celtic
12 @cindex Chinese
13 @cindex Cyrillic
14 @cindex Czech
15 @cindex Devanagari
16 @cindex Hindi
17 @cindex Marathi
18 @cindex Ethiopic
19 @cindex German
20 @cindex Greek
21 @cindex Hebrew
22 @cindex IPA
23 @cindex Japanese
24 @cindex Korean
25 @cindex Lao
26 @cindex Latin
27 @cindex Polish
28 @cindex Romanian
29 @cindex Slovak
30 @cindex Slovenian
31 @cindex Thai
32 @cindex Tibetan
33 @cindex Turkish
34 @cindex Vietnamese
35 @cindex Dutch
36 @cindex Spanish
37 Emacs supports a wide variety of international character sets,
38 including European variants of the Latin alphabet, as well as Chinese,
39 Cyrillic, Devanagari (Hindi and Marathi), Ethiopic, Greek, Hebrew, IPA,
40 Japanese, Korean, Lao, Thai, Tibetan, and Vietnamese scripts. These features
41 have been merged from the modified version of Emacs known as MULE (for
42 ``MULti-lingual Enhancement to GNU Emacs'')
43
44 Emacs also supports various encodings of these characters used by
45 other internationalized software, such as word processors and mailers.
46
47 Emacs allows editing text with international characters by supporting
48 all the related activities:
49
50 @itemize @bullet
51 @item
52 You can visit files with non-ASCII characters, save non-ASCII text, and
53 pass non-ASCII text between Emacs and programs it invokes (such as
54 compilers, spell-checkers, and mailers). Setting your language
55 environment (@pxref{Language Environments}) takes care of setting up the
56 coding systems and other options for a specific language or culture.
57 Alternatively, you can specify how Emacs should encode or decode text
58 for each command; see @ref{Specify Coding}.
59
60 @item
61 You can display non-ASCII characters encoded by the various scripts.
62 This works by using appropriate fonts on X and similar graphics
63 displays (@pxref{Defining Fontsets}), and by sending special codes to
64 text-only displays (@pxref{Specify Coding}). If some characters are
65 displayed incorrectly, refer to @ref{Undisplayable Characters}, which
66 describes possible problems and explains how to solve them.
67
68 @item
69 You can insert non-ASCII characters or search for them. To do that,
70 you can specify an input method (@pxref{Select Input Method}) suitable
71 for your language, or use the default input method set up when you set
72 your language environment. (Emacs input methods are part of the Leim
73 package, which must be installed for you to be able to use them.) If
74 your keyboard can produce non-ASCII characters, you can select an
75 appropriate keyboard coding system (@pxref{Specify Coding}), and Emacs
76 will accept those characters. Latin-1 characters can also be input by
77 using the @kbd{C-x 8} prefix, see @ref{Single-Byte Character Support,
78 C-x 8}.
79 @end itemize
80
81 The rest of this chapter describes these issues in detail.
82
83 @menu
84 * International Chars:: Basic concepts of multibyte characters.
85 * Enabling Multibyte:: Controlling whether to use multibyte characters.
86 * Language Environments:: Setting things up for the language you use.
87 * Input Methods:: Entering text characters not on your keyboard.
88 * Select Input Method:: Specifying your choice of input methods.
89 * Multibyte Conversion:: How single-byte characters convert to multibyte.
90 * Coding Systems:: Character set conversion when you read and
91 write files, and so on.
92 * Recognize Coding:: How Emacs figures out which conversion to use.
93 * Specify Coding:: Various ways to choose which conversion to use.
94 * Fontsets:: Fontsets are collections of fonts
95 that cover the whole spectrum of characters.
96 * Defining Fontsets:: Defining a new fontset.
97 * Undisplayable Characters:: When characters don't display.
98 * Single-Byte Character Support::
99 You can pick one European character set
100 to use without multibyte characters.
101 @end menu
102
103 @node International Chars
104 @section Introduction to International Character Sets
105
106 The users of international character sets and scripts have established
107 many more-or-less standard coding systems for storing files. Emacs
108 internally uses a single multibyte character encoding, so that it can
109 intermix characters from all these scripts in a single buffer or string.
110 This encoding represents each non-ASCII character as a sequence of bytes
111 in the range 0200 through 0377. Emacs translates between the multibyte
112 character encoding and various other coding systems when reading and
113 writing files, when exchanging data with subprocesses, and (in some
114 cases) in the @kbd{C-q} command (@pxref{Multibyte Conversion}).
115
116 @kindex C-h h
117 @findex view-hello-file
118 @cindex undisplayable characters
119 @cindex @samp{?} in display
120 The command @kbd{C-h h} (@code{view-hello-file}) displays the file
121 @file{etc/HELLO}, which shows how to say ``hello'' in many languages.
122 This illustrates various scripts. If some characters can't be
123 displayed on your terminal, they appear as @samp{?} or as hollow boxes
124 (@pxref{Undisplayable Characters}).
125
126 Keyboards, even in the countries where these character sets are used,
127 generally don't have keys for all the characters in them. So Emacs
128 supports various @dfn{input methods}, typically one for each script or
129 language, to make it convenient to type them.
130
131 @kindex C-x RET
132 The prefix key @kbd{C-x @key{RET}} is used for commands that pertain
133 to multibyte characters, coding systems, and input methods.
134
135 @ignore
136 @c This is commented out because it doesn't fit here, or anywhere.
137 @c This manual does not discuss "character sets" as they
138 @c are used in Mule, and it makes no sense to mention these commands
139 @c except as part of a larger discussion of the topic.
140 @c But it is not clear that topic is worth mentioning here,
141 @c since that is more of an implementation concept
142 @c than a user-level concept. And when we switch to Unicode,
143 @c character sets in the current sense may not even exist.
144
145 @findex list-charset-chars
146 @cindex characters in a certain charset
147 The command @kbd{M-x list-charset-chars} prompts for a name of a
148 character set, and displays all the characters in that character set.
149
150 @findex describe-character-set
151 @cindex character set, description
152 The command @kbd{M-x describe-character-set} prompts for a character
153 set name and displays information about that character set, including
154 its internal representation within Emacs.
155 @end ignore
156
157 @node Enabling Multibyte
158 @section Enabling Multibyte Characters
159
160 @cindex turn multibyte support on or off
161 You can enable or disable multibyte character support, either for
162 Emacs as a whole, or for a single buffer. When multibyte characters are
163 disabled in a buffer, then each byte in that buffer represents a
164 character, even codes 0200 through 0377. The old features for
165 supporting the European character sets, ISO Latin-1 and ISO Latin-2,
166 work as they did in Emacs 19 and also work for the other ISO 8859
167 character sets.
168
169 However, there is no need to turn off multibyte character support to
170 use ISO Latin; the Emacs multibyte character set includes all the
171 characters in these character sets, and Emacs can translate
172 automatically to and from the ISO codes.
173
174 By default, Emacs starts in multibyte mode, because that allows you to
175 use all the supported languages and scripts without limitations.
176
177 To edit a particular file in unibyte representation, visit it using
178 @code{find-file-literally}. @xref{Visiting}. To convert a buffer in
179 multibyte representation into a single-byte representation of the same
180 characters, the easiest way is to save the contents in a file, kill the
181 buffer, and find the file again with @code{find-file-literally}. You
182 can also use @kbd{C-x @key{RET} c}
183 (@code{universal-coding-system-argument}) and specify @samp{raw-text} as
184 the coding system with which to find or save a file. @xref{Specify
185 Coding}. Finding a file as @samp{raw-text} doesn't disable format
186 conversion, uncompression and auto mode selection as
187 @code{find-file-literally} does.
188
189 @vindex enable-multibyte-characters
190 @vindex default-enable-multibyte-characters
191 To turn off multibyte character support by default, start Emacs with
192 the @samp{--unibyte} option (@pxref{Initial Options}), or set the
193 environment variable @env{EMACS_UNIBYTE}. You can also customize
194 @code{enable-multibyte-characters} or, equivalently, directly set the
195 variable @code{default-enable-multibyte-characters} to @code{nil} in
196 your init file to have basically the same effect as @samp{--unibyte}.
197
198 @findex toggle-enable-multibyte-characters
199 To convert a unibyte session to a multibyte session, set
200 @code{default-enable-multibyte-characters} to @code{t}. Buffers which
201 were created in the unibyte session before you turn on multibyte support
202 will stay unibyte. You can turn on multibyte support in a specific
203 buffer by invoking the command @code{toggle-enable-multibyte-characters}
204 in that buffer.
205
206 @cindex Lisp files, and multibyte operation
207 @cindex multibyte operation, and Lisp files
208 @cindex unibyte operation, and Lisp files
209 @cindex init file, and non-ASCII characters
210 @cindex environment variables, and non-ASCII characters
211 With @samp{--unibyte}, multibyte strings are not created during
212 initialization from the values of environment variables,
213 @file{/etc/passwd} entries etc.@: that contain non-ASCII 8-bit
214 characters.
215
216 Emacs normally loads Lisp files as multibyte, regardless of whether
217 you used @samp{--unibyte}. This includes the Emacs initialization
218 file, @file{.emacs}, and the initialization files of Emacs packages
219 such as Gnus. However, you can specify unibyte loading for a
220 particular Lisp file, by putting @w{@samp{-*-unibyte: t;-*-}} in a
221 comment on the first line. Then that file is always loaded as unibyte
222 text, even if you did not start Emacs with @samp{--unibyte}. The
223 motivation for these conventions is that it is more reliable to always
224 load any particular Lisp file in the same way. However, you can load
225 a Lisp file as unibyte, on any one occasion, by typing @kbd{C-x
226 @key{RET} c raw-text @key{RET}} immediately before loading it.
227
228 The mode line indicates whether multibyte character support is enabled
229 in the current buffer. If it is, there are two or more characters (most
230 often two dashes) before the colon near the beginning of the mode line.
231 When multibyte characters are not enabled, just one dash precedes the
232 colon.
233
234 @node Language Environments
235 @section Language Environments
236 @cindex language environments
237
238 All supported character sets are supported in Emacs buffers whenever
239 multibyte characters are enabled; there is no need to select a
240 particular language in order to display its characters in an Emacs
241 buffer. However, it is important to select a @dfn{language environment}
242 in order to set various defaults. The language environment really
243 represents a choice of preferred script (more or less) rather than a
244 choice of language.
245
246 The language environment controls which coding systems to recognize
247 when reading text (@pxref{Recognize Coding}). This applies to files,
248 incoming mail, netnews, and any other text you read into Emacs. It may
249 also specify the default coding system to use when you create a file.
250 Each language environment also specifies a default input method.
251
252 @findex set-language-environment
253 @vindex current-language-environment
254 To select a language environment, customize the option
255 @code{current-language-environment} or use the command @kbd{M-x
256 set-language-environment}. It makes no difference which buffer is
257 current when you use this command, because the effects apply globally to
258 the Emacs session. The supported language environments include:
259
260 @cindex Euro sign
261 @quotation
262 Chinese-BIG5, Chinese-CNS, Chinese-GB, Cyrillic-ALT, Cyrillic-ISO,
263 Cyrillic-KOI8, Czech, Devanagari, Dutch, English, Ethiopic, German,
264 Greek, Hebrew, IPA, Japanese, Korean, Lao, Latin-1, Latin-2, Latin-3,
265 Latin-4, Latin-5, Latin-8 (Celtic), Latin-9 (updated Latin-1, with the
266 Euro sign), Polish, Romanian, Slovak, Slovenian, Spanish, Thai,
267 Tibetan, Turkish, and Vietnamese.
268 @end quotation
269
270 @cindex fonts for various scripts
271 @cindex Intlfonts package, installation
272 To display the script(s) used by your language environment on a
273 graphical display, you need to have a suitable font. If some of the
274 characters appear as empty boxes, you should install the GNU Intlfonts
275 package, which includes fonts for all supported scripts.@footnote{If
276 you run Emacs on X, you need to inform the X server about the location
277 of the newly installed fonts with the following commands:
278
279 @example
280 xset fp+ /usr/local/share/emacs/fonts
281 xset fp rehash
282 @end example
283 }
284 @xref{Fontsets}, for more details about setting up your fonts.
285
286 @findex set-locale-environment
287 @vindex locale-language-names
288 @vindex locale-charset-language-names
289 @cindex locales
290 Some operating systems let you specify the character-set locale you
291 are using by setting the locale environment variables @env{LC_ALL},
292 @env{LC_CTYPE}, or @env{LANG}.@footnote{If more than one of these is
293 set, the first one that is nonempty specifies your locale for this
294 purpose.} During startup, Emacs looks up your character-set locale's
295 name in the system locale alias table, matches its canonical name
296 against entries in the value of the variables
297 @code{locale-charset-language-names} and @code{locale-language-names},
298 and selects the corresponding language environment if a match is found.
299 (The former variable overrides the latter.) It also adjusts the display
300 table and terminal coding system, the locale coding system, and the
301 preferred coding system as needed for the locale.
302
303 If you modify the @env{LC_ALL}, @env{LC_CTYPE}, or @env{LANG}
304 environment variables while running Emacs, you may want to invoke the
305 @code{set-locale-environment} function afterwards to readjust the
306 language environment from the new locale.
307
308 @vindex locale-preferred-coding-systems
309 The @code{set-locale-environment} function normally uses the preferred
310 coding system established by the language environment to decode system
311 messages. But if your locale matches an entry in the variable
312 @code{locale-preferred-coding-systems}, Emacs uses the corresponding
313 coding system instead. For example, if the locale @samp{ja_JP.PCK}
314 matches @code{japanese-shift-jis} in
315 @code{locale-preferred-coding-systems}, Emacs uses that encoding even
316 though it might normally use @code{japanese-iso-8bit}.
317
318 You can override the language environment chosen at startup with
319 explicit use of the command @code{set-language-environment}, or with
320 customization of @code{current-language-environment} in your init
321 file.
322
323 @kindex C-h L
324 @findex describe-language-environment
325 To display information about the effects of a certain language
326 environment @var{lang-env}, use the command @kbd{C-h L @var{lang-env}
327 @key{RET}} (@code{describe-language-environment}). This tells you which
328 languages this language environment is useful for, and lists the
329 character sets, coding systems, and input methods that go with it. It
330 also shows some sample text to illustrate scripts used in this language
331 environment. By default, this command describes the chosen language
332 environment.
333
334 @vindex set-language-environment-hook
335 You can customize any language environment with the normal hook
336 @code{set-language-environment-hook}. The command
337 @code{set-language-environment} runs that hook after setting up the new
338 language environment. The hook functions can test for a specific
339 language environment by checking the variable
340 @code{current-language-environment}. This hook is where you should
341 put non-default settings for specific language environment, such as
342 coding systems for keyboard input and terminal output, the default
343 input method, etc.
344
345 @vindex exit-language-environment-hook
346 Before it starts to set up the new language environment,
347 @code{set-language-environment} first runs the hook
348 @code{exit-language-environment-hook}. This hook is useful for undoing
349 customizations that were made with @code{set-language-environment-hook}.
350 For instance, if you set up a special key binding in a specific language
351 environment using @code{set-language-environment-hook}, you should set
352 up @code{exit-language-environment-hook} to restore the normal binding
353 for that key.
354
355 @node Input Methods
356 @section Input Methods
357
358 @cindex input methods
359 An @dfn{input method} is a kind of character conversion designed
360 specifically for interactive input. In Emacs, typically each language
361 has its own input method; sometimes several languages which use the same
362 characters can share one input method. A few languages support several
363 input methods.
364
365 The simplest kind of input method works by mapping ASCII letters
366 into another alphabet; this allows you to use one other alphabet
367 instead of ASCII. The Greek and Russian input methods
368 work this way.
369
370 A more powerful technique is composition: converting sequences of
371 characters into one letter. Many European input methods use composition
372 to produce a single non-ASCII letter from a sequence that consists of a
373 letter followed by accent characters (or vice versa). For example, some
374 methods convert the sequence @kbd{a'} into a single accented letter.
375 These input methods have no special commands of their own; all they do
376 is compose sequences of printing characters.
377
378 The input methods for syllabic scripts typically use mapping followed
379 by composition. The input methods for Thai and Korean work this way.
380 First, letters are mapped into symbols for particular sounds or tone
381 marks; then, sequences of these which make up a whole syllable are
382 mapped into one syllable sign.
383
384 Chinese and Japanese require more complex methods. In Chinese input
385 methods, first you enter the phonetic spelling of a Chinese word (in
386 input method @code{chinese-py}, among others), or a sequence of
387 portions of the character (input methods @code{chinese-4corner} and
388 @code{chinese-sw}, and others). One input sequence typically
389 corresponds to many possible Chinese characters. You select the one
390 you mean using keys such as @kbd{C-f}, @kbd{C-b}, @kbd{C-n},
391 @kbd{C-p}, and digits, which have special meanings in this situation.
392
393 The possible characters are conceptually arranged in several rows,
394 with each row holding up to 10 alternatives. Normally, Emacs displays
395 just one row at a time, in the echo area; @code{(@var{i}/@var{j})}
396 appears at the beginning, to indicate that this is the @var{i}th row
397 out of a total of @var{j} rows. Type @kbd{C-n} or @kbd{C-p} to
398 display the next row or the previous row.
399
400 Type @kbd{C-f} and @kbd{C-b} to move forward and backward among
401 the alternatives in the current row. As you do this, Emacs highlights
402 the current alternative with a special color; type @code{C-@key{SPC}}
403 to select the current alternative and use it as input. The
404 alternatives in the row are also numbered; the number appears before
405 the alternative. Typing a digit @var{n} selects the @var{n}th
406 alternative of the current row and uses it as input.
407
408 @key{TAB} in these Chinese input methods displays a buffer showing
409 all the possible characters at once; then clicking @kbd{Mouse-2} on
410 one of them selects that alternative. The keys @kbd{C-f}, @kbd{C-b},
411 @kbd{C-n}, @kbd{C-p}, and digits continue to work as usual, but they
412 do the highlighting in the buffer showing the possible characters,
413 rather than in the echo area.
414
415 In Japanese input methods, first you input a whole word using
416 phonetic spelling; then, after the word is in the buffer, Emacs
417 converts it into one or more characters using a large dictionary. One
418 phonetic spelling corresponds to a number of different Japanese words;
419 to select one of them, use @kbd{C-n} and @kbd{C-p} to cycle through
420 the alternatives.
421
422 Sometimes it is useful to cut off input method processing so that the
423 characters you have just entered will not combine with subsequent
424 characters. For example, in input method @code{latin-1-postfix}, the
425 sequence @kbd{e '} combines to form an @samp{e} with an accent. What if
426 you want to enter them as separate characters?
427
428 One way is to type the accent twice; this is a special feature for
429 entering the separate letter and accent. For example, @kbd{e ' '} gives
430 you the two characters @samp{e'}. Another way is to type another letter
431 after the @kbd{e}---something that won't combine with that---and
432 immediately delete it. For example, you could type @kbd{e e @key{DEL}
433 '} to get separate @samp{e} and @samp{'}.
434
435 Another method, more general but not quite as easy to type, is to use
436 @kbd{C-\ C-\} between two characters to stop them from combining. This
437 is the command @kbd{C-\} (@code{toggle-input-method}) used twice.
438 @ifinfo
439 @xref{Select Input Method}.
440 @end ifinfo
441
442 @cindex incremental search, input method interference
443 @kbd{C-\ C-\} is especially useful inside an incremental search,
444 because it stops waiting for more characters to combine, and starts
445 searching for what you have already entered.
446
447 @vindex input-method-verbose-flag
448 @vindex input-method-highlight-flag
449 The variables @code{input-method-highlight-flag} and
450 @code{input-method-verbose-flag} control how input methods explain
451 what is happening. If @code{input-method-highlight-flag} is
452 non-@code{nil}, the partial sequence is highlighted in the buffer (for
453 most input methods---some disable this feature). If
454 @code{input-method-verbose-flag} is non-@code{nil}, the list of
455 possible characters to type next is displayed in the echo area (but
456 not when you are in the minibuffer).
457
458 @cindex Leim package
459 Input methods are implemented in the separate Leim package: they are
460 available only if the system administrator used Leim when building
461 Emacs. If Emacs was built without Leim, you will find that no input
462 methods are defined.
463
464 @node Select Input Method
465 @section Selecting an Input Method
466
467 @table @kbd
468 @item C-\
469 Enable or disable use of the selected input method.
470
471 @item C-x @key{RET} C-\ @var{method} @key{RET}
472 Select a new input method for the current buffer.
473
474 @item C-h I @var{method} @key{RET}
475 @itemx C-h C-\ @var{method} @key{RET}
476 @findex describe-input-method
477 @kindex C-h I
478 @kindex C-h C-\
479 Describe the input method @var{method} (@code{describe-input-method}).
480 By default, it describes the current input method (if any). This
481 description should give you the full details of how to use any
482 particular input method.
483
484 @item M-x list-input-methods
485 Display a list of all the supported input methods.
486 @end table
487
488 @findex set-input-method
489 @vindex current-input-method
490 @kindex C-x RET C-\
491 To choose an input method for the current buffer, use @kbd{C-x
492 @key{RET} C-\} (@code{set-input-method}). This command reads the
493 input method name from the minibuffer; the name normally starts with the
494 language environment that it is meant to be used with. The variable
495 @code{current-input-method} records which input method is selected.
496
497 @findex toggle-input-method
498 @kindex C-\
499 Input methods use various sequences of ASCII characters to stand for
500 non-ASCII characters. Sometimes it is useful to turn off the input
501 method temporarily. To do this, type @kbd{C-\}
502 (@code{toggle-input-method}). To reenable the input method, type
503 @kbd{C-\} again.
504
505 If you type @kbd{C-\} and you have not yet selected an input method,
506 it prompts for you to specify one. This has the same effect as using
507 @kbd{C-x @key{RET} C-\} to specify an input method.
508
509 When invoked with a numeric argument, as in @kbd{C-u C-\},
510 @code{toggle-input-method} always prompts you for an input method,
511 suggesting the most recently selected one as the default.
512
513 @vindex default-input-method
514 Selecting a language environment specifies a default input method for
515 use in various buffers. When you have a default input method, you can
516 select it in the current buffer by typing @kbd{C-\}. The variable
517 @code{default-input-method} specifies the default input method
518 (@code{nil} means there is none).
519
520 In some language environments, which support several different input
521 methods, you might want to use an input method different from the
522 default chosen by @code{set-language-environment}. You can instruct
523 Emacs to select a different default input method for a certain
524 language environment, if you wish, by using
525 @code{set-language-environment-hook} (@pxref{Language Environments,
526 set-language-environment-hook}). For example:
527
528 @lisp
529 (defun my-chinese-setup ()
530 "Set up my private Chinese environment."
531 (if (equal current-language-environment "Chinese-GB")
532 (setq default-input-method "chinese-tonepy")))
533 (add-hook 'set-language-environment-hook 'my-chinese-setup)
534 @end lisp
535
536 @noindent
537 This sets the default input method to be @code{chinese-tonepy}
538 whenever you choose a Chinese-GB language environment.
539
540 @findex quail-set-keyboard-layout
541 Some input methods for alphabetic scripts work by (in effect)
542 remapping the keyboard to emulate various keyboard layouts commonly used
543 for those scripts. How to do this remapping properly depends on your
544 actual keyboard layout. To specify which layout your keyboard has, use
545 the command @kbd{M-x quail-set-keyboard-layout}.
546
547 @findex list-input-methods
548 To display a list of all the supported input methods, type @kbd{M-x
549 list-input-methods}. The list gives information about each input
550 method, including the string that stands for it in the mode line.
551
552 @node Multibyte Conversion
553 @section Unibyte and Multibyte Non-ASCII characters
554
555 When multibyte characters are enabled, character codes 0240 (octal)
556 through 0377 (octal) are not really legitimate in the buffer. The valid
557 non-ASCII printing characters have codes that start from 0400.
558
559 If you type a self-inserting character in the range 0240 through
560 0377, or if you use @kbd{C-q} to insert one, Emacs assumes you
561 intended to use one of the ISO Latin-@var{n} character sets, and
562 converts it to the Emacs code representing that Latin-@var{n}
563 character. You select @emph{which} ISO Latin character set to use
564 through your choice of language environment
565 @iftex
566 (see above).
567 @end iftex
568 @ifinfo
569 (@pxref{Language Environments}).
570 @end ifinfo
571 If you do not specify a choice, the default is Latin-1.
572
573 If you insert a character in the range 0200 through 0237, which
574 forms the @code{eight-bit-control} character set, it is inserted
575 literally. You should normally avoid doing this since buffers
576 containing such characters have to be written out in either the
577 @code{emacs-mule} or @code{raw-text} coding system, which is usually
578 not what you want.
579
580 @node Coding Systems
581 @section Coding Systems
582 @cindex coding systems
583
584 Users of various languages have established many more-or-less standard
585 coding systems for representing them. Emacs does not use these coding
586 systems internally; instead, it converts from various coding systems to
587 its own system when reading data, and converts the internal coding
588 system to other coding systems when writing data. Conversion is
589 possible in reading or writing files, in sending or receiving from the
590 terminal, and in exchanging data with subprocesses.
591
592 Emacs assigns a name to each coding system. Most coding systems are
593 used for one language, and the name of the coding system starts with the
594 language name. Some coding systems are used for several languages;
595 their names usually start with @samp{iso}. There are also special
596 coding systems @code{no-conversion}, @code{raw-text} and
597 @code{emacs-mule} which do not convert printing characters at all.
598
599 @cindex international files from DOS/Windows systems
600 A special class of coding systems, collectively known as
601 @dfn{codepages}, is designed to support text encoded by MS-Windows and
602 MS-DOS software. To use any of these systems, you need to create it
603 with @kbd{M-x codepage-setup}. @xref{MS-DOS and MULE}. After
604 creating the coding system for the codepage, you can use it as any
605 other coding system. For example, to visit a file encoded in codepage
606 850, type @kbd{C-x @key{RET} c cp850 @key{RET} C-x C-f @var{filename}
607 @key{RET}}.
608
609 In addition to converting various representations of non-ASCII
610 characters, a coding system can perform end-of-line conversion. Emacs
611 handles three different conventions for how to separate lines in a file:
612 newline, carriage-return linefeed, and just carriage-return.
613
614 @table @kbd
615 @item C-h C @var{coding} @key{RET}
616 Describe coding system @var{coding}.
617
618 @item C-h C @key{RET}
619 Describe the coding systems currently in use.
620
621 @item M-x list-coding-systems
622 Display a list of all the supported coding systems.
623 @end table
624
625 @kindex C-h C
626 @findex describe-coding-system
627 The command @kbd{C-h C} (@code{describe-coding-system}) displays
628 information about particular coding systems. You can specify a coding
629 system name as the argument; alternatively, with an empty argument, it
630 describes the coding systems currently selected for various purposes,
631 both in the current buffer and as the defaults, and the priority list
632 for recognizing coding systems (@pxref{Recognize Coding}).
633
634 @findex list-coding-systems
635 To display a list of all the supported coding systems, type @kbd{M-x
636 list-coding-systems}. The list gives information about each coding
637 system, including the letter that stands for it in the mode line
638 (@pxref{Mode Line}).
639
640 @cindex end-of-line conversion
641 @cindex MS-DOS end-of-line conversion
642 @cindex Macintosh end-of-line conversion
643 Each of the coding systems that appear in this list---except for
644 @code{no-conversion}, which means no conversion of any kind---specifies
645 how and whether to convert printing characters, but leaves the choice of
646 end-of-line conversion to be decided based on the contents of each file.
647 For example, if the file appears to use the sequence carriage-return
648 linefeed to separate lines, DOS end-of-line conversion will be used.
649
650 Each of the listed coding systems has three variants which specify
651 exactly what to do for end-of-line conversion:
652
653 @table @code
654 @item @dots{}-unix
655 Don't do any end-of-line conversion; assume the file uses
656 newline to separate lines. (This is the convention normally used
657 on Unix and GNU systems.)
658
659 @item @dots{}-dos
660 Assume the file uses carriage-return linefeed to separate lines, and do
661 the appropriate conversion. (This is the convention normally used on
662 Microsoft systems.@footnote{It is also specified for MIME @samp{text/*}
663 bodies and in other network transport contexts. It is different
664 from the SGML reference syntax record-start/record-end format which
665 Emacs doesn't support directly.})
666
667 @item @dots{}-mac
668 Assume the file uses carriage-return to separate lines, and do the
669 appropriate conversion. (This is the convention normally used on the
670 Macintosh system.)
671 @end table
672
673 These variant coding systems are omitted from the
674 @code{list-coding-systems} display for brevity, since they are entirely
675 predictable. For example, the coding system @code{iso-latin-1} has
676 variants @code{iso-latin-1-unix}, @code{iso-latin-1-dos} and
677 @code{iso-latin-1-mac}.
678
679 The coding system @code{raw-text} is good for a file which is mainly
680 ASCII text, but may contain byte values above 127 which are not meant to
681 encode non-ASCII characters. With @code{raw-text}, Emacs copies those
682 byte values unchanged, and sets @code{enable-multibyte-characters} to
683 @code{nil} in the current buffer so that they will be interpreted
684 properly. @code{raw-text} handles end-of-line conversion in the usual
685 way, based on the data encountered, and has the usual three variants to
686 specify the kind of end-of-line conversion to use.
687
688 In contrast, the coding system @code{no-conversion} specifies no
689 character code conversion at all---none for non-ASCII byte values and
690 none for end of line. This is useful for reading or writing binary
691 files, tar files, and other files that must be examined verbatim. It,
692 too, sets @code{enable-multibyte-characters} to @code{nil}.
693
694 The easiest way to edit a file with no conversion of any kind is with
695 the @kbd{M-x find-file-literally} command. This uses
696 @code{no-conversion}, and also suppresses other Emacs features that
697 might convert the file contents before you see them. @xref{Visiting}.
698
699 The coding system @code{emacs-mule} means that the file contains
700 non-ASCII characters stored with the internal Emacs encoding. It
701 handles end-of-line conversion based on the data encountered, and has
702 the usual three variants to specify the kind of end-of-line conversion.
703
704 @node Recognize Coding
705 @section Recognizing Coding Systems
706
707 Emacs tries to recognize which coding system to use for a given text
708 as an integral part of reading that text. (This applies to files
709 being read, output from subprocesses, text from X selections, etc.)
710 Emacs can select the right coding system automatically most of the
711 time---once you have specified your preferences.
712
713 Some coding systems can be recognized or distinguished by which byte
714 sequences appear in the data. However, there are coding systems that
715 cannot be distinguished, not even potentially. For example, there is no
716 way to distinguish between Latin-1 and Latin-2; they use the same byte
717 values with different meanings.
718
719 Emacs handles this situation by means of a priority list of coding
720 systems. Whenever Emacs reads a file, if you do not specify the coding
721 system to use, Emacs checks the data against each coding system,
722 starting with the first in priority and working down the list, until it
723 finds a coding system that fits the data. Then it converts the file
724 contents assuming that they are represented in this coding system.
725
726 The priority list of coding systems depends on the selected language
727 environment (@pxref{Language Environments}). For example, if you use
728 French, you probably want Emacs to prefer Latin-1 to Latin-2; if you use
729 Czech, you probably want Latin-2 to be preferred. This is one of the
730 reasons to specify a language environment.
731
732 @findex prefer-coding-system
733 However, you can alter the priority list in detail with the command
734 @kbd{M-x prefer-coding-system}. This command reads the name of a coding
735 system from the minibuffer, and adds it to the front of the priority
736 list, so that it is preferred to all others. If you use this command
737 several times, each use adds one element to the front of the priority
738 list.
739
740 If you use a coding system that specifies the end-of-line conversion
741 type, such as @code{iso-8859-1-dos}, what this means is that Emacs
742 should attempt to recognize @code{iso-8859-1} with priority, and should
743 use DOS end-of-line conversion when it does recognize @code{iso-8859-1}.
744
745 @vindex file-coding-system-alist
746 Sometimes a file name indicates which coding system to use for the
747 file. The variable @code{file-coding-system-alist} specifies this
748 correspondence. There is a special function
749 @code{modify-coding-system-alist} for adding elements to this list. For
750 example, to read and write all @samp{.txt} files using the coding system
751 @code{china-iso-8bit}, you can execute this Lisp expression:
752
753 @smallexample
754 (modify-coding-system-alist 'file "\\.txt\\'" 'china-iso-8bit)
755 @end smallexample
756
757 @noindent
758 The first argument should be @code{file}, the second argument should be
759 a regular expression that determines which files this applies to, and
760 the third argument says which coding system to use for these files.
761
762 @vindex inhibit-eol-conversion
763 @cindex DOS-style end-of-line display
764 Emacs recognizes which kind of end-of-line conversion to use based on
765 the contents of the file: if it sees only carriage-returns, or only
766 carriage-return linefeed sequences, then it chooses the end-of-line
767 conversion accordingly. You can inhibit the automatic use of
768 end-of-line conversion by setting the variable @code{inhibit-eol-conversion}
769 to non-@code{nil}. If you do that, DOS-style files will be displayed
770 with the @samp{^M} characters visible in the buffer; some people
771 prefer this to the more subtle @samp{(DOS)} end-of-line type
772 indication near the left edge of the mode line (@pxref{Mode Line,
773 eol-mnemonic}).
774
775 @vindex inhibit-iso-escape-detection
776 @cindex escape sequences in files
777 By default, the automatic detection of coding system is sensitive to
778 escape sequences. If Emacs sees a sequence of characters that begin
779 with an escape character, and the sequence is valid as an ISO-2022
780 code, that tells Emacs to use one of the ISO-2022 encodings to decode
781 the file.
782
783 However, there may be cases that you want to read escape sequences
784 in a file as is. In such a case, you can set the variable
785 @code{inhibit-iso-escape-detection} to non-@code{nil}. Then the code
786 detection ignores any escape sequences, and never uses an ISO-2022
787 encoding. The result is that all escape sequences become visible in
788 the buffer.
789
790 The default value of @code{inhibit-iso-escape-detection} is
791 @code{nil}. We recommend that you not change it permanently, only for
792 one specific operation. That's because many Emacs Lisp source files
793 in the Emacs distribution contain non-ASCII characters encoded in the
794 coding system @code{iso-2022-7bit}, and they won't be
795 decoded correctly when you visit those files if you suppress the
796 escape sequence detection.
797
798 @vindex coding
799 You can specify the coding system for a particular file using the
800 @w{@samp{-*-@dots{}-*-}} construct at the beginning of a file, or a
801 local variables list at the end (@pxref{File Variables}). You do this
802 by defining a value for the ``variable'' named @code{coding}. Emacs
803 does not really have a variable @code{coding}; instead of setting a
804 variable, this uses the specified coding system for the file. For
805 example, @samp{-*-mode: C; coding: latin-1;-*-} specifies use of the
806 Latin-1 coding system, as well as C mode. When you specify the coding
807 explicitly in the file, that overrides
808 @code{file-coding-system-alist}.
809
810 @vindex auto-coding-alist
811 @vindex auto-coding-regexp-alist
812 The variables @code{auto-coding-alist} and
813 @code{auto-coding-regexp-alist} are the strongest way to specify the
814 coding system for certain patterns of file names, or for files
815 containing certain patterns; these variables even override
816 @samp{-*-coding:-*-} tags in the file itself. Emacs uses
817 @code{auto-coding-alist} for tar and archive files, to prevent it
818 from being confused by a @samp{-*-coding:-*-} tag in a member of the
819 archive and thinking it applies to the archive file as a whole.
820 Likewise, Emacs uses @code{auto-coding-regexp-alist} to ensure that
821 RMAIL files, whose names in general don't match any particular pattern,
822 are decoded correctly.
823
824 If Emacs recognizes the encoding of a file incorrectly, you can
825 reread the file using the correct coding system by typing @kbd{C-x
826 @key{RET} c @var{coding-system} @key{RET} M-x revert-buffer
827 @key{RET}}. To see what coding system Emacs actually used to decode
828 the file, look at the coding system mnemonic letter near the left edge
829 of the mode line (@pxref{Mode Line}), or type @kbd{C-h C @key{RET}}.
830
831 @vindex buffer-file-coding-system
832 Once Emacs has chosen a coding system for a buffer, it stores that
833 coding system in @code{buffer-file-coding-system} and uses that coding
834 system, by default, for operations that write from this buffer into a
835 file. This includes the commands @code{save-buffer} and
836 @code{write-region}. If you want to write files from this buffer using
837 a different coding system, you can specify a different coding system for
838 the buffer using @code{set-buffer-file-coding-system} (@pxref{Specify
839 Coding}).
840
841 You can insert any possible character into any Emacs buffer, but
842 most coding systems can only handle some of the possible characters.
843 This means that it is possible for you to insert characters that
844 cannot be encoded with the coding system that will be used to save the
845 buffer. For example, you could start with an ASCII file and insert a
846 few Latin-1 characters into it, or you could edit a text file in
847 Polish encoded in @code{iso-8859-2} and add some Russian words to it.
848 When you save the buffer, Emacs cannot use the current value of
849 @code{buffer-file-coding-system}, because the characters you added
850 cannot be encoded by that coding system.
851
852 When that happens, Emacs tries the most-preferred coding system (set
853 by @kbd{M-x prefer-coding-system} or @kbd{M-x
854 set-language-environment}), and if that coding system can safely
855 encode all of the characters in the buffer, Emacs uses it, and stores
856 its value in @code{buffer-file-coding-system}. Otherwise, Emacs
857 displays a list of coding systems suitable for encoding the buffer's
858 contents, and asks you to choose one of those coding systems.
859
860 If you insert the unsuitable characters in a mail message, Emacs
861 behaves a bit differently. It additionally checks whether the
862 most-preferred coding system is recommended for use in MIME messages;
863 if not, Emacs tells you that the most-preferred coding system is
864 not recommended and prompts you for another coding system. This is so
865 you won't inadvertently send a message encoded in a way that your
866 recipient's mail software will have difficulty decoding. (If you do
867 want to use the most-preferred coding system, you can still type its
868 name in response to the question.)
869
870 @vindex sendmail-coding-system
871 When you send a message with Mail mode (@pxref{Sending Mail}), Emacs has
872 four different ways to determine the coding system to use for encoding
873 the message text. It tries the buffer's own value of
874 @code{buffer-file-coding-system}, if that is non-@code{nil}. Otherwise,
875 it uses the value of @code{sendmail-coding-system}, if that is
876 non-@code{nil}. The third way is to use the default coding system for
877 new files, which is controlled by your choice of language environment,
878 if that is non-@code{nil}. If all of these three values are @code{nil},
879 Emacs encodes outgoing mail using the Latin-1 coding system.
880
881 @vindex rmail-decode-mime-charset
882 When you get new mail in Rmail, each message is translated
883 automatically from the coding system it is written in, as if it were a
884 separate file. This uses the priority list of coding systems that you
885 have specified. If a MIME message specifies a character set, Rmail
886 obeys that specification, unless @code{rmail-decode-mime-charset} is
887 @code{nil}.
888
889 @vindex rmail-file-coding-system
890 For reading and saving Rmail files themselves, Emacs uses the coding
891 system specified by the variable @code{rmail-file-coding-system}. The
892 default value is @code{nil}, which means that Rmail files are not
893 translated (they are read and written in the Emacs internal character
894 code).
895
896 @node Specify Coding
897 @section Specifying a Coding System
898
899 In cases where Emacs does not automatically choose the right coding
900 system, you can use these commands to specify one:
901
902 @table @kbd
903 @item C-x @key{RET} f @var{coding} @key{RET}
904 Use coding system @var{coding} for the visited file
905 in the current buffer.
906
907 @item C-x @key{RET} c @var{coding} @key{RET}
908 Specify coding system @var{coding} for the immediately following
909 command.
910
911 @item C-x @key{RET} k @var{coding} @key{RET}
912 Use coding system @var{coding} for keyboard input.
913
914 @item C-x @key{RET} t @var{coding} @key{RET}
915 Use coding system @var{coding} for terminal output.
916
917 @item C-x @key{RET} p @var{input-coding} @key{RET} @var{output-coding} @key{RET}
918 Use coding systems @var{input-coding} and @var{output-coding} for
919 subprocess input and output in the current buffer.
920
921 @item C-x @key{RET} x @var{coding} @key{RET}
922 Use coding system @var{coding} for transferring selections to and from
923 other programs through the window system.
924
925 @item C-x @key{RET} X @var{coding} @key{RET}
926 Use coding system @var{coding} for transferring @emph{one}
927 selection---the next one---to or from the window system.
928 @end table
929
930 @kindex C-x RET f
931 @findex set-buffer-file-coding-system
932 The command @kbd{C-x @key{RET} f} (@code{set-buffer-file-coding-system})
933 specifies the file coding system for the current buffer---in other
934 words, which coding system to use when saving or rereading the visited
935 file. You specify which coding system using the minibuffer. Since this
936 command applies to a file you have already visited, it affects only the
937 way the file is saved.
938
939 @kindex C-x RET c
940 @findex universal-coding-system-argument
941 Another way to specify the coding system for a file is when you visit
942 the file. First use the command @kbd{C-x @key{RET} c}
943 (@code{universal-coding-system-argument}); this command uses the
944 minibuffer to read a coding system name. After you exit the minibuffer,
945 the specified coding system is used for @emph{the immediately following
946 command}.
947
948 So if the immediately following command is @kbd{C-x C-f}, for example,
949 it reads the file using that coding system (and records the coding
950 system for when the file is saved). Or if the immediately following
951 command is @kbd{C-x C-w}, it writes the file using that coding system.
952 Other file commands affected by a specified coding system include
953 @kbd{C-x C-i} and @kbd{C-x C-v}, as well as the other-window variants of
954 @kbd{C-x C-f}.
955
956 @kbd{C-x @key{RET} c} also affects commands that start subprocesses,
957 including @kbd{M-x shell} (@pxref{Shell}).
958
959 However, if the immediately following command does not use the coding
960 system, then @kbd{C-x @key{RET} c} ultimately has no effect.
961
962 An easy way to visit a file with no conversion is with the @kbd{M-x
963 find-file-literally} command. @xref{Visiting}.
964
965 @vindex default-buffer-file-coding-system
966 The variable @code{default-buffer-file-coding-system} specifies the
967 choice of coding system to use when you create a new file. It applies
968 when you find a new file, and when you create a buffer and then save it
969 in a file. Selecting a language environment typically sets this
970 variable to a good choice of default coding system for that language
971 environment.
972
973 @kindex C-x RET t
974 @findex set-terminal-coding-system
975 The command @kbd{C-x @key{RET} t} (@code{set-terminal-coding-system})
976 specifies the coding system for terminal output. If you specify a
977 character code for terminal output, all characters output to the
978 terminal are translated into that coding system.
979
980 This feature is useful for certain character-only terminals built to
981 support specific languages or character sets---for example, European
982 terminals that support one of the ISO Latin character sets. You need to
983 specify the terminal coding system when using multibyte text, so that
984 Emacs knows which characters the terminal can actually handle.
985
986 By default, output to the terminal is not translated at all, unless
987 Emacs can deduce the proper coding system from your terminal type or
988 your locale specification (@pxref{Language Environments}).
989
990 @kindex C-x RET k
991 @findex set-keyboard-coding-system
992 @vindex keyboard-coding-system
993 The command @kbd{C-x @key{RET} k} (@code{set-keyboard-coding-system})
994 or the Custom option @code{keyboard-coding-system}
995 specifies the coding system for keyboard input. Character-code
996 translation of keyboard input is useful for terminals with keys that
997 send non-ASCII graphic characters---for example, some terminals designed
998 for ISO Latin-1 or subsets of it.
999
1000 By default, keyboard input is not translated at all.
1001
1002 There is a similarity between using a coding system translation for
1003 keyboard input, and using an input method: both define sequences of
1004 keyboard input that translate into single characters. However, input
1005 methods are designed to be convenient for interactive use by humans, and
1006 the sequences that are translated are typically sequences of ASCII
1007 printing characters. Coding systems typically translate sequences of
1008 non-graphic characters.
1009
1010 @kindex C-x RET x
1011 @kindex C-x RET X
1012 @findex set-selection-coding-system
1013 @findex set-next-selection-coding-system
1014 The command @kbd{C-x @key{RET} x} (@code{set-selection-coding-system})
1015 specifies the coding system for sending selected text to the window
1016 system, and for receiving the text of selections made in other
1017 applications. This command applies to all subsequent selections, until
1018 you override it by using the command again. The command @kbd{C-x
1019 @key{RET} X} (@code{set-next-selection-coding-system}) specifies the
1020 coding system for the next selection made in Emacs or read by Emacs.
1021
1022 @kindex C-x RET p
1023 @findex set-buffer-process-coding-system
1024 The command @kbd{C-x @key{RET} p} (@code{set-buffer-process-coding-system})
1025 specifies the coding system for input and output to a subprocess. This
1026 command applies to the current buffer; normally, each subprocess has its
1027 own buffer, and thus you can use this command to specify translation to
1028 and from a particular subprocess by giving the command in the
1029 corresponding buffer.
1030
1031 The default for translation of process input and output depends on the
1032 current language environment.
1033
1034 @vindex file-name-coding-system
1035 @cindex file names with non-ASCII characters
1036 The variable @code{file-name-coding-system} specifies a coding system
1037 to use for encoding file names. If you set the variable to a coding
1038 system name (as a Lisp symbol or a string), Emacs encodes file names
1039 using that coding system for all file operations. This makes it
1040 possible to use non-ASCII characters in file names---or, at least, those
1041 non-ASCII characters which the specified coding system can encode.
1042
1043 If @code{file-name-coding-system} is @code{nil}, Emacs uses a default
1044 coding system determined by the selected language environment. In the
1045 default language environment, any non-ASCII characters in file names are
1046 not encoded specially; they appear in the file system using the internal
1047 Emacs representation.
1048
1049 @strong{Warning:} if you change @code{file-name-coding-system} (or the
1050 language environment) in the middle of an Emacs session, problems can
1051 result if you have already visited files whose names were encoded using
1052 the earlier coding system and cannot be encoded (or are encoded
1053 differently) under the new coding system. If you try to save one of
1054 these buffers under the visited file name, saving may use the wrong file
1055 name, or it may get an error. If such a problem happens, use @kbd{C-x
1056 C-w} to specify a new file name for that buffer.
1057
1058 @vindex locale-coding-system
1059 The variable @code{locale-coding-system} specifies a coding system
1060 to use when encoding and decoding system strings such as system error
1061 messages and @code{format-time-string} formats and time stamps. You
1062 should choose a coding system that is compatible with the underlying
1063 system's text representation, which is normally specified by one of
1064 the environment variables @env{LC_ALL}, @env{LC_CTYPE}, and
1065 @env{LANG}. (The first one, in the order specified above, whose value
1066 is nonempty is the one that determines the text representation.)
1067
1068 @node Fontsets
1069 @section Fontsets
1070 @cindex fontsets
1071
1072 A font for X typically defines shapes for a single alphabet or script.
1073 Therefore, displaying the entire range of scripts that Emacs supports
1074 requires a collection of many fonts. In Emacs, such a collection is
1075 called a @dfn{fontset}. A fontset is defined by a list of fonts, each
1076 assigned to handle a range of character codes.
1077
1078 Each fontset has a name, like a font. The available X fonts are
1079 defined by the X server; fontsets, however, are defined within Emacs
1080 itself. Once you have defined a fontset, you can use it within Emacs by
1081 specifying its name, anywhere that you could use a single font. Of
1082 course, Emacs fontsets can use only the fonts that the X server
1083 supports; if certain characters appear on the screen as hollow boxes,
1084 this means that the fontset in use for them has no font for those
1085 characters.@footnote{The Emacs installation instructions have information on
1086 additional font support.}
1087
1088 Emacs creates two fontsets automatically: the @dfn{standard fontset}
1089 and the @dfn{startup fontset}. The standard fontset is most likely to
1090 have fonts for a wide variety of non-ASCII characters; however, this is
1091 not the default for Emacs to use. (By default, Emacs tries to find a
1092 font that has bold and italic variants.) You can specify use of the
1093 standard fontset with the @samp{-fn} option, or with the @samp{Font} X
1094 resource (@pxref{Font X}). For example,
1095
1096 @example
1097 emacs -fn fontset-standard
1098 @end example
1099
1100 A fontset does not necessarily specify a font for every character
1101 code. If a fontset specifies no font for a certain character, or if it
1102 specifies a font that does not exist on your system, then it cannot
1103 display that character properly. It will display that character as an
1104 empty box instead.
1105
1106 @vindex highlight-wrong-size-font
1107 The fontset height and width are determined by the ASCII characters
1108 (that is, by the font used for ASCII characters in that fontset). If
1109 another font in the fontset has a different height, or a different
1110 width, then characters assigned to that font are clipped to the
1111 fontset's size. If @code{highlight-wrong-size-font} is non-@code{nil},
1112 a box is displayed around these wrong-size characters as well.
1113
1114 @node Defining Fontsets
1115 @section Defining fontsets
1116
1117 @vindex standard-fontset-spec
1118 @cindex standard fontset
1119 Emacs creates a standard fontset automatically according to the value
1120 of @code{standard-fontset-spec}. This fontset's name is
1121
1122 @example
1123 -*-fixed-medium-r-normal-*-16-*-*-*-*-*-fontset-standard
1124 @end example
1125
1126 @noindent
1127 or just @samp{fontset-standard} for short.
1128
1129 Bold, italic, and bold-italic variants of the standard fontset are
1130 created automatically. Their names have @samp{bold} instead of
1131 @samp{medium}, or @samp{i} instead of @samp{r}, or both.
1132
1133 @cindex startup fontset
1134 If you specify a default ASCII font with the @samp{Font} resource or
1135 the @samp{-fn} argument, Emacs generates a fontset from it
1136 automatically. This is the @dfn{startup fontset} and its name is
1137 @code{fontset-startup}. It does this by replacing the @var{foundry},
1138 @var{family}, @var{add_style}, and @var{average_width} fields of the
1139 font name with @samp{*}, replacing @var{charset_registry} field with
1140 @samp{fontset}, and replacing @var{charset_encoding} field with
1141 @samp{startup}, then using the resulting string to specify a fontset.
1142
1143 For instance, if you start Emacs this way,
1144
1145 @example
1146 emacs -fn "*courier-medium-r-normal--14-140-*-iso8859-1"
1147 @end example
1148
1149 @noindent
1150 Emacs generates the following fontset and uses it for the initial X
1151 window frame:
1152
1153 @example
1154 -*-*-medium-r-normal-*-14-140-*-*-*-*-fontset-startup
1155 @end example
1156
1157 With the X resource @samp{Emacs.Font}, you can specify a fontset name
1158 just like an actual font name. But be careful not to specify a fontset
1159 name in a wildcard resource like @samp{Emacs*Font}---that wildcard
1160 specification matches various other resources, such as for menus, and
1161 menus cannot handle fontsets.
1162
1163 You can specify additional fontsets using X resources named
1164 @samp{Fontset-@var{n}}, where @var{n} is an integer starting from 0.
1165 The resource value should have this form:
1166
1167 @smallexample
1168 @var{fontpattern}, @r{[}@var{charsetname}:@var{fontname}@r{]@dots{}}
1169 @end smallexample
1170
1171 @noindent
1172 @var{fontpattern} should have the form of a standard X font name, except
1173 for the last two fields. They should have the form
1174 @samp{fontset-@var{alias}}.
1175
1176 The fontset has two names, one long and one short. The long name is
1177 @var{fontpattern}. The short name is @samp{fontset-@var{alias}}. You
1178 can refer to the fontset by either name.
1179
1180 The construct @samp{@var{charset}:@var{font}} specifies which font to
1181 use (in this fontset) for one particular character set. Here,
1182 @var{charset} is the name of a character set, and @var{font} is the
1183 font to use for that character set. You can use this construct any
1184 number of times in defining one fontset.
1185
1186 For the other character sets, Emacs chooses a font based on
1187 @var{fontpattern}. It replaces @samp{fontset-@var{alias}} with values
1188 that describe the character set. For the ASCII character font,
1189 @samp{fontset-@var{alias}} is replaced with @samp{ISO8859-1}.
1190
1191 In addition, when several consecutive fields are wildcards, Emacs
1192 collapses them into a single wildcard. This is to prevent use of
1193 auto-scaled fonts. Fonts made by scaling larger fonts are not usable
1194 for editing, and scaling a smaller font is not useful because it is
1195 better to use the smaller font in its own size, which is what Emacs
1196 does.
1197
1198 Thus if @var{fontpattern} is this,
1199
1200 @example
1201 -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24
1202 @end example
1203
1204 @noindent
1205 the font specification for ASCII characters would be this:
1206
1207 @example
1208 -*-fixed-medium-r-normal-*-24-*-ISO8859-1
1209 @end example
1210
1211 @noindent
1212 and the font specification for Chinese GB2312 characters would be this:
1213
1214 @example
1215 -*-fixed-medium-r-normal-*-24-*-gb2312*-*
1216 @end example
1217
1218 You may not have any Chinese font matching the above font
1219 specification. Most X distributions include only Chinese fonts that
1220 have @samp{song ti} or @samp{fangsong ti} in @var{family} field. In
1221 such a case, @samp{Fontset-@var{n}} can be specified as below:
1222
1223 @smallexample
1224 Emacs.Fontset-0: -*-fixed-medium-r-normal-*-24-*-*-*-*-*-fontset-24,\
1225 chinese-gb2312:-*-*-medium-r-normal-*-24-*-gb2312*-*
1226 @end smallexample
1227
1228 @noindent
1229 Then, the font specifications for all but Chinese GB2312 characters have
1230 @samp{fixed} in the @var{family} field, and the font specification for
1231 Chinese GB2312 characters has a wild card @samp{*} in the @var{family}
1232 field.
1233
1234 @findex create-fontset-from-fontset-spec
1235 The function that processes the fontset resource value to create the
1236 fontset is called @code{create-fontset-from-fontset-spec}. You can also
1237 call this function explicitly to create a fontset.
1238
1239 @xref{Font X}, for more information about font naming in X.
1240
1241 @node Undisplayable Characters
1242 @section Undisplayable Characters
1243
1244 Your terminal may be unable to display some non-ASCII
1245 characters. Most non-windowing terminals can only use a single
1246 character set (use the variable @code{default-terminal-coding-system}
1247 (@pxref{Specify Coding}) to tell Emacs which one); characters which
1248 can't be encoded in that coding system are displayed as @samp{?} by
1249 default.
1250
1251 Windowing terminals can display a broader range of characters, but
1252 you may not have fonts installed for all of them; characters that have
1253 no font appear as a hollow box.
1254
1255 If you use Latin-1 characters but your terminal can't display
1256 Latin-1, you can arrange to display mnemonic ASCII sequences
1257 instead, e.g.@: @samp{"o} for o-umlaut. Load the library
1258 @file{iso-ascii} to do this.
1259
1260 @vindex latin1-display
1261 If your terminal can display Latin-1, you can display characters
1262 from other European character sets using a mixture of equivalent
1263 Latin-1 characters and ASCII mnemonics. Use the Custom option
1264 @code{latin1-display} to enable this. The mnemonic ASCII
1265 sequences mostly correspond to those of the prefix input methods.
1266
1267 @node Single-Byte Character Support
1268 @section Single-byte Character Set Support
1269
1270 @cindex European character sets
1271 @cindex accented characters
1272 @cindex ISO Latin character sets
1273 @cindex Unibyte operation
1274 The ISO 8859 Latin-@var{n} character sets define character codes in
1275 the range 0240 to 0377 octal (160 to 255 decimal) to handle the
1276 accented letters and punctuation needed by various European languages
1277 (and some non-European ones). If you disable multibyte characters,
1278 Emacs can still handle @emph{one} of these character codes at a time.
1279 To specify @emph{which} of these codes to use, invoke @kbd{M-x
1280 set-language-environment} and specify a suitable language environment
1281 such as @samp{Latin-@var{n}}.
1282
1283 For more information about unibyte operation, see @ref{Enabling
1284 Multibyte}. Note particularly that you probably want to ensure that
1285 your initialization files are read as unibyte if they contain non-ASCII
1286 characters.
1287
1288 @vindex unibyte-display-via-language-environment
1289 Emacs can also display those characters, provided the terminal or font
1290 in use supports them. This works automatically. Alternatively, if you
1291 are using a window system, Emacs can also display single-byte characters
1292 through fontsets, in effect by displaying the equivalent multibyte
1293 characters according to the current language environment. To request
1294 this, set the variable @code{unibyte-display-via-language-environment}
1295 to a non-@code{nil} value.
1296
1297 @cindex @code{iso-ascii} library
1298 If your terminal does not support display of the Latin-1 character
1299 set, Emacs can display these characters as ASCII sequences which at
1300 least give you a clear idea of what the characters are. To do this,
1301 load the library @code{iso-ascii}. Similar libraries for other
1302 Latin-@var{n} character sets could be implemented, but we don't have
1303 them yet.
1304
1305 @findex standard-display-8bit
1306 @cindex 8-bit display
1307 Normally non-ISO-8859 characters (decimal codes between 128 and 159
1308 inclusive) are displayed as octal escapes. You can change this for
1309 non-standard ``extended'' versions of ISO-8859 character sets by using the
1310 function @code{standard-display-8bit} in the @code{disp-table} library.
1311
1312 There are several ways you can input single-byte non-ASCII
1313 characters:
1314
1315 @itemize @bullet
1316 @cindex 8-bit input
1317 @item
1318 If your keyboard can generate character codes 128 (decimal) and up,
1319 representing non-ASCII characters, you can type those character codes
1320 directly.
1321
1322 On a windowing terminal, you should not need to do anything special to
1323 use these keys; they should simply work. On a text-only terminal, you
1324 should use the command @code{M-x set-keyboard-coding-system} or the
1325 Custom option @code{keyboard-coding-system} to specify which coding
1326 system your keyboard uses (@pxref{Specify Coding}). Enabling this
1327 feature will probably require you to use @kbd{ESC} to type Meta
1328 characters; however, on a Linux console or in @code{xterm}, you can
1329 arrange for Meta to be converted to @kbd{ESC} and still be able type
1330 8-bit characters present directly on the keyboard or using
1331 @kbd{Compose} or @kbd{AltGr} keys. @xref{User Input}.
1332
1333 @item
1334 You can use an input method for the selected language environment.
1335 @xref{Input Methods}. When you use an input method in a unibyte buffer,
1336 the non-ASCII character you specify with it is converted to unibyte.
1337
1338 @kindex C-x 8
1339 @cindex @code{iso-transl} library
1340 @cindex compose character
1341 @cindex dead character
1342 @item
1343 For Latin-1 only, you can use the
1344 key @kbd{C-x 8} as a ``compose character'' prefix for entry of
1345 non-ASCII Latin-1 printing characters. @kbd{C-x 8} is good for
1346 insertion (in the minibuffer as well as other buffers), for searching,
1347 and in any other context where a key sequence is allowed.
1348
1349 @kbd{C-x 8} works by loading the @code{iso-transl} library. Once that
1350 library is loaded, the @key{ALT} modifier key, if you have one, serves
1351 the same purpose as @kbd{C-x 8}; use @key{ALT} together with an accent
1352 character to modify the following letter. In addition, if you have keys
1353 for the Latin-1 ``dead accent characters,'' they too are defined to
1354 compose with the following character, once @code{iso-transl} is loaded.
1355 Use @kbd{C-x 8 C-h} to list the available translations as mnemonic
1356 command names.
1357
1358 @item
1359 @cindex @code{iso-acc} library
1360 @cindex ISO Accents mode
1361 @findex iso-accents-mode
1362 @cindex Latin-1, Latin-2 and Latin-3 input mode
1363 For Latin-1, Latin-2 and Latin-3, @kbd{M-x iso-accents-mode} enables
1364 a minor mode that works much like the @code{latin-1-prefix} input
1365 method, but does not depend on having the input methods installed. This
1366 mode is buffer-local. It can be customized for various languages with
1367 @kbd{M-x iso-accents-customize}.
1368 @end itemize